JP2011033870A - Image processing apparatus, image processing method and program - Google Patents

Abstract

A plurality of images are appropriately scroll-displayed according to operation contents.
A drawing unit 141 draws one image (reference image) of images representing each content in an image memory 300 for each content in a storage unit 200. The drawing unit 141 draws the image memory 300 by arranging a predetermined number of images (neighboring images) that are located before and after the reference image on the time axis and are continuous from the reference image on the reference image according to the time axis. The display control unit 142 causes the display panel 191 to display an image included in a predetermined range among the images drawn in the image memory 300. When an instruction operation for scroll display is accepted, the control unit 160 changes the position of the predetermined range based on the instruction operation. In addition, when the change satisfies a certain condition, the reference image is changed, and neighboring images related to the changed reference image are arranged on the reference image along the time axis and are drawn on the drawing unit 141.
[Selection] Figure 3

Description

  The present invention relates to an image processing apparatus, and more particularly to an image processing apparatus and an image processing method for displaying an image, and a program for causing a computer to execute the method.

  2. Description of the Related Art In recent years, imaging devices such as digital still cameras that capture images of subjects such as people and landscapes, generate image data, and record the image data as image files have become widespread. In addition, an image processing apparatus that can sequentially reproduce each image file recorded in this way by a user operation has been proposed.

  For example, there has been proposed an imaging apparatus capable of moving reproduced images displayed in chronological order in a horizontal direction by animation in a display screen by a user operating a cross key (for example, Patent Documents). 1).

Japanese Patent Laying-Open No. 2005-328243 (FIG. 6)

  In the above-described conventional technology, when an image stored in an external recording medium is reproduced, the image to be reproduced is acquired from the external recording medium, and the acquired image is stored in the internal recording medium. The displayed image is displayed as a reproduced image. Also in the case of scrolling the image on the screen, the image to be played back acquired from the external recording medium is held in the internal recording medium, and the held image is scrolled and displayed as a playback image by animation. .

  As described above, when the image is scroll-displayed by animation in the screen, it is assumed that drawing processing of the reproduced image being scroll-displayed on the internal recording medium is frequently performed. However, when the drawing process of the reproduced image scroll-displayed by the animation is frequently performed, there is a possibility that the scroll display according to the user operation cannot be appropriately performed.

  The present invention has been made in view of such a situation, and an object of the present invention is to appropriately scroll-display a plurality of images according to operation contents.

  The present invention has been made to solve the above-described problems, and a first aspect of the present invention relates to one of the plurality of images for a plurality of images whose order is specified based on a predetermined rule. Rendering as a reference image in an image memory, a predetermined number of images positioned before the reference image in the order and continuing from the reference image, and a predetermined number of images positioned after the reference image in the order and continuing from the reference image A drawing unit that draws each of a plurality of images as a neighborhood image related to the reference image in the order according to the order and draws the image in the image memory, and an image included in a predetermined range among the images drawn in the image memory. When a display control unit to be displayed on the display unit and an instruction operation for changing the display state of the image on the display unit are received, the above-described operation is performed based on the instruction operation. When the position of the range is changed, and the change satisfies a certain condition, the reference image is changed to another image among the images drawn in the image memory, and the neighborhood image related to the changed reference image And an image processing method, and a program for causing a computer to execute the method. Accordingly, when an instruction operation for changing the display state of the image on the display unit is accepted, the position of the predetermined range is changed based on the instruction operation. When the change satisfies a certain condition, the reference image And the neighboring images related to the changed reference image are arranged and drawn on the changed reference image according to the order.

  In the first aspect, when the instruction operation is received, the control unit changes the number of the neighboring images related to the changed reference image according to the type of the instruction operation, and performs the drawing. You may make it draw in a part. As a result, when an instruction operation is accepted, the number of neighboring images related to the changed reference image is changed and drawn according to the type of the instruction operation.

  In the first aspect, the drawing unit draws the reference image and the neighboring image in a specific direction according to the order in the image drawing area in the image memory, and the control unit changes the reference image. In the case where all of the neighboring images related to the changed reference image cannot be drawn side by side in the specific direction in the image drawing area according to the order, the neighboring images that cannot be drawn are set in the image drawing area according to the order. You may make it draw on the other edge part of a specific direction. As a result, if all of the neighboring images related to the changed reference image cannot be drawn side by side in a specific direction in the image drawing area according to the order, the neighboring images that cannot be drawn are changed to other specific directions in the image drawing area according to the order. This brings about the effect of drawing at the end of the.

  In the first aspect, the drawing unit may identify the image that is the same as the reference image or the neighboring image drawn at one end of the specific direction in the image drawing area in the image drawing area. When the predetermined range changed based on the instruction operation reaches the end in any one of the specific directions in the image drawing area, the control unit draws at the other end of the direction. You may make it move a range to the other edge part of the said specific direction in the said image drawing area | region. Thereby, when the predetermined range changed based on the instruction operation reaches one end of the specific direction in the image drawing area, the predetermined range is set to the other end of the specific direction in the image drawing area. The effect of moving is brought about.

  In the first aspect, the drawing unit may have the other end in the specific direction in the image drawing area in which the same image as the reference image or the neighboring image drawn on the one end is drawn. The drawing area of the part may be substantially the same as the maximum size of the predetermined range. As a result, the drawing area at the other end in the specific direction in the image drawing area where the same image as the reference image or the neighboring image drawn at one end in the specific direction in the image drawing area is drawn within the predetermined range. It brings about the effect of making it approximately the same as the maximum size.

  In the first aspect, when the reference image is changed, the control unit draws only the neighboring image that is not drawn in the image memory among the neighboring images related to the changed reference image. You may make it make a part newly draw. As a result, when the reference image is changed, only the vicinity image that is not drawn in the image memory among the vicinity images related to the changed reference image is newly drawn.

  In addition, in the first aspect, an operation receiving unit that receives, as the instruction operation, an operation content for scroll-displaying the plurality of images on the display unit is further provided, and the display control unit is configured based on the instruction operation. Each image drawn in the image memory by moving a predetermined range may be scroll-displayed on the display unit. Thereby, based on the operation content which scroll-displays a several image on a display part, the effect | action that a predetermined range is moved and each image drawn on the image memory is scroll-displayed on a display part is brought about.

  In the first aspect, the plurality of images may be images representing content, and the drawing unit may specify the order based on attribute information associated with the content. This brings about the effect | action of specifying the order for arranging a reference | standard image and a near image based on the attribute information linked | related with content.

  Further, in the first aspect, the plurality of images are thumbnail images representing content, and the drawing unit displays the reference image and the neighborhood image according to an arrangement for displaying a content selection screen for selecting the content. The display control unit includes a plurality of thumbnail images of the thumbnail images drawn in the image memory and includes the plurality of thumbnail images included in the predetermined range. You may make it display a content selection screen on the said display part. As a result, the reference image and the neighboring image are drawn in the order according to the arrangement for displaying the content selection screen, and a plurality of thumbnail images of the thumbnail images drawn in the image memory are included in the predetermined range. The content selection screen including a plurality of thumbnail images included in the predetermined range is displayed.

  According to the present invention, it is possible to achieve an excellent effect that a plurality of images can be appropriately scroll-displayed according to the operation content.

1 is a perspective view illustrating an appearance of an imaging device 100 according to a first embodiment of the present invention. 1 is a block diagram illustrating an internal configuration example of an imaging apparatus 100 according to a first embodiment of the present invention. It is a block diagram which shows the function structural example regarding the drawing control of the imaging device 100 in the 1st Embodiment of this invention. It is a figure which shows typically the image file memorize | stored in the memory | storage part 200 in the 1st Embodiment of this invention. It is a figure which shows typically the drawing area | region of the display target image in the image memory 300 in the 1st Embodiment of this invention. It is a figure which shows typically the image showing the content memorize | stored in the memory | storage part 200 in the 1st Embodiment of this invention. It is a figure which shows the example of a display in the case of changing the display state of the image currently displayed on the input-output panel 190 in the 1st Embodiment of this invention by flick operation. 4 is a diagram schematically showing a drawing method in the image memory 300 by the drawing unit 141 and a display method of an image drawn in the image memory 300 by the display control unit 142 according to the first embodiment of the present invention. FIG. 4 is a diagram schematically showing a drawing method in the image memory 300 by the drawing unit 141 and a display method of an image drawn in the image memory 300 by the display control unit 142 according to the first embodiment of the present invention. FIG. It is a figure which shows the example of a display in the case of changing the display state of the image currently displayed on the input-output panel 190 in the 1st Embodiment of this invention by flick operation. 4 is a diagram schematically showing a drawing method in the image memory 300 by the drawing unit 141 and a display method of an image drawn in the image memory 300 by the display control unit 142 according to the first embodiment of the present invention. FIG. 4 is a diagram schematically showing a drawing method in the image memory 300 by the drawing unit 141 and a display method of an image drawn in the image memory 300 by the display control unit 142 according to the first embodiment of the present invention. FIG. 4 is a diagram schematically showing a drawing method in the image memory 300 by the drawing unit 141 and a display method of an image drawn in the image memory 300 by the display control unit 142 according to the first embodiment of the present invention. FIG. It is a figure which shows the example of a display in the case of changing the display state of the image currently displayed on the input / output panel 190 in the 1st Embodiment of this invention by long press image feed operation. 4 is a diagram schematically showing a drawing method in the image memory 300 by the drawing unit 141 and a display method of an image drawn in the image memory 300 by the display control unit 142 according to the first embodiment of the present invention. FIG. 4 is a diagram schematically showing a drawing method in the image memory 300 by the drawing unit 141 and a display method of an image drawn in the image memory 300 by the display control unit 142 according to the first embodiment of the present invention. FIG. 4 is a diagram schematically showing a drawing method in the image memory 300 by the drawing unit 141 and a display method of an image drawn in the image memory 300 by the display control unit 142 according to the first embodiment of the present invention. FIG. 4 is a diagram schematically showing a drawing method in the image memory 300 by the drawing unit 141 and a display method of an image drawn in the image memory 300 by the display control unit 142 according to the first embodiment of the present invention. FIG. 4 is a diagram schematically showing a drawing method in the image memory 300 by the drawing unit 141 and a display method of an image drawn in the image memory 300 by the display control unit 142 according to the first embodiment of the present invention. FIG. It is a figure which shows the example of a display in the case of changing the display state of the image currently displayed on the input-output panel 190 in the 1st Embodiment of this invention by drag operation. 4 is a diagram schematically showing a drawing method in the image memory 300 by the drawing unit 141 and a display method of an image drawn in the image memory 300 by the display control unit 142 according to the first embodiment of the present invention. FIG. 4 is a diagram schematically showing a drawing method in the image memory 300 by the drawing unit 141 and a display method of an image drawn in the image memory 300 by the display control unit 142 according to the first embodiment of the present invention. FIG. It is a figure which shows typically the drawing area | region of the display target image in the image memory 300 in the 1st Embodiment of this invention. It is a figure which shows typically the drawing method to the image memory 300 by the drawing part 141 in the 1st Embodiment of this invention. It is a figure which shows typically the drawing method to the image memory 300 by the drawing part 141 in the 1st Embodiment of this invention. It is a flowchart which shows the process sequence of the content reproduction process by the imaging device 100 in the 1st Embodiment of this invention. It is a flowchart which shows the scroll process in the process sequence of the content reproduction process by the imaging device 100 in the 1st Embodiment of this invention. It is a flowchart which shows the drag operation scroll process in the process sequence of the content reproduction process by the imaging device 100 in the 1st Embodiment of this invention. It is a flowchart which shows the extraction range edge part movement process in the process sequence of the content reproduction process by the imaging device 100 in the 1st Embodiment of this invention. It is a flowchart which shows the flick operation scroll process in the process sequence of the content reproduction process by the imaging device 100 in the 1st Embodiment of this invention. It is a flowchart which shows the long press image feed operation scroll process in the process sequence of the content reproduction process by the imaging device 100 in the 1st Embodiment of this invention. It is a figure which shows typically the drawing area | region of the display target image in the image memory 300 in the 2nd Embodiment of this invention. It is a figure which shows typically the drawing method to the image memory 300 by the drawing part 141 in the 2nd Embodiment of this invention, and the display method of the image drawn to the image memory 300 by the display control part 142. FIG. It is a figure which shows typically the drawing area | region of the display target image in the image memory 300 in the 3rd Embodiment of this invention. It is a figure which shows typically the drawing method to the image memory 300 by the drawing part 141 in the 3rd Embodiment of this invention, and the display method of the image drawn to the image memory 300 by the display control part 142. FIG. It is a figure which shows typically the drawing area | region of the display target image in the image memory 300 in the 4th Embodiment of this invention. It is a figure which shows typically the drawing method to the image memory 300 by the drawing part 141 in the 4th Embodiment of this invention, and the display method of the image drawn to the image memory 300 by the display control part 142. FIG.

Hereinafter, modes for carrying out the present invention (hereinafter referred to as embodiments) will be described. The description will be made in the following order.
1. First embodiment (drawing control and display control: an example in which an image representing content is scroll-displayed)
2. Second embodiment (drawing control and display control: an example in which a margin area is provided at both ends of a loop area)
3. Third embodiment (drawing control and display control: an example in which the margin area is omitted)
4). Fourth embodiment (drawing control and display control: example of scrolling display of index screen)

<1. First Embodiment>
[External configuration example of imaging device]
FIG. 1 is a perspective view showing an appearance of the imaging apparatus 100 according to the first embodiment of the present invention. FIG. 1A is a perspective view showing an external appearance of the imaging apparatus 100 on the front side (that is, the surface on which the lens unit 111 facing the subject) is provided. FIG. 1B is a perspective view showing the appearance of the imaging device 100 on the back side (that is, the side on which the input / output panel 190 directed to the photographer is provided).

  The imaging apparatus 100 includes a lens unit 111, a shutter button 181, and an input / output panel 190. The imaging device 100 is realized by a digital still camera, a digital video camera, or the like that can capture an image of a subject, generate image data, record the image data as a still image file or a moving image file, and display the image data. . The imaging device 100 is an example of an image processing device described in the claims. Note that the imaging apparatus 100 includes other operation members such as a power switch and a mode change switch, but illustration and description thereof are omitted here. Note that some or all of the plurality of lenses constituting the lens unit 111 are built in the housing of the imaging apparatus 100.

  The lens unit 111 is an optical system including a plurality of lenses that collect light from a subject, a diaphragm, and the like.

  The shutter button 181 is a button pressed by the photographer when recording image data (captured image) generated by capturing an image of an object as an image file.

  The input / output panel 190 displays various images and receives an operation input from the user by detecting a contact operation on the input / output panel 190.

[Example of internal configuration of imaging device]
FIG. 2 is a block diagram showing an example of the internal configuration of the imaging apparatus 100 according to the first embodiment of the present invention. The imaging apparatus 100 includes a lens unit 111, a motor driver 112, an actuator 113, an imaging element 114, a TG (Timing Generator) 115, an analog signal processing unit 120, and an A / D (Analog / Digital) conversion unit 130. With. In addition, the imaging apparatus 100 includes an image processing unit 140, a storage unit 200, a control unit 160, a nonvolatile memory 171, a ROM (Read Only Memory) 172, and a RAM (Random Access Memory) 173. Further, the imaging apparatus 100 includes an operation unit 180, a GPS signal processing unit 185, and an input / output panel 190. The lens unit 111 and the input / output panel 190 are the same as those shown in FIG.

  The lens unit 111 is an optical system that includes a zoom lens for continuously changing the focal length, a focus lens for adjusting focus, a diaphragm, and the like, and collects light from the subject and outputs it to the image sensor 114. . The lens unit 111 is mechanically connected to an actuator 113 for moving a zoom lens, a focus lens, etc., adjusting a diaphragm, and the like.

  The motor driver 112 is a motor driver that drives the actuator 113 based on the control of the control unit 160.

  The actuator 113 is driven based on the control of the motor driver 112, thereby adjusting the diaphragm constituting the lens unit 111 and moving the focus lens constituting the lens unit 111.

  The image sensor 114 is an image sensor disposed on the optical path of light from a subject incident through the lens unit 111. The image sensor 114 operates according to a timing signal supplied from the TG 115, so that the incident subject image is input. To form an image signal. That is, the image sensor 114 generates and generates an image signal (analog signal) corresponding to the amount of received light by receiving light from the subject incident through the lens unit 111 and performing photoelectric conversion. The obtained image signal is supplied to the analog signal processing unit 120. As the image sensor 114, for example, a solid-state image sensor such as a charge coupled device (CCD) type or a complementary metal oxide semiconductor (CMOS) type can be used.

  The TG 115 is a timing generator that supplies a timing signal to the image sensor 114 based on the control of the control unit 160. The exposure time in the image sensor 114 is controlled by this timing signal.

  The analog signal processing unit 120 performs analog signal processing such as amplification on the image signal (analog signal) supplied from the image sensor 114 based on the control of the control unit 160, and this analog signal processing is performed. The image signal is supplied to the A / D converter 130.

  The A / D conversion unit 130 performs A / D conversion on the image signal (analog signal) supplied from the analog signal processing unit 120 based on the control of the control unit 160, and an image obtained by A / D conversion. A signal (digital signal) is supplied to the image processing unit 140.

  The image processing unit 140 performs various types of image processing based on the control of the control unit 160. For example, the image processing unit 140 performs digital signal processing such as noise removal processing on the image signal (digital signal) supplied from the A / D conversion unit 130, and outputs the image signal (image data) subjected to the digital signal processing. This is supplied to the input / output panel 190. As described above, the image processing unit 140 supplies the image signal subjected to the digital signal processing to the input / output panel 190, and displays an image corresponding to the image signal (a so-called through image). Also, the image processing unit 140 generates an image of a focus frame (AF frame) used for focus control based on the control of the control unit 160, and supplies the image to the input / output panel 190 for display.

  Further, the image processing unit 140 compresses the image signal supplied from the A / D conversion unit 130 by a predetermined encoding method, and supplies the compressed image signal to the storage unit 200 to be recorded as an image file. . As this encoding method, for example, a JPEG (Joint Photographic Experts Group) method can be used. The image processing unit 140 expands the compressed image data recorded in the storage unit 200 and supplies each image generated based on the expanded image data to the input / output panel 190 for display. . In addition, the image processing unit 140 acquires image data and information recorded in the storage unit 200 and supplies the acquired image data to the control unit 160.

  The storage unit 200 is a recording device that stores the image signal supplied from the image processing unit 140 as a still image file (still image content) or a moving image file (moving image content). The storage unit 200 stores each piece of information supplied from the image processing unit 140. In addition, the storage unit 200 supplies the stored file and each information to the image processing unit 140. As the storage unit 200, for example, a removable recording medium such as a disc such as a DVD (Digital Versatile Disc) or a semiconductor memory such as a memory card can be used. In addition, the storage unit 200 may be built in the imaging apparatus 100 or may be detachable from the imaging apparatus 100.

  The control unit 160 controls each unit constituting the imaging apparatus 100 by executing a program recorded in the ROM 172. In addition, the control unit 160 performs various processes according to a user operation on the touch panel 192 or an operation signal output from the operation unit 180. The control unit 160 is realized by, for example, a CPU (Central Processing Unit). The control performed by the control unit 160 will be described in detail with reference to FIG.

  The non-volatile memory 171 is a non-volatile memory that stores data (such as various setting information) that needs to be retained even when the power of the imaging apparatus 100 is turned off. As the nonvolatile memory 171, for example, an EEPROM (Electrically Erasable Programmable Read Only Memory) or a flash memory can be used.

  The ROM 172 is a memory that stores a program executed by the control unit 160 and data necessary for the control unit 160 to execute the program.

  The RAM 173 is a memory that temporarily stores programs and data necessary for the control unit 160 to perform various processes, and is used as a work area for an execution program of the control unit 160.

  The operation unit 180 is an operation reception unit that receives operation details operated by the user, and supplies an operation signal corresponding to the received operation content to the control unit 160. The operation unit 180 corresponds to, for example, the shutter button 181 illustrated in FIG.

  The input / output panel 190 includes a display panel 191 and a touch panel 192. The display panel 191 is a display panel that displays an image corresponding to the image data based on the image data supplied from the image processing unit 140. For example, an image captured by the image sensor 114 is displayed on the input / output panel 190 (so-called through image display). Various menu screens and various images are displayed on the input / output panel 190. As the display panel 191, for example, an LCD (Liquid Crystal Display), an organic EL (Electro Luminescence) panel, or the like can be used.

  The touch panel 192 is a touch panel that is placed on the display panel 191 so as to transmit the screen of the display panel 191 and receives an operation input from the user by detecting an object that contacts the display surface. When the user presses a desired position on the operation screen displayed on the display panel 191 by touching a finger or the like, the touch panel 192 detects a coordinate of the pressed position, and an operation signal corresponding to the detected coordinate. Is output to the control unit 160. And the control part 160 will perform a predetermined | prescribed process based on the acquired operation signal, if the operation signal is acquired. As the touch panel 192, for example, a touch panel that converts contact on the display surface into an electrical signal using a dedicated sensing device and outputs the converted electrical signal to the control unit 160 can be used. Further, as the touch panel 192, for example, an optical sensor type touch panel capable of detecting an object close to or in contact with the display surface may be used.

  The GPS signal processing unit 185 calculates position information based on a GPS signal received by a GPS signal receiving antenna (not shown), and outputs the calculated position information to the control unit 160. The calculated position information includes each data regarding the position such as latitude, longitude, altitude at the time of imaging.

  Here, an imaging operation using the imaging apparatus 100 will be described. For example, when the shutter button 181 shown in FIG. 1 is pressed by the user, a release signal is supplied from the operation unit 180 to the control unit 160. When the release signal is supplied to the control unit 160, the control unit 160 controls the image processing unit 140 to compress the image signal supplied from the A / D conversion unit 130 to the image processing unit 140 and compress the compressed image signal. The recorded image signal is recorded in the storage unit 200 as an image file. When the image file is recorded, time information, position information (GPS information) calculated by the GPS signal processing unit 185, a thumbnail image, and a screen nail image are recorded as attached information in the image file. This image file will be described in detail with reference to FIG.

[Functional configuration example of imaging device]
FIG. 3 is a block diagram illustrating a functional configuration example related to drawing control and display control of the imaging apparatus 100 according to the first embodiment of the present invention. The imaging apparatus 100 includes a drawing unit 141, a display control unit 142, a control unit 160, a display panel 191, a storage unit 200, an operation reception unit 210, and an image memory 300. The drawing unit 141, the display control unit 142, and the image memory 300 correspond to the image processing unit 140 shown in FIG. Moreover, since the control part 160, the display panel 191, and the memory | storage part 200 are the same as what is shown in FIG. 2, it attaches | subjects and demonstrates the same code | symbol.

  The storage unit 200 stores content such as a still image file and a moving image file, and supplies the stored content to the drawing unit 141. The content stored in the storage unit 200 will be described in detail with reference to FIG.

  The operation reception unit 210 is an operation reception unit that receives an instruction operation for displaying each image on the display panel 191, and outputs an operation content corresponding to the received instruction operation to the control unit 160. For example, the operation accepting unit 210 accepts an operation content for scrolling and displaying an image representing content on the display panel 191. As this operation content, for example, a drag operation, a long press image feed operation, and a flick operation are accepted. The operation reception unit 210 corresponds to the operation unit 180 and the touch panel 192 illustrated in FIG.

  The drawing unit 141 acquires content stored in the storage unit 200 based on the control of the control unit 160 and draws each image in the image memory 300 based on the acquired content. Specifically, the drawing unit 141 decodes the content stored in the storage unit 200, acquires a display image (for example, a screen nail image) from the decoded content, and displays the acquired image as an image. Drawing in the memory 300. For example, the drawing unit 141 draws one image in the image memory 300 as a reference image for a plurality of images representing content. In addition, the drawing unit 141 draws the neighborhood images related to the reference image in the image memory 300 by arranging them in the reference image along the time axis. Here, the neighborhood image is an image corresponding to a predetermined number of contents that are located in front of the content corresponding to the reference image on the time axis and are continuous from the content. Further, the neighborhood image is an image that is located after the content corresponding to the reference image on the time axis and corresponds to a predetermined number of contents that are continuous from the content. These drawing methods will be described in detail with reference to FIGS.

  The image memory 300 is a drawing buffer that holds the image drawn by the drawing unit 141, and supplies the drawn image to the display control unit 142. The drawing area in the image memory 300 will be described in detail with reference to FIGS.

  Based on the control of the control unit 160, the display control unit 142 displays, on the display panel 191, images included in the extraction range (for example, the extraction range 350 shown in FIG. 8 and the like) among the images drawn in the image memory 300. It is what is displayed. This display control will be described in detail with reference to FIGS.

  The control unit 160 controls the drawing unit 141 and the display control unit 142 based on the operation content from the operation receiving unit 210. For example, when an instruction operation (for example, a scroll operation) for changing the display state of an image on the display panel 191 is received, the control unit 160 changes the position of the extraction range based on the instruction operation. In addition, when the change of the extraction range satisfies a certain condition, the control unit 160 changes the reference image to another image among the images drawn in the image memory 300, and the neighborhood related to the reference image after the change. The drawing unit 141 draws the images side by side on the changed reference image according to the time axis. In this case, only the neighboring images that are not drawn in the image memory 300 among the neighboring images related to the changed reference image are newly drawn by the drawing unit 141.

[Image file configuration example]
FIG. 4 is a diagram schematically showing an image file stored in the storage unit 200 according to the first embodiment of the present invention. The example shown in FIG. 4 schematically shows the file structure of a still image file recorded by the JPEG method.

  The still image file 211 is a still image file recorded by the JPEG method, and is composed of attached information 212 and image information 217. The image information 217 is, for example, image data (so-called main image) generated by the image sensor 114 and compressed by the image processing unit 140 when the user presses the shutter button 181 shown in FIG.

  The attached information 212 is attribute information regarding the still image file 211, and includes, for example, a thumbnail image 213, a screen nail image 214, position information 215, and date / time information 216.

  The thumbnail image 213 is a reduced image corresponding to the image information 217, for example, an image displayed on an index screen for selecting an image file stored in the storage unit 200.

  The screen nail image 214 is a display image corresponding to the image information 217, for example, an image displayed when scrolling the image file stored in the storage unit 200.

  The position information 215 is GPS information calculated by the GPS signal processing unit 185, and includes position information such as latitude, longitude, and altitude.

  The date / time information 216 is date / time information including the time when the image information 217 was captured (imaging time).

[Drawing area example of display target image]
FIG. 5 is a diagram schematically showing a drawing area of a display target image in the image memory 300 according to the first embodiment of the present invention. In the first embodiment of the present invention, when scrolling and displaying an image (for example, a screen nail image) representing content stored in the storage unit 200 by a user operation or the like, the scroll is performed on the image memory 300. A relatively long drawing area is secured in the direction. For example, as shown in FIG. 5, an effective area 310 is secured as a drawing area of the display target image on the image memory 300.

  The effective area 310 includes a loop area 311 and a margin area 312.

  The loop region 311 includes an image to be displayed (reference image), two images located before the reference image on the time axis and continuous from the reference image, and a reference image positioned after the reference image on the time axis. This is an area where two consecutive images are drawn. In the loop area 311, for example, screen nail images of each content are drawn in the image drawing areas 321 to 325. Further, black frame regions 331 to 335 are provided around the image drawing regions 321 to 325, respectively. The black frame regions 331 to 335 are black frames that are displayed around the image representing the content when the images drawn in the image drawing regions 321 to 325 are scroll-displayed by a user operation, for example. Note that these drawing method and display method will be described in detail with reference to FIGS.

  The margin area 312 is an area where the same image as the image drawn in the margin synchronization area 313 in the loop area 311 is drawn. Specifically, the same image as the image drawn in the image drawing area 321 in the loop area 311 is drawn in the image drawing area 326. In addition, the same image as a part of the image drawn in the image drawing area 322 in the loop area 311 (a part on the left side in the left-right direction) is drawn in the image drawing area 327. Similarly to the loop region 311, black frame regions 336 and 337 are provided around the image drawing regions 326 and 327 in the adhesive margin region 312. Here, the margin area 312 is set to have a size larger than the extraction range (for example, the extraction range 350 after enlargement shown in FIGS. 16 to 18 and the like).

[Image example showing content]
FIG. 6 is a diagram schematically showing an image representing the content stored in the storage unit 200 according to the first embodiment of the present invention. An image 400 to an image 410 illustrated in FIG. 6 are screen nail images or thumbnail images included in a still image file recorded by the imaging apparatus 100, for example. In FIG. 6, only simplified images are shown in the rectangles corresponding to the images 400 to 410 for ease of explanation. In FIG. 6, the images 400 to 410 are shown in time series based on the date / time information (shooting time) recorded in association with each of the images 400 to 410.

[Example of scroll display by flick operation]
FIG. 7 is a diagram illustrating a display example when the display state of the image displayed on the input / output panel 190 according to the first embodiment of the present invention is changed by a flick operation. FIG. 7A shows an example of the display state before the change, and FIG. 7B shows an example of the display state after the change. In this example, in the display state shown in FIG. 7A (the state where the image 402 is displayed on the input / output panel 190), the user performs a flick operation using the finger 890 to scroll the image. Indicates. Also, an example is shown in which the display state shown in FIG. 7B (the state in which the image 404 is displayed on the input / output panel 190) is displayed after the scroll display of the image by the flick operation. Here, the flick operation means an operation in which a finger is lightly touched by a target direction and a moving amount while the finger is in contact with the display surface of the input / output panel 190. A flick operation may be performed using an operation member such as a mouse.

  For example, when a desired content is selected from the content stored in the storage unit 200 and played back, the user displays the content selection screen (for example, the index screen 730 shown in FIG. 37B) on the input / output panel. 190 is displayed. On this content selection screen, for example, thumbnail images for selecting content stored in the storage unit 200 are displayed in a list. Then, by selecting a thumbnail image displayed as a list, it is possible to reproduce the content corresponding to the selected thumbnail image. Here, the instruction operation for displaying the content selection screen and the selection operation for selecting the thumbnail image may be performed by a touch operation on the input / output panel 190 or may be performed by an operation input from the operation unit 180. . By selecting in this way, the image 402 can be displayed on the input / output panel 190 as shown in FIG.

  Subsequently, in a state where the image 402 is displayed on the input / output panel 190, the user performs a flick operation in the arrow 891 direction with the finger 890 on the display surface of the input / output panel 190 as shown in FIG. . This flick operation is performed with an operation direction and an operation amount for displaying the image 404. Thus, when a flick operation is performed, the display state on the input / output panel 190 transitions from the image 402 to the image 404, and the images 402 to 404 are scroll-displayed by animation. After the scroll display, an image 404 is displayed on the input / output panel 190 as shown in FIG. The transition from the image 402 to the image 404 in the input / output panel 190 will be described in detail with reference to FIGS.

  8 and 9 schematically illustrate a drawing method on the image memory 300 by the drawing unit 141 and a display method of an image drawn on the image memory 300 by the display control unit 142 according to the first embodiment of the present invention. FIG. The example shown in FIGS. 8 and 9 is an example corresponding to FIG. 7, and the image 404 is displayed on the input / output panel 190 from the state where the image 402 is displayed on the input / output panel 190 by the flick operation by the user. This is an example of changing to a state.

  FIG. 8A schematically shows the relationship between the drawing state of the image memory 300 and the display state of the input / output panel 190 when the image 402 is displayed on the input / output panel 190.

  For example, when an instruction operation for displaying a desired image on the input / output panel 190 is performed by a user operation, the drawing unit 141 transmits content corresponding to an image (reference image) to be displayed from the storage unit 200. get. Then, the drawing unit 141 draws a screen nail image included in the acquired content in the image memory 300. Further, along with the drawing of the reference image, the drawing unit 141 obtains, from the storage unit 200, two pieces of content that are located in front of the content corresponding to the reference image on the time axis and that are continuous from the content. Further, the drawing unit 141 obtains, from the storage unit 200, two contents that are located after the content corresponding to the reference image on the time axis and that are continuous from the content. Then, the drawing unit 141 draws a screen nail image included in each acquired content in the image memory 300.

  Specifically, as illustrated in FIG. 8A, the drawing unit 141 draws an image 402 as a reference image in the image drawing area 323 of the loop area 311. In addition, the drawing unit 141 draws an image 401 corresponding to content adjacent to the content corresponding to the reference image and positioned adjacent to the content corresponding to the reference image (image 402) in the image drawing area 322 on the time axis. . In addition, the drawing unit 141 draws the image 400 corresponding to the content adjacent to the content corresponding to the image 401 located in front of the content corresponding to the reference image on the time axis in the image drawing area 321. In addition, the drawing unit 141 draws an image 403 corresponding to the content adjacent to the content corresponding to the reference image (image 402) on the time axis and adjacent to the content corresponding to the reference image in the image drawing area 324. In addition, the drawing unit 141 draws an image 404 corresponding to content adjacent to the content corresponding to the image 403 in the image drawing area 325 that is located after the content corresponding to the reference image on the time axis.

  That is, the drawing unit 141 draws the images 400 to 404 in time series in the image drawing areas 321 to 325 of the loop area 311.

  The drawing unit 141 draws the same image as the image drawn in the image drawing area 321 in the loop area 311 in the image drawing area 326 in the glue margin area 312. The drawing unit 141 draws the same image as a part of the image drawn in the image drawing area 322 in the loop area 311 in the image drawing area 327 in the margin area 312. In other words, the same image as the image drawn in the adhesive margin synchronization area 313 of the loop area 311 is drawn in the margin area 312. Specifically, as illustrated in FIG. 8A, the drawing unit 141 draws the image 400 in the image drawing area 326 in the margin area 312, and the image 401 is displayed in the image drawing area 327 in the margin area 312. Draw a part.

  In each figure shown below, out of images drawn in the image memory 300, an image displayed on the input / output panel 190 is given an extraction range 350 (rectangular thick line). That is, in the example shown in FIG. 8A, the image 402 (image drawn in the image drawing area 323) included in the extraction range 350 is displayed on the input / output panel 190. Further, in each figure shown below, the black frame regions 331 to 337 are shown in white for easy explanation.

  8B and 9A, the drawing state of the image memory 300 when the display state on the input / output panel 190 transitions from the image 402 to the image 404 by the flick operation, and the display of the input / output panel 190 are shown. The relationship with a state is shown typically.

  As shown in FIG. 7A, the user performs a flick operation to change the display state on the input / output panel 190 from the image 402 to the image 404 while the image 402 is displayed on the input / output panel 190. Assuming that In this case, as shown in FIGS. 8B and 9A, the display control unit 142 is included in the extraction range 350 while moving the extraction range 350 in the direction from the image 402 toward the image 404. Images are sequentially displayed on the input / output panel 190. Thus, the images included in the extraction range 350 are sequentially displayed on the input / output panel 190, whereby the images 402 to 404 are scroll-displayed by animation. Note that the extraction range 350 may be moved at a constant speed, for example, or may be moved by changing the speed according to a flick operation. Further, as shown in FIGS. 8B and 9A, the portions corresponding to the black frame regions 331 to 337 included in the extraction range 350 are displayed on the input / output panel 190 as black frame images.

  If it is determined that the extraction range 350 has moved to satisfy a certain condition, the drawing unit 141 draws a new image using the image drawn next to the reference image as the reference image. For example, as illustrated in FIG. 9A, the extraction range 350 is separated from the position when the flick operation is performed (the image drawing area 323 where the image 402 is drawn) and the surrounding black frame area 333. As a condition, the reference image can be changed from the image 402 to the image 403. Further, on the condition that the entire image adjacent to the reference image is included in the extraction range 350, the reference image may be changed to the adjacent image. Alternatively, the reference image may be changed to the adjacent image on the condition that a certain percentage of the adjacent image of the reference image is included in the extraction range 350.

  For example, as shown in FIG. 9A, when the extraction range 350 moves to an image 403 drawn next to the image 402 displayed on the input / output panel 190 when the flick operation is performed, The drawing unit 141 draws a new image using the image 403 as a reference image. Specifically, on the time axis, there are four contents that are located before and after the content corresponding to the image 403 (reference image) drawn in the image drawing area 324 of the loop area 311 and are continuous to the content corresponding to the reference image. The corresponding image becomes the drawing target. That is, the images 401 and 402 positioned before the time axis and the images 404 and 405 positioned after the time axis are to be drawn. As shown in FIG. 8A, since the images 401 to 404 are already drawn in the image memory 300, the drawing unit 141 moves the image 405 after moving the extraction range 350 to the image 403. Only draw new.

  Here, there are five image drawing areas 321 to 325 in the loop area 311. For this reason, if the reference image is not an image drawn in the image drawing area 323 located in the middle of the five image drawing areas, two images cannot be arranged side by side on both sides of the reference image. Therefore, when the reference image is not an image drawn in the image drawing area 323, the reference image and the four images to be arranged on both sides thereof are arranged in a time series in a ring shape (cycle). Drawn. For example, since the image 403 is an image drawn in the image drawing area 324, it is impossible to draw two images side by side on both sides of the loop area 311. Therefore, the image 404 is drawn in the image drawing area 325 on the right side of the image 403, and the image 405 is drawn in the image drawing area 321 located at the other end in the loop area 311. That is, the drawing unit 141 draws the image 405 in the image drawing area 321 of the loop area 311 and draws the image 405 in the image drawing area 326 of the margin area 312.

  Subsequently, as illustrated in FIG. 9B, the extraction range 350 moves to the image 404 to be displayed by the flick operation, and the image 404 included in the extraction range 350 is displayed on the input / output panel 190. Further, as illustrated in FIG. 9B, when the extraction range 350 moves to the image 404, the drawing unit 141 draws a new image using the image 404 as a reference image. Specifically, on the time axis, there are four contents that are located before and after the content corresponding to the image 404 (reference image) drawn in the image drawing area 325 of the loop area 311 and that are continuous to the content corresponding to the reference image. The corresponding image becomes the drawing target. That is, the images 402 and 403 corresponding to the content located before the time axis and the images 405 and 406 corresponding to the content located after the time axis are to be rendered. As shown in FIG. 9A, since the images 402 to 405 are already drawn in the image memory 300, the drawing unit 141 moves the image 406 after moving the extraction range 350 to the image 404. Only draw new. In this case, as described above, the reference image and the other four images are arranged and drawn so as to be arranged in time series in an annular shape. That is, in the loop area 311, the image 406 is drawn in the image drawing area 322 located on the opposite side of the image drawing area 325 where the image 404 is drawn. The drawing unit 141 draws the image 406 in the image drawing area 322 of the loop area 311 and draws a part of the image 406 in the image drawing area 327 of the margin area 312.

  Next, an example in which the display state on the input / output panel 190 is changed from the image 404 to the image 406 by a flick operation will be described.

  FIG. 10 is a diagram illustrating a display example when the display state of the image displayed on the input / output panel 190 according to the first embodiment of the present invention is changed by a flick operation. FIG. 10A shows an example of the display state before the change, and FIG. 10B shows an example of the display state after the change. In this example, in the display state shown in FIG. 10A (the state where the image 404 is displayed on the input / output panel 190), the user performs a flick operation using the finger 890 to scroll the image. Indicates. In addition, an example is shown in which the display state shown in FIG. 10B (the state where the image 406 is displayed on the input / output panel 190) is displayed after the scroll display of the image by the flick operation.

  For example, in a state where the image 404 is displayed on the input / output panel 190, the user performs a flick operation in the direction of the arrow 892 with the finger 890 on the display surface of the input / output panel 190 as shown in FIG. This flick operation is performed with an operation direction and an operation amount for displaying the image 406. Thus, when a flick operation is performed, the display state on the input / output panel 190 transitions from the image 404 to the image 406, and the images 404 to 406 are scroll-displayed by animation. After the scroll display, an image 406 is displayed on the input / output panel 190 as shown in FIG. The transition from the image 404 to the image 406 in the input / output panel 190 will be described in detail with reference to FIGS.

  FIGS. 11 to 13 schematically illustrate a drawing method in the image memory 300 by the drawing unit 141 and a display method of an image drawn in the image memory 300 by the display control unit 142 according to the first embodiment of the present invention. FIG. The example shown in FIGS. 11 to 13 is an example corresponding to FIG. 10, and the image 406 is displayed on the input / output panel 190 from the state where the image 404 is displayed on the input / output panel 190 by the flick operation by the user. This is an example of changing to a state.

  FIG. 11A schematically shows the relationship between the drawing state of the image memory 300 and the display state of the input / output panel 190 when the image 404 is displayed on the input / output panel 190. The state shown in FIG. 11A is a state in which an image 404 is displayed on the input / output panel 190 by a flick operation, for example, as shown in FIGS. Note that the example shown in FIG. 11A is the same as the example shown in FIG. 9B, and thus detailed description thereof is omitted here.

  FIGS. 11B to 13A show the drawing state of the image memory 300 and the display of the input / output panel 190 when the display state of the input / output panel 190 changes from the image 404 to the image 406 by a flick operation. The relationship with a state is shown typically.

  As shown in FIG. 10A, the user performs a flick operation to change the display state on the input / output panel 190 from the image 404 to the image 406 while the image 402 is displayed on the input / output panel 190. Assuming that In this case, as shown in FIG. 11B and FIG. 12A, the display control unit 142 moves the extraction range 350 in the direction from the image 404 toward the image 405 and is included in the extraction range 350. Images are sequentially displayed on the input / output panel 190. Here, the image drawing area 325 in which the image 404 is drawn is located at the end of the loop area 311, and the image 405 adjacent to the image 404 is in the image drawing area 321 located at the other end of the loop area 311. Has been drawn. For this reason, when moving the extraction range 350 from the image 404 to the image 405 in the loop region 311, the other end (image drawing) of the loop region 311 is changed from one end (image drawing region 325) of the loop region 311. It is necessary to move to area 321). Therefore, in the first embodiment of the present invention, the same image as the image drawn in the glue margin synchronization area 313 in the loop area 311 is drawn in the glue margin area 312. Then, as shown in FIGS. 11B and 12A, when moving the extraction range 350 from the image 404 to the image 405 in the loop region 311, an image in which the image 405 in the margin region 312 is drawn. The extraction range 350 is moved to the drawing area 326. After this movement, as shown in FIG. 12B, the extraction range 350 is moved to the image drawing area 321 where the image 405 in the loop area 311 is drawn. Thereby, when scroll display is performed from the image 404 to the image 405, animation display can be appropriately performed. On the other hand, when scrolling from the image 405 to the image 404, the extraction range 350 is moved to the image drawing area 321 in the glue margin synchronization area 313, and then the extraction range 350 is set in the image drawing area 326 in the glue margin area 312. Move.

  Also, as shown in FIGS. 12A and 12B, the extraction range 350 sequentially moves to the image 405 in the margin area 312 and the margin margin synchronization area 313, and the image 405 included in the extraction range 350 is the input / output panel. 190. When the extraction range 350 moves to the image 405, the drawing unit 141 draws a new image using the image 405 as a reference image. Specifically, on the time axis, there are four contents that are located before and after the content corresponding to the image 405 (reference image) drawn in the image drawing area 321 of the loop area 311 and are continuous to the content corresponding to the reference image. The corresponding image becomes the drawing target. In other words, the images 403 and 404 corresponding to the content located before the time axis and the images 406 and 407 corresponding to the content located after the time axis are to be rendered. In this case, as described above, the reference image and the other four images are arranged and drawn so as to be arranged in time series in an annular shape. That is, the image 407 is drawn in the image drawing area 323 in the loop area 311.

  Subsequently, as illustrated in FIG. 13A, the extraction range 350 moves from the image 405 toward the image 406, and the image 423 (a part of the image 405, a part of the image 406, and the image 406 included in the extraction range 350). (Black frame) is displayed on the input / output panel 190.

  Subsequently, as illustrated in FIG. 13B, the extraction range 350 moves to the image 406 to be displayed by the flick operation, and the image 406 included in the extraction range 350 is displayed on the input / output panel 190. As illustrated in FIG. 13B, when the extraction range 350 moves to the image 406, the drawing unit 141 draws a new image using the image 406 as a reference image. Specifically, on the time axis, there are four contents that are located before and after the content corresponding to the image 406 (reference image) drawn in the image drawing area 322 of the loop area 311 and are continuous to the content corresponding to the reference image. The corresponding image becomes the drawing target. That is, the images 404 and 405 corresponding to the content located before the time axis and the images 407 and 408 corresponding to the content located after the time axis are to be rendered. In this case, as described above, the reference image and the other four images are arranged and drawn so as to be arranged in time series in an annular shape. That is, the image 408 is drawn in the image drawing area 324 in the loop area 311.

[Scroll display example by long press image feed operation]
Next, an example in which the display state on the input / output panel 190 is changed from the image 402 to the image 406 by a long press image feed operation will be described.

  FIG. 14 is a diagram showing a display example when the display state of the image displayed on the input / output panel 190 according to the first embodiment of the present invention is changed by a long press image feed operation. FIG. 14A shows an example of the display state before the change, and FIG. 14B shows an example of the display state after the change. In this example, in the display state shown in FIG. 14A (the state where the image 402 is displayed on the input / output panel 190), the user scrolls the image by performing a long press image feed operation using the finger 890. An example of display is shown. Further, an example is shown in which the display state shown in FIG. 14B (the state in which the image 406 is displayed on the input / output panel 190) is displayed after the scroll display of the image by the long press image feed operation. Here, in the long press image feed operation, the finger is slightly moved in the target direction while the finger is in contact with the display surface of the input / output panel 190, and the state is maintained after this movement, and the desired one is displayed. It means an operation of releasing a finger from the display surface when displayed on the surface. Note that a long press image feed operation may be performed using an operation member such as a mouse.

  For example, in a state where the image 402 is displayed on the input / output panel 190, as shown in FIG. 14A, on the display surface of the input / output panel 190, the user performs a long press image feed operation with the finger 890 in the arrow 893 direction. I do. This long-press image feed operation is performed in the operation direction in which the image 406 is displayed. As described above, when the long-press image feeding operation is performed, the display state on the input / output panel 190 transitions from the image 402 to the image 406 and is scrolled and displayed by animation. During the scroll display, the images 402 to 406 are reduced and displayed. Further, when the user releases the finger 890 from the display surface of the input / output panel 190 at a predetermined timing (timing for displaying the image 406), as shown in FIG. 14B, the input / output panel 190 is displayed after scroll display. An image 406 is displayed on the screen. The transition from the image 402 to the image 406 on the input / output panel 190 will be described in detail with reference to FIGS.

  15 to 19 schematically illustrate a drawing method in the image memory 300 by the drawing unit 141 and a display method of an image drawn in the image memory 300 by the display control unit 142 according to the first embodiment of the present invention. FIG. The example shown in FIGS. 15 to 19 is an example corresponding to FIG. It is an example which changes to the state where is displayed.

  FIG. 15A schematically shows the relationship between the drawing state of the image memory 300 and the display state of the input / output panel 190 when the image 402 is displayed on the input / output panel 190. Note that the example shown in FIG. 15A is the same as the example shown in FIG.

  FIGS. 15B and 19A show the drawing state of the image memory 300 and the input / output when the display state on the input / output panel 190 transitions from the image 402 to the image 406 by a long press image feed operation. The relationship with the display state of the panel 190 is shown typically.

  As shown in FIG. 14A, in the state where the image 402 is displayed on the input / output panel 190, the user performs a long-press image feed operation for scroll display in the direction from the image 402 to the image 406. Assuming that In this case, as illustrated in FIG. 15B, the display control unit 142 moves the extraction range 350 in the direction from the image 402 toward the image 403 and enlarges the size of the extraction range 350. The images included in 350 are sequentially displayed on the input / output panel 190. Further, the enlargement process of the extraction range 350 is continuously performed until it reaches a certain size. For example, as illustrated in FIG. 16A, the extraction range 350 is expanded until the vertical length of the rectangle corresponding to the extraction range 350 is the same as the vertical length of the black frame regions 331 to 337. . Further, the horizontal length of the rectangle of the extraction range 350 can be set to a length including a maximum of three images, for example, as shown in FIG. Then, after the extraction range 350 is expanded to a certain size, the extraction range 350 is moved in the direction from the image 402 toward the image 405 without performing the enlargement process of the extraction range 350. In this case, the images included in the extraction range 350 are sequentially displayed on the input / output panel 190, whereby each image from the image 402 is reduced and scrolled by animation. For example, as shown in FIGS. 15B to 19A, each image from the image 402 is reduced, and black frame images corresponding to the black frame regions 331 to 337 are surrounded around each reduced image. Attached. For this reason, each image 430 thru | or 436 can be displayed so that a photographic film may be scrolled. The extraction range 350 may be moved at a constant speed, for example, or may be moved by changing the speed according to the long press image feed operation. Further, in the enlargement process of the extraction range 350, for example, the enlargement amount may be sequentially enlarged by a certain amount, or the enlargement amount may be changed according to the long press image feed operation. The rectangle specified by the image drawing areas 326 and 327 and the black frame areas 336 and 337 in the margin area 312 is assumed to be larger than the size of the rectangle corresponding to the extraction range 350 after enlargement. For example, the rectangle specified by each area in the margin area 312 and the rectangle corresponding to the extracted extraction range 350 can be made the same.

  Here, the reference image is changed by moving the extraction range 350, for example, as shown in FIG. 16B, the extraction range 350 includes all the images (403) adjacent to the reference image (image 402). As a result, the adjacent image can be changed to the reference image. Further, the reference image may be changed under the same conditions as in the above-described flick operation.

  For example, as illustrated in FIG. 16B, when the extraction range 350 includes the entire image 403 due to the movement of the extraction range 350, the drawing unit 141 draws a new image using the image 403 as a reference image. To do. For example, the drawing unit 141 draws the image 405 in the image drawing area 321 in the loop area 311 and also draws the image 405 in the image drawing area 326 in the margin area 312.

  When the display control unit 142 sequentially displays the images included in the extraction range 350 on the input / output panel 190 while moving the extraction range 350 in the direction from the image 402 toward the image 405, FIG. As shown, the take-out range 350 reaches the margin area 312. Thus, when the extraction range 350 reaches the margin area 312, the extraction range 350 is moved to the margin allowance area 313 as shown in FIG. Thereby, when scroll display is performed from the image 404 to the image 405, animation display can be appropriately performed. On the other hand, when scroll display is performed in the direction opposite to the example shown in FIGS. 15 to 19, the extraction range 350 is moved to the paste margin synchronization region 313 and then moved to the paste margin region 312.

  Further, when the long press image feed operation by the user is completed, the extraction range 350 is moved while reducing the size of the extraction range 350, and the extraction range 350 is set according to the timing at the end of the long press image feed operation. Stop. For example, it is possible to stop in the image drawing area that passes after the long-press image feed operation is completed. Note that the long-press image feed operation is ended by releasing the finger from the display surface of the input / output panel 190.

  For example, it is assumed that the long press image feed operation by the user ends after the extraction range 350 has passed the image drawing area 321. In this case, for example, as illustrated in FIG. 19A, the display control unit 142 moves the extraction range 350 while reducing the size of the extraction range 350, and an image 406 drawn in the image drawing area 322. The extraction range 350 is stopped at the position. Here, reduction processing is performed on the extraction range 350 until the size of the rectangle corresponding to each image drawing area (size before enlargement) is reached. In this way, when the user releases his / her finger from the display surface of the input / output panel 190 at a predetermined timing (timing for displaying the image 406), as shown in FIG. An image 406 is displayed at 190.

[Scroll display example by dragging]
Next, an example in which the display state on the input / output panel 190 is changed from the image 402 to the image 403 by a drag operation will be described.

  FIG. 20 is a diagram illustrating a display example when the display state of the image displayed on the input / output panel 190 according to the first embodiment of the present invention is changed by a drag operation. FIG. 20A shows an example of the display state before the change, and FIG. 20B shows an example of the display state after the change. In this example, in the display state shown in FIG. 20A (in the state where the image 402 is displayed on the input / output panel 190), the user performs a drag operation using the finger 890 to scroll the image. Indicates. Also, an example is shown in which the display state shown in FIG. 20D (the state in which the image 403 is displayed on the input / output panel 190) is displayed after scrolling the image by the drag operation. Here, the drag operation means an operation of sliding the finger by a target direction and a moving amount in a state where the finger is in contact with the display surface of the input / output panel 190. For example, the object displayed on the display surface can be moved to a target position by a drag operation. Note that a drag operation may be performed using an operation member such as a mouse.

  For example, in a state where the image 402 is displayed on the input / output panel 190, the user performs a drag operation with the finger 890 in the arrow 894 direction on the display surface of the input / output panel 190, as shown in FIG. This drag operation is performed only slightly in the direction in which the image 401 is displayed. In this way, when a drag operation is performed, the display state on the input / output panel 190 transitions to an image 440 (an image including a part of the image 402 and a black frame image) as shown in FIG. And scrolled by animation. Subsequently, in a state where the image 440 is displayed on the input / output panel 190, the user performs a drag operation with the finger 890 in the arrow 895 direction on the display surface of the input / output panel 190, as shown in FIG. . This drag operation is performed in the direction in which the image 403 is displayed. Thus, when a drag operation is performed, as shown in FIG. 20C, the display state on the input / output panel 190 transitions from the image 402 to the image 403 and is scrolled and displayed by animation. In addition, when the user releases the finger 890 from the display surface of the input / output panel 190 in the state shown in FIG. 20C, the image is displayed on the input / output panel 190 as shown in FIG. 403 is displayed. The transition from the image 402 to the image 403 on the input / output panel 190 will be described in detail with reference to FIGS. 21 and 22.

  21 and 22 schematically illustrate a drawing method in the image memory 300 by the drawing unit 141 and a display method of an image drawn in the image memory 300 by the display control unit 142 according to the first embodiment of the present invention. FIG. The example shown in FIGS. 21 and 22 is an example corresponding to FIG. 20, and the image 403 is displayed on the input / output panel 190 from the state where the image 402 is displayed on the input / output panel 190 by the drag operation by the user. This is an example of changing to a state.

  FIG. 21A schematically shows the relationship between the drawing state of the image memory 300 and the display state of the input / output panel 190 when the image 402 is displayed on the input / output panel 190. Note that the example illustrated in FIG. 21A is the same as the example illustrated in FIG. 8A, and thus description thereof is omitted here.

  FIG. 21B shows the relationship between the drawing state of the image memory 300 and the display state of the input / output panel 190 when the display state on the input / output panel 190 changes from the image 402 toward the image 401 by a drag operation. Is shown schematically.

  As shown in FIG. 20A, a case where the user performs a drag operation for scroll display in a direction from the image 402 toward the image 401 in a state where the image 402 is displayed on the input / output panel 190. Suppose. In this case, as shown in FIG. 21B, the display control unit 142 moves the extraction range 350 in the direction from the image 402 toward the image 401, and displays the image included in the extraction range 350 as the input / output panel 190. Are displayed sequentially. The extraction range 350 can be moved according to the moving direction and moving amount of the drag operation by the user, for example.

  FIG. 22A shows the relationship between the drawing state of the image memory 300 and the display state of the input / output panel 190 when the display state of the input / output panel 190 transitions from the image 402 to the image 403 by a drag operation. Is shown schematically.

  As shown in FIG. 20B, when the user performs a drag operation for scrolling in the direction from the image 402 to the image 403 while the image 440 is displayed on the input / output panel 190. Suppose. In this case, as shown in FIG. 22A, the display control unit 142 moves the extraction range 350 in the direction from the image 402 toward the image 403, and displays the images included in the extraction range 350 in the input / output panel 190. Are displayed sequentially.

  Here, a criterion for changing an image drawn next to the reference image to the reference image when the extraction range 350 is moved by the drag operation will be described. For example, when a drag operation is performed, as illustrated in FIG. 20, it is assumed that the vicinity of the boundary between images frequently moves according to the movement of the user's finger. For this reason, in the first embodiment of the present invention, the reference image is not changed during the drag operation, but the reference image is changed at the end of the drag operation. That is, in operations other than the drag operation (for example, flick operation, long-press image feed operation), even when it is determined that the reference image is to be changed, the reference image is not changed during the drag operation. Further, when the drag operation is ended, as described above, it is possible to perform the same determination as the operation other than the drag operation and change the reference image. In this way, by changing the reference image related to the drag operation, it is possible to prevent the drawing process from occurring frequently even when the extraction range 350 is frequently moved near the boundary between the images by the drag operation. can do. In addition, since the range in which an image is moved by a single user operation is limited in the drag operation, even if the reference image is changed at the end of the drag operation and the drawing process is performed, scroll display can be performed appropriately. it can. Thereby, the load of drawing processing can be reduced.

  As described above, since the range in which the image is moved by a single user operation is limited in the drag operation, the reference image change process performed at the end of the drag operation is more than in the operation other than the drag operation described above. The judgment criteria may be relaxed. For example, when the extraction range 350 at the end of the drag operation includes more than half of the adjacent image of the reference image, the adjacent image can be changed to the reference image.

  For example, as shown in FIG. 22A, when the extraction range 350 at the end of the drag operation includes more than half of the image 403 adjacent to the reference image (image 402), the image 403 is used as the reference image. The drawing unit 141 draws a new image. For example, the drawing unit 141 draws the image 405 in the image drawing area 321 in the loop area 311 and also draws the image 405 in the image drawing area 326 in the margin area 312. In addition, when the ratio of the reference image (image 402) and the adjacent image 403 included in the extraction range 350 at the end of the drag operation is larger than the image 402, the drawing unit 141 uses the image 403 as the reference image. May draw a new image.

  Further, as described above, since the range in which an image is moved by a single user operation is limited in the drag operation, it is determined which image is displayed on the input / output panel 190 at the end of the drag operation. It may be. For example, when the reference image is changed at the end of the drag operation, the reference image can be displayed on the input / output panel 190 as a display target image. If the reference image is not changed, the input / output panel 190 can be displayed with the reference image at the start of the drag operation as the display target image.

  For example, when the image 403 is changed to the reference image at the end of the drag operation, the image 403 is displayed on the input / output panel 190 as shown in FIG.

  In this example, the drag operation is performed only in the left-right direction. However, for example, the drag operation may be performed in the vertical direction. When the drag operation is performed in the vertical direction as described above, a black frame image is displayed around the image to be displayed.

[Modification of drawing area of display target image]
FIG. 23 is a diagram schematically showing a drawing area of a display target image in the image memory 300 according to the first embodiment of the present invention. The example shown in FIG. 23 is a modification of FIG. 5 and is the same as the example shown in FIG. 5 except that the number of image drawing areas and black frame areas in the loop area 311 is changed from 5 to 7. Therefore, in the following, a part of the description of the parts common to FIG. 5 is omitted.

  The effective area 510 includes a loop area 511 and a margin area 512.

  The loop region 511 is positioned in front of the reference image on the time axis and a predetermined number of images continuous from the reference image on the time axis, and positioned after the reference image on the time axis. This is an area where a predetermined number of images are drawn from the reference image. In the loop area 511, for example, each image is drawn in the image drawing areas 521 to 527. In addition, black frame regions 531 to 537 are provided around the image drawing regions 521 to 527, respectively.

  The margin area 512 is an area where the same image as the image drawn in the margin synchronization area 513 in the loop area 511 is drawn. In the margin area 512, for example, each image is drawn in the image drawing areas 528 and 529. Black frame regions 538 and 539 are provided around the image drawing regions 528 and 529, respectively.

[Comparison of drawing process by flick operation]
24 and 25 are diagrams schematically illustrating a drawing method on the image memory 300 by the drawing unit 141 according to the first embodiment of the present invention. The example shown in FIGS. 24 and 25 is a comparative example of the drawing processing when the number of image drawing areas in the loop area is 5 and when the number of image drawing areas in the loop area is 7. Specifically, this is a comparative example in the case where the display state is changed from the image 402 to the image 404 on the input / output panel 190 by the flick operation by the user, and then the display state is returned from the image 404 to the image 402.

  FIG. 24 shows an example in which, as shown in FIG. 5, an effective area 310 is secured as a drawing area for a display target image on the image memory 300, and a reference image and two consecutive images are drawn.

  FIG. 24A schematically shows a drawing state of the image memory 300 when the image 402 is displayed on the input / output panel 190. Note that the example illustrated in FIG. 24A is the same as the example illustrated in FIG. 8A, and thus description thereof is omitted here.

  FIG. 24B schematically shows the drawing state of the image memory 300 when the display state on the input / output panel 190 transitions from the image 402 to the image 404 by a flick operation. Note that the case where the display state on the input / output panel 190 transitions from the image 402 to the image 404 is the same as the example illustrated in FIGS. 8 and 9, and thus detailed description thereof is omitted here.

  As shown in FIG. 24B, when the display state on the input / output panel 190 transitions from the image 402 to the image 404, images 405 and 406 are newly drawn in the image drawing areas 321 and 322 in the loop area 311. Is done. Also, part of the images 405 and 406 are newly drawn in the image drawing areas 326 and 327 in the margin area 312.

  FIG. 24C schematically shows the drawing state of the image memory 300 when the display state on the input / output panel 190 transitions from the image 404 to the image 402 by a flick operation.

  As shown in FIG. 24C, when the display state on the input / output panel 190 transitions from the image 404 to the image 402, the images 400 and 401 are newly drawn in the image drawing regions 321 and 322 in the loop region 311. Is done. Also, part of the images 400 and 401 are newly drawn in the image drawing areas 326 and 327 in the margin area 312. That is, the drawing state is the same as that shown in FIG.

  As described above, when the number of image drawing areas in the loop area 311 is 5, and when drawing the reference image and two images consecutive thereto, drawing processing for drawing four images is required.

  FIG. 25 shows an example in which, as shown in FIG. 23, the effective area 510 is secured as the drawing area of the display target image on the image memory 300, and the reference image and two consecutive images are drawn.

  FIG. 25A schematically shows a drawing state of the image memory 300 when the image 402 is displayed on the input / output panel 190. The example shown in FIG. 25A is substantially the same as the example shown in FIG. 8A except that the number of image drawing areas and black frame areas in the loop area 511 is changed. That is, two images 400, 401, 403, and 404 continuous with the reference image are drawn on both sides of the reference image (image 402), and drawn in the paste margin synchronization area 513 in the loop area 511 in the paste margin area 512. The same image as that obtained (images 400 and 401) is drawn. Here, it is not necessary to draw an image in the image drawing areas 526 and 527 in the loop area 511.

  FIG. 25B schematically shows the drawing state of the image memory 300 when the display state on the input / output panel 190 transitions from the image 402 to the image 404 by a flick operation. As shown in FIG. 25B, when the display state on the input / output panel 190 transitions from the image 402 to the image 404, two images that are continuous with the reference image are displayed on the right side of the image 404 that is to be a new reference image. 405 and 406 are drawn. In this way, since the number of image drawing areas in the loop area 511 is 7, unlike the example shown in FIG. 24B, images newly added to the drawing objects in the image drawing areas 521 and 522 in the loop area 511. There is no need to overwrite 405 and 406. That is, even when the reference image is changed to the image 404, the images 400 and 401 are drawn in the image drawing areas 521 and 522 in the loop area 511.

  FIG. 25C schematically shows the drawing state of the image memory 300 when the display state on the input / output panel 190 transitions from the image 404 to the image 402 by a flick operation. As shown in FIG. 25C, when the display state on the input / output panel 190 transitions from the image 404 to the image 402, two images that are continuous with the reference image are displayed on the left side of the image 402 that becomes a new reference image. Drawings 400 and 401 are required. Here, as described above, the images 400 and 401 are drawn in the image drawing areas 521 and 522 in the loop area 511. For this reason, it is not necessary to perform a new drawing process for the images 401 and 402 that are newly drawn. Even when the reference image is changed to the image 402, the images 405 and 406 are drawn because there is no image to be drawn in the image drawing regions 526 and 527 in the loop region 511.

  As described above, when the number of image drawing areas in the loop area 511 is set to 7 and a reference image and two images continuous to the drawing are drawn, only drawing processing for drawing two images is required. As described above, in the image memory 300, the larger the number of image drawing areas in the loop area, the more the drawing process can be reduced, and the load on the drawing process can be reduced.

  In the above example, the number of image drawing areas in the loop area is set to 5 or 7. However, it is preferable to set the number of image drawing areas in the loop area to about 17. Further, in the above description, an example in which the same number of images is drawn in each operation is shown for images that are continuous with the reference image. However, for example, an image that is a drawing target continuous with the reference image according to the type of operation. The number of (neighboring images) may be changed. For example, the number of neighboring images is increased in the order of drag operation, long-press image feed operation, and flick operation. For example, when the number of image drawing areas in the loop area is 9, and a drag operation is performed, two images that are continuous with the reference image are drawn as neighboring images. For example, when the number of image drawing areas in the loop area is set to 9, and a long-press image feed operation is performed, three images that are continuous with the reference image are drawn as neighboring images. Further, for example, when the number of image drawing areas in the loop area is set to 9, and a flick operation is performed, four images that are continuous with the reference image are drawn as neighboring images. Further, for example, in the case of a drag operation or a long-press image feed operation, the number of neighboring images on both sides of the reference image may be changed according to the traveling direction of the extraction area. For example, it is possible to increase the number of neighboring images drawn in the advancing direction of the extraction area and reduce the number of neighboring images drawn on the side opposite to the advancing direction of the extraction area.

[Operation example of imaging device]
FIG. 26 is a flowchart illustrating a processing procedure of content reproduction processing by the imaging apparatus 100 according to the first embodiment of the present invention.

  First, a content selection screen (index screen) is displayed on the input / output panel 190 by a user operation (step S900). In this content selection screen, it is determined whether or not a content reproduction instruction operation for selecting desired content has been accepted (step S901). If the reproduction instruction operation has not been accepted, the reproduction instruction operation is accepted. Until monitoring continues. On the other hand, when a content reproduction instruction operation is accepted (step S901), the drawing unit 141 acquires content related to the content reproduction instruction operation and an image (image data) representing a predetermined number of content items following the content (image data) ( Step S902).

  Subsequently, the drawing unit 141 draws the acquired images in time series in the loop area in the image memory 300 (step S903). Subsequently, the drawing unit 141 draws the same image as the image drawn in the margin synchronization area in the loop region in the margin area (step S904). Steps S903 and S904 are an example of a drawing procedure described in the claims. Subsequently, the display control unit 142 sets an image representing the content related to the content reproduction instruction operation as a reference image, and sets an extraction range for the reference image (step S905). Subsequently, the display control unit 142 causes the display panel 191 to display an image included in the extraction range among the images drawn in the image memory 300 (step S906). Note that steps S905 and S906 are an example of a display control procedure described in the claims.

  Subsequently, it is determined whether or not a scroll operation by the user has been accepted for the image displayed on the display panel 191 (step S907). If the scroll operation has not been accepted (step S907), it is determined whether or not a return operation by the user has been accepted (step S908). When the return operation is not accepted (step S908), the process returns to step S907, and when the return operation is accepted, the process returns to step S900.

  When a scroll operation by the user is accepted (step S907), scroll processing is performed (step S910). This scroll process will be described in detail with reference to FIG. Note that step S910 is an example of a control procedure described in the claims.

  Subsequently, it is determined whether or not a content reproduction end operation by the user has been accepted (step S909). If the content reproduction end operation has not been accepted (step S909), the process returns to step S907. If the content reproduction end operation has been accepted, the operation of the content reproduction process is terminated.

  FIG. 27 is a flowchart showing scroll processing (processing procedure of step S910 shown in FIG. 26) in the processing procedure of content reproduction processing by the imaging apparatus 100 according to the first embodiment of the present invention.

  First, it is determined whether or not the accepted scroll operation is a drag operation (step S911). If the accepted scroll operation is a drag operation (step S911), a drag operation scroll process is performed (step S920). This drag operation scroll process will be described in detail with reference to FIG.

  If the accepted scroll operation is not a drag operation (step S911), it is determined whether or not the accepted scroll operation is a flick operation (step S912). If the accepted scroll operation is a flick operation (step S912), a flick operation scroll process is performed (step S940). The flick operation scroll process will be described in detail with reference to FIG.

  If the accepted scroll operation is not a flick operation (step S912), it is determined whether or not the accepted scroll operation is a long press image feed operation (step S913). When the accepted scroll operation is a long press image feed operation (step S913), a long press image feed operation scroll process is performed (step S950). This long press image feed operation scroll process will be described in detail with reference to FIG.

  If the accepted scroll operation is not a long-press image feed operation (step S913), another scroll process corresponding to the accepted scroll operation is performed (step S914).

  FIG. 28 is a flowchart illustrating a drag operation scroll process (the process procedure of step S920 shown in FIG. 27) in the process procedure of the content reproduction process performed by the imaging device 100 according to the first embodiment of the present invention.

  First, the display control unit 142 moves the extraction range in response to the drag operation (step S921), and displays, among the images drawn in the image memory 300, images included in the moved extraction range on the display panel 191. (Step S922). Subsequently, an extraction range end portion moving process is performed (step S930). The extraction range end portion moving process will be described in detail with reference to FIG.

  Subsequently, it is determined whether or not the drag operation has ended (step S923). If the drag operation has not ended (step S923), the process returns to step S921. On the other hand, when the drag operation is finished (step S923), it is determined whether or not the take-out range has moved so as to satisfy a certain condition (step S924). If the extraction range has not moved so as to satisfy a certain condition (step S924), the drag operation scroll process is terminated.

  When the extraction range moves so as to satisfy a certain condition (step S924), the destination image satisfying the certain condition is set as a reference image, and the extraction range is moved to this reference image (step S925). In accordance with this movement, images included in the extraction range are sequentially displayed on the display panel 191. Subsequently, a newly set reference image and a predetermined number of continuous images are specified, and the drawing unit 141 acquires an image (image data) that is not drawn in the loop area in the image memory 300 (step S926). ).

  Subsequently, the drawing unit 141 draws the acquired images in time series in the loop area in the image memory 300 (step S927). In this case, if the drawn image is drawn in the margin synchronization area in the loop area, the same image as that image is drawn in the margin area.

  FIG. 29 is a flowchart showing an extraction range end movement process (the process procedure of step S930 shown in FIG. 28) in the process procedure of the content reproduction process performed by the imaging device 100 according to the first embodiment of the present invention.

  First, the display control unit 142 determines whether or not the extraction range has reached a predetermined position in the glue margin area (for example, the position of the image drawing area 326 shown in FIG. 5) (step S931). When the extraction range reaches a predetermined position in the margin area (step S931), the display control unit 142 determines the predetermined position in the margin synchronization area of the loop area (for example, the position of the image drawing area 321 shown in FIG. 5). The extraction range is moved to (Step S932). On the other hand, when the extraction range has not reached the predetermined position in the margin area (step S931), the process proceeds to step S933.

  Subsequently, the display control unit 142 determines whether or not the extraction range has reached a predetermined position (for example, the position of the image drawing area 321 shown in FIG. 5) in the glue margin synchronization area of the loop area (step S933). When the extraction range has reached a predetermined position in the margin allowance synchronization area (step S933), the display control unit 142 extracts the extraction range to a predetermined position in the margin allowance area (for example, the position of the image drawing area 326 shown in FIG. 5). Is moved (step S934). On the other hand, when the extraction range has not reached the predetermined position in the adhesive margin synchronization area (step S933), the operation of the extraction range end portion moving process is terminated.

  FIG. 30 is a flowchart showing a flick operation scroll process (the process procedure of step S940 shown in FIG. 27) in the process procedure of the content reproduction process by the imaging device 100 according to the first embodiment of the present invention.

  First, the display control unit 142 moves the extraction range in the direction corresponding to the flick operation (step S941), and among the images drawn in the image memory 300, the image included in the extracted extraction range is displayed on the display panel 191. (Step S942). Subsequently, an extraction range end portion moving process is performed (step S930). The extraction range end portion moving process is the same as the process shown in FIG.

  Subsequently, it is determined whether or not the extraction range has moved so as to satisfy a certain condition (step S943). If the extraction range has not moved so as to satisfy a certain condition (step S943), the process proceeds to step S947. If the extraction range has moved so as to satisfy a certain condition (step S943), the destination image satisfying the certain condition is set as a reference image (step S944). Subsequently, a newly set reference image and a predetermined number of continuous images are specified, and the drawing unit 141 acquires an image (image data) that is not drawn in a loop area in the image memory 300 (step S945). ).

  Subsequently, the drawing unit 141 draws the acquired images in time series in the loop area in the image memory 300 (step S946). In this case, if the drawn image is drawn in the margin synchronization area in the loop area, the same image as that image is drawn in the margin area.

  Subsequently, it is determined whether or not the extraction range has been moved to the image position corresponding to the flick operation (step S947). If the extraction range has not moved to the image position corresponding to the flick operation (step S947), the process returns to step S941. If the extraction range has moved to the image position corresponding to the flick operation (step S947), the operation of the flick operation scroll process is terminated.

  FIG. 31 is a flowchart showing the long-press image feed operation scroll process (the process procedure of step S950 shown in FIG. 27) in the process procedure of the content reproduction process by the imaging device 100 according to the first embodiment of the present invention. .

  First, the display control unit 142 determines whether or not the extraction range is a certain size (for example, the size of the extraction range 350 after enlargement shown in FIGS. 16 to 18) (step S951). If the extraction range is not a certain size (step S951), the display control unit 142 expands the extraction range (step S952), and if the extraction range is a certain size, the process proceeds to step S953.

  Subsequently, the display control unit 142 moves the extraction range in a direction corresponding to the long-press image feeding operation (step S953), and among the images drawn in the image memory 300, images included in the extracted extraction range are displayed. It is displayed on the display panel 191 (step S954). Subsequently, an extraction range end portion moving process is performed (step S930). This extraction range end moving process is substantially the same as the process shown in FIG. However, in the long press image feed operation, since the extraction range is enlarged, the predetermined position in the paste margin area or the paste margin synchronization area can be the entire paste margin area or the paste margin synchronization area.

  Subsequently, it is determined whether or not the extraction range has moved so as to satisfy a certain condition (step S955). When the extraction range does not move so as to satisfy a certain condition (step S955), the process proceeds to step S959. On the other hand, when the extraction range has moved so as to satisfy a certain condition (step S955), a destination image satisfying the certain condition is set as a reference image (step S956). Subsequently, a newly set reference image and a predetermined number of continuous images are specified, and the drawing unit 141 acquires an image (image data) that is not drawn in the loop area in the image memory 300 (step S957). ).

  Subsequently, the drawing unit 141 draws the acquired images in time series in the loop area in the image memory 300 (step S958). In this case, if the drawn image is drawn in the margin synchronization area in the loop area, the same image as that image is drawn in the margin area.

  Subsequently, it is determined whether or not the long press image feed operation has been completed (step S959). If the long press image feed operation has not been completed (step S959), the process returns to step S951. On the other hand, when the long press image feed operation is completed (step S959), the display control unit 142 reduces the extraction range, and among the images drawn in the image memory 300, the position of the nearest image in the traveling direction. The extraction range is moved to (step S960). Then, among the images drawn in the image memory 300, the images included in the extraction range after movement are sequentially displayed on the display panel 191 (step S960), and the operation of the long press image feed operation scroll processing is ended.

<2. Second Embodiment>
In the first embodiment of the present invention, the example in which the margin area is provided at one end portion in the specific direction in the loop area has been described. In the second embodiment of the present invention, an example in which a margin area is provided at both ends in a specific direction in a loop area will be described. Note that the configuration of the imaging apparatus according to the second embodiment of the present invention is substantially the same as that of the first embodiment of the present invention. For this reason, below, it demonstrates centering on a different part from the 1st Embodiment of this invention.

[Drawing area example of display target image]
FIG. 32 is a diagram schematically showing a drawing area of a display target image in the image memory 300 according to the second embodiment of the present invention. The example shown in FIG. 32 is a modification of FIG. 5, except that instead of providing a margin area at one end in a specific direction in the loop area, a margin area is provided at both ends in the specific direction in the loop area. Is substantially the same as the example shown in FIG. For this reason, below, it demonstrates centering on a different part from the example shown in FIG.

  As shown in FIG. 32, when scrolling an image representing content stored in the storage unit 200 by a user operation or the like, a relatively long drawing area (effective area) in the scroll direction on the image memory 300 is displayed. 610) is secured.

  The effective area 610 includes a loop area 611, a first margin area 612, and a second margin area 613.

  The loop region 611 includes a reference image, two images that are located before the reference image on the time axis and continuous from the reference image, and two images that are located after the reference image on the time axis and are continuous from the reference image. The area to be drawn. In the loop area 611, for example, each image is drawn in the image drawing areas 621 to 625. Further, black frame regions 631 to 635 are provided around the image drawing regions 621 to 625, respectively.

  The first margin area 612 is an area where the same image as the image drawn in the first margin allowance area 614 in the loop area 611 is drawn. The second margin area 613 is an area in which the same image as the image drawn in the second margin allowance area 615 in the loop area 611 is drawn. In addition, a black frame region 637 is provided around the image drawing region 627 in the first margin area 612, and a black frame region 636 is provided around the image drawing region 626 in the second margin area 613. Here, the rectangle specified by the first margin allowance area 612 and the second margin allowance synchronization area 615 is set to have a size equal to or larger than the extraction range (for example, the enlarged extraction range 350 shown in FIG. 33). . Similarly, the rectangle specified by the second margin allowance area 613 and the first margin allowance synchronization area 614 is set to have a size larger than the extraction range.

[Scroll display example by long press image feed operation]
FIG. 33 is a diagram schematically illustrating a drawing method on the image memory 300 by the drawing unit 141 and a display method of an image drawn on the image memory 300 by the display control unit 142 according to the second embodiment of the present invention. It is. In the example shown in FIG. 33A, when the reference image is the image 404, two images 402, 403, 405, and 406 continuous with the reference image are drawn on both sides of the reference image as an example. Show. In this case, in the first margin area 612, the same image as the image (image 404) drawn in the first margin synchronization area 614 in the loop area 611 is drawn. In the second margin area 613, the same image as the image (image 405) drawn in the second margin allowance area 615 in the loop area 611 is drawn. The example illustrated in FIG. 33A illustrates a state in which the enlarged extraction range 350 is moved in the direction from the image 404 toward the image 405 (rightward direction) by the long press image feed operation.

  FIG. 33B shows a display example of an image displayed on the input / output panel 190 in the state shown in FIG. As shown in FIG. 33A, when the extraction range 350 moves and the entire extraction range 350 reaches the second margin allowance area 613 and the first margin allowance synchronization area 614, the extraction range 350 is It moves to the first margin area 612 and the second margin area 615. In this case, the images 640 included in the extraction range 350 are sequentially displayed on the input / output panel 190. In FIG. 33A, the extraction range 350 that has reached the second margin area 613 and the first margin allowance area 614 is indicated by a dotted line, and moved to the first margin area 612 and the second margin allowance area 615. The extracted range 350 is indicated by a solid line.

  Thus, in the second embodiment of the present invention, the total size of the first margin area and the second margin area is set to be equal to or larger than the enlarged extraction range, and the margin area is divided at both ends of the loop area. Arrange. Even when arranged in this way, it is possible to perform scroll display by continuous animation at the end in the loop region.

<3. Third Embodiment>
In the first and second embodiments of the present invention, an example has been shown in which scroll margins are continuously displayed at the end of the loop region by providing a margin area at the end of the loop region in a specific direction. In the third embodiment of the present invention, an example will be described in which scroll display of the end portion in the loop region is continuously performed without providing a margin area at the end portion in the specific direction in the loop region. Note that the configuration of the imaging apparatus according to the third embodiment of the present invention is substantially the same as that of the first embodiment of the present invention. For this reason, below, it demonstrates centering on a different part from the 1st Embodiment of this invention.

[Drawing area example of display target image]
FIG. 34 is a diagram schematically showing a drawing area of a display target image in the image memory 300 according to the third embodiment of the present invention. The example shown in FIG. 34 is a modification of FIG. 5 and is substantially the same as the example shown in FIG. 5 except that the margin area is not provided at the end in the specific direction in the loop area. For this reason, below, it demonstrates centering on a different part from the example shown in FIG.

  As shown in FIG. 34, when an image representing content stored in the storage unit 200 is scroll-displayed by a user operation or the like, a relatively long drawing area (effective area) in the scroll direction is displayed on the image memory 300. 650). The effective area 650 includes only a loop area 651.

  The loop region 651 includes a reference image, two images located before the reference image on the time axis and continuing from the reference image, and two images located after the reference image on the time axis and continuous from the reference image. The area to be drawn. In the loop area 651, for example, each image is drawn in the image drawing areas 661 to 665. Further, black frame regions 671 to 675 are provided around the image drawing regions 661 to 665, respectively.

[Scroll display example by long press image feed operation]
FIG. 35 schematically illustrates a drawing method on the image memory 300 by the drawing unit 141 and a display method of an image drawn on the image memory 300 by the display control unit 142 according to the third embodiment of the present invention. It is. In the example shown in FIG. 35A, when the reference image is the image 404, the case where two images 402, 403, 405, and 406 continuous with the reference image are drawn on both sides of the reference image is taken as an example. Show. In addition, the example illustrated in FIG. 35A illustrates a state in which the extraction range is moved in the direction from the image 404 toward the image 405 (rightward direction) by the long press image feed operation.

  FIG. 35B shows a display example of an image displayed on the input / output panel 190 in the state shown in FIG. When the extraction range moves and the extraction range reaches the end of the loop region 651, the display control unit 142 has two extraction ranges at both ends in the loop region 651 as shown in FIG. (Extraction ranges 351 and 352) are set. The total size of the two extraction ranges can be the same as the size of the extraction range 350 described above, for example. Then, the display control unit 142 combines the images included in the extraction ranges 351 and 352 arranged at both ends in the loop region 651 and causes the input / output panel 190 to display the combined image 680. Further, the display control unit 142 moves the extraction ranges 351 and 352 arranged at both ends in the loop region 651 at a predetermined speed. The display control unit 142 sets one extraction range in the loop region 651 when the extraction range at any end of the loop region 651 becomes unnecessary. For example, when the extraction range is moving in the direction from the image 405 toward the image 406 (rightward direction), the extraction range 351 is deleted, and the size of the extraction range 352 is larger than the normal extraction range (extraction range 350). As a result, the movement of the extraction range 352 is continued.

  As described above, in the third embodiment of the present invention, two extraction ranges are set at both ends of the loop region, and a composite image is generated by combining the images included in the two extraction ranges. Display an image. As described above, even when the margin area is not provided, scroll display by continuous animation at the end in the loop area can be performed.

<4. Fourth Embodiment>
In the first to third embodiments of the present invention, the example in which the image representing the content is scroll-displayed in the left-right direction has been described. In the fourth embodiment of the present invention, an example will be described in which thumbnail images included in an index screen (content selection screen) for selecting content to be reproduced are scroll-displayed. Note that the configuration of the imaging apparatus according to the fourth embodiment of the present invention is substantially the same as that of the first embodiment of the present invention. For this reason, below, it demonstrates centering on a different part from the 1st Embodiment of this invention.

[Drawing area example of display target image]
FIG. 36 is a diagram schematically showing a drawing area of a display target image in the image memory 300 according to the fourth embodiment of the present invention. Here, in the fourth embodiment of the present invention, when an index screen for selecting content stored in the storage unit 200 is displayed by a user operation or the like, the scroll is performed on the image memory 300. A relatively long drawing area is secured in the direction. For example, as shown in FIG. 36, an effective area 710 is secured on the image memory 300 as a drawing area of the display target image. In the example shown in FIG. 36, an example of a drawing area of the display target image when the index screen is scrolled in the vertical direction on the input / output panel 190 is shown. The example shown in FIG. 36 is a modification of FIG. 5 and differs in that the drawing target is a thumbnail image included in the content, the index screen is scrolled in the vertical direction, and the like. Is substantially the same. For this reason, below, it demonstrates centering on a different part from the example shown in FIG.

  The effective area 710 includes a loop area 711 and a margin area 712. In the effective area 710, each image is drawn in time series by an array for displaying an index screen.

  The loop area 711 is an area in which a plurality of thumbnail images (reference image group) to be displayed and a plurality of images (neighboring images) continuous to the reference image group are drawn. For example, 4 × 15 Thumbnail images # 0 to # 59 are drawn in a matrix. Note that the thumbnail images # 0 to # 59 are arranged in time series (in the order of # 0 to # 59). For example, 24 thumbnail images (4 × 6 matrix-like thumbnail images) that are located in front of the reference image group on the time axis and are continuous from the reference image group are drawn as neighboring images drawn in the loop region 711. . Further, for example, 24 thumbnail images (4 × 6 matrix-like thumbnail images) positioned after the reference image group on the time axis and continuing from the reference image group are drawn as neighboring images drawn in the loop region 711. The For example, when the thumbnail images # 24 to # 35 included in the extraction range 720 are set as the reference image group, 24 thumbnail images that are located before the reference image group on the time axis and are continuous from the reference image group are thumbnails. Images # 0 to # 23. The 24 thumbnail images that are located after the reference image group on the time axis and are continuous from the reference image group are thumbnail images # 36 to # 59.

  The margin area 712 is an area in which the same thumbnail image as the thumbnail image drawn in the margin synchronization area 713 in the loop area 711 is drawn. Also, the margin area 712 is set so as to have a size larger than the extraction range 720.

[Example of scrolling index image display]
FIG. 37 is a diagram schematically illustrating a drawing method on the image memory 300 by the drawing unit 141 and a display method of an image drawn on the image memory 300 by the display control unit 142 according to the fourth embodiment of the present invention. It is. In FIG. 37A, a part of the image drawing area in the loop area 711 is omitted. As shown in FIG. 37A, in the margin area 712, the same thumbnail image as the thumbnail image (4 × 3 matrix thumbnail image) drawn in the margin synchronization area 713 in the loop area 711 is drawn. Is done.

  FIG. 37B shows a display example of the index screen displayed on the input / output panel 190 in the state shown in FIG. As shown in FIG. 37B, a list of thumbnail images included in the extraction range 720 is displayed on the input / output panel 190 as an index screen 730. As described above, when the index screen 730 is displayed on the input / output panel 190 and the user performs an instruction operation for moving the index screen 730 in the vertical direction, the extraction range 720 is set according to the instruction operation. Moves up and down. Then, the thumbnail images included in the extraction range 720 are changed according to the movement of the extraction range 720, and a list of thumbnail images after the change is sequentially displayed on the input / output panel 190 as an index screen.

  Further, the reference image group is changed according to the movement of the extraction range 720. For example, the reference image group is changed for each row of the three rows of thumbnail images included in the extraction range 720. For example, when a predetermined ratio in the vertical direction is included in the extraction range 720 among the thumbnail images of one row newly included in the extraction range 720 according to the movement of the extraction range 720, the new one row thumbnail image Can be changed as a reference image group.

  In addition, the movement of the extraction range 720 when the extraction range 720 reaches the margin margin area 712 or the margin margin synchronization area 713 is the same as that of the first embodiment of the present invention, and thus the description thereof is omitted here. .

  As described above, according to the fourth embodiment of the present invention, when scrolling the thumbnail images included in the index screen, it is possible to appropriately perform scroll display of these thumbnail images by continuous animation. .

  As described above, according to the embodiment of the present invention, when each image is scroll-displayed, it is possible to perform scroll display using an appropriate animation corresponding to a user operation. That is, according to the user operation, a series of operations related to scroll display by animation can be performed lightly and without delay. For example, even in the case of image transition from the end of the loop region in the image memory to another end, scroll display by animation can be performed without giving the user a sense of incongruity. Thereby, in the GUI (Graphical User Interface) of the image transition for scroll-displaying each image, it is possible to improve the visibility when the image is scroll-displayed.

  Further, in the embodiment of the present invention, an example in which images representing content are arranged and drawn using date and time information as a predetermined rule has been described. For example, position information and names associated with the content (for example, file Attribute information such as name) may be used. When position information is used, for example, the order of each content can be specified based on a distance from a reference position (for example, a user's home). When using names, for example, the order of the contents can be specified by setting the names in dictionary order (for example, in the order of letters, alphabets, and numbers).

  In the embodiment of the present invention, an example in which a screen nail image or a thumbnail image included in a still image file is drawn as an image representing content is shown. However, for example, when the screen nail image to be rendered is not included in the still image file, the thumbnail image included in the still image file may be used for rendering. For example, when a thumbnail image to be rendered is not included in the still image file, a screen nail image included in the still image file may be used for rendering. For example, when the screen nail image and the thumbnail image are not included in the still image file, the main image included in the still image file may be used for drawing. Further, instead of using an image included in a still image file for drawing, for example, an image representing content may be drawn based on each attribute information recorded in a management file for managing the content. Further, the embodiment of the present invention can be applied to a case where an image representing a moving image file is displayed as an image representing content. As an image representing a moving image file, for example, a thumbnail image of a representative frame (for example, the first frame) can be used.

  Furthermore, the embodiment of the present invention can be applied to a case where an image representing content other than moving image content and still image content is displayed. For example, the embodiment of the present invention can be applied to the case where an image (for example, a music jacket image) related to audio data content is displayed and scrolled by a user operation.

  In the embodiment of the present invention, an imaging device such as a digital still camera has been described as an example. However, a mobile phone, a portable media player, or the like that can play back content such as music, moving images, and still images. The embodiment of the present invention can be applied to an image processing apparatus. For example, the embodiment of the present invention can be applied to an image processing apparatus such as a personal computer capable of generating and displaying content such as document data. Further, the embodiment of the present invention can be applied to an image processing apparatus that can output content to another display device and display an image representing the content on the display device.

  The embodiment of the present invention shows an example for embodying the present invention. As clearly shown in the embodiment of the present invention, the matters in the embodiment of the present invention and the claims Each invention-specific matter in the scope has a corresponding relationship. Similarly, the matters specifying the invention in the claims and the matters in the embodiment of the present invention having the same names as the claims have a corresponding relationship. However, the present invention is not limited to the embodiments, and can be embodied by making various modifications to the embodiments without departing from the gist of the present invention.

  The processing procedure described in the embodiment of the present invention may be regarded as a method having a series of these procedures, and a program for causing a computer to execute the series of procedures or a recording medium storing the program May be taken as As this recording medium, for example, a CD (Compact Disc), an MD (MiniDisc), a DVD (Digital Versatile Disk), a memory card, a Blu-ray Disc (registered trademark), or the like can be used.

DESCRIPTION OF SYMBOLS 100 Image pick-up device 111 Lens part 112 Motor driver 113 Actuator 114 Image sensor 120 Analog signal processing part 130 A / D conversion part 140 Image processing part 141 Drawing part 142 Display control part 160 Control part 171 Non-volatile memory 172 ROM
173 RAM
180 Operation unit 181 Shutter button 185 GPS signal processing unit 190 Input / output panel 191 Display panel 192 Touch panel 200 Storage unit 210 Operation reception unit 300 Image memory

Claims (11)

For a plurality of images whose order is specified based on a predetermined rule, one of the plurality of images is drawn as a reference image in an image memory, and the reference image is positioned in front of the reference image in the order. A predetermined number of images consecutive from the reference image and a predetermined number of images located after the reference image in the order and continuing from the reference image are arranged in the reference image according to the order as neighboring images related to the reference image. A drawing unit for drawing in memory;
A display control unit that causes a display unit to display an image included in a predetermined range among the images drawn in the image memory;
When an instruction operation for changing the display state of the image on the display unit is accepted, the position of the predetermined range is changed based on the instruction operation, and when the change satisfies a certain condition, the reference image is A control unit that changes each of the images drawn in the image memory to another image, arranges the neighboring images related to the changed reference image in the order according to the order, and causes the drawing unit to draw An image processing apparatus.   2. The control unit according to claim 1, wherein when the instruction operation is received, the control unit changes the number of the neighboring images related to the reference image after the change according to the type of the instruction operation, and causes the drawing unit to draw. Image processing device. The drawing unit draws the reference image and the neighboring image in a specific direction according to the order in the image drawing area in the image memory,
The control unit, when the reference image is changed, if all the neighboring images related to the changed reference image cannot be drawn side by side in the specific direction in the image drawing area according to the order, the neighboring image that cannot be drawn 2. The image processing apparatus according to claim 1, wherein the image is drawn at the other end of the specific direction in the image drawing area according to the order. The drawing unit draws the same image as the reference image or the neighboring image drawn at one end of the specific direction in the image drawing region at the other end of the specific direction in the image drawing region. ,
When the predetermined range changed based on the instruction operation reaches one end of the specific direction in the image drawing area, the control unit determines the predetermined range as the specific direction in the image drawing area. The image processing apparatus according to claim 3, wherein the image processing apparatus is moved to the other end.   The drawing unit sets a drawing area at the other end in the specific direction in the image drawing area in which the same image as the reference image or the neighborhood image drawn at the one end is drawn within the predetermined range. The image processing apparatus according to claim 4, wherein the image processing apparatus is substantially the same as the maximum size.   The control unit causes the drawing unit to newly draw only a neighboring image that is not drawn in the image memory among the neighboring images related to the changed reference image when the reference image is changed. The image processing apparatus described. An operation receiving unit that receives, as the instruction operation, an operation content for scrolling the plurality of images on the display unit;
The image processing apparatus according to claim 1, wherein the display control unit moves the predetermined range based on the instruction operation and scrolls and displays each image drawn in the image memory on the display unit. The plurality of images are images representing content,
The image processing apparatus according to claim 1, wherein the drawing unit specifies the order based on attribute information associated with the content. The plurality of images are thumbnail images representing content,
The drawing unit draws the reference image and the neighborhood image according to the order by an array for displaying a content selection screen for selecting the content,
The display control unit includes the content selection screen including a plurality of thumbnail images included in the predetermined range by including a plurality of thumbnail images among the thumbnail images drawn in the image memory. The image processing apparatus according to claim 1, wherein the image processing apparatus is displayed on the screen. For a plurality of images whose order is specified based on a predetermined rule, one of the plurality of images is drawn as a reference image in an image memory, and the reference image is positioned in front of the reference image in the order. A predetermined number of images consecutive from the reference image and a predetermined number of images located after the reference image in the order and continuing from the reference image are arranged in the reference image according to the order as neighboring images related to the reference image. Drawing procedure to draw in memory;
A display control procedure for causing the display unit to display an image included in a predetermined range among the images drawn in the image memory;
When an instruction operation for changing the display state of the image on the display unit is accepted, the position of the predetermined range is changed based on the instruction operation, and when the change satisfies a certain condition, the reference image is A control procedure for changing to another image among the images drawn in the image memory, and causing the drawing unit to draw the neighboring images related to the changed reference image in the changed reference image according to the order. Image processing method. For a plurality of images whose order is specified based on a predetermined rule, one of the plurality of images is drawn as a reference image in an image memory, and the reference image is positioned in front of the reference image in the order. A predetermined number of images consecutive from the reference image and a predetermined number of images located after the reference image in the order and continuing from the reference image are arranged in the reference image according to the order as neighboring images related to the reference image. Drawing procedure to draw in memory;
A display control procedure for causing the display unit to display an image included in a predetermined range among the images drawn in the image memory;
When an instruction operation for changing the display state of the image on the display unit is accepted, the position of the predetermined range is changed based on the instruction operation, and when the change satisfies a certain condition, the reference image is A control procedure for changing to another image among the images drawn in the image memory and arranging the neighboring images related to the changed reference image in the order in the order of the changed reference images and drawing them on the drawing unit A program to be executed.

Images