JP2014160989A - Display device, display method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display device, a display method, and a program which enables satisfactory visual recognition of a stereoscopic image of an anaglyph system.SOLUTION: An imaging device 1 has a display section 60 which can display a stereoscopic image of an anaglyph system using two pieces of image data having a parallax respectively to a subject. The imaging device 1 has a display control section 72 which controls a display state of the stereoscopic image which the display section 60 displays on the basis of optical characteristics of two filters which transmit light in wavelength bands different from each other which are arranged in glasses of the anaglyph system.

Description

  The present invention relates to a display device, a display method, and a program for displaying an anaglyph three-dimensional image.

  2. Description of the Related Art Conventionally, an image processing apparatus that acquires two image data having parallax for the same subject and generates stereoscopic image data (hereinafter referred to as “3D image data”) using the acquired two image data. It is known (see Patent Document 1). In this technique, unnatural 3D image data having excessive parallax is converted into 3D having appropriate parallax by rotating or moving at least one of two images corresponding to the two image data according to the parallax direction. Correct to image data.

  Incidentally, in recent years, with the spread of 3D televisions, 3D monitors, and the like that can display stereoscopic images (hereinafter referred to as “3D images”), imaging devices equipped with a stereoscopic imaging function are increasing. As a reproduction display method applicable to an image pickup apparatus equipped with such a stereoscopic photographing function, a frame sequential method, an anaglyph method, a parallax barrier method, or the like can be considered. Of these, the frame-sequential method must display left and right images with different parallax alternately in time series, and in order to display them as 3D images, dedicated electronic control glasses are required, It was difficult to apply to a standard imaging device. In contrast, in the anaglyph method, two image data having parallax with respect to the same subject are reproduced by superimposing them after performing special image processing, respectively, and having, for example, red and blue color filters on the left and right (Hereinafter, referred to as “anaglyph glasses”) allows a user to visually recognize a 3D image corresponding to 3D image data, and can be easily applied to a standard imaging apparatus with a low cost and a simple configuration.

JP 2010-232911 A

  By the way, the above-described anaglyph method requires the user to visually recognize each image with both eyes in order to visually recognize the optimal 3D image. However, the anaglyph glasses convert the color of the image into black or another color according to the optical characteristics of the filter and transmit it. For this reason, there is a problem in that, depending on the image, the user cannot visually recognize one of the images, so that a stereoscopic effect cannot be obtained and an unnatural 3D image is visually recognized.

  The present invention has been made in view of the above, and an object thereof is to provide a display device, a display method, and a program that allow a user to visually recognize a natural 3D image.

  In order to solve the above-described problems and achieve the object, a display device according to the present invention includes a display unit capable of displaying an anaglyph stereoscopic image using two image data having parallax with respect to the same subject. A display device provided with an anaglyph-type eyeglass that controls the display mode of the stereoscopic image displayed by the display unit based on optical characteristics of two filters that transmit light in different wavelength bands. A display control unit is provided.

  In the display device according to the present invention as set forth in the invention described above, the display control unit changes at least part of the color or shape of the stereoscopic image.

  In the display device according to the present invention, the anaglyph stereoscopic image is obtained using the image acquisition unit that acquires the two image data and the two image data acquired by the image acquisition unit. A stereoscopic image generation unit that generates data; and an operation information generation unit that generates operation information related to the display device, wherein the display control unit generates the stereoscopic image data generated by the stereoscopic image generation unit. Is displayed on the display unit, and the operation information is superimposed on the stereoscopic image in a color that can be identified by the two filters, and is displayed on the display unit.

  The display device according to the present invention further includes a color detection unit that detects a color of a display region in which the operation information is superimposed on the stereoscopic image, and the display control unit includes the color detection unit. The operation information is displayed on the display unit in a color separable from the detected color of the display area.

  In the display device according to the present invention as set forth in the invention described above, the color detection unit divides the display region into a plurality of color regions for each color, and the area ratio and the visual recognition of the color region among the plurality of color regions. A color of a color area having a value based on an index larger than a predetermined value is detected as a color of the display area.

  The display device according to the present invention further includes an operation input unit capable of receiving an input of an instruction signal for selecting any of the plurality of operation information displayed on the display unit in the above invention, and the display control unit includes: The shape of the operation information selected according to the instruction signal input from the operation input unit is changed to a shape distinguishable from other operation information and displayed on the display unit.

  In the display device according to the present invention, the shape is any one of a polygon, a circle, an ellipse, a shape formed by connecting semicircles with a straight line, a cloud shape, a star shape, and a polygon having rounded corners. It is characterized by being.

  Further, in the display device according to the present invention, in the above invention, the operation information includes a menu indicating a warning information indicating a warning regarding the display device, a warning information indicating a warning regarding the display device, and a menu executable by the display device. It is at least one of information.

  The display device according to the present invention includes an image acquisition unit that acquires the two image data and two images corresponding to the two image data acquired by the image acquisition unit. Change the color space variable of the two image data so that the main subject detected by the main subject detection unit can be identified with respect to the main subject detection unit for detecting the subject and the background included in each of the two images. A color space changing unit that performs the color space changing process, and a stereoscopic image that generates the anaglyph stereoscopic image data using the two image data that the color space changing unit has performed the color space changing process. A generation unit, wherein the display control unit causes the display unit to display a stereoscopic image corresponding to the stereoscopic image data generated by the stereoscopic image generation unit. To.

  In the display device according to the present invention as set forth in the invention described above, the color space variable is luminance.

  In the display device according to the present invention as set forth in the invention described above, the color space variable is any one of saturation, hue, and white balance.

  The display device according to the present invention further includes an operation input unit that receives an input of an instruction signal instructing the color space changing unit to execute the color space changing process, wherein the color space changing unit includes: When the instruction signal is input from the operation input unit, the color space changing process is executed.

  The display device according to the present invention further includes an imaging unit that captures an image of the subject, receives a subject image formed by imaging light from the subject, and performs photoelectric conversion to generate image data. The image acquisition unit includes two pieces of image data generated at different positions by the image pickup unit, and two pieces of image data in which one end in the left-right direction of each field of view overlaps each other. It acquires from the said imaging part.

  In the display device according to the present invention, in the above-described invention, the optical axes of the display devices are arranged in parallel so that their optical axes are parallel or at a predetermined angle, and a subject image formed by imaging a light beam from the subject is received and photoelectrically converted. The image acquisition unit further includes an imaging unit that generates the two image data, and the image acquisition unit acquires the two image data generated by the imaging unit simultaneously imaging the subject from the imaging unit. And

  The display device according to the present invention is characterized in that, in the above invention, the imaging unit is detachable from the display device.

  The display device according to the present invention further includes a recording unit that records the two image data in the above-described invention, and the image acquisition unit acquires the two image data from the recording unit. To do.

  The display device according to the present invention further includes an external input unit that obtains the two image data from the outside of the display device in the above invention, and the image acquisition unit receives the two image data from the external input unit. It is characterized by acquiring.

  In the display device according to the present invention, only one of the display mode change mode for changing the display mode of the display unit or the two images corresponding to the two image data is displayed on the display unit. A mode changeover switch unit for receiving an input of a mode instruction signal for instructing a two-dimensional image display mode to be performed, and the display control unit is configured to display the display mode according to the mode instruction signal input from the mode changeover switch unit. It is characterized by changing.

  The display method according to the present invention is a display method executed by a display device including a display unit capable of displaying an anaglyph stereoscopic image using two image data having parallax with respect to the same subject. A display control step of controlling a display mode of the stereoscopic image displayed by the display unit based on optical characteristics of two filters that transmit light of different wavelength bands provided in the anaglyph glasses. It is characterized by.

  A program according to the present invention is a program that is executed by a display device that includes a display unit capable of displaying an anaglyph stereoscopic image using two image data having parallax with respect to the same subject. A display control step for controlling a display mode of the stereoscopic image displayed by the display unit based on optical characteristics of two filters that transmit light of different wavelength bands provided in the glasses of the system. Features.

  According to the present invention, the display control unit changes the display mode of the display unit according to the two filters that transmit light of different wavelength bands provided in the anaglyph type glasses. The 3D anaglyph image can be visually recognized.

FIG. 1 is a block diagram schematically showing the configuration of the imaging apparatus according to the first embodiment of the present invention. FIG. 2 is a flowchart illustrating an outline of processing executed by the imaging apparatus according to the first embodiment of the present invention. FIG. 3 is a flowchart showing an outline of the normal reproduction process of FIG. FIG. 4 shows a state in which the display control unit of the imaging apparatus according to the first embodiment of the present invention visually recognizes the state where the operation information is superimposed on the 2D image and displayed on the display unit through the anaglyph glasses. It is a figure which shows typically the image visually recognizable at the time. FIG. 5 is a diagram illustrating a list of colors that can be visually recognized through the filters with respect to the colors displayed by the display unit of the imaging apparatus according to the first embodiment of the present invention. FIG. 6 is a diagram showing a list of colors that can be visually recognized through the anaglyph glasses. FIG. 7 is a flowchart showing an outline of the anaglyph compatible reproduction process of FIG. FIG. 8 shows a state in which the display control unit of the imaging apparatus according to the first embodiment of the invention visually recognizes the state where the operation information is superimposed on the 3D image and displayed on the display unit through the anaglyph glasses. It is a figure which shows typically the image visually recognizable. FIG. 9 shows a state in which the display control unit of the imaging apparatus according to the first embodiment of the invention displays an anaglyph on the display unit by superimposing a normal icon as operation information on the anaglyph 3D image. It is a figure which shows typically the image visually recognizable when visually recognizing through spectacles. FIG. 10 shows a state in which the display control unit of the imaging apparatus according to the first embodiment of the invention displays an anaglyph on the display unit by superimposing a normal icon as operation information on the anaglyph 3D image. It is a figure which shows typically the image visually recognizable when visually recognizing through spectacles. FIG. 11 is a block diagram schematically showing the configuration of the imaging apparatus according to the second embodiment of the present invention. FIG. 12 is a diagram illustrating an example of a visual index table indicating a visual index obtained by indexing a change in visibility due to an overlap between the background color and the color of operation information. FIG. 13 is a diagram showing the three primary colors of light. FIG. 14A is a diagram illustrating an example of a visual index table indicating a visual index obtained by indexing a change in visibility due to an overlap between a background color and an operation information color when viewed through the left eye of anaglyph glasses. FIG. 14B is a diagram illustrating an example of a visual index table indicating a visual index obtained by indexing a change in visibility due to an overlap between a background color and an operation information color when viewed through the right eye of anaglyph glasses. FIG. 15 is a flowchart illustrating an outline of the anaglyph compatible reproduction process executed by the imaging apparatus according to the second embodiment of the present invention. FIG. 16 is a flowchart showing an overview of the background image modeling process of FIG. FIG. 17 is a diagram illustrating an example of a state where the display area of the operation information to be superimposed on the 3D image is modeled for each color by the modeling unit of the imaging apparatus according to the second embodiment of the present invention. FIG. 18 illustrates a case where the background color index calculating unit and the visual index calculating unit of the imaging apparatus according to the second embodiment of the present invention calculate the background index and the visual index using the visual index information recorded by the visual index recording unit. It is a figure which shows an example of calculation of. FIG. 19 shows an anaglyph glasses when the display control unit of the imaging apparatus according to the second embodiment of the present invention superimposes operation information on a normal anaglyph 3D image and displays it on the display unit. It is a figure which shows typically the image visually recognizable when visually recognizing via. FIG. 20 shows a state in which the display control unit of the imaging apparatus according to the second embodiment of the present invention superimposes the operation information generated by the operation information generation unit on the 3D image and displays it on the display unit. It is a figure which shows typically the image visually recognizable when visually recognizing via anaglyph glasses. FIG. 21 is a block diagram schematically illustrating the configuration of the imaging apparatus according to the third embodiment of the present invention. FIG. 22 is a flowchart showing an outline of an anaglyph compatible reproduction process executed by the imaging apparatus according to the third embodiment of the present invention. FIG. 23 is a diagram schematically illustrating an outline of a correction method executed by the luminance component correction unit according to the third embodiment of the present invention. FIG. 24 is a diagram schematically illustrating an outline of a correction method executed by the luminance component correction unit according to the third embodiment of the present invention. FIG. 25 shows a state in which the display control unit of the imaging apparatus according to the third embodiment of the present invention visually recognizes a normal anaglyph 3D image on the display unit through the anaglyph glasses. It is a figure which shows typically the image which can be visually recognized. FIG. 26 shows a state where the display control unit of the imaging apparatus according to the third embodiment of the present invention displays the 3D image whose color space is converted by the color space changing unit on the display unit. It is a figure which shows typically the image visually recognizable when visually recognizing via.

  DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments for carrying out the present invention (hereinafter referred to as “embodiments”) will be described with reference to the drawings. In the following description, an imaging apparatus equipped with the display device of the present invention will be described as an example. Further, the present invention is not limited by this embodiment. Further, in the description of the drawings, the same portions will be described with the same reference numerals.

(Embodiment 1)
FIG. 1 is a block diagram schematically showing the configuration of the imaging apparatus according to the first embodiment of the present invention. The imaging device 1 illustrated in FIG. 1 includes an imaging unit 10, an external I / F 20, an operation input unit 30, an image processing unit 40, a recording unit 50, a display unit 60, and a control unit 70.

  The imaging unit 10 images a subject and generates image data of the subject. The imaging unit 10 collects light from a predetermined field of view and forms an image, and receives an object image focused by the optical system and forms an image on the imaging surface to perform photoelectric conversion. An image sensor such as a CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor) that converts the signal into an electrical signal (analog signal) and a signal process such as amplification (gain adjustment) on the electrical signal output from the image sensor An analog front-end circuit; and an A / D conversion circuit that converts an electrical signal output from the analog front-end circuit into digital image data by performing A / D conversion. Note that the imaging unit 10 may apply a binocular system that captures an image of a subject from different positions and has one end in the left-right direction of each field of view overlapping and capable of generating two image data.

  The external I / F 20 is a communication interface through which various data including image data is input by communicating with other devices. The external I / F 20 may receive various data including image data by performing wireless communication with other devices in accordance with a predetermined wireless communication standard.

  The operation input unit 30 includes a power switch 31 that receives an input of an instruction signal that drives the imaging apparatus 1, a release switch 32 that receives an input of a release signal that gives an instruction to shoot, and various shooting mode switches set in the imaging apparatus 1. Mode switch 33 that accepts an input of a switching signal that gives an instruction for the image, setting switch 34 that accepts an input of a setting signal for setting various parameters of the imaging apparatus 1, and reproduction of image data recorded by the recording unit 50 on the display unit 60 And a reproduction switch 35 for receiving an input of an instruction signal to be displayed.

  The image processing unit 40 acquires image data from any of the imaging unit 10, the external I / F 20, and the recording unit 50 via the control unit 70, and performs various types of image processing on the acquired image data. The image processing unit 40 includes an image acquisition unit 41, a 3D image generation unit 42, a color detection unit 43, and an operation information generation unit 44.

  The image acquisition unit 41 acquires two pieces of image data having parallax with respect to the same subject from any of the imaging unit 10, the external I / F 20, and the recording unit 50 via the control unit 70. Here, the two image data are right-eye image data and left-eye image data. Further, the image acquisition unit 41 acquires one image data from any of the imaging unit 10, the external I / F 20, and the recording unit 50 via the control unit 70.

  The 3D image generation unit 42 generates anaglyph 3D image data using the two image data acquired by the image acquisition unit 41. Specifically, the 3D image generation unit 42 extracts the magenta component and the yellow component from the left-eye image data, respectively, and combines the extracted magenta component and yellow component. While anaglyph-type left-eye image data is generated, a cyan component is extracted from the right-eye image data, and anaglyph-type right-eye image data is generated from the extracted cyan component.

  The color detection unit 43 detects color components included in two images corresponding to the two image data acquired by the image acquisition unit 41 and outputs the detection result to the operation information generation unit 44. Specifically, the color detection unit 43 detects the color of the display area in which operation information related to the imaging device 1 described later is superimposed on the 3D image, and outputs the detection result to the operation information generation unit 44. The color detection unit 43 may detect a color component for each pixel constituting the 3D image and output the detection result to the operation information generation unit 44.

  Based on the instruction signal input from the operation input unit 30 and the detection result input from the color detection unit 43, the operation information generation unit 44 uses the anaglyph method operation information (operation data) related to the imaging device 1 to be superimposed on the 3D image. ) And the generated operation information is output to the control unit 70. Here, the operation information includes caution information indicating a caution regarding the imaging apparatus 1, warning information indicating a warning regarding the imaging apparatus 1, and menu information indicating a menu executable by the imaging apparatus 1. In addition, when the display unit 60 displays a normal 2D image, the operation information generation unit 44 generates operation information related to the imaging device 1 according to the instruction signal input from the operation input unit 30, and the generated operation information Is output to the control unit 70.

  The recording unit 50 includes a program recording unit 51 that records various programs executed by the imaging apparatus 1 and a program executed by the image processing unit 40, and image data captured by the imaging unit 10 (for example, RAW data or compressed data by the JPEG method). The image processing unit 40 includes 3D image data subjected to image processing and an image data recording unit 52 that records 2D image data. The recording unit 50 includes a semiconductor memory such as a flash memory and a DRAM (Dynamic Random Access Memory) that is fixedly provided inside the imaging apparatus 1 and a memory card that is mounted from outside the imaging apparatus 1 via an I / F (not shown). It is configured using.

  The display unit 60 displays a 2D image or a 3D image corresponding to the image data under the control of the control unit 70. The display unit 60 is configured using a display panel made of liquid crystal or organic EL (Electro Luminescence), a display drive driver, and the like. Here, for image display, a post-shooting confirmation display immediately after shooting (hereinafter referred to as “rec view display”), a playback display for playing back image data recorded in the recording unit 50, and the imaging unit 10 are continuously provided. This includes live view image display that sequentially displays live view images corresponding to the image data to be generated in time series. Here, the REC view display is to display image data immediately after shooting for a predetermined time (for example, 3 seconds). Further, the display unit 60 appropriately displays operation information of the imaging apparatus 1 and information related to photographing under the control of the control unit 70.

  The control unit 70 performs overall control of the operation of the imaging device 1 by transferring control signals and various data to each unit constituting the imaging device 1. The control unit 70 is configured using a CPU (Central Processing Unit) or the like. Here, a detailed configuration of the control unit 70 will be described. The control unit 70 includes a shooting control unit 71 and a display control unit 72.

  When a release signal is input via the release switch 32, the shooting control unit 71 performs control to start a shooting operation in the imaging device 1. Here, the imaging operation in the imaging apparatus 1 is an operation in which at least the image processing unit 40 performs predetermined processing on image data (RAW data or the like) output from the imaging unit 10 by driving the imaging unit 10. Say. The image data thus processed is recorded in the recording unit 50 by the imaging control unit 71.

  The display control unit 72 displays a 3D image corresponding to 3D image data input from the image processing unit 40 or an image corresponding to normal image data that is not a stereoscopic image (hereinafter referred to as “2D image”) on the display unit 60. Control the display. Specifically, when displaying a 3D image on the display unit 60, the display control unit 72 causes the display unit 60 to display a 3D image corresponding to the 3D image data generated by the image processing unit 40. On the other hand, when displaying a 2D image on the display unit 60, the display control unit 72 displays a 2D image corresponding to the 2D image data generated by the image processing unit 40 on the display unit 60. In addition, the display control unit 72 controls the display mode of the stereoscopic image displayed by the display unit 60 based on the optical characteristics of the two filters that transmit light in different wavelength bands provided in the anaglyph glasses. Further, the display control unit 72 causes the display unit 60 to display the operation information corresponding to the anaglyph method generated by the operation information generation unit 44 on the 3D image displayed by the display unit 60.

  Processing executed by the imaging apparatus 1 having the above configuration will be described. FIG. 2 is a flowchart illustrating an outline of processing executed by the imaging apparatus 1.

  As shown in FIG. 2, first, when the power switch 31 is operated by the user and the power of the imaging apparatus 1 is turned on, the control unit 70 performs initialization processing of the imaging apparatus 1 (step S101). Initialization for clearing an operation flag for enabling the auto power off function of the imaging apparatus is performed.

  Subsequently, when the imaging device 1 is set to the imaging mode (step S102: Yes), the imaging control unit 71 drives the imaging unit 10 in accordance with the release signal input from the release switch 32 to perform imaging. The image data is generated in the unit 10, and the image processing unit 40 performs image processing on the image processing unit 40 and records it in the recording unit 50 (step S 103).

  Thereafter, when the power switch 31 is operated and the power of the imaging apparatus 1 is turned off (step S104: Yes), the control unit 70 returns the processing of setting each flag to the initial state and the imaging unit 10 to the initial state. An end process is executed (step S105). For example, the control unit 70 performs a process of moving the optical system of the imaging unit 10 to the initial position. After step S105, the imaging apparatus 1 ends this process. On the other hand, when the power switch 31 is not operated and the power of the imaging device 1 is not turned off (step S104: No), the imaging device 1 returns to step S102.

  In step S102, when the imaging device 1 is not set to the shooting mode (step S102: No), when the imaging device 1 is set to the anaglyph reproduction mode (step S106: Yes), the imaging device 1 will be described later. The process proceeds to step S108. On the other hand, when the imaging device 1 is not set to the anaglyph playback mode (step S106: No), the imaging device 1 proceeds to step S107 described later.

  In step S <b> 107, the imaging apparatus 1 executes normal reproduction processing for displaying a 2D image corresponding to normal image data recorded in the image data recording unit 52 of the recording unit 50 on the display unit 60. Details of the normal reproduction process will be described later. After step S107, the imaging apparatus 1 proceeds to step S104.

  In step S <b> 108, the imaging apparatus 1 executes an anaglyph compatible reproduction process in which a 3D image corresponding to the 3D image data recorded in the image data recording unit 52 of the recording unit 50 is displayed on the display unit 60. The details of the anaglyph compatible reproduction process will be described later. After step S108, the imaging apparatus 1 proceeds to step S104.

  Next, the normal reproduction process in step S107 in FIG. 2 will be described. FIG. 3 is a flowchart showing an outline of the normal reproduction process.

  As shown in FIG. 3, the image acquisition unit 41 acquires image file data to be reproduced from the image data recording unit 52 (step S201). For example, the image acquisition unit 41 acquires the latest image file data from among a plurality of image file data recorded in the image data recording unit 52 as image file data to be reproduced.

  Subsequently, the display control unit 72 generates a 2D image corresponding to the image data subjected to the image processing by the image processing unit 40 by using the normal setting (OSD; On Screen Display) setting by the operation information generation unit 44. The displayed operation information is superimposed and displayed on the display unit 60 (step S202).

FIG. 4 shows an image that can be seen when the user visually recognizes via the anaglyph glasses 100 with respect to the state in which the display control unit 72 displays the operation information superimposed on the 2D image W1 _LR on the display unit 60. It is a figure shown typically. FIG. 5 is a diagram illustrating a list of colors that can be visually recognized through the filters with respect to the colors displayed on the display unit 60. FIG. 6 is a diagram showing a list of colors that can be visually recognized through the anaglyph glasses. In the first embodiment, a case where a red filter for the left eye and a cyan filter for the left eye are used as two filters that transmit light in different wavelength bands as anaglyph glasses will be described. The filter of the anaglyph glasses may be magenta and green, for example, and can be changed as appropriate.

As illustrated in FIG. 4, the display control unit 72 causes the display unit 60 to display the operation information related to the imaging device 1 on the 2D image W1 _LR corresponding to the image data. Thereby, the user can grasp the operation information of the imaging apparatus 1 via the display unit 60 if the user is in the naked eye state. Further, the situation shown in FIG. 4 indicates in red that the message cannot be reproduced indicating that the image data recorded in the image file data designated via the operation input unit 30 cannot be reproduced and displayed. Further, the 2D image W1 _LR shown in FIG. 4 shows a state in which the background image is displayed in black and the operation information is displayed in red. Under such circumstances, when the user wears the anaglyph glasses 100 and visually recognizes the 2D image W1 _LR , the left eye visually recognizes the image W1 _L , while the right eye visually recognizes the image W1 _R. Specifically, as shown in the viewing table T1 of FIG. 5 and the viewing table T2 of FIG. 6, when the user visually recognizes the 2D image W1 _LR using the anaglyph glasses 100, red is converted to black by the cyan filter, In addition, since the background is black, the operation information is buried in the background, and the operation information cannot be visually recognized by the right eye.

  Returning to FIG. 3, the description of step S203 and subsequent steps will be continued. In step S <b> 203, the control unit 70 determines whether or not an instruction signal for changing the display of the operation information is input from the operation input unit 30. Specifically, the control unit 70 determines whether or not an imaging condition parameter, for example, an instruction signal for changing an aperture value is input from the setting switch 34 of the operation input unit 30. When the control unit 70 determines that an instruction signal for changing the display of the operation information is input from the operation input unit 30 (step S203: Yes), the imaging device 1 returns to step S202. On the other hand, when the control unit 70 determines that the instruction signal for changing the display of the operation information is not input from the operation input unit 30 (step S203: No), the imaging apparatus 1 proceeds to step S204.

  In step S204, when an instruction signal for changing the reproduced image is input from the operation input unit 30 (step S204: Yes), the imaging apparatus 1 returns to step S201. On the other hand, when the instruction signal for changing the reproduced image is not input from the operation input unit 30 (step S204: No), the imaging apparatus 1 proceeds to step S205.

  Subsequently, when an instruction signal for ending the reproduction mode is input from the operation input unit 30 (step S205: Yes), the imaging apparatus 1 returns to the main routine of FIG. On the other hand, when the instruction signal for ending the reproduction mode is not input from the operation input unit 30 (step S205: No), the imaging apparatus 1 returns to step S203.

  Next, the anaglyph compatible reproduction process in step S108 of FIG. 2 will be described. FIG. 7 is a flowchart showing an outline of an anaglyph compatible reproduction process.

  As shown in FIG. 7, the image acquisition unit 41 acquires image file data to be reproduced from the image data recording unit 52 (step S301). At this time, the image acquisition unit 41 acquires, from the image data recording unit 52, image file data in which two pieces of image data having parallax with respect to the subject are recorded.

  Subsequently, the 3D image generation unit 42 generates anaglyph 3D image data using the two image data included in the image file data acquired by the image acquisition unit 41 (step S302).

  Thereafter, the color detection unit 43 detects the color of the 3D image corresponding to the 3D image data generated by the 3D image generation unit 42 (step S303). Specifically, the color detection unit 43 detects the most used color in the pixel group constituting the 3D image. Note that the color detection unit 43 may detect the color of a predetermined region on the 3D image. Further, the color detection unit 43 may detect a color having the largest luminance component on the 3D image. Further, the color detection unit 43 may detect the color of the main subject area of the main subject or the background area of the background on the 3D image.

  Subsequently, the operation information generation unit 44 generates operation information corresponding to the color detected by the color detection unit 43 (step S304). Specifically, when the color detection unit 43 detects that the background is black, the operation information generation unit 44 generates operation information in a color that can be visually recognized by each filter of the anaglyph glasses 100, for example, white.

  Thereafter, the display controller 72 superimposes the operation information generated by the operation information generator 44 on the 3D image corresponding to the 3D image data generated by the 3D image generator 42 and causes the display 60 to display the information (Step 60). S305).

FIG. 8 shows an image that can be viewed when the user visually recognizes via the anaglyph glasses 100 with respect to the state in which the display control unit 72 displays the operation information superimposed on the 3D image W2 _LR on the display unit 60. It is a figure shown typically. Note that the 3D image W2 _LR shown in FIG. 8 shows a state in which the background is displayed in black and the operation information is displayed in white.

As illustrated in FIG. 8, the display control unit 72 causes the display unit 60 to display operation information related to the imaging device 1, for example, playback impossibility, on the 3D image W _< b _> 2 _LR . Under such circumstances, when the user wears the anaglyph glasses 100 and visually recognizes the 3D image W2 _LR , the left eye visually recognizes the image W2 _L , while the right eye visually recognizes the image W2 _R. Specifically, the user visually recognizes that reproduction as operation information is not possible with red in the left eye, and visually recognizes reproduction impossibility as operation information in cyan with the right eye. As a result, the user can visually recognize the operation information related to the imaging device 1 on the 3D image W2 _LR in white while viewing the 3D image W2 _LR stereoscopically.

  Returning to FIG. 7, the description from step S306 is continued. In step S306, when an instruction signal for changing the display of the operation information is input from the operation input unit 30 (step S306: Yes), the imaging apparatus 1 returns to step S303. On the other hand, when the instruction signal for changing the display of the operation information is not input from the operation input unit 30 (step S306: No), the imaging device 1 proceeds to step S307.

  Subsequently, when an instruction signal for changing the reproduced image is input from the operation input unit 30 (step S307: Yes), the imaging apparatus 1 returns to step S301. On the other hand, when the instruction signal for changing the reproduced image is not input from the operation input unit 30 (step S307: No), the imaging apparatus 1 proceeds to step S308.

  Thereafter, when an instruction signal for ending the reproduction mode is input from the operation input unit 30 (step S308: Yes), the imaging apparatus 1 returns to the main routine of FIG. On the other hand, when the instruction signal for ending the reproduction mode is not input from the operation input unit 30 (step S308: No), the imaging device 1 returns to step S306.

  According to the first embodiment of the present invention described above, the display control unit 72 changes the display mode of the display unit 60 according to the two filters that are provided in the anaglyph glasses 100 and transmit light in different wavelength bands. To do. Accordingly, the user can visually recognize the anaglyph 3D image in a good state.

  Further, according to Embodiment 1 of the present invention, the display control unit 72 displays operation information related to the imaging device 1 in a color that can be identified by the two filters of the anaglyph glasses 100 on the 3D image on the display unit 60. Let Thereby, even if it is a 3D image of an anaglyph system, the user can see the operation information regarding the imaging device 1 satisfactorily.

  Further, according to the first embodiment of the present invention, the display control unit 72 displays the operation information in a color separable from the color of the display area of the operation information superimposed on the 3D image detected by the color detection unit 43. 60. Thereby, the user can visually recognize the operation information better.

(Modification 1 of Embodiment 1)
In the first embodiment, the operation information generation unit 44 changes the shape and color of the icon indicating the operation information in accordance with the color component of the 3D image corresponding to the 3D image data detected by the color detection unit 43, thereby operating information. May be generated.

  FIG. 9 shows a state in which the display controller 72 visually recognizes an anaglyph type 3D image on the display unit 60 by superimposing a normal icon as operation information on the display unit 60 through the anaglyph glasses 100. It is a figure which shows typically the image which can be visually recognized. FIG. 10 shows a state in which the display control unit 72 of the imaging apparatus 1 according to the first modification of the first embodiment displays a normal icon as operation information on the anaglyph 3D image and displays it on the display unit 60. On the other hand, it is a figure which shows typically the image which can be visually recognized when a user visually recognizes via the anaglyph glasses 100.

As shown in FIG. 9, when the display unit 60 is displaying the normal icon A1~A4 as operation information to the 3D image W3 _LR, when the icon A2 is selected, the display control unit 72 is selected The icon A2 is highlighted (highlighted) in yellow compared to the other icons A1, A3, A4 and displayed on the display unit 60. Under such circumstances, as shown in FIG. 9, when the user wears anaglyph glasses 100 and visually recognizes the 3D image W3 _LR , the left eye visually recognizes the image W3 _L , while the right eye visually recognizes the image W3 _R. To do. However, in the 3D image W3 _LR , the display unit 60 displays the selected icon A2 in yellow and the icons A3 and A4 in magenta. In this case, if the user is naked, the combination is easy to distinguish between yellow and magenta, but if the user wears the anaglyph glasses 100 and sees it, the user will see the same color. Further, the icons A1 to A4 have the same shape. For this reason, it was difficult for the user to grasp the selected icon. Furthermore, since the shape of each icon displayed on the display unit 60 is the same, the user cannot easily grasp which one has been selected.

On the other hand, as shown in FIG. 10, when the display unit 60 displays an icon as operation information on the 3D image W4 _LR , the display control unit 72 uses the color detected by the color detection unit 43 from the 3D image W4 _LR. depending on the icon to change the icon distinguishable colors other operation information is superimposed on the 3D image W4 _LR is displayed on the display unit 60 on the operation information. Furthermore, the display control unit 72 changes the icon selected in accordance with the instruction signal input from the operation input unit 30 to a shape that can be distinguished from other icons as operation information, and causes the display unit 60 to display the icon. For example, as shown in FIG. 10, the display control unit 72 changes the icon A2 from a rectangular shape to an ellipse shape or a shape in which semicircles are connected by a straight line and causes the display unit 60 to display the icon A2.

  According to the first modification of the first embodiment of the present invention described above, the display control unit 72 is selected based on the color detected by the color detection unit 43 and the instruction signal input from the operation input unit 30. The icon color and shape are changed and displayed on the display unit 60. Accordingly, the user can easily grasp the selected operation information in a state where the selected operation information is identified from other operation information.

  In the first modification of the first embodiment of the present invention, the display control unit 72 displays the icon shape as the selected operation information on the display unit 60 in a shape in which an ellipse or a semicircle is connected by a straight line. However, it may be any one of a polygon, a circle, a cloud, a star, a polygon with rounded corners, and the like. Further, the display control unit 72 may display the icon frame as the operation information selected via the operation input unit 30 on the display unit 60 with emphasis, for example, a thick line or a dotted line, as compared with other icons. . In this case, the display control unit 72 may cause the display unit 60 to display the line color in a color that can be distinguished from the background.

(Embodiment 2)
Next, a second embodiment of the present invention will be described. The imaging apparatus according to the second embodiment has a different configuration from the imaging apparatus according to the first embodiment described above, and also has an anaglyph compatible reproduction process. Therefore, in the following, after describing the configuration of the imaging apparatus according to the second embodiment, an anaglyph compatible reproduction process executed by the imaging apparatus according to the second embodiment will be described. In addition, the same code | symbol is attached | subjected and demonstrated to the structure same as the imaging device 1 concerning Embodiment 1 mentioned above.

  FIG. 11 is a block diagram schematically showing the configuration of the imaging apparatus 2 according to the second embodiment of the present invention. An imaging apparatus 1 illustrated in FIG. 11 includes an imaging unit 10, an external I / F 20, an operation input unit 30, a display unit 60, a control unit 70, an image processing unit 200, and a recording unit 210.

  The image processing unit 200 acquires image data from any of the imaging unit 10, the external I / F 20, and the recording unit 210 via the control unit 70, and performs various types of image processing on the acquired image data. The image processing unit 200 includes an image acquisition unit 41, a 3D image generation unit 42, an operation information generation unit 44, and a color detection unit 201.

  The color detection unit 201 divides a display region in which operation information is superimposed on a 3D image into a plurality of color regions for each color, and the color of the color region having the largest area among the plurality of color regions is the color of the display region. Detect as. Here, the color detection unit 201 includes a modeling unit 201a, a background color index calculation unit 201b, a visual index calculation unit 201c, and a color setting unit 201d.

  The modeling unit 201a performs a modeling process for dividing the display area of the operation information related to the imaging device 2 to be superimposed on the 3D image into a plurality of color areas for each color. Specifically, the modeling unit 201a includes a luminance component, an RGB component (red, green, blue), a complementary color component (magenta, yellow, cyan), a white component, and a black component of each pixel of the 3D image. Is detected and digitized, and the operation information display area is divided into a plurality of color areas for each color using the numerical values.

  The background color index calculation unit 201b calculates a background color index for each operation information display area related to the imaging device 2 superimposed on the 3D image displayed by the display unit 60.

  The visual index calculation unit 201c calculates a visual index relative to the background index for each display area of the operation information superimposed on the 3D image displayed by the display unit 60.

  The color setting unit 201d is a color of operation information related to the imaging device 2 generated by the operation information generating unit 44 based on the background color index calculated by the background color index calculating unit 201b and the visual index calculated by the visual index calculating unit 201c. Set.

  The recording unit 210 includes a program recording unit 51, an image data recording unit 52, and a visual index recording unit 211.

  The visibility index recording unit 211 is based on the visibility index obtained by indexing the change in visibility due to the overlap of the background color and the color of the operation information, and the overlap of the background color when visually recognized through the anaglyph glasses 100 and the color of the operation information. The visibility index information including the visibility index obtained by indexing the change in visibility is recorded.

  FIG. 12 is a diagram illustrating an example of a visual index table indicating the visual index obtained by indexing the change in the visibility due to the overlap between the background color and the color of the operation information. FIG. 13 is a diagram showing the three primary colors of light. FIG. 14A is a diagram showing an example of a visual index table indicating a visual index obtained by indexing a change in visibility due to an overlap between the background color and the color of the operation information when viewed through the left eye (red) of the anaglyph glasses 100. It is. FIG. 14B is a diagram showing an example of a visual index table indicating a visual index obtained by indexing a change in visibility due to the overlap between the background color and the color of the operation information when viewed through the right eye (cyan) of the anaglyph glasses 100. It is.

The visual index shown in FIG. 12 is defined by the three primary colors of light shown in FIG. Specifically, as shown in FIG. 13, the visibility index is “0” when the color cannot be visually recognized with the same color in the RGB additive color mixture, and the adjacent color in the RGB additive color mixture can be visually recognized. Is “0.5”, and “1” is a color that can visually recognize colors other than adjacent colors in the additive color mixture of RGB. For example, when the background color is red and the operation information color is red, the visibility index is “0”, when the operation information color is magenta or yellow, “0.5”, and the operation information color is white or green. "1" for any of cyan, blue and black. Thus, the values in the visual index table T3 shown in FIG. 12 are defined by the three primary colors of light. The visual recognition index is not limited to “0”, “0.5”, “1”, and for example, “0”, “50”, “100”, “−1”, “0”, “+1”. Etc. may be used. Further, the visibility index may be defined by the three primary colors instead of the three primary colors of light.

  In the visibility index tables T4 and T5 shown in FIGS. 14A and 14B, values obtained by indexing changes in visibility due to the overlap between the background color and the color of the operation information are described. As described above, the background color index calculating unit 201b and the visual index calculating unit 201c calculate the indexes using the visual index tables T4 and T5, respectively.

  An anaglyph compatible reproduction process executed by the imaging apparatus 2 having the above configuration will be described. FIG. 15 is a flowchart illustrating an outline of the anaglyph compatible reproduction process executed by the imaging apparatus 2.

  As shown in FIG. 11, the image acquisition unit 41 acquires image file data to be reproduced from the image data recording unit 52 (step S401).

  Subsequently, the 3D image generation unit 42 generates anaglyph 3D image data using the two image data recorded in the image file data acquired by the image acquisition unit 41 (step S402).

  Thereafter, the color detection unit 201 executes background image modeling processing for modeling a background image in two images corresponding to two image data included in the image file data acquired by the image acquisition unit 41 for each color component. (Step S403).

  FIG. 16 is a flowchart showing an overview of the background image modeling process in step S403 of FIG.

  As illustrated in FIG. 16, the modeling unit 201a detects the luminance component and the RGB component of each pixel of the background image, and digitizes them from 0 to 255 (step S501).

  Subsequently, when the luminance component is 0 to 30 (step S502: Yes), the modeling unit 201a classifies and detects the target pixel as white (step S503). After step S503, the imaging apparatus 2 returns to the anaglyph compatible reproduction process of FIG.

  In step S502, if the luminance component is not 0 to 30 (step S502: No) and the luminance component is 215 to 255 (step S504: Yes), the modeling unit 201a classifies the target pixel as black and detects it. (Step S505). After step S505, the imaging apparatus 2 returns to the anaglyph compatible reproduction process of FIG.

  In step S504, when the luminance component is not 215 to 255 (step S504: No), the imaging device 2 proceeds to step S506.

  Subsequently, when the value difference of the RGB components is within 20 (step S506: Yes), the modeling unit 201a classifies the target pixel as black and detects it (step S507). After step S507, the imaging apparatus 2 returns to the anaglyph compatible reproduction process of FIG.

  If the difference between the RGB component values is not less than 20 in step S506 (step S506: No), and the difference between the largest value and the second value in the RGB components is 100 or more (step S508: Yes), the modeling unit The 201a classifies and detects the target pixel as one of the maximum values of R (red), G (green), and B (blue) (step S509). After step S509, the imaging apparatus 2 returns to the anaglyph compatible reproduction process of FIG.

  In step S508, when the difference between the largest value and the second value in the RGB components is not 100 or more (step S508: No), the modeling unit 201a combines the maximum color and the second color for the target pixel. It is classified and detected as any of cyan (C), magenta (M), and yellow (Y) (step S510). Thereafter, the imaging apparatus 2 returns to the anaglyph compatible reproduction process of FIG.

  Returning to FIG. 15, the description of step S404 and subsequent steps will be continued. In step S404, the background color index calculation unit 201b calculates a background color index for each display area of the operation information to be superimposed on the 3D image displayed by the display unit 60.

  Subsequently, the visual recognition index calculation unit 201c calculates a visual recognition index with respect to the background index for each display area of operation information superimposed on the 3D image displayed by the display unit 60 (step S405).

  FIG. 17 shows an example of a state where the display area of the operation information superimposed on the 3D image is modeled for each color by the modeling unit 201a. FIG. 18 is a diagram illustrating an example of calculation when the background color index calculating unit 201b and the visual index calculating unit 201c calculate the background index and the visual index using the visual index information recorded by the visual index recording unit 211. .

  As illustrated in FIGS. 17 and 18, the background color index calculation unit 201b uses the visual index information table T6 recorded by the visual index recording unit 211 to superimpose operation information on an image W5 modeled by the modeling unit 201a. A background color index is calculated for each of the color regions D1 to D3 in the display region R1. For example, as shown in FIG. 18, in the case of the left eye (red) of the anaglyph glasses 100, the background color index calculation unit 201b has an area ratio of the green / black color region D1 in the display region R1 of 25% and white color. When the area ratio of the area D2 is 30% and the area ratio of the cyan / black color area D3 is 45%, the background color index (70, 70, 30, 30, 30, 70, 70, 30) (see arrow A). Similarly, the background color index calculation unit 201b calculates a background color index for the right eye (cyan) of the anaglyph glasses 100 (see arrow A). Thereafter, the visual index calculation unit 201c calculates the visual index by adding the background color indexes of the left eye and the right eye of the anaglyph glasses 100 calculated by the background color index calculation unit 201b. Specifically, as shown in FIG. 18, in the case of white, the visual index calculation unit 201c calculates 70 for the background color index calculation unit 201b with the left eye and the background color index calculation unit 201b with the right eye for white. By adding 5, 82.5 is calculated as the visual index.

  In step S406, the color setting unit 201d sets the color of the operation information based on the background color index calculated by the background color index calculating unit 201b and the visual index calculated by the visual index calculating unit 201c. Specifically, as illustrated in FIG. 18, the color setting unit 201d sets the color of the operation information with reference to a visual index table T8 indicating the visual index calculated for each color by the visual index calculation unit 201c. Under the situation shown in FIG. 18, the color setting unit 201d sets red having the highest visual index as the color of the operation information (see arrow B).

  Subsequently, the operation information generation unit 44 generates operation information related to the imaging device 2 with the color set by the color setting unit 201d (step S407).

  Thereafter, the display control unit 72 displays the operation information generated by the operation information generation unit 44 on the display region R1 on the 3D image corresponding to the 3D image data generated by the 3D image generation unit 42 on the display unit R1. (Step S408). Thereby, even if the 3D image which the display part 60 displays is a background image, the user can visually recognize the operation information regarding the imaging device 2 satisfactorily.

  FIG. 19 is visible when the user visually recognizes the display unit 60 through the anaglyph glasses 100 with respect to the state in which the display information is displayed on the display unit 60 by superimposing the operation information on the normal anaglyph 3D image. It is a figure which shows a simple image typically. FIG. 20 shows that the display control unit 72 visually recognizes the state where the operation information generated by the operation information generation unit 44 is superimposed on the 3D image and displayed on the display unit 60 via the anaglyph glasses 100. It is a figure which shows typically the image visually recognizable at the time.

As shown in FIG. 19, when the display unit 60 displays the operation information (for example, a caution character) superimposed on yellow on the background 3D image W6 _LR , the user wears the anaglyph glasses 100. When the 3D image W6 _LR is viewed, the left eye passes through the red filter and thus the image W6 _L is viewed. On the other hand, the right eye passes through the cyan filter and W6 _R is viewed. However, as shown in FIG. 19, in the left eye, the operation information yellow of the image W6 _L blends into the background white, and in the right eye, the operation information yellow of the W6 _R blends into the background green. For this reason, the user cannot visually recognize the operation information in a good state.

On the other hand, as shown in FIG. 20, when the display control unit 72 superimposes the operation information generated by the operation information generation unit 44 on the 3D image W7 _LR and displays it on the display unit 60, the user When the anaglyph glasses 100 are worn and the 3D image W7 _LR is viewed, the left eye views the image W7 _L , while the right eye views the image W7 _R. Specifically, as shown in FIG. 20, the image W7 _R, a red operation information is visually separated from the background of the 3D image W7 _LR. Thereby, even if it is 3D image W7 _LR , the user can visually recognize operation information satisfactorily.

  Steps S409 to S411 correspond to steps S406 to S408 in FIG. 7, respectively.

  According to the second embodiment of the present invention described above, the operation information generated by the operation information generation unit 44 according to the color set by the color setting unit 201d by the display control unit 72 is displayed superimposed on the 3D image. Display on the unit 60. Thereby, the user can visually recognize good operation information.

  Further, according to the second embodiment of the present invention, the color detection unit 201 divides the display area into a plurality of color areas for each color, and the area ratio of the plurality of color areas, the visual index of the color area, and Since the color having the largest value based on is detected as the color of the display area, the operation information generation unit 44 can reliably generate operation information that can be visually recognized by the user.

(Embodiment 3)
Next, a third embodiment of the present invention will be described. The third embodiment has a different configuration from the imaging apparatus according to the first embodiment described above and an anaglyph compatible reproduction process. Therefore, in the following, after describing the configuration of the imaging apparatus according to the third embodiment, an anaglyph-compatible reproduction process executed by the imaging apparatus according to the third embodiment will be described.

  FIG. 21 is a block diagram schematically illustrating the configuration of the imaging apparatus according to the third embodiment. The imaging device 3 illustrated in FIG. 21 includes an imaging unit 10, an external I / F 20, an operation input unit 30, a recording unit 50, a display unit 60, a control unit 70, and an image processing unit 300.

  The image processing unit 300 acquires image data from the outside, performs predetermined image processing on the acquired image data, and outputs the image data to the control unit 70. The image processing unit 300 includes an image acquisition unit 41, a 3D image generation unit 42, a color detection unit 43, an operation information generation unit 44, a main subject specifying unit 301, and a color space changing unit 302.

  The main subject specifying unit 301 detects the main subject at the time of shooting in the image corresponding to the image data based on the shooting information included in the image file data acquired by the image acquisition unit 41 from the image data recording unit 52. Specifically, the main subject specifying unit 301 is based on metadata of image file data recorded in Exif (Exchangeable image file format), for example, focal length information indicating the focal length of the imaging unit 10, focus area information, or the like. The main subject at the time of shooting in the image is detected.

  The color space changing unit 302 can identify two main objects detected by the main subject specifying unit 301 with respect to backgrounds included in two images corresponding to the two image data acquired by the image acquiring unit 41, respectively. Change data color space variables. Specifically, the color space changing unit 302 changes the luminance component and the hue component as color space variables. Here, a detailed configuration of the color space changing unit 302 will be described. The color space changing unit 302 includes an edge detection unit 302a, a hue conversion unit 302b, and a Y component correction unit 302c.

  The edge detection unit 302a performs edge detection processing on the main subject specified by the main subject specifying unit 301 to detect the contour of the main subject. For example, the edge detection unit 302a detects the edge (contour) of the main subject by performing binarization processing on the image data.

Hue conversion unit 302b converts the 3D image data (RGB data) to the YC _r C _b data. A detailed conversion method by the hue conversion unit 302b will be described later.

  The Y component correction unit 302c corrects the Y component converted by the hue conversion unit 302b. Specifically, the Y component correction unit 302c performs correction to increase or decrease luminance by multiplying the Y component by a predetermined coefficient.

  An anaglyph compatible reproduction process executed by the imaging apparatus 3 having the above configuration will be described. FIG. 22 is a flowchart illustrating an outline of the anaglyph compatible reproduction process executed by the imaging apparatus 3.

  As shown in FIG. 22, the image acquisition unit 41 acquires image file data to be reproduced from the image data recording unit 52 (step S601).

  Subsequently, the 3D image generation unit 42 generates 3D image data by using the two image data recorded in the image file data acquired by the image acquisition unit 41 (step S602).

  Thereafter, the main subject specifying unit 301 selects the main object in the two images corresponding to the two image data based on the focal length information and the focus area information included in the head region of the image file data acquired by the image acquisition unit 41. A subject is specified (step S603).

  Subsequently, the edge detection unit 302a performs edge detection processing on the main subject specified by the main subject specifying unit 301 to detect the contour of the main subject (step S604). At this time, the edge detection unit 302a also performs edge detection processing on the Y component (luminance component), R component (red component), and cyan component (blue-green component) included in the main subject.

  Subsequently, the edge detection unit 302a compares the Y component outline, the R component outline, and the cyan component outline of the main subject and quantifies the different points (step S605).

Thereafter, when the numerical value of each component digitized by the edge detection unit 302a exceeds the threshold value (step S606: Yes), when the overall average luminance of the 3D image corresponding to the 3D image data is low (step S607: yes), color conversion unit 302b converts the 3D image data (RGB data) to the YC _r C _b data (step S608). Specifically, color conversion unit 302b has the following formula (1) to (3) for converting the 3D image data to YC _r C _b data.
Y = 0.299 + 0.587G + 0.114B (1)
C _r = 0.500R−0.419G−0.081B (2)
C _b = −0.169R−0.332G + 0.500B (3)
Y represents the value of the luminance component, and C _r and C _b represent the color difference values.

  Subsequently, the Y component correction unit 302c performs correction to increase the luminance of the Y component converted by the hue conversion unit 302b (step S609). For example, as shown in FIG. 23, the Y component correction unit 302c performs correction by multiplying the Y component converted by the hue conversion unit 302b by a coefficient of 1.5 (FIG. 23 (a) → FIG. 23 (b) → FIG. 23 (c)).

Then, color conversion unit 302b converts the YC _r C _b data Y component correcting section 302c has corrected Y component in the 3D image data (RGB data) (step S610). Specifically, color conversion unit 302b is by the following equation (4) to (6), converts the YC _r C _b data into 3D image data (FIG. 23 (c) → Fig. 23 (d)).
R = Y + 1.402C _r (4)
G = Y−0.714C _r −0.344C _b (5)
B = Y + 1.772C _b (6)

In step S606, when the numerical value of each component digitized by the edge detection unit 302a exceeds the threshold value (step S606: Yes), the overall average luminance of the 3D image corresponding to the 3D image data is not low ( step S607: No), color conversion unit 302b converts the 3D image data (RGB data) to the YC _r C _b data (step S611).

  Subsequently, the Y component correction unit 302c performs correction to reduce the luminance of the Y component converted by the hue conversion unit 302b (step S612). For example, as shown in FIG. 24, the Y component correction unit 302c performs correction by multiplying the Y component converted by the hue conversion unit 302b by a coefficient of 0.8 (FIG. 24 (a) → FIG. 24 (b) → FIG. 24 (c) After step S612, the imaging device 3 proceeds to step S610.

  In step S613, the display control unit 72 causes the display unit 60 to display a 3D image corresponding to the 3D image data converted by the hue conversion unit 302b.

  FIG. 25 schematically illustrates an image that can be visually recognized when the user visually recognizes through the anaglyph glasses 100 with respect to a state in which the display control unit 72 displays the normal anaglyph 3D image on the display unit 60. FIG. FIG. 26 is visible when the user visually recognizes through the anaglyph glasses 100 the display control unit 72 displaying the 3D image whose color space has been converted by the color space changing unit 302 on the display unit 60. It is a figure which shows a simple image typically.

As shown in FIG. 25, when the display unit 60 displays the 2D image W8, the green main subject P1, the blue background B1, and the green background B2 can be clearly identified with different colors. regardless (Figure 25 (a)), when the display unit 60 displays the 3D image W8 _LR of anaglyph method (FIG. 25 (b)), the user wearing the anaglyph glasses 100, the main object P1 in the left eye background B1 while viewing the image W8 _L which melted into B2, the right eye main object P1 is the image visible W8 _R state separated from the background B1, B2 (FIG. 25 (c)). However, as shown in FIG. 25C, in the image W8 _L , the main subject P1 is melted into the backgrounds B1 and B2. For this reason, the user cannot visually recognize an accurate 3D image.

In contrast, as shown in FIG. 26, the display control unit 72, 3D image data color conversion unit 302b is to convert the YC _r C _b data Y component is corrected by the Y component correcting section 302c (RGB data) Is displayed on the display unit 60 (FIG. 26 (a) → FIG. 26 (b)). Thus, when the user wears the anaglyph glasses 100 and visually recognizes the 3D image W9 _LR , the user visually recognizes the image W9 _L with the left eye and visually recognizes the image W9 _R with the right eye (FIG. 26C). Specifically, as shown in FIG. 26C, in the image W9 _L , the subject P1 is separated from the backgrounds B1 and B2. Thereby, the user can visually recognize a favorable 3D image in a state where there is no extreme color change. After step S613, the imaging apparatus 3 proceeds to step S614 described later.

  Subsequently, when an instruction signal for changing the reproduced image is input from the operation input unit 30 (step S614: Yes), the imaging device 3 returns to step S601. On the other hand, when the instruction signal for changing the reproduced image is not input from the operation input unit 30 (step S614: No), the imaging device 3 proceeds to step S615.

  Thereafter, when an instruction signal for ending the reproduction mode is input from the operation input unit 30 (step S615: Yes), the imaging device 3 returns to the main routine of FIG. On the other hand, when the instruction signal for ending the reproduction mode is not input from the operation input unit 30 (step S615: No), the imaging device 3 returns to step S613.

  According to the third embodiment of the present invention described above, since the display control unit displays the 3D image in the state where 72 main subjects are separated from the background on the display unit 60, an accurate 3D image is visually recognized. Can do.

  In the third embodiment, 1.5 is used as a coefficient to be multiplied by the Y component when the luminance is increased, or 0.8 is used as a coefficient to be multiplied by the Y component when the luminance is decreased. Is not limited to this value, and a larger or smaller value may be used as necessary.

  So far, the embodiment for carrying out the present invention has been described, but the present invention should not be limited only by the embodiment described above.

  For example, in the present invention, an electronic viewfinder may be provided separately from the display unit, and the present invention may be applied to this electronic viewfinder. In this case, it is more preferable that the appearance of the 3D anaglyph image is different between the display unit and the electronic viewfinder.

  In the present invention, the main body of the imaging device and the imaging unit may be formed separately.

  Further, in the present invention, a subject image in which the imaging units are arranged side by side on the same plane so that their optical axes are parallel or at a predetermined angle, images a subject at the same time, and images light rays from the subject is formed. It may be a twin-lens imaging unit that generates two image data having parallax by receiving light and performing photoelectric conversion.

  In addition to a digital single-lens reflex camera, an imaging device equipped with a display device according to the present invention includes, for example, a digital camera to which accessories can be attached, a digital video camera, a mobile phone having an imaging function, a tablet-type mobile device, and the like. It can also be applied to electronic devices.

  The program to be executed by the display device according to the present invention is file data in an installable format or executable format, and is a CD-ROM, flexible disk (FD), CD-R, DVD (Digital Versatile Disk), USB medium. And recorded on a computer-readable recording medium such as a flash memory.

  The program to be executed by the display device according to the present invention may be configured to be provided by being stored on a computer connected to a network such as the Internet and downloaded via the network. Furthermore, the program executed by the display device according to the present invention may be provided or distributed via a network such as the Internet.

  In the description of the flowchart in the present specification, the context of the processing between steps is clearly indicated using expressions such as “first”, “after”, “follow”, etc., in order to implement the present invention. The order of processing required is not uniquely determined by their representation. That is, the order of processing in the flowcharts described in this specification can be changed within a consistent range.

  As described above, the present invention can include various embodiments not described herein, and various design changes and the like can be made within the scope of the technical idea specified by the claims. Is possible.

1, 2, 3 Imaging device 10 Imaging unit 20 External I / F
DESCRIPTION OF SYMBOLS 30 Operation input part 31 Power switch 32 Release switch 33 Mode change switch 34 Setting switch 35 Playback switch 40,200,300 Image processing part 41 Image acquisition part 42 3D image generation part 43,201 Color detection part 44 Operation information generation part 50, 210 recording unit 51 program recording unit 52 image data recording unit 60 display unit 70 control unit 71 imaging control unit 72 display control unit 100 anaglyph glasses 201a modeling unit 201b background color index calculation unit 201c visual index calculation unit 201d color setting unit 211 visual index Recording unit 301 Main subject specifying unit 302 Color space changing unit 302a Edge detection unit 302b Hue conversion unit 302c Y component correction unit

Claims (20)

A display device including a display unit capable of displaying an anaglyph stereoscopic image using two image data having parallax with respect to the same subject,
A display control unit configured to control a display mode of the stereoscopic image displayed by the display unit based on optical characteristics of two filters that transmit light of different wavelength bands provided in the anaglyph type glasses; A display device.   The display device according to claim 1, wherein the display control unit changes a color or a shape of at least a part of the stereoscopic image. An image acquisition unit for acquiring the two image data;
A stereoscopic image generation unit that generates the anaglyph stereoscopic image data using the two image data acquired by the image acquisition unit;
An operation information generation unit for generating operation information related to the display device;
Further comprising
The display control unit displays a stereoscopic image corresponding to the stereoscopic image data generated by the stereoscopic image generation unit on the display unit, and displays the operation information in a color that can be identified by the two filters. The display device according to claim 1, wherein the display device is displayed on the display unit so as to be superimposed on a stereoscopic image. A color detection unit that detects a color of a display area on which the operation information is superimposed on the stereoscopic image;
The display device according to claim 3, wherein the display control unit displays the operation information on the display unit in a color separable from the color of the display area detected by the color detection unit.   The color detection unit divides the display region into a plurality of color regions for each color, and selects a color of a color region having a value based on an area ratio and a visibility index of the color region greater than a predetermined value among the plurality of color regions. The display device according to claim 4, wherein the display device detects the color of the display area. An operation input unit capable of accepting an input of an instruction signal for selecting any of the plurality of operation information displayed on the display unit;
The display control unit changes the shape of the operation information selected according to the instruction signal input from the operation input unit to a shape distinguishable from other operation information, and causes the display unit to display the shape. The display device according to claim 2, wherein the display device is a display device.   The display device according to claim 6, wherein the shape is any one of a polygon, a circle, an ellipse, a shape obtained by connecting semicircles with a straight line, a cloud shape, a star shape, and a polygon with rounded corners. .   The operation information is at least one of caution information indicating a caution regarding the display device, warning information indicating a warning regarding the display device, and menu information indicating a menu executable by the display device. The display apparatus as described in any one of Claims 3-7. An image acquisition unit for acquiring the two image data;
A main subject detection unit for detecting a main subject included in two images corresponding to the two image data acquired by the image acquisition unit;
Color space change for performing color space change processing for changing a color space variable of the two image data so that the main subject detected by the main subject detection unit can be identified with respect to backgrounds included in the two images, respectively. And
A stereoscopic image generation unit that generates the anaglyph stereoscopic image data using the two image data on which the color space change unit has performed the color space change process;
Further comprising
The display device according to claim 1, wherein the display control unit causes the display unit to display a stereoscopic image corresponding to the stereoscopic image data generated by the stereoscopic image generation unit.   The display device according to claim 9, wherein the color space variable is luminance.   The display device according to claim 9, wherein the color space variable is one of saturation, hue, and white balance. An operation input unit that receives an input of an instruction signal that instructs the color space change unit to execute the color space change process;
The display device according to claim 9, wherein the color space changing unit executes the color space changing process when the instruction signal is input from the operation input unit. An image pickup unit that picks up an image of the subject, receives a subject image formed by forming a light beam from the subject, and performs photoelectric conversion to generate image data;
The image acquisition unit includes two pieces of image data generated by the image pickup unit at different positions, and two pieces of image data in which one end in the horizontal direction of each field of view overlaps as the two pieces of image data. It acquires from an imaging part, The display apparatus as described in any one of Claims 3-12 characterized by the above-mentioned. An imaging unit that generates the two image data by receiving and photoelectrically converting a subject image in which light axes from the subject are formed in parallel so that their optical axes are parallel or at a predetermined angle. Prepared,
The display according to claim 3, wherein the image acquisition unit acquires the two image data generated by the imaging unit imaging the subject at the same time from the imaging unit. apparatus.   The display device according to claim 13 or 14, wherein the imaging unit is detachable from the display device. A recording unit for recording the two image data;
The display device according to claim 3, wherein the image acquisition unit acquires the two image data from the recording unit. An external input unit for obtaining the two image data from the outside of the display device;
The display device according to claim 3, wherein the image acquisition unit acquires the two image data from the external input unit. Input of a mode instruction signal for instructing a display mode change mode for changing the display mode of the display unit or a two-dimensional image display mode for displaying only one of the two images corresponding to the two image data on the display unit Further comprising a mode changeover switch unit for receiving
The display device according to claim 1, wherein the display control unit changes the display mode in accordance with the mode instruction signal input from the mode changeover switch unit. A display method executed by a display device including a display unit capable of displaying an anaglyph stereoscopic image using two image data having parallax with respect to the same subject,
Including a display control step of controlling a display mode of the stereoscopic image displayed by the display unit based on optical characteristics of two filters that transmit light in different wavelength bands provided in the anaglyph glasses. Characteristic display method. A program to be executed by a display device having a display unit capable of displaying an anaglyph stereoscopic image using two image data having parallax with respect to the same subject,
Executing a display control step for controlling a display mode of the stereoscopic image displayed by the display unit based on optical characteristics of two filters that transmit light of different wavelength bands provided in the anaglyph glasses. A program characterized by

Images