JP2012032964A - Display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display device that can be naturally operated by a user while accurately checking change in a 3D image displayed three-dimensionally.SOLUTION: There are provided a display unit 6 that displays a 3D image generated by combining two image data in which one end portions in a right/left direction of a field of view are overlapped with each other, a touch panel 7 that is provided on a display screen of the display unit 6, detects a region and a distance to the display screen of an object approaching from the outside, and receives input of a signal according to a result of the detection, a pop-up setting unit 93 that sets a distance of virtual pop-up of a 3D image in a direction vertical to the display screen in accordance with the signal received in a predetermined region by the touch panel 7 with respect to the 3D image displayed by the display unit 6, and a display control unit 95 that controls the display unit 6 to display the 3D image set by the pop-up setting unit 93.

Description

  The present invention relates to a display device that displays a three-dimensional image using two pieces of image data in which one end in the horizontal direction of each field of view overlaps.

  In recent years, a plurality of image data is acquired by photographing a same subject from different positions using a plurality of digital cameras, and a user can obtain a plurality of image data by using parallax of the subject included in the acquired plurality of image data. There is known a display device that displays a three-dimensional image (hereinafter referred to as “3D image”) that can be viewed stereoscopically.

  In such a display device, when a user operates a touch panel provided on the screen of the display monitor, an image displayed on the display monitor is switched between a 3D image and a two-dimensional image (hereinafter referred to as “2D image”). The technique which can do is known (refer patent document 1). In this technique, an image of an area corresponding to a position touched by a touch panel by a user is switched to a 2D image or a 3D image and displayed on a display monitor.

JP 2010-108203 A

  By the way, the touch panel with which the conventional display apparatus is equipped detects the position touched by the user planarly (plane coordinate), although the display monitor displays the 3D image. For this reason, a deviation occurs between the position touching the touch panel and the position touching the 3D image virtually popping out from the screen of the display monitor, and the user pops out the 3D image while virtually touching the 3D image. Could not be adjusted.

  The present invention has been made in view of the above, and an object of the present invention is to provide a display device that allows a user to operate naturally while correctly confirming a change in a 3D image displayed in three dimensions. .

  In order to solve the above-described problems and achieve the object, a display device according to the present invention provides a three-dimensional image generated by combining two pieces of image data in which one end in the left-right direction of each field of view overlaps. A display unit to be displayed, and a touch panel provided on the display screen of the display unit, which detects a region of an object approaching from the outside and a distance to the display screen, and receives a signal input according to the detection result And, for the three-dimensional image displayed by the display unit, a distance at which the three-dimensional image virtually jumps out in a vertical direction orthogonal to the display screen is set according to a signal received by the touch panel in a predetermined area. And a display control unit that controls the display unit to display the three-dimensional image set by the pop-up setting unit.

  The display device according to the present invention is the display device according to the above invention, wherein the image capturing unit generates two image data that are captured from different positions and in which one end in the horizontal direction of each field of view overlaps, and the image capturing unit generates A stereoscopic image generation unit that generates the three-dimensional image by cutting out the two images corresponding to the two image data with a predetermined aspect ratio, and the pop-out setting unit includes the stereoscopic image generation unit By changing the cut-out area of the two image data according to (2), the pop-out distance of the three-dimensional image is set, and the display control unit displays an image corresponding to the two image data set by the pop-up setting unit. The display screen is alternately arranged for each pixel in the horizontal direction and output to the display unit is performed.

  Further, in the display device according to the present invention, in the above invention, the pop-out setting unit determines the two image data cut-out areas by the stereoscopic image generation unit according to a signal received by the touch panel. A feature is that the parallax of the subject included in the image data is changed stepwise in a direction to reduce the parallax.

  The display device according to the present invention further includes an exposure adjustment unit that adjusts the exposure of the imaging unit according to a signal received by the touch panel for the three-dimensional image displayed by the display unit. The display control unit controls the display unit to display the three-dimensional image adjusted by the exposure adjustment unit.

  In the display device according to the present invention, in the above invention, a header information generation unit that generates the pop-out distance of the three-dimensional image set by the pop-out setting unit as header information of the two image data, and the imaging unit The image processing apparatus further includes a storage unit that stores the plurality of image data generated by and the header information generated by the header information generation unit in association with each other.

  Further, the display device according to the present invention includes a display unit that displays a three-dimensional operation image generated by combining two image data in which one end in the left-right direction of each field of view overlaps in a predetermined area; A touch panel that is provided on the display screen of the display unit, detects a region of an object approaching from the outside and a distance to the display screen, and receives an input of a signal according to the detection result, and the display unit displays A pop-out setting unit configured to set a distance for the three-dimensional operation image to be virtually popped out in a direction perpendicular to the display screen of the three-dimensional operation image designated by a signal received by the touch panel; A display control unit configured to control the display unit to display the three-dimensional operation image set by the setting unit; and the table according to a display change of the three-dimensional operation image. Parts is characterized in that and an image control unit that performs control to change the three-dimensional display mode of the image to be displayed.

  The display device according to the present invention further includes an imaging unit that captures images from different positions and generates two image data in which one end in the left-right direction of each field of view overlaps in the above-described invention, The unit alternately outputs an image corresponding to the two image data captured by the imaging unit for each pixel in the horizontal direction on the display screen, and outputs the image to the display unit. The three-dimensional display mode of an image corresponding to the two image data taken by is changed.

  According to the display device of the present invention, the touch panel detects the area of the object approaching from the outside and the distance to the display screen, receives an input of a signal according to the detection result, and the pop-out setting unit displays the display unit. For the 3D image displayed by the touch panel, the distance that the 3D image virtually jumps out in the vertical direction orthogonal to the display screen of the display unit is set according to the signal received by the touch panel, and the display control unit sets by the pop-up setting unit Control is performed so that the displayed 3D image is displayed on the display unit. Thereby, there is an effect that the user can operate naturally while correctly confirming the change of the 3D image displayed in three dimensions.

FIG. 1 is a block diagram showing a configuration of a display device according to an embodiment of the present invention. FIG. 2 is a schematic diagram illustrating a schematic configuration of a display unit included in the display device according to the embodiment of the present invention. FIG. 3 is a schematic diagram illustrating a schematic configuration of a touch panel included in the display device according to the embodiment of the present invention. FIG. 4 is a schematic diagram illustrating a situation when the imaging unit included in the display device according to the embodiment of the present invention generates two pieces of image data in which one end in the horizontal direction of each field of view overlaps. . FIG. 5 is a diagram illustrating an example of two images corresponding to two image data generated by the imaging unit under the situation illustrated in FIG. 4. FIG. 6 is a diagram illustrating an example of an image in which the right eye image and the left eye image generated by the imaging unit under the situation illustrated in FIG. 4 are virtually overlapped. FIG. 7 is a diagram illustrating the relationship between the imaging distance between the imaging unit and the subject under the situation illustrated in FIG. FIG. 8 is a flowchart showing an outline of processing performed by the display device according to the embodiment of the present invention. FIG. 9 is a schematic diagram when an icon provided in a virtual 3D image recognized by the user displayed on the display unit is operated. FIG. 10 is a schematic diagram illustrating a detection area detected by a touch panel included in the display device according to the embodiment of the present invention. FIG. 11 is a schematic diagram illustrating an outline of processing performed by the pop-out setting unit included in the display device according to the embodiment of the present invention. FIG. 12 is a diagram illustrating an example of an image in which the right-eye image and the left-eye image are virtually overlapped after the pop-out setting unit has set the cut-out area of the stereoscopic image generation unit. FIG. 13 is a diagram illustrating an example of a virtual 3D image recognized by the user set by the pop-out setting unit. FIG. 14 is a diagram illustrating an example of a virtual 3D image recognized by the user adjusted by the exposure adjustment unit. FIG. 15 is a flowchart showing an outline of the reproduction display process of FIG.

  DESCRIPTION OF EMBODIMENTS Hereinafter, modes for carrying out the present invention (hereinafter referred to as “embodiments”) will be described with reference to the drawings. The present invention is not limited to the embodiments described below. In the description of the drawings, the same parts are denoted by the same reference numerals.

  FIG. 1 is a block diagram showing a configuration of a display device according to an embodiment of the present invention. In this embodiment, a digital stereo camera equipped with a display device will be described as an example. As shown in FIG. 1, the display device 1 shoots images from different positions and generates two image data in which one end in the left-right direction of each field of view overlaps, and the posture of the display device 1. An attitude detection unit 3 to detect, an operation input unit 4 that receives input of various information of the display device 1, a clock 5 having a shooting date determination function and a timer function, and a display unit 6 that displays a 2D image or a 3D image The touch panel 7 that receives an input of a signal corresponding to the detection result and the image data generated by the imaging unit 2 are detected while detecting the distance to the area of the object approaching from the outside and the display screen of the display unit 6. A storage unit 8 that stores various types of information that is included, and a control unit 9 that controls the operation of the display device 1 are provided.

  The imaging unit 2 includes a first imaging unit 21 and a second imaging unit 22. The first imaging unit 21 and the second imaging unit 22 are arranged side by side on the same plane so that their optical axes L1 and L2 are parallel or have a predetermined angle.

  The first imaging unit 21 includes a lens unit 21a, a lens driving unit 21b, a diaphragm 21c, a diaphragm driving unit 21d, a shutter 21e, a shutter driving unit 21f, an imaging element 21g, and a signal processing unit 21h. . The lens unit 21a is configured by a focus lens, a zoom lens, or the like, and collects light from a predetermined visual field region. The lens driving unit 21b is configured by a DC motor or the like, and changes the focus position and focal length of the lens unit 21a by moving the focus lens, the zoom lens, and the like of the lens unit 21a on the optical axis L1. The diaphragm 21c adjusts the exposure by limiting the amount of incident light collected by the lens unit 21a. The aperture drive unit 21d is configured by a stepping motor or the like, and drives the aperture 21c. The shutter 21e sets the state of the image sensor 21g to an exposure state or a light shielding state. The shutter drive unit 21f is configured by a stepping motor or the like, and drives the shutter 21e according to the release signal. The imaging element 21g is realized by a CCD (Charge Coupled Device), a CMOS (Complementary Metal Oxide Semiconductor), or the like that receives the light collected by the lens unit 21a and converts it into an electrical signal (analog signal), and converts the converted electrical signal. It outputs to the signal processor 21h. The signal processing unit 21h performs signal processing such as amplification on the electrical signal output from the image sensor 21g, and then converts the digital signal to digital image data by performing A / D conversion, and outputs the digital image data to the control unit 9.

  The second imaging unit 22 is realized by the same configuration as the first imaging unit 21, and includes a lens unit 22a, a lens driving unit 22b, a diaphragm 22c, a diaphragm driving unit 22d, a shutter 22e, and a shutter driving unit 22f. The image sensor 22g and the signal processor 22h are included.

  The posture detection unit 3 includes an acceleration sensor, and detects the posture state of the display device 1 by detecting the acceleration of the display device 1. Specifically, the posture detection unit 3 detects the posture of the display device 1 with respect to the horizontal plane.

  The operation input unit 4 includes a power switch 41 that switches the power state of the display device 1 to an on state or an off state, a release switch 42 that inputs a release signal that gives a still image shooting instruction, and various shooting modes of the display device 1. It has a selector switch 43 for switching various settings, and a zoom switch 44 for performing a zoom operation of the imaging unit 2.

  The timepiece 5 generates a time signal that serves as a reference for the operation of the display device 1. Thereby, the control part 9 can set the acquisition time of image data, the exposure time of the image pick-up elements 21g and 22g, etc.

  FIG. 2 is a schematic diagram illustrating a schematic configuration of the display unit 6. As shown in FIG. 2, the display unit 6 includes a backlight 61, a display panel 62, and a parallax barrier 63. The backlight 61 is configured by an LED (Light Emitting Diode) or the like, and irradiates light for displaying an image from the back side. The display panel 62 is configured by a display panel such as liquid crystal or organic EL (Electro Luminescence). The parallax barrier 63 is made of liquid crystal or the like and is stacked on the upper surface of the display panel 62. The parallax barrier 63 is provided with slits at an interval narrower than the interval of each pixel of the display panel 62, and separates images corresponding to the user's right eye O1 and left eye O2, respectively. In the present embodiment, a parallax barrier method is applied to the parallax barrier 63. In the present embodiment, a lens sheet in which lenticular lenses are stacked may be stacked on the upper surface of the display panel 62 instead of the parallax barrier 63.

  In the display unit 6 having the above configuration, when 3D image data is input from the control unit 9, the display panel 62 in the order of the right eye image and the left eye image in the horizontal direction from the leftmost pixel under the control of the control unit 9. The parallax barrier 63 separates the light emitted from each pixel of the display panel 62. Therefore, the right eye image reaches only the right eye O1, and the left eye image reaches only the left eye O2. Thereby, the user can virtually stereoscopically view the 3D image displayed on the display unit 6. Further, when the display unit 6 switches the display mode from the 3D image to the 2D image, the voltage applied to the parallax barrier 63 is changed from the on state to the off state, so that the parallax barrier 63 is changed from the light shielding state to the transmissive state. Either the right-eye image or the left-eye image is output to the display panel 62, so that a 2D image can be displayed.

  FIG. 3 is a schematic diagram showing a schematic configuration of the touch panel 7. As illustrated in FIG. 3, the touch panel 7 includes a front panel 71, a drive unit 72, a drive electrode 73, a reception electrode 74, and a detection unit 75. The front panel 71 is made of glass or PET (Polyethylene Terephthalate) which has a predetermined thickness and is formed in a rectangular shape when seen in a plan view. The drive unit 72 outputs a drive pulse (for example, an applied voltage of 5 V) to the drive electrode 73 to form a capacitance between the drive electrode 73 and the reception electrode 74. The drive electrodes 73 and the reception electrodes 74 are composed of ITO (Indium Tin Oxide) electrodes, and are alternately provided at a pitch of 5 mm with respect to the lower surface of the front panel 71. The detection unit 75 is configured by a capacitance sensor, and a minute change amount of the capacitance formed between the drive electrode 73 and the reception electrode 74 when the user's finger O3 approaches the electric field E1, for example, A value of about 1 pF is detected as the amount of change when the finger O3 contacts (touches) the front panel 71. This detector 75 is disclosed in, for example, US Pat. No. 7,148,704. By using this technique, the detection unit 75 can detect a minute change in the capacitance formed between the drive electrode 73 and the reception electrode 74 before the finger O3 touches the front panel 71. Specifically, as shown in FIG. 3, the detection unit 75 has a minute distance as when the finger O3 is located at a distance h1 (for example, 0.5 cm) and a distance h2 (for example, 1 cm). It is possible to detect a change in capacitance formed between the drive electrode 73 and the reception electrode 74 when moving at two locations that are far away from each other.

  The touch panel 7 having the above-described configuration is provided on the display screen of the display unit 6 and detects the distance of the object area approaching from the outside and the display screen of the display unit 6 and responds to the detection result. Accepts signal input. Specifically, the touch panel 7 changes the electric field E1 formed around the display screen before the user touches the screen of the touch panel 7 based on the 2D image or 3D image displayed on the display unit 6. A distance corresponding to the generated capacitance change region and the amount of capacitance change is detected, and input of an operation signal corresponding to the change region and the distance is received. Further, in the present embodiment, the touch panel 7 is described as an example of a capacitive touch panel, but may be, for example, an optical capacitive touch panel or an infrared touch panel.

  The storage unit 8 includes an image data storage unit 81 that stores image data captured by the imaging unit 2 and a program storage unit 82 that stores various programs executed by the display device 1. The storage unit 8 is realized by using a semiconductor memory such as a flash memory or a RAM (Random Access Memory) fixedly provided inside the display device 1. The storage unit 8 may be provided with a function as a recording medium interface that reads information stored in the storage medium while storing information in a storage medium such as a memory card mounted from the outside.

  The control unit 9 is realized by a CPU (Central Processing Unit) or the like. The control unit 9 reads out and executes a program from the program storage unit 82 of the storage unit 8 in accordance with operation signals from the operation input unit 4 and the touch panel 7, and transfers instructions and data to each unit constituting the display device 1. To control the operation of the display device 1 in an integrated manner. The control unit 9 includes an image processing unit 91, a stereoscopic image generation unit 92, a pop-out setting unit 93, an exposure adjustment unit 94, a display control unit 95, and a header information generation unit 97.

  The image processing unit 91 performs various types of image processing on the left-eye image data and right-eye image data output from the signal processing units 21 h and 22 h and outputs the processed image data to the image data storage unit 81 of the storage unit 8. Specifically, the image processing unit 91 performs processing such as edge enhancement, color correction, and γ correction on the left-eye image data and the right-eye image data output from the signal processing units 21h and 22h, respectively.

  The stereoscopic image generation unit 92 generates a 3D image by cutting out each of the left eye image data and right eye image data subjected to image processing by the image processing unit 91 with a predetermined aspect ratio, for example, an aspect ratio of 3: 4. Note that the aspect ratio that the stereoscopic image generation unit 92 cuts out from each of the left-eye image data and the right-eye image data may be set by the changeover switch 43.

  The pop-out setting unit 93 virtually performs a 3D image in a vertical direction orthogonal to the display screen of the display unit 6 in response to a signal received by the touch panel 7 in a predetermined area with respect to the 3D image displayed by the display unit 6. Set the distance to jump out (hereinafter referred to as “jump distance”). Specifically, the pop-out setting unit 93 changes the regions cut out from the left-eye image data and the right-eye image data by the stereoscopic image generation unit 92 according to a signal received by the touch panel 7 in a predetermined region. Set the pop-up distance of the image. Further, the pop-out setting unit 93 determines the regions that the stereoscopic image generation unit 92 cuts out from the left-eye image data and the right-eye image data according to the signal received by the touch panel 7 in a predetermined region, respectively. The jump distance of the 3D image is set by changing the parallax of the subject included in the image in a stepwise manner in the direction of decreasing the parallax. Furthermore, the pop-out setting unit 93 pops out a three-dimensional operation image (hereinafter referred to as “3D operation image”) designated by a signal received by the touch panel 7 with respect to a plurality of three-dimensional operation images displayed on the display unit 6. Set the distance. In the present embodiment, the pop-out setting unit 93 virtually retracts the 3D image in a vertical direction orthogonal to the display screen of the display unit 6 in accordance with a signal received by the touch panel 7 in a predetermined area. (Distance in the depth direction) may be adjusted.

  The exposure adjustment unit 94 adjusts the exposure of the imaging unit 2 according to the signal received by the touch panel 7 for the 3D image displayed by the display unit 6. Specifically, the exposure adjusting unit 94 adjusts the exposure of the imaging unit 2 by driving the aperture driving units 21d and 22d and adjusting the setting values of the apertures 21c and 22c in accordance with the signal received by the touch panel 7. Do.

  The display control unit 95 performs control to display a 3D image or a 2D image on the display unit 6. Specifically, when displaying the 3D image on the display unit 6, the display control unit 95 displays the left eye image and the right eye image of the 3D image generated by the stereoscopic image generation unit 92 in the horizontal direction on the display screen of the display unit 6. Control is performed to output 3D images alternately arranged for each pixel to the display unit 6. On the other hand, when displaying the 2D image on the display unit 6, the display control unit 95 switches the power applied to the parallax barrier 63 from the on state in order to change the parallax barrier 63 of the display unit 6 from the light shielding state to the transmission state. While turning off, control is performed to output only one of the left-eye image and the right-eye image to the display panel 62. Further, the display control unit 95 performs control to display the 3D image and / or 3D operation image set by the pop-out setting unit 93 on the display unit 6. The display control unit 95 performs control to display the 3D image adjusted by the exposure adjustment unit 94 on the display unit 6.

  The image control unit 96 performs control to change the three-dimensional display mode of the image displayed on the display unit 6 in accordance with the display change of the 3D operation image. Specifically, the image control unit 96 performs a 3D image corresponding to a 3D operation image in which the pop-out distance changes according to a signal received by the touch panel 7 with respect to a 3D operation image displayed on a predetermined area by the display unit 6. Control to change the pop-up distance.

  The header information generating unit 97 generates the 3D image pop-out distance set by the pop-out setting unit 93 as header information, and stores this header information in the image data storage unit 81 in association with the image data generated by the imaging unit 2. .

  In the display device 1 having the above configuration, a situation when the imaging unit 2 generates two pieces of image data in which one end in the left-right direction of each field of view overlaps will be described. FIG. 4 is a schematic diagram illustrating a situation when the imaging unit 2 generates two image data in which one end in the horizontal direction of each field of view overlaps. FIG. 5 is a diagram illustrating an example of two images corresponding to two image data generated by the imaging unit 2 under the situation illustrated in FIG. 4. 5, the image WR1 in FIG. 5 is a right-eye image generated by the stereoscopic image generation unit 92 cut out from an image corresponding to the right-eye image data generated by the first imaging unit 21, and the image WL1 in FIG. The stereoscopic image generation unit 92 is a left-eye image generated by cutting out an image corresponding to the left-eye image data generated by the second imaging unit 22. FIG. 6 is a diagram illustrating an example of an image obtained by virtually superimposing the right eye image and the left eye image generated by the stereoscopic image generation unit 92 under the situation illustrated in FIG. FIG. 7 is a diagram illustrating the relationship between the imaging distances between the imaging unit 2 and the subject under the situation illustrated in FIG. In FIG. 7, the horizontal axis is the subject position in the image W1 when the left end is the origin, and the vertical axis is the distance between the imaging unit 2 and the subject. 5 and 6, the broken line and the alternate long and short dash line indicate image areas corresponding to the image data generated by the first imaging unit 21 and the second imaging unit 22, respectively.

  As illustrated in FIG. 4, the imaging unit 2 includes a first imaging unit 21 arranged in parallel at a distance B1 with respect to a subject A1 (distance d1) and a subject A2 (distance d2) having different distances from the imaging unit 2. Then, the right eye image data and the left eye image data are generated by photographing with the second imaging unit 22. After that, the stereoscopic image generation unit 92 generates the right eye image WR1 and the left eye image WL1 by cutting out the right eye image data and the left eye image data processed by the image processing unit 91 at a predetermined aspect ratio (see FIG. 5). . As shown in FIG. 7, the distance between the imaging unit 2 and the subject A2 is larger than the distance between the imaging unit 2 and the subject A1. For this reason, the area of the subject A2 almost overlaps. Specifically, as shown in FIG. 6, the area of the subject A2 almost overlaps in the image W1. On the other hand, the area of the subject A1 does not overlap and has a parallax a1 with respect to the subject A1. Thus, in the right-eye image WR1 and the left-eye image WL1, the subject (subject A1) that is closer to the imaging unit 2 has a larger parallax in the 3D image and the subject that is farther from the imaging unit 2 (subject A2). The parallax in the 3D image is small.

  Next, processing performed by the display device 1 according to the present embodiment will be described. FIG. 8 is a flowchart illustrating an outline of processing performed by the display device 1.

  In FIG. 8, first, the control unit 9 determines whether or not the display device 1 is turned on (step S <b> 101). When the power of the display device 1 is on (step S101: Yes), the display device 1 proceeds to step S102. On the other hand, when the display device 1 is not turned on (step S101: No), the display device 1 ends this process.

  Subsequently, the control unit 9 determines whether or not the display device 1 is set to the shooting mode (step S102). When the display device 1 is set to the shooting mode (step S102: Yes), the display device 1 proceeds to step S103 described later. On the other hand, when the display device 1 is not set to the imaging mode (step S102: No), the display device 1 proceeds to step S119 described later.

  First, the case where the display device 1 is set to the shooting mode (step S102: Yes) will be described. In this case, the display control unit 95 causes the display unit 6 to display a through image of a 3D image corresponding to the image data continuously generated by the imaging unit 2 at a constant minute time interval (step S103).

  Subsequently, the control unit 9 determines whether or not a release signal for instructing photographing is input by operating the release switch 42 by the user (step S104). When a release signal instructing photographing is input (step S104: Yes), the display device 1 proceeds to step S116 described later. On the other hand, when the release signal instructing photographing is not input (step S104: No), the display device 1 proceeds to step S105 described later.

  First, a case where a release signal instructing shooting is not input (step S104: No) will be described. In this case, the control unit 9 determines whether or not the depth icon Q1 has been operated (step S105). When the depth icon Q1 is operated (step S105: Yes), the display device 1 proceeds to step S106 described later. On the other hand, when the depth icon Q1 is not operated (step S105: No), the display device 1 proceeds to step S112 described later.

  FIG. 9 is a schematic diagram when an icon provided in a virtual 3D image recognized by the user displayed on the display unit 6 is operated. As illustrated in FIG. 9, the control unit 9 determines whether or not the depth icon Q1 provided in the image W2 displayed on the display unit 6 and for inputting an instruction signal for instructing the setting of the pop-out distance of the 3D image is operated. Judging. In this case, the touch panel 7 detects the area of the user's finger O3 approaching from the outside and the distance between the display screen of the display unit 6 and the finger O3, and receives and controls input of a signal corresponding to the detection result. It outputs to the part 9 (FIG. 9 (a)-> (b)). Further, as shown in FIG. 10A, when the user operates the 3D image displayed on the display unit 6, for example, the finger O3 enters between the display unit 6 and the user's right eye O1, and the user performs the 3D image. May be difficult to recognize and may not be able to perform a desired operation. Thus, in the case of the three-dimensional display in which the user perceives a 3D image from each image entering both eyes, if only one of the images is blocked, the user cannot perceive a correct three-dimensional image. That is, in the state shown in FIG. 10A, the user cannot operate naturally while correctly confirming the change of the 3D image displayed in three dimensions. For this reason, in the present embodiment, as shown in FIG. 10B, the touch panel 7 detects the detection region to be detected based on the 3D image, for example, the jump distance ΔZ of the depth icon Q1, by Δx (Δx = ΔZ / tan θ). ) Widen the detection to the right or left. Thereby, the user can adjust naturally while confirming the change of the 3D image while virtually touching the depth icon Q1 which is a 3D image.

  In step S106, the control unit 9 determines whether or not the retraction distance of the 3D image currently displayed by the display unit 6 is the limit. Specifically, as illustrated in FIG. 6, the control unit 9 sets a state in which the parallax a1 of the subject A1 included in the image W1 virtually overlapping the right-eye image WR1 and the left-eye image WL1 is not included in the 3D image retraction distance. Is determined to be the limit. When the retraction distance of the 3D image is the limit (step S106: Yes), the display device 1 returns to step 101. On the other hand, when the retraction distance of the 3D image is not the limit (step S106: No), the display device 1 proceeds to step S107.

  Subsequently, the control unit 9 determines whether or not the distance corresponding to the change amount of the capacitance detected by the touch panel 7 is equal to or less than the first threshold (step S107). Specifically, it is determined whether or not the amount of change in capacitance detected by the touch panel 7 is 0.2 pF or less. When the distance corresponding to the amount of change in capacitance detected by the touch panel 7 is equal to or less than the first threshold (step S107: Yes), the pop-out setting unit 93 is an area that the stereoscopic image generation unit 92 cuts out from the right-eye image data Is moved 1/100 (step S108), and the display device 1 returns to step S101.

  FIG. 11 is a schematic diagram illustrating an outline of processing performed by the pop-out setting unit 93. In FIG. 11, the right eye in which the image WR21 in FIG. 11A and the image WR22 in FIG. 11B are extracted from the right-eye image data generated by the first imaging unit 21 by the stereoscopic image generation unit 92 at a predetermined aspect ratio. It is an image. In addition, the image WL21 in FIG. 11A and the image WL22 in FIG. 11B are left-eye images that the stereoscopic image generation unit 92 extracts from the left-eye image data generated by the second imaging unit 22 at a predetermined aspect ratio. is there. An image W3 in FIG. 12 is an example of an image obtained by virtually overlapping the right eye image and the left eye image after the pop-out setting unit 93 sets the cut-out area of the stereoscopic image generation unit 92. FIG. 13 is a diagram illustrating an example of a virtual 3D image recognized by the user set by the pop-out setting unit 93. In FIG. 13, an image W <b> 4 in FIG. 13A is a 3D image before setting by the pop-out setting unit 93, and an image W <b> 5 in FIG. 13B is a 3D image after setting by the pop-out setting unit 93. In FIG. 11 and FIG. 12, broken lines and alternate long and short dash lines indicate image regions corresponding to image data generated by the first imaging unit 21 and the second imaging unit 22, respectively.

  As illustrated in FIG. 11, the pop-out setting unit 93 causes the stereoscopic image generation unit 92 to output the right-eye image data and the 3D image displayed on the display unit 6 according to a signal received by the touch panel 7 in the region of the depth icon Q1. The pop-out distance of the 3D image is set by changing the cut-out areas of the right-eye image and the left-eye image that are generated by cutting out from the left-eye image data. Specifically, when the pop-out setting unit 93 causes the subject A1 that has virtually popped out in the vertical direction orthogonal to the display screen of the display unit 6 to be retracted to the display screen side of the display unit 6, the pop-up setting unit 93 The cut-out area of the right-eye image data is changed by moving 1/100 (FIG. 11 (a) → FIG. 11 (b)), and the parallax of the subject A1 included in the right-eye image WR22 and the left-eye image WL22 (area overlap) (Refer to the image W3 in FIG. 12), the pop-out distance of the subject A1 is set (FIG. 13 (a) → (FIG. 13 (b)). For the depth icon Q1 (3D operation image) to be displayed, the pop-out distance of the depth icon Q1 is set according to the signal received by the touch panel 7 (FIG. 13 (a) → (FIG. 13 (b)). Yu The sets the pop-out distance of depth icon Q1 depending on the amount pushed the virtually depth icon Q1 (distance).

  As described above, the pop-out setting unit 93 generates the right-eye image and the left-eye image that the stereoscopic image generation unit 92 generates by cutting out from the right-eye image data and the left-eye image data according to the signal received by the touch panel 7 in the area of the depth icon Q1. The pop-out distance of the 3D image is set by changing the area to be cut out. Thereafter, the display control unit 95 performs control to display the 3D image and / or 3D operation image set by the pop-out setting unit 93 on the display unit 6. Thereby, the user can adjust naturally while confirming the change of the pop-out distance of the 3D image while virtually touching the depth icon Q1 provided in the 3D image displayed on the display unit 6. In FIG. 11, the pop-out setting unit 93 moves and changes only the cut-out area of the right-eye image, but moves the cut-out areas of the right-eye image and the left-eye image while synchronizing the right-eye image and the left-eye image. It is possible to change and set the jump distance of the 3D image. Further, the pop-out setting unit 93 may move and change only the cut-out area of the left eye image to set the pop-out distance of the 3D image.

  Here, returning to FIG. 8, the case where the distance corresponding to the change amount of the capacitance detected by the touch panel 7 is not less than or equal to the first threshold value in step S107 (step S107: No) will be described. In this case, the control unit 9 determines whether or not the distance corresponding to the amount of change in capacitance detected by the touch panel 7 is equal to or smaller than the second threshold (step S109). Specifically, it is determined whether or not the amount of change in capacitance detected by the touch panel 7 is 0.5 pF or less. When the distance corresponding to the amount of change in capacitance detected by the touch panel 7 is equal to or smaller than the second threshold (step S109: Yes), the pop-out setting unit 93 is an area that the stereoscopic image generation unit 92 cuts out from the right-eye image data Is moved 1/20 (step S110), and the display device 1 returns to step S101.

  On the other hand, when the distance corresponding to the amount of change in the capacitance detected by the touch panel 7 is not equal to or less than the second threshold (step S109: No), the pop-out setting unit 93 causes the stereoscopic image generation unit 92 to execute the right-eye image data. The display apparatus 1 returns to step S101 after changing the area to be cut out from 1/10 (step S111).

  Next, a case where the depth icon Q1 is not operated in step S105 (step S105: No) will be described. In this case, the control unit 9 determines whether or not the return icon Q2 has been operated (step S112). Specifically, as illustrated in FIG. 9, the control unit 9 includes a return icon Q2 that is provided in the image W2 displayed on the display unit 6 and that inputs an instruction signal for returning the pop-up distance of the 3D image to the initial state. It is determined whether or not an operation has been performed. In this case, the control unit 9 determines that the return icon Q2 is operated when the capacitance detected by the touch panel 7 changes. Here, the initial position is the position of the cut-out area of each of the right-eye image and the left-eye image where the pop-out distance of the 3D image is maximized. Specifically, it is the position of the cutout region where the parallax of the subject A1 included in each of the right eye image and the left eye image generated by the stereoscopic image generation unit 92 is maximized (see FIG. 6). When the return icon Q2 is operated (step S112: Yes), the pop-out setting unit 93 returns the region cut out from the right-eye image data by the stereoscopic image generation unit 92 to the initial position (step S113), and the display device 1 performs step S101. Return to.

  Next, a case where the return icon Q2 is not operated in step S112 (step S112: No) will be described. In this case, the control unit 9 determines whether or not the EV (exposure) icon Q3 has been operated (step S114). Specifically, as shown in FIG. 9, the control unit 9 is provided in an image W2 displayed on the display unit 6, and an EV icon Q3 for inputting an instruction signal for adjusting the exposure of the imaging unit 2 is operated. It is determined whether or not. When the EV icon Q3 is not operated (step S114: No), the display device 1 returns to step S101. On the other hand, when the EV icon Q3 is operated (step S114: Yes), the exposure adjustment unit 94 adjusts the exposure of the imaging unit 2 according to the distance corresponding to the amount of change in capacitance detected by the touch panel 7 ( In step S115), the display device 1 returns to step S101. Specifically, as illustrated in FIG. 14, the exposure adjustment unit 94 adjusts the exposure of the imaging unit 2 according to the distance corresponding to the amount of change in capacitance detected by the touch panel 7 (FIG. ) → FIG. 14B). At this time, as shown in FIG. 14, the display control unit 95 may display the aperture value F <b> 1 (+0.3) on the screen of the display unit 6. Thereby, the user can easily know the amount of change when the EV icon Q3, which is a 3D image, is changed while being virtually touched.

  Next, a case will be described in which a release signal instructing photographing is input by the user operating the release switch 42 in step S104 (step S104: Yes). In this case, the imaging unit 2 captures an image currently displayed on the display unit 6 and stores the captured image data in the image data storage unit 81 of the storage unit 8 (step S116).

  Subsequently, the display control unit 95 displays a 3D image corresponding to the image data captured by the imaging unit 2 on the display unit 6 in a rec view (step S117). Thereby, the user can confirm the sense of depth of the captured image.

  Thereafter, the control unit 9 determines whether or not a predetermined time has elapsed since the 3D image was displayed on the display unit 6 (step S118). Specifically, it is determined whether or not one minute has passed since the 3D image was displayed on the display unit 6. As a result of the determination by the control unit 9, if the predetermined time has not elapsed since the rec view display of the 3D image by the display unit 6 (step S118: No), the display device 1 returns to step S117. On the other hand, as a result of the determination by the control unit 9, when a predetermined time has elapsed since the rec view display of the 3D image by the display unit 6 (step S118: Yes), the display device 1 returns to step S101.

  Here, a case where the display device 1 is not set to the shooting mode in step S102 (step S102: No) will be described. In this case, the display device 1 executes a reproduction display process for displaying the captured image data on the display unit 6 (step S119), and the display device 1 returns to step S101.

  Next, the reproduction display process in step S119 of FIG. 8 will be described. FIG. 15 is a flowchart showing an outline of the reproduction display process. In FIG. 15, first, the display control unit 95 causes the display unit 6 to display an image selection screen in which a plurality of image data stored in the image data storage unit 81 are displayed together (step S201).

  Subsequently, the control unit 9 determines whether or not an image is selected from the image selection screen displayed on the display unit 6 when the user operates the touch panel 7 (step S202). When the user selects an image from the image selection screen (step S202: Yes), the display device 1 proceeds to step S203 described later. On the other hand, when the user does not select an image from the image selection screen (step S202: No), the display device 1 proceeds to step S210 to be described later.

  First, a case where an image is selected from the image selection screen by the user (step S202: Yes) will be described. In this case, the display control unit 95 causes the display unit 6 to display the image selected by the user on the full screen (step S203), and the control unit 9 determines whether the image displayed on the display unit 6 is a 3D image. Judgment is made (step S204). Specifically, the control unit 9 refers to the header information of the image displayed on the display unit 6 to determine whether the image is a 3D image. When the image displayed on the display unit 6 is a 3D image (step S204: Yes), the display device 1 proceeds to step S205 described later. On the other hand, when the image displayed on the display unit 6 is not a 3D image (step S204: No), the display device 1 proceeds to step S210 to be described later.

  In step S205, the control unit 9 determines whether or not the depth icon Q1 has been operated. When the depth icon Q1 is not operated (step S205: No), the display device 1 proceeds to step S210. On the other hand, when the depth icon Q1 is operated (step S205: Yes), the display device 1 proceeds to step S206.

  In step S206, the control unit 9 determines whether or not the distance corresponding to the amount of change in capacitance detected by the touch panel 7 is equal to or less than the first threshold (step S206). When the distance corresponding to the amount of change in capacitance detected by the touch panel 7 is equal to or less than the first threshold (step S206: Yes), the control unit 9 displays the 3D image displayed by the display unit 6 at that time. It is determined whether or not the retraction distance is a limit (step S207). When the retraction distance of the 3D image is not the limit (step S207: No), the pop-out setting unit 93 performs a change to move the area cut out from the right-eye image data by the stereoscopic image generation unit 92 by 1/100 (step S208), and display The apparatus 1 moves to step S209.

  On the other hand, when the retracting distance of the 3D image is the limit (step S207: Yes), the display device 1 proceeds to step S209.

  In step S209, the header information generation unit 97 generates the 3D image pop-up distance displayed on the display unit 6 at that time as header information of the 3D image data, and associates the generated header information with the 3D image data. In addition, the image data is stored in the image data storage unit 81.

  Subsequently, the control unit 9 determines whether or not an image reproduction end operation has been performed (step S210). Specifically, the control unit 9 determines whether or not the changeover switch 43 is operated by the user and an instruction signal for ending the image reproduction is input. When the image reproduction end operation is not performed (step S210: No), the display device 1 returns to step S201. On the other hand, when the image reproduction end operation is performed (step S210: Yes), the display device 1 returns to the main routine of FIG.

  Next, a case will be described in which the distance corresponding to the amount of change in capacitance detected by the touch panel 7 is not the first threshold value in Step S206 (No in Step S206). In this case, the control unit 9 determines whether or not the distance corresponding to the change amount of the capacitance detected by the touch panel 7 is equal to or less than the second threshold (step S211). When the distance corresponding to the change amount of the capacitance detected by the touch panel 7 is equal to or smaller than the second threshold (step S211: Yes), the control unit 9 displays the 3D image displayed on the display unit 6 at that time. It is determined whether or not the retraction distance is a limit (step S212). When the retraction distance of the 3D image is the limit (step S212: Yes), the display device 1 proceeds to step S209. On the other hand, when the retraction distance of the 3D image is not the limit (step S212: No), the pop-out setting unit 93 performs a change to move the area that the stereoscopic image generation unit 92 cuts out from the right-eye image data by 1/20 ( In step S213), the display device 1 proceeds to step S209.

  Next, the case where the distance corresponding to the amount of change in capacitance detected by the touch panel 7 is not equal to or smaller than the second threshold in Step S211 will be described (Step S211: No). In this case, the control unit 9 determines whether or not the retraction distance of the 3D image currently displayed by the display unit 6 is the limit (step S214). When the retraction distance of the 3D image is the limit (step S214: Yes), the pop-out setting unit 93 performs a change to return the region cut out from the right-eye image data by the stereoscopic image generation unit 92 to the initial position (step S215) and display The apparatus 1 moves to step S209.

  On the other hand, when the retraction distance of the 3D image is not the limit (step S214: No), the pop-out setting unit 93 performs a change to move the area that the stereoscopic image generation unit 92 cuts out from the right-eye image data by 1/10 ( In step S216), the display device 1 proceeds to step S209.

  According to the present embodiment described above, the touch panel 7 detects the distance to the object area approaching from the outside and the display screen of the display unit, accepts the input of a signal corresponding to the detection result, and jumps out. For the 3D image displayed by the display unit 6, the setting unit 93 sets the distance at which the 3D image pops out according to the signal received by the touch panel 7 in a predetermined area, and the display control unit 95 is set by the popping setting unit 93. Control is performed to display the 3D image on the display unit 6. Thereby, the user can naturally adjust while confirming the change of the 3D image while virtually touching the depth icon Q1 which is a 3D image.

  In the above-described embodiment, the imaging unit 2 generates two pieces of image data in which the left and right ends of each field of view overlap each other. For example, the imaging unit 2 has only one imaging unit. Further, two image data in which one end in the left-right direction of each field of view overlaps may be generated by continuously capturing images with this imaging unit.

  In the above-described embodiment, the imaging unit 2 generates two pieces of image data in which the left and right ends of each field of view overlap each other. For example, the imaging unit 2 includes only one imaging element. By using two image data corresponding to two images collected by two optical systems in the imaging region of this one image sensor, two images in which one end in the horizontal direction of each field of view overlaps each other. Data may be generated.

  Further, the posture detection unit 3 detects the posture state of the display device 1. For example, the posture detection unit 3 detects various accelerations of the display device 1 by detecting acceleration generated when the user taps the display screen of the display unit 6. An operation signal for a tap operation for switching between modes and various settings may be received, and this operation signal may be output to the control unit 9.

  Further, in the present embodiment described above, the pop-out setting unit 93 performs the right-eye image data and the left-eye generated by the stereoscopic image generation unit 92 when the depth icon Q1 provided in the 3D image displayed on the display unit 6 is operated. The area to be cut out from the image data is changed and the pop-out distance of the 3D image is set. The pop-out distance of the 3D image may be set by changing the viewing area.

  Further, in the present embodiment described above, the pop-out setting unit 93 performs the right-eye image data and the left-eye generated by the stereoscopic image generation unit 92 when the depth icon Q1 provided in the 3D image displayed on the display unit 6 is operated. Although the regions to be cut out from the image data are changed in stages, for example, the regions to be continuously cut out may be changed according to a signal received by the touch panel 7.

  Further, in the present embodiment described above, when the user operates the depth icon Q1, the setting is made to change the pop-up distance of the 3D image. For example, the user operates the subject A1 included in the 3D image. Thus, the setting for changing the pop-out distance of the 3D image may be performed. In this case, the pop-out setting unit 93 sets the pop-up distance of the 3D image by adjusting the overlapping state (parallax) of the subject in the right eye image and the left eye image with respect to the subject specified by the signal received by the touch panel 7. It may be.

  In the above-described embodiment, the detection unit 75 of the touch panel 7 detects the distance corresponding to the change in capacitance. For example, the reflected light from the outside of the display unit 6 of the irradiation light by the backlight 61 is detected. The pop-out setting unit 93 may set the pop-out distance of the 3D image according to the time detected by the optical sensor. In this case, a photoelectric touch panel may be used as the touch panel.

  In the present embodiment described above, the detection unit 75 of the touch panel 7 detects the distance corresponding to the change in capacitance. For example, an infrared sensor is provided, and this infrared sensor faces the front panel 71. The projection setting unit 93 may set the projection distance of the 3D image according to the area of the area where the user touches the front panel 71 by irradiating infrared rays. In this case, an infrared touch panel may be used as the touch panel.

  Further, in the present embodiment described above, the pop-out setting unit 93 performs this processing on the through image displayed on the display unit 6 or the image data stored in the image data storage unit 81. Alternatively, this processing may be performed on an image that the display unit 6 displays in REC view.

  In the present embodiment described above, when the EV icon Q3 provided in the image W3 displayed on the display unit 6 is operated, the exposure adjustment unit 94 adjusts the exposure of the imaging unit 2. A zoom icon may be provided in the image W2, and the zoom magnification of the imaging unit 2 may be changed when the zoom icon is operated by the user. Further, a mode switching icon or the like for switching the imaging mode may be provided on the image W2 displayed on the display unit 6.

  In the above-described embodiment, the display device 1 has been described as a digital stereo camera. However, the display device 1 may be applied to various electronic devices having a shooting function and a display function, such as a digital video camera and a mobile phone with a camera. Can do.

DESCRIPTION OF SYMBOLS 1 Display apparatus 2 Image pick-up part 3 Posture detection part 4 Operation input part 5 Clock 6 Display part 7 Touch panel 8 Storage part 9 Control part 21 1st image pick-up part 21a, 22a Lens part 21b, 22b Lens drive part 21c, 22c Aperture 21d, 22d Aperture driving unit 21e, 22e Shutter 21f, 22f Shutter driving unit 21g, 22g Image sensor 21h, 22h Signal processing unit 22 Second imaging unit 41 Power switch 42 Release switch 43 Changeover switch 44 Zoom switch 61 Backlight 62 Display panel 63 Parallax barrier 71 Front Panel 72 Drive Unit 73 Drive Electrode 74 Receive Electrode 75 Detection Unit 81 Image Data Storage Unit 82 Program Storage Unit 91 Image Processing Unit 92 Stereo Image Generation Unit 93 Projection Setting Unit 94 Exposure Adjustment Unit 95 Display Control Unit 96 Image Control Unit 97 F Ladder information generator L1, L2 Optical axis O1 Right eye O2 Left eye O3 Finger

Claims (7)

A display unit that displays a three-dimensional image generated by combining two image data in which one end in the left-right direction of each field of view overlaps;
A touch panel provided on the display screen of the display unit, detecting a region of an object approaching from the outside and a distance to the display screen, and receiving a signal input according to the detection result;
A pop-up that sets a distance for the three-dimensional image to virtually pop out in a vertical direction orthogonal to the display screen in response to a signal received by the touch panel in a predetermined area with respect to the three-dimensional image displayed by the display unit. A setting section;
A display control unit for controlling the display unit to display the three-dimensional image set by the pop-out setting unit;
A display device comprising: An imaging unit that captures images from different positions and generates two image data in which one end in the left-right direction of each field of view overlaps;
A stereoscopic image generating unit that generates the three-dimensional image by cutting out the two images corresponding to the two image data generated by the imaging unit at a predetermined aspect ratio;
Further comprising
The pop-out setting unit sets the pop-out distance of the three-dimensional image by changing a region to be cut out of the two image data by the stereoscopic image generation unit,
The display control unit performs control to alternately arrange images corresponding to the two image data set by the pop-out setting unit for each pixel in the horizontal direction on the display screen and output the images to the display unit. The display device according to claim 1.   The pop-out setting unit directs a region from which the two image data is cut out by the stereoscopic image generation unit in a direction to reduce the parallax of the subject included in the two image data in accordance with a signal received by the touch panel. The display device according to claim 2, wherein the display device is changed step by step. An exposure adjustment unit that adjusts the exposure of the imaging unit according to a signal received by the touch panel for the three-dimensional image displayed by the display unit;
The display device according to claim 1, wherein the display control unit performs control to display the three-dimensional image adjusted by the exposure adjustment unit on the display unit. A header information generating unit that generates a pop-out distance of the three-dimensional image set by the pop-out setting unit as header information of the two image data;
A storage unit that associates and stores a plurality of image data generated by the imaging unit and header information generated by the header information generation unit;
The display device according to claim 1, further comprising: A display unit that displays, in a predetermined area, a three-dimensional operation image generated by combining two image data in which one end in the left-right direction of each field of view overlaps;
A touch panel provided on the display screen of the display unit, detecting a region of an object approaching from the outside and a distance to the display screen, and receiving a signal input according to the detection result;
A pop-out setting for setting a distance to virtually jump out in a direction perpendicular to the display screen of the three-dimensional operation image specified by the signal received by the touch panel for the three-dimensional operation image displayed by the display unit And
A display control unit for controlling the display unit to display the three-dimensional operation image set by the pop-out setting unit;
An image control unit that performs control to change a three-dimensional display mode of an image displayed by the display unit in accordance with a display change of the three-dimensional operation image;
A display device comprising: It further includes an imaging unit that captures images from different positions and generates two image data in which one end in the left-right direction of each field of view overlaps,
The display control unit alternately outputs an image corresponding to the two image data captured by the imaging unit to the display unit for each horizontal pixel in the display screen,
The display device according to claim 6, wherein the image control unit changes a three-dimensional display mode of an image corresponding to the two image data captured by the imaging unit.

Images