JP2012053113A - Image pickup device, three-dimensional image generation system, and three-dimensional image generation program - Google Patents

Abstract

An imaging device, a three-dimensional image generation system, and a three-dimensional image generation program capable of easily generating a three-dimensional image are provided.
A camera includes a first determination unit that determines whether or not another camera is positioned within the cooperative imaging range, and the other imaging device is positioned within the cooperative imaging range by the first determination unit. The subject based on one two-dimensional image of the subject imaged by the camera and another two-dimensional image of the subject imaged by another camera located within the cooperative imaging range Second determination means for determining whether or not a three-dimensional image of the subject can be generated, and image data of the three-dimensional image when the second determination means determines that a three-dimensional image of the subject can be generated. Image data generating means for generating
[Selection] Figure 2

Description

  The present invention relates to an imaging device, a three-dimensional image generation system, and a three-dimensional image generation program.

  2. Description of the Related Art Conventionally, a three-dimensional image generation system that captures a subject with two portable terminals with cameras and generates a three-dimensional image based on the captured images is known (see, for example, Patent Document 1). That is, in the three-dimensional image generation system of Patent Document 1, a subject is photographed with two camera-equipped mobile terminals installed on a pedestal for generating a three-dimensional image, and a three-dimensional image is obtained from the obtained plurality of images. Is generated.

JP 2002-27495 A

  By the way, the 3D image generation system of Patent Document 1 requires a 3D image generation pedestal that sets a plurality of cameras in a fixed positional relationship when photographing a subject for obtaining an image used for generating a 3D image. I was trying. For this reason, there is a problem that it is not possible to easily generate a three-dimensional image.

  The present invention has been made in view of such circumstances, and an object thereof is to provide an imaging device, a three-dimensional image generation system, and a three-dimensional image generation program that can easily generate a three-dimensional image. It is to provide.

  In order to achieve the above object, an imaging apparatus of the present invention is an imaging apparatus capable of cooperatively imaging a subject by communicating with another imaging apparatus, and cooperates with the other imaging apparatus. A first determination unit that determines whether or not the other imaging device is located within a cooperative imaging possible range that is a range in which the subject can be imaged, and the first imaging unit causes the other imaging device to When it is determined that the image is located within the cooperative image pickup possible range, the image is picked up by one other two-dimensional image of the subject imaged by the image pickup device and the other image pickup device located within the cooperative image pickup range. A second determination unit that determines whether or not a three-dimensional image of the subject can be generated based on another two-dimensional image of the subject, and the second determination unit generates a three-dimensional image of the subject. Determined to be possible When, and spirit that an image data generation means for generating image data of the three-dimensional image.

  Further, the imaging apparatus of the present invention includes a communication unit capable of communicating cooperative imaging possible suggestion information that suggests that the cooperative imaging can be performed with the other imaging apparatus. To do.

  Further, the imaging apparatus of the present invention includes an imaging condition matching unit that matches the imaging conditions for the cooperative imaging with the other imaging apparatus when performing the cooperative imaging with the other imaging apparatus. Is the gist.

  The imaging apparatus according to the present invention further includes display means for displaying a through image of the subject captured by the other imaging apparatus on a display screen when performing the cooperative imaging with the other imaging apparatus. The summary is provided.

  In the imaging device of the present invention, the display unit displays the amount of angle of view deviation from the other imaging device on the display screen when performing the cooperative imaging with the other imaging device. This is the gist.

  In the imaging apparatus of the present invention, the image data generation unit may determine the image data of the one two-dimensional image and the image data when the second determination unit determines that the three-dimensional image of the subject cannot be generated. The gist is to generate image data of another two-dimensional image.

  The three-dimensional image generation system according to the present invention is capable of cooperative imaging in which a plurality of imaging devices capable of imaging a subject in cooperation by communicating with each other and a range in which the subject can be imaged in cooperation between the imaging devices. First determination means for determining whether or not at least two of the imaging devices are located within a range, and at least two of the imaging devices within the cooperative imaging possible range by the first determination means Whether or not a three-dimensional image can be generated based on each two-dimensional image of the subject imaged by each imaging device located within the cooperative imaging possible range. And a second determination unit that determines whether the three-dimensional image can be generated by the second determination unit, and an image data generation unit that generates image data of the three-dimensional image. The gist of the door.

  In the three-dimensional image generation program of the present invention, is at least two of the imaging devices positioned in a cooperative imaging range where the subject can be imaged in cooperation with a plurality of imaging devices in the computer? A first determination procedure for determining whether or not, and when it is determined by the first determination procedure that at least two of the imaging devices are located within the cooperative image capture possible range, the cooperative image capture possible range A second determination procedure for determining whether or not a three-dimensional image can be generated based on each two-dimensional image of the subject imaged by each of the imaging devices located inside, The gist is to execute an image data generation procedure for generating image data of the three-dimensional image when it is determined that a three-dimensional image can be generated.

  According to the present invention, a three-dimensional image can be easily generated.

1 is a block diagram showing a schematic configuration of a digital still camera according to an embodiment. The flowchart of a cooperative imaging process routine. The flowchart of a cooperative imaging condition setting routine. In an embodiment, (a) is a mimetic diagram showing a state where two cameras are mutually located outside their cooperative image pickup possible range, and (b) is a case where two cameras are mutually within their cooperative image pickup possible range. The schematic diagram which shows the state located. The schematic diagram which shows a state when displaying the other party's through image on a part of mutual monitor between two cameras. The schematic diagram which shows a state when a mutual through image overlaps in the vertical direction between two cameras. FIG. 6 is a schematic diagram illustrating a relationship between a distance from both cameras to the subject and a parallax angle between the two cameras when the subject is cooperatively imaged by two cameras. In the example of a change, the schematic diagram which shows the state in which two cameras and external apparatuses are wirelessly connected so that data communication is possible.

  Hereinafter, an embodiment in which the present invention is embodied in a digital still camera (hereinafter referred to as a “camera”) as an imaging apparatus constituting a three-dimensional image generation system will be described with reference to FIGS.

  As shown in FIG. 1, the camera 11 includes an imaging lens 12 (only one lens is shown in FIG. 1) composed of a plurality of lenses such as a zoom lens, and an aperture for adjusting the amount of subject light that has passed through the imaging lens 12. 13 and an image sensor 14 that forms an image of subject light that has passed through the aperture 13 on an incident-side light receiving surface 14a that serves as an imaging surface. An AFE (Analog Front End) 15 and an image processing circuit 16 are connected to the output side of the image sensor 14, and an MPU (Micro Processing Unit) 17 connects the data processing circuit 18 to the image processing circuit 16. Connected through.

  The MPU 17 also includes a nonvolatile memory 19 that stores various control programs in the camera 11, a RAM 20 that functions as a buffer memory, a monitor 21 that is a liquid crystal display screen that displays a through image of a subject, and a memory that is a storage medium. A card I / F (Inter-Face) 23 into which the card 22 can be inserted and removed is connected via the data bus 18.

  Further, the MPU 17 includes a communication unit 24 that communicates image data and the like with another camera 11 and an external device via the antenna 24a, and a distance measurement unit that measures the distance between the camera 11 and the subject. 25 are connected via the data bus 18. Further, on the camera body 11A (see FIG. 5), an operation unit 26 including a mode switching button 26a, a release button 26b, a cross button 26c, and the like operated by a user of the camera 11 is operated on the MPU 17 respectively. Signals (such as a mode switching signal and a half-press operation signal) can be output.

  The image sensor 14 is composed of a complementary metal oxide semiconductor (CMOS) image sensor or a charge coupled device (CCD) image sensor. The imaging element 14 has an electronic shutter function, and a large number of light receiving elements (not shown) are two-dimensionally arranged on the light receiving surface 14a. The image sensor 14 accumulates signal charges corresponding to the image of the subject formed on the light receiving surface 14a, and then outputs the accumulated signal charges to the AFE 15 as an analog signal called a pixel signal that is the source of the image data. To do.

  The AFE 15 samples an analog pixel signal input from the image sensor 14 at a predetermined timing (correlated double sampling), and amplifies the signal to a predetermined signal level based on, for example, ISO sensitivity (not shown). And an A / D converter (not shown) for converting the amplified pixel signal into a digital signal. The AFE 15 outputs image data generated by digitizing the pixel signal of the analog signal by the A / D conversion unit to the image processing circuit 16.

  The image processing circuit 16 performs various image processing on the image data input from the AFE 15 based on a control signal from the MPU 17. Then, the image processing circuit 16 temporarily stores the image data subjected to the image processing in the RAM 20 and displays it on the monitor 21 as a through image in a moving image mode that changes with time. When the release button 26b (see FIG. 5) is fully pressed, the image corresponding to the image data at that time is displayed on the monitor 21 as a confirmation image, while the format processing for JPEG compression, for example, is performed. After performing predetermined image processing, the image data is stored in the memory card 22 as an image file.

  In addition to various control programs including a three-dimensional image generation program and the like, the nonvolatile memory 19 is used in various numerical values used when executing these programs, for example, a determination step when a three-dimensional image generation program is executed. The threshold value M and threshold value N for determination, the setting range of the parallax angle of the camera 11 with respect to the subject, and the like are stored.

  In the present embodiment, the MPU 17, the nonvolatile memory 19, and the RAM 20 constitute a control unit 30 as a computer that executes a control program. That is, the control unit 30 performs overall control of various processing operations (for example, imaging processing and the like) in the camera 11 by using the RAM 20 as a work area when the MPU 17 executes a control program stored in the nonvolatile memory 19. The data bus 18 functions as a transmission path for various data accompanying the control of the control unit 30.

  The mode switching button 26a in the operation unit 26 is operated when the operation mode of the camera 11 is switched, for example, when switching from the normal imaging mode for generating a 2D image to the cooperative imaging mode capable of generating a 3D image. . Also, the release button 26b (see FIG. 5) is pressed down when the subject is imaged (captured) when the operation mode of the camera 11 is the imaging mode. In the camera 11, when the release button 26b (see FIG. 5) of the operation unit 26 is half-pressed, AF (Auto Focus) processing for focusing on the subject and AE (Auto Exposure) for exposure adjustment are performed. ) Processing, AWB (Auto White balance) processing for correcting the color of the subject to be captured to a color close to the appearance according to the type of light, and the like are executed. Thereafter, when the release button 26b is fully pressed, image generation processing such as a two-dimensional image and a three-dimensional image is executed. The cross button 26c is operated to move a cursor (not shown) displayed on the monitor 21.

  Note that when the operation mode is the cooperative imaging mode, the camera 11 according to the present embodiment can image the same subject in cooperation by transmitting and receiving (communication) image data and the like with the other cameras 11. It has become. That is, in the cooperative imaging mode, based on the control of the control unit 30, the communication unit 24 can provide various types of information (for example, cooperative imaging possible suggestion information that suggests that cooperative imaging with other cameras 11 is possible, The image data of the subject imaged by the camera 11) functions as communication means for communicating with an external device.

  In this case, the signal level of various information transmitted from the communication unit 24 (that is, the strength level as a signal radio wave) is determined by the user of the camera 11 through the operation of the operation unit 26 (for example, the cross button 26c). The setting can be changed. Here, when the signal level of the information transmitted from the communication unit 24 is set to be relatively strong, the communicable range in which communication with the other camera 11 is possible becomes relatively wide. As a result, the cooperative imaging possible range set as a range below this communicable range, that is, the range in which the same subject can be imaged in cooperation with other cameras 11 is also relatively wide. On the contrary, when the signal level of the information transmitted from the communication unit 24 is set to be relatively weak, the communicable range and the cooperative imaging possible range with the other cameras 11 are relatively narrow. The level of the signal level is appropriately set by the user in consideration of the battery consumption level of the camera 11 and the information amount of image data communicated with each other.

  The distance measuring unit 25 includes, for example, an infrared distance measuring sensor, measures the distance between the camera 11 (particularly the imaging lens 12) and the subject based on the control of the MPU 17, and sends the measurement information to the MPU 17. input. And in this embodiment, the three-dimensional image generation system is comprised by the some camera 11 comprised as mentioned above.

  Next, a cooperative imaging processing routine (three-dimensional image) executed by the control unit 30 when two cameras 11 configured as described above are coordinated to capture (photograph) the same subject and generate a three-dimensional image. The generation program will be described below with reference to the flowchart of FIG. As a premise for explanation, it is assumed that the MPUs 17 of the two cameras (the own camera 11 and the counterpart camera 11) that cooperatively image the same subject are both executing the cooperative imaging processing routine.

  Now, when the operation mode of the camera 11 is the imaging mode, the control unit 30 operates the mode switching button 26a of the operation unit 26 to switch the imaging mode from the normal imaging mode to the cooperative imaging mode. The cooperative imaging process routine shown in the flowchart of FIG. 2 is started. Further, with the start of this cooperative imaging processing routine, the control unit 30 transmits a signal of cooperative imaging possible suggestion information (hereinafter, this signal is referred to as a “pairing signal”) from the antenna 24 a of the communication unit 24. .

  First, in step S11, the control unit 30 determines whether or not a pairing signal has been received. That is, the other imaging apparatus other than the own camera 11 and having the cooperative imaging function (in this case, the other camera 11 serving as another camera) switches itself to the cooperative imaging mode. It is determined whether or not it exists within a range where communication with the camera 11 is possible. Specifically, the control unit 30 determines whether or not the partner camera 11 is located within the communicable range from the radio wave reception status of the pairing signal from the partner camera 11 in the communication unit 24. When the determination result in step S11 is negative, the control unit 30 periodically repeats the determination in step S11. And if the determination result of this step S11 becomes affirmation determination, the control part 30 will transfer the process to following step S12.

  Then, in the next step S12, the control unit 30 notifies that communication is possible. That is, in order to notify that the counterpart camera 11 as another imaging apparatus having the operation mode set to the cooperative imaging mode is located within the communicable range in the same manner as the own camera 11, Is displayed on the monitor 21. Then, when the process of step S12 ends, the control unit 30 proceeds to the next step S13.

  In step S13, the control unit 30 determines whether the signal level of the pairing signal from the other camera 11 in the communication unit 24 is equal to or higher than the threshold level. That is, when the signal level of the pairing signal is less than the threshold level, there is a possibility that the reception status of information including image data is hindered and cooperative imaging becomes impossible. Therefore, whether or not the counterpart camera 11 is located within the cooperative imaging range depending on whether or not the signal level of the pairing signal is equal to or higher than a predetermined threshold level that does not cause a problem in the reception status of information including image data. It is determined whether or not. In this respect, the control unit 30 functions as a first determination unit that executes a first determination procedure regarding whether or not another imaging device (an opponent camera) is located within the cooperative imaging possible range.

  Here, as shown in FIG. 4 (a), when the cooperative image pickup possible ranges of both cameras 11 are S1 and S2, respectively, the two cameras 11 are in a state in which the cooperative image pickup possible ranges S1 and S2 of both cameras 11 are separated from each other. Is moved and, as shown in FIG. 4B, when the cooperative imaging possible ranges S <b> 1 and S <b> 2 of both cameras 11 intersect each other, the determination in step S <b> 13 is affirmative.

  In this specification, it is also possible that at least a part of the cooperative image pickup possible range S2 of the other camera 11 intersects the cooperative image pickup possible range S1 of one camera 11 of the two cameras 11 It is assumed that the other camera 11 is located within the possible range S1. That is, the fact that both cameras 11 are located at positions where both cameras 11 can communicate with each other in order to capture the same subject means that the other camera 11 is within the cooperative imaging possible range S1 of one camera 11. It is assumed that the camera 11 is included. Therefore, as shown in FIG. 4B, in the state where the cooperative imaging possible range S1 of one of the cameras 11 and the cooperative imaging possible range S2 of the other camera 11 intersect, both the cameras 11 The communication for capturing the subject in cooperation with each other is possible.

  When the determination result in step S13 is negative, the control unit 30 periodically repeats the determination in step S13. And if the determination result of this step S13 becomes affirmation determination, the control part 30 will transfer the process to following step S14. In the next step S14, the control unit 30 performs notification that cooperative imaging is possible. That is, the control unit 30 indicates that the counterpart camera 11 positioned within the communicable range is positioned within the cooperative image capturing range that does not hinder transmission / reception of information including image data for cooperative imaging. Then, the characters “capable of cooperative imaging” are displayed on the monitor 21 of the camera 11. Then, when the process of step S14 ends, the control unit 30 proceeds to the next step S15.

  Then, in the next step S15, the control unit 30 sets cooperative imaging conditions for imaging the same subject by coordinating both cameras 11. The cooperative imaging condition is set by executing a cooperative imaging condition setting routine shown in FIG. Next, the cooperative imaging condition setting routine will be described in detail with reference to FIG.

  In step S31 of the cooperative imaging condition setting routine, the control unit 30 calculates the distance between both the cameras 11 and the subject based on the signal transmitted from the distance measurement unit 25. Then, when the process of step S31 ends, the control unit 30 proceeds to the next step S32. In the next step S32, the control unit 30 determines whether or not the difference between the distances between the two cameras 11 and the subject calculated in the previous step S31 is equal to or less than the threshold value M. That is, the control unit 30 determines the difference between the distance from one camera (the own camera 11) of the two cameras 11 to the subject and the distance from the other camera (the partner camera 11) of the two cameras 11 to the subject. It is determined whether or not the threshold value is equal to or less than M.

  When the determination result in step S32 is negative, the control unit 30 periodically repeats the determination in step S32. And if the determination result of this step S32 becomes affirmation determination, the control part 30 will transfer the process to the following step S33. Note that the threshold value M is set to a value (for example, 30 cm) that can generate a three-dimensional image with appropriate quality from the two-dimensional images captured by both cameras 11.

  Then, in the next step S33, the control unit 30 calculates the parallax angle (convergence angle) of both cameras 11 up to the subject based on the through images of both cameras 11. When the process of step S33 ends, the control unit 30 proceeds to the next step S34. Then, in the next step S34, the control unit 30 determines whether or not the parallax angles of both cameras 11 calculated in the previous step S33 are within the setting range. This setting range is set to such a value that a three-dimensional image can be generated in an optimal state from the two-dimensional images captured by both cameras 11.

  Here, in general, when the distance between the imaging lenses 12 of both cameras 11 is the distance between the left and right eyes of a human (about 7 cm), the distance from both cameras 11 to the subject that is optimal for obtaining a stereoscopic effect is 1 to 4 m. Therefore, as shown in FIG. 7, when the distance A between the imaging lenses 12 of both cameras 11 is 7 cm, the parallax angle Q1 of both cameras 11 when the distance B from both cameras 11 to the subject H is 1 m is 4 The parallax angle Q2 of both cameras 11 is 1 degree when the distance C from both cameras 11 to the subject H is 4 m. For these reasons, the setting range of the parallax angle in this embodiment is set to an angle of 1 to 4 degrees. Conversely, even when the distance from both cameras 11 to the subject H changes, the distance A between the imaging lenses 12 of both cameras 11 is adjusted so that the parallax angle of both cameras 11 falls within the range of 1 to 4 degrees. By doing so, it is possible to capture a two-dimensional image capable of generating an optimal three-dimensional image.

  And when the determination result of step S34 is negative determination, the control part 30 repeats determination of this step S34 periodically. And if the determination result of this step S34 becomes affirmation determination, the control part 30 will transfer the process to following step S35. In the next step S35, the control unit 30 adjusts the imaging parameters (imaging conditions) of both cameras 11 so as to match each other according to the imaging environment (brightness, type of light, etc.). In this respect, the control unit 30 functions as an imaging condition matching unit that matches imaging conditions with other imaging devices when performing cooperative imaging.

  In this case, as imaging parameters, for example, AF (Auto Focus), AE (Auto Exposure), AWB (Auto White balance), angle of view, focus, shutter speed, still image continuous shooting frame speed, moving image frame rate, etc. Is mentioned. In step S35, the control unit 30 sets the shutter timings of both cameras 11 to be synchronized. When the process of step S35 ends, the control unit 30 ends the cooperative imaging condition setting routine, returns to the cooperative imaging process routine of FIG. 2 again, and proceeds to the next step S16.

  In the next step S <b> 16, the control unit 30 reduces the through image displayed on the monitor 21 of the counterpart camera 11 on a part of the monitor 21 of the camera 11. That is, as shown in FIG. 5, the control unit 30 displays a rectangular reduction monitor unit 21a on a lower right part of the monitor 21 of the camera 11, and the counterpart camera 11 captures an image on the reduction monitor unit 21a. The through image of the subject is reduced and displayed. In this respect, the control unit 30 and the monitor 21 function as display means.

  At this time, as shown in FIG. 6, the control unit 30 also displays the shift amount Z in the vertical direction between the through images (view angles) G <b> 1 and G <b> 2 of both cameras 11 on the monitor 21 of the camera 11. Therefore, between the own camera 11 and the counterpart camera 11 that are in the cooperative imaging mode, image data of a through image of the subject that is being captured at that time is transmitted and received. 6 indicates an overlapping portion in the vertical direction between the through images (view angles) G1 and G2 of both cameras 11. When the process of step S16 ends, the control unit 30 proceeds to the next step S17.

  In next step S <b> 17, the control unit 30 determines whether or not the degree of overlap between the through images of both cameras 11 in the vertical direction is equal to or greater than a threshold value N. When the determination result of step S17 is negative determination, the control unit 30 periodically repeats the determination of step S17. And if the determination result of this step S17 becomes affirmation determination, the control part 30 will transfer the process to following step S18. Note that the threshold value N is set to a value (for example, 80%) that allows a three-dimensional image to be generated with an appropriate size from the two-dimensional images captured by both cameras 11.

  In the next step S18, the control unit 30 notifies the completion of cooperative imaging preparation. That is, the control unit 30 displays the characters “Ready for cooperative imaging” on the monitor 21 of the camera 11 in order to indicate that both cameras 11 have completed preparations for cooperative imaging of the same subject. Then, when the process of step S18 is completed, the control unit 30 proceeds to the next step S19. In the next step S19, the control unit 30 determines whether or not the release button 26b of the operation unit 26 is half-pressed. When the determination result of step S19 is negative, the control unit 30 periodically repeats the determination of step S19. And if the determination result of this step S19 becomes affirmation determination, the control part 30 will transfer the process to following step S20.

  In the next step S20, the control unit 30 determines whether or not the release button 26b of the operation unit 26 is fully pressed. When the determination result of step S20 is negative, the control unit 30 periodically repeats the determination of step S20. If the determination result in step S20 is affirmative, the control unit 30 causes the image sensor 14 to execute an imaging process, temporarily stores image data generated based on the imaging process in the RAM 20, and the image data. Is transmitted from the communication unit 24 to the outside (the partner camera 11), and the process proceeds to the next step S21.

  Then, in the next step S21, the control unit 30 temporarily stores in the RAM 20 the image data of the two-dimensional images of both cameras 11 captured in the previous step S20 in association with each other. That is, the control unit 30 sets the image data of one (for example, the two-dimensional image captured by the own camera 11) of the two two-dimensional images captured by both the cameras 11 to the right-eye image data and the other (for example, Image data of the two-dimensional image captured by the counterpart camera 11) is temporarily stored in the RAM 20 as left-eye image data. Then, when the process of step S21 ends, the control unit 30 proceeds to the next step S22.

  Then, in the next step S22, the control unit 30 determines whether it is possible to generate the image data of the three-dimensional image based on the image data of the two two-dimensional images temporarily stored in the RAM 20 in the previous step S21. . That is, the control unit 30 determines whether or not the image data of the three-dimensional image can be generated by determining from the state of the two two-dimensional images (for example, the overlapping degree or angle of the two two-dimensional images). To do. In this regard, the control unit 30 executes a second determination procedure regarding whether or not a three-dimensional image can be generated based on each two-dimensional image captured by a plurality of imaging devices located within the cooperative image capturing possible range. It functions as a second determination means. If the determination result of step S22 is affirmative, the control unit 30 proceeds to the next step S23. In the next step S23, the control unit 30 generates image data of the three-dimensional image based on the image data of the two two-dimensional images temporarily stored in the RAM 20 in the previous step S21, and includes the three-dimensional image including the three-dimensional image. Are stored in the memory card 22 of the camera 11. That is, the control unit 30 stores the two two-dimensional images in the memory card 22 as a three-dimensional image by a recording method (so-called multi-picture format) in which the two two-dimensional images are associated and stored in the same file. In this respect, the control unit 30 functions as an image data generation unit that executes an image data generation procedure for generating image data of a three-dimensional image.

  Then, when the process of step S23 ends, the control unit 30 proceeds to the next step S24. On the other hand, if the determination result of the previous step S22 is negative, the process proceeds directly to step S24 without going through step S23. In step S24, the control unit 30 includes two two-dimensional images each including the image data (right-eye image data and left-eye image data) of the two two-dimensional images temporarily stored in the RAM 20 in the previous step S21. Are stored in the memory card 22 of the camera 11 as they are, and the cooperative imaging processing routine is terminated.

Next, an operation when the subject is imaged in cooperation with the two cameras 11 of the present embodiment configured as described above will be described.
As a premise for explanation, it is assumed that an automobile is imaged as a subject in cooperation with two cameras 11 with different users at an exhibition hall such as an automobile. Further, it is assumed that the imaging mode of the two cameras 11 is switched from the normal imaging mode to the cooperative imaging mode by operating the mode switching button 26a in the operation unit 26.

  Under the premise described above, after the characters “communicable” are displayed on the monitors 21 of both cameras 11, when the users of the cameras 11 approach each other, “the cooperative imaging is possible on the monitors 21 of both cameras 11. "Is displayed. When both users hold the camera 11 toward the subject, the through image of the partner camera 11 is displayed together with the through image of the own camera 11 on the monitors 21 of both cameras 11.

  Then, when both users change the position mode of each camera 11 so as to adjust the position with the other camera 11 while looking at the monitor 21 of their own camera 11, the “cooperation” is displayed on the monitors 21 of both cameras 11. The text “Ready for imaging” is displayed. When either one of the two users presses the release button 26b of his / her camera 11 halfway and then fully presses it, the two cameras 11 perform cooperative imaging of the subject. Then, the image data of the two-dimensional image of the subject imaged by both cameras 11 is stored in each camera 11. If the image data of both two-dimensional images in this case can be stored as image data of the three-dimensional image, the image data of the three-dimensional image is generated based on the image data of the two-dimensional images of both cameras 11. , An image file of a three-dimensional image including the image file is stored.

According to the present embodiment as described above, the following effects can be obtained.
(1) A three-dimensional image can be generated by only two cameras 11 without using a special pedestal for generating a three-dimensional image. That is, it is possible to generate image data of a three-dimensional image from two two-dimensional images obtained by imaging the subject in cooperation with the two cameras 11. Therefore, a three-dimensional image can be easily generated.

  (2) The camera 11 performs cooperative imaging by transmitting and receiving a pairing signal as cooperative imaging possible suggestion information that suggests that it is possible to perform cooperative imaging with another (cooperative partner) camera 11. Therefore, it is possible to know the existence of another imaging device (other camera 11) capable of data communication with the own camera 11. Therefore, for example, when one person goes to the exhibition hall and wants to cooperatively capture a subject and generate a three-dimensional image, it is possible to easily find a partner who cooperates to capture the subject together.

  (3) When the camera 11 captures a subject in cooperation with another camera 11, the other camera 11 and the various imaging parameters (for example, AE, AF, AWB, etc.) can be matched. Therefore, the quality of a three-dimensional image generated from two two-dimensional images can be improved.

  (4) Since the camera 11 can display a through image of the subject imaged by the other camera 11 on the monitor 21 when imaging the subject in cooperation with the other camera 11. In the cooperative imaging, the users of both cameras 11 can confirm each other's imaging status.

  (5) When the camera 11 captures a subject in cooperation with another camera 11, the camera 11 can display the amount of field angle deviation with the other camera 11 on the monitor 21. The angle of view can be easily adjusted between the cameras 11.

  (6) When the camera 11 cannot generate a three-dimensional image from two two-dimensional images obtained by imaging a subject in cooperation with other cameras 11, without generating a three-dimensional image, The image data of these two two-dimensional images are stored in the memory cards 22 of both cameras 11 as they are. For this reason, it can suppress that the two-dimensional image of the to-be-photographed object is wasted.

(Example of change)
The above embodiment may be changed to another embodiment as described below.
As shown in FIG. 8, both cameras 11 may be wirelessly connected to an external device 31 such as a laptop computer so that data communication is possible. In this case, at least one of the cameras 11 and the external device 31 generates a 3D image file. For example, a three-dimensional image generation system that performs data communication for cooperative imaging between a control unit (not shown) in the external device 31 and the control unit 30 of both cameras 11 is configured. In that case, the control of the external device 31 is performed. The unit may control the overall operation and processing of the system.

-You may make it image a to-be-photographed object in cooperation with the 3 or more cameras 11. FIG.
In the cooperative imaging processing routine, step S11 and step S12 may be omitted. That is, the cooperative imaging processing routine may be started from step S13.

  In step S14 of the cooperative imaging processing routine, the user of both cameras 11 may be notified by lamps, melody, buzzer, voice, etc. that cooperative imaging is possible with both cameras 11. In this case, it is necessary to provide both cameras 11 with speakers for emitting lamps, melodies, buzzers, and voices.

In the cooperative imaging process routine, step S16 may be omitted.
In step S22 of the cooperative imaging processing routine, when the image data of both the two-dimensional images cannot be stored as the image data of the three-dimensional image, the cooperative imaging is performed without storing each image data of the two-dimensional images in the memory card 22. You may make it complete | finish a processing routine.

  In the cooperative imaging processing routine, if the determination in step S22 is affirmative, a three-dimensional image is temporarily displayed on the monitor 21 of the camera 11, and the user of the camera 11 sees the result of the three-dimensional image. After that, it may be possible to select whether or not to generate an image file of a 3D image including image data of a 3D image based on the image data of both 2D images.

In the cooperative imaging processing routine, step S24 may be omitted.
In the cooperative imaging condition setting routine, step S32 may be omitted.
In step S35 of the cooperative imaging condition setting routine, it is not always necessary to match all imaging parameters between the two cameras 11.

  -Two two-dimensional images generated by both cameras 11 to generate a three-dimensional image may be a single-shot image and the other one of continuous-shot images, or both may be continuous-shot images. One of them may be one, or one may be a still image and the other may be a single frame image in a moving image.

  In the above embodiment, the imaging device is embodied as a digital still camera, but may be embodied in other imaging devices such as a digital video camera, a mobile phone with a camera function, and a portable game machine with a camera function.

  DESCRIPTION OF SYMBOLS 11 ... Camera (imaging device), 21 ... Monitor (display screen, display means), 24 ... Communication part (communication means), 30 ... Control part (computer, display means, 1st determination means, 2nd determination means, image data) Generating means, imaging condition matching means), H ... subject, G1, G2 ... through image, S1, S2 ... cooperative imaging possible range, Z ... shift amount.

Claims (8)

An imaging device capable of imaging a subject in cooperation by communicating with other imaging devices,
First determination means for determining whether or not the other imaging device is located within a cooperative imaging possible range that is a range in which the subject can be imaged in cooperation with the other imaging device;
When the first determination unit determines that the other imaging device is located within the cooperative imaging possible range, the two-dimensional image of the subject imaged by the imaging device and the cooperative imaging are possible. Second determination means for determining whether a three-dimensional image of the subject can be generated based on another two-dimensional image of the subject captured by the other imaging device located within a range;
An image pickup apparatus comprising: an image data generation unit configured to generate image data of the three-dimensional image when the second determination unit determines that a three-dimensional image of the subject can be generated. The imaging apparatus according to claim 1, further comprising communication means capable of communicating cooperative imaging possible suggestion information that suggests that the cooperative imaging can be performed with the other imaging apparatus. . The imaging condition matching means for adjusting the imaging conditions for the cooperative imaging with the other imaging apparatus when performing the cooperative imaging with the other imaging apparatus. Item 3. The imaging device according to Item 2. The display device for displaying a through image of the subject captured by the other imaging device on a display screen when performing the cooperative imaging with the other imaging device. The imaging device according to any one of claims 1 to 3. 5. The display unit according to claim 4, wherein when performing the cooperative imaging with the other imaging device, the display unit displays an amount of deviation of an angle of view with the other imaging device on the display screen. The imaging device described. The image data generation unit obtains the image data of the one two-dimensional image and the image data of the other two-dimensional image when the second determination unit determines that the three-dimensional image of the subject cannot be generated. The imaging device according to claim 1, wherein the imaging device is generated. A plurality of imaging devices capable of imaging a subject in cooperation by communicating with each other;
First determination means for determining whether or not at least two of the imaging devices are located within a cooperative imaging possible range that is a range in which the subject can be imaged in cooperation between the imaging devices;
When it is determined by the first determination means that at least two of the imaging devices are located within the cooperative imaging possible range, the images are respectively captured by the imaging devices located within the cooperative imaging possible range. Second determination means for determining whether a three-dimensional image can be generated based on each two-dimensional image of the subject;
A three-dimensional image generation system comprising: image data generation means for generating image data of the three-dimensional image when the second determination means determines that the three-dimensional image can be generated. . On the computer,
A first determination procedure for determining whether or not at least two of the imaging devices are located within a cooperative imaging possible range that is a range in which a subject can be imaged in cooperation between a plurality of imaging devices;
When it is determined by the first determination procedure that at least two of the imaging devices are located within the cooperative imaging possible range, the imaging devices are respectively captured by the imaging devices located within the cooperative imaging possible range. A second determination procedure for determining whether a three-dimensional image can be generated based on each two-dimensional image of the subject;
A three-dimensional image generation program for executing an image data generation procedure for generating image data of the three-dimensional image when it is determined by the second determination procedure that the three-dimensional image can be generated .

Images