JP2014049960A - Imaging device, control method therefor, and program - Google Patents

Abstract

Panorama image data that does not cause a sense of incongruity at the joint of image data without generating an effect of aberration due to a lens is generated.
A digital camera acquires region information corresponding to a lens body and indicating a region where the influence of aberration by the lens is small. Then, the digital camera generates panoramic image data using image data corresponding to the region indicated by the region information among the captured image data.
[Selection] Figure 1

Description

  The present invention relates to a technique for generating panoramic image data.

  In recent years, digital cameras equipped with a panorama shooting mode for connecting a plurality of image data to generate a single panorama image data have been widely used. When generating panoramic image data, it is necessary to combine the image data and the image data so as not to give a sense of incongruity to the joint of the image data and image data. If the joint has a sense of incongruity, the quality of the panoramic image data is deteriorated and the user is uncomfortable.

  In Patent Document 1, in order to make it easy to align the edges of image data, when the image data of the second and subsequent images is captured, the image data is captured before being targeted for joining together with the currently captured image data. A technique for displaying the image data is disclosed.

  It is also a well-known fact that image data taken by a digital camera is affected by aberrations caused by a lens. Aberration is a phenomenon in which image data is not similar to an actual subject and distortion occurs. For example, there are a barrel shape in which a straight line around the lens is bent outward due to distortion and the like, and a pincushion shape that is bent inward, which are known to depend on the optical system of the lens.

JP-A 64-49031

  Since the panoramic image data is obtained by connecting a plurality of pieces of image data, if each image data is affected by an aberration caused by a lens, a sense of incongruity is generated at the connected portion. In order to alleviate the uncomfortable feeling of the joint, it is necessary to correct the influence of the aberration caused by the lens when connecting the image data. However, in order to correct the influence of the aberration caused by the lens, a large amount of computation is performed. Therefore, since a personal computer and a dedicated application are required, it is difficult for a general user to easily correct the influence of aberration caused by the lens. In addition, there is a concern that the portion in which the influence of the aberration due to the lens is corrected causes a reduction in resolution.

  In addition, in order to reduce the influence of the aberration caused by the lens, a method is known in which image data is shot so that a part of the subject overlaps at the part to be joined, and the part that is greatly affected by the aberration is cut and joined later. ing. However, at the time of image data shooting, it is not possible to know how much image data should be shot with overlapping subjects, and if there is a shortage of overlapping parts, satisfactory panoramic image data cannot be generated. was there.

  An object of the present invention is to generate panoramic image data that does not correct the influence of the aberration caused by the lens and does not cause a sense of incongruity at the joint of the image data.

  An imaging apparatus according to the present invention is imaged by an imaging means, an acquisition means for acquiring area information corresponding to a lens attached to the imaging apparatus and indicating an area where the influence of aberration by the lens is small, and the imaging means. And generating means for generating panoramic image data using image data corresponding to the region indicated by the region information.

  According to the present invention, it is possible to generate panoramic image data that does not cause a sense of incongruity at the joint of image data without correcting the influence of aberration caused by the lens.

It is a figure which shows the structure of the digital camera which concerns on embodiment of this invention. It is a figure which shows an example of the area | region information with little influence of the aberration by a lens. It is a flowchart which shows the process at the time of the panoramic photography mode of the digital camera which concerns on embodiment of this invention. It is a figure for demonstrating the guide screen for performing an angle of view adjustment by the next imaging | photography. It is a figure for demonstrating the production | generation process of panorama image data without a lens aberration influence, and wide panorama image data.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, preferred embodiments to which the invention is applied will be described in detail with reference to the accompanying drawings.

  FIG. 1 is a diagram illustrating a configuration of a digital camera according to an embodiment of the present invention. In FIG. 1, a power supply circuit unit 2 of the digital camera body 1 receives power supply from a battery 3 to generate a stabilized power supply, and enables each circuit component described below to operate. The control unit 4 performs overall control of the digital camera body 1. Further, the control unit 4 outputs a control signal for power supply to each circuit component to the power supply circuit unit 2 in accordance with various operation modes. Furthermore, a release switch 5 and an operation member 6 for instructing the start of the shooting preparation operation and the start of the shooting operation are connected to the control unit 4. The operation member 6 is a switch for setting various camera operations such as switching the photographing mode of the digital camera to the panoramic photographing mode.

  The lens (LENS) main body 50 is configured to be detachable from the digital camera main body 1. The lens body 50 includes a single focal length lens having a single focal length, a zoom lens capable of changing the focal length, a wide-angle lens having a short focal length capable of photographing a wide range, and a telephoto lens opposite thereto. is there. The effect of aberration due to the lens also depends on the type of lens. In particular, in the zoom lens, the influence of the aberration due to the lens changes depending on the focal length.

  The lens body 50 is an optical system for photographing and includes a lens 51. The lens 51 is generally configured by combining a plurality of lenses. The lens body 50 includes a lens control unit 52 for controlling an actuator for adjusting the diaphragm and focus based on an instruction from the control unit 4, and a lens memory 53 storing lens information. The lens information includes region information that is used in the panoramic shooting mode and is less affected by the aberration of the lens. The control unit 4 acquires lens information stored in the lens memory 53 via the lens control unit 52.

  The subject light that has passed through the lens body 50 passes through the optical filter 7 in which the optical low-pass filter and the infrared cut filter are integrated, and is then exposed to the imaging element 8. The imaging element 8 is composed of a two-dimensional area sensor such as a CCD or a CMOS that converts an optical image into an electrical signal. The output signal from the imaging element 8 is subjected to noise reduction and gain adjustment in a CDS (Correlated Double Sampling) / AGC (Automatic Gain Control) 9. The output signal from the CDS / AGC 9 is converted from an analog signal to a digital signal in the A / D conversion circuit 10 and input to the image processing unit 11 as image data.

  The image processing unit 11 performs image processing such as color adjustment, contrast adjustment, and edge enhancement (contour enhancement) on the image data. Further, the image processing unit 11 performs compression processing on the image data when storing the image data in the storage unit 12, and performs decompression processing on the image data when reading the image data from the storage unit 12. Apply. The storage unit 12 includes, for example, a semiconductor memory, a magnetic disk, an optical disk, or the like, and stores captured image data (hereinafter referred to as subject image data).

  The image processing unit 11 outputs subject image data and the like to the display unit 13 and causes the display unit 13 to display the image data. The display unit 13 is composed of a liquid crystal panel or the like, and displays subject image data, various shooting information, setting information, and the like. The image processing unit 11 drives a timing generator (TG / VDR) 14 to generate a clock signal to be supplied to the imaging element 8.

  A memory 15 is connected to the control unit 4 and the image processing unit 11. The memory 15 stores a program executed by the control unit 4, is used as a work area of the control unit 4, and temporarily stores image data subjected to image processing by the image processing unit 11. . The memory 15 also stores region information that is less affected by the aberration of the lens for each lens type and focal length. Note that the digital camera according to the present embodiment illustrated in FIG. 1 is an example of an imaging apparatus.

  FIG. 2 is a diagram illustrating an example of region information stored in the memory 15 and having little influence of aberration due to the lens. In FIG. 2, “lens ID” is an identification code representing the type of lens. The “focal length” is the focal length of the lens type corresponding to the “lens ID”. “Horizontal” and “vertical” refer to “horizontal” and “horizontal” of image data corresponding to an area where the influence of aberration by the lens is small in the size of the entire subject image data (here, 4000 pixels × 3000 pixels). "Vertical" size.

  As described above, the lens body 50 includes a zoom lens capable of changing the focal length. In FIG. 2, lens ID = “03” and “04” correspond to the zoom lens. In the case of a zoom lens, even if the same lens is used, the influence of aberration due to the lens varies depending on the focal length. Therefore, each lens ID has region information with little influence of aberration due to the lens for each focal length. In addition, you may make it have area | region information for every position of a distance ring of the lens main body 50, and each aperture value.

  The control unit 4 acquires lens information stored in the lens memory 53 via the lens control unit 52. In the panoramic shooting mode, the image processing unit 11 acquires, from the memory 15, region information corresponding to the lens information acquired by the control unit 4 and having little influence of aberration by the lens. Then, the image processing unit 11 superimposes the acquired region information on the subject image data and outputs it to the display unit 13.

  Next, processing in the panoramic shooting mode of the digital camera according to the present embodiment will be described with reference to FIG. The process shown in FIG. 3 is a process that is started by shifting to the panorama shooting mode in accordance with the operation of the operation member 6. 3 is a process realized by the control unit 4 reading out a necessary program from the memory 15 and executing it.

  In step S <b> 301, the control unit 4 acquires lens information stored in the lens memory 53 via the lens control unit 52. The lens information includes a lens ID for identifying the type of the lens body 50, focal length information of the lens body 50, and the like.

  In step S <b> 302, the control unit 4 outputs lens information to the image processing unit 11. The image processing unit 11 acquires, from the memory 15, region information corresponding to the lens information input from the control unit 4 and having less influence of lens aberration. For example, when the size of the entire subject image data is 4000 pixels wide × 3000 pixels long, the lens ID corresponding to the type of the lens body 50 is “04”, and the focal length of the lens body 50 is 50 mm, FIG. In the example shown in FIG. 4, the size of the image data corresponding to the area information that is less affected by the aberration of the lens is 3000 horizontal pixels × 2000 vertical pixels.

  In step S <b> 303, the image processing unit 11 superimposes the area information acquired in step S <b> 302 on the current subject image data, and outputs it to the display unit 13. FIG. 4A shows an example of a screen in which the area information 402 is superimposed on the subject image data 401 photographed for the first image in the panoramic photographing mode.

  In step S304, the control unit 4 determines whether or not the release switch 5 has been operated. When the release switch 5 is operated (when the switch is turned on), the process proceeds to step S305. On the other hand, when the release switch 5 is not operated (when the switch is off), the process returns to step S301.

  In step S305, the control unit 4 performs a shooting operation and acquires subject image data. In step S306, the image processing unit 11 stores the subject image data acquired in step S305 in the storage unit 12. When the subject image data is stored in the storage unit 12, the area information superimposed on the subject image data in step S303 is also stored as additional information of the subject image data. In step S307, the control unit 4 displays the subject image data acquired in step S305 on the display unit 13.

  The control unit 4 displays a screen on the display unit 13 for allowing the user to input an instruction of the direction in which the image data is to be connected next (next photographing direction). Here, the next image data joining direction (next photographing direction) is a direction in which the digital camera is scrolled, and is leftward, rightward, upward or downward. In step S <b> 308, the control unit 4 determines whether or not an instruction for connecting image data next is instructed. Next, when the direction in which the image data is to be joined is instructed, the process proceeds to step S309. On the other hand, if the direction for joining the next image data is not instructed, the process returns to step S308.

  In step S309, the control unit 4 displays a guide screen for adjusting the angle of view in the next shooting on the display unit 13 in accordance with the direction instructed by the user. For example, the control unit 4 divides the screen into two, displays the subject image data currently captured on the divided screen on the direction side designated by the user, and the subject image data acquired in step S306 on the divided screen on the opposite side. Is displayed. At this time, similarly to step S303, the region information acquired in step S302 is superimposed on the subject image data displayed on both split screens. Note that at the time of image data capture for the third and subsequent images, the currently captured subject image data is displayed on the divided screen on the direction side designated by the user, and is acquired in the immediately preceding step S312 on the other divided screen. The subject image data thus displayed is displayed. Step S309 is a processing example of the display control means.

  FIG. 4B shows an example of the guide screen. FIG. 4B shows an example in which the right direction is instructed by the user as the direction in which the image data is next joined. Accordingly, as shown in FIG. 4B, the subject image data currently being shot is displayed on the right-side divided screen 403 instructed by the user, and the step is displayed on the opposite (left-side) divided screen 404. The first subject image data acquired in S306 is displayed. In the divided screens 403 and 404, the area information 402 is superimposed on each subject image data. By displaying such a guide screen, the user can confirm image data corresponding to a region where the influence of the aberration by the lens is small when the angle of view is adjusted when the image data to be connected next is captured.

  In step S310, the control unit 4 determines whether or not the release switch 5 has been operated. When the release switch 5 is operated (switch on), the process proceeds to step S311. On the other hand, when the release switch 5 is not operated (switch off), the process returns to step S310.

  In step S <b> 311, the control unit 4 performs a shooting operation and acquires subject image data. In step S312, the control unit 4 stores the subject image data acquired in step S311 in the storage unit 12. In step S313, the control unit 4 displays the subject image data acquired in step S311 on the display unit 13.

  The control unit 4 displays on the display unit 13 a screen for allowing the user to input an instruction to continue or end the image data to be connected next. In step S <b> 314, the control unit 4 determines whether it is instructed to continue or end the image data to be joined next. If the instruction to continue shooting is instructed, the process proceeds to step S309, and the shooting of the next image data to be joined is repeated. On the other hand, when the end of shooting is instructed, the process proceeds to step S315.

  The control unit 4 displays on the display unit 13 a screen for allowing the user to input an instruction to generate panorama image data without aberration influence or to generate wide panorama image data. In step S315, the control unit 4 determines whether it is instructed to generate panoramic image data without aberration influence or to generate wide panoramic image data. When it is instructed to generate panorama image data without aberration influence, the process proceeds to step S316. On the other hand, if it is instructed to generate wide panorama image data, the process proceeds to step S317.

  In step S316, the image processing unit 11 generates panoramic image data without aberration influence. That is, the image processing unit 11 reads out the subject image data and area information stored in step S306 and the subject image data stored in step S312 from the storage unit 12. Next, the image processing unit 11 cuts out image data corresponding to a region where the influence of the aberration caused by the lens indicated by the region information is small from each subject image data. Next, the image processing unit 11 generates panoramic image data free from aberrations by connecting the cut out image data in the scroll direction of the digital camera. Thereby, panoramic image data without the influence of aberration is generated using only the image data corresponding to the region where the influence of the lens aberration is small.

  In step S317, the image processing unit 11 generates wide panorama image data. That is, the image processing unit 11 reads out the subject image data and area information stored in step S306 and the subject image data stored in step S312 from the storage unit 12. Here, the subject image data positioned at both ends of the combined panorama image data, that is, the subject image data stored in step S306 and the subject image data last acquired in step S312 are processed by image processing. The unit 11 moves from the subject image data to a region other than the region where the influence of the aberration by the lens is small, on the opposite side of the joint between the image data corresponding to the region where the influence of the aberration by the lens is small and the other subject image data. Cut out the corresponding image data. Further, subject image data that is not located at both ends of the combined panoramic image data, that is, subject image data other than the subject image data acquired last in the subject image data acquired in step S312, The processing unit 11 cuts out only the image data corresponding to the region where the influence of the lens aberration is small from the subject image data. Next, the image processing unit 11 refines the wide panorama image data by connecting the cut out image data in the digital scroll direction.

  FIG. 5 is a diagram for explaining processing for generating panoramic image data from three subject image data. FIG. 5A shows three pieces of subject image data 501 to 503 acquired to generate panoramic image data. Note that reference numeral 402 in FIG. 5A denotes area information superimposed on each subject image data. FIG. 5B shows the panoramic image data without lens aberration influence generated in step S316 based on the subject image data 501 to 503. FIG. 5C shows the wide panorama image data generated in step S317 based on the subject image data 501 to 503.

  When the panorama image data is generated, for example, three pieces of subject image data 501 to 503 are acquired by moving the angle of view to the right side. Then, when generating panoramic image data without lens aberration influence in step S316, only the image data corresponding to the region information 402 is used among the subject image data 501 to 503. As a result, as shown in FIG. 5B, panoramic image data having no lens aberration effect is generated by connecting only the image data corresponding to the region where the influence of the lens aberration is small. On the other hand, when the wide panorama image data is generated in step S317, the second subject image data 502 that is not located at both ends of the combined panorama image data is included in the region information 402 of the subject image data 502. Only the image data corresponding to is used. For the subject image data (first and third images) 501 and 503 located at both ends of the combined panorama image data, the image data corresponding to the area information 402 in the subject image data 501 and 503 The image data corresponding to the region outside the region information 402 on the opposite side of the joint with the other subject image data is used. As a result, as shown in FIG. 5C, the image data corresponding to the region where the influence of the lens aberration is small in each of the subject image data 501 to 503 and the first and third subject image data 501 and 503. Among them, wide panorama image data is generated by connecting image data corresponding to a region other than a region where the influence of lens aberration is small on the opposite side of the joint of the second subject image data 502.

  The control unit 4 displays on the display unit 13 a screen for allowing the user to input an instruction to continue or end the panoramic shooting mode. In step S318, the control unit 4 determines whether it has been instructed to continue the panoramic shooting mode or to end. When it is instructed to continue the panorama shooting mode, the process returns to step S301, and the panorama shooting mode is started again. On the other hand, when it is instructed to end the panorama shooting mode, the process shifts to the normal shooting mode.

  In the embodiment described above, panoramic image data is generated using a region corresponding to the type of the lens body 50 and the like that is less affected by the aberration of the lens. Therefore, according to the present embodiment, it is possible to generate panoramic image data that does not cause a sense of incongruity at the joint of image data without correcting the influence of aberration caused by the lens.

  In the above-described embodiment, an example in which the present invention is applied to a digital camera has been described, but not all of the embodiments of the present invention have been described. In the present embodiment, the area information that is less affected by the aberration of the lens is stored in the memory 15 of the digital camera body 1 so as to be compatible with the conventional lens. However, the present invention is not limited to this. The area information may be stored in the lens memory 53 on the lens body 50 side so as to be compatible with a new lens, or may be stored in both the lens body 50 and the digital camera body 1. In this embodiment, the area information indicates the size of the image data corresponding to the area information that is less affected by the lens aberration, but corresponds to the area information that is less affected by the lens aberration with respect to the entire subject image data. The ratio of image data to be processed may be used.

  Furthermore, in the present embodiment, the lens body 50 is detachable, but this is not restrictive. Further, in this embodiment, the user is made to select the direction in which the image data is joined after the first image data is photographed, but the direction in which the image data is joined is selected before the first image data is photographed. You may do it. For example, the second image data is connected in the right direction, the third image data is connected in the upward direction, and the fourth image data is connected in the left direction. You may be able to change it.

  Further, in steps S306 and S312, all of the subject image data is stored in the storage unit 12, but only the portion used for generating the panoramic image data of the subject image data is stored in the storage unit 12. It may be. Thereby, the capacity consumption of the storage unit 12 can be suppressed. This processing is an example of processing performed by the storage control unit.

  The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, or the like) of the system or apparatus reads the program. It is a process to be executed.

  1: Digital camera body 2: Power supply circuit unit 3: Battery 4: Control unit 5: Release switch 6: Operating member 7: Optical filter 8: Image sensor 9: CDS / AGC 10: A / D conversion circuit, 11: image processing unit, 12: storage unit, 13: display unit, 14: TG / VDR, 15: memory, 50: lens body, 51: lens, 52: lens control unit, 53: lens memory

Claims (8)

Imaging means;
An acquisition unit that acquires region information corresponding to a lens mounted on the imaging apparatus and indicating a region with less influence of aberration by the lens;
An imaging apparatus comprising: generating means for generating panoramic image data using image data corresponding to an area indicated by the area information among image data captured by the imaging means.   The imaging apparatus according to claim 1, wherein the acquisition unit acquires the area information corresponding to at least one of the lens type, focal length, distance ring position, and aperture value. .   3. The display control unit according to claim 1, further comprising: a display control unit that causes the display unit to display both the image data currently captured by the imaging unit and the image data captured immediately before by the imaging unit. Imaging device.   The imaging apparatus according to claim 3, wherein the display control unit further displays the area information on the display unit.   For the image data corresponding to both ends of the panoramic image data, the generation means uses image data corresponding to a region other than the region indicated by the region information together with the image data corresponding to the region indicated by the region information. The imaging device according to claim 1, wherein the panorama image data is generated. Of the image data picked up by the image pickup means, the storage means further stores in the storage means only the part used when the panoramic image data is generated by the generation means,
The imaging apparatus according to claim 1, wherein the generation unit generates the panoramic image data using image data stored in the storage unit. A method for controlling an imaging apparatus having imaging means,
An acquisition step for acquiring region information corresponding to a lens mounted on the imaging device and indicating a region with less influence of aberration by the lens;
A generation method for generating panoramic image data using image data corresponding to a region indicated by the region information among the image data captured by the imaging unit. A program for causing a computer to execute a control method of an image pickup apparatus having an image pickup means,
An acquisition step for acquiring region information corresponding to a lens mounted on the imaging device and indicating a region with less influence of aberration by the lens;
A program for causing a computer to execute a generation step of generating panoramic image data using image data corresponding to a region indicated by the region information among image data captured by the imaging unit.

Images