JP2013179509A - Imaging apparatus, imaging method, and imaging program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To appropriately determine an imaging scene.SOLUTION: The imaging apparatus determines whether an imaging scene of an image is a scene in water or not according to which range of a graph for determining the imaging scene the image applies to, based on color information included in the captured and generated image. In this case, when it cannot be determined whether the imaging scene is a scene in water or not, it is determined whether the imaging environment of the imaging apparatus is in water or not based on detection of a prescribed pressure on the whole surface of a touch panel, and it is determined whether the imaging scene is a scene in water or not based on the determination result. Thus, the imaging scene can be determined by using the touch panel even when the color information of the captured image is not enough for appropriately determining whether the imaging scene is a scene in water or not.

Description

  The present technology relates to an imaging apparatus, an imaging method, and an imaging program.

  For example, a digital still camera, which is an imaging device that captures an object such as a landscape, a person, an article, or the like, can shoot underwater such as in the sea, in a pool, or in a river depending on the state of being housed in a waterproof case.

  By the way, in water, red has a property that red tends to attenuate and blue tends to transmit. For this reason, in a captured image of an underwater subject imaged by a white balance digital still camera in normal air, a phenomenon of blue fog is generated in which blue is reflected in the entire image. For underwater imaging, it is possible to suppress the occurrence of blue fog by setting the digital still camera to underwater white balance. In recent years, for example, there has been proposed a digital still camera that controls white balance for underwater use based on a result of determining whether or not an imaged scene is an underwater scene using color information included in a captured image (for example, , See Patent Document 1).

  According to Patent Document 1, first, “horizontal value of B (Blue) / average value of G (Green)” is plotted on the horizontal axis of the graph, and “average value of R (Red) / G (Green) is plotted on the vertical axis. Set the “average value”. Then, a large number of captured images classified into an underwater scene or a non-underwater scene are distributed according to the average value of RGB for the graph. Such a graph is divided into a region where many underwater scene images are distributed, a region where many non-underwater scene images are distributed, and a region where both underwater scene and non-underwater scene images are distributed together. A discrimination graph created in this way is prepared in advance. Next, the digital still camera discriminates the photographic scene based on which region of the discrimination graph the captured image captured corresponds to based on the color information included in the captured image. Then, a white balance corresponding to the determined shooting scene is set for the digital still camera. For example, at a position where the sea surface is shallow, even if the external environment is underwater, the occurrence of blue fog is small if the position is accessible to outside light. For this reason, in the digital still camera, a non-underwater scene is discriminated based on the area of the discrimination graph corresponding to the color information included in the captured image, and a white balance corresponding to the scene is set. In addition, in a digital still camera in a deep position in the sea, an underwater scene is discriminated and a white balance suitable for the scene is set.

JP 2009-194437 A

  However, in Patent Document 1, if the color information of the captured image corresponds to a region where the underwater scene and the non-underwater scene are mixed in the determination graph, the captured scene cannot be appropriately determined. For this reason, when picking up an image, it is impossible to pick up an image with an appropriate image pickup / signal parameter corresponding to the image pickup scene, and the picked-up image is deteriorated.

  The present technology has been made in view of such a point, and an object thereof is to provide an imaging device, an imaging method, and an imaging program that can appropriately determine an imaging scene.

  In order to solve the above problem, the imaging apparatus includes an imaging unit, a color information extraction unit, a pressure detection unit, an environment determination unit, and an imaging scene determination unit. The color information extraction unit extracts color information included in a captured image generated by imaging the subject by the imaging unit. The environment determination unit determines whether the imaging environment is underwater according to the pressure from the external environment detected by the pressure detection unit. Then, when the imaging scene determination unit cannot determine whether the imaging scene of the subject is an underwater scene based on the color information extracted by the color information extraction unit, an imaging scene corresponding to the imaging environment determined by the environment determination unit is selected. Determine.

  In order to solve the above problem, as an imaging method, color information included in a captured image generated by the imaging unit imaging the subject is extracted, and according to the pressure from the external environment detected by the pressure detection unit, It is determined whether or not the imaging environment is underwater. If it is not possible to determine whether or not the imaging scene of the subject is an underwater scene based on the extracted color information, the imaging scene corresponding to the determined imaging environment is determined.

  In order to solve the above problem, in the imaging program, an imaging unit is connected to a computer in which an imaging unit that captures an image of a subject and generates a captured image and a pressure detection unit that detects pressure from the external environment are connected. Extracts the color information contained in the generated captured image, determines whether the imaging environment is underwater according to the pressure detected by the pressure detection unit, and determines whether the imaging scene of the subject is an underwater scene based on the extracted color information If it is not possible to determine whether or not, a process for determining an imaging scene corresponding to the determined imaging environment is executed.

  According to the imaging apparatus, the imaging method, and the imaging program, it is possible to suppress the deterioration of the captured image.

It is a figure which shows an example of the external appearance of the imaging device which concerns on embodiment. It is a figure which shows an example of the external appearance of the waterproof case which accommodates the imaging device which concerns on embodiment. It is a figure which shows an example of the hardware constitutions of the imaging device which concerns on embodiment. It is a figure showing an example of functional composition with which an imaging device concerning an embodiment is provided. It is a figure which shows an example of the imaging scene discrimination | determination graph for discriminating an imaging scene with the imaging device which concerns on embodiment. It is a figure for demonstrating discrimination | determination of the imaging environment by the touchscreen part of the imaging device which concerns on embodiment. It is a figure which shows an example of the threshold value (stable waiting time) of the count value required for the update of the judgment result of the imaging scene of the imaging device which concerns on embodiment. It is a figure which shows an example of the setting content of the imaging parameter according to the imaging scene which the imaging device which concerns on embodiment sets. 6 is a flowchart (part 1) illustrating imaging parameter setting processing executed by the imaging apparatus according to the embodiment. 12 is a flowchart (part 2) illustrating an imaging parameter setting process executed by the imaging apparatus according to the embodiment. It is a flowchart which shows the discrimination process of the imaging scene performed with the imaging device which concerns on embodiment. It is a flowchart which shows the setting process of the stable waiting time performed with the imaging device which concerns on embodiment.

  Hereinafter, embodiments will be described with reference to the drawings.

  In the imaging device according to the embodiment, when the environment determination unit cannot determine whether the imaging scene of the subject is an underwater scene based on the color information extracted from the captured image of the subject, the environment determination unit performs imaging based on the pressure from the external environment. An imaging scene corresponding to the imaging environment where it is determined whether or not the scene is an underwater scene is determined. As a result, the imaging apparatus can appropriately determine the imaging scene, appropriately set the imaging parameter corresponding to the determined imaging scene, and suppress deterioration of the captured image. Such an imaging apparatus is realized as, for example, a digital still camera, a digital video camera, or the like. In the present embodiment, the imaging device is described as a digital still camera.

  First, the appearance of the imaging apparatus will be described with reference to FIG.

  FIG. 1 is a diagram illustrating an example of an external appearance of an imaging apparatus according to an embodiment. 1A shows the front side of the imaging device 100 (the side on which the imaging lens 11a is provided), and FIG. 1B shows the back side of the imaging device 100 (the display unit 17 that displays the captured image). The perspective view of each side) is shown.

  The imaging apparatus 100 includes a housing unit 10 that forms an exterior.

  As shown in FIG. 1A, a lens mechanism 11 and a flash mechanism 12 positioned side by side with respect to the lens mechanism 11 are provided at the upper part on the front side of the housing unit 10. An imaging mechanism (not shown) that forms an imaging signal of a subject based on light input from the imaging lens 11a of the lens mechanism 11 is incorporated. Such an imaging mechanism is disposed behind the lens mechanism 11 on the optical axis.

  A lens cover 16 that slides up and down with respect to the housing unit 10 in FIG. 1A to open and close the imaging lens 11 a and the light emitting unit of the flash mechanism 12 is provided at the lower part on the front side of the housing unit 10. ing. As shown in FIG. 1A, when the lens cover 16 is slid downward and is in the lens open position, the imaging lens 11a and the light emitting portion of the flash mechanism 12 are both opened, and imaging operation is possible. On the other hand, when the lens cover 16 is slid upward and is in the lens closed position, both the imaging lens 11a and the light emitting portion of the flash mechanism 12 are closed, and the imaging operation is disabled.

  A power button 13 for turning on / off the power, an imaging button 14 for performing imaging, and a zoom lever 15 for performing a zoom operation on the wide-angle side or the telephoto side are provided on the upper surface of the housing unit 10. It has been.

Further, as shown in FIG. 1B, on the back side of the housing unit 10, a display that displays an image, a moving image, or the like that is imaged by the imaging mechanism or that is already stored in the memory unit of the imaging device 100 A portion 17 is provided. The display unit 17 is further provided with a touch panel unit 18 that receives a touch input from the user.
The display unit 17 is formed so as to largely occupy the back surface of the housing unit 10. The display unit 17 includes a display unit such as a liquid crystal display or an organic EL (Electo-Luminescence) display. When pressure is applied from the outside to the transparent sheet-like touch panel unit 18 bonded to the display unit 17, various operations and settings of the imaging apparatus 100 related to imaging, reproduction, editing, and the like according to the pressure position are performed.

  The imaging device 100 is housed in a waterproof case 50 (see FIG. 2) described later and set to a special mode when imaging in water. In this case, icons 17 a to 17 f for operation of the imaging apparatus 100 are displayed on the display unit 17. For example, the icon 17a is displayed on the upper left portion of the display unit 17. Further, the icons 17b to 17f are displayed in a straight line on the right side with an interval in the vertical direction.

  The icon 17a is, for example, a captured image playback button icon. The icons 17b to 17f are icons for performing other operations and settings of the imaging apparatus 100. For example, the icons 17b to 17f are an imaging mode setting icon for setting whether to shoot a moving image or a still image, a flash mode setting icon for setting an operation mode of the flash mechanism 12, and a macro mode setting for setting whether to perform macro shooting or normal shooting. Icons.

  Further, a metal fitting 19 for attaching a strap string or the like is provided on the right side (in FIG. 1B) of the housing unit 10.

  Next, a waterproof case for housing the imaging device 100 when performing underwater imaging will be described with reference to FIG.

  FIG. 2 is a diagram illustrating an example of an external appearance of a waterproof case that houses the imaging device according to the embodiment. 2A shows the front side of the waterproof case 50 (front case 20 side provided with the lens window 21), and FIG. 2B shows the back side of the waterproof case 50 (viewing window 32). Further, perspective views of the rear case 30 side are shown.

  The waterproof case 50 can detachably store the imaging device 100. Such a waterproof case 50 includes a front case 20 and a rear case 30 that are rotatably connected via a hinge 31, and a fastening mechanism that binds the front case 20 and the rear case 30 in a state in which the imaging device 100 is housed. 23. In addition, the front case 20 and the rear case 30 are each formed in a bottomed box shape, and each has a housing recess. A storage unit that can store the imaging device 100 is provided inside by overlapping the front case 20 and the rear case 30 with these storage recesses facing each other. Moreover, as a material of the front case 20 and the rear case 30, for example, PC (polycarbonate) is used. In addition, the material of the front case 20 and the rear case 30 is not limited to this, Other synthetic resins may be sufficient and metals, such as aluminum alloy other than a synthetic resin, may be sufficient. Moreover, transparent PC etc. may be sufficient as a material so that an internal structure can be seen, and other synthetic resin transparent, semi-transparent, or opaque may be sufficient.

  As shown in FIG. 2A, the front case 20 is provided with a substantially rectangular lens window 21. The lens window 21 is provided at a position facing the imaging lens 11 a of the lens mechanism 11 of the accommodated imaging device 100 when the imaging device 100 is accommodated in the front accommodation recess of the waterproof case 50. In addition, a glass plate 22 is attached to the lens window 21 so that external light can be naturally input to the lens mechanism 11.

  A power button 24 and an imaging button 25 on the case side are provided on the upper surface of the front case 20. The power button 24 and the imaging button 25 on the case side are provided at positions corresponding to the power button 13 and the imaging button 14 of the imaging device 100 housed in the front housing recess of the waterproof case 50, respectively. Accordingly, when a pressing operation is performed on the power button 24 on the case side, the power button 13 on the imaging device 100 side is pressed. Further, when a pressing operation is performed on the imaging button 25 on the case side, the imaging button 14 on the imaging device 100 side is pressed.

  As shown in FIG. 2B, the rear case 30 includes a viewing window 32 for visually recognizing the display unit 17 of the imaging device 100 housed in the housing part of the waterproof case 50, and the viewing window 32. A case hood 33 is provided on the outer surface so as to surround.

  The visual recognition window 32 is provided at a position facing the display unit 17 when the imaging device 100 is stored in the storage unit of the waterproof case 50. The visual recognition window 32 allows the display unit 17 of the imaging device 100 to be visually recognized from the outside even when the imaging device 100 is stored in the storage unit of the waterproof case 50.

  The case hood 33 is provided so as to protrude outward on the opposite side of the lens window 21 over the entire circumference so as to surround the visual recognition window 32. Therefore, the case hood 33 prevents light from entering the imaging apparatus 100 from the back side and being irradiated to the display unit 17.

  Further, a plurality of operation buttons 34 are provided on the side of the case hood 33 of the rear case 30 (on the right side in FIG. 2B). These operation buttons 34 are for operating the icons 17b to 17f displayed on the display unit 17 of the imaging device 100 housed in the waterproof case 50 from the outside of the imaging device 100, and correspond to the icons 17b to 17f. Is provided.

  Next, an example of the hardware configuration of the imaging device 100 housed in such a waterproof case 50 will be described with reference to FIG.

  FIG. 3 is a diagram illustrating an example of a hardware configuration of the imaging apparatus according to the embodiment.

  As illustrated in FIG. 3, the imaging apparatus 100 includes an optical block 111, an imaging element 112, an A / D conversion unit 113 (the above corresponds to the imaging unit), an image information processing unit 114, a display processing unit 115, and an operation reception unit 116. The touch panel control unit 117 and the recording medium control unit 118 are provided. Further, the optical block 111, the image sensor 112, the A / D conversion unit 113, the image information processing unit 114, the display processing unit 115, the operation reception unit 116, the touch panel control unit 117, and the recording medium control unit 118 are connected to each unit. A control unit 200 for inputting and outputting signals is provided.

  The optical block 111 performs focusing, zooming, and optical axis adjustment (camera shake correction) by moving the imaging lens 11a (FIG. 1A) for condensing light from the subject onto the imaging device 112 and moving the imaging lens 11a. A drive mechanism, a shutter mechanism, an iris mechanism, and the like are provided.

  The image sensor 112 is, for example, a solid-state image sensor such as a charge coupled device (CCD) type or a complementary metal oxide semiconductor (CMOS) type. Such an image sensor 112 is driven based on a timing signal output from the control unit 200, and converts incident light from the subject into an electrical signal. In the image sensor 112, an image of a subject is extracted as an analog image signal of three primary colors of RGB (Red, Green, Blue), for example, and amplified as necessary.

  The A / D conversion unit 113 converts the image information of the analog image signal output from the image sensor 112 into a digital image signal.

  Based on the control from the control unit 200, the image information processing unit 114 performs image processing such as black level correction, white balance adjustment, and γ correction on the digital image signal output from the A / D conversion unit 113. The image information subjected to the image processing in this way is output to the display processing unit 115, the recording medium control unit 118, etc. (via the control unit 200). For example, the image information processing unit 114 performs compression processing on the image information subjected to the image processing, and outputs the image information (compressed image information) subjected to the compression processing to the control unit 200. The control unit 200 causes the recording medium control unit 118 to supply the compressed image information output from the image information processing unit 114 to the recording medium 119. In addition, the image information processing unit 114 acquires the compressed image information recorded on the recording medium 119 via the recording medium control unit 118 and the control unit 200, performs decompression processing on the compressed image information, and performs this decompression processing. The applied image information is output to the display processing unit 115. A display processing unit 115 described later causes the display unit 17 to display image information output from the image information processing unit 114. As a compression method, for example, a JPEG (Joint Photographic Experts Group) method can be adopted.

  The display processing unit 115 receives image information from the image information processing unit 114 and causes the display unit 17 to display the image information. In addition, the display processing unit 115 receives, from the control unit 200, image information related to an operation screen such as icons 17a to 17f, a setting screen, a management screen, and the like as illustrated in FIG. In this case, the display processing unit 115 causes the display unit 17 to display image information such as an operation screen together with the image information from the image information processing unit 114.

  The operation accepting unit 116 accepts operation inputs by the power button 13, the imaging button 14, and the zoom lever 15 other than the operation input accepted by the touch panel unit 18, for example, as shown in FIG. The received signal is output to the control unit 200.

  The touch panel control unit 117 is connected to the touch panel unit 18, detects the touch position and pressure based on the touch input information received by the touch panel unit 18, and outputs the detection result to the control unit 200.

  The recording medium control unit 118 is connected to the recording medium 119 based on the control from the control unit 200, outputs image information output from the recording medium 119 to the control unit 200, and records various image information on the recording medium 119. Let

  The recording medium 119 is a recording device that records image information supplied from the recording medium control unit 118. Various types of data such as JPEG image information are recorded on the recording medium 119, for example. As the recording medium 119, for example, a semiconductor memory such as a disk memory card or a removable recording medium such as a DVD (Digital Versatile Disc) can be used. Further, the recording medium 119 can be built in the imaging apparatus 100 or can be detachable from the imaging apparatus 100.

  The control unit 200 is connected to the optical block 111, the image sensor 112, the A / D conversion unit 113, the image information processing unit 114, the display processing unit 115, the operation reception unit 116, the touch panel control unit 117, and the recording medium control unit 118. In addition, input / output of signals to / from each unit is performed to control each unit.

  Such a control unit 200 includes a main control unit 200a, a memory unit 200b, a graphic processing unit 200c, and an input / output interface 200d, and the respective units are connected to each other by a bus 200e.

  The main control unit 200a performs overall control of the entire imaging apparatus 100 by executing various programs stored in a storage medium such as the memory unit 200b.

  The memory unit 200b temporarily stores an OS (Operating System) to be executed by the main control unit 200a and at least a part of the program. The memory unit 200b stores various data necessary for processing by the main control unit 200a.

  A display processing unit 115 is connected to the graphic processing unit 200c. The graphic processing unit 200c outputs an operation screen such as icons 17a to 17f, a setting screen, a management screen, and the like to the display processing unit 115 in accordance with a command from the main control unit 200a.

  An operation receiving unit 116, a touch panel control unit 117, and a recording medium control unit 118 are connected to the input / output interface 200d. The input / output interface 200d notifies the recording medium control unit 118 of a control signal from the main control unit 200a via the bus 200e, and similarly notifies the main control unit 200a of a signal from each unit. Similarly, a signal from the touch panel control unit 117 is notified to the main control unit 200a.

  Next, functions of the imaging apparatus 100 having such a hardware configuration will be described with reference to FIG.

  FIG. 4 is a diagram illustrating an example of a functional configuration included in the imaging apparatus according to the embodiment.

  The imaging apparatus 100 includes an image information acquisition unit 210, a color information extraction unit 220, an imaging scene determination graph holding unit 230, a touch information acquisition unit 240, an environment determination unit 250, an imaging scene determination unit 260, and a stable waiting time setting unit 270. . Furthermore, a counter unit 280, an imaging scene determination threshold holding unit 290, an imaging scene holding unit 310, an imaging scene determination unit 320, and a parameter setting unit 330 are provided.

  The image information acquisition unit 210 acquires the image information of the digital image signal converted from the analog image signal of the subject from the A / D conversion unit 113 and outputs the image information to the color information extraction unit 220.

  The color information extraction unit 220 extracts color information from the image information of the captured image output from the image information acquisition unit 210 and outputs the color information to the imaging scene determination unit 260. The color information is, for example, an average value calculated from each density value of RGB extracted from the entire screen of the captured image. The calculated average values of RGB are output to the imaging scene determination unit 260.

  The imaging scene discrimination graph holding unit 230 holds an imaging scene discrimination graph and outputs the graph to the imaging scene discrimination unit 260.

  Here, the imaging scene discrimination graph held by the imaging scene discrimination graph holding unit 230 will be described with reference to FIG.

  FIG. 5 is a diagram illustrating an example of an imaging scene determination graph for determining an imaging scene by the imaging apparatus according to the embodiment.

  In the discrimination graph, regarding the average value of each RGB value extracted from the entire screen of the captured image, the horizontal axis indicates “B average value / G average value”, and the vertical axis indicates “R average value / "Average value of G" respectively. In such a discrimination graph, a large number of captured images classified in advance into an underwater scene or a non-underwater scene are distributed according to the average value of RGB.

  In the graph distributed in this manner, a large number of underwater scene images are plotted in a broken line 231 (right side from the broken line 232) and a region below 232 (underwater area), and a large number of non-underwater scene images are plotted. What is indicated is a region (non-underwater region) beyond the broken line 231. In addition, the area (mixed area) surrounded by the broken lines 231 and 232 is a plot in which the images of the underwater scene and the non-underwater scene are mixed.

  As described above, the imaging scene discrimination graph is divided into three areas, an underwater area, a non-underwater area, and a mixed area.

  The imaging scene discrimination graph holding unit 230 holds such a graph.

  Returning to the description of FIG. 4, the touch information acquisition unit 240 detects the touch position of the touch detected based on the touch operation on the touch panel unit 18, the pressure at the position, and the touch information such as the electrical grounding of the touch panel unit 18. Is obtained from the touch panel control unit 117 and output to the environment determination unit 250.

  The environment determination unit 250 determines whether the external environment (imaging environment) of the imaging apparatus 100 is underwater based on the touch information output from the touch information acquisition unit 240.

  Here, a method for determining whether or not the external environment of the imaging apparatus 100 that performs imaging by the environment determination unit 250 is underwater will be described with reference to FIG.

  FIG. 6 is a diagram for explaining the determination of the imaging environment by the touch panel unit of the imaging apparatus according to the embodiment.

  The imaging device 100 in a state where the back surface (touch panel portion 18) is directed is not in water (in the air) in FIG. 6A, part in water in FIG. 6B, and in water in FIG. 6C. Each case is illustrated.

  First, when the imaging device 100 is located in non-water (FIG. 6A), the touch panel unit 18 does not detect a pressure exceeding a predetermined level from the external environment. If the pressure is not detected, the environment determination unit 250 determines that the imaging environment of the imaging device 100 is non-water.

  When a part of the imaging apparatus 100 is in water (FIG. 6B), the touch panel unit 18 detects a predetermined pressure from the external environment partially on the entire surface. As described above, when the predetermined pressure (water pressure from the water) is detected on some of the touch panels 18, the environment determination unit 250 does not determine the imaging environment of the imaging device 100.

  Further, when the imaging apparatus 100 is located in water (FIG. 6C), the touch panel unit 18 applies a predetermined pressure (water pressure from the water) from the external environment to the entire surface and electrical grounding of the touch panel unit 18. Detect. As described above, when the pressure on the entire surface of the touch panel unit 18 and the touch panel unit 18 are detected to be electrically grounded, the environment determination unit 250 determines that the imaging environment of the imaging device 100 is underwater. Determine.

  Returning to the description of FIG. 4 again, when the color information of the captured image is output from the color information extraction unit 220, the captured scene determination unit 260 outputs the captured scene determination graph (FIG. 5) from the captured scene determination graph holding unit 230. To get. The captured scene determination unit 260 refers to the captured scene determination graph to determine whether the captured scene of the captured image is an underwater scene, a non-underwater scene, or an unknown based on a region corresponding to the output color information. “Unknown” refers to the case where the output color information corresponds to the “mixed region” in the imaging scene determination graph, and the imaging scene cannot be appropriately determined. Therefore, in this case, the imaging scene determination unit 260 refers to the determination result of the imaging environment of the environment determination unit 250 to determine the imaging scene corresponding to the determination result. The imaging scene determination unit 260 outputs such an imaging scene determination result to the imaging scene holding unit 310 and the imaging scene determination unit 320, respectively.

  The stable waiting time setting unit 270 waits for stable updating of the imaging scene determination result according to whether or not the touch information is used to determine the imaging scene of the imaging scene determination unit 260 (stable Set the waiting time. The stable waiting time can be expressed as a count value in which a predetermined time is associated with one count, for example.

  The details of the imaging scene determination process by the imaging scene determination unit 260 and the stable waiting time setting process by the stable waiting time setting unit 270 will be described later.

  The counter unit 280 sequentially supplies count values used for determining an imaging scene by an imaging scene determination unit 320 (described later) to the imaging scene determination unit 320.

  The imaging scene determination threshold value holding unit 290 holds a threshold value of a count value used for determining an imaging scene by an imaging scene determination unit 320 (described later) for each imaging scene. Hereinafter, a specific example of the imaging scene determination threshold will be described with reference to FIG.

  FIG. 7 is a diagram illustrating an example of a threshold value (stable waiting time) of a count value required for updating a determination result of an imaging scene of the imaging device according to the embodiment. FIG. 7 shows a case where 0.1 second is associated with one count.

  According to this, in the underwater scene of the imaging scene, the threshold value (stability waiting time) of the count value when the touch panel unit 18 determines that the imaging environment of the imaging device 100 is underwater is “1 (0 .1 second) ”. The threshold value of the count value (stable waiting time) when there is no discrimination on the touch panel unit 18 is set to “20 (2.0 seconds)”. In addition, the threshold value (stabilization waiting time) of the count value in the case of the non-underwater scene of the imaging scene is set to “10 (1.0 seconds)”.

  In addition, the stable waiting time in each case can be set freely. However, the threshold value of the count value when the touch panel unit 18 determines that the imaging environment of the imaging device 100 is underwater is set as short as possible.

  Returning to the description of FIG. 4 again, the imaging scene holding unit 310 sequentially inputs and holds the determined imaging scenes output from the imaging scene determination unit 260 one by one and holds them at the time of input. The captured scene is output to the captured scene determination unit 320. Specifically, when an imaging scene is sequentially input from the imaging scene determination unit 260, the imaging scene holding unit 310 holds an imaging scene (for example, this imaging scene corresponds to the nth). The case will be described. In this case, when the n + 1th imaging scene is input from the imaging scene determination unit 260, the imaging scene holding unit 310 outputs the nth imaging scene to the imaging scene determination unit 320 and also the n + 1th imaging. Try to keep the scene. In this way, the captured images held by the captured scene holding unit 310 are sequentially updated.

  The captured scene determination unit 320 finally determines the captured scene of the captured image and outputs the determination result to the parameter setting unit 330. Whenever the imaging scene determination unit 320 receives the count value counted up by the counter unit 280, the imaging scene output from the imaging scene determination unit 260 and the imaging scene held by the imaging scene holding unit 310 are the same. Determine whether or not. If the respective imaging scenes are the same, the count value at that time should be equal to or greater than the count value threshold (stable waiting time) held by the imaging scene discrimination threshold holding unit 290 set by the stabilization waiting time setting unit 270. For example, the imaging scene determination unit 320 determines that the same imaging scene is the imaging scene of the subject included in the captured image. However, if the count value after the count-up is less than the threshold value, the next determination process is performed without determining the imaging scene of the subject included in the captured image. On the other hand, if the captured scenes are not the same (different), the count value is temporarily reset without determining the captured scene of the subject included in the captured image, and the next determination process is performed.

  The parameter setting unit 330 is used for the optical block 111 or the like to generate a captured image based on the determination result output from the captured scene determination unit 320, or for the image information processing unit 114 to perform image processing of the captured image. Set each parameter.

  Hereinafter, a specific example of the imaging parameter as an example of the parameter will be described with reference to FIG.

  FIG. 8 is a diagram illustrating an example of the setting content of the imaging parameter corresponding to the imaging scene set by the imaging device according to the embodiment.

  According to this, when the imaging scene is an underwater scene, the parameter setting unit 330 selects “underwater white balance” and sets it in the optical block 111.

  Further, when the imaging scene is a non-underwater scene, a normal white balance corresponding to the non-underwater scene is set in the optical block 111.

  In addition to white balance, parameters set according to the imaging scene can be set in the same manner as in FIG. 8 with respect to γ correction, tone curve, color reproduction, shutter speed, ISO sensitivity, and the like.

  Next, imaging parameter setting processing of the imaging apparatus 100 having such a function will be described with reference to FIGS. 9 and 10.

  9 and 10 are flowcharts illustrating imaging parameter setting processing executed by the imaging apparatus according to the embodiment.

  [Step S110] The operation accepting unit 116 accepts power-on by the power button 13 (via pressing the power button 24 of the waterproof case 50).

  [Step S120] The control unit 200 performs an initialization process. In the initialization process, for example, the imaging scene held by the imaging scene holding unit 310 is deleted, and the touch determination flag is initialized.

  [Step S <b> 130] The counter unit 280 sets 0 to the count value i.

  [Step S140] The optical block 111 condenses light from the subject on the image sensor 112, and the image sensor 112 generates a captured image of an analog image signal from incident light from the subject. Further, the A / D conversion unit 113 converts the captured image of the analog image signal output from the image sensor 112 into a digital image signal.

  [Step S150] The imaging scene determination unit 260 and the like determine whether the imaging scene of the captured image is an underwater scene or a non-underwater scene based on the digital image signal output from the A / D conversion unit 113.

  The imaging scene determination unit 260 outputs the determination result to the imaging scene holding unit 310 and the imaging scene determination unit 320, respectively. At this time, if the imaging scene holding unit 310 holds the imaging scene, the imaging scene is output to the imaging scene determination unit 320 so that the imaging scene output from the imaging scene determination unit 260 is held. To do.

  Details of the processing in step S150 will be described with reference to FIG.

  [Step S160] The stable waiting time setting unit 270 sets the stable waiting time of the imaging scene based on the determination result of the imaging scene in step S150.

  Details of the processing in step S160 will be described with reference to FIG.

  [Step S170] The imaging scene determination unit 320 acquires from the imaging scene determination threshold holding unit 290 a count value threshold corresponding to the stabilization wait time of the imaging scene determined and set in steps S150 and S160.

  [Step S180] The imaging scene determination unit 320 determines whether or not the imaging scene output from the imaging scene determination unit 260 is the same as the imaging scene held by the imaging scene holding unit 310. If the captured scenes are not the same, the process proceeds to step S190. If the captured scenes are the same, the process proceeds to step S200.

  [Step S190] The counter unit 280 sets the count value i to 0.

  [Step S200] The counter unit 280 sets i + 1 to the count value i.

  [Step S210] The imaging scene determination unit 320 determines whether or not the count value i is equal to or greater than the threshold value of the count value for the imaging scene. If the count value i is smaller than the threshold value of the count value for the determined imaging scene, the process proceeds to step S240. If the count value i is greater than or equal to the threshold value of the count value for the captured scene, the process proceeds to step S220.

  [Step S220] The imaging scene determination unit 320 determines the imaging scene determined in step S150.

  [Step S230] The parameter setting unit 330 sets the imaging parameter corresponding to the imaging scene determined in step S220 in the optical block 111 and the image information processing unit 114.

  [Step S240] It is determined whether or not the operation accepting unit 116 has accepted the power off by the power button 13 (via pressing the power button 24 of the waterproof case 50). If the power-off is accepted, the imaging parameter setting process is terminated. If the power-off is not accepted, the process proceeds to step S140 again.

  Here, the imaging scene determination process in step S150 in the imaging parameter setting process will be described with reference to FIG.

  FIG. 11 is a flowchart illustrating an imaging scene determination process executed by the imaging apparatus according to the embodiment.

  [Step S <b> 141] The color information extraction unit 220 acquires image information of a captured image from the image information acquisition unit 210, extracts RGB density values from the acquired image information, and extracts the extracted RGB values. The average value is calculated.

  The imaging scene discrimination unit 260 refers to the discrimination graph (FIG. 5) held by the imaging scene discrimination graph holding unit 230, and based on the color information extracted in this way, the acquired captured image indicates which region of the discrimination graph. It is determined whether it corresponds to.

  [Step S142] The captured scene determination unit 260 determines whether or not the captured image corresponds to the mixed area of the determination graph based on the color information extracted from the image information of the captured image.

  For example, if the imaging environment of the imaging apparatus 100 is a shallow position even underwater, the captured image is a non-underwater region based on color information included in the captured image captured at such a position due to the influence of external light. May fall under. Further, even in water where blue fog is generated as an imaging environment, the captured image may correspond to a mixed region based on color information included in a captured image obtained by imaging toward the water surface. Furthermore, even when the imaging environment is non-water, the captured image may correspond to a mixed region based on color information included in the captured image, depending on the color reflected by the subject. When it corresponds to the mixed area of the discrimination graph, the process proceeds to step S143, and when it does not correspond to the mixed area of the determination graph (when it corresponds to the underwater area or the non-underwater area), the process proceeds to step S149.

  [Step S143] The touch information acquisition unit 240 acquires touch information detected by the touch panel control unit 117.

  [Step S144] The environment determination unit 250 determines the imaging environment of the imaging apparatus 100 based on the touch information acquired in Step S143.

  [Step S145] The environment determination unit 250 determines whether or not the imaging environment of the imaging apparatus 100 is underwater depending on whether or not a predetermined pressure on the entire surface of the touch panel unit 18 and electrical grounding of the touch panel unit 18 are detected. Is determined.

  When the environment determination unit 250 detects the predetermined pressure and the electrical grounding of the touch panel unit 18 on the entire surface of the touch panel unit 18, the environment determination unit 250 determines that the imaging environment is underwater, and proceeds to the process of step S146. If the predetermined pressure is not detected on the entire surface of the touch panel unit 18 or the electrical grounding of the touch panel unit 18 is not detected, it is determined that the imaging environment is non-water, and the process proceeds to step S148.

  When the image is taken toward the water surface in the above example, since the imaging environment is underwater, the touch panel unit 18 detects a predetermined pressure on the entire surface, so the environment determining unit 250 is underwater. Determine that. In addition, when the captured image corresponds to the mixed region according to the color reflected by the subject in the above example, since the imaging environment is non-water, the touch panel unit 18 does not detect the pressure. 250 determines that the imaging environment is non-water.

  [Step S146] The imaging scene determination unit 260 determines that the imaging scene is an underwater scene.

  [Step S147] The imaging scene determination unit 260 sets a touch determination flag indicating that the imaging scene is an underwater scene using the touch information.

  [Step S148] The imaging scene determination unit 260 determines that the imaging scene is a non-underwater scene.

  [Step S149] The imaging scene determination unit 260 determines whether or not the touch determination flag is set. When the touch determination flag is set, the process proceeds to step S141a. When the touch determination flag is not set, the process proceeds to step S141b.

  [Step S141a] The imaging scene determination unit 260 clears the touch determination flag.

  [Step S141b] The imaging scene determination unit 260 determines the imaging scene determined in step S141, step S146, or step S148, and outputs the determined imaging scene to the imaging scene holding unit 310 and the imaging scene determination unit 320, respectively.

  Next, the stable waiting time setting process in step S160 in the imaging parameter setting process will be described with reference to FIG.

  FIG. 12 is a flowchart illustrating a stabilization waiting time setting process executed by the imaging apparatus according to the embodiment.

  [Step S161] The stable waiting time setting unit 270 determines whether or not the touch determination flag described with reference to FIG. 11 is set.

  [Step S162] As a result of the determination in step S161, if the touch determination flag is not set (touch information is not used), the process proceeds to step S163 and is set (touch information is used). In that case, the process proceeds to step S166.

  [Step S163] The stable waiting time setting unit 270 determines whether or not the imaging scene determination unit 260 determines that the imaging scene is an underwater scene. If the captured scene is not an underwater scene (if it is a non-underwater scene), the process proceeds to step S164. If the captured scene is an underwater scene, the process proceeds to step S165.

  [Step S164] The stable waiting time setting unit 270 selects the non-underwater scene for the threshold value of the count value corresponding to the stable waiting time associated with the imaging scene held by the imaging scene determination threshold holding unit 290.

  For example, in the case of FIG. 7, the count value threshold is set to 10 (the stabilization waiting time is 1.0 second) with reference to the count value threshold held by the imaging scene determination threshold holding unit 290.

  [Step S165] The stable waiting time setting unit 270 uses the threshold value of the count value corresponding to the stable waiting time associated with the imaging scene held by the imaging scene determination threshold holding unit 290 (for the underwater scene (in the touch panel unit 18). Select No discrimination.

  For example, in the case of FIG. 7, the count value threshold is set to 20 (the stabilization waiting time is 2.0 seconds) with reference to the count value threshold held by the imaging scene determination threshold holding unit 290.

  As described above, when it is determined that the imaging scene is an underwater scene using only color information without using touch information, the determination result may change immediately. In order to prevent such fluctuation of the determination result, it is desirable to set a relatively long stable waiting time.

  [Step S166] The stabilization waiting time setting unit 270 uses the threshold value for the underwater scene (in the touch panel unit 18) of the count value threshold corresponding to the stabilization waiting time associated with the imaging scene held by the imaging scene determination threshold holding unit 290. Select Yes / No.

  For example, in the case of FIG. 7, the count value threshold is set to 1 (the stabilization waiting time is 0.1 second) with reference to the count value threshold held by the imaging scene determination threshold holding unit 290.

  As described above, when it is determined that the imaging scene is an underwater scene by using the touch information, it is conceivable that the imaging apparatus 100 is surely underwater. For this reason, in order to speed up the update of the determination result, it is desirable to set a stable waiting time as short as possible.

  [Step S167] The stable waiting time setting unit 270 sets the stable waiting time selected in steps S164 to S166.

  In such an imaging device 100, whether the captured scene of the captured image is an underwater scene depending on which region of the captured scene discrimination graph the captured image corresponds to based on color information included in the captured image generated by capturing an image. Is determined. At this time, if it is not possible to determine whether or not the imaging scene is an underwater scene, it is determined whether or not the imaging environment of the imaging device 100 is underwater according to detection of a predetermined pressure on the entire surface of the touch panel unit 18. It is determined whether or not the imaging scene is an underwater scene based on the determination result. Accordingly, even when it is not possible to appropriately determine whether the captured scene is an underwater scene or a non-underwater scene based only on the color information of the captured image, the captured scene can be determined using the touch panel unit 18. For this reason, the accuracy of discrimination of the captured scene is improved, and parameters such as white balance according to the captured scene can be appropriately set, and deterioration of the captured image can be suppressed.

  If only the touch information on the touch panel unit 18 is used to discriminate the imaging scene, for example, in the shallow water of seawater, in the case of only the touch panel unit 18, the imaging scene is underwater because the imaging environment is underwater. It is determined that the scene is an underwater scene. However, in shallow water, since it is affected by external light, a blue fog does not always occur, and it is desirable that the imaging scene be a non-underwater scene. Thus, when only the touch panel unit 18 is used, it is not possible to appropriately determine the imaging scene. Therefore, as in the case of the imaging apparatus 100, when the imaging scene cannot be determined using the color information, the imaging scene can be more appropriately determined by using the touch information detected by the touch panel unit 18, and appropriate for the imaging scene. It is possible to set various parameters.

  In addition, when only the color information is used in order to determine that the imaging scene is an underwater scene, a relatively long stabilization waiting time is set. As a result, it is possible to prevent the fluctuation of the determination result of the imaging scene and to reliably set the parameter corresponding to the underwater scene. Further, in order to make the same determination, when only the touch panel unit 18 is used, a short stabilization waiting time is set. Thereby, since the imaging device 100 is surely underwater, it is possible to quickly update the determination result and set the parameter corresponding to the underwater scene appropriately and immediately.

  The above processing can be realized by causing a computer to execute a predetermined program. In that case, a program describing the processing contents to be realized is provided. The program describing the processing contents can be stored in a computer-readable storage medium. Examples of the computer-readable storage medium include a magnetic recording device, an optical disk, a magneto-optical recording medium, and a semiconductor memory. Examples of the magnetic recording device include a hard disk device, a flexible disk (FD), and a magnetic tape (MT). Examples of the optical disk include a DVD, a DVD-RAM (Random Access Memory), a CD-ROM (Compact Disc-Read Only Memory), a CD-R (Recordable), and a CD-RW (ReWritable). Magneto-optical recording media include MO (Magneto-Optical disk).

  When distributing the program, for example, a portable recording medium such as a DVD or a CD-ROM in which the program is recorded is sold. It is also possible to store the program in a storage device of a server computer and transfer the program from the server computer to another computer via a network.

  The computer that executes the program stores, for example, the program recorded on the portable recording medium or the program transferred from the server computer in its own storage device. Then, the computer reads the program from its own storage device and executes processing according to the program. The computer can also read the program directly from the portable recording medium and execute processing according to the program. Further, each time the program is transferred from the server computer, the computer can sequentially execute processing according to the received program.

In addition, this technique can also take the following structures.
(1) an imaging unit that images a subject and generates a captured image;
A color information extraction unit that extracts color information included in the captured image generated by the imaging unit;
A pressure detector that detects pressure from the external environment;
An environment discriminating unit that discriminates whether or not the imaging environment is underwater according to the pressure detected by the pressure detecting unit;
When it is not possible to determine whether or not the imaging scene of the subject is an underwater scene based on the color information extracted by the color information extraction unit, the imaging scene corresponding to the imaging environment determined by the environment determination unit is determined. An imaging scene discrimination unit;
An imaging apparatus having
(2) A stable waiting time setting unit that sets a stable waiting time required to update the imaging scene according to the imaging scene determination process of the imaging scene determination unit,
The imaging apparatus according to (1), further including:
(3) When the determination result of the environment determination unit is used in the determination process of the imaging scene, the stable waiting time setting unit is extracted by the color information extraction unit in the determination process of the imaging scene. The stabilization waiting time is set shorter than when the determination result based on color information is used.
The imaging device according to (2).
(4) The imaging apparatus according to (2) or (3), wherein the determination process of the imaging scene is a process of determining that the imaging scene is an underwater scene.
(5) The pressure detection unit is a touch panel,
The touch panel detects a predetermined pressure from the external environment over the entire surface of the touch panel, and depending on whether the touch panel surface is electrically grounded,
The environment determination unit determines whether the imaging environment is underwater;
The imaging device according to any one of (1) to (4).
(6) The imaging scene determination unit determines that the imaging scene is an underwater scene when the environment determination unit determines that the imaging environment is underwater.
The imaging device according to (5).
(7) The imaging scene determination unit determines that the imaging scene is a non-underwater scene when the environment determination unit determines that the imaging environment is non-underwater.
The imaging device according to (5).
(8) Extracting color information included in the captured image generated by the imaging unit imaging the subject,
According to the pressure from the external environment detected by the pressure detector, determine whether the imaging environment is underwater,
An imaging method for determining the imaging scene corresponding to the determined imaging environment when it is not possible to determine whether the imaging scene of the subject is an underwater scene based on the extracted color information.
(9) To a computer connected to an imaging unit that captures an image of a subject and generates a captured image, and a pressure detection unit that detects pressure from the external environment,
Extracting color information included in the captured image generated by the imaging unit;
According to the pressure detected by the pressure detection unit, determine whether the imaging environment is underwater,
Determining the imaging scene corresponding to the determined imaging environment when it is not possible to determine whether the imaging scene of the subject is an underwater scene based on the extracted color information;
An imaging program for executing processing.

  Note that various modifications can be made to the above-described embodiment without departing from the gist of the embodiment.

  Further, the above-described embodiments can be modified and changed by those skilled in the art, and are not limited to the exact configurations and application examples described.

  210... Image information acquisition unit 220... Color information extraction unit 230... Imaging scene determination graph holding unit 240... Touch information acquisition unit 250. ... Stabilization waiting time setting unit, 280... Counter unit, 290... Imaging scene determination threshold value holding unit, 310... Imaging scene holding unit, 320.

Claims (9)

An imaging unit that images a subject and generates a captured image;
A color information extraction unit that extracts color information included in the captured image generated by the imaging unit;
A pressure detector that detects pressure from the external environment;
An environment discriminating unit that discriminates whether or not the imaging environment is underwater according to the pressure detected by the pressure detecting unit;
When it is not possible to determine whether or not the imaging scene of the subject is an underwater scene based on the color information extracted by the color information extraction unit, the imaging scene corresponding to the imaging environment determined by the environment determination unit is determined. An imaging scene discrimination unit;
An imaging apparatus having A stable waiting time setting unit for setting a stable waiting time required to update the imaging scene according to the imaging scene determination process of the imaging scene determination unit;
The imaging device according to claim 1, further comprising: When the determination result of the environment determination unit is used in the determination process of the imaging scene, the stable waiting time setting unit adds the color information extracted by the color information extraction unit to the determination process of the imaging scene. The stabilization waiting time is set shorter than when using the determination result based on
The imaging device according to claim 2.   The imaging apparatus according to claim 2, wherein the determination process of the imaging scene is a process of determining that the imaging scene is an underwater scene. The pressure detection unit is a touch panel,
The touch panel detects a predetermined pressure from the external environment over the entire surface of the touch panel, and depending on whether the touch panel surface is electrically grounded,
The environment determination unit determines whether the imaging environment is underwater;
The imaging device according to claim 1. The imaging scene determination unit determines that the imaging scene is an underwater scene when the environment determination unit determines that the imaging environment is underwater.
The imaging device according to claim 5. The imaging scene determination unit determines that the imaging scene is a non-underwater scene when the environment determination unit determines that the imaging environment is non-underwater.
The imaging device according to claim 5. Extracting color information included in the captured image generated by the imaging unit imaging the subject,
According to the pressure from the external environment detected by the pressure detector, determine whether the imaging environment is underwater,
An imaging method for determining the imaging scene corresponding to the determined imaging environment when it is not possible to determine whether the imaging scene of the subject is an underwater scene based on the extracted color information. To a computer connected to an imaging unit that images a subject and generates a captured image, and a pressure detection unit that detects pressure from the external environment,
Extracting color information included in the captured image generated by the imaging unit;
According to the pressure detected by the pressure detection unit, determine whether the imaging environment is underwater,
Determining the imaging scene corresponding to the determined imaging environment when it is not possible to determine whether the imaging scene of the subject is an underwater scene based on the extracted color information;
An imaging program for executing processing.

Images