JP2013162173A - Imaging apparatus and program - Google Patents

Abstract

A defective pixel is corrected appropriately.
An imaging apparatus includes an imaging element in which a plurality of pixels are arranged and outputs a signal corresponding to light, generates an image data corresponding to a subject, and information on a scene of the subject based on the image data A scene information generation unit that generates image data and a correction unit that corrects image data based on information related to the scene of the subject, and corrects image data generated by a signal output from a defective pixel included in the image sensor. A correction unit.
[Selection] Figure 1

Description

  The present invention relates to an imaging apparatus and a program.

  2. Description of the Related Art In recent years, imaging devices including imaging elements such as CCD (Charge Coupled Device) image sensors and CMOS (Complementary Metal Oxide Semiconductor) image sensors have been widely used. When an imaging device such as a CCD image sensor or a CMOS image sensor provided in this imaging device has a defect in a pixel unit in its manufacturing process or the like, and includes defective pixels such as white scratches that output an abnormally high signal level There is. In order to reduce the influence of such defective pixels, it is common for an imaging apparatus to perform defective pixel correction processing (see, for example, Patent Document 1).

Japanese Patent Laid-Open No. 2007-124056

However, for example, the imaging apparatus described in Patent Document 1 switches the correction process according to the determination result of whether or not the defect level of the defective pixel is higher than a predetermined level set by the imaging condition. In the imaging apparatus described in Patent Document 1, the value of a predetermined level used for switching the correction process is changed according to the imaging condition. As described above, since the above-described imaging apparatus switches the correction process depending on the imaging condition that does not depend on the captured image data, the image quality deterioration may be caused by performing the correction process on the defective pixel depending on the captured image data. You may be invited.
As described above, the above-described imaging device may not be able to appropriately perform the correction process of the defective pixel.

  The present invention has been made to solve the above problems, and an object of the present invention is to provide an imaging apparatus and a program capable of appropriately correcting defective pixels.

  In order to solve the above problem, an embodiment of the present invention includes an imaging unit that generates image data according to a subject, a scene information generation unit that generates information about the scene of the subject from the image data, and the information And a correction unit that corrects the image data based on the image data.

  According to one embodiment of the present invention, an imaging procedure in which a plurality of pixels are arranged in a computer and an imaging unit that outputs a signal corresponding to light generates image data corresponding to a subject, scene information A scene information generation procedure in which the generation unit generates information regarding the scene of the subject from the image data, and a correction unit is a correction procedure in which the image data is corrected based on the information, and is included in the imaging element. And a correction procedure for correcting image data generated by the signal output from the defective pixel.

  According to the present invention, it is possible to appropriately perform defective pixel correction processing.

It is a block diagram which shows the imaging device by this embodiment. It is a figure which shows an example of the classification | category of scene analysis information. It is a flowchart which shows the correction process of the defective pixel in 1st Embodiment. It is a figure which shows an example of the scene analysis for every division area in the embodiment. It is a flowchart which shows the correction process of the defective pixel in 2nd Embodiment.

Hereinafter, an imaging apparatus according to an embodiment of the present invention will be described with reference to the drawings.
[First Embodiment]
FIG. 1 is a block diagram illustrating an imaging apparatus 100 according to the present embodiment.
In this figure, the imaging apparatus 100 includes an imaging unit 10, a buffer memory unit 30, an image processing unit 40, a display unit 50, a storage unit 60, a communication unit 70, an operation unit 80, and a control unit 90.
In the present embodiment, as an example, a case where the imaging apparatus 100 is a digital single lens reflex camera will be described.

  The imaging unit 10 includes an optical system 11 including a plurality of lenses, an imaging element (12, 14), an A / D (analog / digital) conversion unit (13, 15), and a mirror 16. The imaging unit 10 is controlled by the control unit 90 based on set imaging conditions (for example, aperture value, exposure value, imaging sensitivity, exposure time, etc.). The imaging unit 10 forms an optical image via the optical system 11 on the imaging element 12 or the imaging element 14, and image data based on the optical image converted by the A / D conversion unit 13 or the A / D conversion unit 15. Is generated. That is, the imaging unit 10 includes an imaging element (12, 14) in which a plurality of pixels are arranged and outputs a signal corresponding to light, captures an image of an optical image via the optical system 11, and corresponds to the subject. Generated image data. The optical system 11 described above is detachably attached.

  Note that the imaging unit 10 generates captured image data that is image data that is actually recorded as a captured image, and through image data for analyzing a captured scene by a user confirming a subject or the like before imaging. . When generating the through image data, the imaging unit 10 reflects the optical image via the optical system 11 by the mirror 16 to form an image on the imaging element 14, and converts the optical image into the optical image converted by the A / D conversion unit 15. Generate based image data. Further, when generating captured image data, the imaging unit 10 moves the mirror 16 from the optical path of the optical system 11 according to an imaging instruction to form an image on the imaging element 12, and the optical converted by the A / D conversion unit 13. Image data based on the image is generated.

For example, the image sensor 12 converts an optical image formed on a light receiving surface (not shown) into an electric signal (voltage signal) and supplies the electric signal to the A / D converter 13. The light receiving surface of the image pickup device 12 is configured by a plurality of image sensors (not shown) arranged in a grid such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor. Each image sensor corresponds to each pixel of the image to be captured, and converts the formed optical image into a voltage value. That is, the image sensor 12 captures an image by generating a pixel signal corresponding to light incident on the image sensor 12 via the optical system 11. In the present embodiment, the image sensor 12 is a main image sensor, and generates a pixel signal of captured image data as described above.
Further, the image sensor 12 has a defective pixel that outputs a high voltage signal regardless of light. The imaging apparatus 100 according to the present embodiment corrects pixel data corresponding to the defective pixel by a correction process described later.

  For example, the image sensor 14 converts an optical image formed on a light receiving surface (not shown) into an electric signal (voltage signal) and supplies the electric signal to the A / D converter 15. The light receiving surface of the image sensor 14 is composed of a plurality of image sensors (not shown) arranged in a lattice pattern such as a CCD image sensor or a CMOS image sensor, for example, as with the image sensor 12. Each image sensor corresponds to each pixel of the image to be captured, and converts the formed optical image into a voltage value. In the present embodiment, the image sensor 12 is a sub-image sensor, and generates a pixel signal of through image data as described above. Further, since the through image data is used for confirmation of a subject to be imaged and analysis of an imaging scene, the image sensor 14 generates image data having a smaller number of pixels (resolution) than the image sensor 12. May be.

The A / D converter 13 performs analog-to-digital conversion on the voltage value (pixel signal) converted by the image sensor 12 and outputs image data formed by the converted digital signal (pixel data).
The A / D conversion unit 15 performs analog-digital conversion on the voltage value (pixel signal) converted by the image sensor 14 and outputs image data formed by the converted digital signal (pixel data).

  The buffer memory unit 30 temporarily stores image data captured by the imaging unit 10 and the like.

  The display unit 50 is, for example, a liquid crystal display, and displays image data (through image and captured image data) captured by the imaging unit 10, an operation screen, and the like. The display unit 50 may be a display unit in the finder.

  The storage unit 60 stores various information used for processing of the control unit 90, imaging conditions by the imaging unit 10, image processing conditions, and the like. The storage unit 60 includes a defect storage unit 61 that stores position information of defective pixels.

  The defect storage unit 61 is, for example, a nonvolatile memory, and stores in advance position information (for example, address information of the image sensor 12) of defective pixels included in the image sensor 12. As the position information of the defective pixel, for example, the position information of the defective pixel included in the image sensor 12 detected at the time of manufacture is stored in advance. Further, the degree of conspicuousness of the defective pixel varies depending on the imaging conditions (for example, ISO sensitivity (imaging sensitivity) and shutter speed). That is, there are cases where it is better to determine a defective pixel at the same position, depending on the imaging conditions, and cases where the defective pixel can be ignored without being determined as a defective pixel. Therefore, the defect storage unit 61 stores position information of defective pixels in association with the imaging conditions.

The communication unit 70 is connected to a removable storage medium 200 such as a card memory, and performs writing, reading, or erasing of image data on the storage medium 200.
The storage medium 200 is a storage unit that is detachably connected to the imaging apparatus 100, and stores captured image data captured by the imaging unit 10, for example.

  The operation unit 80 includes, for example, a power switch, a shutter button, a cross key, a confirmation button, a delete button, and other operation keys. The operation unit 80 is operated by a user to receive a user's operation input and perform control. To the unit 90.

  The bus 300 is connected to the imaging unit 10, the buffer memory unit 30, the image processing unit 40, the display unit 50, the storage unit 60, the communication unit 70, the operation unit 80, and the control unit 90. The output image data and control signals are transferred.

  The control unit 90 includes, for example, a CPU (Central processing unit) and the like, and controls each component included in the imaging apparatus 100. For example, the control unit 90 causes the display unit 50 to display through image data obtained via the image sensor 14 and the A / D conversion unit 15. In addition, the control unit 90 analyzes the imaging scene based on, for example, through image data obtained through the imaging element 14 and the A / D conversion unit 15. The control unit 90 sets an imaging condition according to the analyzed imaging scene, or causes the image processing unit 40 to perform image processing of captured image data according to the analyzed imaging scene. This imaging scene analysis will be described later in detail.

For example, when the imaging unit 12 receives an imaging instruction via the operation unit 80, the control unit 90 captures captured image data obtained via the imaging element 12 and the A / D conversion unit 13 in the image processing unit 40. Correction processing of defective pixels included in the element 12 is executed. The defective pixel correction process will be described later in detail. For example, the control unit 90 stores the captured image data corrected by the image processing unit 40 in the storage medium 200 as a captured image.
The control unit 90 includes a scene analysis unit 91.

  The scene analysis unit 91 (scene information generation unit) generates scene analysis information, which is information for analyzing a captured scene, based on image data (for example, through image data). The scene analysis information is information related to the scene of the subject, for example. Here, the through image data is divided into a plurality of divided areas (regions) for each of the plurality of regions of the image sensor 12, and the scene analysis unit 91 generates scene analysis information for each of the divided areas. The plurality of divided areas are, for example, areas in which the through image data is equally divided into a predetermined number, and are similarly equally divided in the captured image data corresponding to the through image data. That is, the scene analysis unit 91 generates scene analysis information for each of a plurality of areas of the image sensor 12.

The scene analysis unit 91 analyzes (determines) the captured scene for each divided area based on the generated scene analysis information. Here, the scene analysis information is information for analyzing a captured scene such as color information, luminance information, and frequency information. The captured scene information is, for example, information indicating areas such as a person, a face, a background, a night view, and the sky, and includes information obtained by predicting a subject pattern from a feature amount such as scene analysis information. The scene analysis information includes, for example, imaging scene information indicating areas such as a person, a face, a background, a night view, and the sky, together with information for analyzing the imaging scene such as color information, luminance information, and frequency information (frequency component). May be included. The scene analysis unit 91 supplies the generated scene analysis information to the image processing unit 40 via the bus 300.
The control unit 90 performs AF (autofocus) control and setting of imaging conditions based on the imaging scene information analyzed by the scene analysis unit 91. Further, the control unit 90 may cause the image processing unit 40 to perform image processing of the captured image data in accordance with the captured scene information analyzed by the scene analyzing unit 91.

  The image processing unit 40 performs image processing on the image data stored in the buffer memory unit 30 based on the image processing conditions stored in the storage unit 60. For example, the image processing unit 40 may perform image processing according to the captured scene information supplied from the scene analysis unit 91. The image data stored in the buffer memory unit 30 here is image data (input image) input to the image processing unit 40. For example, captured image data, through image data, or a storage medium This is captured image data read from 200. Further, the image processing unit 40 includes a correction unit 41 that performs correction processing on pixel data corresponding to a defective pixel included in the image sensor 12.

  The correction unit 41 uses pixel data corresponding to a defective pixel included in the image sensor 12 among pixel data included in the captured image data captured by the image sensor 12 in the scene analysis information generated by the scene analysis unit 91. Accordingly, correction processing is performed. That is, the correction unit 41 corrects the captured image data based on the information. For example, the correction unit 41 corrects captured image data generated by a signal output from a defective pixel included in the image sensor 12. Note that the captured image data is divided into a plurality of divided areas. The correction unit 41 performs correction processing for each divided area according to the scene analysis information corresponding to the plurality of divided areas. That is, the correction unit 41 corrects pixel data corresponding to the defective pixel for each divided area according to the scene analysis information generated for each divided area by the scene analysis unit 91. That is, the correction unit 41 corrects the captured image data corresponding to the area of the image sensor 12 based on the scene analysis information generated for each area of the image sensor 12.

  Specifically, the correction unit 41 reads out the position information of the defective pixel corresponding to the imaging condition from the defect storage unit 61. The correction unit 41 switches, for example, two correction patterns (correction pattern A and correction pattern B) according to the scene analysis information generated by the scene analysis unit 91, and pixel data corresponding to defective pixels for each divided area. Is corrected. Here, the two correction patterns (correction processing patterns) are correction processing patterns for performing correction processing corresponding to different correction levels.

  For example, the correction pattern A is a correction pattern in a case where defective pixels corresponding to the correction level “A” are easily noticeable, and it is necessary to correct defects due to more defective pixels, and a small amount of correction marks remain. Is a correction pattern when priority is given to correcting defective pixels. On the other hand, the correction pattern B is a correction pattern when the defective pixel corresponding to the correction level “B” is not conspicuous. This is a correction pattern. Here, for example, when there is a light / dark boundary near the defective pixel, or when the contrast changes rapidly, a correction mark that remains overcorrected remains. A correction trace due to this overcorrection or the like is referred to as a correction trace. When this correction mark is generated, the captured image data subjected to the correction process may cause deterioration in image quality.

  The two correction patterns have different thresholds for determining whether or not to correct pixel data corresponding to defective pixels, for example, corresponding to the correction levels (“A” and “B”). That is, the correction pattern A has a lower threshold value for whether or not to perform correction processing than the correction pattern B, and can correct more defective pixels than the correction pattern B. In addition, the correction pattern B has a threshold value for determining whether or not to perform correction processing higher than that of the correction pattern A, and it is possible to perform correction processing on defective pixels that are fewer than the correction pattern A. In the case of the correction pattern A, for example, the correction unit 41 performs correction processing that is simplified compared to the correction pattern B to easily perform correction processing of defective pixels within a predetermined processing period, and correction marks are likely to remain. Execute correction processing.

  For example, the correction unit 41 determines whether or not each divided area is an image (area) in which correction marks are conspicuous in accordance with the scene analysis information of each divided area. When it is determined that the correction mark is an image (area) where the correction mark is conspicuous, the correction unit 41 corrects the determined divided area using the correction pattern B described above. Further, when it is determined that the correction trace is not an image (area) where the correction mark is conspicuous, the correction unit 41 corrects the determined divided area using the correction pattern A described above.

FIG. 2 is a diagram illustrating an example of classification of scene analysis information in the present embodiment.
In this figure, the table shows an example of the case where the scene analysis information is classified into two cases: (a) when a defective pixel correction mark is conspicuous and (b) when a defective pixel correction mark is conspicuous.
The correction unit 41 determines that the correction trace is an image (area) where the correction trace is conspicuous when the correction trace of the defective pixel shown in FIG. Here, the case where the correction mark of the defective pixel shown in FIG. 2A is conspicuous means that, for example, when the imaging scene information is a human face, or when the imaging scene information is empty, the frequency component is high (predetermined A case where the luminance information is an intermediate region (predetermined threshold Y1 <luminance <predetermined threshold Y2).

  The correction unit 41 determines that the correction analysis mark is an image (area) where the correction mark is not conspicuous when the correction mark of the defective pixel shown in FIG. 2B is not conspicuous. Here, the case where the correction trace of the defective pixel shown in FIG. 2B is not conspicuous is, for example, when the imaging scene information is the background, or when the imaging scene information is a night scene, the frequency component is low (a predetermined threshold value). And the case where the luminance information is high (higher than a predetermined threshold Y2) or low (lower than a predetermined threshold Y1).

  As described above, the correction unit 41 corrects the pixel data corresponding to the defective pixel by switching a plurality of (for example, two) correction patterns for performing correction processing corresponding to different correction levels according to the scene analysis information. To process. The correction unit 41 stores the corrected captured image data in the buffer memory unit 30.

Next, the operation of the imaging apparatus 100 in this embodiment will be described.
In the imaging apparatus 100, when the subject to be imaged is imaged, the control unit 90 first periodically acquires the image via the imaging element 14 and the A / D conversion unit 15 and stores it in the buffer memory unit 30. The control unit 90 causes the buffer memory unit 30 to store the through image data on the display unit 50. By confirming the through image displayed on the display unit 50, the user confirms the subject to be imaged.

Next, when the control unit 90 receives an imaging instruction via the operation unit 80, the image data obtained via the imaging element 12 and the A / D conversion unit 13 is taken as captured image data. The data is stored in the buffer memory unit 30 (imaging procedure). The scene analysis unit 91 of the control unit 90 generates scene analysis information for each divided area based on the through image data stored in the buffer memory unit 30 (scene information generation procedure), and analyzes the captured scene information. To do.
Next, the control unit 90 causes the correction unit 41 of the image processing unit 40 to perform defective pixel correction processing on the captured image data captured by the image sensor 12. That is, the control unit 90 causes the correction unit 41 to execute a correction process for defective pixels according to the scene analysis information generated by the scene analysis unit 91 (correction procedure).

FIG. 3 is a flowchart showing a defective pixel correction process according to this embodiment.
In this figure, first, the correction unit 41 of the image processing unit 40 acquires scene analysis information for each divided area from the scene analysis unit 91 via the bus 300 (step S101).
Next, the correction unit 41 acquires imaging sensitivity information (for example, ISO sensitivity information) when the captured image data is captured from the storage unit 60 (step S102).

  Next, the correction unit 41 acquires shutter time information when the captured image data is captured from the storage unit 60 (step S103). Here, the shutter time information is exposure time or exposure time. The shutter time information may include the charge accumulation time of the image sensor 12 from the reset of the pixel data in the image sensor 12 or the read time of the pixel data to the next pixel data read time.

  Next, the correction unit 41 acquires defective pixel information based on the acquired ISO sensitivity information and shutter time information (step S104). That is, the correction unit 41 reads out and acquires the ISO sensitivity information that is the imaging condition and the position information of the defective pixel associated with the shutter time information from the defect storage unit 61 of the storage unit 60.

Next, the correcting unit 41 determines whether or not the image is an image (area) in which correction marks are conspicuous for each divided area (step S105). That is, the correction unit 41 determines whether or not an image (area) in which correction marks are conspicuous for each divided area based on the scene analysis information for each divided area acquired from the scene analysis unit 91. Note that the correction unit 41 determines whether the correction mark is an image (area) where the correction mark is conspicuous based on the classification information of the scene analysis information as illustrated in FIG.
When it is determined that the correction mark is an image (area) where the correction mark is conspicuous (step S105: YES), the correction unit 41 advances the processing to step S107. If the correction unit 41 determines that the correction mark is not a conspicuous image (area) (step S105: NO), the process proceeds to step S106.

In step S <b> 106, the correction unit 41 selects the correction pattern A described above as a correction pattern for correcting the divided area.
In step S107, the correction unit 41 selects the correction pattern B described above as a correction pattern for correcting the divided area.
In addition, the correction | amendment part 41 performs the process of step S106 and step S107 for every division area similarly to the process of step S105. That is, the correction unit 41 selects a correction pattern for each divided area in step S106 and step S107.

  Next, the correction unit 41 calculates correction data (step S108). That is, the correction unit 41 reads out pixel data corresponding to the defective pixel of the captured image data stored in the buffer memory unit 30 based on the acquired position information of the defective pixel. The correction unit 41 calculates correction data of each pixel data corresponding to the read defective pixel based on the correction pattern (correction pattern A or correction pattern B) selected for each divided area.

  Next, the correction unit 41 writes the correction data calculation value to the captured image data as corrected pixel data (step S109). That is, the correction unit 41 replaces the calculated correction data corresponding to each defective pixel with the pixel data corresponding to each defective pixel of the captured image data, and stores it in the buffer memory unit 30. Thereby, the correction unit 41 completes the correction process of the defective pixel and ends the correction process.

FIG. 4 is a diagram showing an example of scene analysis for each divided area in the present embodiment.
In this figure, an image G1 shows an example of a captured image captured by the image sensor 12. The image G1 is equally divided into nine divided areas R1 to R9.
The scene analysis unit 91 determines, for example, the divided area R5 as a human face, and determines, for example, the divided area R1 and the divided area R2 as a background (mountain). For example, the scene analysis unit 91 determines that the divided area R3 is empty. The scene analysis unit 91 supplies scene analysis information, which is determination information for each divided area, to the correction unit 41.

The correction unit 41 selects the correction pattern A or the correction pattern B according to the scene analysis information. For example, since the scene analysis information indicates a human face with respect to the divided area R5, the correction unit 41 determines that the correction trace is conspicuous and selects the correction pattern A. For example, the correction unit 41 determines that the correction trace B is not an image (area) where the correction trace is conspicuous because the scene analysis information indicates the background for the divided area R1 and the divided area R2, and selects the correction pattern B. For example, the correction unit 41 determines that the correction trace A is an image (area) where the correction trace is conspicuous because the scene analysis information indicates empty for the divided area R3, and selects the correction pattern A.
Thus, the correction unit 41 selects a correction pattern based on the scene analysis information for each divided area, and performs correction processing based on the correction pattern selected for each divided area.

As described above, in the imaging apparatus 100 according to the present embodiment, the scene analysis unit 91 generates scene analysis information that is information for analyzing a captured scene based on image data (for example, through image data). Then, the correction unit 41 performs scene analysis generated by the scene analysis unit 91 on pixel data corresponding to a defective pixel included in the image sensor 12 out of pixel data included in the captured image data captured by the image sensor 12. Correction processing is performed according to the information. That is, the imaging unit 10 generates image data corresponding to the subject, and the scene analysis unit 91 generates information (scene analysis information) related to the scene of the subject from the image data. Then, the correction unit 41 corrects the image data based on the scene analysis information. The imaging unit 10 includes an imaging element 12 in which a plurality of pixels are arranged and outputs a signal corresponding to light, and the correction unit 41 is generated by a signal output from a defective pixel included in the imaging element 12. The captured image data is corrected.
This makes it possible to perform correction processing in consideration of the content of captured image data (for example, a captured scene), and thus the imaging apparatus 100 according to the present embodiment reduces the occurrence of correction traces due to overcorrection. be able to. For this reason, the imaging apparatus 100 according to the present embodiment can appropriately perform the defect pixel correction process. Therefore, the imaging apparatus 100 according to the present embodiment can reduce image quality deterioration (decrease) due to defective pixel correction processing.

In the present embodiment, the image data is divided into a plurality of areas. The scene analysis unit 91 generates scene analysis information for each divided area. The correction unit 41 corrects pixel data corresponding to the defective pixel for each divided area according to the scene analysis information generated for each divided area by the scene analysis unit 91. That is, the scene analysis unit 91 generates scene analysis information corresponding to the divided area, and the correction unit 41 corresponds to the defective pixel according to the scene analysis information generated corresponding to the divided area by the scene analysis unit 91. The pixel data to be corrected is corrected. That is, the scene analysis unit 91 generates scene analysis information for each of the plurality of regions of the image sensor 12, and the correction unit 41 determines the image of the image sensor 12 based on the scene analysis information generated for each region of the image sensor 12. The captured image data corresponding to the area is corrected.
As a result, correction processing can be performed by selecting different correction patterns according to scene analysis information for each divided area. Therefore, the imaging apparatus 100 according to the present embodiment appropriately performs defective pixel correction processing for each divided area. It can be carried out.

In the present embodiment, the correction unit 41 switches the correction process step by step (for example, two steps) according to the scene analysis information. For example, the correction unit 41 corrects captured image data by switching a plurality of correction patterns in stages according to the scene analysis information.
As a result, the correction processing is switched stepwise in accordance with the scene analysis information that affects whether or not the correction trace is conspicuous. Therefore, the imaging apparatus 100 according to the present embodiment corrects an appropriate defective pixel according to the scene analysis information. Processing can be performed.

Further, in the present embodiment, the correction unit 41 corrects pixel data by switching a plurality of (for example, two) correction patterns that perform correction processing corresponding to different correction levels according to the scene analysis information. That is, the correction unit 41 corrects captured image data (pixel data) by switching a plurality of (for example, two) correction patterns corresponding to different correction levels according to the scene analysis information.
Thereby, the correction unit 41 can perform correction processing by switching correction patterns having different correction levels according to the scene analysis information. Therefore, the imaging apparatus 100 according to the present embodiment can appropriately perform defective pixel correction processing.
In addition, since the correction process can be simplified according to the correction level, the imaging apparatus 100 according to the present embodiment can reduce unnecessary (excessive) correction process of defective pixels. That is, since the imaging apparatus 100 according to the present embodiment can efficiently perform the defective pixel correction process, the processing time for the defective pixel correction process can be reduced.

[Second Embodiment]
Next, the imaging device 100 according to the second embodiment will be described.
The configuration of the imaging apparatus 100 in the second embodiment is the same as the configuration in the first embodiment shown in FIG. The imaging apparatus 100 according to the second embodiment is different from the imaging apparatus 100 according to the first embodiment in the defective pixel correction processing by the correction unit 41.

The correction unit 41 according to the present embodiment corrects pixel data corresponding to a defective pixel in accordance with an imaging condition for capturing captured image data and scene analysis information. Here, the imaging conditions include environmental temperature, shutter speed, exposure amount, ISO sensitivity (imaging sensitivity), etc. In this embodiment, as an example, the shutter speed and ISO sensitivity (imaging sensitivity) are set as the imaging conditions. An example will be described. That is, in the present embodiment, the imaging condition includes imaging sensitivity or shutter speed.
The correction unit 41 switches the correction process step by step according to the imaging condition (shutter time or ISO sensitivity). That is, the correction unit 41 performs correction processing on pixel data corresponding to a defective pixel by switching a plurality of correction patterns for performing correction processing corresponding to different correction levels according to the imaging condition and scene analysis information.

For example, five correction patterns from correction pattern 1 to correction pattern 5 are predetermined as a plurality of correction patterns.
For example, the correction pattern 5 is a correction pattern in the case where defective pixels corresponding to the correction level “5” are easily noticeable, and it is necessary to correct defects due to more defective pixels, and a small amount of correction traces remain. Is a correction pattern when priority is given to correcting defective pixels. The correction pattern 5 is a correction pattern corresponding to an imaging condition in which defective pixels are easily noticeable.
On the other hand, the correction pattern 1 is a correction pattern when the defective pixel corresponding to the correction level “1” is not conspicuous, and the number of scratches due to the defective pixel is small, and correction is performed so as not to leave a correction mark as much as possible. This is a correction pattern. This correction pattern 1 is a correction pattern corresponding to an imaging condition in which defective pixels are not easily noticeable.
The correction pattern 2, the correction pattern 3, and the correction pattern 4 between the correction pattern 1 and the correction pattern 5 are the correction levels (“2”, “3”, “4”) between the correction pattern 1 and the correction pattern 5, respectively. ).

  The five correction patterns have different threshold values for determining whether or not to correct pixel data corresponding to defective pixels, for example, corresponding to the correction levels (“1” to “5”). That is, the correction pattern 5 has the lowest threshold for whether or not to perform correction processing, and can correct the largest number of defective pixels. Further, the correction pattern 1 has the highest threshold value for whether or not correction processing is performed, and can correct the smallest defective pixel. In the correction pattern 2 to the correction pattern 4, a threshold value indicating whether or not to perform correction processing is set between the correction pattern 1 and the correction pattern 5. The correction unit 41 executes, for example, the most simplified correction process and the correction process in which correction marks are likely to remain in the case of the correction pattern 5 in order to perform the correction process of defective pixels within a predetermined processing period. To do.

  Further, the five correction patterns are determined so that the sizes of the neighborhood areas of the defective pixels for calculating the correction values of the pixel data corresponding to the defective pixels are different corresponding to the correction levels (“1” to “5”). It may be. In the five correction patterns, the size of the neighborhood area of the defective pixel is set corresponding to the correction level, for example, any one of 3 pixels × 3 pixels, 5 pixels × 5 pixels, and 7 pixels × 7 pixels. . Here, in the calculation of the correction value by 3 pixels × 3 pixels, the number of defective pixels that can be corrected within a predetermined processing period is larger than 5 pixels × 5 pixels and 7 pixels × 7 pixels, but correction marks tend to remain. Processing becomes possible. In addition, the calculation of the correction value by 7 pixels × 7 pixels is a correction process in which the number of defective pixels that can be corrected within a predetermined processing period is smaller than 3 pixels × 3 pixels and 5 pixels × 5 pixels, but correction marks hardly remain. Is possible. In the present embodiment, for example, when the correction pattern is 5, the correction unit 41 performs a correction process for calculating a correction value of pixel data by 3 pixels × 3 pixels, and when the correction pattern is 1, A correction process for calculating a correction value of pixel data using 7 pixels is executed.

Next, the operation of the imaging apparatus 100 in this embodiment will be described.
In the imaging apparatus 100, when the subject to be imaged is imaged, the control unit 90 first periodically acquires the image via the imaging element 14 and the A / D conversion unit 15 and stores it in the buffer memory unit 30. The control unit 90 causes the buffer memory unit 30 to store the through image data on the display unit 50. By confirming the through image displayed on the display unit 50, the user confirms the subject to be imaged.

Next, when the control unit 90 receives an imaging instruction via the operation unit 80, the image data obtained via the imaging element 12 and the A / D conversion unit 13 is taken as captured image data. The data is stored in the buffer memory unit 30. The scene analysis unit 91 of the control unit 90 generates scene analysis information for each divided area based on the through image data stored in the buffer memory unit 30, and analyzes the captured scene information.
Next, the control unit 90 causes the correction unit 41 of the image processing unit 40 to perform defective pixel correction processing on the captured image data captured by the image sensor 12.

FIG. 5 is a flowchart showing the defective pixel correction processing in the present embodiment.
In this figure, first, the correction unit 41 of the image processing unit 40 acquires scene analysis information for each divided area from the scene analysis unit 91 via the bus 300 (step S201).
Next, the correction unit 41 acquires imaging sensitivity information (for example, ISO sensitivity information) when the captured image data is captured from the storage unit 60 (step S202).

  Next, the correction unit 41 acquires shutter time information (t) when the captured image data is captured from the storage unit 60 (step S203). Here, the shutter time information is exposure time or exposure time. The shutter time information (t) may include the charge accumulation time of the image sensor 12 from the reset of the pixel data in the image sensor 12 or the readout of the pixel data to the readout of the next pixel data.

  Next, the correction unit 41 acquires defective pixel information based on the acquired ISO sensitivity information and shutter time information (t) (step S204). That is, the correction unit 41 reads out and acquires the ISO sensitivity information as the imaging condition and the position information of the defective pixel associated with the shutter time information (t) from the defect storage unit 61 of the storage unit 60.

  Next, the correcting unit 41 determines whether or not the shutter time information (t), which is one of the acquired imaging conditions, is longer than a predetermined threshold time T2 (step S205). That is, the correction unit 41 determines whether or not the shutter time information (t) is a long time (t> T2). When it is determined that the shutter time information (t) is longer than the predetermined threshold time T2 (step S205: YES), the correction unit 41 advances the process to step S206. Further, when the correction unit 41 determines that the shutter time information (t) is equal to or shorter than the predetermined threshold time T2 (step S205: NO), the correction unit 41 proceeds with the process to step S209.

In step S <b> 206, the correction unit 41 determines whether the image is an image (area) in which correction marks are conspicuous for each divided area. That is, the correction unit 41 determines whether or not an image (area) in which correction marks are conspicuous for each divided area based on the scene analysis information for each divided area acquired from the scene analysis unit 91. Note that the correction unit 41 determines whether the correction mark is an image (area) where the correction mark is conspicuous based on the classification information of the scene analysis information as illustrated in FIG.
When it is determined that the correction mark is an image (area) where the correction mark is conspicuous (step S206: YES), the correction unit 41 advances the processing to step S208. If the correction unit 41 determines that the correction mark is not a conspicuous image (area) (step S206: NO), the process proceeds to step S207.

In step S207, the correction unit 41 selects the correction pattern 5 described above as the correction pattern for the correction process of the divided area, and advances the process to step S222.
In step S208, the correction unit 41 selects the correction pattern 4 described above as the correction pattern for correction processing of the divided area, and advances the processing to step S222.
In addition, the correction | amendment part 41 performs the process of step S207 and step S208 for every division area similarly to the process of step S206. That is, the correction unit 41 selects a correction pattern for each divided area in step S207 and step S208.

  Next, in step S209, the correction unit 41 determines whether or not the shutter time information (t) is shorter than a predetermined threshold time T1 and the ISO sensitivity is ISO 800 or more. That is, the correction unit 41 determines whether or not the shutter time information (t) is a short time (t <T1) and the ISO sensitivity exceeds the high sensitivity (ISO 800 or more). When it is determined that the shutter time information (t) is shorter than the predetermined threshold time T1 and the ISO sensitivity is ISO 800 or more (step S209: YES), the correction unit 41 advances the process to step S210. In addition, when the correction unit 41 determines that the shutter time information (t) is equal to or greater than the predetermined threshold time T1 or the ISO sensitivity is less than ISO800 (step S209: NO), the process proceeds to step S213.

  Next, in step S210, the correction unit 41 determines whether or not the image is an image (area) in which correction marks are conspicuous for each divided area. That is, the correction unit 41 determines whether or not an image (area) in which correction marks are conspicuous for each divided area based on the scene analysis information for each divided area acquired from the scene analysis unit 91. When it is determined that the correction mark is an image (area) where the correction mark is conspicuous (step S210: YES), the correction unit 41 advances the process to step S212. Further, when the correction unit 41 determines that the correction mark is not a conspicuous image (area) (step S210: NO), the process proceeds to step S211.

In step S211, the correction unit 41 selects the correction pattern 4 described above as the correction pattern for correction processing of the divided area, and advances the process to step S222.
In step S212, the correction unit 41 selects the correction pattern 3 described above as the correction pattern to be corrected for the divided area, and advances the process to step S222.
In addition, the correction | amendment part 41 performs the process of step S211 and step S212 for every division area similarly to the process of step S211. That is, the correction unit 41 selects a correction pattern for each divided area in step S211 and step S212.

Next, in step S213, the correction unit 41 determines whether one of the following two conditions is satisfied.
As the first condition, the correction unit 41 determines whether or not the shutter time information (t) is shorter than a predetermined threshold time T1 and the ISO sensitivity is ISO400. That is, as the first condition, the correction unit 41 determines whether the shutter time information (t) is a short time (t <T1) and the ISO sensitivity is high sensitivity (ISO 400). .
Further, as the second condition, the correction unit 41 determines whether or not the shutter time information (t) is longer than the predetermined threshold time T1 and shorter than the predetermined threshold time T2, and the ISO sensitivity is ISO200. . That is, as the second condition, the correction unit 41 determines whether or not the shutter time information (t) is an intermediate time (T1 <t <T2) and the ISO sensitivity is medium sensitivity (ISO200). judge.
When it is determined that the first condition or the second condition is satisfied (step S213: YES), the correction unit 41 proceeds with the process to step S214. Further, when it is determined that neither of the first condition and the second condition is satisfied (step S213: NO), the correction unit 41 advances the process to step S217.

  Next, in step S <b> 214, the correction unit 41 determines whether or not the image (area) in which correction marks are conspicuous for each divided area. That is, the correction unit 41 determines whether or not an image (area) in which correction marks are conspicuous for each divided area based on the scene analysis information for each divided area acquired from the scene analysis unit 91. When it is determined that the correction mark is an image (area) where the correction mark is conspicuous (step S214: YES), the correction unit 41 advances the processing to step S216. If the correction unit 41 determines that the correction mark is not a conspicuous image (area) (step S214: NO), the process proceeds to step S215.

In step S215, the correction unit 41 selects the correction pattern 3 described above as the correction pattern for the correction process for the divided area, and advances the process to step S222.
In step S216, the correction unit 41 selects the correction pattern 2 described above as the correction pattern to be corrected for the divided area, and advances the process to step S222.
In addition, the correction | amendment part 41 performs the process of step S215 and step S216 for every division area similarly to the process of step S214. That is, the correction unit 41 selects a correction pattern for each divided area in step S215 and step S216.

Next, in step S217, the correction unit 41 determines whether one of the following two conditions is satisfied.
The correction unit 41 determines whether the shutter time information (t) is shorter than a predetermined threshold time T1 and the ISO sensitivity is ISO 200 as a third condition. That is, the correction unit 41 determines, as the third condition, whether or not the shutter time information (t) is a short time (t <T1) and the ISO sensitivity is medium sensitivity (ISO 200). .
Further, as the fourth condition, the correction unit 41 determines whether or not the shutter time information (t) is longer than the predetermined threshold time T1 and shorter than the predetermined threshold time T2 and the ISO sensitivity is ISO100. . That is, the correction unit 41 determines whether the shutter time information (t) is an intermediate time (T1 <t <T2) and the ISO sensitivity is low sensitivity (ISO100) as a fourth condition. judge.
When it is determined that the third condition or the fourth condition is satisfied (step S217: YES), the correction unit 41 proceeds with the process to step S218. Moreover, the correction | amendment part 41 advances a process to step S221, when it determines with satisfy | filling neither conditions of this 3rd condition and 4th conditions (step S217: NO).

  Next, in step S218, the correction unit 41 determines whether or not the image is an image (area) in which correction marks are conspicuous for each divided area. That is, the correction unit 41 determines whether or not an image (area) in which correction marks are conspicuous for each divided area based on the scene analysis information for each divided area acquired from the scene analysis unit 91. When it is determined that the correction mark is an image (area) where the correction mark is conspicuous (step S218: YES), the correction unit 41 advances the processing to step S220. If the correction unit 41 determines that the correction mark is not a conspicuous image (area) (step S218: NO), the process proceeds to step S219.

In step S219, the correction unit 41 selects the correction pattern 2 described above as the correction pattern to be corrected for the divided area, and advances the process to step S222.
In step S220, the correction unit 41 selects the correction pattern 1 described above as the correction pattern to be corrected for the divided area, and advances the process to step S222.
In addition, the correction | amendment part 41 performs the process of step S219 and step S220 for every division area similarly to the process of step S218. That is, the correction unit 41 selects a correction pattern for each divided area in step S219 and step S220.
In step S221, the correction unit 41 selects the correction pattern 1 described above as the correction pattern for correction processing of the divided area, and advances the process to step S222.

  Next, the correction unit 41 calculates correction data (step S222). That is, the correction unit 41 reads out pixel data corresponding to the defective pixel of the captured image data stored in the buffer memory unit 30 based on the acquired position information of the defective pixel. The correction unit 41 calculates correction data of each pixel data corresponding to the read defective pixel based on a correction pattern (any one of the correction pattern 1 to the correction pattern 5) selected for each divided area.

  Next, the correction unit 41 writes the correction data calculation value in the captured image data as corrected pixel data (step S223). That is, the correction unit 41 replaces the calculated correction data corresponding to each defective pixel with the pixel data corresponding to each defective pixel of the captured image data, and stores it in the buffer memory unit 30. Thereby, the correction unit 41 completes the correction process of the defective pixel and ends the correction process.

As described above, in the imaging apparatus 100 according to the present embodiment, the correction unit 41 corrects the pixel data corresponding to the defective pixel according to the imaging conditions for capturing the image data and the scene analysis information. That is, the correction unit 41 corrects the pixel data according to the imaging conditions of the imaging unit 10 and the scene analysis information.
This makes it possible to perform correction processing in consideration of not only scene analysis information but also imaging conditions that affect the occurrence of defective pixels. Therefore, the imaging apparatus 100 according to the present embodiment can correct correction traces such as overcorrection. Generation can be reduced. For this reason, the imaging apparatus 100 according to the present embodiment can appropriately perform the defect pixel correction process. Therefore, the imaging apparatus 100 according to the present embodiment can reduce image quality deterioration (decrease) due to defective pixel correction processing.

In the present embodiment, the correction unit 41 switches the correction process step by step in accordance with the imaging conditions (for example, imaging sensitivity and shutter speed). That is, the correction unit 41 corrects the captured image data by switching a plurality of correction patterns in stages according to the imaging conditions and the information. Note that the imaging conditions include imaging sensitivity or shutter speed.
As a result, the correction process is switched in a stepwise manner in accordance with the imaging condition that affects the occurrence of the defective pixel. Therefore, the imaging apparatus 100 according to the present embodiment may perform an appropriate defective pixel correction process according to the imaging condition. it can.

In the present embodiment, the correction unit 41 switches pixel data corresponding to defective pixels by switching a plurality of correction patterns that perform correction processing corresponding to different correction levels according to the imaging conditions and scene analysis information. Is corrected. That is, the correction unit 41 corrects the captured image data (pixel data) by switching a plurality of correction patterns corresponding to different correction levels according to the imaging conditions and the scene analysis information.
Accordingly, the correction unit 41 can perform correction processing by switching correction patterns having different correction levels according to the imaging conditions and the scene analysis information. Therefore, the imaging apparatus 100 according to the present embodiment can appropriately perform defective pixel correction processing.

Further, in the present embodiment, the plurality of correction patterns are determined so that thresholds for determining whether or not to correct pixel data corresponding to defective pixels differ according to the correction level. That is, the plurality of correction patterns are determined so that the determination criteria for determining whether or not to correct pixel data corresponding to the defective pixel are different.
Accordingly, since the number of defective pixels can be changed according to the correction level, the imaging apparatus 100 according to the present embodiment can reduce unnecessary (excessive) correction processing of defective pixels. That is, since the imaging apparatus 100 according to the present embodiment can efficiently perform the defective pixel correction process, the processing time for the defective pixel correction process can be reduced.

Further, in the present embodiment, the plurality of correction patterns are determined so that the sizes of the neighboring areas of the defective pixels for calculating the correction values of the pixel data corresponding to the defective pixels differ according to the correction level.
Accordingly, the imaging apparatus 100 according to the present embodiment can perform correction processing by switching between correction processing in which correction marks are unlikely to remain and correction processing in which correction marks are likely to remain depending on the correction level. For this reason, the imaging apparatus 100 according to the present embodiment can reduce unnecessary (excessive) correction processing of defective pixels. That is, since the imaging apparatus 100 according to the present embodiment can efficiently perform the defective pixel correction process, the processing time for the defective pixel correction process can be reduced.

The present invention is not limited to the above embodiments, and can be modified without departing from the spirit of the present invention.
For example, in each of the above-described embodiments, the correction unit 41 has been described as selecting one of two correction patterns according to the scene analysis information. It is possible to select one of the correction patterns. In this case, the correction unit 41 may be configured to switch the correction process step by step according to the scene analysis information, as in the case of the imaging conditions.
As a result, the correction processing is switched stepwise in accordance with the conspicuousness of the correction trace of the captured image based on the scene analysis information. Therefore, the imaging apparatus 100 according to the present embodiment can appropriately detect the defective pixel corresponding to the scene analysis information. Correction processing can be performed.

Further, in each of the above-described embodiments, the mode in which the image processing unit 40 includes the correction unit 41 has been described. However, a mode in which the correction unit 41 is provided outside the image processing unit 40 may be used. For example, the control unit 90 may include the correction unit 41.
Further, in each of the above-described embodiments, the mode in which the control unit 90 includes the scene analysis unit 91 has been described. However, a mode in which the scene analysis unit 91 is provided outside the control unit 90 may be used. For example, the imaging unit 10 may include the scene analysis unit 91 and output the generated scene analysis information to the correction unit 41.

  Further, in each of the embodiments described above, the defect storage unit 61 has been described as having stored the position information of the defective pixel in association with the imaging condition. However, the defective pixel detected when the defective pixel is most likely to occur. The position information may be stored. In this case, the correction unit 41 detects the position information of the defective pixel corresponding to the imaging condition based on the predetermined threshold value corresponding to the imaging condition from the position information of the defective pixel read from the defect storage unit 61. May be performed.

In each of the above embodiments, a case where a digital single-lens reflex camera is used as an example of the imaging device 100 has been described. However, the imaging device 100 may be applied to imaging devices of other forms. For example, each of the above embodiments may be applied to a form in which the optical system 11 is attached to and integrated with the imaging apparatus 100. The imaging unit 10 may not include the imaging element 14, the A / D conversion unit 15, and the mirror 16, for example. In this case, the image sensor 12 and the A / D conversion unit 13 generate both the through image data and the captured image data, and the scene analysis unit 91 generates the through image generated by the image sensor 12 and the A / D conversion unit 13. Scene analysis information is generated based on the data.
In each of the above embodiments, the scene analysis unit 91 has been described as generating scene analysis information based on through image data. However, the scene analysis unit 91 may generate scene analysis information based on captured image data. .

  In the second embodiment, the correction unit 41 has been described using the imaging sensitivity and the shutter speed as the imaging condition for selecting the correction pattern. However, other imaging conditions may be used. For example, the correction unit 41 may use an environment temperature, an exposure amount, an aperture value, or the like as an imaging condition.

  In each of the above-described embodiments, the form in which the plurality of divided areas are areas obtained by equally dividing the image data has been described. However, a form in which the area of the divided area is variably divided may be employed. For example, when a plurality of types of imaging scene information (for example, two types of human face and background) are extracted in the equally divided area, the scene analysis unit 91 further determines the equally divided area. Subdivision may be performed to generate a plurality of divided areas according to the captured scene information. In this case, since the correction process can be performed by selecting different correction patterns according to the scene analysis information for the subdivided divided areas, the imaging apparatus 100 can detect defective pixels more appropriately than the case of equal division. Correction processing can be performed.

Further, in each of the above embodiments, the correction unit 41 has been described as selecting a correction pattern for each divided area according to the scene analysis information of the divided area. However, the scene analysis information of the divided area adjacent to the divided area is described. The correction pattern may be selected in consideration of the above. That is, the correction unit 41 may select a correction pattern for each divided area according to the scene analysis information of the divided area and the scene analysis information of the divided area adjacent to the divided area.
For example, in FIG. 4, the divided area R4 whose scene analysis information is the background is adjacent to the divided area R5 whose scene analysis information is the human face, and the divided area R1 whose scene analysis information is the background is the divided area R5. Not adjacent. In this case, the correction unit 41 corresponds to a correction pattern (for example, an intermediate correction level between a human face correction level and a background correction level) different from the divided area R1 which is the same background with respect to the divided area R4. Select (Correction pattern).
As described above, since the correction pattern is selected in consideration of the scene analysis information of the divided area adjacent to the divided area, the imaging apparatus 100 is more than the case of selecting the correction pattern according to the scene analysis information for each divided area. It is possible to appropriately correct a defective pixel.

In addition, each part with which the control part 90 or the image process part 40 in each said embodiment is provided may be implement | achieved by exclusive hardware, and each part with which the control part 90 or the image process part 40 is provided is It is composed of a memory and a CPU (central processing unit), and implements its functions by loading a program for realizing the functions of the respective units included in the control unit 90 or the image processing unit 40 and executing them. Also good.
Moreover, the above-described imaging apparatus 100 has a computer system inside. The processing process (processing procedure) of the control unit 90 or the image processing unit 40 described above is stored in a computer-readable recording medium in the form of a program, and the program is read out and executed by the computer. Processing may be performed.

  Further, a program for realizing the function of each unit included in the control unit 90 or the image processing unit 40 is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read into a computer system and executed. As a result, processing by each unit included in the control unit 90 or the image processing unit 40 may be performed. Here, the “computer system” includes an OS and hardware such as peripheral devices.

Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used.
The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. Furthermore, the “computer-readable recording medium” dynamically holds a program for a short time like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. In this case, a volatile memory in a computer system serving as a server or a client in that case, and a program that holds a program for a certain period of time are also included. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.

  DESCRIPTION OF SYMBOLS 10 ... Imaging part, 12 ... Imaging element, 41 ... Correction | amendment part, 62 ... Defect memory | storage part, 91 ... Scene analysis part, 100 ... Imaging device

Claims (12)

An imaging unit that generates image data according to the subject;
A scene information generation unit that generates information on the scene of the subject from the image data;
A correction unit that corrects the image data based on the information;
An imaging apparatus comprising: The imaging device according to claim 1,
The imaging unit includes an imaging element in which a plurality of pixels are arranged and outputs a signal corresponding to light,
The image correction apparatus, wherein the correction unit corrects image data generated by the signal output from a defective pixel included in the image sensor. The imaging device according to claim 2,
The scene information generation unit generates the information for each of a plurality of regions of the image sensor,
The image correction apparatus, wherein the correction unit corrects image data corresponding to the area based on the information generated for each area. In the imaging device according to claim 2 or 3,
The image capturing apparatus, wherein the correction unit corrects image data by switching a plurality of correction processing patterns in stages according to the information. In the imaging device according to any one of claims 2 and 3,
The image pickup apparatus, wherein the correction unit corrects pixel data by switching a plurality of correction processing patterns corresponding to different correction levels according to the information. In the imaging device according to any one of claims 1 to 5,
The said correction | amendment part correct | amends pixel data according to the imaging conditions and the said information of the said imaging part, The imaging device characterized by the above-mentioned. The imaging device according to claim 6,
The imaging apparatus, wherein the imaging condition includes imaging sensitivity or shutter speed. In the imaging device according to claim 6 or 7,
The image correction apparatus, wherein the correction unit corrects image data by switching a plurality of correction processing patterns in stages according to the image pickup condition and the information. In the imaging device according to any one of claims 6 to 8,
The imaging apparatus corrects pixel data by switching a plurality of correction processing patterns corresponding to different correction levels according to the imaging condition and the information. In the imaging device according to claim 4 or 5,
The plurality of correction processing patterns have different criteria for determining whether or not to correct pixel data corresponding to the defective pixel. In the imaging device according to claim 4 or 5,
2. The imaging apparatus according to claim 1, wherein the plurality of correction processing patterns have different sizes in the vicinity area of the defective pixel for calculating a correction value of pixel data corresponding to the defective pixel. On the computer,
An imaging procedure in which a plurality of pixels are arranged and an imaging unit having an imaging device that outputs a signal corresponding to light generates image data corresponding to a subject;
A scene information generation unit for generating information on the scene of the subject from the image data;
A correction unit executes a correction procedure for correcting the image data based on the information, and a correction procedure for correcting the image data generated from the signal output from the defective pixel included in the imaging element. Program to let you.

Images