JP2005151345A - Data processing apparatus, method thereof and imaging apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a data processing device capable of determining whether or not the image data is obtained based on image data generated by the same imaging device.
Reference image data REF generated by a digital camera 3 is subjected to interpolation processing by a computer 5 to generate reference image data REFa, which is registered in a collation device 6. Then, the collation device 6 detects a correlation between at least one element data of R, G, and B constituting the input determination image data OBJa and element data of G constituting the registered reference image data REFa. . Then, based on the detected correlation, it is determined whether or not the determination image data OBJa is obtained based on the image data S3 generated by the digital camera 3.
[Selection] Figure 1

Description

  The present invention relates to a data processing apparatus that determines whether or not image data is obtained based on image data generated by the same imaging apparatus, a method thereof, and an imaging apparatus.

For example, digital image data captured by a digital camera may be used illegally by a third party without obtaining permission from the copyright holder of the image data.
Image data captured by such a digital camera is, for example, transmitted to a server device or the like after being subjected to a display decoding process and then released.
In the display decoding process, for example, G element data is extracted from original image data generated by the camera, and interpolation processing is performed to generate all G element data at the pixel position of the camera. Then, for each of the R and B element data extracted from the image data, new element data is obtained based on the element data and the G element data generated by the interpolation process corresponding to the element data. The image data for publication is generated by performing interpolation processing based on the new element data.

  However, conventionally, when image data is generated by illegally falsifying another person's image data released through the display decoding process described above, there is a problem that the fraud cannot be specified.

The present invention has been made in view of the above-described problems of the prior art, and provides a data processing apparatus and method for determining whether or not the image data is obtained based on image data generated by the same imaging apparatus. Objective.
It is another object of the present invention to provide an imaging apparatus used for enabling the above-described determination to be performed with high reliability.

  In order to solve the above-described problems of the prior art and achieve the above-described object, the data processing apparatus according to the first aspect of the present invention provides R (red), G (green), B ( Correlation detection means for detecting a correlation between at least one element data of blue) and G element data constituting the second image data, and the first image based on the correlation detected by the correlation detection means A determination unit configured to determine whether the data and the second image data are obtained based on image data generated by the same imaging device;

The operation of the data processing apparatus of the first invention is as follows.
First, the correlation detecting means includes at least one element data of R (red), G (green), and B (blue) constituting the first image data and G element data constituting the second image data. Detect correlation.
Next, based on the correlation detected by the correlation detection unit, whether or not the determination unit has obtained the first image data and the second image data based on image data generated by the same imaging device. Determine whether or not.

  According to a second aspect of the present invention, there is provided a data processing method in which at least one element data of R (red), G (green), and B (blue) constituting the first image data and an element of G constituting the second image data. Image data generated by an imaging device in which the first image data and the second image data are the same based on the first step of detecting a correlation with data and the correlation detected in the first step And a second step of determining whether or not it has been obtained based on the above.

The operation of the data processing method of the second invention is as follows.
First, in the first step, at least one element data of R (red), G (green), and B (blue) constituting the first image data and element data of G constituting the second image data; To detect the correlation.
Next, in the second step, based on the image data generated by the same imaging device, the first image data and the second image data are based on the correlation detected in the first step. It is determined whether or not it has been obtained.

  An image pickup apparatus according to a third aspect of the present invention is an image pickup apparatus that generates digital image data according to an image pickup result, and is any one of R, G, and B at each of a plurality of pixel positions arranged in a matrix. Imaging means for generating first image data composed of R, G, B element data obtained by imaging two lights, and the first image data generated by the imaging means for the imaging device A first interface to be output to the outside, and G element data is extracted from the first image data generated by the imaging means and subjected to interpolation processing to obtain all G element data at the plurality of pixel positions. For each of the R and B element data generated and extracted from the image data, a new element is created based on the element data and the G element data generated by the interpolation process corresponding to the element data. data Generating and generating second image data by performing interpolation processing based on the new element data; and outputting the second image data generated by the processing means to the outside of the imaging device. 2 interfaces.

The operation of the image pickup apparatus of the third invention is as follows.
First, the imaging means is composed of element data of R, G, B obtained by imaging any one light of R, G, B at each of a plurality of pixel positions arranged in a matrix. First image data is generated.
Then, the first interface outputs the first image data generated by the imaging unit to the outside of the imaging device.
Further, the processing means extracts G element data from the first image data generated by the imaging means and performs an interpolation process to generate all G element data at the plurality of pixel positions. For each of the R and B element data extracted from the data, new element data is generated based on the element data and the G element data generated by the interpolation process corresponding to the element data, Interpolation processing is performed based on the new element data to generate second image data.
Then, the second interface outputs the second image data generated by the processing means to the outside of the imaging device.

According to the first and second aspects of the present invention, it is possible to provide a data processing apparatus and method that can determine whether or not the image data is obtained based on image data generated by the same imaging apparatus.
In addition, according to the second invention, it is possible to provide an imaging apparatus that is used to enable the above-described determination to be performed with high reliability.

First Embodiment Hereinafter, a first embodiment of the present invention will be described with reference to FIGS.
This embodiment corresponds to the first and second inventions.
First, the correspondence between the components of the present invention and the components of the present embodiment will be described.
A collation device 6 shown in FIG. 1 and the like corresponds to the data processing device of the first invention.
The correlation detection unit 42 shown in FIG. 7 corresponds to the correlation detection unit of the first invention, and the determination unit 43 corresponds to the determination unit of the first invention.
Further, the determination image data OBJa (OBJ) shown in FIG. 1 and the like correspond to the first image data of the first and second inventions, and the reference image data REFa is the second image of the first and second inventions. It corresponds to the data and the reference image data of the first invention.

The outline of the first embodiment of the present invention will be described below.
The reference image data REF generated by the digital camera 3 is subjected to interpolation processing by the computer 5 to generate reference image data REFa, which is registered in the collation device 6.
Then, the correlation detection unit 42 shown in FIG. 7 includes at least one element data of R (red), G (green), and B (blue) constituting the input determination image data OBJa, and the registered reference image data. Correlation with element data of G constituting REFa is detected.
At this time, the correlation detection unit 42 is generated by the digital camera 3 or the like that makes the reflected light from the subject incident on the light receiving element having a variation unique to the light receiving sensitivity, and the determination image data OBJa and the reference image data REFa A process for reflecting the variation in the light receiving sensitivity generated in the element data corresponding to the light receiving result of the light receiving element constituting the image data in the correlation is performed.
Then, the determination unit 43 determines whether the determination image data OBJa is obtained based on the image data S3 generated by the digital camera 3 based on the correlation detected by the correlation detection unit 42.

Hereinafter, the data processing system 1 of the first embodiment will be described in detail.
FIG. 1 is a configuration diagram of a data processing system 1 according to the present embodiment.
As shown in FIG. 1, the data processing system 1 includes, for example, a digital camera 3, a computer 4, a computer 5, and a collation device 6.
[Digital camera 3]
As shown in FIG. 1, the digital camera 3 includes a lens 10, a light receiving unit 11, an A / D conversion unit 12, and an encoder 13.
The lens 10 receives light from the subject and outputs it to the light receiving unit 11.
The light receiving unit 11 has a plurality of light receiving elements arranged in a matrix.
Light from the subject input through the lens 10 enters the light receiving element.
Then, the light receiving unit 11 outputs an image signal corresponding to the light reception results of the plurality of light receiving elements to the A / D conversion unit 12.
The A / D conversion unit 12 A / D converts the image signal input from the light receiving unit 11 to generate digital image data, and outputs the digital image data to the encoder 13.
The encoder 13 encrypts the reference image data input from the A / D conversion unit 12 to generate reference image data REF, and writes this into the recording medium 21.
Similarly, the encoder 13 encrypts the public image data input from the A / D converter 12 to generate image data S3, and writes this into the recording medium 20.

As shown in FIG. 2, the light receiving unit 11 includes a color filter 25 in which R, G, and B filters are arranged at positions (pixel positions) corresponding to the respective light receiving elements arranged in a matrix.
As a result, only the R component of the light from the subject passes through the color filter 25 and enters the light receiving element at the “R” position of the color filter 25 shown in FIG. Only the G component of the light from the subject passes through the color filter 25 and enters the light receiving element, and only the B component of the light from the subject enters the color filter 25 at the light receiving element at the position “B”. Through and incident.
Thereby, the light receiving unit 11 receives an image signal composed of R, G, and B pixel signals obtained by imaging any one of R, G, and B light at each of the plurality of pixel positions. Generate.

The light receiving element of the light receiving unit 11 is, for example, a CCD (Charge Coupled Device) image pickup element, and the light receiving sensitivity has an inherent variation in manufacturing. This variation is difficult to reproduce artificially.
FIG. 3 is a diagram schematically showing a cross section of the light receiving element of the light receiving unit 11 shown in FIG.
As shown in FIG. 3, the light receiving element of the light receiving unit 11 includes a silicon substrate 32, a light shielding layer 34 provided with an opening 33, and a condenser lens 35.
A photoelectric conversion region is formed in the silicon substrate 32 at a position facing the opening 33. The condensing lens 35 is formed so as to reach the silicon substrate 32 via the light shielding layer 34 from a position opposite to the silicon substrate 32 with respect to the light shielding layer 34.

The opening 33 is formed by, for example, finely processing a resist serving as an etching mask by exposure to ultraviolet rays, and then removing the light shielding layer 34 and the insulating layer 36 therebelow by etching.
The condenser lens 35 is formed in a spherical shape by subjecting the glass layer to fine processing by photolithography and then melting the glass layer at a high temperature.
In the manufacturing process of the light receiving element described above, the opening 33 is controlled so as to form a uniform shape as much as possible, but the shape varies due to various factors. For this reason, the shape of the opening 33 of each of the plurality of light receiving elements varies.
Here, due to the variation in the shape of the opening 33 of each light receiving element, the shape of light (light flux) incident on the light receiving element varies, and the amount of light incident on the photoelectric conversion region of the silicon substrate 32 varies. Accordingly, the light receiving sensitivity varies among the light receiving elements.
Such variation in light receiving sensitivity is not artificial, and is unique to each light receiving element such as a fingerprint. In addition, the influence of the variation in the light receiving sensitivity of the light receiving element occurs in the image data generated by the digital camera 3 using the light receiving element.
In the present embodiment, as described above, collation is performed using the manufacturing variation in the light receiving sensitivity of the light receiving element that occurs in the image data generated by the camera.
The collation device 6 determines whether the image data for determination OBJ is generated using the image data generated by the digital camera 3 based on the reference image data REF of the digital camera 3 registered in advance.

[Computer 4]
As shown in FIG. 4, the computer 4 extracts element data R, G, and B from the image data S3 read from the recording medium 20, and generates image data IM_R, IM_G, and IM_B (not shown), respectively. To do.
Then, the computer 4 interpolates the image data IM_G to generate image data IM1_G composed of element data at all pixel positions.
At this time, for example, as shown in FIG. 5A, the computer 4 calculates the average (= (G1 + G2 + G3 + G4) / 4) of the element data G1, G2, G3, G4 around the element data Gx as the element data Gx. Interpolation processing for interpolation data is performed.

The computer 4 divides the R element data in the image data IM_R by the G element data in the image data IM1_G corresponding to the R element data to generate image data IM1_R.
For example, the computer 4 interpolates the image data IM1_R to generate image data IM2_R including element data Hr at all pixel positions.
At this time, as shown in FIG. 5B, the computer 4 uses the element data R1, R2, R3, and R4 to perform interpolation processing for generating the surrounding element data Rx1, Rx2, and Rx3.
That is, element data Rx1 is generated by (R1 + R2) / 2, element data Rx2 is generated by (R1 + R3) / 2, and element data Rx3 is generated by (R1 + R2 + R3 + R4) / 4.

The computer 4 calculates (Hr * G) on the element data Hr, G at the corresponding pixel positions of the image data IM1_G and IM2_R to generate the image data IM3_R.
Further, the computer 4 also performs the same processing as the above-described R image data IM_R on the B image data IM_B to generate image data IM3_B.
Then, the computer 4 transmits the image data S4 composed of the image data IM1_G, IM3_R, and IM3_B to, for example, a server device on the network and discloses it.

[Computer 5]
The computer 5 interpolates element data in the reference image data REF read from the recording medium 20 or the input image data for determination OBJ for each element data of R, G, B, and performs R, R for all pixel positions. Generate element data for all G and B.
Specifically, as shown in FIG. 6, the computer 5 extracts G element data from the reference image data REF or the determination image data OBJ to generate image data IM10_G, and extracts R element data. The image data IM10_R is generated, the B element data is extracted, and the image data IM10_B is generated.
Then, for example, the computer 5 performs the interpolation processing described in FIG. 5A on the image data IM10_G to generate the image data IM11_G.
In addition, for example, the computer 5 performs the interpolation processing described in FIG. 5B on the image data IM10_R to generate the image data IM11_R.
In addition, the computer 5 performs similar interpolation processing on the image data IM10_B to generate image data IM11_B.
The computer 5 outputs the reference image data REFa composed of the image data IM11_G, IM11_R, and IM11_B or the determination image data OBJa to the collation device 6, respectively.

[Verification device 6]
FIG. 7 is a configuration diagram of the collation device 6 shown in FIG.
As illustrated in FIG. 7, the collation device 6 includes, for example, an interface 41, a correlation detection unit 42, and a determination unit 43.
The interface 41 inputs the above-described reference image data REFa and determination image data OBJa from the computer 5.
The correlation detection unit 42 includes G, which constitutes the judgment image data OBJa input via the interface 41 for each of IM11_G, IM11_R, and IM11_B shown in FIG. 6 constituting the reference image data REFa input via the interface 41. A correlation with each of the R and B image data is detected.
The correlation detection unit 42 receives the light received by the light receiving element of the light receiving unit 11 constituting the image data from the image data generated by the digital camera 3 in which the reflected light from the subject is incident on the light receiving element having a variation unique to the light receiving sensitivity. A process for reflecting the variation in the light receiving sensitivity generated in the element data corresponding to the result in the correlation is performed.

The determination unit 43 determines whether or not the determination-target image data OBJ has been generated using the image data generated by the digital camera 3 based on the correlation detected by the correlation detection unit 42.
FIG. 8 is a diagram for explaining the determination process of the determination unit 43.
Step ST1:
As shown in FIG. 9, the determination unit 43 determines the correlation between the G image data IM11_G of the reference image data REFa shown in FIG. 6 and each of the R, G, B image data constituting the determination image data OBJa. Based on the result, it is determined whether or not all these correlations are equal to or higher than a predetermined first level. If it is determined that the correlation is higher than a predetermined level, the process proceeds to step ST2, and if not, the process proceeds to step ST3. .

Step ST2:
The determination unit 43 determines that the determination image data OBJa has been generated based on the image data S4 captured by the digital camera 3 and released through the processing of the computer 4.
For example, as shown in FIG. 10, when the image data S4 generated and released by the computer 4 is directly input to the collation device 6 as the image data OBJa, the image data S4 is displayed as shown in FIG. Since the data IM3_R and IM3_B are generated based on the image data IM1_G, the correlation between the image data IM3_R and IM3_B and the G image data IM11_G of the reference image data REFa shown in FIG. 6 is high.
Note that, even if the image data S4 and the reference image data REFa are generated by imaging different imaging targets by the digital camera 3, the manufacturing variation that occurs in the manufacturing sensitivity of the light receiving element of the light receiving unit 11 described above. Due to the uniqueness, the correlation shown in FIG. 9 is obtained.

As shown in FIG. 11, for example, when a large number of image data S4 obtained based on the image data S3 captured by the digital camera 3 is disclosed, the image data S4 is subjected to an averaging process AVR. Image data S52 is generated. Thereby, a part of the image pattern information disappears in the image data S52.
Then, the image data S53 is generated by multiplying the image data S3b and the image data S52 obtained based on the imaging result of the digital camera 3b in element data units.
In this case, when the image data S53 is input to the computer 5 as the image data OBJ shown in FIG. 1, the correlation shown in FIG. 9 is obtained.
Thereby, the collation apparatus 6 can determine that the image data S53 is not the original raw (RAW) data but the raw data forged based on the image data generated by the digital camera 3.
In the present embodiment, the raw data is image data that is generated by a digital camera and has not undergone interpolation processing by the computer 4.

As shown in FIG. 12, for example, when image data S4 obtained based on image data S3 captured by the digital camera 3 is disclosed, the color filter shown in FIG. 2 of the digital camera 3 from the image data S4. The R, G, and B element data corresponding to the 25 R, G, and B arrangements are extracted and rearranged to generate image data S58 forgery of the raw data of the other digital camera.
Then, the forged image data S58 is input as the raw data of the other digital camera to the computer 5 to generate the image data S58a. When the image data S58a is input to the verification device 6, the digital camera 3 is referred to. When the correlation is detected by the collation device 6 based on the image data REFa, the same result as FIG. 9 is obtained as shown in FIG.
When the correlation is detected by the collating device 6 based on the reference image data REFb of the other digital camera for the image data S58a, the result shown in FIG. 13B is obtained.
Thereby, the collation apparatus 6 can determine that the image data S58 is not the raw data of the other digital camera but the raw data forged based on the image data generated by the digital camera 3.

Further, as shown in FIG. 14, for example, when image data S4 obtained based on image data S3 captured by the digital camera 3 is disclosed, the color filter shown in FIG. R, G, B element data corresponding to 25 R, G, B arrays are extracted and rearranged to generate image data S58.
Then, the image data S3b, which is raw data obtained based on the imaging result of the digital camera 3b, and the image data S58 are subjected to multiplication processing MUL in element data units to generate forged image data S59.
When the forged image data S59 is input to the collation device 6 as false data from the digital camera 3b, the correlation device 6 detects the correlation based on the reference image data REFa of the digital camera 3b. As shown in FIG. 15A, the same result as in FIG. 9 is obtained.
When the correlation is detected by the collation device 6 based on the image data S59 based on the reference image data REFb of the digital camera 3b, the result shown in FIG. 15B is obtained.
Thereby, the collation apparatus 6 can determine that the image data S58 is not the raw data of the digital camera 3 but the raw data forged based on the image data generated by the digital camera 3b.

Step ST3:
16, the determination unit 43 correlates the reference image data REFa with the R image data IM11_R shown in FIG. 6 and the R image data constituting the determination image data OBJa, and the G image shown in FIG. The correlation between the data IM11_G and the G image data constituting the determination image data OBJa, and the correlation between the G image data IM11_B and the B image data constituting the determination image data OBJa shown in FIG. If it exceeds, the process proceeds to step ST4, and if not, the process proceeds to step ST5.

Step ST4:
The determination unit 43 determines that the reference image data REFa and the determination image data OBJa are raw data captured by the same digital camera 3.
That is, when the reference image data REFa and the determination image data OBJa are raw data picked up by the same digital camera 3, the processing by the computer 4 has not been performed, and thus the light reception sensitivity variation pattern of the light receiving unit 11 is caused. Then, the G image data IM11_G shown in FIG. 6 of the reference image data REFa has a correlation of the first level or more only with the G image data IM11_G of the determination image data OBJa, and the diagram of the reference image data REFa. The R image data IM11_R shown in FIG. 6 has a first level or higher correlation only with the R image data IM11_R of the determination image data OBJa. The B image data IM11_B of the reference image data REFa shown in FIG. Only between the image data for determination OBJa and the B image data IM11_B of the image data OBJa is equal to or higher than the first level. Results in the relationship. Thereby, the correlation shown in FIG. 16 is obtained.

Step ST5:
The determination unit 43 determines that the reference image data REFa and the determination image data OBJa are raw data captured by different digital cameras 3 and 3b as shown in FIG. 17 or image data obtained by processing the image data.
This is the case, for example, when the correlation result in the correlation detection unit 42 is as shown in FIG.

Hereinafter, the configuration of the correlation detection unit 42 shown in FIG. 7 adopting the SPOMF (Symmetrical Phase Only Matched Filtering) method will be described.
SPOMF is described in the literature “Symmetric Phase-Only Matched Filtering of Fourier-Mellin Transforms for Image Registration and Recognition” IEEE Transaction on Pattern analysis and Machine Intelligence, VOL.16 No.12 December 1994, and the like.
FIG. 19 is a functional block diagram of the correlation detector 42 shown in FIG.
As shown in FIG. 19, the correlation detection unit 42 includes, for example, an FFT circuit (Fast Fourier Transforms) 121, a whitening circuit 122, an FFT circuit 123, a whitening circuit 124, a complex conjugate circuit 125, a multiplication circuit 126, and an IFFT circuit 127. Have.
The FFT circuit 121 and the FFT circuit 123 correspond to the conversion means of the present invention, the whitening circuit 122 and the whitening circuit 124 correspond to the division means of the present invention, and the complex conjugation circuit 125 corresponds to the replacement means of the present invention. The circuit 126 corresponds to the multiplication circuit of the present invention, and the IFFT circuit 127 corresponds to the inverse conversion circuit of the present invention.

The FFT circuit 121 performs, for example, Fourier transform on the reference image data REFa from the digital camera 3 to generate second frequency component data S121, and outputs this to the whitening circuit 122.
The whitening circuit 122 divides each complex number data constituting the second frequency component data S121 by the absolute value of each complex number data (that is, equalizes the absolute value of each element data), and the second complex number data S122. Is output to the multiplication circuit 126.

  For example, the FFT circuit 123 performs Fourier transform on the input determination image data OBJa (OBJ) to generate first frequency component data S123, and the whitening circuit 124 configures the first frequency component data S123. Each complex number data is divided by the absolute value of each complex number data to generate first complex number data S124, which is output to the complex conjugate circuit 125.

The complex conjugate circuit 125 generates third complex number data S125 in which each complex number data constituting the first complex number data S124 is replaced with complex conjugate complex number data, and outputs the third complex number data S125 to the multiplication circuit 126.
The multiplication circuit 126 multiplies the second complex number data S122 and the third complex number data S125 to generate fourth complex number data S126, and outputs this to the IFFT circuit 127.
The IFFT circuit 127 performs inverse Fourier transform on the fourth complex number data S126 to generate correlation data S42, which is output to the determination unit 43 shown in FIG.

Hereinafter, a method for determining a value used as the above-described criterion for determining the correlation level by the determination unit 43 illustrated in FIG. 7 will be described.
The correlation detection unit 42 sets all values of correlation values S42 by cyclically shifting the relative position between the reference image data REFa and the determination image data OBJa (OBJ) in two dimensions.
Here, since the reference image data REFa and the determination image data OBJa (OBJ) are uncorrelated with respect to the design, values other than the origin of the correlation data S42 indicate an accidental correlation value between uncorrelated data. Yes.
The determination unit 43 obtains the standard deviation σ of the correlation data S42 and makes the above determination based on whether or not the origin value C00 of the correlation data S42 exceeds a predetermined number of times the standard deviation.
The reason why the value C00 is used is that when the correlation is made between the entire images, the unique pattern of the image sensor matches the origin, so that a peak appears in the output C00 of the correlator in that case. .

Each element data in the correlation data S42 is Cij, and the number of element data is n.
The determination unit 43 generates an average value mean of the values indicated by all the element data in the correlation data S42 based on the following formula (1).

(Equation 1)
cmean = (Σcij) / n (1)

  Moreover, the determination part 43 produces | generates standard deviation (sigma) based on following formula (2) using the said average value mean.

(Equation 2)
σ = √ {{Σ (cij-cmean) × (cij-cmean)} / n}
... (2)

  Based on the following formula (3), the determination unit 43 determines that the correlation level is the first level described above when the value indicated by the origin element data c00 in the correlation data S42 exceeds 10 times the standard deviation σ. It is determined that the level exceeds (high correlation).

(Equation 3)
c00> 10 × σ (3)

Hereinafter, the overall operation of the data processing system 1 shown in FIG. 1 will be described.
FIG. 20 is a flowchart for explaining the operation.
Step ST11:
The reference image data REF generated by the digital camera 3 is subjected to interpolation processing by the computer 5 to generate reference image data REFa, which is registered in the collation device 6.
Step ST12:
The image data for determination OBJ is interpolated by the computer 5 as necessary to generate image data for determination OBJa, which is input to the collation device 6.
Step ST13:
The correlation detection unit 42 of the collation device 6 shown in FIG. 7 registers at least one element data of R (red), G (green), and B (blue) that constitutes the input determination image data OBJa in step ST11. The correlation with the G element data constituting the reference image data REFa is detected.
Step ST14:
7 is obtained based on the image data S3 generated by the digital camera 3 based on the correlation detected by the correlation detection unit 42 in step ST13. It is determined whether or not.

As described above, according to the data processing system 1, the collation device 6 performs the correlation detection by the correlation detection unit 42 and the determination by the determination unit 43 as described using steps ST1 and ST2 shown in FIG. Thus, it can be determined whether the determination image data OBJa (OBJ) is the public image data S4 of the digital camera 3 or image data generated based on the public image data S4.
Further, according to the data processing system 1, the collation device 6 performs the correlation detection by the correlation detection unit 42 and the determination by the determination unit 43 as described using steps ST3, ST4, and ST5 shown in FIG. It can be determined whether the determination image data OBJa (OBJ) is the image data S3 (raw data) of the digital camera 3 or not.

This makes it possible to appropriately determine whether the determination image data OBJa (OBJ) is obtained by illegally using image data obtained by another person's digital camera. At this time, it becomes possible to identify the other person's digital camera, which was not possible with the conventional method of adding digital signature information or digital watermark information based on a hash value to image data.
Further, it is possible to appropriately avoid registering forged data obtained by illegally tampering with image data of another person as reference image data REF.

  Further, according to the data processing system 1, since the digital watermark information is not added to the image data, it is possible to prevent the image data from being deteriorated.

Second Embodiment The second embodiment is an embodiment corresponding to the third invention.
FIG. 21 is a configuration diagram of the digital camera 203 according to the embodiment of the present invention.
As illustrated in FIG. 21, the digital camera 203 includes a lens 10, a light receiving unit 11, an A / D conversion unit 12, an encoder 13, an interface 211, an interpolation processing unit 212, and an interface 213.
Here, the lens 10 and the light receiving unit 11 correspond to the imaging unit of the present invention, the interpolation processing unit 212 corresponds to the processing unit of the present invention, the interface 211 corresponds to the first interface of the present invention, and the interface 213 This corresponds to the second interface of the present invention.

In FIG. 21, the light receiving unit 11, the A / D conversion unit 12, and the encoder 13 denoted by the same reference numerals as those in FIG. 1 are the same as those described in the first embodiment.
The interface 211 outputs the encrypted reference image data REF generated by the encoder 13 to the outside of the digital camera 203 as it is.
For example, the interface 211 is connected to the computer 5 shown in FIG. 1 and outputs the reference image data REF to the computer 5.
The interpolation processing unit 212 performs the interpolation processing described as the processing of the computer 4 in the first embodiment on the image data S3 input from the encoder 13 to generate image data S4.
The interface 213 outputs the image data S4 generated by the interpolation processing unit 212 to the outside of the digital camera 203.
For example, the interface 213 outputs the image data S4 to a predetermined computer, transmits the image data S4 to the server device, and publishes it.
The digital camera 203 encrypts at least one of the process of encrypting the image data S4 before output to the outside of the digital camera 203 and the process of encrypting the reference image data REF before output to the outside of the digital camera 203. An encryption circuit may be provided.

According to the digital camera 203, reference image data REF that is raw data can be output to the outside of the digital camera 203 via the interface 211 and registered in the computer 5.
Further, according to the digital camera 203, image data S 4 that can be disclosed can be generated by performing interpolation processing on the image data S 3 that is raw data, and can be output to the outside of the digital camera 203 via the interface 213. Thereby, the image data S4 can be disclosed.
Here, the usage pattern of the reference image data REF and the image data S4 is the same as that of the first embodiment, for example.
As described above, the digital camera 203 can be used for performing the same determination process as in the first embodiment, and performs a highly reliable determination by the action of the data processing system 1 of the first embodiment. Enable.

The present invention is not limited to the embodiment described above.
In the present embodiment, the case where the determination unit 43 proceeds to step ST2 when the determination unit 43 detects the correlation pattern shown in FIG. 9 in step ST1 shown in FIG. 8 is illustrated, but the correlation detection unit 42 shown in FIG. The correlation between at least one element data of R (red), G (green), and B (blue) constituting the determination image data OBJa and the element data of G constituting the reference image data REFa is detected, and the correlation is detected. If is equal to or higher than the first level, the process may proceed to step ST12.

  The present invention can be applied to a data processing system that determines whether or not image data is obtained based on image data generated by the same imaging apparatus.

FIG. 1 is a configuration diagram of a data processing system according to an embodiment of this invention. FIG. 2 is a diagram for explaining a color filter used in the light receiving unit shown in FIG. FIG. 3 is a diagram schematically illustrating a cross section of a light receiving element included in the camera. FIG. 4 is a diagram for explaining interpolation processing in the computer 4 shown in FIG. FIG. 5 is a diagram for explaining the interpolation processing shown in FIG. FIG. 6 is a diagram for explaining interpolation processing in the computer 5 shown in FIG. FIG. 7 is a functional block diagram of the collation apparatus shown in FIG. FIG. 8 is a flowchart for explaining an operation example of the collation device shown in FIG. FIG. 9 is a diagram for explaining a correlation pattern when determination image data is obtained based on public image data of a predetermined digital camera. FIG. 10 is a diagram for explaining a case where the published image data is used as it is as the determination image data. FIG. 11 is a diagram for explaining a case where image data obtained by performing predetermined processing on published image data is used as determination image data. FIG. 12 is a diagram for explaining a case where image data obtained by performing other predetermined processing on the published image data is used as determination image data. FIG. 13 is a diagram for explaining the correlation pattern in the case shown in FIG. FIG. 14 is a diagram for explaining a case where image data obtained by performing other predetermined processing on the published image data is used as determination image data. FIG. 15 is a diagram for explaining the correlation pattern in the case shown in FIG. FIG. 16 is a diagram for explaining a correlation pattern when the determination image data is raw data of a predetermined digital camera. FIG. 17 is a diagram for explaining a case where correlation is detected based on image data of two different digital cameras. FIG. 18 is a diagram for explaining the correlation pattern in the case shown in FIG. FIG. 19 is a block diagram of the correlation detection unit shown in FIG. FIG. 20 is a flowchart for explaining the overall operation of the data processing system shown in FIG. FIG. 21 is a block diagram of a digital camera according to the second embodiment of the present invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Data processing system, 3 ... Digital camera, 4 ... Computer, 5 ... Computer, 6 ... Collation apparatus, 25 ... Color filter, 31 ... Light receiving element, 32 ... Silicon substrate, 33 ... Opening part, 34 ... Light shielding layer, 35 DESCRIPTION OF SYMBOLS ... Condensing lens, 41 ... Interface, 42 ... Correlation detection part, 43 ... Determination part, 121 ... FFT circuit, 122 ... Whitening circuit, 123 ... FFT circuit, 124 ... Whitening circuit, 125 ... Complex conjugate circuit, 126 ... Multiplication Circuit, 127 ... IFFT circuit

Claims (12)

Correlation detecting means for detecting a correlation between at least one element data of R (red), G (green) and B (blue) constituting the first image data and element data of G constituting the second image data When,
Determination means for determining whether or not the first image data and the second image data are obtained based on image data generated by the same imaging device based on the correlation detected by the correlation detection means And a data processing apparatus. The correlation detecting unit corresponds to image data generated by an imaging device that makes reflected light from a subject incident on a light receiving element having a variation inherent in light receiving sensitivity, in accordance with a light reception result of the light receiving element constituting the image data. The data processing apparatus according to claim 1, wherein a process of reflecting a variation in the light receiving sensitivity generated in the element data in the correlation is performed. The correlation detection means detects the correlation between each of the R, G, B element data constituting the first image data and the G element data constituting the second image data,
The determination means is based on image data generated by the same imaging device in which the first image data and the second image data are the same when all of the correlations detected by the correlation detection means are equal to or higher than a predetermined level. The data processing device according to claim 1, wherein the data processing device is determined to be obtained. The correlation detection unit is configured to detect, for each of the R, G, and B element data constituting the first image data, each of the element data and the R, G, and B element data constituting the second image data. Detect a total of 9 correlations with
The determination means constitutes the second image data with each of the R, G, B element data constituting the first image data out of the total of nine correlations detected by the correlation detection means. When the correlation other than the correlation with the element data of G is less than the predetermined level, the first image data and the second image data are obtained based on the image data generated by the same imaging device. The data processing device according to claim 3, wherein the data processing device is determined to have been. The correlation detection means is obtained by imaging any one light of R, G, and B at each of a plurality of pixel positions that are imaged by the imaging device and arranged in a matrix in the imaging device. Reference image data composed of all R, G, B element data at the plurality of pixel positions generated by interpolating R, G, B element data for each R, G, B element data. , Detecting the correlation using as the first image data,
The determination means extracts the element data of G from the image data generated by the imaging device when the correlation detected by the correlation detection means is higher than a predetermined level. Interpolation processing is performed to generate all G element data at the plurality of pixel positions, and for each of the R and B element data extracted from the image data, the element data and the element data correspond to the element data. Image data obtained based on image data generated by generating new element data based on the G element data generated by the interpolation process, and performing interpolation process based on the new element data. The data processing device according to claim 4, wherein the data processing device is determined to be present. The correlation detecting means has a first correlation between R element data constituting the first image data and R element data constituting the second image data, and G constituting the first image data. Second element data and G element data constituting the second image data, B element data constituting the first image data and B element constituting the second image data Detecting a third correlation with the data,
The determination means determines that the first image data is the second image when all of the first correlation, the second correlation, and the third correlation detected by the correlation detection means are equal to or higher than a predetermined level. R obtained by imaging any one light of R, G, and B at each of a plurality of pixel positions arranged in a matrix in the imaging device. The data processing apparatus according to claim 1, wherein the data processing apparatus determines that the raw data is composed of element data of G, B, and B. The correlation detection means includes
Transform means for orthogonally transforming the first image data and the second image data to generate first frequency component data and second frequency component data, respectively;
Each complex number data constituting the first frequency component data is divided by the absolute value of each complex number data to generate first complex number data, and each complex number data constituting the second frequency component data is converted to each complex number data constituting the second frequency component data. Dividing means for generating the second complex data by dividing by the absolute value of each complex data;
Replacement means for generating third complex number data by replacing each complex number data constituting one of the first complex number data and the second complex number data with complex conjugate complex data;
Multiplying the first complex number data or the second complex number data that has not been replaced by the replacing unit and the third complex number data generated by the replacing unit to generate fourth complex number data Multiplying means to
The data processing apparatus according to claim 1, further comprising: an inverse transform circuit that performs inverse orthogonal transform on the fourth complex data generated by the multiplication unit to generate the correlation. First detecting the correlation between at least one element data of R (red), G (green) and B (blue) constituting the first image data and element data of G constituting the second image data Process,
A first determination is made based on the correlation detected in the first step to determine whether the first image data and the second image data are obtained based on image data generated by the same imaging device. A data processing method comprising two steps. The first step detects the correlation between each of the R, G, B element data constituting the first image data and the G element data constituting the second image data,
In the second step, an image generated by the same imaging device with the first image data and the second image data when all of the correlations detected in the first step are equal to or higher than a predetermined level. The data processing method according to claim 8, wherein it is determined that the data is obtained based on data. An imaging device that generates digital image data according to an imaging result,
First image data composed of element data of R, G, and B obtained by imaging any one light of R, G, and B at each of a plurality of pixel positions arranged in a matrix Imaging means for generating
A first interface for outputting the first image data generated by the imaging means to the outside of the imaging device;
G element data is extracted from the first image data generated by the imaging means, and interpolation processing is performed to generate all G element data at the plurality of pixel positions, and R extracted from the image data. For each of the element data of B and B, new element data is generated based on the element data and the G element data generated by the interpolation processing corresponding to the element data, and the new element data is Processing means for performing interpolation processing based on the second image data,
An imaging apparatus comprising: a second interface that outputs the second image data generated by the processing means to the outside of the imaging apparatus. At least one of a process of encrypting the first image data before being output to the outside of the imaging apparatus and a process of encrypting the second image data before being output to the outside of the imaging apparatus is performed. The imaging apparatus according to claim 10, further comprising an encryption unit. The imaging apparatus according to claim 10, wherein the imaging unit is provided corresponding to each of the plurality of pixel positions, and forms an image of the light on a light receiving element having a variation unique to light receiving sensitivity.

Images