JP2003069889A - Imaging apparatus and image output device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging apparatus for correcting various inconvenient phenomena due to an image pickup lens such as a distortion aberration, a magnification color aberration or shading at the side of an image output device such as a printer for displaying, printing or outputting the image and also to provide the image output device. SOLUTION: The imaging apparatus is provided with a lens barrel 100 for forming a subject image in an imaging means 150, a correction value recording means 141 for recording the correction value of the magnification color aberration, the distortion aberration or the shading due to the lens barrel 100 and output means (an exchange means 157, a recording medium interface 170, etc.), for associating the image of the subject formed in the imaging means 141 with the correction value due to the lens barrel 100 recorded in the correction value recording means 141 and outputting them to another kind of communication equipment or a recording medium 177. Then the image is recorded in connection with correcting information of the image, the various inconvenient phenomena caused by the lens barrel 100 are corrected at the side of the image output device and, then, the preferable image is obtained.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image pickup device and an image output device, and more particularly to an image pickup device for picking up and outputting a subject image, and an image output device for obtaining, displaying, printing or outputting an image. .

[0002]

2. Description of the Related Art Conventionally, in a camera having an image pickup lens, since the image pickup lens does not satisfy an ideal image forming condition, various adverse effects such as distortion (distortion), chromatic aberration of magnification, and shading due to the image pickup lens are caused. It occurs in the image obtained by imaging.

A low-cost image pickup apparatus for correcting such a lateral chromatic aberration and a distortion aberration of an image pickup lens at low cost is disclosed in Japanese Patent Laid-Open No. Hei 6-1994.
-292207.

[0004]

In the image pickup lens, in order to minimize the adverse effects of various phenomena such as the above-mentioned distortion, chromatic aberration of magnification, and shading, there is a method of searching for a high-performance image pickup lens. It has been implemented. However, a high-performance lens is heavy, large-sized, and very expensive. Therefore, it becomes difficult for the user to purchase a high-performance image pickup lens, and a large-sized image pickup lens or an image pickup lens having a heavy weight causes a great inconvenience when carrying the lens.

In the image pickup device disclosed in Japanese Patent Laid-Open No. 6-292207, the image pickup lens characteristics are recorded in a correction data memory in the image pickup lens body, and the image pickup device equipped with the image pickup lens is mounted. The distortion is internally corrected by image processing. However, in correcting an image such as the distortion aberration and the chromatic aberration of magnification, the information processing means (generally a CPU, an image processing engine, etc.) provided in the camera is required to have a high image processing capability, and therefore, a high level image processing is required. In order to carry out the high-speed shooting in continuous shooting or the like, a dedicated high-performance image processing circuit is required.
Therefore, it becomes impossible to achieve the object of providing a camera that is small in size, inexpensive, and capable of capturing high-quality images.

Further, when a dedicated high-performance image processing circuit is not provided in the camera, the calculation time in the camera is increased due to the complicated correction algorithm for correcting the distortion aberration and the chromatic aberration of magnification of the captured image. This requires a long period of time, which causes a problem that the user has to wait and that continuous shooting cannot be performed.

The present invention has been made in view of such circumstances, and outputs phenomena such as distortion, chromatic aberration of magnification, and shading caused by various image pickup lenses to a printer or the like for displaying, printing, or outputting an image. An object of the present invention is to provide an imaging device capable of recording correction information of an image in association with the image so that the device can perform correction.

Further, the present invention provides distortion, chromatic aberration of magnification,
When image correction information due to various image pickup lenses such as shading is recorded in association with the image, problems caused by various image pickup lenses such as distortion aberration, chromatic aberration of magnification, and shading may occur with respect to the image. An object of the present invention is to provide an image output device capable of correcting and outputting.

[0009]

In order to achieve the above object, the invention according to claim 1 is an image pickup apparatus for outputting an image obtained by picking up an image of a subject to another communication device or recording it in a recording means. An image pickup lens that forms an image on the image pickup surface, a correction value recording unit that records a correction value such as chromatic aberration of magnification, distortion, or shading caused by the image pickup lens; an image of a subject image formed on the image pickup surface; It is characterized in that it is provided with an output means for associating with a correction value due to the image pickup lens recorded in the correction value recording means and outputting it to another communication device or the recording means.

According to the present invention, the image pickup device includes an image pickup lens for forming a subject image on an image pickup surface, and a correction value recording means for recording a correction value for lateral chromatic aberration, distortion, shading or the like caused by the image pickup lens. An output means for associating the image of the subject image formed on the image pickup surface with the correction value caused by the image pickup lens recorded in the correction value recording means and outputting the correction value to another communication device or the recording means. So
It is possible to record the image and the correction information of the image in association with each other, and it is possible to correct an inconvenient phenomenon caused by the imaging lens on the image output device side to obtain a preferable image.

Further, in order to achieve the above object, a second aspect is provided.
The invention described in, in the image output device that displays, prints or outputs the acquired image to another communication device, and a correction value such as chromatic aberration of magnification, distortion, or shading due to the image and the imaging lens that captured the image. Is acquired from another communication device or a recording unit, an image conversion unit that performs image conversion on the acquired image based on a correction value caused by the imaging lens, and the image conversion unit performs conversion. It is characterized by comprising display means for displaying an image, printing means for printing the image converted by the image conversion means, or output means for outputting the converted image to another communication device or a recording means.

According to the present invention, the image output device acquires the image and the correction value such as the chromatic aberration of magnification, the distortion aberration, or the shading caused by the image pickup lens for capturing the image from another communication device or the recording means. An image conversion unit that performs image conversion on the acquired image based on a correction value caused by the imaging lens, a display unit that displays the image converted by the image conversion unit, and an image conversion unit that converts the image. Since it is provided with a printing unit that prints the image, or an output unit that outputs the converted image to another communication device or a recording unit, the image caused by various image pickup lenses such as distortion aberration, chromatic aberration of magnification, and shading is displayed. It is possible to output a high-quality image in which various defects caused by the imaging lens are corrected based on the correction information.

[0013]

BEST MODE FOR CARRYING OUT THE INVENTION Preferred embodiments of an image pickup apparatus and an image output apparatus according to the present invention will be described below in detail with reference to the accompanying drawings.

FIG. 1 is a block diagram including a signal processing unit of an image pickup apparatus according to the present invention.

As shown in the figure, the lens barrel 100 includes
Mount the lens barrel 100 to the lens mount 1 of the electronic camera 10.
A mount 101 for mounting on the lens 51 is provided, and the lens barrel 100 can be removably mounted on the electronic camera 10.

Inside the lens barrel 100, a focus lens unit 13 capable of adjusting the subject image to be focused on the image pickup surface of the image pickup means 150 of the electronic camera 10.
0, a zoom lens unit 131 capable of adjusting the angle of view of the image formed on the imaging surface, and a diaphragm 135 capable of adjusting the brightness of the subject image.

The focus lens unit 130 is provided with a motor 136 for supplying power when adjusting the in-focus position based on a command from the electronic camera 10 or a command from a user.
A and an encoder 1 for detecting the in-focus position of the focus lens unit 130 or the set position of the lens unit
37A and a driver 138A that drives the motor 136A while integrating or calculating the detection value of the encoder 137A are connected.

The zoom lens unit 131 is provided with a motor 136B for providing power when adjusting the angle of view based on a command from the electronic camera 10 or a command from a user, and the zoom position of the zoom lens unit 131 or the zoom position of the zoom lens unit 131. An encoder 137B for detecting the setting position of the lens unit,
A driver 138 that integrates or calculates detection values of the encoder 137B and drives the motor 136B.
B is connected.

The diaphragm 135 is provided with a motor 136C for providing power when adjusting the brightness of the subject image based on a command from the electronic camera 10 or a command from the user, and the diaphragm 13
The encoder 137C that detects the diaphragm position of No. 5 or the setting position of the diaphragm and the driver 138C that drives the motor 136C while integrating or calculating the detection value of the encoder 137C are connected.

Further, in the lens barrel 100, information such as the setting positions of the encoders 137A, 137B, 137C and the like is acquired from various drivers such as the drivers 138A, 138B and 138C, and the motor 136A is supplied to the various drivers. An information processing unit 140 that outputs a command to drive 136B, 136C and the like is provided.

The information processing means 140 can send and receive information to and from the electronic camera 10 via electrical contacts provided on the mount 101. In addition, the information processing unit 140 records the correction value of the image such as the chromatic aberration of magnification, the distortion aberration, or the shading caused by the imaging lens provided in the lens barrel 100.
It is possible to read the recorded correction value from the (correction value recording means) and output it to the electronic camera 10 side.

The information processing means 140 is the electronic camera 1.
The means for transmitting / receiving information to / from the 0 side may transmit / receive information via electrical contacts provided on the mount 101, or may transmit / receive information wirelessly without using electrical contacts. It is possible to achieve the object of the present invention.

In the image processing section of the electronic camera 10 which is one form of the image pickup apparatus having the image pickup means, the image pickup means 150 (image) for forming an image of a subject on the image pickup surface, photoelectrically converting it, and outputting it as an image signal. (Means for acquiring the information) and the imaging means 150
A shutter 152 that adjusts the amount of light by passing or blocking light that is focused on the image, image processing means 153 that performs processing such as correlated double sampling and amplification, and converts an analog image signal into digital image data. A / D converter 15
And 4 are provided.

Further, the communication means of the electronic camera 10 for transmitting and receiving information such as image files to and from other communication devices by communication is a short-distance transmitting and receiving for transmitting or receiving information such as image files on carrier waves such as radio waves. Means 157 (including the function of output means), an antenna 156 for transmitting and receiving carrier waves and image files, a communication connector 162 for transmitting and receiving information such as image files to and from other communication devices via a communication cable, and the electronic camera 10. It is composed of a cradle connector 163 that transmits and receives information to and from other communication devices via a cradle in which the s.

Further, the electronic camera 10 is provided with a compression / expansion means 167 for performing compression processing or thinning processing on information such as image data by a method typified by JPEG or motion JPEG, and expansion / expansion processing of compressed image data. OS for displaying on-screen various characters and message data displayed on the display unit 168 together with images
D169, and a signal processing unit 170 that performs white balance processing, gamma conversion, YC conversion processing, pixel number conversion processing, electronic zoom processing, trimming processing, and the like on image data obtained by imaging. A frame memory 171 for temporarily storing image data for display,
A D / A converter 172 for converting digital image data into a composite signal for display or the like is provided.

The electronic camera 10 has an input means 174 including a power switch, a release button, a communication button, a transmission button, a function switch, a cross button, a decision switch, a mode changeover switch, and the like.
And I / I which is an interface for inputting / outputting information input by the inputting means 174 and information for display means such as LEDs.
O 175, a recording medium mounting portion 178 for removably mounting the recording medium 177 (recording means), and a recording medium interface 179 (function of output means) for recording and reading information such as image data on the recording medium 177. And) are provided. The recording medium 177 is a semiconductor such as a memory card, or a removable recording medium typified by a magnetic recording type typified by MO or the like, or an optical recording type.

The electronic camera 10 includes the electronic camera 1
0 overall control and image data sampling timing control, image data recording control, image data graphic recognition, electronic camera 10 model information or device-specific identification information reading processing, communication control, image and voice recording Information processing means 1 for performing control such as display control and display control
80, a non-volatile memory 182 capable of rewriting information and capable of continuing to store the stored information such as various constants for adjustment after power-off, and the electronic camera 10.
Unique identification information such as model name and serial number, operation program, constants, display information, correction value of image due to imaging lens, and the like, and a high-speed working area for program execution A RAM 184 that is a readable / writable storage unit is provided. When the image pickup lens is not a replaceable image pickup lens like the lens barrel 100, it is caused by the image pickup lens provided in the electronic camera 10 in the recording means such as the nonvolatile memory 182 of the electronic camera 10. Image correction values such as chromatic aberration of magnification, distortion, or shading may be recorded.

Further, the lens mount 1 of the electronic camera 10
51 is provided with one to a plurality of electrical contacts, and when the lens barrel 100 is mounted, the mount 10 of the lens barrel 100 is mounted.
1 is configured so as to be in contact with and electrically connected to the electrical contact provided in the first embodiment. In this way, the information processing means 140 of the lens barrel 100 and the information processing means 18 of the electronic camera 10
It is possible to transmit and receive information to and from 0 via the lens interface 185 (acquisition unit) provided in the electronic camera 10.

The information output from the information processing means 180 of the electronic camera 10 to the information processing means 140 of the lens barrel 100 is a drive command for the focus lens unit 130,
The information includes control information such as a drive command for the zoom lens unit 131 and a drive command for the diaphragm 135, and information for acquiring the status of the lens barrel 100.

Information processing means 1 of the lens barrel 100
The information output by 40 is the focus lens unit 13
Status information such as position information of 0, position information of the zoom lens unit 131, position information of the diaphragm 135, and correction of images such as chromatic aberration of magnification, distortion, or shading due to various lenses provided in the lens barrel 100. Information about the value and the like.

Further, the electronic camera 10 has a calendar clock 190 for ticking, a power source 191 for supplying various electric power for driving the electronic camera 10, a power source connector 192 for receiving electric power from an external power source, A light emitting unit 193 that emits light to the subject at the time of image capturing to make up for the insufficient light amount, and a light emission control unit 194 that adjusts the light emission timing of the light emitting unit 193 and the amount of light emitted are provided.

Image pickup processing of the electronic camera 10 configured as described above will be described.

The image to be picked up is the focus lens unit 1.
An image is formed on the image pickup surface of the image pickup unit 150 by the 30 and the zoom lens unit 131, and the formed subject image is photoelectrically converted and output to the image processing unit 153. The image processing means 153 performs image processing such as correlated double sampling, amplification and noise reduction processing on this image signal, and the A / D converter 154 converts it into digital data.

The image data converted into the digital data is transferred to the signal processing unit 170 in accordance with a command from the information processing unit 180, and the image white balance, gamma correction, YC and YC correction are performed.
After being subjected to image processing such as conversion, zoom processing, and pixel number conversion processing, they are temporarily stored in the frame memory 171 such as VRAM.

The information processing means 180 is the frame memory 1
The image data stored in 71 is sequentially added to the D / A converter 1
An instruction to transmit to 72 is given, and it is displayed on the display unit 168 together with information such as characters generated from the OSD 169.

When the user presses the release button for inputting an image pickup instruction provided on the input means 174, the information processing means 180 enters a mode for picking up an image of a subject. Then, the information processing means 180 records the image data converted into digital data by the A / D converter 154 in the RAM 184.

When recording an image on the recording medium 177, the image stored in the RAM 184 is sequentially read out and transferred to the signal processing means 170, where the white balance of the image, gamma correction, YC conversion, zoom processing, After performing image processing such as pixel number conversion processing to perform gradation conversion of each color and image size conversion processing, the compression / expansion unit 167 is performed.
Transferred to.

The image data compressed by the compression / expansion means 167 under a predetermined condition is temporarily stored in the FILE work area of the temporary RAM 184 again on the basis of the instruction from the information processing means 180, and thereafter, is recorded. After being converted into image data, it is output to the recording medium interface 179 and sequentially recorded in the recording medium 177.

Further, the information processing means 180 gives the information processing means 140 of the lens barrel 100 via the lens interface 185 an image such as magnification chromatic aberration, distortion or shading due to the image pickup lens used for the image pickup. Requests output of information about the correction value. Then, the information processing unit 140 of the lens barrel 100 acquires the correction value of the image caused by the image pickup lens from the correction value recording unit 141 and outputs it to the electronic camera 10.

The information processing means 180 of the electronic camera 10 is
The correction value is acquired through the electrical contact provided on the lens mount 151 and the lens interface 185. Then, the correction value of the image caused by the image pickup lens used for the image pickup is associated with the picked-up image, and is output to another communication device via the transmitting / receiving unit 157. Further, it is also possible to perform a process of associating the correction value of the image caused by the image pickup lens used for the image pickup with the picked-up image and outputting the image to the recording medium 177 via the recording medium interface 179.

The communication device as an output destination for outputting the image and the correction value of the image is an electronic device such as a personal computer having an image converting unit and a displaying unit, and a printer having an image converting unit and a printing unit. Is. According to the present invention, it is possible to output the image and the correction value of the image caused by the image pickup lens that captured the image in association with each other. Therefore, the conversion for correcting the image is performed by the communication device of the output destination. As a result, a high quality image can be obtained.

In the above description, an electronic camera provided with an image pickup device has been described as an embodiment. However, the present invention is not limited to this, and chromatic aberration of magnification caused by an image pickup lens for picking up an image, Even if it is an imaging device such as a scanner, a personal computer, a mobile phone, a PDA (Personal Data Assistance), etc., which outputs a captured image to a communication device by associating a correction value such as distortion or shading with the captured image, It is possible to achieve the object of the invention.

In the above description, the image pickup apparatus according to the present invention is an electronic device for forming a subject image on an image pickup means such as a CCD and performing photoelectric conversion, converting the obtained image into digital data, and recording or outputting the digital data. Although the embodiment has been described as a camera, the present invention is not limited to an electronic camera, and a silver salt camera that forms an image on a silver salt film, exposes it, and records it is also an object of the present invention. Can be achieved.

When the image pickup apparatus according to the present invention is a silver salt camera, the correction value of the image such as chromatic aberration of magnification, distortion or shading due to the image pickup lens which picked up the image and the picked-up image are displayed. The information is recorded in association with a recording means such as a silver salt film. Further, the image pickup apparatus according to the present invention is not limited to the image pickup apparatus for recording a still image, and the object of the present invention can be achieved even with an image pickup apparatus for picking up a moving image.

The correction value of the image caused by the image pickup lens, which is output by the image pickup apparatus in association with the image, will be described below.

2 and 3 are explanatory views showing shading caused by the image pickup lens.

As shown in the figure, the center point is the position where the optical axis of the imaging surface 12 passes, and the distance from the center point O is r. Then, the amount of light that passes through the imaging lens group 14 decreases according to the distance r from the center point O, so that the transmittance S (r)
Is reduced.

This transmittance S (r) is obtained by the image pickup lens group 14
Since it is determined by the design dimension of A, the aperture value, and the setting value such as the focal length, it is possible to correct the brightness of the subject image formed on the imaging surface based on the distance r from the center point O. is there.

For example, let us say that the transmittance S (r) is expressed by the following equation 1 as a function of r.

[0050]

## EQU1 ## S (r) = 1-a.r.r (Equation 1) where r: distance from center point O (pixel) S (r): transmittance at distance r: constant (correction value ) Then, the shading correction can be corrected by the following Expression 2.

[0051]

[Equation 2] QL ′ (r) = QL (r) / (1−a · r · r) (Equation 2) where QL (r): Luminance information (Quantity Level) QL ′ before correction at the distance r (R): Luminance information after correction conversion at the distance r Note that the shading correction value caused by the imaging lens (imaging lens group 14 or the like) to be recorded in the correction value recording unit 141 is the above Expression 1, Expression 2 or the like. Or an approximation of the formula, or a constant such as a.

FIG. 4 shows how a subject is spectrally divided by chromatic aberration of magnification.

When the chromatic aberration of magnification occurs in the image pickup lens 16, the image of the subject P emitting white light is formed on the image pickup surface 18 in each color as shown in FIG.
In the figure, for convenience of explanation, red, green, and blue R, G, B
Only the three primary colors are described.

FIG. 5 is a diagram showing the state of image formation due to lateral chromatic aberration, which is expressed on the XY plane on the image pickup surface.

As shown in the figure, in the image of the object P, red is imaged at a position of radius r _r from the center point O, green is imaged at a position of radius r _{g, and at} a position of radius r _b . The blue color is imaged.

FIG. 6 shows the relationship between the amount of lateral chromatic aberration and the focal length obtained by zooming.

Magnification chromatic aberration amounts Mr (f) and Mb (f)
Is generally represented by the characteristic shown in FIG.

The chromatic aberrations of magnification Mr (f) and Mb
(F) represents the difference in distance from green. Therefore, Mr (f) and Mb (f) are expressed by the following equations 3 and 4.

[0059]

Equation 3] _{Mr (f) = r r (} f) -r g (f) ... ( Equation 3) where, Mr (f): red magnification chromatic aberration at the focal length f _r r (f): the focal length f Position of red at r _g (f): position of green at focal length f

[0060]

Equation 4] _{Mb (f) = r b (} f) -r g (f) ... ( Equation 4) where, Mb (f): lateral chromatic aberration of the blue at the focal length f r _b (f): the focal length f Blue position r _g (f) at: green position at focal length f The red magnification chromatic aberration correction calculation for converting r _r to r _g is shown in the following formula 5 by solving the above formula 3 with respect to r _g. It can be defined by the function G _Mr.

[0061]

Equation 5] _{r '= r r (f)} -Mr (f) = G Mr (r, f) ... ( Equation 5) However, r': the focal length f, the position of the red corrected conversion in position r Note , R _b to r _g can be defined by a function G _Mb shown in Formula 6 below by solving Formula 4 above with respect to r _g .

[0062]

[Equation 6] r '= r_b(F) -Mb (f) = G_Mb(R, f) (Equation 6) However, r ′: focal length f, position r after correction conversion
Blue position The image pickup lens 1 is to be recorded in the correction value recording means 141.
The correction value of the lateral chromatic aberration correction caused by the above equation 6 is
Formula such as Formula 6, or G_Mr(R, f) or G _Mb(R,
It is a function such as f) or an approximate expression of the function.

FIG. 7 is a diagram showing a state in which a subject image having a positive distortion by the image pickup lens is formed on the image pickup surface.

Consider a case in which the subject 20 is imaged on the image pickup means 150 through the image pickup lens 24 as shown in FIG. 9 and a subject image 22 having a pincushion-type positive distortion is obtained. The optical axis of the image pickup lens 24 is the image pickup means 15.
The point that intersects with 0 is the center point O. FIG. 8 shows the relationship between the distance r from the center point O and the distortion amount D in this case.

FIG. 8 is a diagram showing the relationship between the distance from the center and the amount of distortion D at that time when positive distortion is generated.

As shown in the figure, when the image pickup lens 24 causes a positive distortion, the distortion amount D (r) with respect to the distance r from the center point O is, for example, first-order, second-order, Alternatively, it indicates the degree of distortion due to a function such as a logarithm, an exponent, or the like, which is a third order or higher.

FIG. 9 is a diagram showing a state in which a subject image having negative distortion caused by the image pickup lens is formed on the image pickup surface.

Consider a case where the subject 30 is imaged on the image pickup means 150 via the image pickup lens 34 as shown in FIG. 8 and a subject image 32 having barrel-shaped negative distortion is obtained. The optical axis of the image pickup lens 34 is the image pickup means 150.
The center point O is the point intersecting with. FIG. 10 shows the relationship between the distance r from the center point O and the distortion amount D in this case.

FIG. 10 is a diagram showing the relationship between the distance from the center and the distortion amount D when a negative distortion aberration occurs.

As shown in the figure, when a positive distortion is generated by the image pickup lens 34, the distortion amount D (r) with respect to the distance r from the center point O is, for example, primary, secondary, Alternatively, it indicates the degree of distortion due to a function such as a logarithm, an exponent, or the like, which is a third order or higher.

FIG. 11 shows the relationship between the distance r from the center and the ideal position r _{0 (r)} of the subject image when positive distortion occurs.

As shown in the figure, when the image pickup lens 24 has a positive distortion, the actual object image with respect to the ideal object image position r _{0 (r)} from the center point O is obtained. Position r
Takes a large value.

For example, it is assumed that the distortion amount D (r, f) is expressed by the following equation 7 as a function of the position r and the focal length f by zooming.

[0074]

## EQU00007 ## D (r, f) = (r (f) -r0 _{(r, f)} ) / r0 _{(r, f)} (Equation 7) where D (r, f): central point O When the amount of distortion is at the distance r from the focal length f and the focal length f, the distortion can be corrected using Equation 8 below, and the function used for the correction can be defined as F _D.

[0075]

Equation 8] r '= r (f) / (1 + D (r, f)) = F D (r, f) ... ( Equation 8) Note that the imaging lens so as to record in the correction value recording unit 141 2
The correction value of the distortion aberration caused by 4 or 34 is a mathematical expression such as the above Expressions 7 and 8, or an approximate expression of the mathematical expression.

Table 1 shows an embodiment in which the correction value of the distortion aberration is recorded in the correction value recording means 141 in the form of a table. Although Table 1 shows an embodiment in which only the correction value of the distortion aberration is recorded in the table format, the present invention is not limited to the distortion aberration, and correction of images such as lateral chromatic aberration and shading is performed. Correction value recording means 1 in the form of table
It is also possible to achieve the object of the present invention by recording the data in No. 41.

[0077]

[Table 1]

In the case where shading correction is performed and finally expressed as a digital image, a luminance signal QL of a discrete value represented by 8 bits or the like obtained by actual image pickup is used.
After converting (r) into a continuous quantity QL ′ (r), it is further converted into a discrete value QL ″ (r) by rounding or the like.

Further, when the distortion aberration correction and the magnification chromatic aberration correction are performed on the image actually obtained and finally expressed again as a digital image which is an aggregate of discrete values, after correction, The image correction process is performed by considering that the discrete value r ′ on the image is a linear transformation of the continuous amount on the image before correction.

Here, the function G _Mr (r,
f), the function G _Mb (r, f) shown in Formula 6, or the function F _D (r, f) shown in Formula 8 is collectively referred to as a function F (r, f), and Let F ^{−1 be} the inverse function of F.

Then, the continuous quantity r to be converted into the discrete value r ′ which finally becomes the pixel of the digital image is calculated by the following expression 9.
(Continuous amount including pixels of the image actually acquired and continuous positions between the pixels which are not actually acquired) can be obtained.

[0082]

## EQU00009 ## r = F.sup.- ¹ (r ', f) (Equation 9) In Equation 9 above, r is shown as a continuous amount on the image before correction, but it is actually captured before correction. Since only discrete point pixels are present on the obtained image, it is necessary to interpolate between these discrete points to obtain the continuous amount r. FIG. 12 illustrates the relationship between the calculated continuous amount r and the discrete value r ′ that is the corrected pixel.

When calculating the luminance information, color information, etc. at the position of the continuous amount r calculated by the above equation 9, the discrete points of pixels actually obtained in the vicinity of the continuous amount r and obtained by r1 ,
From the brightness information and color information of the sample points at r2, r3, r4, etc., an interpolation operation represented by linear interpolation or the like is performed to calculate brightness information, color information, etc. at the position of the continuous amount r. Then, the brightness information, the color information, and the like at the calculated position of the continuous amount r are set as the value of the discrete value r ′ in the corrected digital image.

When the image due to the image pickup lens is corrected with respect to the picked-up image, shading correction may be performed first, and then magnification chromatic aberration correction or distortion correction may be performed.

FIG. 13 shows a description example in which the correction value of an image caused by the image pickup lens and the image are recorded in association with each other.

In the embodiment shown in the figure, the correction value of the image such as the chromatic aberration of magnification, the distortion aberration or the shading due to the image pickup lens for picking up the image is described in the tag portion of the image file. The present invention is not limited to describing the correction value of the image in the tag portion of the image file.

As shown in the figure, in the image file 40, the tag portion in which the auxiliary information 41 of the image is described and the main image 42 in which the number of pixels of 1280 × 960 is described. And a portion in which a reduced image 43 (thumbnail image) of the main image 42 used for index display and the like is described.

In the part where the attached information 41 is described,
The original image identification information ("scene UID" in FIG. 13 is described as the image identification information. Note that the UID is Uniqu.
e Identification means a 128-bit value or a value such as “0x12345678”), conversion identification information (described as “self-image UID” in FIG. 13), and a copied image. Or a duplication classification indicating whether the image is the original image.

As shown in FIG. 13, in the duplication section, "ORIG" indicating that the newly picked-up image is the original image
Information of "INAL" is described. Information such as “COPY” is described in the image after the image processing such as resizing is performed.

Further, in the portion in which the additional information 41 is described, information on the number of pixels of the main image 42 and compression rate information such as the average information amount (bit) per pixel (pel) are provided as image property information. Have been described. In addition to the above-mentioned image property information, information indicating that the image is a compressed image or an uncompressed image, RGB or Y
Information on the amount of information after image sampling such as CC,
Alternatively, information such as image data amount information (image file size) may be described.

Further, in the portion in which the additional information 41 is described, incidental information at the time of capturing or generating the original image may be described as shooting information. In the example shown in FIG. 13, shooting date information indicating the date and time when the main image 42 was shot, and a shooting mode indicating that the image was shot by setting the shooting mode of the electronic camera 10 to the “NOMAL” mode at the time of shooting. Information and various information such as title information in which the title of the main image 42 designated by the user is described are described.

Further, in the portion in which the auxiliary information 41 is described, white balance information in which a mode for adjusting the white balance set in the electronic camera 10 at the time of image capturing is described and in the electronic camera 10 at the time of image capturing are set. Information such as "AUTO" or "MANUAL", which has been described above, the focus information, the shooting position information that describes the position where the image of the subject is captured by the electronic camera 10, and the image captured by the electronic camera 10. Strobe information that describes the emission mode of the auxiliary light set when performing the operation and how much the emitted auxiliary light has returned.

Further, in the attached information 41, image pickup lens correction value information 44 for recording correction values such as magnification chromatic aberration, distortion aberration and shading due to the image pickup lens used when the main image 42 is picked up is described. .

Further, the imaging lens correction value information 44 includes shading correction value information 45 and magnification chromatic aberration correction value information 46.
And various kinds of correction information such as the distortion aberration correction value information 47, and the image output device (electronic device or the like) such as a printer that has acquired the image file has the imaging lens correction value information 4
4 based on various correction information described in No. 4
2 can be corrected to a preferable image.

The following information may be further described as the additional information 41 of the image file 40 and referred to at the time of printing or displaying.

A first example of other information described in the accessory information 41 of the image file 40 is the electronic zoom magnification set by the user when the subject image is picked up. An image enlarged by trimming the image with respect to the optical zoom (an image obtained by using the electronic zoom process) has a smaller number of pixels than the image not subjected to the electronic zoom process. If the printed image is printed under the same printing conditions as the image that has not been subjected to the electronic zoom process, a problem such as blurring of the outline occurs.

Therefore, by recording the electronic zoom magnification in association with the picked-up image, the electronic zoom processing is performed at the time of printing or the like to automatically increase the sharpness of the recorded image (correction) by image processing. It becomes possible for the user to easily obtain a good-looking image.

A second example of other information described in the auxiliary information 41 of the image file 40 is the auto white balance information in the electronic camera 10 when the electronic zoom process is performed. When the electronic zoom process is performed, the electronic camera 10 also acquires an image outside the zoom-up image (trimming image) that is actually acquired.

Generally, the image information obtained by the electronic camera 10 before the electronic zoom process includes a high-luminance object such as sunlight or white light outside the finally obtained zoom-up image (trimming image). In many cases
The electronic zoom processing is performed on the information of the outer high-brightness part that is not included in the image actually obtained by performing the electronic zoom processing (which has been omitted), or the gain information when the white balance is performed. When the image is printed by an image output device such as a printer, the information is recorded in association with the acquired main image 42 to reduce the influence of the color ferria by referring to the information of the high-brightness portion, thereby reducing the natural It is possible to easily obtain an image with various color tones.

A third example of other information described in the accessory information 41 of the image file 40 is AE (Automatic Exposure) information when the electronic zoom process is performed. When the electronic zoom process is performed, the electronic camera 10 also acquires an image outside the zoom-up image (trimming image) that is actually acquired.

Generally, the image information acquired by the electronic camera 10 before the electronic zoom process includes information useful for specifying the condition of the subject such as the sky or the ground outside the trimming image actually acquired. In many cases Therefore, when the AE correction is performed on the acquired image, if the AE correction is performed in consideration of the information about the condition of the subject such as the sky or the ground outside the actually acquired trimming image, the brightness and It is possible to obtain an image with good color reproducibility.

Therefore, the electronic zoom processing is performed on the brightness information of the portion not included in the image obtained by performing the electronic zoom processing, the gain information when the AE processing is performed by the electronic camera 10, and the like. By recording in association with the acquired main image 42, the image of a printer or the like is printed with an image on a coarse output device, the information of the acquired brightness is referred to, and an image of natural brightness and color tone is obtained. Can be easily obtained.

A fourth example of other information described in the auxiliary information 41 of the image file 40 is that the auxiliary light is emitted when the electronic camera 10 takes an image, and before and after the emission of the auxiliary light. The information on the difference in brightness of the subject image during light emission is acquired and described. The difference in brightness due to the emission of the auxiliary light is hereinafter referred to as auxiliary light return information. By recording this auxiliary light return information in association with the main image 42, it becomes possible to automatically correct the brightness and color tone of the image in a preferred direction in an image output device such as a printer.

For example, when the amount of auxiliary light return information is small, the brightness is adjusted so that the entire image is regarded as a night scene, and when the amount of auxiliary light return information is large, a subject such as a person is in the vicinity. Correct the color of the person image so that it does not appear white.

If the color component of the auxiliary light emitted by the electronic camera 10 or the like is known in advance, the color information of the auxiliary light emitted may be recorded in association with the image. An image output device such as a printer can automatically correct the color tone of an image to be output in a preferred direction by referring to the color information of auxiliary light recorded in association with the image.

The fifth example of other information described in the auxiliary information 41 of the image file 40 is information on the focus position set when the electronic camera 10 takes an image or the distance to the subject. is there.

When a person is present at a distance like a general group photograph, the contour of the face of each person tends to be blurred when the image is printed. Therefore, the contour should be emphasized or sharpness should be set strongly. Good to print. In addition, when the subject is close to the electronic camera 10 such as within 1 meter, if the contour of the image is emphasized or the sharpness is increased, the image becomes rather dull.
Since the atmosphere of the person image is tightly expressed, the image is different from the intention of the photographer.

Therefore, by knowing the distance to the object imaged by a device such as a printer for outputting an image, the degree of emphasis of the contour of the image and the degree of emphasis of sharpness according to the distance to the object can be automatically adjusted appropriately. It becomes possible to adjust.

The sixth example of other information described in the auxiliary information 41 of the image file 40 is that a series of continuous images are recorded for the images recorded by continuously shooting a plurality of images by the electronic camera 10. Is the continuous shooting information for identifying. When outputting a series of consecutively shot images by an image output device such as a printer, it is desirable that the expression conditions such as sharpness correction, gamma correction, brightness correction, hue, and saturation are unified and output. However, even in the case of a series of consecutively shot images, the brightness of the subject and the white balance to be corrected change depending on the movement of the captured camera, so if these corrections are performed independently for each image, It becomes difficult to unify the brightness and color tone.

Therefore, by knowing the continuous shooting information of the images picked up by an image output device such as a printer,
It is possible to automatically obtain a series of images in which expression conditions such as sharpness correction, gamma correction, brightness correction, hue, and saturation of a series of continuous shot images are unified.

A seventh example of other information described in the auxiliary information 41 of the image file 40 is to display an image picked up by the display means 168 provided in the electronic camera 10 so that the user can browse the image. At this time, it is the correction information of the display image used at the time of browsing. The correction information of the display image includes expression information such as sharpness correction, gamma correction, brightness correction, hue, and saturation.

When the image once viewed by the user is to be output by an image output device such as a printer, it is desirable that the image is output uniformly under the expression condition set by the user. Conventionally, when an image is output by an image output device such as a printer, the expression condition once set by the user is set again and the image is output. However, by recording the expression condition once set by the user in association with the image, an image output device such as a printer can perform sharpness correction, gamma correction, brightness correction, hue, saturation, etc. once set by the user. It becomes possible to output an image using expression conditions.

FIG. 14 shows a block diagram of a signal processing system of the image output apparatus according to the present invention.

As shown in the figure, the information transmitting / receiving unit of the printer 70, which is one form of the image output apparatus, has an antenna 756 used as a short-distance wireless communication means or a long-distance wireless network communication means, and wirelessly transmits information. Alternatively, a transmission / reception unit 757 (including a function of an acquisition unit or an output unit) that converts data into a predetermined format for wired transmission / reception, and a communication connector that connects a wired communication unit such as a communication cable to transmit / receive information. 759 and a transmission / reception unit 765 (including a function of an acquisition unit or an output unit) for transmitting / receiving information to / from another communication device (server, electronic camera 10 or the like) via a public network 760 or a communication network such as a communication network.
And are provided.

Further, the printer 70 has display means 768 for displaying information such as images and characters, and display control means 769 for outputting an image signal for display to the display means 768 based on a command from the information processing means. And the user input means 77
I / O 7 which reads various information input via 4 and transmits it to information processing means described later, or outputs a display command to a notification means such as an LED based on an instruction from the information processing means.
And 75 are provided.

The printer 70 has a recording medium 777.
Recording medium mounting portion 77 for removably mounting (recording means)
8 and a recording medium interface 7 for recording and reading information such as image data on the recording medium 777.
79 (including the function of the acquisition unit or the output unit). It should be noted that the recording medium 777 is the electronic camera 1
It is a recording medium similar to the recording medium 177 mounted on 0.

Further, in the printer 70, an information processing means (CPU) 780 (including a function of an image conversion means) for controlling the entire printer 70, a program for operating the information processing means 780 and various constants are recorded. A memory 781 including a built-in ROM and a RAM that is a recording unit that serves as a work area when the information processing unit 780 executes processing
And are provided.

The information processing means 780 changes the image size, sharpness correction, contour processing, and
It is possible to perform image processing such as contrast correction. Generally, in an image output device such as a printer that prints an image, when printing one image, it is possible to secure a certain amount of time for performing image processing. Further, since an image output device such as a printer is generally large and expensive, it is easy to provide an image processing circuit dedicated to image processing such as image size change, sharpness correction, contour processing, and contrast correction. Similarly, it is easy to provide a dedicated image conversion circuit that corrects an image such as chromatic aberration of magnification, distortion, or shading caused by the image pickup lens of the image pickup apparatus that picked up the image.

However, in the image pickup apparatus such as the electronic camera 10, miniaturization and cost reduction are extremely pursued, so that it is generally difficult to provide the image conversion circuit due to the image pickup lens in the image pickup apparatus. Further, in the image pickup apparatus such as the electronic camera 10, since the speedup of image pickup processing such as continuous shooting is pursued,
It is also generally difficult to perform image correction (image conversion processing) due to the imaging lens.

Therefore, the image pickup device such as the electronic camera 10 records the correction value caused by the image pickup lens in association with the image, and the image output device such as the printer 70 corrects the image caused by the image pickup lens. It is more rational to adopt the method.

Further, the printer 70 has a white balance correction means 784 (image conversion means) for automatically correcting white balance for an image to be printed, displayed or output.
And an AE correction unit 785 (image conversion unit) that automatically corrects the brightness of the image to be printed, displayed, or output, and automatically corrects the white balance of the acquired image, It is possible to correct the brightness.

Further, the AE correction means 785 can acquire the shading correction value caused by the image and the image pickup lens that picked up the image, and can automatically perform the shading correction for each pixel. There is. Note that instead of providing the independent AE correction unit 785, the information processing unit 780 may have a function of performing shading correction and AE correction.

The printer 70 prints the acquired image on paper or the like and outputs the print engine 789 (printing means), and outputs print information to the print engine 789 based on an instruction from the information processing means 780. In addition, a printer interface 787 is provided for acquiring status information output by the print engine 789, information regarding sheets, and the like and outputting the information to the information processing unit 780.

Information processing means 780 in the printer 70,
Peripheral circuits including the display control means 769, I / O 775, memory 781, printer interface 787, etc. are connected by a bus 799, and the information processing means 780 can control each peripheral circuit.

The short-distance wireless communication means is a communication means using light such as radio waves, ultrasonic waves, and infrared rays as carrier waves. When radio waves are used, it may be based on the specifications of wireless communication such as wireless LAN (local area network).

In the above description, an example in which the communication device is the printer 70 has been described, but the present invention is not limited to the printer 7 described above.
The image is not limited to 0. The acquired image and the correction value of the image are acquired, and the image conversion unit that performs the image conversion on the acquired image and the image converted by the image conversion unit are displayed. Display means, a printing means for printing the image converted by the image conversion means, or an electronic device including the converted image with another communication device or recording means,
It is possible to achieve the object of the present invention.

The acquisition means such as the transmission / reception means 757, the transmission / reception means 765, the recording medium interface 779 and the like stores the image and the correction value of the image such as the chromatic aberration of magnification, the distortion aberration or the shading due to the image pickup lens which picked up the image. It is possible to acquire from the communication device or the recording medium 777 (recording means). The correction value may be acquired in the format of the image file 40 as shown in FIG. 13, or may be acquired by another method.

Image conversion means such as the information processing means 780,
It is possible to perform image conversion on the image acquired by the acquisition unit based on the correction value due to the imaging lens. The image conversion performed by the image conversion unit such as the information processing unit 780 includes the image conversion shown in Expressions 1 to 9.

The display means 768 is the information processing means 7.
It is possible to display the image converted by the image conversion means such as 80. The printing unit such as the print engine 789 can print the image converted by the image conversion unit such as the information processing unit 780. Also,
The output means such as the transmission / reception means 757, the transmission / reception means 765, and the recording medium interface 779 is the information processing means 780.
It is possible to output the image converted by the image conversion means such as to another communication device or the recording medium 777 (recording means).

Further, the transmitting / receiving means 757 and the transmitting / receiving means 76.
5, acquisition means such as the recording medium interface 779,
It is possible to acquire conversion information regarding whether or not the acquired image is an image on which image conversion has already been performed based on the correction value caused by the imaging lens. Then, the image conversion unit such as the information processing unit 780 can determine whether or not the image conversion has already been performed on the image acquired based on the conversion information acquired by the acquisition unit. When the image conversion means such as the information processing means 780 determines that the acquired image is not subjected to the image conversion, it is possible to perform the unconverted image conversion on the acquired image. ing.

Further, the image conversion means such as the information processing means 780 can record the information indicating that the image conversion has been performed in the column of the imaging lens correction value information 44. For example, image conversion means such as the information processing means 780
When shading correction is performed on the acquired image, conversion information indicating “shading correction completed” is written in the entry column of the shading correction value information 45.

Further, for example, when the image conversion means such as the information processing means 780 performs the chromatic aberration of magnification correction on the acquired image, the column of “Magnification chromatic aberration correction completed” is entered in the column of the magnification chromatic aberration correction value information 46. Enter the conversion information to that effect.

Further, for example, when the image conversion means such as the information processing means 780 performs the distortion aberration correction on the acquired image, “Distortion aberration corrected” is indicated in the column of the distortion aberration correction value information 47. Enter the conversion information to that effect.

Further, the transmitting / receiving means 757 and the transmitting / receiving means 76
5, output means such as recording medium interface 779,
The conversion information indicating that the image conversion based on the correction value caused by the imaging lens is performed is output to another communication device or the recording unit in association with the image converted by the image conversion unit such as the information processing unit 780. It is possible to do. The converted image and the conversion information may be output in the form of an image file.

[0135]

As described above, according to the image pickup apparatus of the present invention, the image pickup lens for forming a subject image on the image pickup surface, and the correction value for the lateral chromatic aberration, the distortion aberration, the shading and the like caused by the image pickup lens. To the other communication device or recording means by associating the correction value recording means for recording the image of the subject image formed on the imaging surface with the correction value due to the imaging lens recorded in the correction value recording means. Since the output means for outputting is provided, it is possible to record the image and the correction information of the image in association with each other, and the inconvenient phenomenon caused by the imaging lens is corrected on the image output device side to obtain a preferable image. It becomes possible.

Further, it becomes possible to provide an image pickup device which is small in size, inexpensive, and capable of outputting a high quality image.

Further, according to the image output apparatus of the present invention, the image and the correction value for the chromatic aberration of magnification, the distortion aberration, the shading and the like caused by the image pickup lens that picked up the image are obtained from another communication device or the recording means. Acquisition unit, image conversion unit that performs image conversion on the acquired image based on a correction value caused by the imaging lens, display unit that displays the image converted by the image conversion unit, and the image conversion unit Since the means includes a printing means for printing the converted image, or an output means for outputting the converted image to another communication device or a recording means, it is caused by various imaging lenses such as distortion, chromatic aberration of magnification, and shading. It is possible to output a high-quality image in which various problems caused by the image pickup lens are corrected based on the correction information of the image to be corrected.

[Brief description of drawings]

FIG. 1 is a block diagram including a signal processing unit of an image pickup apparatus according to the present invention.

FIG. 2 is an explanatory diagram showing shading caused by an imaging lens.

FIG. 3 is an explanatory diagram showing shading caused by an imaging lens.

FIG. 4 is a diagram showing how a subject is spectrally divided due to lateral chromatic aberration.

FIG. 5 shows a state of image formation due to chromatic aberration of magnification on X-
Diagram expressed on the Y plane

FIG. 6 is a diagram showing a relationship between a chromatic aberration of magnification and a focal length by zooming.

FIG. 7 is a perspective view showing a state in which a subject image in which positive distortion is generated by the imaging lens is formed on the imaging surface.

FIG. 8 is a diagram showing the relationship between the distance from the center and the amount of distortion when positive distortion is generated.

FIG. 9 is a perspective view showing a state in which a subject image in which negative distortion is generated by the imaging lens is formed on the imaging surface.

FIG. 10 is a diagram showing the relationship between the distance from the center and the amount of distortion when negative distortion is generated.

FIG. 11 is a diagram showing the relationship between the distance r from the center and the position r _{0 (r)} of the ideal subject image when positive distortion is generated.

FIG. 12 is a diagram showing a relationship between a continuous amount r, a discrete value r ′ that is a pixel after correction, and a sampling point.

FIG. 13 is a diagram showing a description example of an image file when recording a correction value of an image caused by an imaging lens and the image in association with each other.

FIG. 14 is a block diagram of a signal processing system of an image output device according to the present invention.

[Explanation of symbols]

10 ... Electronic camera, 12 ... Imaging surface, 14 ... Imaging lens group, 16 ... Imaging lens, 18 ... Imaging surface, 20 ... Subject,
22 ... Subject image, 24 ... Imaging lens, 30 ... Subject, 3
2 ... Subject image, 34 ... Imaging lens, 40 ... Image file, 41 ... Attached information, 42 ... Main image, 43 ... Reduced image,
44 ... Imaging lens correction value information, 45 ... Shading correction value information, 46 ... Magnification chromatic aberration correction value information, 47 ... Distortion aberration correction value information, 70 ... Printer, 100 ... Lens barrel,
101 ... Mount, 130 ... Focus lens unit, 131 ... Zoom lens unit, 135 ... Aperture, 1
36A, 136B, 136C ... Motors, 137A, 13
7B, 137C ... Encoder, 138A, 138B, 1
38C ... Driver, 140 ... Information processing means, 141 ... Correction value recording means, 150 ... Imaging means, 151 ... Lens mount, 152 ... Shutter, 153 ... Image processing means, 15
4 ... A / D converter, 156 ... Antenna, 157 ... Transmitting / receiving means, 162 ... Communication connector, 163 ... Cradle connector, 167 ... Compression / expansion means, 168 ... Display means, 16
9 ... OSD, 170 ... Signal processing means, 171 ... Frame memory, 172 ... D / A converter, 174 ... Input means, 1
75 ... I / O, 177 ... Recording medium, 178 ... Recording medium mounting part, 179 ... Recording medium interface, 180 ... Information processing means, 182 ... Non-volatile memory, 183 ... RO
M, 184 ... RAM, 185 ... Lens interface, 190 ... Calendar clock, 191 ... Power supply, 192 ... Power supply connector, 193 ... Light emitting means, 194 ... Light emitting control means, 199 ... Bus, 756 ... Antenna, 757 ... Transmitting / receiving means, 759 … Communication connector, 760… Public line, 76
5 ... Transmission / reception means, 768 ... Display means, 769 ... Display control means, 774 ... Input means, 775 ... I / O, 777 ... Recording medium, 778 ... Recording medium loading section, 779 ... Recording medium interface, 780 ... Information processing means , 781 ... Memory, 784 ... White balance correction means, 785 ... AE
Correction means, 787 ... Printer interface, 789
... print engine, 799 ... bus

Claims (5)

[Claims] 1. An image pickup apparatus for outputting an image obtained by picking up an image of a subject to another communication device or recording the image in a recording means, and an image pickup lens for forming the image of the subject on an image pickup surface, and lateral chromatic aberration caused by the image pickup lens. A correction value recording means for recording a correction value such as distortion or shading; an image of a subject image formed on the imaging surface; and a correction value due to the imaging lens recorded in the correction value recording means. An image pickup apparatus comprising: an output unit that outputs the data to another communication device or a recording unit in association with each other. 2. An image pickup apparatus in which an image pickup lens for forming a subject image on an image pickup surface can be mounted, and an image of the subject image formed on the image pickup surface by the image pickup lens is used by another communication device or a recording means. In an output imaging device, an interchangeable imaging lens attached to the imaging device is capable of outputting a correction value such as lateral chromatic aberration, distortion aberration, or shading caused by the imaging lens to the imaging device. The image pickup apparatus obtains, from the image pickup lens, a correction value such as chromatic aberration of magnification, distortion, or shading caused by the image pickup lens; an image of a subject image formed on the image pickup surface; An image pickup device, comprising: an output unit that outputs a correction value caused by the image pickup lens in association with another communication device or a recording unit. . 3. An image output device that displays, prints, or outputs an acquired image to another communication device, and an image and a correction value for chromatic aberration of magnification, distortion, shading, or the like caused by an imaging lens that captured the image. Acquiring means for acquiring from the other communication device or recording means, an image converting means for performing image conversion on the acquired image based on a correction value caused by the imaging lens, and the image converting means Display means for displaying the selected image,
Printing means for printing the image converted by the image converting means,
Alternatively, an output device that outputs the converted image to another communication device or a recording device, and an image output device. 4. The acquisition unit acquires conversion information regarding whether or not the acquired image is an image on which image conversion based on a correction value caused by an imaging lens has already been performed, and the image conversion unit. When the image acquired based on the acquired conversion information is determined not to be subjected to the image conversion, the image conversion not executed is performed to the acquired image. The image output device according to item 3. 5. The output unit, together with the image subjected to the image conversion, conversion information indicating that the image conversion based on the correction value caused by the imaging lens is being performed, to another communication device or a recording unit. The image output device according to claim 3, wherein the image is output to the image output device.