JP2009290664A - Camera system, image information reproducing means therefor, and image information reproducing means - Google Patents

Abstract

An object in a digital photograph to be compared is displayed at the same scale.
A digital photograph is provided with a value of pix / m indicating the number of pixels of the digital photograph in which the length of 1 m of the subject of the digital photograph is recorded, and the pix / A camera system in which the display unit reads the value of m, enlarges / reduces each digital photograph to convert it into an image of the same pix / m, and displays it on a single image.
[Selection] Figure 6

Description

  The present invention relates to a camera system capable of adjusting the magnification of two or more types of digital photographs, displaying them side-by-side or overlapping, and comparing the size of the subject of the photographs as an image, and image information therefor The present invention relates to reproduction means and image information reproduction means.

Although it is easy to compare the size of a plurality of subjects in one photo, the size of subjects in different photos cannot be compared in general. When it is necessary to compare, the size of each subject is indirectly compared by copying a subject whose size is known, such as a cigarette, a matchstick, or a ruler, into each photograph. Japanese Patent Application Laid-Open No. 2004-133260 discloses a ruler arranged at the outer peripheral position of an image area. In Patent Document 2, an actual distance between any two points on a screen designated by a user is displayed by a process of acquiring size information indicating a correspondence relationship between a pixel size and an actual size from image data. It is disclosed.
The fact that the images cannot be directly compared in size is a problem when selecting a product in online shopping or the like. In the current online shopping, for example, imagine the actual size from the information about the size of the product, such as "Vase height is 17cm, so it will be this size when placed on my table" Then, through comparison with existing furniture, it is determined whether or not to purchase. If you don't know the actual size of the image, you often go to a retail store to see the actual product and give up on the online shop.
JP 2001-285627 A JP 2006-81854 A JP 2004-294420 A Masahiro Kawakita et al., Real-time distance detection 3D TV camera (Axi-Vision camera) (image and video processing), IEICE Transactions. D-II, Vol. J87DII, no. 6 (20040601) pp. 1267-1278

In particular, in children's growth photos etc., you may feel growth based on the furniture, house pillars, entrance doors, etc. that happened to be in the background. Since the composition of the camera and the size of the print are different, it is difficult to directly compare the sizes. In Patent Document 1, the actual size of the subject is displayed by displaying the size numerically by copying the ruler, and in Patent Document 2 by displaying the size information indicating the correspondence between the pixel size and the actual size from the image data. The size is communicated to the user, enabling comparison. However, these are indirect, for example, “A is 7 scales for B and B is 8 because B is larger” and “B is larger because A is 16 cm and B is 18 cm”. It is difficult to make a direct and intuitive comparison such as comparing both in real space.
As described above, there is no fundamental solution to the problem that it is difficult to compare the sizes of subjects in a plurality of photographs having different shooting conditions and printing conditions.

  In view of the above problems, an object of the present invention is to provide a camera system capable of easily comparing the size of a photographed subject, an image information reproducing unit, and an image information reproducing unit.

The present invention employs the following solutions in order to achieve the above object.
(1) The camera system of the present invention is a camera system having image information recording means for performing processing from imaging to recording of image information, and image information reproducing means for reading the recorded image information.
The image information recording means includes a camera imaging system, a pix / m calculation means, a recording means, and a storage means, and is a combination of the captured image information combined with at least pix / m value information related to the captured image. Create and store image information,
The image information reproduction means includes a storage means, an image information correction means, an image composition means, and a display means. The image information reproduction means reads the combined image information, appropriately performs correction processing on the combination image information, and performs the correction processing. An arbitrary number of combined images are processed and displayed.
(2) The recording unit of the camera system is a sensor that represents a function of digital image information constituting a captured image acquired via a lens system and a focus adjustment system sensor of the camera and a distance from the camera to the subject. The combination image information for each image is configured by combining the measurement information of the above and information on the value of pix / m obtained by the pix / m calculation means based on the digital image information.
(3) In the camera system, the image information correction means includes image information correction means according to the position in the background image, magnification change means, and pix / m value change means, and is selected from the storage means by the input means. The image information of the selected image is read, the magnification change process, the pix / m value change process, and the image information correction process corresponding to the position in the background image are performed to output the corrected image information.
(4) The image synthesizing unit of the camera system synthesizes a plurality of corrected images selected by the input unit to generate and output a synthesized image signal.
(5) The image information recording means is used for a camera system having an image information recording means for performing processing from imaging to recording of image information and an image information reproducing means for reading the recorded image information. Image information recording means for performing processing up to recording of combined image information combining information on the value of / m,
The camera system includes an imaging system, a pix / m calculation unit, and a recording unit. In the captured image information, combined image information that combines information on the value of pix / m related to the captured image is created and stored.
(6) The image information reproducing means is recorded for use in a camera system having image information recording means for performing processing from imaging to recording of image information and image information reproducing means for reading the recorded image information. Image information reproducing means having image information reproducing means for reading out combined image information obtained by combining information on pix / m values,
It comprises a storage means, an image information correction means, an image composition means, and a display means. The combination image information is read out, the combination image information is appropriately corrected, and the number of images subjected to the correction processing is synthesized. And display.

The above-described solution will be described in detail below. The present invention has a value of unit pix / m indicating, as data, the number of pixels of a digital photograph in which the length of 1 m of the subject of the digital photograph is recorded. In the digital photo to be compared, the display device reads the pix / m value of the digital photo to be compared, enlarges or reduces each digital photo to convert it to the same pix / m image, and displays it. Are displayed at the same scale.

  Digital photo as background with pix / m value, ground and floor contact point image position, infinity point position information, or pix / m value, ground and floor contact point image position When another digital photograph is placed on the background digital photograph with information on the shooting distance from the camera and the position of the infinity point, the pix / m value appropriate for the placement position is calculated and placed. The image is converted to a pix / m image calculated by enlarging / reducing the image, and then overwritten at that location, so that the subject of the digital photo placed on the background is displayed at the same scale as the subject of the background digital photo To do.

The same unit as pix / m proposed in the present invention is also defined in the image file formats JPEG and BMP. However, these units indicate how many pixels of a digital photograph correspond to 1 m at the time of printing (image). Resolution) and is independent of the value of the present invention.
A camera system capable of writing information of a value of unit pix / m indicating how many pixels of a digital photograph subject are recorded as 1 m in length of the digital photograph can be realized by the following method, for example.

  The distance to the subject in focus with the camera can be determined from the state of the lens system. Further, the angle of view of the camera can be obtained from the state of the zoom lens. Accordingly, the camera system itself can determine pix / m indicating the number of pixels in the digital photograph in which the length of 1 m of the subject is recorded, and the value can be written in the digital photograph.

  The value of pix / m that indicates how many pixels of the digital photograph the 1m length of the subject in the digital photograph is recorded, the image position of the ground contact point with the ground or the floor, the image position of the infinity point A camera system capable of writing information can be realized by the following method, for example.

(1) The image position of the subject is determined from the in-focus portion.
(2) Next, for example, by using the “real-time distance detection three-dimensional television camera (Axi-Vision camera)” of Non-Patent Document 1 and “Distance Image Sensor” of Patent Document 3, the distance to the subject is constant. Detect areas.
(3) Further, a ground area or a floor area is detected from the gradient of the distance, and an arbitrary one of the intersections is set as a grounding point. The camera is provided with a level, and the horizontal line on the screen is obtained from the vertical angle of view φ at the time of shooting by measuring the horizontal tilt and the angle θ between the shooting axis and the horizontal line. An arbitrary point on the horizontal line, for example, the center of the angle of view is selected as an infinite point, and the position information is recorded.

In general, the size of a photographic subject is affected by shooting conditions and printing conditions, so it is difficult to compare the size of a plurality of photographic subjects.
In the present invention, each digital photograph is displayed by adding to the image data a value of pix / m indicating how many pixels of the digital photograph the 1 m length of the subject is recorded. By adjusting so that a subject of the same size is displayed and printed at the same size when printing, the size of the subject can be compared as an image.
For example, even if the subjects cannot be compared directly in time and space, such as the difference in height between parents and children of the same age and the size of buildings that are far apart, they can be photographed. By copying and displaying them side by side, it becomes possible to compare their sizes as images. By making one of the comparison targets an image familiar to the user, the size of the subject of the other target photograph can be intuitively understood.

  Furthermore, by displaying another digital photograph on top of the digital photograph that is the background, it is possible to compare the size of the subject in different photographs as if one photograph was viewed. Furthermore, if the display position of the superimposed photo is changed, the subject is enlarged and reduced to a size suitable for the display position, so that it appears as if the subject of the superimposed photo is in the background of the subject of the digital photo. An image that exists is obtained. So, for example, you can prepare photos of the whole family and furniture photos of various heights, and overlay the furniture and family photos on top of the background photo of your home. It can be effectively used for selecting furniture.

  Although the same effect can be obtained by general image synthesis display by three-dimensional CG, it is necessary to model each object, arrange them in a three-dimensional space, and render them. In contrast, in the present invention, the value of pix / m, the image position of the ground contact point with the ground or the floor, the position of the infinity point, or the value of pix / m, the image position of the ground contact point with the ground or the floor, the camera It is only necessary to prepare information on the shooting distance from the camera and the position of the point at infinity, and modeling work is unnecessary. Even during the display, it is only necessary to obtain the value of pix / m suitable for the display position, and to display it with enlargement / reduction, so that a large amount of data and a large amount of calculation processing are performed as in general three-dimensional CG display. Do not need.

  Embodiments of the present invention will be described in detail with reference to the drawings.

The camera system of the present invention has the following configuration and processing procedure. Details will be sequentially described below.
Hereinafter, the processing procedure of the present invention is processed in accordance with a microcomputer program. Depending on the program procedure, an input operation may be required.
FIG. 1 is a diagram for explaining the principle of detecting the value of pix / m of a subject according to the present invention.

FIG. 1 shows a “camera system capable of writing information of a value of pix / m indicating the number of pixels of a digital photograph in which the length of 1 m of the subject of the digital photograph is recorded”. An example of a method for detecting the value of m will be shown.
The distance L (m) from the camera to the subject is obtained from the state of the camera lens system when the camera is in focus on the subject. The upper and lower shooting ranges H (m) at the distance L are obtained from the state of the zoom lens, for example. The number of pixels h (pixels) in the vertical direction of the camera obtained at the time of designing the camera is divided by the shooting range H from the value of pix / m indicating the number of pixels in the digital photograph in which the 1 m length of the subject is recorded. Ask for it.

The procedure for obtaining the value of pix / m will be described based on the flowchart of FIG.
Start (1) Focus adjustment (Step S1: Hereinafter, step is abbreviated as S)
Focus the camera on the subject.
(2) Detect lens position information (S2)
The position information of the lens in focus from the reference position is detected by a sensor built in the camera.
(3) Calculate the distance L (S3)
Based on the detected lens position information, a distance L from the camera to the subject is calculated by a microcomputer built in the camera or camera system.
(4) Check for presence or absence of zoom lens (S4)
If there is no zoom lens, the process proceeds to S7.
(5) Zoom lens position (S5)
The position information of the zoom lens is detected by a sensor built in the camera.
(6) Calculation of shooting angle of view (S6)
Based on the detected position information of the zoom lens, a shooting angle of view is calculated by a microcomputer built in the camera or camera system. Proceed to S8.
(7) When there is no zoom lens, the value of the shooting angle of view at the time of camera design is read (S7).
(8) Calculation of upper and lower shooting ranges H on the surface of the subject (S8)
The shooting range H is calculated from the distance L and the shooting angle of view by a microcomputer built in the camera or camera system.
(9) Reading the number of pixels in the vertical direction of the image taken by the camera (S9)
The number of pixels in the vertical direction in the imaging range of the camera obtained at the time of designing the camera is stored in advance in a memory and is read out in this step.
(10) Calculation of the value of pix / m (S10)
By dividing the number of pixels h in the vertical direction of the camera by the shooting range H by a microcomputer built in the camera or the camera system, pix indicating how many pixels of the subject are recorded in the digital photograph The value of / m is obtained, stored in the memory, and added to the image data of the captured image.
stop

FIG. 3 is an explanatory diagram for explaining a method of detecting the image position of the ground contact point with the ground or floor of the subject and the image position of the infinity point.
FIG. 3 shows the value of pix / m indicating the number of pixels in a digital photograph in which the length of 1 m of the subject of the digital photograph is recorded, the image position of the ground contact point with the ground or the floor, and the image position of the infinity point. 1 shows an example of a method in which the camera system capable of writing the above information detects the image position of the contact point with the ground or floor of the subject and the image position of the infinity point. The following description is processing by the microcomputer in the camera or camera system. Various parameters used for processing are captured as information from various sensors attached to the camera.

First, the image position of the subject is determined from the image portion in focus of the camera. In FIG. 3, it is assumed that the person who is the subject is in focus. At this time, it is well known to those skilled in the art described in, for example, “Real-time distance detection three-dimensional television camera (Axi-Vision camera)” shown in Non-Patent Reference 1 and “Distance Image CMOS Sensor” in Patent Reference 3. By using a technique for obtaining the obtained image position, an area having a constant distance from the subject is detected.
Further, the ground or floor area is detected from the gradient of the distance, and an arbitrary point in the intersecting portion is set as the grounding point P. The camera is provided with a level, and the horizontal line on the screen is obtained from the vertical angle of view φ during shooting by measuring the horizontal tilt and the angle θ between the shooting axis and the horizontal line. An arbitrary point on the horizontal line, for example, the midpoint of the angle of view, is selected as the infinite point R, and the position information is recorded.

FIG. 4 illustrates a digital photograph in which pix / m data is recorded.
For example, it is assumed that the digital photograph A (1a) has image data in which data of 400 pix / m is recorded, and the digital photograph B (1b) has image data in which data of 250 pix / m is recorded.

FIG. 5 is a diagram showing a display state of the digital photograph A.
As shown in FIG. 5, the user operates the input means while looking at the display unit of the camera system to select the digital photograph A (1a) recorded in the memory of the camera system, and displays it on the display unit 3 of the camera system. indicate.
FIG. 6 is a diagram showing a state where the digital photograph A is displayed at an arbitrary position and in an arbitrary size.
The user operates the display unit of the camera system to process the image data of the digital photograph A (1a) recorded in the memory of the camera system so that the image data is displayed at an arbitrary position and in an arbitrary size. Is displayed on the display unit 3.

FIG. 7 is an explanatory diagram showing a processing procedure for displaying two digital photographs A and B with the same value of pix / m on the screen.
As shown in FIG. 7, the general processing procedure for displaying the same pix / m value by the microcomputer constituting the processing unit of the display unit of the camera system is as follows.
The user operates the input means while looking at the display unit of the camera system to enlarge / reduce the digital photograph A (1a) and display it at an arbitrary position on the display unit.

Next, when the user operates the input means while looking at the display unit to select the digital photograph B (1b) and designates the left of the digital photograph A as the display position on the display unit 3, the display unit displays the digital photograph A. The digital photograph B is enlarged / reduced so as to be equal to the value of pix / m on the screen (ie, 400 pix / m), and then displayed at the position designated by the user.
The processing of the microcomputer that constitutes the image signal processing unit of the display unit of the camera system includes the processing expressed from the viewpoint of combining images, and the detailed processing for combining that will be described later, that is, image addition processing and image size. This is a process for changing the size, and will be described below.

(Process expressed from the viewpoint of compositing images)
The processing expressed from the viewpoint of synthesizing an image includes the following procedures (1) and (2).
(1) The image data of, for example, 400 pix / m digital photograph A designated according to the user's input operation is read from the memory, and reduced to a value of, for example, 50% designated according to the user's input operation. To display. The digital photograph A is displayed at 200 pix / m which is 50% of 400 pix / m on the display screen.
(2) The image data of the digital photograph B of, for example, 250 pix / m designated according to the user's input operation is read from the memory, and the value of pix / m of the digital photograph B, that is, 250 pix / m, is read out from the digital photograph A. Compared with the value of pix / m on the screen, i.e., 200 pix / m, the scale ratio (80%) is obtained, the image data of the digital photograph B is scaled at the obtained scale ratio (80%), and the screen It is displayed on the screen as an image of 200 pix / m which is the same as the value of pix / m above.
As a result, the user can directly compare the sizes of the two subjects appearing in the digital photographs A and B as images on the display screen.

A more detailed processing procedure for displaying the same value of pix / m by the microcomputer constituting the processing unit of the display unit of the camera system is as described in FIGS. 7 to 12 below.
FIG. 8 is a diagram showing an image of a digital photograph having various image data arranged in a selectable manner displayed on the display screen of the display unit and a display frame for displaying the selected image.
The digital photograph in FIG. 8 is a digital photograph as a background having information on the value of pix / m, the image position of the ground contact point with the ground or the floor, and the position of the infinity point, or the value of pix / m, the ground or floor. A digital photograph 1c as a background having information on the image position of the ground contact point, the shooting distance from the camera, and the position of the infinity point, and a digital photograph 1c in which pix / m data is recorded.

The user operates the input means while looking at the display unit of the camera system, and first displays the screen shown in FIG.
At this time, the microcomputer reads the image data of the input screen displaying the image frame 3a designated in accordance with the user's input operation from the memory, and performs a process of displaying it on the display unit.

FIG. 9 is a diagram showing a display screen in which one digital photograph as a background is selected and displayed in the display frame of FIG.
As shown in FIG. 9, the user selects one digital photograph as a background (1d) and displays it at an arbitrary position on the display screen of the display unit 3a.
At this time, the microcomputer reads out, for example, 400 pix / m of digital photograph A image data specified in accordance with the user's input operation from the memory, and has a value of, for example, 50% specified in accordance with the user's input operation. Scaled and displayed.

FIG. 10 is a diagram showing a composite image in which the selected image is displayed on the background image of FIG.
As shown in FIG. 10, the user selects an arbitrary digital photograph 1e and overlays it on the digital photograph 1d as the background.
The microcomputer obtains a scale ratio suitable for the superimposed position, that is, pix / m at the superimposed position of the background digital photograph by a method described later, and the digital designated by the user to be equal to the calculated pix / m. The photograph 1e is enlarged / reduced and displayed at a position designated by the user.

At this time, the microcomputer reads out the image data of the digital photograph 1e designated according to the user's input operation from the memory, and reads the image data of this digital photograph 1e as the background image designated according to the user's input operation. The scale ratio corresponding to the superimposed position of the image, that is, pix / m at the position where the background digital photograph is superimposed is obtained by the method described later, and the image data of the digital photograph 1e is enlarged to be equal to the obtained pix / m. -Reduce and display at the position specified by the user.
As a result, the display unit displays an image in which the subject of the selected digital photograph 1e is present in the background digital photograph 1d. The user can compare the size of the subjects of the two combined digital photos as if they were looking at one photo.

FIG. 11 is a diagram showing a composite image in which another image is displayed on the composite image of FIG.
The user can select another arbitrary digital photo 1f and superimpose it on the digital photo 1d as the background.
The display unit enlarges / reduces the image so as to have a scale ratio suitable for the position where another arbitrary digital photograph 1f is overlaid, and displays it at a position designated by the user.

At this time, the microcomputer reads the image data of the other digital photograph 1f designated according to the user's input operation from the memory, and the image data of this digital photograph 1f is designated according to the user's input operation. The scale factor that matches the superimposed position on the background image, that is, pix / m at the superimposed position of the background digital photograph is obtained by the method described later, and the image of the digital photograph 1f is equal to the obtained pix / m. The data is enlarged / reduced and displayed at a specified position on the background image input by the user.
As a result, the display unit displays an image in which the selected two digital photographs 1e and 1f are present in the background digital photograph 1d. The user can compare the size of the subjects of the three combined digital photos as if they were looking at one photo.

FIG. 12 is a diagram showing a composite image in which the display position of one image in the composite image of FIG. 11 is changed.
In FIG. 12, the user changes the display position of an arbitrary one (1e) of the displayed digital photograph.
The display unit displays the digital photograph selected so as to have a scale ratio suitable for the changed position by enlarging or reducing the digital photograph.

At this time, the microcomputer reads out the image data of the digital photograph 1e designated according to the user's input operation from the memory, and reads the image data of this digital photograph 1e as the background image designated according to the user's input operation. The scale factor that matches the overlaid position, that is, pix / m at the overlaid position of the background digital photograph is obtained by the method described later, and the image data of the digital photograph 1e is set to be equal to the obtained pix / m. The image is enlarged / reduced and displayed at a specified position on the background image input by the user.
FIG. 13 is a diagram showing a composite image in which the display position of another image in the composite image of FIG. 12 is changed.

In FIG. 13, the user changes the display position of another arbitrary one (1f) of the displayed digital photograph.
The display unit displays the selected digital photograph 1f in an enlarged / reduced manner so as to have a scale ratio suitable for the changed position.
At this time, the microcomputer reads the image data of the other digital photograph 1f designated according to the user's input operation from the memory, and the image data of this digital photograph 1f is designated according to the user's input operation. The scale factor that matches the superimposed position on the background image, that is, pix / m at the superimposed position of the background digital photograph is obtained by the method described later, and the image of the digital photograph 1f is equal to the obtained pix / m. The data is enlarged / reduced and displayed at a specified position on the background image input by the user.

As a result, a display is provided in which the subject of the two selected digital photographs can be freely moved in the digital photograph as the background, and the three digital photographs are displayed so that the user always sees one photograph. You can compare the size of the subject in the photo.
As a result, the display unit displays an image in which the subjects of the two selected digital photographs can be freely moved in the background digital photograph. The user can compare the size of the subjects of the three combined digital photos as if they were looking at one photo.
When four or more digital photographs are selected, the same operation and processing are possible, and the user can compare the sizes of a plurality of subjects so as to view one photograph.

Next, processing for adding an image and changing the size of a part of the entire image composition processing described above will be described with reference to a flowchart. Step (procedure) is abbreviated as S.
FIG. 15 shows a flowchart of image addition processing, and FIG. 16 shows a flowchart of processing for changing the size of an image.
(Image addition processing)
Start (11) Load image (S11)
(12) Is the first image? (S12)
It is determined whether or not the read image is the first image. If it is the first sheet (Yes), the process proceeds to S13. If it is not the first sheet (No), the process proceeds to S15.
(13) Read the default enlargement ratio (K ₀ ) (S13)
(14) the image data read is displayed on the screen to expand to _{K 0} times (S14)
Stop (15) Select any other image (S15)
Select any other image.
(16) Reading the enlargement ratio (K ₁ ) of the selected image (S16)
(17) The original pix / m value N of the selected image is read (S17).
(18) N * K ₁ = N ₁ is calculated (S18)
N * K ₁ = N ₁ is calculated to obtain N ₁ .
₍₁₉₎ calculates the _{N 1 / N = K 2 (} S19)
N ₁ / N = K ₂ is calculated to obtain K ₂ .
(20) an image read on the screen is enlarged to _{twice K} (S20)
stop

(Process to change the image size)
Start (21) Are there images other than the corrected image? (S21)
It is determined whether or not there is an image other than the corrected image. If there is no image (No), the process ends (stops), and if there is (Yes), the process proceeds to S22.
(22) to modify the size of the image in magnification _{K 3} (S22)
(23) the size of the corrected image original pix / m reading the value of _{N 2} (S23)
(24) Calculate N ₂ * K ₃ = N ₃ (S24)
N ₂ * K ₃ = N ₃ is calculated to obtain N ₃ .
(25) Is there an image whose size has not been corrected? (S25)
It is determined whether there is an image whose size has not been corrected. If there is no image (No), the process ends (stops), and if there is (Yes), the process proceeds to S26.
(26) Select any one of unmodified images (S26)
(27) selected to read the value _{N 4} original pix / m of the image (S27)
(28) Calculate N ₃ / N ₄ = K ₄ (S28)
N ₃ / N ₄ = K ₄ is calculated to obtain K ₄ .
(29) the image you choose to display on the screen to expand to _{K 4} times (S29)
Proceed to S25

(Method of calculating the value of pix / m at the display position on the image)
FIG. 14 is an explanatory diagram for calculating the value of pix / m at the display position on the image.
According to FIG. 14, the value of pix / m from the value of pix / m, the image position of the ground contact point with the ground or the floor, and the display position of the digital photograph as the background having the position information of the infinity point is obtained. A calculation method for calculating the will be described.
2 and FIG. 3, the ground contact point P with the ground or floor, the value of pix / m at the ground contact point P, and the infinity point R are obtained, and the unit length (1 m) is perpendicular to the subject from the point P. ), I.e., 200 pix / m, a 200 pixel line segment is drawn. In FIG. 14, this is indicated by an arrow.

At this time, the value of pix / m at the drawing position Q designated by the user is obtained by the following procedure.
The size of the displayed object is inversely proportional to the distance from the camera (shooting distance), and a point S having a shooting distance equal to the point Q is obtained on the straight line PR. In other words, the shooting distance of the subject corresponding to the point S is equal to the shooting distance of the subject corresponding to the point Q, and the point S is obtained on the straight line PR on the screen. The curve SQ is a curve obtained by photographing an arc formed by the intersection of the spherical surface centered on the camera and the ground. If this arc is approximated by a straight line assuming that the shooting distance is sufficiently large, the curve SQ can be approximated by a horizontal line passing through the point Q, and the point S is obtained as an intersection of the horizontal line passing through the point Q and the straight line PR. It can be seen that the value of pix / m at the point S is SR / PR times the value of pix / m at the point P due to the principle of similarity of triangles on the digital photograph. Since the points S and Q are equidistant from the camera, they are of an equal scale. Accordingly, the value of pix / m at the point Q is SR / PR times the value of pix / m at the point P, similarly to the value of pix / m at the point S.

Further, instead of obtaining the point S, the subject corresponding to the point Q is obtained by using the shooting distance d of the corresponding point P _{r of the} subject corresponding to the point P (hereinafter, the subscript r represents the point of the subject). The point Q _r is obtained by the method described later, the photographing distance of the obtained corresponding point Q _r is obtained, and the reciprocal of the ratio of the photographing distances of P _{r and} Q _r is multiplied by pix / m at the point P to pix / There is also a method for obtaining the value of m.
Corresponding point Q _r of the object corresponding to the point Q can be determined by the following method.
In general, when the perspective center is (0, 0, −z ₀ ) and the projection plane is the xy plane (z = 0), the point (x, y, z) is projected onto the point (x _t , y _t , 0). If the following formula
And an infinite point (0,0, ∞) is projected to (0,0,0).

The digital photograph is taken on the xy plane (z = 0) in the space of the subject, the camera position is the perspective center (0, 0, -z ₀ ), and the subject point _Pr is obtained by photographing a point (x ₀ , Corresponding to y ₀ , 0), the pixel position of the point P on the digital photograph is (u ₀ , v ₀ ), and the pixel position of the infinity point R is (u ₁ , v ₁ ). When the point (x, y, 0) on the xy plane corresponds to the pixel position (u, v) on the digital screen,
Meet. If so, the following formula
Is obtained, wherein the photographing distance d of point P _r of the object below
Is required. That is, the values of x ₀ , y ₀ , and z ₀ are obtained from the position of the point P on the digital photograph, the shooting distance d of the corresponding subject point _Pr , and the position of the infinity point R.

In general, a subject position Q _r (x, y, z) corresponding to a pixel position Q (u, v) on a digital screen is represented by a corresponding point (u−u ₁ , v−v ₁ , 0) and perspective center (0, 0, although any point on the straight line connecting the -z _0), for example, the point _{Q r} "is on the same horizontal plane as the point _{P r",} the same as the "point _{P r} It can be obtained by adding a restriction condition of the digital photograph as a background such as “on the vertical plane”. In the example of FIG. 14 of the present invention, by selecting the constraint that the point Q _r is on the same horizontal plane as the point P _r , the coordinates of the point Q _r are (x, y ₀ , z), that is, (x, v ₀ −v ₁ , z), and x and z can be obtained from the equation (1).

  Generally, in the CG world, when drawing a world including objects that can freely move in a three-dimensional space, each object is modeled, arranged in the three-dimensional space, and rendered to obtain a single image. . For this reason, in order to obtain the same effect as that of the present invention using an image of a digital photograph, modeling work of a moving object is required. Specialization knowledge is required for modeling work, and it is difficult for general users to model hand-held photographic objects easily. Furthermore, when a composite image is displayed, a large amount of data and a large amount of calculation processing are required to arrange these modeled objects in a three-dimensional space and render it to obtain one image.

  On the other hand, in the present invention, the value of pix / m indicating how many pixels of the digital photograph the 1 m length of the subject of the original digital photograph is recorded, the image position of the ground contact point with the ground or the floor, The same effect can be obtained simply by preparing information on the position of the infinity point. The value of pix / m, the image position of the ground contact point with the ground and the floor, and the information of the position of the infinity point can be easily captured by the user while viewing the digital photograph already taken, not only by photographing with a dedicated camera. You can create and write on digital photos. Furthermore, the calculation required for obtaining one composite image is very small.

FIG. 17 is a block diagram of the camera system of the present invention.
The camera system 10 of the present invention is configured by connecting an imaging unit 15, a display unit 16, and an input unit 17 to a microcomputer 11, and executes the above processing procedure by a program read into the memory 12 of the microcomputer 11. . The microcomputer 11 includes a general CPU (central processing unit) 13, a memory 12, and an I / O (input / output) interface 14. The input unit 17 includes an external terminal such as a USB terminal, a keyboard, and the like. The processing procedure described above is recorded as a program in a recording medium or memory.

FIG. 18 is a block diagram showing a block diagram of the configuration of the camera system of the present invention.
The camera system of the present invention is configured with programs and components so that all the functions described above can be executed.
The camera system includes an image information recording unit 33 that performs processing from imaging to recording of image information, and an image information reproducing unit 34 that reads the recorded image information.
The image information recording unit 33 includes an imaging system of a camera system, a pix / m calculation unit 24, a recording unit 25, and a storage unit 26.

  The recording means 25 includes functions such as the distance from the lens system of the camera system to the subject, and the digital image information b that constitutes the captured image 23 acquired via the lens system 21 of the camera system and the sensor 22 such as the focus adjustment system. A combination image for each image by combining the measurement information a of the sensor 22 to be represented and the information c on the value of pix / m obtained as described above in the pix / m calculation means 24 based on the digital image information b. Information d is configured. The combined image information d is stored in the storage means 26 such as a memory.

The image information reproduction unit 34 includes a storage unit 26, an image information correction unit 30, an image composition unit 31, and a display unit 32.
The image information correcting unit 30 includes an image information correcting unit 27 according to the position in the background image, a magnification changing unit 28, and a pix / m value changing unit 29. The image of the selected image selected from the storage unit 26 by the input unit. The information e is read, and the magnification change process, the pix / m value change process, and the image information correction process corresponding to the position in the background image are performed as appropriate, and the corrected image information f is output. The image synthesizing unit 31 synthesizes a plurality of corrected images selected by the input unit to create and output a synthesized image signal g. The display means 32 displays an image using the composite image signal g.

As another embodiment, the storage unit may be a portable memory such as a USB memory, and the image information recording unit 33 and the image information reproducing unit 34 may be configured separately.
When the image information recording unit 33 and the image information reproducing unit 34 are configured separately, the image information including the pix / m value created by the image information recording unit 33 is a portable type such as a memory, preferably a flash memory or a USB memory. Store it in the memory and store and manage it as needed. If necessary, it is read out from the memory, reproduced by the image information reproducing means 34, displayed, edited, and stored. The image information including the pix / m value in the memory can be transmitted / received via a transmission medium such as the Internet.

It is a figure explaining the detection principle of the value of the pix / m of the to-be-photographed object of this invention. It is a figure which shows the flowchart which calculates | requires the value of pix / m. It is explanatory drawing explaining the detection method of the image position of the earthing | grounding point of a to-be-photographed object's ground and a floor, and the image position of an infinite point. The digital photograph in which the data of pix / m is recorded is illustrated. It is a figure which shows the display state of the digital photograph A. FIG. It is a figure which shows a mode that the digital photograph A is displayed on arbitrary positions by arbitrary magnitude | sizes. FIG. 5 is an explanatory diagram showing a processing procedure for displaying two digital photographs A and B with the same value of pix / m on the screen. It is a figure which shows the display frame for displaying the image of the digital photograph which has the various image data arranged on the display screen of a display part so that selection is possible, and a selection image. It is a figure which shows the display screen which selected and displayed one digital photograph used as a background in the display frame of FIG. It is a figure which shows the synthesized image which displayed the selection image on the background image of FIG. It is a figure which shows the synthesized image which displayed another image on the synthesized image of FIG. It is a figure which shows the synthesized image which changed the display position of 1 image in the synthesized image of FIG. It is a figure which shows the synthesized image which changed the display position of the other image in the synthesized image of FIG. It is explanatory drawing for calculating the value of pix / m in the display position on an image. The flowchart of the addition process of the image of this invention is shown. FIG. 16 of the present invention shows a flowchart of processing for changing the size of an image. It is a block block diagram of the camera system of this invention. It is a block block diagram for every process means of the camera system of this invention.

Explanation of symbols

1, 1a-1f Image 3, 3a Display frame 10 Camera system 11 Microcomputer 12 Memory 13 CPU
14 I / O interface 15 Imaging unit 16 Display unit 17 Input unit 21 Lens system 22 Sensor 23 Captured image 24 Pix / m calculation unit 25 Recording unit 26 Storage unit 27 Image information correction unit 28 according to position in background image Magnification Changing means 29 Pix / m value changing means 30 Image information correcting means 31 Image combining means 32 Display means 33 Image information recording means 34 Image information reproducing means

Claims (6)

A camera system having image information recording means for performing processing from imaging to recording of image information, and image information reproducing means for reading the recorded image information,
The image information recording means includes a camera imaging system, a pix / m calculation means, a recording means, and a storage means, and is a combination of the captured image information combined with at least pix / m value information related to the captured image. Image information is created and stored, and the image information reproduction means includes a storage means, an image information correction means, an image composition means, and a display means, reads the combined image information, and appropriately corrects the combined image information. The camera system is characterized in that any number of images subjected to the correction process are combined and displayed.   The recording means includes digital image information constituting a captured image acquired via a lens system and a focus adjustment system sensor of the camera, sensor measurement information representing a function of a distance from the camera to a subject, and a digital image. 2. The camera system according to claim 1, wherein combined image information for each image is configured by combining information on the value of pix / m obtained by the pix / m calculation means based on the information.   The image information correcting means comprises image information correcting means corresponding to the position in the background image, magnification changing means, and pix / m value changing means, and reads image information of the selected image selected by the input means from the storage means. 3. The camera system according to claim 1, wherein a magnification change process, a pix / m value change process, a correction process of image information corresponding to a position in the background image is performed, and the corrected image information is output.   4. The camera system according to claim 1, wherein the image synthesizing unit generates a synthesized image signal by synthesizing a plurality of modified images selected by the input unit. For use in a camera system having image information recording means for performing processing from imaging to recording of image information and image information reproducing means for reading out recorded image information.
Image information recording means for performing processing from imaging to recording of combined image information combining information on pix / m values,
Composed of an imaging system of a camera system, a pix / m calculation means, and a recording means, and combined image information that combines information on pix / m values related to the captured image is created and stored in the captured image information. Image information recording means. For use in a camera system having image information recording means for performing processing from imaging to recording of image information and image information reproducing means for reading out recorded image information.
Image information reproducing means having image information reproducing means for reading out combined image information combining information on recorded pix / m values,
It comprises a storage means, an image information correction means, an image composition means, and a display means. The combination image information is read out, the combination image information is appropriately corrected, and the number of images subjected to the correction processing is synthesized. And displaying the image information.