JP2006099497A - Panorama image composition - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve workability by enabling panoramic image synthesis by a simple operation.
An array that can be taken by a panoramic image is obtained as a candidate array from the number n of image data Dpi used for creating a panoramic image (a to d in the figure). The plurality of pieces of image data Dpi are taken while moving the shooting range in the horizontal direction, which is the main shooting direction, so that some of the shot images overlap. Whether the plurality of pieces of image data Dpi are combined into the shape of each candidate array in accordance with the order of shooting is determined from the connection possibility S of two adjacent image data in the vertical direction orthogonal to the main shooting direction. Candidate sequences determined to have a high connection possibility S are determined as a normal sequence, and a plurality of image data Dpi are combined while joining together adjacent image data in accordance with the shooting order so as to be a normal sequence MM. Is done.
[Selection] Figure 7

Description

  The present invention relates to a technology for creating a panoramic image by combining a plurality of images by connecting a plurality of image data captured so that a part of the images overlap.

  In recent years, with the widespread use of digital cameras (digital still cameras) and personal computers, it has become possible to variously process image data captured by digital cameras using a personal computer. As one of various processes, there is a panoramic image synthesis process for synthesizing a panoramic image based on a plurality of image data photographed by a digital camera.

  In this panoramic image synthesis process, a subject image is divided into a plurality of images so that a part of the image is overlapped by a digital camera, and the connection between adjacent image data is combined with the obtained plurality of images ( A panoramic image is generated by superimposing common portions. The content of such a panoramic image composition process is disclosed in Patent Document 1, for example.

JP 2000-90232 A

  By the way, in the above technique, the operator has to designate the arrangement of the plurality of pieces of image data one by one. For example, by displaying a list of thumbnails of multiple image data, the operator can drag and drop the thumbnails one by one into a horizontal line, a vertical line, or a combination of vertical and horizontal tiles. , The array was specified. For this reason, there is a problem that the operator needs many manual operations and the workability is poor.

  The problem to be solved by the present invention is to improve the workability by enabling panoramic image synthesis by a simple operation.

  As means for solving at least a part of the problems described above, the following configuration is adopted.

The first panoramic image synthesizing apparatus of the present invention comprises:
Create a panoramic image by combining multiple images taken by moving the shooting range while moving the shooting range in either the vertical or horizontal direction so that part of the image overlaps A panoramic image synthesizing device,
Image capturing means for capturing the plurality of image data;
Photographing order recognition means for recognizing the photographing order of the plurality of image data;
Image number counting means for counting the number of the plurality of image data;
Candidate sequence calculation means for obtaining a sequence of image data that can be taken by the number obtained by the image count counting means as a candidate sequence;
Whether or not the plurality of image data captured by the image capturing unit is combined into the shape of each candidate array in accordance with the order of capturing is determined in a direction on the side different from the main capturing direction in the vertical and horizontal directions. Determination means for determining from the connection possibility of two adjacent image data;
The candidate sequence determined to be correct by the determination unit is determined as a normal sequence constituting the panoramic image, and a plurality of pieces of image data captured by the image capture unit are arranged in the normal sequence. The gist of the present invention is that the image synthesizing unit includes an image synthesizing unit that synthesizes the adjacent image data in accordance with the order of photographing.

  Here, the arrangement of image data corresponds to one of a horizontal row, a vertical row, and a row in which a plurality of tiles in the vertical and horizontal directions are all rectangular.

  According to the panorama image synthesizing apparatus configured as described above, an array of image data that can be taken by the panorama image is obtained as a candidate array from the number of image data used for creating the panorama image. The plurality of pieces of image data are taken while moving the shooting range in either the vertical or horizontal direction as the main shooting direction so that a part of the image overlaps. In the determination unit, whether two or more adjacent image data in the direction different from the main shooting direction in the vertical and horizontal directions is determined when the plurality of pieces of image data are combined into the shape of each candidate array in accordance with the shooting order. Judgment is based on data connectivity. The candidate sequence determined to be correct by the determining means is determined as a normal sequence, and a plurality of image data are combined in accordance with the order of photographing so as to match the connection between adjacent image data so as to become a normal sequence.

  For this reason, even if the operator does not specify the arrangement of the plurality of pieces of image data one by one, the arrangement constituting the panoramic image is automatically determined from the possibility of connection of the image data. Therefore, the number of operations by the operator can be reduced and workability can be improved.

  The image synthesizing unit arranges a plurality of pieces of image data captured by the image capturing unit according to the order of photographing so as to be the normal sequence, and displays them on a display device. An operation command unit that receives an operation command and commands the execution of creating a panoramic image, and a unit that executes the composition when an execution command is issued by the execution command unit may be provided.

  According to this configuration, since the operator can visually recognize whether or not the automatically determined arrangement is correct, it is possible to avoid a failure to synthesize a panoramic image with an incorrect arrangement.

  Further, the image composition means arranges a plurality of image data captured by the image capture means in accordance with the order of photographing so as to be the regular array, and displays the composite image on the display device, and the composition When executing the above, when it is determined that there is a connection determination unit that determines whether connection is possible between adjacent image data and image data that cannot be connected by the connection determination unit, Error mark display means for displaying a mark indicating that joining is impossible between the image data determined to be impossible in the arrangement of the image data displayed by the regular array display means; It is good also as a structure provided with.

  According to this configuration, when it is determined that it is impossible to join two image data when automatically determining the arrangement, the portion where the joining is impossible is marked Can inform the operator.

  The photographing order recognizing means may be configured to recognize the photographing order based on photographing date / time data attached to the image data. According to this configuration, the image data used for creating the panoramic image can be easily arranged in the shooting order.

  Further, the photographing order recognizing means may be configured to recognize a data file name corresponding to the order in which image data is stored in the photographing apparatus that performs the photographing. Also with this configuration, it is possible to easily arrange the image data used for creating the panoramic image in the shooting order.

The second panoramic image synthesizing apparatus of the present invention is
Create a panoramic image by combining multiple images taken by moving the shooting range while moving the shooting range in either the vertical or horizontal direction so that part of the image overlaps A panoramic image synthesizing device,
Image capturing means for capturing the plurality of image data;
Photographing order recognition means for recognizing the photographing order of the plurality of image data;
From the plurality of image data, two image data that are legitimately connected in a direction different from the main shooting direction of the vertical and horizontal directions are searched, and the shooting of the two image data is performed. An image arrangement calculation means for obtaining an arrangement of image data constituting the panoramic image based on the order;
A plurality of image data captured by the image capturing means are combined in accordance with the order of photographing so as to align adjacent image data so as to be an array of image data obtained by the image array calculating means. The gist of the present invention is to provide an image composition means.

  According to the panorama image synthesizing apparatus having the above-described configuration, the plurality of image data used for creating the panorama image is moved in the shooting range in either the vertical or horizontal direction as the main shooting direction so that a part of the image overlaps. It was taken while. Then, from among a plurality of image data, two image data that are legitimately connected in a direction different from the main shooting direction in the vertical and horizontal directions are searched, and the order of the shooting for the image data is searched Based on the above, the arrangement of the image data constituting the panoramic image is obtained. After that, a plurality of image data are synthesized while matching the connection between adjacent image data in accordance with the order of photographing so that the obtained arrangement is obtained.

  For this reason, the arrangement of the panoramic image is automatically determined from the connection of the image data even if the operator does not specify the arrangement of the plurality of pieces of image data one by one. Therefore, the number of operations by the operator can be reduced and workability can be improved.

  In the second panoramic image synthesis device, the image processing device further includes an image number counting unit that counts the number of the plurality of image data, and the image arrangement calculation unit includes the imaging sequence of the two image data, Based on the number of image data obtained by the image number counting means, an arrangement of image data constituting the panoramic image can be obtained.

  According to this configuration, when determining the arrangement of image data, the number of image data is based on the number of image data. Therefore, the number of image data arrays is not only the number of main shooting directions but also the number in the direction different from the main shooting direction. Can also be sought.

The first panoramic image synthesis method of the present invention includes:
Create a panoramic image by combining multiple images taken by moving the shooting range while moving the shooting range in either the vertical or horizontal direction so that part of the image overlaps Panoramic image composition method,
(A) a step of capturing the plurality of image data;
(B) a step of recognizing the shooting order of the plurality of image data;
(C) a step of counting the number of the plurality of image data;
(D) a step of obtaining a sequence of image data that can be taken in the number obtained in the step (c) as a candidate sequence;
(E) The side when the plurality of image data captured in the step (a) is combined with the shape of each candidate array in accordance with the order of photographing, and whether the main photographing direction is different from the vertical and horizontal directions. A step of judging from the connectability of two adjacent image data in the direction of
(F) The candidate array determined to be correct in the process (e) is determined as a normal array constituting the panoramic image, and a plurality of image data captured in the process (a) is defined as the normal array. Thus, the gist of the present invention is to include a step of combining the adjacent image data while combining them in accordance with the photographing order.

The first computer program of the present invention is:
Create a panoramic image by combining multiple images taken by moving the shooting range while moving the shooting range in either the vertical or horizontal direction so that part of the image overlaps A computer program for
(A) a function of capturing the plurality of image data;
(B) a function of recognizing the shooting order of the plurality of image data;
(C) a function of counting the number of the plurality of image data;
(D) a function for obtaining, as a candidate sequence, an array of image data that can be obtained in the number obtained by the function (c);
(E) The right or wrong when the plurality of image data captured by the function (a) are combined into the shape of each candidate sequence according to the order of photographing is different from the main photographing direction in the vertical and horizontal directions. A function of judging from the connectability of two adjacent image data in the direction of
(F) The candidate sequence determined to be correct by the function (e) is determined as a normal sequence constituting the panoramic image, and a plurality of image data captured by the function (a) is defined as the normal sequence. Thus, a computer program for causing a computer to realize a function of combining while combining adjacent image data in accordance with the order of photographing.

  According to the first panoramic image synthesis method and the first computer program of the present invention, as in the first panoramic image synthesis apparatus of the present invention, the panoramic image can be synthesized by a simple operation, which improves workability. There is an effect that it is excellent.

The second panoramic image synthesis method of the present invention includes:
Create a panoramic image by combining multiple images taken by moving the shooting range while moving the shooting range in either the vertical or horizontal direction so that part of the image overlaps Panoramic image composition method,
(A) a step of capturing the plurality of image data;
(B) a step of recognizing the shooting order of the plurality of image data;
(C) Searching for two image data that are legitimately connected in the direction different from the main shooting direction of the vertical and horizontal from the plurality of image data, A step of obtaining an array of image data constituting the panoramic image based on the order of photographing;
(D) A plurality of image data captured in the step (a) are aligned according to the shooting order so that a plurality of image data are arranged in the image data obtained in the step (c). And the process of synthesizing.

The second computer program of the present invention is:
Create a panoramic image by combining multiple images taken by moving the shooting range while moving the shooting range in either the vertical or horizontal direction so that part of the image overlaps A computer program for
(A) a function of capturing the plurality of image data;
(B) a function of recognizing the shooting order of the plurality of image data;
(C) Searching for two image data that are legitimately connected in the direction different from the main shooting direction of the vertical and horizontal from the plurality of image data, A function for obtaining an array of image data constituting the panoramic image based on the shooting order;
(D) A plurality of image data captured by the function (a) are aligned according to the shooting order so that the plurality of image data is arranged in the image data obtained by the function (c). It is a computer program that allows a computer to realize the function of synthesizing while.

  Similarly to the second panorama image synthesizing apparatus of the present invention, the panorama image can be synthesized by a simple operation with the second panorama image synthesizing method and the second computer program of the present invention. There is an effect that it is excellent.

  The recording medium of the present invention is characterized by a computer-readable recording medium that records the first or second computer program of the present invention. This recording medium has the same operation and effect as each computer program of the present invention.

  The present invention includes other aspects as follows. The 1st aspect is an aspect as a program supply apparatus which supplies the computer program of this invention via a communication path. In this first aspect, the above-described method and apparatus are realized by placing a computer program on a server or the like on a computer network, downloading a necessary program to a computer via a communication path, and executing the program. Can do.

The best mode for carrying out the present invention will be described based on examples. This embodiment will be described in the following order.
1. First embodiment:
A. Device configuration:
B. Computer processing:
B-1. Overall processing:
B-2. Joining process:
C. Action / Effect:
2. Second embodiment:
3. Other embodiments:

1. First embodiment:
A. Device configuration:
FIG. 1 is an explanatory diagram showing a schematic configuration of a computer system to which the first embodiment of the present invention is applied. The computer system of this embodiment mainly includes a personal computer 10 that constitutes a panoramic image composition apparatus of the present invention, and includes a display 20, a keyboard 22, and a mouse 24 as peripheral devices. Furthermore, a digital camera 26, a CD drive 28, and a printer 29 are connected to the personal computer 10. The mouse 24 can be replaced with other pointing devices such as a trackball, a trackpad, and a tablet.

  The personal computer 10 includes a memory 13, a display image memory 14, a hard disk drive 15, an input control unit 16, a display control unit 17, an output control unit 18, and the like that are mutually connected by a bus 12 around a CPU 11 as a central processing unit. Is provided. The memory 13 stores various data and becomes a work area of the CPU 11. The display image memory 14 is a memory that temporarily stores image data of an image to be displayed on the display 20.

  The hard disk drive 15 stores a computer program Pr as software of the panoramic image synthesizer. The hard disk drive 15 stores a plurality of image data Dpi (i = 1 to n, n is a positive integer) used for panoramic image synthesis. The image data Dpi is image data of a captured image taken by the digital camera 26 and is stored in a predetermined area (for example, a holder) of the hard disk drive 15. The captured image is a color image.

  FIG. 2 is an explanatory diagram illustrating an example of a plurality of captured images captured by the digital camera 26. As shown in the figure, the plurality of photographed images are obtained by dividing a landscape as a subject into two rows and three columns in total so that a part of the photographed images overlaps. That is, the plurality of photographed images P1 to P6 were photographed while moving the photographing range from the upper left, the upper center, the upper right, the lower left, the lower center, and the lower right so that a part of the photographed images overlap. Is.

  In other words, the plurality of captured images are moved in order from the upper left to the right, which is the main shooting direction, so that a part of the image overlaps. Similarly, it moves in order from the left end to the right, which is the main shooting direction. In this way, the movement of the photographing range in the main photographing direction is repeated to photograph a plurality of photographed images (hereinafter, this photographing method is referred to as “main photographing direction method”). The plurality of captured images do not necessarily have to be captured in a plurality of tiles in the vertical and horizontal directions, and may be captured in a horizontal row or in a vertical row. The plurality of captured images P1 to P6 are stored in the hard disk drive 15 as image data Dp1 to Dp6 (see FIG. 1).

  Returning to FIG. 1, the input control unit 16 is a control unit that captures input operations from the keyboard 22 and mouse 24, captures image data from the digital camera 26, and captures data from the CD drive 28. The display control unit 17 is a control unit that controls signal output to the display 20. The output control unit 18 is a control unit that controls printing on the printer 29.

  The computer program Pr is originally stored in a CD-ROM (not shown) as a recording medium. The computer program Pr can be read from the CD-ROM and installed in the hard disk drive 15 by setting the CD-ROM in the CD drive 28 and starting a predetermined installation program. Various configuration requirements of the panoramic image synthesis apparatus of the present invention are realized by the CPU 11 executing this computer program Pr.

  In FIG. 1, various constituent requirements are indicated by functional blocks implemented in the CPU 11. That is, the CPU 11 includes an image capturing unit 31, a photographing order recognition unit 32, an image number counting unit 33, a candidate sequence calculation unit 34, a determination unit 35, and an image composition unit 36 as functions.

  The computer program Pr is provided as a configuration stored in another portable recording medium (portable recording medium) such as a flexible disk, a magneto-optical disk, and an IC card in place of the CD-ROM. It can be. Further, the computer program Pr can be provided via a network from a specific server connected to an external network. The network may be the Internet or a computer program obtained by downloading from a specific homepage. Alternatively, it may be a computer program supplied in the form of an email attachment.

B. Computer processing:
B-1. Overall processing:
By executing the computer program Pr by the CPU 11 of the personal computer 10, the above-described image capturing unit 31, imaging order recognition unit 32, image number counting unit 33, candidate sequence calculation unit 34, determination unit 35, and image composition unit 36 are displayed. Realized. The control process according to this computer program Pr will be described in detail below.

  FIG. 3 is a flowchart showing the overall flow of this control process. This routine is started when an instruction to start the computer program Pr is given. As shown in the figure, when the process is started, the CPU 11 first performs a process of displaying the application window WD on the CRT display 12 (step S100).

  FIG. 4 is an explanatory diagram showing the application window WD. As shown in the figure, in the process menu field MN on the left side of the application window WD, four types of buttons BT1, BT2, BT3, and BT4 of “input”, “composite”, “print”, and “output” are directed downward. The operator clicks these buttons BT1 to BT4 with the mouse 24 in order, and the image captured by the digital camera 26 is combined into one panoramic image on the screen of the CRT display 12. You can proceed with the output. That is, as shown in FIG. 3, after executing step 100, the CPU 11 takes in an operation command in which the buttons BT <b> 1 to BT <b> 4 are clicked by the mouse 24, and performs input processing, panoramic image synthesis processing, printing corresponding to the operation command. Processing and output processing are executed in order (steps S200, S300, S400, S500).

  The input process executed in step S200 captures a plurality of image data used for panoramic image synthesis. Here, the above-described image data Dpi (image data Dp1) captured by the digital camera 26 and stored in the hard disk drive 15 is used. ~ Dp6). This image data Dpi import operation is performed by receiving an operation command in which the “file” button BT11 provided in the menu bar BR1 of the application window WD shown in FIG. This is performed for each image data. In addition, it is good also as a structure which takes in several image data collectively by designating a folder etc. Further, it is possible to adopt a configuration in which the digital camera 26 directly captures the data without going through the hard disk drive 15 once.

  The plurality of pieces of image data Dp1 to Dp6 captured as described above are stored in a predetermined area of the memory 13 and are displayed in the work field FDW of the application window WD as shown in FIG. . When the image data Dp1 to Dp6 are stored in the memory 13, the “shooting date / time” data of the tag information attached to the image data Dp1 to Dp6 is read out, and the image data Dp1 to Dp6 is read from this data. The shooting order is determined, and data indicating the shooting order (shooting order data) is also stored in the memory 13. As an example of the shooting order data, the file names of the image data Dp1 to Dp6 are arranged in order according to the shooting order. The image data Dp1 to Dp6 displayed in the work field FDW are displayed in the order according to the shooting order data from the upper left to the right, and from the left to the right by changing the rows when reaching the right end. The input process (including the process for storing the shooting sequence data) executed in step S200 corresponds to the image capturing unit 31 (FIG. 1) and the shooting sequence recognition unit 32 (FIG. 1).

  The panoramic image synthesis executed in step S300 is to combine a plurality of image data Dp1 to Dp6 input in step S200 to synthesize one panoramic image, and details will be described later. The panoramic image data PD created here is stored in the HDD 42.

  The printing process executed in step S400 outputs the panorama image data PD created in step S300 to the printer driver as a print command. This printing process has a well-known configuration and will not be described in detail here. However, panorama image data PD representing a panorama image obtained by connecting the image data Dp1 to Dp6 is printed from the printer 29.

  The output process executed in step S500 is to output the panoramic image data PD created in step S300 to an external device. As a result, the panoramic image data PD is output to a desired external device.

B-2. Panorama image composition processing:
The panoramic image synthesis process executed in step S300 will be described in detail below. 5 to 6 are flowcharts showing the panoramic image synthesis process. When the process shifts to this routine, as shown in the figure, the CPU 11 first performs a process of counting the number n of image data Dpi captured in the input process of step S200 (step S310). For example, in the example shown in FIG. Although not shown in the drawing, when the number n is 1, the panoramic image synthesis process is terminated, assuming that the image synthesis is not necessary.

  Next, the CPU 11 performs a process of calculating an array of image data that can be taken by the number n of the image data Dpi as a candidate array M (step S320). FIG. 7 is an explanatory diagram showing a list of candidate sequences M that can be taken when the number n of image data Dpi is six. (A) in the figure is a horizontal row of candidate sequences (hereinafter also referred to as “6 × 1 candidate sequences”), and (b) is two candidate sequences in the horizontal direction and three candidate sequences (hereinafter referred to as “candidate sequences”). , Also referred to as “2 × 3 candidate sequences”), (c) is three candidate sequences in the horizontal direction and two candidate sequences in the vertical direction (hereinafter also referred to as “3 × 2 candidate sequences”), (D) is a vertical sequence of candidate sequences (hereinafter also referred to as “1 × 6 candidate sequences”).

  Returning to FIG. 5, after executing step S <b> 320, the CPU 11 has a correct arrangement (hereinafter referred to as “normal arrangement”) for constructing a panoramic image to be created from the plurality of candidate arrays M obtained in step S <b> 320. A normal sequence determination process is performed to determine (step S330).

  FIG. 8 is a flowchart showing details of the normal sequence determination process. As shown in the figure, when the process shifts to the normal array determination process, the CPU 11 first performs a process of substituting the value 0 into the variable XS (step S331). Next, the CPU 11 reads one of the plurality of candidate sequences M obtained in step S320 (step S332).

  Subsequently, when the CPU 11 combines the plurality of image data Dpi captured in step S200 into the candidate array M read in step S332 according to the order of the shooting order data stored in step S200, the candidate array A process of calculating the connection possibility S between two adjacent image data among the plurality of image data included in the first column of M is performed (step S333).

  Specifically, assuming that the plurality of image data Dp1, Dp2, Dp3, Dp4, Dp5, and Dp6 captured in step S200 are taken in this order, the candidate array M read in step S332 is “ In the case of “2 × 3 candidate sequences”, first, the image data Dp1 to Dp6 are arranged as shown in FIG. Next, each connection between two adjacent image data of the image data Dp1, Dp3, Dp5 included in the first column, that is, between the image data Dp1 and Dp3, and between the image data Dp3 and Dp5. The possibilities S1 and S2 are calculated. Then, an average value of the connection possibilities S1 and S2 is obtained, and this average value is stored as the connection possibility S of the “2 × 3 candidate array”.

  If the candidate sequence M read in step S332 is “3 × 2 candidate sequence”, first, the image data Dp1 to Dp6 are arranged as shown in FIG. Next, the connection possibility between the two image data Dp1 and Dp4 included in the first column is calculated, and this connection possibility is stored as the connection possibility S of “3 × 2 candidate array”.

  If the candidate sequence M read in step S332 is “1 × 6 candidate sequence”, first, the image data Dp1 to Dp6 are arranged as shown in FIG. Next, between adjacent two image data among the image data Dp1 to Dp6 included in the first column, that is, between the image data Dp1 and Dp2, between the image data Dp2 and Dp3, and image data Dp3 Each connection possibility S1, S2, S3, S4, S5 between Dp4, between image data Dp4 and Dp5, and between image data Dp5 and Dp6 is calculated. Then, an average value of the connection possibilities S1 to S5 is obtained, and this average value is stored as the connection possibility S of the “1 × 6 candidate array”.

  If the candidate array M read in step S332 is “6 × 1 candidate array”, there is no two image data included in the first column, so the connectability S is stored as a value 0. To do.

  The calculation of the connection possibility between two image data is performed using an image positional relationship calculation program for determining the positional relationship between the two images. The image position relation calculation program is built in the panoramic image composition software, and is as follows.

The image position relation calculation program basically includes the following procedure.
(1) Data indicating in which direction the two image data overlap is received from the outside.
(2) Each of the two input images is converted to gray scale.
(3) A plurality of points (for example, 100 to 200) that are corners on the gray scale image are acquired.
(4) For the points of one image, the points that may correspond in the other image are examined in consideration of the direction acquired in (1) above. Specifically, in consideration of the above direction, the local cross-correlation is calculated for all combinations of each point of one image and each point of the other image, and the calculated value is a predetermined value. A combination of points that have a local cross-correlation degree larger than a threshold is set as a possibility of matching.

(5) Processing is performed so that the combination of the points becomes one-to-one. If a certain point is a correct combination, there is a high possibility that a nearby point in the vicinity is also a correct combination. Using this feature, the correct combination of points is obtained based on how much the surrounding points indicate the matching degree of a certain combination of points.

  In step S333, in practice, the connection direction of the two image data is designated as the vertical direction from top to bottom, and the number of correct point combinations obtained in the above (5) is the above (3). The percentage of the total number of points acquired in (1) is calculated, and the percentage is calculated as connectability.

  In the image position relation calculation program, as shown in (1) above, the direction of connection is input, but this is for improving the processing speed, and the above (1) is unnecessary. It can be set as the structure. In this case, the image positional relationship calculation program may output the connection direction of the two images together with the obtained connection possibility.

  Returning to FIG. 8, the CPU 11 then proceeds to step S334 to determine whether or not the connection possibility S obtained in step S333 is greater than the variable XS set to 0 in step S331. . If it is determined that the connectability S is greater than the variable XS, the CPU 11 assigns the connectability S to the variable XS and stores the candidate array M at this time as the normal array MM ( Steps S335 and S336). Thereafter, the CPU 11 advances the process to step S337. If it is determined in step S334 that the connection possibility S is equal to or less than the variable XS, the CPU 11 advances the process to step S337 without executing the processes of steps S335 and S336.

  In step S337, the CPU 11 determines whether or not the processing in steps S332 to S336 has been completed for all candidate sequences M obtained in step S320. If it is determined that the processing has not been completed yet, the process returns to step S332, the next candidate sequence M is read, and the processes of steps S332 to S336 are executed for the read candidate sequence M. On the other hand, if it is determined in step S337 that all processing has been completed, the process proceeds to step S338.

  In step S338, the CPU 11 determines whether or not the variable XS is equal to or less than a predetermined value S0 (for example, 50%). Here, when it is determined that the value is equal to or less than the predetermined value S0, the normal array MM stored in step S336 is changed to an array in a horizontal row (step S339). After the execution of step S339, the process returns to “return”, and the normal array determination process is temporarily ended. On the other hand, if it is determined that the variable XS exceeds the predetermined value S0, the process returns to “RETURN” without executing step S339, and this normal array determination process is temporarily terminated.

  That is, according to the normal array determination process configured as described above, when the candidate array M is a single vertical array or a plurality of vertical and horizontal tile-shaped arrays, the candidate array M having the highest connection possibility S is used. Is selected, and when the connection possibility S at this time exceeds a predetermined value S0 (50%), the selected candidate sequence M is stored as the normal sequence MM. On the other hand, when the connectability S is equal to or less than the predetermined value S0, the horizontal candidate array M is stored as the normal array MM.

  Returning to FIG. 5, after execution of the normal arrangement determination process in step S330, the CPU 11 then obtains the image data Dpi captured in the input process in step S200 in accordance with the imaging order stored in step S200 and obtained in step S330. A process of displaying in an array is performed (step S340).

  FIG. 9 is an explanatory diagram showing a dialog box DB1 for composition processing. As shown in the figure, the left half of the dialog box DB1 is provided with an array display field FD1 for displaying the state in which the image data Dpi are arranged in a regular array, and the right half is a combined result display field for displaying the combined result. FD2 is provided. A [Create] button BT21 is provided below the array display field FD1, and an [End] button BT22 is provided below the synthesis result display field FD2.

  In the array display field FD1, rectangular blocks are displayed in a tile shape. In step S340 of FIG. 5, the image data Dpi is respectively displayed according to the order of the shooting order data stored in the memory 13 in step S200 for a plurality of blocks corresponding to the normal array obtained in step S330. In this embodiment, as a precondition, there is a condition that shooting is performed in the above-described main shooting direction method. Therefore, when the image data Dpi is arranged in the normal arrangement, the same as in the main shooting direction method. Arranged in random order. That is, the image data Dpi is moved in order from the upper left to the right, moved downward by one when reaching the right end, and sequentially moved from the left end to the right. Are lined up. As a result, in the example of FIG. 2, the image data Dp1 is in the upper left (first row, first column) block of the array display field FD1, and the image data Dp2 is in the first row, second column block. Is the image data Dp3 in the block of the first row and the third column, the image data Dp4 is in the block of the second row and the first column, the image data Dp5 is in the block of the second row and the second column, The image data Dp6 is displayed in the blocks in the second row and the third column, respectively.

  Returning to FIG. 5, after executing step S340, the CPU 11 determines whether or not the [Create] button BT21 provided in the dialog box DB1 has been clicked by the operation of the mouse 24 by the operator (step S350). If it is determined that the button has not been clicked, the process of step S350 is repeated to wait for the operator to click. If it is determined in step S350 that the button has been clicked, the CPU 11 performs a process of substituting the value 1 for the variable i (step S360), and then proceeds to step S370 in FIG.

  As shown in FIG. 7, in step S370, referring to the shooting order data stored in the memory 13 in step S200, a process of reading i-th image data Dpi whose shooting order is determined by a variable i is performed.

  Subsequently, the CPU 11 arranges the image data Dpi read out in step S270 at the i-th position in the normal array obtained in step S330, and performs a process of joining the adjacent images. Here, the “i-th position in the normal array” is a rank according to the main photographing direction method described above. In the example shown in FIG. 2, upper left (first row-first column), first row-second column, first row-third column, second row-first column, second row. The order is determined in the order of the second column, the second row, and the third column. “Between adjacent images” means between adjacent images among the images up to the (i−1) th that have been arranged so far.

  In the joining process, the positional relationship between two images is obtained using an image positional relationship calculation program, and overlapping portions are overlapped from this positional relationship so that the two images are connected in a natural connection. Synthesize. This synthesis result is temporarily stored in the memory 13, and there is no display on the display 20 at this time.

  Next, the CPU 11 determines whether or not an error has occurred in the image stitching process in step S380 (step S390). Specifically, when performing the stitching process, when the image positional relationship calculation program determines that the positional relationship between the two images does not correspond, that is, the connection possibility obtained as described above falls below a predetermined threshold value. If it is determined that the two images are not connected, the processing result is output as “error”. In step S390, upon receiving the processing result of “error”, processing is performed to display a mark MK indicating that the joining is impossible between the two image data in which the error has occurred (step S391).

  FIG. 10 is an explanatory diagram showing an example of a mark MK indicating that it is impossible to join two pieces of image data. As shown in the figure, this mark MK is an “x” mark. A mark MK with an “x” mark is displayed because it is impossible to connect the image data Dp4 and Dp5. The operator can know that the two images cannot be automatically automatically joined together by finding the mark “M” marked “×” between the two images. When this mark MK is displayed, as shown in the figure, a [designate feature point] button BT23 appears below the array display field FD1.

  Thereafter, the CPU 11 determines whether or not the “specify feature point” button BT23 is clicked by the operation of the mouse 24 by the operator (step S392). Here, if it is determined that it has not been clicked, the processing in step S392 is repeated to wait for the operator to click. If it is determined in step S392 that the button has been clicked, a process for designating a feature point for connecting the two image data in which the error has occurred is performed in accordance with an input operation by the operator from the keyboard 22 and the mouse 24. This is performed (step S393).

  FIG. 11 is an explanatory diagram showing a dialog box DB2 for specifying feature points. This dialog box DB2 is displayed in response to a click on the [specify feature point] button BT23 provided in the compositing process dialog box DB1. As shown in the figure, the left half of the dialog box DB2 has a first image display field FD11 for displaying one of the two image data in which an error has occurred, and an error has occurred in the right half. A second image display field FD12 for displaying the other image data of the two image data is displayed.

  As shown in the figure, the operator designates a predetermined feature point X1 by clicking with the mouse 24 on the overlapping portion W1 of the one side image (first image) displayed in the first image display field FD11. The operator then moves the feature point X2 corresponding to the designated feature point to the overlapping portion W of the other image (second image) displayed in the second image display field FD12, and the operator uses the mouse 24. Click to specify. The feature points X1 and X2 are common parts (in the illustrated example, the left end of the roof of the house) in each image, and their positions are determined by visual recognition by the operator. The feature points X1 and X2 designated for both images are in a one-to-one correspondence. Although not illustrated, the combination of the feature points X1 and X2 is performed at a plurality of locations (for example, 4 locations).

  Returning to FIG. 6, after executing step S393, the CPU 11 performs a process of connecting the two images based on the correspondence relationship between the plurality of sets of feature points X1 and X2 in both images specified in step S393 (step S394). . Specifically, by superimposing both images so that the feature points X1 and X2 match each other, the two images are combined so that they are connected in a natural connection. If it is determined in step S393 that the feature point cannot be specified, or if the operator determines that the images cannot be connected, it is determined in step S395 that the connection is impossible, and step S396 is performed. Proceed with the process. In step S396, the CPU 11 displays “not connectable” in the combination result display field FD2 of the combination processing dialog box DB1 (see FIG. 9).

  On the other hand, if it is determined in step S390 that the image stitching process is not an error, or if it is determined in step S395 that stitching by the operator is not possible, the CPU 11 sets the variable i. The value is incremented by 1 (step S397), and it is determined whether or not the variable i is larger than the number n of the image data Dpi (step S398).

  If it is determined in step S398 that the variable i is equal to or less than the number n, it is determined that the composition for all the image data Dp1 to Dpn input in step S200 has not been completed, and the process returns to step S370. Steps S370 to S397 are repeatedly executed. On the other hand, if it is determined in step S398 that the variable i exceeds the number n, it is determined that the synthesis for all the image data Dp1 to Dpn is completed, and all the image data Dp1 to Dpn stored in the memory 13 are stored. The composite result is displayed as a panoramic image in the composite result display field FD2 of the composite processing dialog box DB1 (step S399).

  FIG. 12 is an explanatory diagram showing a dialog box DB1 for composition processing for displaying a panoramic image obtained by composition. As shown in the figure, the synthesis result obtained by synthesizing the image data Dpi of the array displayed in the array display field FD1 is displayed in the synthesis result display field FD2 as a panoramic image.

  After execution of step S396 or S399, the process returns to “RETURN” to end the panoramic image synthesis process once.

  Step S310 of the panoramic image composition process configured as described above is performed for the image number counting unit 33 (FIG. 1), step S320 is performed for the candidate sequence calculation unit 34 (FIG. 1), and step S330 is performed for the determination unit 35 (FIG. 1). Steps S360 to S399 correspond to the image composition unit 36 (FIG. 1), respectively.

C. Action / Effect:
According to the computer system of this embodiment configured as described above, an array that can be taken by a panoramic image is obtained as a candidate array M from the number n of image data Dpi used to create a panoramic image. The plurality of pieces of image data Dpi are taken while moving the shooting range in the horizontal direction, which is the main shooting direction, so that some of the shot images overlap. Whether or not a plurality of pieces of image data Dpi are combined into the shape of each candidate array M in accordance with the order of shooting is determined from the connection possibility S of two adjacent image data in the vertical direction orthogonal to the main shooting direction. . A candidate sequence M determined to have a high connection possibility S is determined as a normal sequence MM, and a plurality of image data Dpi is connected to adjacent image data according to the order of photographing so as to become a normal sequence MM. Synthesized together.

  For this reason, the arrangement of the panoramic image is automatically determined from the connectability of the image data without the operator having to specify the arrangement of the plurality of pieces of image data Dpi one by one. . Therefore, the number of operations by the operator can be reduced and workability can be improved.

  In this embodiment, prior to synthesizing the panoramic image, the normal arrangement automatically determined by the normal arrangement determination process is displayed in the arrangement display field FD1 of the dialog box DB1. For this reason, since the operator can visually recognize whether or not the automatically determined arrangement is correct, it is possible to avoid a failure to synthesize a panoramic image with an incorrect arrangement.

2. Second embodiment:
Next, a second embodiment of the present invention will be described. Compared with the computer system of the first embodiment, the computer system of the second embodiment is a panoramic image synthesis process executed by the CPU 11 of the personal computer 10 (shown in FIGS. 5 to 6 in the first embodiment). The other software configurations and hardware configurations have the same configuration. Accordingly, the same components as those in the first embodiment will be described using the same reference numerals.

  FIG. 13 is a flowchart showing details of the panoramic image synthesis process in the second embodiment. When the process shifts to this panoramic image composition process, as shown in the figure, the CPU 11 first performs a process of counting the number n of image data Dpi captured in the input process of step S200 (step S510). This process is the same as step S310 in the first embodiment.

  Next, the CPU 11 performs a process of substituting the value 2 for the variable i (step S520), and then refers to the shooting order data stored in the memory 13 in step S200, and the i-th shooting order is determined by the variable i. A process of reading the image data Dpi is performed (step S530). The process of step S530 is the same as step S530 of the first embodiment.

  Thereafter, the CPU 11 performs a process of calculating the connection possibility Sa between the image data Dpi read out in step S530 and the i-1st image data Dpi-1 read out in the previous execution of step S530 (step S540). . The connection possibility between two pieces of image data is calculated using an image positional relationship calculation program, as in the first embodiment. At this time, the connection possibility is obtained after designating the connection direction of the two image data as the horizontal direction from left to right. It is determined whether or not the calculated connection possibility Sa exceeds a predetermined value S0 (for example, 50%) that is a predetermined threshold value (step S550).

  If it is determined in step S550 that the connection possibility Sa exceeds the predetermined value S0, the CPU 11 determines that the connection between the two image data Dpi and Dpi-1 in which the photographing order is continuous is possible. Then, the process proceeds to step S560. In step S560, the variable i is incremented by 1 and it is determined whether or not the variable i is larger than the number n of the image data Dpi (step S570), and it is determined that the variable i is less than or equal to the number n. If YES, the process returns to step S530, and the processes of steps S530 to S560 are repeatedly executed.

  On the other hand, if it is determined in step S570 that the variable i exceeds the number n, it is assumed that all the image data Dp1 to Dpn can be connected to adjacent image data. The MM is determined to be an array in a horizontal row (step S580).

  If it is determined in step S550 that the connection possibility Sa is equal to or less than the predetermined value S0, it is assumed that the connection between the two image data Dpi and Dpi-1 in which the imaging order is continuous is impossible. The CPU 11 advances the process to step S590. In step S590, a process of calculating the connection possibility Sb between the image data Dpi read out in step S530 and the image data Dp1 in the upper left (first row, first column) of the array is performed. The calculation of the connection possibility between two pieces of image data is performed using an image positional relationship calculation program, as in step S540. At this time, the connection possibility is obtained after designating the connection direction of the two image data as the vertical direction from top to bottom. It is determined whether or not the calculated connection possibility Sb exceeds a predetermined value S0 (for example, 50%) (step S600).

  If it is determined in step S600 that the connectability Sb exceeds the predetermined value S0, the CPU 11 proceeds to step S610 assuming that the image data Dpi and the upper left image data Dp1 can be connected. To proceed. As shown in FIG. 14, the image data Dpi cannot be connected to the previous read image data Dpi-1, and the image data Dp1 with the upper left image data Dp1 in the first read array It can be understood that the line is changed in this image data Dpi.

  Accordingly, in step S610, the CPU 11 obtains the number a of columns of the regular array MM by subtracting the value 1 from the variable i. In the example of FIG. 14, the column number a is a value of 3. Thereafter, the CPU 11 obtains the number of rows b of the regular array MM by dividing the number n of the image data Dpi by the number of columns a (step S620). After executing step S580 or S620, the CPU 11 executes the same steps S340 to S398 as those in the first embodiment, and once ends the routine.

  On the other hand, if it is determined in step S600 that the connection possibility Sb is equal to or less than the predetermined value S0, it is impossible to connect the image data Dpi and the upper left image data Dp1, and also in step S550. Since it is impossible to connect two pieces of image data Dpi and Dpi-1 having consecutive photographing orders, error processing is performed on the assumption that there is an error in determination of connection possibility Sa or Sb ( Step S630). As error processing, processing such as notifying the operator of an error is performed.

  According to the computer system of the second embodiment configured as described above, one of the plurality of image data Dpi used for creating a panoramic image has a direction different from the main shooting direction in the vertical and horizontal directions ( In this embodiment, the upper left image data Dp1 and the fourth image data Dp4 that are legitimately joined in the vertical direction) are searched, and a panoramic image is constructed based on the respective ranks in the shooting order for the image data. The horizontal array (number of columns a) of the image data to be obtained is obtained. Then, based on the number n of the image data Dpi, the vertical arrangement (number of rows b) is also obtained. Thereafter, the plurality of pieces of image data Dpi are combined while matching the connection between the adjacent image data in accordance with the photographing order so as to form an a × b array.

  For this reason, as in the first embodiment, the arrangement of the panoramic image can be connected to the arrangement of the image data without the operator having to specify the arrangement of the plurality of pieces of image data Dpi one by one. Automatically determined from gender. Therefore, the number of operations by the operator can be reduced and workability can be improved.

  As a first modification of the second embodiment, it is possible to obtain only the horizontal arrangement (number of columns a) and not the vertical arrangement (number of rows b). Even in this configuration, when images are combined, if the image data are sequentially connected from the upper left by the main shooting direction method described above, all image data can be combined without necessarily calculating the number of rows b. is there.

  Further, in the second embodiment, the arrangement is obtained based on the connection of the image data between the first row and the second row in the first column. The arrangement may be obtained based on the connection of the image data between the second row and the third row. Similarly, the configuration may be such that the connection between two adjacent image data in other locations in the first column is viewed, or the column can be replaced with another column.

3. Other embodiments:
The present invention is not limited to the first and second embodiments and modifications described above, and can be carried out in various modes without departing from the gist of the present invention. Various modifications are possible.

(1) In the first and second embodiments, as a precondition, the subject is photographed in the photographing order of the main photographing direction method described above, and a plurality of pieces of image data are connected in an order matching this order. Matching. FIG. 15 shows the connecting order. On the other hand, as another embodiment, the preconditions for photographing can be changed, and the order of joining image data can be changed variously as shown in FIG.

  In FIG. 16A, the images to be joined are sequentially moved from the upper left to the right, and when they reach the right end, they are moved one downward in the sub-shooting direction and moved from the right end to the left. In this way, it can also be set as the structure which joins in the order used as the meandering form of one stroke. Of course, as a precondition, the order in which the subject is photographed needs to be meandered so as to coincide with the joining order.

  In the first and second examples and the other embodiments described above, the main shooting direction is the horizontal direction. Alternatively, the main shooting direction can be the vertical direction. That is, as shown in FIG. 16B, the images to be joined are moved sequentially from the upper left to the lower direction, which is the main shooting direction, and when they reach the lower end, one image is moved to the right, which is the sub shooting direction. Similarly, it is also possible to adopt a configuration in which the images are connected in the order of moving sequentially from the upper end to the lower direction which is the main photographing direction.

  Also, as shown in FIG. 16C, the images to be joined are sequentially moved from the upper left to the lower direction, and when reaching the lower end, the image is moved one by one in the right direction, which is the sub-shooting direction, and the upper end from the lower end. It is also possible to connect them in a meandering order of moving in the direction. Note that in both the example of FIG. 16B and the example of FIG. 16C, it is necessary to match the order of photographing the subject with the order of joining.

(2) In the first and second embodiments and the modified examples, the photographing order recognition unit is configured to recognize the photographing order according to the “photographing date / time” data of the tag information attached to each image data. However, instead of this, a configuration may be adopted in which the order of photographing is recognized in accordance with the data file name corresponding to the order in which the digital camera 26 is stored in the storage medium. Also, the data indicating the shooting order is configured to be stored in the memory 13, but instead of storing the shooting order data in the memory 13, the image data is read from the storage medium one by one. It is also possible to adopt a configuration in which image data to be read is determined by recognizing the shooting order by looking at the “shooting date / time” data attached to each image data.

(3) In the above embodiment, the image data Dpi used for creating the panoramic image is taken by the digital camera 26, but instead of this, an image of a silver salt photograph obtained by using a color scanner or the like. It may be data. In short, any configuration may be used as long as a captured image obtained by capturing with some imaging device (for example, a video camera having a still image capturing function) is acquired. For example, instead of a device prepared in advance in a storage device such as the HDD 15, a device imported from the outside via a network may be used. Further, it is not always necessary to use color image data, and can be applied to monochrome image data.

  The following configuration can also be disclosed as a reference example of the present invention. In other words, this configuration detects a connection possibility of both image data for all combinations of two image data extracted from all the image data Dpi used for creating a panoramic image, and has a high connection possibility. By connecting them together, they are finally combined into the correct arrangement to create a panoramic image. According to this configuration, a panoramic image can be automatically created from a plurality of image data by using a high-speed computer device. In contrast, in the first and second embodiments and modifications of the present invention described above, a panoramic image can be created by a simple operation even with a personal computer that is widely used in the home.

It is explanatory drawing which shows schematic structure of the computer system to which 1st Example of this invention is applied. It is explanatory drawing which shows an example of the some picked-up image P1-P6 image | photographed with the digital camera. It is a flowchart which shows the whole flow of the control processing according to a computer program. It is explanatory drawing which shows the application window WD. It is a flowchart which shows the first half part of a panoramic image composition process. It is a flowchart which shows the latter half part of a panoramic image synthetic | combination process. It is explanatory drawing which shows the list of the candidate arrangement | sequences which can be taken when the number n of image data Dpi is 6. FIG. It is a flowchart which shows the detail of a normal sequence determination process. It is explanatory drawing which shows dialog box DB1 for a synthetic | combination process. It is explanatory drawing which shows an example of the mark MK which shows that the joining between two image data was impossible. It is explanatory drawing which shows dialog box DB2 for a feature point designation | designated. It is explanatory drawing which shows dialog box DB1 for a synthetic | combination process which displays the panoramic image obtained by synthesize | combining. It is a flowchart which shows the detail of the panoramic image synthetic | combination process in 2nd Example. It is explanatory drawing which shows the content of the said panoramic image composition process. It is explanatory drawing which shows the order of the joining of the image data in 1st, 2nd Example. It is explanatory drawing which shows the order of the joining of the image data in other embodiment.

Explanation of symbols

10 ... Personal computer 11 ... CPU
12 ... Bus 13 ... Memory 14 ... Display image memory 15 ... Hard disk drive 16 ... Input control unit 17 ... Display control unit 18 ... Output control unit 20 ... Display 22 ... Keyboard 24 ... Mouse 26 ... Digital camera 28 ... CD drive 29 ... Printer 31 ... Image capture unit 32 ... Shooting sequence recognition unit 33 ... Image count counting unit 34 ... Candidate sequence calculation unit 35 ... Determination unit 36 ... Image composition unit Dp1-Dp6 ... Image data M ... Candidate sequence MM ... Normal sequence Pr ... Computer program S .. Connection possibility WD ... Application window DB1 ... Dialog box for composition processing FD1 ... Sequence display field FD2 ... Composition result display field BT21 ... [Create] button BT22 ... [End] Button BT23 ... [Feature Point] button DB2 ... Special Dialog box for specifying points

Claims (14)

Create a panoramic image by combining multiple images taken by moving the shooting range while moving the shooting range in either the vertical or horizontal direction so that part of the image overlaps A panoramic image synthesizing device,
Image capturing means for capturing the plurality of image data;
Photographing order recognition means for recognizing the photographing order of the plurality of image data;
Image number counting means for counting the number of the plurality of image data;
Candidate sequence calculation means for obtaining a sequence of image data that can be taken by the number obtained by the image count counting means as a candidate sequence;
Whether or not the plurality of image data captured by the image capturing unit is combined into the shape of each candidate array in accordance with the order of capturing is determined in a direction on the side different from the main capturing direction in the vertical and horizontal directions. Determination means for determining from the connection possibility of two adjacent image data;
The candidate sequence determined to be correct by the determination unit is determined as a normal sequence constituting the panoramic image, and a plurality of pieces of image data captured by the image capture unit are arranged in the normal sequence. A panoramic image synthesizing apparatus comprising: an image synthesizing unit that synthesizes the adjacent image data in accordance with a shooting order. The panoramic image synthesis device according to claim 1,
The image composition means includes
A plurality of pieces of image data captured by the image capturing means, arranged in accordance with the order of the photographing so as to be the regular array, and displayed on a display device;
An execution command means for commanding execution of creation of a panoramic image in response to an operation command from an operator;
A panoramic image synthesizing device comprising: a unit that executes the synthesis when an execution command is issued by the execution command unit. The panoramic image synthesis device according to claim 1,
The image composition means includes
A plurality of pieces of image data captured by the image capturing means, arranged in accordance with the order of the photographing so as to be the regular array, and displayed on a display device;
A joining determination unit that determines whether joining is possible between adjacent image data when performing the composition;
When it is determined by the splicing determination means that there is an image data that cannot be spliced, it is determined that the splicing in the arrangement of the image data displayed by the normal arrangement display means is impossible. A panoramic image synthesizing apparatus comprising: error mark display means for displaying a mark indicating that joining is impossible between the image data. A panoramic image synthesis device according to any one of claims 1 to 3,
The photographing order recognizing unit is configured to recognize a photographing order based on photographing date and time data attached to the image data.
Panorama image composition device. A panoramic image synthesis device according to any one of claims 1 to 3,
The photographing order recognizing means is configured to recognize a data file name corresponding to the order in which image data is stored in the photographing device that performs the photographing.
Panorama image composition device. Create a panoramic image by combining multiple images taken by moving the shooting range while moving the shooting range in either the vertical or horizontal direction so that part of the image overlaps A panoramic image synthesizing device,
Image capturing means for capturing the plurality of image data;
Photographing order recognition means for recognizing the photographing order of the plurality of image data;
From the plurality of image data, two image data that are legitimately connected in a direction different from the main shooting direction of the vertical and horizontal directions are searched, and the shooting of the two image data is performed. An image arrangement calculation means for obtaining an arrangement of image data constituting the panoramic image based on the order;
A plurality of image data captured by the image capturing means are combined in accordance with the order of photographing so as to align adjacent image data so as to be an array of image data obtained by the image array calculating means. And a panoramic image synthesizing device. The panoramic image synthesis device according to claim 6,
Image number counting means for counting the number of the plurality of image data,
The image arrangement calculating means includes
In addition to the shooting order for the two image data, the arrangement is for obtaining an array of image data constituting the panoramic image based on the number of image data obtained by the image number counting means.
Panorama image composition device. Create a panoramic image by combining multiple images taken by moving the shooting range while moving the shooting range in either the vertical or horizontal direction so that part of the image overlaps Panoramic image composition method,
(A) a step of capturing the plurality of image data;
(B) a step of recognizing the shooting order of the plurality of image data;
(C) a step of counting the number of the plurality of image data;
(D) a step of obtaining a sequence of image data that can be taken in the number obtained in the step (c) as a candidate sequence;
(E) The side when the plurality of image data captured in the step (a) is combined with the shape of each candidate array in accordance with the order of photographing, and whether the main photographing direction is different from the vertical and horizontal directions. A step of judging from the connectability of two adjacent image data in the direction of
(F) The candidate array determined to be correct in the process (e) is determined as a normal array constituting the panoramic image, and a plurality of image data captured in the process (a) is defined as the normal array. As described above, a panoramic image synthesizing method comprising: a step of synthesizing the adjacent image data while matching them according to the order of photographing. Create a panoramic image by combining multiple images taken by moving the shooting range while moving the shooting range in either the vertical or horizontal direction so that part of the image overlaps Panoramic image composition method,
(A) a step of capturing the plurality of image data;
(B) a step of recognizing the shooting order of the plurality of image data;
(C) Searching for two image data that are legitimately connected in the direction different from the main shooting direction of the vertical and horizontal from the plurality of image data, A step of obtaining an array of image data constituting the panoramic image based on the order of photographing;
(D) A plurality of image data captured in the step (a) are aligned according to the shooting order so that a plurality of image data are arranged in the image data obtained in the step (c). A panoramic image synthesis method comprising: Create a panoramic image by combining multiple images taken by moving the shooting range while moving the shooting range in either the vertical or horizontal direction so that part of the image overlaps A computer program for
(A) a function of capturing the plurality of image data;
(B) a function of recognizing the shooting order of the plurality of image data;
(C) a function of counting the number of the plurality of image data;
(D) a function for obtaining, as a candidate sequence, an array of image data that can be obtained in the number obtained by the function (c);
(E) The right or wrong when the plurality of image data captured by the function (a) are combined into the shape of each candidate sequence according to the order of photographing is different from the main photographing direction in the vertical and horizontal directions. A function of judging from the connectability of two adjacent image data in the direction of
(F) The candidate sequence determined to be correct by the function (e) is determined as a normal sequence constituting the panoramic image, and a plurality of image data captured by the function (a) is defined as the normal sequence. Thus, a computer program for causing a computer to realize a function of synthesizing while joining together adjacent image data in accordance with the order of photographing. A computer program according to claim 10,
The function (f) is
(F-1) a function of arranging a plurality of image data captured by the function (a) according to the order of photographing so as to be in the normal arrangement and displaying on the display device;
(F-2) a function of instructing execution of creation of a panoramic image in response to an operation command from an operator;
(F-3) A computer program comprising a function for executing the synthesis when an execution instruction is given in (f-2). A computer program according to claim 10,
The function (f) is
(F-1) a function of arranging a plurality of image data captured by the function (a) according to the order of photographing so as to be in the normal arrangement and displaying on the display device;
(F-2) a function for determining whether or not it is possible to connect adjacent image data when executing the synthesis;
(F-3) When it is determined by the function (f-2) that there is an image data that cannot be joined, the joining in the arrangement of the image data displayed by the above (f-1) A computer program comprising a function of displaying a mark indicating that stitching is impossible between image data determined to be impossible. Create a panoramic image by combining multiple images taken by moving the shooting range while moving the shooting range in either the vertical or horizontal direction so that part of the image overlaps A computer program for
(A) a function of capturing the plurality of image data;
(B) a function of recognizing the shooting order of the plurality of image data;
(C) Searching for two image data that are legitimately connected in the direction different from the main shooting direction of the vertical and horizontal from the plurality of image data, A function for obtaining an array of image data constituting the panoramic image based on the shooting order;
(D) A plurality of image data captured by the function (a) are aligned according to the shooting order so that the plurality of image data is arranged in the image data obtained by the function (c). A computer program that allows a computer to realize the function of combining them.   A computer-readable recording medium on which the computer program according to any one of claims 10 to 13 is recorded.

Images