JP2004297339A - Method and program for image display - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image display method and an image display program capable of recognizing easily an object to be photographed for a display image. <P>SOLUTION: When a photographed image is displayed, image information to be displayed is obtained (step 101), the photographed image based on photographed image data contained in the image information is displayed (step 102). Then, map data of an area including a photographed location indicated by photographed location information contained in the retrieved image information is searched (step 103), and corresponding map data are read (step 105). At a step 106, the retrieved map data are rotated so that a photographed direction indicated by photographed direction information contained in the image information is set to a predetermined direction on a display screen, and map display data are generated. At a step 107, display data indicating the photographed location based on the photographed location information are generated to be synthesized with the map display data, and a map image is displayed based on the synthesized map display data. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an image display method and an image display program for displaying a captured image.
[0002]
[Prior art]
Image data captured by a digital camera is often recorded in the Exif format. In the Exif format, it is possible to record shooting condition information, GPS information, and the like of the shot image data in the Tag format as attached information together with the shot image data. The shooting condition information includes subject distance as well as shutter speed, aperture value, luminance value, light source type, strobe state, and the like. Further, the GPS information includes altitude information of the shooting position and shooting direction in addition to the longitude and latitude information of the shooting position.
[0003]
Attached information recorded in association with captured image data is used for various purposes. Patent Document 1 describes a technique used for reproducing captured images and managing captured image data.
[0004]
The technique described in Patent Document 1 displays an electronic map including a shooting position when reproducing a shot image registered in an album, and displays a shooting location and a shooting time on the electronic map based on GPS information. To display. In addition, a marker indicating the shooting location is superimposed and displayed near the shooting position of the map information based on the GPS information of the shooting image data included in the album. According to this technology, it is possible to easily recognize the shooting location of each captured image recorded by the camera connected to the GPS device on the electronic map. Also, it is possible to manage captured image data according to the shooting location.
[0005]
On the other hand, Patent Document 2 describes a technique in which imaging position information and imaging orientation information are recorded together with image information, and a position direction indicating the imaging position and imaging orientation is displayed when the recorded image information is displayed. ing. The technique described in Patent Literature 2 is formed based on the acquired map information based on the imaging position information and the imaging direction information, when acquiring the map information based on the imaging position information when displaying the position direction. A position / direction display indicating an imaging position and an imaging orientation on a map is generated and synthesized on the map.
[0006]
[Patent Document 1]
Japanese Patent Laid-Open No. 10-233985 [Patent Document 2]
Japanese Patent Laid-Open No. 9-312825
[Problems to be solved by the invention]
However, although what is described in Patent Document 1 can easily grasp the photographing position, it is difficult to recognize the photographing object from the map. Moreover, although what was described in patent document 2 can recognize a photographing position and a photographing direction easily, it is not always easy to recognize a photographing target from a map.
[0008]
The present invention has been made in view of the above circumstances, and an object thereof is to provide an image display method and an image display program capable of easily recognizing a subject to be captured of a display image.
[0009]
[Means for Solving the Problems]
The image display method of the present invention is an image display method for displaying a photographed image, the step of obtaining photographed image data, photographing position information and photographing direction information of the photographed image data, and the obtained photographing position information. A map data acquisition step of acquiring map data of an area including the shooting position indicated by the map, and map display data in which the shooting direction indicated by the shooting direction information is a predetermined direction on a display screen, the shooting direction information and the map data A map display data generation step that is generated based on the shooting position information; a combining step that generates display data indicating a shooting position based on the shooting position information and combines it with the map map display data; and a shot image based on the shot image data; And an image display step for displaying a map image based on the map display data obtained in the synthesis step. According to such a display method, since the shooting direction is a fixed direction on the map display screen, the direction in which the shooting target exists can be quickly grasped, and the shooting target can be easily recognized.
[0010]
The image display method of the present invention includes one in which the display data generated in the combining step indicates a shooting position based on the shooting position information and a shooting direction based on the shooting direction information. According to such a display method, since the shooting direction is indicated on the map display screen, the direction in which the shooting target exists can be grasped more quickly, and the shooting target can be easily recognized.
[0011]
The image display method of the present invention includes the display data in which the display data is display data obtained by adding a line facing the shooting direction to the display data indicating the shooting position.
[0012]
The image display method of the present invention includes a method in which the predetermined direction in the map display data generation step is an upward direction of a display screen.
[0013]
The image display method of the present invention is an image display method for displaying a photographed image, the method comprising: obtaining photographed image data, and photographing position information, photographing direction information, and subject distance information of the photographed image data; Map data acquisition step for acquiring map data of an area including the shooting position indicated by the acquired shooting position information, and map display data generation for generating map display data for displaying a map on the display screen based on the map data Generating display data indicating a step, a shooting position based on the shooting position information, and a shooting position information, shooting direction information, and subject position based on the subject distance information, and combining the generated map data with the map display data A captured image based on the captured image data, and a map image based on the map display data obtained in the combining step. And a Shimesuru image display step. According to such a display method, since the shooting position and the subject position are shown on the map display screen, it is possible to easily recognize the shooting target.
[0014]
The image display method of the present invention includes a method in which the display data generated in the combining step is data for displaying an arrow starting from the photographing position and ending at the subject position. According to such a display method, since the shooting direction is shown together with the subject position on the map display screen, the shooting target can be recognized more easily.
[0015]
In the image display method of the present invention, the map display data generation step is configured to generate map display data in which the shooting direction indicated by the shooting direction information is a predetermined direction on a display screen based on the shooting direction information and the map data. Includes what is to be generated. According to such a display method, according to such a display method, since the shooting direction shown together with the subject position on the map display screen is a fixed direction on the map display screen, the direction in which the shooting target exists is changed. It is possible to grasp quickly and to recognize the photographing target more easily.
[0016]
The image display method of the present invention includes a method in which the predetermined direction in the map display data generation step is an upward direction of a display screen.
[0017]
The program of the present invention is a program for executing each step included in the above-described image display method using a computer.
[0018]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 6 is a diagram showing a schematic configuration of an image processing apparatus that implements the image display method of the present invention. 6 includes an input / output interface 1, a control unit 2, a storage unit 3, a display unit 4, and an operation unit 5. The control unit 2 includes a partial image extraction processing unit 21 and a conversion processing unit 22.
[0019]
The input / output interface 1 performs input / output of various data including input of image information and map information used for displaying captured images, and is connected to a recording medium drive device, a communication control unit, and the like (not shown). The input image information is usually stored in a recording medium such as a memory card of a digital camera in the Exif format, stored directly from the recording medium or in another external storage device, and then input to the image processing apparatus. Reading of image information from the recording medium may be performed by connecting the media taken out from the digital camera to the media interface connected to the input / output interface 1, or by connecting the digital camera with a predetermined cable. It may be performed while attached to. FIG. 7 shows a schematic diagram of an example of a format of image information.
[0020]
The image information input to the image processing apparatus includes photographed image data and image attached information, and the image attached information includes at least photographing position information and photographing direction information of the photographed image data. The image ancillary information may further include subject distance information indicating the distance from the shooting position to the subject. The format of the image information is not limited to the Exif format as long as it includes at least shooting position information and shooting direction information of the shot image data as the image attached information. Further, image attached information such as shooting position information may be recorded as a separate file as long as it can be associated with shot image data.
[0021]
The shooting position information can be acquired by using a GPS module built in the digital camera or an externally provided GPS module at the time of shooting and recorded in association with the shot image data. Further, the shooting direction information can be acquired by using an electronic compass built in the digital camera at the time of shooting and recorded in association with the shot image data. Furthermore, the subject distance information obtained from a distance measuring sensor built in the digital camera and recorded in association with the photographed image data can be used. Note that the shooting position information may be manually added to image information taken out from the digital camera.
[0022]
The control unit 2 controls the entire data image processing apparatus including display processing of a captured image based on the captured image data included in the image information and a map image of an area including the captured position of the image based on the image information and the map data. Is to do. Details of the display process will be described later.
[0023]
The storage unit 3 stores various data including image information and map data input via the input / output interface 1.
[0024]
The display unit 4 displays a captured image and a map image of an area including the shooting position of the image. Also, various information necessary for the operation of the image processing apparatus is displayed.
[0025]
The operation unit 5 inputs various operation signals when using the image processing apparatus, in addition to an operation including an instruction to display a captured image and selection of an image to be displayed.
[0026]
6 can be realized by installing a predetermined program in a computer such as a personal computer. However, the computer for realizing the image processing apparatus is not limited to a stand-alone type and is a client computer connected to a server computer. It may be. When using a server computer, map data is stored in the server computer, and map data of an area necessary for displaying a captured image is acquired. Furthermore, you may make it perform all or one part of the production | generation process of the map display data mentioned later by a server computer.
[0027]
Next, processing when displaying a captured image based on captured image data using the image processing apparatus shown in FIG. 6 will be described. In the storage unit 3 of the image processing apparatus, image information and map data stored in the Exif format are stored in advance. The stored image information includes shooting image data, shooting position information (longitude / latitude information obtained from the GPS module), shooting direction information (direction information obtained from the electronic compass), and a different file for each shot image. Remembered by name.
[0028]
FIG. 1 is a diagram illustrating a schematic flow of an example of display processing of captured image information. When displaying a captured image, image information to be displayed is acquired (step 101). That is, the selected specific image information is read from the storage unit 3 to the control unit 2. Selection of image information to be displayed is performed by operating the operation unit 5. When thumbnail data is included in the image information stored in the storage unit, it is possible to display an image based on the thumbnail data and perform a selection operation.
[0029]
When specific image information in the image information stored in the storage unit 3 is read, the control unit 2 displays a captured image based on the captured image data included in the image information (step 102).
[0030]
Next, the map data of the area including the shooting position indicated by the shooting position information included in the read image information is searched (step 103). For example, when the shooting position information is longitude and latitude information of the shooting position, it is searched whether or not map data of a point corresponding to the longitude and latitude is stored in the storage unit 3. The presence or absence of the corresponding map data is determined in step 104, and if it exists, the corresponding map data is acquired (step 105). Acquisition of map data is performed by reading from the storage unit 3 map data in a range that takes into account the size of the map displayed on the display unit 4. As will be described later, map rotation is performed, and the range of map data to be read is determined in consideration of placing the photographing position in the center of the display screen.
[0031]
In step 106, the read map data is rotated according to the shooting direction indicated by the shooting direction information included in the image information. That is, the read map data is rotated so that the shooting direction is a predetermined direction on the display screen, and map display data is generated. The direction in which the shooting direction is set on the display screen is arbitrary. For example, if the shooting direction is set to the upper side of the display screen, the recognition of the shooting direction and the imaging target can be easily performed. Various methods proposed in the map image display process in the navigation system can be used for the map data rotation process.
[0032]
In step 107, display data indicating the shooting position based on the shooting position information is generated and combined with the map display data, and a map image based on the combined map display data is displayed on the display unit 4. The display data indicating the shooting position may indicate not only the shooting position but also the shooting direction. As such display data, for example, display data obtained by adding a line facing the shooting direction to display data indicating the shooting position can be used. The line indicating this direction may be an arrow. Note that the display area is an area where the shooting position is substantially at the center of the display screen.
[0033]
If it is determined in step 104 that the corresponding map data does not exist, a display indicating that the corresponding map data does not exist is displayed in step 108. Note that. In the flow of FIG. 1, the display indicating that the map image or the map data does not exist is performed after the captured image is displayed. Further, after displaying the photographed image, the map image display processing may be performed when an instruction to display the map image is given from the operation unit.
[0034]
An example of a display screen displayed by the display process shown in FIG. 1 is shown in FIG. FIG. 2 is an example in which the upper part of the display screen is the shooting direction, the shooting position is indicated by a circle, and the shooting direction is indicated by an arrow. The display screen includes a captured image display area 21, a map display area 22, a file information display area 23, and a thumbnail display area 24. In FIG. 2, descriptions of the captured image and the map content are omitted.
[0035]
The captured image display area 21 displays a captured image based on the selected captured image data, and the map display area 22 displays a map image indicating a captured position. In the file information display area 23, the file name and shooting date of the selected image information are displayed. In the thumbnail display area 24, some thumbnail images are displayed based on the thumbnail data of the image information stored in the storage unit 3. The thumbnail image to be displayed can be changed by a button with arrows 24B and 24F. The displayed thumbnail image also serves as a selection button for a captured image to be displayed. FIG. 2 shows a state in which the image 1 is selected.
[0036]
Assuming that the shooting direction of the image 1 is the northwest direction, the map image displayed in the map display area 22 is an image in which the northwest direction is above the display screen and the shooting position is substantially in the center of the display screen. (In FIG. 2, only the bearing symbol is shown.) A mark indicating the shooting position (indicated by a circle in FIG. 2) and a mark indicating the shooting direction (in the figure, an arrow) are displayed facing the top of the display screen so that the direction in which the shooting target exists can be quickly grasped It is possible to easily recognize the object to be photographed. The mark indicating the shooting direction is not limited to an arrow, and may be a simple line. Further, since the shooting direction is a fixed direction (upward in FIG. 2) on the map display screen, the mark indicating the shooting direction may be omitted. As shown in FIG. 2, the display of the captured image and the display of the map image are preferably performed by dividing the screen into the same display device. However, depending on the size of the display device, the display may be performed by switching the screen. Moreover, you may display a picked-up image and a map image on a some display apparatus, respectively.
[0037]
Next, display processing in a case where the image information stored in the storage unit 3 includes not only captured image data and shooting position information but also shooting direction information will be described. FIG. 3 is a diagram showing a schematic flow of display processing of photographed image information in that case.
[0038]
The image information to be displayed is acquired in step 301, the captured image based on the captured image data included in the image information is displayed in step 302, and the imaging position indicated by the imaging position information included in the image information read out in step 303 The processing for searching the map data of the area including “S” is the same as steps 101 to 103 in FIG.
[0039]
The presence / absence of the corresponding map data is determined in step 304, and if it exists, the corresponding map data acquisition process (step 305) is the same as steps 104 and 105 in FIG. Further, when it is determined in step 304 that the corresponding map data does not exist, the processing for displaying that the corresponding map data does not exist in step 308 is the same as step 108 in FIG.
[0040]
In step 306, the subject position is obtained based on the photographing position information, the photographing direction information, and the subject distance information. Next, in step 307, display data indicating the shooting position and subject position is generated, combined with the map display data based on the map data read in step 305, and a map image based on the combined map display data is displayed. Part 4 is displayed. As the display data indicating the shooting position and the subject position, arrow display data having the shooting position as a start point and the subject position as an end point can be used. A mark indicating the photographing position and a mark indicating the subject position may be combined. Similar to the case of FIG. 1, the map display area is an area in which the shooting position is substantially at the center of the display screen.
[0041]
When the display processing as described above is performed, the subject position is shown together with the photographing position on the map display screen, so that the photographing target can be easily recognized. Further, when generating the map display data based on the map data read in step 305, the map data is rotated in accordance with the shooting direction as in the display process of FIG. For example, you may make it produce | generate the map display data which becomes an upper direction on a display screen.
[0042]
Examples of display screens displayed by the display process shown in FIG. 3 are shown in FIGS. FIG. 4 shows an example in which the shooting position and the subject position are indicated by arrows with the top of the display screen being north, the shooting position being the start point, and the subject position being the end point. The display screen includes a captured image display area 41, a map display area 42, a file information display area 43, and a thumbnail display area 44. The information displayed in each area is almost the same as in FIG. 2, but the information displayed in the map display area 42 is different. In FIG. 4, the upper part of the display screen is fixed to the north, and the shooting position and the subject position are indicated by arrows 42X. Here, since the shooting direction of the image b is the south direction, the arrow 42X is arranged facing downward on the display screen.
[0043]
FIG. 5 is a display example when the map data is rotated according to the shooting direction so that the shooting direction is at the top of the display screen. In FIGS. 4 and 5, the description of the captured image and the contents of the map is omitted as in FIG.
[0044]
In the above description, what is stored in the storage unit 3 as captured image information to be displayed is used. However, image information is not recorded in the storage unit in advance, but directly from an external storage device or via a communication line. It may be used for reading and display. Similarly, map data for displaying a map may be read directly from an external storage device or via a communication line and used for display.
[0045]
【The invention's effect】
As is apparent from the above description, according to the present invention, it is possible to provide an image display method and an image display program capable of easily recognizing a photographing target of a display image.
[Brief description of the drawings]
FIG. 1 is a diagram showing a schematic flow of an example of display processing of photographed image information. FIG. 2 is a diagram showing an example of a display screen obtained by the display processing shown in FIG. FIG. 4 is a diagram showing an outline flow of the example of FIG. 4. FIG. 4 is a diagram showing an example of a display screen obtained by the display processing shown in FIG. 3. FIG. FIG. 7 is a diagram showing a schematic configuration of an image processing apparatus for carrying out the image display method of the invention. FIG. 7 is a diagram showing a schematic diagram of an example of a format of image information according to the invention.
DESCRIPTION OF SYMBOLS 1 ... Input / output interface 2 ... Control part 3 ... Memory | storage part 4 ... Display part 5 ... Operation part

Claims (9)

An image display method for displaying a captured image,
Acquiring captured image data and imaging position information and imaging direction information of the captured image data;
A map data acquisition step of acquiring map data of an area including a shooting position indicated by the acquired shooting position information;
A map display data generating step for generating map display data in which the shooting direction indicated by the shooting direction information is a predetermined direction on a display screen, based on the shooting direction information and the map data;
Generating display data indicating a shooting position based on the shooting position information, and combining with the map display data;
An image display method including an image display step of displaying a captured image based on the captured image data and a map image based on the map display data obtained in the combining step. The image display method according to claim 1,
The image display method, wherein the display data generated in the synthesizing step indicates a shooting position based on the shooting position information and a shooting direction based on the shooting direction information. The image display method according to claim 2,
The image display method, wherein the display data is display data obtained by adding a line facing the shooting direction to display data indicating the shooting position. The image display method according to any one of claims 1 to 3,
The image display method in which the predetermined direction in the map display data generation step is an upward direction of a display screen. An image display method for displaying a captured image,
Acquiring captured image data and imaging position information, imaging direction information, and subject distance information of the captured image data;
A map data acquisition step of acquiring map data of an area including a shooting position indicated by the acquired shooting position information;
A map display data generation step for generating map display data for displaying a map on the display screen based on the map data; and
Generating a display data indicating the shooting position based on the shooting position information, the shooting position information, the shooting direction information, and the subject position based on the subject distance information, and combining the generated map data with the map display data;
An image display method including an image display step of displaying a captured image based on the captured image data and a map image based on the map display data obtained in the combining step. The image display method according to claim 5,
The image display method, wherein the display data generated in the synthesizing step is data for displaying an arrow starting from the photographing position and ending at the subject position. The image display method according to claim 5 or 6,
The map display data generation step generates map display data in which the shooting direction indicated by the shooting direction information is a predetermined direction on a display screen based on the shooting direction information and the map data. . The image display method according to claim 7,
The image display method in which the predetermined direction in the map display data generation step is an upward direction of a display screen. The program for performing each step of any one of Claim 1 thru | or 8 using a computer.

Images