JP2003018638A - Information providing apparatus, information providing method, program thereof, communication terminal, and program thereof - Google Patents

Abstract

(57) [Summary] An object of the present invention is to enable a service for providing information related to various objects located in a direction designated by a communication terminal to the communication terminal. SOLUTION: From an image communication terminal 2, captured image data,
Upon receiving the photographing position data and the photographing azimuth data, the image guidance server 1 narrows down the object candidates located in the photographing azimuth direction based on the photographing position from the object information stored in the object DB 161. The narrowed-down object is compared with the object projected in the photographed image, and the object name and the position of the object having a high matching rate are set in the object DB1.
At the same time, a straight-line distance from the shooting position is calculated. Then, the image guidance server 1 transmits, to the image communication terminal 2 via the communication network N, data in which object information (object name, distance) is linked to each object position on the captured image.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information providing device for providing various information to a communication terminal connected via a network, an information providing method, a program therefor, a communication terminal for receiving various information from the information providing device, and Regarding the program.

[0002]

2. Description of the Related Art Recently, image communication terminals such as mobile phones with a camera function, which are capable of transmitting and receiving photographed image data, are becoming popular. In such an image communication terminal, a CCD (Charge Coupl) built in (or detachable from) the terminal.
ed Device) Image data captured by a camera,
It can be reproduced on the display unit or transmitted to another terminal.

[0003]

However, in the conventional image communication terminal as described above, there is no way to obtain information about various objects (buildings, etc.) displayed in the photographed image, so that the terminal user Has a problem that it is troublesome and time consuming because it is necessary to check information about a desired target object, a distance and a route from the current position to the target object with a map book or a guide book in hand.

An object of the present invention is to enable a service that provides the communication terminal with information relating to various objects located in the direction specified by the communication terminal.

[0005]

The present invention has the following features in order to solve such problems. In the following description of the means, the configuration corresponding to the embodiment will be illustrated by writing in parentheses. Reference numerals and the like are reference numerals and the like of the drawings described later.

The invention according to claim 1 provides an information providing device (for example, the image guide server shown in FIG. 1) for providing various information to a communication terminal (for example, the image communication terminal 2 shown in FIG. 1) connected via a network. 1), which is a storage unit (for example, the storage device 16 in FIG. 2 or the target object DB 161 in FIG. 3) that stores information about various objects located in various places, and a photographing device (for example, image communication in FIG. 1). A receiving unit (for example, the transmission control unit 14 of FIG. 2, step S1 of FIG. 5) that receives the photographing position data and the photographing direction data together with the image data photographed by the terminal 2) and the receiving unit. A specifying unit (for example, the CPU 11 in FIG. 2 and step S4 in FIG. 5) that specifies the object on the received captured image based on the shooting position and the shooting direction, and the specifying unit. Corresponding information acquisition means (for example, CPU 11 in FIG. 2, steps S6 and S7 in FIG. 5) for acquiring information corresponding to the selected object based on the object information stored in the storage means, and the correspondence information. Transmitting means (for example, the CPU 11 and the transmission control unit 14 in FIG. 2, step S in FIG. 5) for transmitting the correspondence information of each target object acquired by the acquiring means to the communication terminal owned by the user of the image capturing apparatus.
12) and are provided.

According to the first aspect of the present invention, the information providing apparatus includes the storage means, the receiving means, the specifying means, the correspondence information acquiring means, and the transmitting means, so that the user of the photographing apparatus can By providing the information regarding the object on the image captured by the image capturing device to the communication terminal that the user possesses, it is possible to provide a useful service to the user.

According to a sixth aspect of the invention, an information providing device (for example, the image guide server shown in FIG. 1) for providing various information to a communication terminal (for example, the image communication terminal 2 shown in FIG. 1) connected via a network. 1), which is a storage unit (for example, the storage device 16 in FIG. 2, the target object DB 161 in FIG. 3) that stores information about various objects located in various places, and the current position data and orientation of the communication terminal. A receiving means (for example, the transmission control unit 14 in FIG. 2, step S21 in FIG. 8) that receives data, and the object information stored in the storage means, based on the current position received by the receiving means. , Specifying means for specifying an object located in the azimuth direction (for example, CPU 11 in FIG. 2, step S2 in FIG. 8)
2) and object information acquisition means (for example, CPU in FIG. 2) that acquires information related to the object specified by the specifying means based on the object information stored in the storage means.
11, step S23 in FIG. 8) and transmitting means for transmitting the information on the object acquired by the object information acquiring means to the communication terminal (for example, the CPU 11 and the transmission control unit 14 in FIG. 2, in FIG. 8). And step S27).

According to the sixth aspect of the invention, the information providing apparatus includes the storage means, the receiving means, the specifying means, the object information obtaining means, and the transmitting means, so that the communication terminal can: By providing the information about the object located in the azimuth direction designated by the communication terminal user, it is possible to provide a useful service to the terminal user.

The invention according to claim 14 is an information providing device for providing various information (for example, the image guide server 1 in FIG. 1).
In a communication terminal (for example, the image communication terminal 2 in FIG. 1) connected via a network, a transmission unit (for example, the CPU 201 in FIG. 4) that transmits the current position data and orientation data of the own terminal to the information providing device. And the wireless communication control unit 205, step T23 in FIG. 9), and from the information providing apparatus, the image of each target object located in the azimuth direction based on the current position of the own terminal, and the target object. Receiving means (for example, the wireless communication control unit 205 in FIG. 4, step T24 in FIG. 9) for receiving information, and a display unit (for example, in FIG. 4) for displaying the image of each object and the related information received by the receiving means. Display control means (for example, CPU 201 in FIG. 4, step T2 in FIG. 9) displayed on the display unit 202)
6) and are provided.

According to the fourteenth aspect of the present invention, the communication terminal is provided with the transmitting means, the receiving means, and the display control means. The image information of various objects located in the azimuth direction based on the current position of the terminal itself and the related information thereof can be acquired by simply transmitting

[0012]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described in detail below with reference to the drawings. First, the configuration will be described.

FIG. 1 is a diagram conceptually showing the system configuration of an information providing system 10 to which the present invention is applied. As shown in FIG. 1, the information providing system 10 includes an image guide server 1 and each image communication terminal 2, and the image guide server 1 and each image communication terminal 2 are connected to each other via a communication network N such as the Internet. Connected via the station.

In FIG. 1, in order to simplify the description of the present embodiment, one image guide server 1 and 3 are provided.
Although a case is shown in which one image communication terminal 2 is connected to the communication network N, the number of these is not particularly limited.

FIG. 2 is a block diagram showing the internal structure of the image guide server 1 to which the present invention is applied. The image guidance server 1 is a server owned by the image guidance center, and is shown in FIG.
, The CPU 11, the display unit 12, the input unit 13,
The transmission control unit 14, the RAM 15, the storage device 16, and the recording medium 17 are provided, and each unit except the recording medium 17 is connected by a bus 18.

CPU (Central Processing Unit) 11
Reads various application programs stored in the storage device 16 and expands them in a program storage area (not shown) in the RAM 15, executes various processes based on these programs, and outputs the processing results to a work area (not shown) in the RAM 15. ) And temporarily displays it on the display unit 12. The CPU 11 further stores the processing result in the designated storage destination in the storage device 16 based on the instruction signal input from the input unit 13.

Specifically, when the CPU 11 receives the photographed image data, the current position data of the image communication terminal 2 and the bearing data from the image communication terminal 2, the CPU 11 reads out the photographing guidance processing program stored in the storage device 16. Then, based on the received data, a shooting guidance process is executed to acquire information about the object (building, etc.) displayed in the image and send it to the image communication terminal 2 (see FIG. 5).

When the current position data and orientation data of the image communication terminal 2 are received from the image communication terminal 2, the CPU 11 reads out the orientation guidance processing program stored in the storage device 16 and based on the received data. , Azimuth guidance processing of acquiring an image of an object existing in the azimuth and information about the object and transmitting the information to the image communication terminal 2 (see FIG. 8).

The display unit 12 is a CRT (Cathode Ray Tub).
e), LCD (Liquid Crystal Display), etc., and performs a required display according to a display signal input from the CPU 11.

The input unit 13 is equipped with a keyboard, a mouse, etc., and sends a key depression signal and a mouse operation signal to the CPU.
Output to 11.

The transmission controller 14 is a modem (MODEM:
MOdulator / DEModulator) or terminal adapter (T
erminal Adapter), telephone line, I
Control is performed to communicate with an external device via a communication line such as an SDN line. The modem modulates the digital data processed by the CPU 11 into an analog signal in the frequency band of the telephone line to communicate with an external device such as a personal computer via the telephone line, and also via the telephone line. It is a device for demodulating an analog signal input as a digital signal. The terminal adapter is
It is a device that converts an existing interface into an interface compatible with ISDN in order to communicate with an external device such as a personal computer via an ISDN line.

A RAM (Random Access Memory) 15 is
The processing programs and various application programs executed by the CPU 11 are expanded in a program storage area (not shown) in the RAM 15, and input instructions, input data, processing results generated when the processing programs are executed, etc. are illustrated. Not stored temporarily in the work area.

The storage device 16 is pre-stored with programs, data and the like, and has a structure including a recording medium 17 which can be read by the CPU 11, such as a magnetic or optical recording medium or a semiconductor memory. This recording medium 17 is C
It includes a portable medium such as a D-ROM and a memory card, and a fixed medium such as a hard disk. In addition, this recording medium 1
A part or all of the programs, data, etc. stored in 7 may be received from the transmission controller 14 via a network such as WAN or LAN from a server or a client, and the recording medium 17 may be a network. It may be a recording medium of the server or client constructed above.

The storage device 16 stores various application programs corresponding to the image guidance server 1, a shooting guidance processing program, a direction guidance processing program, data processed by each processing program, and the like.

The storage device 16 also stores a map DB (Data Base) (not shown) covering a wide area. This map DB stores two-dimensional plane map data of roads, buildings (objects), etc. in various places as viewed from above.

Further, the storage device 16 stores an object DB 161 as shown in FIG. This object DB16
1 is an “object name” 161a, a “position” 161b,
The “direction-specific image links (8 directions)” 161c are stored in association with each other, and as the “object name”, name data of each facility such as various facilities or stores and buildings that serve as landmarks is stored. The "position" stores absolute position (latitude, longitude) data corresponding to each object whose name is stored in the "object name", and the "direction-specific image link" stores each object. It stores the image link data when the object is viewed from 8 directions. Here, the eight directions mean north, northwest, west, southwest, south, southeast, east, and northeast, as shown in FIG. 3B.

FIG. 4 shows an image communication terminal 2 to which the present invention is applied.
3 is a block diagram showing the internal configuration of FIG. As shown in FIG. 4, the image communication terminal 2 includes a CPU 201, a display unit 202,
Input unit 203, camera unit 204, wireless communication control unit 20
5, RAM 206, storage device 207, recording medium 208,
The recording medium 2 including the GPS unit 209 and the direction sensor 210
Each unit except 08 is connected by a bus 211.

The CPU 201 stores a system program stored in the storage device 207 and a program designated from various application programs in a RAM.
The program is expanded in the program storage area in 206 and the input unit 20
3, according to the data input from the camera unit 204, the wireless communication control unit 205, the GPS unit 209, the azimuth sensor 210, etc., the processing according to the program is executed, and the processing result is temporarily stored in the work area of the RAM 206. It is also displayed on the display unit 202. The CPU 201 further stores the processing result in the storage destination instructed in the storage device 207 based on the instruction signal input from the input unit 203.

Specifically, the CPU 201 causes the image guide server 1 to transmit the captured image data, the current position data of the image communication terminal 2, and the orientation data, and the image guide server 1 acquires the image data based on these transmitted data. The photographing guide display process is executed to receive the photographed image data with the object information and the marked map image data from the image guide server 1 and display them on the display unit 202 (see FIG. 6).

Further, the CPU 201 causes the image guidance server 1 to transmit the current position data and orientation data of the image communication terminal 2, and the object existing in the orientation acquired by the image guidance server 1 based on these transmission data. A direction guidance display process is executed to receive image data of an object and data related to the object from the image guidance server 1 and display the data on the display unit 202 (see FIGS. 9 and 10).

The display unit 202 has a display screen such as an LCD, and performs a required display according to a display signal input from the CPU 201. 7 and 11 show examples of screen display on the display unit 202.

The input unit 203 is provided with various keys such as character keys and numeral keys, a shooting guide button 203a, a direction guide button 203b, and a distance dial 203c (see FIGS. 7 and 11). Operation signal to CPU2
Output to 01. In addition, the input unit 203 is a display unit 202.
The touch panel is provided so as to cover the touch panel, detects the touched coordinates according to the coordinate reading principle such as the electromagnetic induction type, the magnetostrictive type, and the pressure sensitive type, and outputs the detected coordinates as a position signal to the CPU 201.

The camera section 204 is composed of an optical lens made of glass or plastic and an optical sensor such as a CCD. The image inputted through the optical lens is converted into an electric signal by the optical sensor and output to the CPU 201.

The wireless communication control unit 205 executes a communication protocol for a (portable) image communication terminal with a wireless base station through an antenna, and performs data communication and the like through a set communication channel.

The RAM 206 expands the processing program and various application programs executed by the CPU 201 into a program storage area (not shown) in the RAM 206, and is generated when the input instruction, the input data, and the processing program are executed. The processing result and the like are temporarily stored in a work area (not shown). For example, the RAM 206 temporarily stores the image data transmitted from the image communication terminal 2 in the work area when the CPU 201 executes the shooting guidance process (see FIG. 5).

The storage device 207 is pre-stored with programs, data and the like, and has a structure including a recording medium 208 readable by the CPU 201, such as a magnetic or optical recording medium or a semiconductor memory. This recording medium 20
Reference numeral 8 includes a portable medium such as a CD-ROM and a memory card, and a fixed medium such as a hard disk. Further, some or all of the programs, data, and the like stored in this recording medium 208 are transferred from the server or client to the WAN,
Wireless communication control unit 20 via a network such as a LAN
5, the recording medium 20 may be received.
8 may be a recording medium of a server or a client constructed on the network.

The storage device 207 stores various application programs corresponding to the image communication terminal 2, a shooting guidance display processing program, a direction guidance display processing program, data processed by each processing program, and the like.

The GPS unit 209 uses a GPS antenna to transmit GPS from at least three GPS satellites among a plurality of GPS satellites launched into a low earth orbit.
A signal is received, and the absolute two-dimensional current position of the image communication terminal 2 is detected as GPS data (latitude, longitude) based on the received GPS signal.

The azimuth sensor 210 detects the geomagnetism and outputs the detected camera azimuth data of the image communication terminal 2 to the CPU 201.

Next, the operation of this embodiment will be described. 5, 6, and 8 to 10 are flowcharts for explaining the operation of the embodiment according to the present invention. Of these flowcharts, the flowcharts shown in FIGS. 5 and 8 are for explaining a program for causing a computer constituting the image guide server 1 to which the present invention is applied to realize each function. This program is CPU1
1 is stored in the recording medium 17 in the form of a readable program code, but it is not necessary to store all the functions in the recording medium 17, and some or all of them may be communicated as necessary. It may be realized by receiving from the transmission control unit 14 via the network N.

The flowcharts shown in FIGS. 6, 9 and 10 are for explaining a program for causing a computer constituting the image communication terminal 2 to which the present invention is applied to realize each function. This program is CPU2
Although 01 will be described as an example in which 01 is stored in the recording medium 208 in the form of a readable program code, it is not necessary to store all the functions in the recording medium 208, and some or all of them can be communicated as necessary. It may be realized by receiving from the wireless communication control unit 205 via the network N.

First, referring to the flowchart of FIG.
The shooting guidance processing executed in the image guidance server 1 will be described.

When the image data photographed by the image communication terminal 2, the current position data of the terminal 2 and the photographing direction (camera direction) data are received from the image communication terminal 2 (step S1), the CPU 11 causes the image communication terminal 2. Based on the current position of 2, the azimuth specified by the received azimuth data and the object candidate records located in the vicinity thereof are narrowed down from the object DB 161 (step S2).

Then, the CPU 11 cuts out all the object images such as buildings shown in the image from the photographed image data received in step S1 (step S3), and narrows down the object candidates from the object DB 161 in step S2. From the azimuth-specific image link (8 directions) 161c, an object image having an azimuth close to the specified azimuth is extracted. Then, the CPU 11 selects one of the object images cut out from the captured image in step S3 and the image link 1 for each direction.
The comparison and collation with each object image extracted from 61c is started (step S4).

In the comparison and collation of step S4, if there is an object having a high collation rate (step S5; YES), CP
U11 acquires the object name and absolute position of the object from the object DB 161 (step S6), and step S6.
From the current position data of the image communication terminal 2 received in 1 and the position data of the target object acquired in step S6, a straight line distance from the image communication terminal 2 to the target object is calculated (step S7). If there is no object with a high matching rate (step S
5; NO), the CPU 11 proceeds to step S9 described later.

Next, the CPU 11 links the object name acquired in step S6 and the straight line distance calculated in step S7 to the position of the corresponding object in the photographed image received in step S1 (step S8). .

Next, in step S3, the CPU 11 determines whether or not there is another object image cut out from the photographed image (step S9), and if there is another object image (step S9; YES). , CPU11 again
Each processing of steps S5 to S8 is repeated.

At step S3, if there is no other object image cut out from the photographed image (step S9; N).
O), the CPU 11 controls the map D stored in the storage device 16.
A map image including the current position of the image communication terminal 2 and the position of each object acquired in step S6 is extracted from B (step S10).

Then, the CPU 11 displays the current position of the image communication terminal 2 on the map image extracted in step S10.
Mark each of the above object positions (step S1
1), the photographed image data with the object information created in step S8 and the map image data with the mark created in step S11 are transmitted to the image communication terminal 2 (step S12), and the main photographing guidance process ends. To do.

Next, the photographing guidance display processing executed by the image communication terminal 2 corresponding to the photographing guidance processing by the image guidance server 1 will be described with reference to the flowchart of FIG.

The CPU 201 waits for the input of an operation signal from the photographing guide button 203a or the direction guide button 203b of the input unit 203 (step T1), and the operation signal is input (step T1; YES). If it is an operation signal for the shooting guidance button 203a (step T2;
(YES), shift to the shooting guidance mode, and wait for image data input from the camera unit 204.

When an operation signal is input from the direction guidance button 203b (step T2; NO, step T1).
8; YES), the CPU 201 shifts to azimuth guidance display processing (see FIGS. 9 and 10) described later, and when an operation signal other than the photographing guidance button 203a and the azimuth guidance button 203b is input (step T18; NO). ), And executes the process corresponding to the operation.

When an image is photographed by the camera section 204 in the photographing guidance mode (step T3), the CPU 201 causes the G
The current position data of the terminal itself is acquired from the PS unit 209 (step T4), and the camera azimuth data is acquired from the azimuth sensor 210 (step T5).

Next, the CPU 201 controls the camera section 204.
The captured image data acquired from the camera, the current position data acquired from the GPS unit 209, and the camera orientation data acquired from the orientation sensor 210 are transmitted to the image guidance server 1 (step T6), and a response from the image guidance server 1 is sent. To wait.

When the photographed image data with object information and the map image data with marks are received from the image guide server 1 (step T7), the CPU 201 first causes the display unit 202 to display the data as shown in FIG. 7 (a). Then, the captured image data with the object information is displayed (step T8), and a screen instruction (touch instruction) from the touch panel on the display screen is awaited (step T9).

If there is a screen instruction in step T9 (step T9: YES), and if the screen instruction indicates a certain object in the photographed image (step T10;
YES), the CPU 201 displays the object information (object name, linear distance from the current location) linked to the position of the object instructed on the screen at the object position (step T).
11). 7B, in the photographed image shown in FIG. 7A, the tower-shaped object on the right side of the screen is indicated on the screen, and as a result, the object information “ΔΔ tower, distance 2 km” is displayed at the object position. "Is displayed.

There is a screen instruction in step T9 (step T9: YES), and if the screen instruction is a "map" instruction for switching the display to the marked map image (step T12; YES, step T10; N).
O), the CPU 201 displays the marked map image received in step T7 on the display unit 202 according to the map instruction (step T13).

For example, in the photographed image with object information shown in FIGS. 7A and 7B, as a result of instructing the "map" displayed on the upper left of the screen, a map with a mark corresponding to this photographed image is displayed. An example in which an image is displayed is shown in FIG. 7C, and the positional relationship between the current position of the image communication terminal 2 and each object (○ × building, ΔΔ tower, mountain, etc.) located in the camera direction is shown. It is shown.

In step T9, if there is no screen instruction on the display screen (step T9; NO) and there is a button operation of the input unit 203 (step T17; YES), the CPU
The 201 returns to step T2, determines the type of the input operation signal, executes processing according to the operation signal, and if there is no button operation or screen instruction on the display screen (step T17; NO). , Returns to step T9, and waits for these instructions.

While the map image with the mark is displayed on the display unit 202, the CPU 201 waits for a screen instruction on the display screen (step T14) and switches the display from the map image with the mark to the photographed image with the object information. If there is an “image” instruction for instructing (step T14; YES, step T15; YES), the process returns to step T8 and the display unit 202
The captured image with the object information is displayed on.

If there is a button operation of the input section 203 (step T16; YES), the CPU 201 determines that the step T2.
Then, the type of the input operation signal is discriminated, the process according to the operation signal is executed, and if there is no button operation or "image" instruction on the display screen (step T16; NO, step T15; No) returns to step T14 and waits for these instructions.

Next, referring to the flowchart of FIG.
The direction guidance process executed by the image guidance server 1 will be described.

When there is a direction guidance request from the image communication terminal 2 and the current position data of the image communication terminal 2 and the camera direction data are received (step S21), the CPU 11
Uses the current position of the image communication terminal 2 as a reference, and narrows down from the object DB 161 the object candidate records located in the direction specified by the received direction data and in the vicinity thereof (step S22).

Next, the CPU 11 calculates the linear distance between the position of each object narrowed down in step S22 and the current position of the image communication terminal 2 (step S23), and the calculated linear distance is in ascending order (image The object records are sorted (sorted) in the order of distance from the communication terminal 2 (step S24), and the sorted object list is temporarily stored in the RAM 15.

Next, the CPU 11 executes step S24.
Then, among the object records sorted in ascending order of the straight line distance, the first 10 object records in the order of distance are specified (step S25), and the image link by direction corresponding to each of the specified objects ( From 8 directions) 161c, an object image having an orientation close to the orientation specified by the received orientation data is extracted (step S26). And
The CPU 11 transmits each object image data extracted in step S26 to the image communication terminal 2 together with the corresponding object name data and straight line distance data (step S2).
7).

Next, the CPU 11 confirms whether or not there is a next request from the image communication terminal 2 for requesting data transmission for the next 10 objects in the order of distance (step S2).
8). If there is a next request (step S28; YES), C
The PU 11 refers to the object list sorted in order of distance, which is temporarily stored in the RAM 15, and checks whether or not there is a next object record in order of distance (step S2).
9).

If there is a next object record in step S29 (step S29; YES), the CPU 11
Specify 10 object records in order of distance (step S
30), proceeding to step S26, the image of the specified object is extracted. If there is no next target record in step S29 (step S29; NO), the CPU 11
Returns to step S28 and waits for the next request from the image communication terminal 2.

In step S28, if there is no next request from the image communication terminal 2 (step S28; NO) and there is a previous request (step S31; YES), the CPU 11 causes the R
By referring to the object list temporarily stored in the AM 15, whether or not there is a previous object in the order of distance from the object data transmitted in step S27, that is, closer to the image communication terminal 2 side in terms of distance. It is confirmed whether or not there is an object (step S32).

In step S32, if there is an object preceding in order of distance from the object data transmitted in step S27 (step S32; YES), the CPU 11 selects the object in order of distance from these objects. 10 object records are designated (step S33), the process proceeds to step S26, and the image of the designated object is extracted.

After transmitting the object data in step S27,
If there is no next request or previous request from the image communication terminal 2 (step S28; NO, step S31; NO) and there is another direction guidance request (step S34; YES), CP
U11 returns to step S21 and waits for reception of the current position and azimuth data from the image communication terminal 2.

If there is no direction guidance request from the image communication terminal 2 (step S34; NO) and there is a termination request (step S35; YES), the CPU 11 terminates the main direction guidance processing and there is no termination request. , Return to step S28,
It waits for various requests from the image communication terminal 2.

Next, the azimuth guidance display process executed by the image communication terminal 2 corresponding to the azimuth guidance process by the image guidance server 1 will be described with reference to the flowchart of FIG.

When the "direction guide" button of the input unit 203 is operated (step T18 in FIG. 6; YES), the CPU 2
01 shifts to the azimuth guidance mode, acquires the current position data (latitude, longitude) of the image communication terminal 2 from the GPS unit 209 (step T21), and acquires the camera azimuth data from the azimuth sensor 210 (step T22). ), Transmits the acquired current position data and orientation data to the image guidance server 1 (step T23), and waits for a response from the image guidance server 1.

When the object image data and the corresponding object information data are received from the image guide server 1 (step T24), the CPU 201 associates the received image data of the object with the corresponding object information data. RAM attached
It is temporarily stored in 206 (step T25).

Then, the CPU 201 proceeds to step T25.
Then, the leading image data is read out from the data temporarily stored in the RAM 206, and the leading image and the correspondence information (object name, straight line distance) are displayed on the display unit 202 (step T26). An example of image display on the display unit 202 is shown in FIG. In this display example, "Name: XX building distance: 2.5 km" is displayed as the object information at the top of the screen.
Is displayed and "2.5 km" is displayed from the image communication terminal 2.
It indicates that there is an object whose name is "XX building" in the direction of the distant camera.

Further, at this time, the display section 202 is displayed as shown in FIG.
As shown in FIG. 1 (a), "Next" for instructing to display the next image, "Previous" for instructing to display the previous image, and "End" for instructing to end the direction guidance mode are displayed. CP
U201 waits for these screen instructions (step T).
27).

When "next" is instructed on the display screen (step T28; YES), the CPU 201 causes the RAM
By referring to the target object data stored in 206, it is confirmed whether or not there is target object (image) data corresponding to the image next to the currently displayed image (step T29). Step T29
If there is next data (step T29; YES), C
The PU 201 displays the next image and the correspondence information on the display unit 202 (step T30), moves to step T27, and waits for the next screen instruction.

At step T29, if there is no object (image) data corresponding to the image next to the currently displayed image (step T29; NO), the CPU 201 sends to the image guide server 1 the next 10 items in the order of distance. Data transmission for each object is requested (step T31), and a response from the image guide server 1 is waited for.

When "front" is designated on the display screen (step T32; YES), the CPU 201 causes the RAM
By referring to the object data stored in 206, it is confirmed whether or not there is object (image) data corresponding to the image currently displayed (step T33). Step T33
If there is previous data (step T33; YES), C
The PU 201 displays the previous image and the correspondence information on the display unit 202 (step T34), moves to step T27, and waits for the next screen instruction.

At step T33, if there is no corresponding object (image) data before the image currently being displayed (step T33; NO), the CPU 201 sends the previous 10 items in order of distance to the image guide server 1. Data transmission regarding each object is requested (step T35), and a response from the image guide server 1 is waited for.

When "End" is instructed on the display screen (step T36; YES), the CPU 201 requests the image guide server 1 to end the orientation guide process (step T37) and "End". Is not displayed on the screen (step T36; NO), the process proceeds to step T27 to wait for the screen instruction.

On the display screen, there is no screen instruction (step T27; NO), and the shooting guide button 203 of the input unit 203.
a or the direction guidance button 203b is pressed (step T38; YES, step T39; N).
O), the CPU 201 moves to step T2 in FIG.
When the distance dial 203c is operated (step T
39; YES), a distance dial 203 described later with reference to FIG.
The process shifts to the direction guidance process according to the operation of c.

A direction guidance screen is displayed on the display unit 202,
When the image communication terminal 2 is in the direction guidance mode, the CPU
201 is always the direction sensor 210, the image communication terminal 2
Camera orientation data has been acquired (step T4
0), the orientation data changes (step T41;
YES), the process returns to step T23, and the image guidance server 1
The current position data and the orientation data of the image communication terminal 2 are transmitted to.

While the azimuth data has not changed (step T41; NO), the CPU 201 proceeds to step T2.
The process moves to 7 and waits for a screen instruction on the display screen in the direction guidance mode. If the current position has not changed and only the camera azimuth data has changed, in step T23, only the newly acquired azimuth data is displayed on the image guide server 1.
May be sent to.

Next, with reference to FIG. 10, the direction guidance display process executed in the image communication terminal 2 when the distance dial operation is performed will be described.

When the distance dial 203c is operated while the azimuth guidance screen of the display unit 202 is being displayed (step T in FIG. 9).
39; YES), the CPU 201 obtains the straight line distance L between the object currently being image-displayed and the image communication terminal 2 (step T51), and the previous distance dial operation is a forward operation or a backward operation. Is confirmed (step T
52). Here, the forward operation refers to an operation of moving away from the image communication terminal 2, and the backward operation refers to an operation of reducing the distance from the image communication terminal 2.

If the operation of the distance dial is the forward operation (step T52; YES), the CPU 201 positively updates the linear distance L acquired in step T51 (step T53), and the object data temporarily stored in the RAM 206. By referring to (Image, Correspondence Information), it is confirmed whether or not there is a corresponding object image near the plus updated distance L (step T54).

If the operation of the distance dial is a backward operation (step T52; NO), the CPU 201 updates the linear distance L obtained in step T51 by minus (step T57), and the object data temporarily stored in the RAM 206. By referring to (image, correspondence information), it is confirmed whether or not there is a corresponding target image near the minus updated distance L (step T54).

At step T54, when the RAM 206 stores the object data corresponding to the vicinity of the distance L designated by the dial operation (step T54; YES),
The CPU 201 reads the corresponding object image data and the corresponding information data from the RAM 206, and displays the display unit 2
02 (step T55), and the distance dial 20
It waits for the continuous operation of 3c (step T56).

In step T54, even when there is no object data corresponding to the distance L designated by the dial operation in the RAM 206 (step T54; NO), the CPU 20
No. 1 is waiting for the operation of the distance dial 203c (step T56), and when the distance dial 203c is operated (step T56; YES), the process proceeds to step T52, and the operation is forward operation or backward operation. If the distance dial 203c is not operated (step T56; NO), a screen instruction from the display screen is awaited.

For example, assuming that the camera direction of the image communication terminal 2 is northeast, as shown in FIG. 11B, in the northeast direction, 2 km away from the image communication terminal, ΔΔ
It is assumed that the tower is located and the XX building is located 2.5 km away. At present, as shown in FIG. 11A, when the image of the XX building and the corresponding information "name: XX building distance: 2.5 km" are displayed on the display unit 202, the distance dial 203c is used to set the L When the backward operation is performed up to the position of = 2 km, the image of the △△ tower and the corresponding information "Name: △△ tower Distance:
2 km ”will be displayed.

As described above, according to the information providing system 10 of the present embodiment, the image communication terminal 2 receives, as data relating to the image taken from the image guide server 1,
By being able to download captured images with target information,
The terminal user can immediately grasp the information (object name, distance to the object) regarding each object displayed in the captured image. In addition, the image communication terminal 2 can further download the map image with the mark viewed from the sky in addition to the captured image with the object image from the image guide server 1, and thus, as shown in FIG. The positional relationship between the target object and each object can be easily confirmed.

Further, the image communication terminal 2 simply transmits the current position data of the terminal itself and the camera azimuth data to the image guide server 1, and the object image located in the camera azimuth,
Information such as the name of the target object and the linear distance from the terminal 2 can be downloaded from the image guide server 1 and displayed, so that not only the target object within the visual field of the terminal user but also each target object image outside the visual field and Correspondence information can be obtained. In this case, in particular, the image switching operation on the display screen is performed for each object image located in the camera direction and the corresponding information (“Next” in FIG.
By "before"), the images can be displayed in the order of distance from the image communication terminal 2, so that the terminal user can imagine the arrangement of the objects located outside the field of view. Further, when the distance dial 203c is used in the distance order display of the respective objects, the terminal user can roughly grasp the magnitude of the distance between the respective objects by the dial operation of the distance dial 203c.

The description contents in this embodiment are as follows.
Modifications can be made as appropriate without departing from the spirit of the present invention.
For example, in the present embodiment, the image guidance server 1
Indicates the position of the image communication terminal 2,
Although it is acquired by receiving the position data acquired from the unit 209, it may be acquired by using a PHS (Personal Handyphone System) position search service.

Further, in the present embodiment, the information about each object provided by the image guidance server 1 to the image communication terminal 2 is the object name and the linear distance between the image communication terminal 2 but the information is not limited to these. Alternatively, for example, information such as required time from the image communication terminal 2 to each object, route guidance, etc. may be added.

Further, in the present embodiment, the image guide server 1 responds to a target object information acquisition request from the image communication terminal 2 in response to the target object photographed image data, the marked map image data, the target object image data, Although the object information such as the correspondence information and the like is transmitted to the image communication terminal 2, another device (for example, a personal computer) owned by the user of the image communication terminal 2 or a device connected to the image communication terminal 2 or the like. May be sent to.

[0097]

According to the invention described in claims 1, 10, and 12, the information providing apparatus relates to the object on the image photographed by the photographing apparatus for the communication terminal owned by the user of the photographing apparatus. By providing information, it becomes possible to provide useful services to communication terminal users.

According to the second aspect of the invention, in addition to the effect of the first aspect of the invention, the information providing device has the photographing position and the position of each object on the photographed image with respect to the communication terminal. By acquiring the related information, the communication terminal user can grasp the positional relationship between the imaging device and each object.

According to the invention of claim 3, claim 1,
In addition to the effect of the invention described in 2, the information providing apparatus extracts the candidate of the target object existing in the shooting azimuth direction based on the received shooting position, and extracts the extracted image of the target object and the image on the shot image. By comparing with the image of the target object, it becomes easy to specify the target object on the captured image.

According to the invention described in claim 4,
In addition to the effect of the invention described in 3, the information providing device provides the communication terminal with information by linking corresponding information to the image position of each object on the captured image, thereby allowing the communication terminal user Can easily obtain the object information on the captured image.

According to the invention of claim 5, claim 1
In addition to the effects of the invention described in 4, the information providing apparatus provides the communication terminal with the map image information in which the shooting position and the position of each object are marked, so that the communication terminal user can use the image capturing apparatus. The positional relationship of each object can be visually grasped.

According to the sixth, eleventh and thirteenth aspects of the present invention, the information providing apparatus provides the communication terminal with the information regarding the object located in the azimuth direction designated by the communication terminal user. A useful service can be provided to the communication terminal user.

According to the invention described in claim 7, in addition to the effect of the invention described in claim 6, the information providing apparatus causes the communication terminal to target the object located in the azimuth direction designated by the communication terminal user. By being able to provide images, communication terminal users can
Images of objects outside the field of view as well as objects within the field of view can be obtained.

According to the invention of claim 8, claim 6,
In addition to the effects of the invention described in 7, the information communication terminal can provide the communication terminal with the distance information between the object located in the azimuth and direction designated by the communication terminal user, and the communication terminal user. Can grasp the positional relationship between the communication terminal and each object.

According to the invention described in claim 9, claims 6 to
In addition to the effect of the invention described in 8, the communication terminal user can sort the images of the objects located in the azimuth direction specified by the communication terminal user in order of distance from the communication terminal and provide the communication terminal with each communication terminal user. The arrangement of the object can be grasped.

According to the fourteenth and eighteenth aspects of the present invention, the communication terminal only transmits the current position and azimuth data to the information providing device, and the information providing device determines the current position of the own terminal as a reference. It is possible to easily acquire image information of various objects located in the azimuth direction and related information thereof.

According to the inventions of claims 15 and 16,
In addition to the effect of the invention according to claim 14, the communication terminal displays the object images in the order of the distance between each object and its own terminal, so that the communication terminal user can communicate with the communication terminal and each object. The positional relationship can be grasped and the arrangement of each object inside and outside the visual field can be imaged.

According to the invention of claim 17, claim 1
In addition to the effects of the invention described in 4, when the azimuth changes, the communication terminal can immediately acquire the object information located in the changed azimuth direction from the information communication terminal.

[Brief description of drawings]

FIG. 1 is a diagram showing a schematic configuration of an information providing system 10 to which the present invention is applied.

FIG. 2 is a block diagram showing an internal configuration of the image guide server 1 of FIG.

FIG. 3 is an object DB 16 stored in a storage device 16.
1 is a diagram showing the configuration of FIG. 1 (FIG. 3A) and a diagram for explaining 8 orientations (FIG. 2B).

4 is a block diagram showing an internal configuration of the image communication terminal 2 of FIG.

FIG. 5 is a flowchart showing a shooting guidance process executed in the image guidance server 1.

FIG. 6 is a flowchart showing a shooting guidance display process executed in the image communication terminal 2.

FIG. 7 is a diagram showing an example of a screen display in the shooting guidance display processing of FIG.

FIG. 8 is a flowchart showing direction guidance processing executed in the image guidance server 1.

FIG. 9 is a flowchart showing a direction guidance display process executed in the image communication terminal 2.

FIG. 10 is a flowchart showing azimuth guidance display processing executed in the image communication terminal 2 according to an operation of a distance dial.

11 is a diagram showing an example of a screen display in the direction guidance display processing of FIGS. 9 and 10 (FIG. 11A), and a diagram showing the positional relationship between the current location and various objects (FIG. 11B). is there.

[Explanation of symbols]

1 Image guidance server 11,201 CPU 12,202 Display 13 Input section 14 Transmission control unit 15,206 RAM 16,207 Storage device 161a Object name Position 161b 161c Image link by direction (8 directions) 17,208 recording medium 2 Image communication terminal 203 Input section 203a shooting guide button 203b Direction guidance button 203c distance dial 204 camera section 205 wireless communication control unit 209 GPS section 210 orientation sensor 10 Information provision system N communication network

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) G06F 17/30 230 G06F 17/60 326 17/60 326 336 336 506 506 H04Q 7/04 Z

Claims (18)

[Claims] 1. An information providing device for providing various kinds of information to a communication terminal connected via a network, and a storage means for storing information on various objects located in various places, and an image taking device. Receiving means for receiving the photographing position data and the photographing direction data together with the image data, and the object on the received photographed image is specified based on the photographing position and the photographing direction received by the receiving means. Identifying means, information corresponding to the object identified by the identifying means, corresponding information obtaining means for obtaining based on the object information stored in the storage means, each obtained by the corresponding information obtaining means An information providing apparatus, comprising: a transmission unit that transmits correspondence information of an object to a communication terminal owned by a user of the image capturing apparatus. 2. The object information stored in the storage means is:
The correspondence information acquisition unit includes position information of an object, and the correspondence information acquisition unit acquires the imaging position and position-related information of the object specified by the specifying unit based on the position information stored in the storage unit. The information providing apparatus according to claim 1, wherein: 3. The object information stored in the storage means is:
Image information of each target is further included, and from the position information of each target stored in the storage unit, a candidate for the target existing in the shooting direction is extracted based on the shooting position received by the receiving unit. Further comprising: an object candidate extracting means for extracting the image of each object extracted by the object candidate extracting means from the image information stored in the storage means, and each extracted object Image of
The information providing apparatus according to claim 1, wherein the object on the captured image is specified by comparing the captured image received by the receiving unit. 4. A linking means for linking the information corresponding to each object acquired by said correspondence information acquiring means to the image position of the corresponding object on the photographed image received by said receiving means. The information providing apparatus according to any one of claims 1 to 3, wherein the transmitting unit transmits the captured image to which the correspondence information of each object is linked by the linking unit. 5. The storage means further stores map image information of each place, and the map position information stored in the storage means indicates the photographing position and the position of each object specified by the specifying means. Image extracting means for extracting a map image containing, further comprising a marking means for marking the shooting position and the position of each of the specified objects on the map image extracted by the image extracting means, The information providing apparatus according to any one of claims 1 to 4, wherein the transmitting unit further transmits the map image information marked by the marking unit. 6. An information providing device for providing various kinds of information to a communication terminal connected via a network, a storage means for storing information on various objects located in various places, and the present state of the communication terminal. A receiving unit that receives the position data and the azimuth data, and an object located in the azimuth direction based on the current position received by the receiving unit from the object information stored in the storage unit. Identifying means, information about the object identified by the identifying means,
An object information acquiring unit that acquires the object information based on the object information stored in the storage unit; and a transmitting unit that transmits the object information acquired by the object information acquiring unit to the communication terminal. An information providing device characterized by the above. 7. The information about the object stored in the storage means includes image information of each object, and the information acquired by the object information acquisition means is each object specified by the specifying means. 7. The information providing device according to claim 6, further comprising image information of. 8. The information about the object stored in the storage means further includes position information of the object, and calculates the distance between the object specified by the specifying means and the current position of the communication terminal. The information acquisition device further comprises a calculating device, and the information acquired by the object information acquiring device further includes distance information between the communication terminal and the specified object calculated by the calculating device. Item 6. The information providing device according to item 6 or 7. 9. The apparatus further comprises rearrangement means for rearranging the information of the objects acquired by the object information acquisition means based on the calculated distance, and the transmission means is arranged by the rearrangement means. The information providing apparatus according to claim 6, wherein the information is transmitted. 10. An information providing method for providing various information to a communication terminal connected via a network, comprising: a storage step of storing information about various objects located in various places; A receiving step of receiving the photographing position data and the photographing direction data together with the image data, and the object on the received photographed image is specified based on the photographing position and the photographing direction received by the receiving step. A specific step, a correspondence information acquisition step of acquiring information corresponding to the target object specified by the specific step based on the target object information stored in the storage step, and each acquired by the correspondence information acquisition step. A transmitting step of transmitting the correspondence information of the target object to a communication terminal owned by the user of the image capturing apparatus, the information providing method. 11. An information providing method for providing various information to a communication terminal connected via a network, comprising: a storage step of storing information about various objects located in various places; and a present of the communication terminal. A receiving step of receiving position data and azimuth data, and an object located in the azimuth direction based on the current position received by the receiving step from the object information stored in the storing step. Information about the specified step and the object specified by the specified step,
An object information acquisition step of acquiring based on the object information stored in the storage step; and a transmission step of transmitting the information of the object acquired in the object information acquisition step to the communication terminal. An information providing method characterized by the above. 12. A storage function of causing a computer to store information relating to various objects located in various places, and a reception function of receiving shooting position data and shooting direction data together with image data taken by a shooting device, Based on the received shooting position and shooting direction, a specific function of specifying an object on the received captured image, and information corresponding to the specified object, the stored object information A program for realizing a correspondence information acquisition function that is acquired based on the above, and a transmission function that transmits the acquired correspondence information of each target object to a communication terminal owned by the user of the imaging apparatus. 13. A computer having a storage function of storing information on various objects located in various places, a reception function of receiving current position data and direction data of a communication terminal, and the stored object information. A specific function for specifying an object located in the azimuth direction based on the received current position, and an object for acquiring information about the specified object based on the stored object information A program for realizing an object information acquisition function and a transmission function for transmitting the acquired information about an object to the communication terminal. 14. A communication terminal connected to an information providing device for providing various information via a network, transmitting means for transmitting current position data and azimuth data of the own terminal to the information providing device, and the information providing. From the device, an image of each target object located in the azimuth direction based on the current position of the terminal itself, a receiving means for receiving information related to the target object, and each target object received by the receiving means. And a display control unit for displaying the image and related information on the display unit. 15. The related information includes distance information between each of the objects and its own terminal, and specifies a switch of information about the object to be displayed on the display unit based on the distance from the own terminal. Further, the display control means, when there is a display switching designation by the designation means, selects the target object information to be displayed based on the distance information between each target object included in the related information and the own terminal. 15. The information is displayed on a display unit according to claim 14.
The described communication terminal. 16. The communication terminal according to claim 15, wherein the designating unit designates switching of images in the order of distance between each of the objects and the own terminal. 17. A detection means for detecting a change in the azimuth of the own terminal is further provided, and when the change in the azimuth is detected by the detection means, the transmission means transmits the changed azimuth data to the information providing device. The communication terminal according to claim 14, wherein: 18. A transmission function for transmitting, to a computer, current position data and azimuth data of a communication terminal to an information providing device; and a position in the azimuth direction based on the current position of the own terminal from the information providing device. A program for realizing an image of each target object, a reception function of receiving information related to the target object, and a display control function of displaying information about the received target object on a display unit.