JP2006136019A - System for displaying video in approximately real time - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a system for providing images in approximately real time which can provide users with the actual circumstances of distant places by images in real time. <P>SOLUTION: The system comprises: an image acquiring means of acquiring images of a number of places in approximately real time; an image capturing means of capturing the images in approximately real time by radio or cable (to capture images by methods such as transmitting over a network and browsing by accessing with browsing software for the Internet); and a display means of outputting the images (dynamic images or still images) captured by the image capturing means. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a substantially real-time video display system capable of providing video of each place to a user side.

2. Description of the Related Art Conventionally, there is a system that records video at each point on a recording medium such as a CD-ROM or a hard disk, and searches and displays it based on search data such as a predetermined keyword. Conventionally, a technique of “smell data conversion, recording, communication, and reproduction” has been proposed (see Patent Document 1).
JP 7-55742 A

However, the video recorded on the recording medium is “past” (not “raw”). Therefore, the actual scenery changes every day depending on the changing seasons, the weather of the day, the construction conditions of the roads and buildings, etc., but the user can see “old (not fresh) ) ”Is a problem. Also, even if the video recorded on the recording medium is just after the update, it cannot meet the user's desire to “see the real-time situation at this moment now”. Furthermore, there is a problem that it is very expensive to frequently update the video data on the recording medium.
The present invention was made paying attention to such problems of the prior art, and provides a user with a live video providing system that can provide a user with an actual situation at any point in real time, and Using this live video, the user can confirm whether the point on the map corresponding to the “estimated current position” estimated from data such as a GPS receiver matches the “actual current position” The purpose is to provide a current location confirmation system using live video.

(Related technology)
Whether it falls under the “prior art” of the present invention (whether it is a known fact before the “priority date (June 11, 1996)” of the present application) is not clear, but the present application (Patent Act Article 41) As the “related technology” recognized by the present inventor as of the filing date of the later application with the domestic priority date claim), there are the following.
(B) “Diamond weekly volume 1996.8 Internet super time technique” published by Diamond Inc. has the following description.
“On the Internet, there are now many cases where tourist attractions are broadcast simultaneously with TV cameras. From the top of your home desk, in front of the Sphinx, the Arc de Triomphe, the hills overlooking the Himalayas, and other global cultures You will soon be able to see the heritage and tourist attractions of Justnow. ”(Ibid., P. 76)
“How about a hotel with a camera in front of the lobby or the entrance, and seeing it online with a remote control? Look at it on the web and say,“ It ’s not too crowded ”or“ Oh, there is a guy ”. Such online cameras are also increasing on the web. (Ibid., P. 82)
As an introduction to the Internet homepage, “Historic Road http: //www.kiis.or/rekishi/Mr. Keiko Yasu Ishi, Asuka, Nara, Kyoto, Osaka, Kobe, which are the main routes of the historical road, and their photographs (100 (Omitted) Access to each item includes search by region and period, and selection with the mouse on the map (clickable map). Although it is only a photo, we will also provide video and audio information (in the future). ”(Page 133)
(B) The Nihon Keizai Shimbun, dated June 16, 1996, is an article that introduces computer artist Masaki Fujihata with an article titled “Use the magic box to overlook the world”. It states in.
“Recently I'm devoted to a project using the Internet with Keio University students who are teaching. For example, we started an attempt to send 24 hours a day in real time to Mt. Fuji imaged by a camera attached to the Shonan Fujisawa campus. “Thousands of users from around the world can turn their cameras and zoom in on their computers.”
(C) On page 84 of “Weekly Diamond” issued by Diamond, Inc. on August 31, 1996, in the article “Super Organizing Diary Map and Photo Virtual Traveling Technique (Takeo Noguchi)” There is such a description.
“There is a“ virtual tour ”on the Internet. When you click on the map on the screen, a picture of that point appears. "
(D) In the advertising section of the Nihon Keizai Shimbun dated September 3, 1996, there is the following description under the heading “Map information system with improved operability: Sumitomo Electric Systems”.
“The Windows 95 digital road map“ AtlaMate / Windows 95 ”, developed and sold by Sumitomo Electric Systems, is ... (Omitted) As a multimedia function, this product can paste still images, videos, and audio on a map. "
In addition, the following description is included in the description of the “AtlaMate / Windows 95 version” specification in this advertisement column.
“Abundant registration functions Still images such as photos, videos such as videos, and voices can be registered on the map”
(E) The Nihon Keizai Shimbun, dated September 30, 1996, stated in an article titled “Use the Internet to feel nature at home”:
“Sagawa Town, Kochi Prefecture, in collaboration with NEC, has opened the“ Sagawa Internet Broadcasting Station, ”which allows users to enjoy live scenery over the Internet live. A camera is installed at the summit of Mt. Kakuzo in the same town (at an altitude of 675m), and you can enjoy the view from Cape Ashizuri to Cape Muroto by moving the camera freely from your home or office computer. Opened at Sagawa Local Production Center. The camera video is transmitted wirelessly to the camera control device of Nagano Town Hall, a town-owned facility located about 3 km away, and still images are provided on the Internet. You can remotely control the camera from a personal computer and enjoy panoramas of about 300 degrees left and right and about 60 degrees up and down with a maximum zoom of 10 times. The address of the Internet broadcasting station is http: // www / meshnet. or. jp / sakawa / NEC has been developing Internet broadcasting stations nationwide since May. Opened in Matsumae Town, Biei Town and Saroma Town, Hokkaido, and plans to install cameras in 100 sightseeing spots and scenic spots within 2-3 years. "
As described above, there are various techniques related to the present invention. However, these are all related to the present invention, but the present invention is a further development of these related technologies, and these related technologies do not deny the inventive step of the present invention.

The current position confirmation system using the live video according to the present invention for solving the problems of the prior art as described above is as follows (for example, description of paragraph numbers 0017 and 0018, for example) See).
That is, the present invention is a video input means that is provided at each of actual points corresponding to a plurality of points on a map and inputs live video around the points in real time, each connected to a network. Video input means, current position estimating means for estimating the current position of the user, means for obtaining a point on the map corresponding to the estimated current position obtained by the current position estimating means, and means for obtaining the point on the map A capturing unit that captures the live video from the video input unit provided at the actual point corresponding to the point determined by the network, and a display unit that displays the captured live video. This is a current location confirmation system using live video.
In addition, the present invention distinguishes each of the live video from the video input means provided at each live point in order to constantly input real-time video of a large number of live points that can be disclosed to the public. Live video identification data recording means for recording live video identification data (consisting of coordinate data of latitude data and longitude data, etc.) and current position specifying means for specifying the current position of the user (a conventionally known GPS receiver, etc.) ) And the current position of the user specified by the current position specifying means (consisting of coordinate data of latitude data and longitude data, etc.), or corresponding to or related to one or more live spots close to the current position Live video identification data selection means for selecting one or more live video identification data, and based on the selected live video identification data Capture the corresponding live video online (including when accessing and browsing via a network and sending it) and real-time video (video or still image) captured by this video capture device Display means for displaying on the screen.
Further, in the present invention, the video input means captures videos viewed from a plurality of live spots in a plurality of directions, and the live video identification data for identifying the live videos from each other includes It is composed of position data indicating the position of each live spot provided with video input means and direction data indicating the direction in which the video input means captures, and the current position specifying means specifies the current position of the user And the live image identification data selection means includes data indicating the current position of the user specified by the current position specifying means (including latitude data and longitude data). Based on the position coordinate data) and the data indicating the direction of travel (eg, east, west, south, north) In addition, the live video point identification data for specifying the live video (moving image or still image) that is the live video of the live point that is close to the current point of the user and that shows the direction close to the user's moving direction is selected. Is.

Among the inventions disclosed in this specification, there are the following as inventions not described in the claims of the present application.
(1) The live video providing system according to the present invention includes a video input means provided at each live spot for constantly inputting real live video of a large number of live spots that can be disclosed to the public, A live video identification database means for recording live video identification data for distinguishing live video at a location from each other on the map of the map database, while being associated with and associated with each point on the map of the map database, and designated on the map of the map database A search means for searching for one or more corresponding live video identification data from the live video identification database means based on the location, and a corresponding live situation based on the live video identification data searched by the search means Capture video in real-time wirelessly or by wire (transmitting over a network or browsing for the Internet Capturing) video capture unit by a method such as to view and access by software, and a display means for outputting a commentary image captured by the image capture means (moving image or still image), is made of.
(2) In addition, the present invention provides a video input means provided at each live spot for constantly inputting live video of a large number of live spots that can be disclosed to the public, and a map and various locations on the map. A map database for recording coordinate data for specifying points, coordinate data in the map database, and live video identification data for identifying each live video from each other, Corresponding to the live video identification point from the live video identification database, using the live video identification database means to record and the live video identification data that mutually identifies the live video when displaying a live video Or a search means for searching for one or more related points on the map, and a predetermined area including the points on the map searched by the search means. A map data extracting means for extracting the map data indicating a display means for outputting a map by the map data extracted by the map data extracting means, is made of.
(3) Further, the live video providing system according to the present invention is a video input means provided at each live spot in order to constantly input live video of a large number of live spots that can be disclosed to the public in real time, The live video identification database means for recording the live video identification data for identifying each live video while associating the live video identification data with a key made up of a character string / symbol string / graphic or video, etc., and the character string / symbol string / graphic Alternatively, a key input means for inputting a key composed of a video and the like, and a search for searching for one or more relevant live video identification data from the live video identification database means based on the key input from the key input means And the corresponding live video is captured based on the live video identification data retrieved by the search means and the search video. And) the image capturing means, including when browsing the browser for the Internet, and a display means for outputting a commentary image captured by the image capture means (moving image or still image), is made of.
(4) In the present invention, the video input means captures video in a plurality of directions from one live point (for example, when a video camera is turned in a plurality of directions) For example, in the case of imaging, or in the case where a plurality of video cameras are respectively provided in a plurality of directions and imaged at the same time), the live video identification data for specifying each live video is the live spot where the video input means is provided. It is desirable that it is composed of position data indicating the position of the image and direction data indicating the direction in which the video input means captures.
(5) In the present invention, the marking means for marking the part specified by the user in the live video (moving picture or still picture) displayed on the display means to distinguish it from other parts. It is good to have.
(6) In the present invention, the video input means preferably further includes means for inputting the sound generated at the point in real time.
(7) In the present invention, it is further provided in the vicinity of the video input means, and includes an odor sensor and a means for converting a signal from the odor sensor into odor digital data. The odor input means for inputting the odor at or around the spot, the conversion means for converting the odor data from the odor input means into the fragrance preparation data for generating an odor similar to the odor, and It is preferable to include odor generating means that is provided in the vicinity of the display means and generates a desired odor by preparing a fragrance from the fragrance preparation data. In (8), the “conversion means for converting to fragrance preparation data for generating an odor similar to the odor” is directly connected to the odor input means, and the conversion means is connected to computer communication. It may be connected to the odor generating means via a network, or may be connected to the input input means via a computer communication network, and this conversion means may be directly connected to the odor generating means. .

In the present invention, the user's estimated current position is obtained by current position estimating means (sometimes referred to as current position specifying means) such as a GPS receiver, and this "actual video of the actual point corresponding to the obtained estimated current position" Is taken online and displayed.
Therefore, the user can use the following, for example. For example, when you are moving on a vehicle or the like, find your “estimated current position” based on data from the GPS receiver, and display the “point on the map corresponding to the estimated current position” on the map screen. (The system for this purpose has been put to practical use as a map search / driving guidance system for routes to destinations for automobiles). At the same time, the user accesses the corresponding video input means via the communication network, and retrieves the live video corresponding to the “point on the map corresponding to the estimated current position” online and displays it on the screen. Let me see. As a result, the user can see the estimated current position displayed on the map while viewing the map that describes the route to the destination (the estimated current position of the user measured by the GPS receiver is The system displayed in (1) is already available on the market as a car driving guidance system) and confirms whether or not the live video matches, and if they match, it is obtained from the GPS receiver data. It can be confirmed that “the estimated current position” is correct without any measurement error. If they do not match, it is understood that the “estimated current position” obtained from the GPS receiver data is incorrect.
That is, the user reads out and displays a map of a predetermined area including the estimated current position from the map database based on the estimated current position from the GPS receiver, and displays “one close to the estimated current position on the displayed map or If the “live video of multiple live spots” is extracted online, the user can confirm whether the “estimated current position” from the GPS receiver is correct. That is, using a conventional GPS receiver, a predetermined area including the estimated current position from the map database based on the “estimated current position” (latitude data and longitude data coordinate data) from the GPS receiver. If the map is read out and displayed, and the "live image of the estimated current position (coordinate data) or a point close to it" displayed on the displayed map is retrieved online, the "estimated current" from the GPS receiver It is possible to confirm whether the “position” is correct without any measurement error. In other words, if the “displayed live video” matches “what is actually visible from the user's current position”, the [estimated current position] from the GPS receiver can be determined to be correct (previously, the user It was difficult to confirm by myself whether the current position by the GPS receiver was correct with the map alone).
Further, in the present invention, the video input means captures images that are visible from the respective live spots in a plurality of directions, and the live spot identification data for identifying each live spot is the video. It is composed of position data indicating the position of each live point provided with the input means and direction data indicating the direction in which the video input means captures, and the current position specifying (estimating) means determines the current position of the user. Means for specifying (estimating) and means for specifying the direction of travel of the user, and the live spot identification data selecting means is specified (estimated) by the current position specifying (estimating) means and the estimated current position of the user Based on the user ’s direction of travel (such as latitude and longitude data) and the user ’s direction of travel (eg, east, west, north, and south) And it indicates the point "in the traveling direction of the user (the most) and selects the close direction Commentary point identification data. Therefore, a user who is moving on a vehicle or the like is simultaneously viewing the “your current estimated position on the map (your current estimated position from the GPS receiver is displayed with an arrow)” at the same time. From the GPS receiver, it is possible to see “the live video showing the point on the map corresponding to the estimated current position”, “the live video showing the point on the map corresponding to the estimated current position” and “your position The “estimated current position” measured by the GPS can be confirmed by comparing with the “landscape that can be actually seen”.

  The best mode for carrying out the present invention is a mode as described in Example 1 below.

Next, Embodiment 1 of the present invention will be described with reference to FIGS.
In FIG. 1, reference numeral 1 denotes a personal computer (personal computer) used by a user, a control device 2 comprising a CPU and a communication modem, a hard disk device 3 in which computer programs and data are recorded, and computer programs and data are recorded. A CD-ROM drive 5 for driving the CD-ROM 4, a keyboard 6 and a mouse 6 a for inputting data, a display 7 for outputting an image, and a speaker 8 for outputting sound are configured. ing.
The control device 2 is connected to a relay service computer 11 through a computer network public line 10 such as the Internet. The relay service computer 11 controls the video cameras 12, 12 a, 12 b and the sound collection microphones 13, 13 a, 13 b respectively installed at a number of actual points, and also from these video cameras 12 and the sound collection microphones 13. Computers (servers) 14, 14 a, 14 b for recording data and browsing through a communication network are connected. The video data and audio data input by these many video cameras 12 and microphones 13 can be transmitted to the user side via the computer 14 and the relay service computer 11 in response to a request from the user side. Yes. Note that four video cameras 12 are installed at each actual point, and the four video cameras are installed so as to capture images in four directions of east, west, south, and north, respectively. desirable.

The relay service computer 11 is also connected to a number of other relay service computers 12. For example, a user connected to a certain relay service computer 11 passes through the relay service computer 11. Data input from a video camera and a microphone can be taken in from another relay service computer 12 or the like via a computer (server) connected thereto.
Video and audio capture methods in this case include a method for sending information from the video camera and microphone attached to an e-mail, and a homepage for providing input information of the video camera and microphone is a computer network. A method that allows users to import this website using browser software (browsing software) for the Internet (in other words, using a website on a computer network like a hard disk of a user's computer). There can be various methods such as.

In the first embodiment, the CD-ROM 4 includes a map database that records map data and address data for specifying each point on the map in association with each other, this address data, and each actual point ( Live video database for recording video identification data for identifying live video at each location where the video camera 12 and the microphone 13 are installed) in association with each other, and playback for playing back the map database A program, a search program for searching the live video database, and a program for capturing and displaying a live video corresponding to the searched live video identification data are recorded.
Now, for example, a user who lives in Osaka thinks that he wants to see the setting sun on the coastline of the summer Shonan coast of Kanagawa Prefecture, his hometown. In this case, for example, it is assumed that the user reproduces the map database, displays a map of a predetermined area including the Shonan coast, and clicks the location of the Shonan coast on the screen with the mouse 6a. Then, based on this input, the control device 2 searches the point database for address data corresponding to the point on the map. Based on the retrieved address data, live video identification data indicating the live video of the corresponding live location is searched from the live video database. Then, based on the retrieved live image identification data, the relay service computer 11 is accessed, and the video camera and microphone (and the live image identification) installed at the live point corresponding to the live image identification data. When the data also specifies the imaging direction, video data and audio data from a video camera and a microphone installed in a direction corresponding to the imaging direction are captured online, and real time is displayed by the display 7 and the speaker 8. Output to. Since the video and audio output at this time are real-time video and audio at the present time, the user can feel as if they were actually at the site.
In other words, there has been a CD-ROM or the like that can record a video of a beach such as the Shonan coast and search and output it with a keyword or the like. The images recorded on these CD-ROMs are beautifully photographed by a professional photographer from a perfect angle of a perfect day / time (for example, a beautiful time of the sunset). On the other hand, the video provided in this embodiment may be rainy or cloudy, and the time may not be the time when the best scenery can be seen. However, for the user, “the video at this point in time and the video at this moment (a video that will never happen again)” creates a single “sense of reality” and “impression”. In other words, if the user thinks “I want to see the sunset on the Shonan coast now,” it ’s not just the recorded “sunset on the Shonan coast” recorded in the past. If you ca n’t see the video, you wo n’t be able to get a big impression. This embodiment can answer such user's wishes.

Here, the configuration of the embodiment described above with reference to FIG. 1 will be described again with reference to FIG. FIG. 2 shows the configuration of the embodiment functionally and conceptually. In FIG. 2, reference numeral 32 denotes a live video input unit that is connected to a computer network (computer communication network) 30 and includes a video camera and a microphone for inputting live video and audio in various places in real time. Reference numeral 24 denotes the map database 26, its reproduction program and its search program, the live video database 25 and its search program, and a program for taking in the corresponding live video from the live video identification data via a communication network. Is a CD-ROM on which is recorded.
In FIG. 2, 21 is a map database playback unit for playing back the map database 26 recorded on the CD-ROM 24, 22 receives a signal from the map database playback unit 21, and displays a display unit 27 and a speaker 28. It is a control part which controls and outputs a predetermined image and sound. 23 corresponds to the response from the live video database 25 based on the address data of the point designated by the user (clicked with the mouse) on the screen where the map database is reproduced in response to the signal from the control unit 22. It is a search part which searches the identification data of the live video to perform. Based on the identification data of the live video from the search unit 23, the control unit 22 controls the video capturing unit (for example, a device that records and executes a browser as Internet homepage browsing software) 26 for the computer network. The video input unit 32 is accessed via the communication line 30, and real-time live video and audio are captured from there. The control unit 22 causes the live video and audio captured online to be output in real time by the display unit 27 and the speaker 28 while associating with the reproduced image (map image) from the map database 26.

Next, a screen displayed on the display 7 while being controlled by the control device 2 shown in FIG. 1 will be described with reference to FIGS.
According to each program recorded in the CD-ROM 4, as shown in FIG. 3, a live image is displayed on the upper half 7 a and a map is displayed on the lower half 7 b of the display 7. . When using the first embodiment, the user first drives the CD-ROM 4 of FIG. 1 to display a desired map on the lower half 7b of the display 7 from the map database. Which part of the map in the map database recorded on the CD-ROM 4 is to be displayed may be obtained by searching for map data from a keyword such as a place name and displaying it (such a technique is conventionally known). is there).
In the present embodiment, in the displayed map, points indicating each point have a predetermined color (for example, red) as shown in, for example, a, i, c, e, o, mosquito, and ki in FIG. It is colored and displayed.
Among the points indicated by a, i, u, d, o, mosquito, and ki in FIG. 4, a, i, c, and d in FIG. 4 correspond to the video camera 12 and the microphone 13 in FIG. is doing. That is, in the first embodiment, the video camera 12 in FIG. 1 is configured by four video cameras installed at positions a, b, c, and d in FIG. 4 so as to capture images in different directions. ing. Moreover, the microphone 13 of FIG. 1 is comprised by the four microphones installed so that each may collect a sound from a mutually different direction.
In other words, the video camera 12 will be described. Of the four video cameras constituting the video camera 12, the video camera installed at position a in FIG. 4 takes an image in the west direction (left direction) in the figure. The live video having the video identification data “1428A” is generated. Also, the video camera installed at the position of A in FIG. 4 captures images in the south direction (downward) in the figure, and generates a live video having video identification data “1428B”. Further, the video camera installed at the position of c in FIG. 4 captures an image in the east direction (right direction) in the figure, and generates a live video having video identification data of “1428C”. Further, the video camera installed at the position D in FIG. 4 captures an image in the north direction (upward direction) in the figure, and generates a live video having video identification data “1428D”.
Among the points indicated by a, i, c, e, o, mosquito, and ki in FIG. 4, o, mosquito, and ki in FIG. 4 correspond to the video camera 12a and the microphone 13a in FIG. is doing. In other words, in the first embodiment, the video camera 12a in FIG. 1 is configured by three video cameras installed at the positions of “e”, “f”, and “ki” in FIG. 4 so as to capture different directions. . Moreover, the microphone 13a of FIG. 1 is comprised by the three microphones installed so that each may collect sound from a mutually different direction. In other words, the video camera 12a will be described. Of the three video cameras constituting the video camera 12a, the video camera installed at the position o in FIG. 4 takes an image in the northwest direction (upper left direction) in the figure. The live video having the video identification data “1429A” is generated. Further, the video camera installed at the position of F in FIG. 4 captures an image in the southeast direction (lower right direction) in the figure, and generates a live video having video identification data of “1429B”. Further, the video camera installed at the position of K in FIG. 4 captures an image in the east direction (right direction) in the figure, and generates a live video having video identification data of “1429C”.
As described above, in the embodiment described with reference to FIG. 4, the address data (“1428”, “1429”, etc.) for identifying each point on the map and each video camera at the same live point. Combination with data indicating the imaging direction (“A”, “B”, “C”, “D”, etc.), and live video identification data (“1428A”, “1429A”, etc.) for identifying live video at each point Are recorded in correspondence with each other.
More specifically, in the example of FIG. 4, one address data “1428” on the map (address data for identifying the intersection area at the center of FIG. 4) is “1428A”, “1428B”, “1428C”. And four live video identification data respectively indicating the four imaging directions of “1428D” are recorded correspondingly. Further, for one address data “1429” on the map (address data for identifying the intersection area on the left side in FIG. 4), three addressing directions “1429A”, “1429B” and “1429C” are shown. Live video identification data is recorded correspondingly.
In the example of FIG. 4, the live video identification data (eg, “1428A”) is configured by a combination of address data (eg, “1428”) on the map and direction data (eg, “A”). In the present invention, it is not always necessary to use the address data on the map as it is in the actual situation identification data. For example, the address data on the map is address data (or coordinate data) configured by allocating the entire map evenly, and the live video identification data is the identification code of the point where the video camera is actually attached (for example, installation of the video camera) (Sequential number in the order) and direction data may be combined.

In the example of FIG. 4, each video camera 12 and microphone 13 is a live video obtained by inputting video and audio, respectively (in this case, the term “live video” is basically video data input by a video camera). And the voice data input with the microphone are used for identification data), the data indicating the point and the direction in which the video camera 12 is shooting (this is the microphone 13 trying to collect the sound) In the same direction). In other words, the live video is mutually identified by each point and its imaging direction, and the “live video identification data” is composed of data indicating each point and data indicating the direction of shooting or sound collection. . Therefore, even at the same point, if the shooting direction (direction such as east, west, south, and north) is different, another live image having different identification data is obtained.
This will be explained with reference to FIG. 4. A point having the address data (1428A) indicated by “A” in FIG. 4 corresponds to a live video having video identification data (1428A), and this identification (1428A) is identified. The live video showing data is a video taken in the direction A (the left direction in the drawing) from the point “a” in FIG. 4. Further, the point on the map having the address data (1428B) indicated by “I” in FIG. 4 corresponds to the live video having the identification data (1428B), and the live video showing the identification data (1428B). These are images taken in the direction B (downward in the drawing) from the point “a” in FIG. 3. Further, the point having the address data (1428C) indicated by “c” in FIG. 4 corresponds to the live video having the identification data (1428C). The live video showing the identification data (1428C) is shown in FIG. 4 is an image obtained by photographing the direction C (right direction as viewed in the drawing) from the point “4” in FIG. Further, the point indicated by “d” in FIG. 4 having the address data of (1428D) has a one-to-one correspondence with the live video having the identification data of (1428D), and indicates the identification data of (1428D). The live video is a video taken in the direction D (upward in the drawing) from the point “d” in FIG.
Further, in FIG. 4, a point indicated by “O” having address data (1429A) corresponds to a live video having identification data (1429A), and the live video showing the identification data (1429A) is It is the image | video which image | photographed the direction of A (upper left direction toward drawing) from the "o" point of FIG. Further, the point indicated by “K” having the address data (1429B) in FIG. 4 corresponds to the live video having the identification data (1429B), and the live video showing the identification data (1429B) is It is the image | video which image | photographed the direction B (the direction of the lower right toward drawing) from the "f" point of FIG. Further, the point indicated by “K” having the address data (1429C) in FIG. 4 corresponds to the live video having the identification data (1429C), and the live video showing the identification data (1429C) is It is the image | video which image | photographed the direction of C (right direction toward drawing) from the "ki" point of FIG.

As can be seen from the above, in this example of FIG. 4, 1428 is an intersection area located in the center of the map of FIG. 4 (in this example of FIG. 4, this intersection area is referred to as “actual point”). A, B, C, D indicate the direction of shooting (and sound collection) from the intersection area (actual point).
Similarly, in the example of FIG. 4, 1429 is address data on the map indicating the area (actual point) of the intersection at the left end of the map of FIG. 4, and A, B, and C are within the intersection (actual point). The direction of shooting (and sound collection) from each location is shown.
In the example of FIG. 4, the live video identification data includes address data (“1428”, “1429”, etc.) indicating the location of each live location on the map and data (A, B, C, D, etc.).

  Therefore, the user sees the map of FIG. 4 and determines that the place he / she wants to go to is the intersection area indicated by 1428 in FIG. 4, for example, “What is the situation of this intersection now? If you want to know, what kind of people, what kind of clothes, and what kind of clothes you are going through, etc.) Can be clicked with a pointing device such as a mouse. Then, the control device 2 searches for live video identification data corresponding to the address data on the map (from the live video database), and based on the searched live video identification data, the corresponding live video is converted into a computer. -Captured via the network and displayed on the upper half 7a of the display 7.

In addition, the user obtains a traffic route between the place where he / she wants to go and the place where he / she is present on the map (this has already been realized by a conventionally known technique), and on that route. It is also possible to display live video at a certain point in order (display time of one live video is 5 seconds, for example, and display the next live video in order every 5 seconds).
In addition, when the user is driving a car, the user obtains the current position on the map from the positioning information received by the GPS receiver and the positioning information obtained by various sensors (this is already known in the prior art). The real-time video identification data is obtained from the point corresponding to the current position obtained on the map, and a server on the network (for example, for the relay service in FIG. 1) is obtained based on the identification data. It is also possible to capture and display the corresponding live video through the computer 11). As a result, the user can visually confirm whether or not the current position on the map (current position estimated based on information from the GPS receiver or sensor) and the actual current position are the same. . In other words, if the live image displayed on the display 7 based on the live image identification data obtained as described above matches the actual scenery obtained by looking at the outside from the inside of the car, The current position estimated by the GPS is correct with no measurement error, but if it does not match, the estimated current position is incorrect.

  The connection between the control device 2 and the relay service computer 11 may be wireless, the connection between the relay service computer and each video camera 12 and microphone 13 may be wireless, and the “map database”, The “live video database”, these search programs, and the map database playback program may be read from a server (computer) on the network such as the relay service computer 11 instead of being read from the CD-ROM 4. In particular, as described above, when the personal computer 1 of FIG. 1 is used in a moving car (positioning information received by a GPS receiver and positioning information obtained by various sensors when the user is driving the car). The current position is obtained on the map displayed on the screen, and this “real-time video of the live location corresponding to the current location and the imaging direction corresponding to the traveling direction” is displayed on the display 7 of the personal computer 1. In the case of display on the computer, it is necessary to transmit and receive wirelessly between the control device 2 of the personal computer 1 and the relay service computer.

Next, a second embodiment of the present invention will be described with reference to FIG. In FIG. 1, reference numeral 1 denotes a personal computer (personal computer) used by a user, a control device 2 comprising a CPU and a communication modem, a hard disk device 3 in which computer programs and data are recorded, and computer programs and data are recorded. A CD-ROM drive 5 for driving the CD-ROM 4, a keyboard 6 for inputting data, a display 7 for outputting an image, and a speaker 8 for outputting sound are constituted.
The control device 2 is connected to a relay service computer 11 via a public line 10. To this relay service computer 11, video cameras 12 and sound collecting microphones 13 installed at a number of points are connected via a computer (server) 14. The video data and audio data input by the large number of video cameras 12 and microphones 13 can be transmitted to the user via the computer (server) 14 and the relay service computer 11 in response to a request from the user. It has become.
Further, the multiple video cameras 12 and the sound collecting microphones 13 shown in FIG. 1 can be distinguished from each other by the identification data. Therefore, the live video and audio from each video camera 12 and the sound collecting microphone 13 can be distinguished from each other. In addition, the video data and audio data input by the large number of video cameras 12 and microphones 13 can be viewed online by the user via the relay service computer 11 in response to a request from the user. (For example, it can be browsed using a browser of internet homepage browsing software).
The relay service computer 11 is also connected to a number of other relay service computers 12. For example, a user connected to the relay service computer 11 can connect to other relay service computers 11 via the relay service computer 11. Data input from a video camera and a microphone connected to the relay service computer 12 or the like can be taken in.

In the second embodiment, the CD-ROM 4 associates video identification data for identifying live video at each location (each location where the video camera 12 and the microphone 13 are installed) with a number of keywords. A live video database and a program for retrieving the video identification data from these keywords are recorded. The keywords recorded in this live video database include place names and genres of places (coasts, street corners, port towns, mountains, intersections, buildings, restaurants, theatres, cinemas, sports facilities, baseball fields, hot springs, temples, etc.) , Genres of behavior (sports, drama, movies, meals, walks, etc.), and so on.
Now, for example, a user who lives in Osaka thinks that he wants to see the setting sun on the coastline of the summer Shonan coast of Kanagawa Prefecture, his hometown. In this case, for example, when the user inputs a keyword such as “Kanagawa Prefecture, summer, Shonan coast, coastline, sunset” using the keyboard 6, the control device 2 stores the keyword in the CD-ROM 4 based on these input keywords. A corresponding one is searched from the recorded live video identification data. Then, based on the retrieved live video identification data, the relay service computer 11 is accessed, and video data and audio data from a video camera and a microphone installed at a point corresponding to the identification data are captured in real time. Thus, it can be output from the display 7 and the speaker 8. Since the video and audio output at this time are real-time video and audio at the present time, the user can feel as if they are actually at the site.

  Similarly, in the second embodiment, when the user inputs the keyword “Temple, Kyoto”, for example, the control device 2 retrieves a plurality of video identification data corresponding to the keyword and sequentially displays them on the display 7. To do. Also, for example, if a user who has been hospitalized for a long time cannot actually go but wants to go around hot springs around Kyushu, enter a keyword such as "around hot springs around Kyushu". Then, a plurality of video identification data corresponding thereto are searched, and actual videos corresponding to the identification data are received and sequentially displayed on the display 7. This gives the user the same excitement as they do when they are not actually doing it. Thus, it can be said that the second embodiment is a system that can realize “virtual travel (virtual travel)” that can give the user the same impression as if the user is not traveling.

  Similarly, if the user wants to “walk around the port town of Yokohama” and enters the keyword “Yokohama, port town, walk around”, the control device 2 can respond to a plurality of images based on these keywords. It retrieves identification data and captures live video data from each of the corresponding points (in this case, the video camera and microphone are installed inside a restaurant that has agreed to provide video to the public) If you keep it, you can know the inside situation, such as the current crowd of customers and the atmosphere in the store.) Similarly, if the user wants to go around Japan to visit theaters (baseball stadium tours), enter the keyword "Japan, tour around theaters (baseball stadium tours)", and the control device 2 will make these It searches the corresponding video identification data based on the keyword and outputs live video corresponding to them in real time. In this case, if each theater or each baseball field approves the transmission of the contents of the play (or the contents of the game) only for a predetermined time, the user will not be able to change It can be seen instead of an index.

Next, a third embodiment of the present invention will be described. In the third embodiment, in addition to the configuration of the first embodiment, the following is provided.
First, an odor input device provided in the vicinity of the video camera 12 and the microphone 13 is provided. The odor input device includes an odor sensor and an encoding unit that encodes a signal from the odor sensor into odor digital data. The odor sensor is composed of a plurality of existing odor sensors, and all odor amount detection values from each sensor are supplied to the encoding unit (encoder). The encoding unit (encoder) encodes the supplied odor amount detection value. The encoded odor data (digital data) is recorded in a recording device and can be viewed and captured in real time by a remote user via a computer communication network. It should be noted that it is desirable to prepare a plurality of odor sensors for each type of odor that can be sensed, and to obtain information that can reproduce the original odor as closely as possible.
Next, the user side converts the browsed and captured odor data (digital data) into a fragrance preparation data for generating an odor similar to the odor on site, and the display 7 (FIG. 1), and an odor generating device for preparing a desired odor by preparing a fragrance from the fragrance preparation data.
First, the “conversion device for converting the browsed and captured odor data (digital data) into fragrance preparation data for generating an odor similar to the odor on site” will be described. The conversion device converts a detection value pattern of each odor sensor into an output value pattern of each fragrance. More specifically, for each of various types of odors, what value the detection value takes when the odor sensor detects the odor is previously investigated and recorded. Then, from the data recording the relationship between the odor and the detection value pattern of the odor sensor and the data recording the relationship between each odor and the fragrance (component), the detection value pattern of each odor sensor and a plurality of types The pattern of the output value of the fragrance is recorded in association with each other. The converter converts the detection value pattern of the odor sensor into an output value pattern of the fragrance (component) (this becomes “fragrance preparation data”) based on the associated information. is there. This will be described in more detail as follows. In the conversion device, the correspondence between the detected value of the odor sensor when each odor is detected by the odor sensor and the output value of each fragrance when the odor is generated by the odor generating device described later is recorded. A sensor fragrance amount conversion table is recorded in advance. Then, the conversion device refers to the sensor fragrance amount conversion table based on the detection value data of the odor sensor, and converts the detection value for each odor sensor into an output value for each fragrance.

Next, the “scent generating device for preparing a desired odor by preparing a fragrance from the fragrance preparation data” will be described. The odor generating device prepares a plurality of types of fragrances in advance, and the “fragrance preparation data” (the fragrance output pattern data. Data indicating how much odor components from each fragrance are generated. ) To generate a necessary amount of odor components (components from the fragrance) in a necessary amount. As a form of odor generating device, a stationary type that spreads the scent throughout the space in a certain space, and an individual who can feel the scent only by wearing near the user's nose or in the nose A portable type can be considered.
For example, the following can be considered as the stationary type. That is, arrange containers with fragrances at the bottom of the box, and attach a lid to each container to adjust the area where the fragrance and air are in contact with each other. Provide. Then, according to the data of the “fragrance output pattern”, the opening / closing state of the lid of each corresponding fragrance container is adjusted so that a predetermined amount of each fragrance component can be released. In addition, for the portable type, the basic configuration may be the same as that of the stationary type, but this is reduced in size by a head support such as a helmet type, a headset type, a glasses type, or a mask type. It can be worn near the user's nose.
In the third embodiment, the above-mentioned “conversion device that converts the encoded odor data that has been browsed and captured into fragrance preparation data for generating an odor similar to the odor on site” is provided on the user side. However, the present invention is not limited to this. For example, the personal computer 1 may be provided at a site where the video camera 12 and the microphone 13 are installed on the computer, or on a computer network. The relay service computer (server) 11 may be provided. Further, the technology of “smell data conversion, recording, communication, and reproduction” described in the third embodiment is a known technology disclosed in, for example, Japanese Patent Laid-Open No. 7-55742.

FIG. 5 is a block diagram showing Embodiment 4 of the present invention. In FIG. 5, 21 is a liquid crystal display (LCD). In FIG. 5, 22 is a GPS (Global Positioning System) receiver that has been commercially available so far, which measures the delay time of the radio wave from the artificial satellite and obtains the current position of the user from the distance from the orbit. is there. The GPS receiver 22 includes a GPS receiving antenna that receives GPS radio waves transmitted from artificial satellites, and a position recognition unit (configured by a CPU) that recognizes the current position as latitude data and longitude data from the GPS radio waves. It is out. The GPS antenna receives, for example, a 1.5 GHz radio wave from a GPS satellite and sends the signal to the position recognition unit. The position recognition unit receives radio waves of four or more receivable satellites among GPS satellites in operation, and calculates the position between each satellite and the reception point calculated from the known satellite positions and the received radio waves. Based on this, the current position of the reception point is acquired, and latitude data and longitude data are calculated. The detailed configuration and usage of the GPS receiver 2 described above are conventionally known (see, for example, JP-A-5-45171, JP-A-7-306054, and JP-A-8-94735). Therefore, detailed description is omitted.
In FIG. 5, reference numeral 26 denotes a traveling direction input unit, which measures the traveling direction (such as east, west, south, and north) when the user is moving by walking, vehicle, railroad, or the like using geomagnetism or the like to obtain the traveling direction. It is a traveling direction input unit. In the fourth embodiment, the GPS receiver 22 and the traveling direction input unit 26 constitute a “current position specifying unit” of the user according to the present invention.
In FIG. 5, 23 receives coordinate data (latitude data and longitude data) as current position information from the GPS receiver 22 and the traveling direction data from the traveling direction input unit 26, and selects the corresponding satellite image. A control unit for displaying it on the LCD 21 is constituted by a personal computer or the like.

  In FIG. 5, reference numeral 24 denotes a map database server (computer) connected to the control unit 23 via a computer communication public network 20 such as the Internet. This map server 24 associates a map of Japan with, for example, position identification data such as coordinate data (latitude data and longitude data), place name, facility name, facility identification data (facility telephone number, etc.) As recorded. The map server 24 is connected to the control unit 23 online by the public line network 20. The public line network 20 includes not only a wired communication network but also a wireless communication network such as a mobile phone network, a PHS (Personal Handyphone System) network, a car phone network, and an artificial satellite communication network. desirable.

In FIG. 5, reference numeral 25 denotes a live video input device connected to a public network 20 for computer communication such as the Internet. Each live spot is provided, and a live video in a plurality of directions at each live spot (a plurality of live videos from each live spot). We have been accessing multiple digital video cameras that constantly input real-time video (viewed in the direction) in real time and digital video data from these digital video cameras via a computer communication network such as the Internet. And a live video providing computer for providing online to a plurality of users.
This computer for live video provides live video of each point, location data such as coordinate data (latitude data and longitude data), place name, facility name, facility identification data (such as facility phone numbers), It is recorded as a database in association with the direction data. This live video providing computer is connected to the control unit 3 online via the communication network 20. The communication network 20 preferably includes not only a wired communication network but also a wireless communication network such as a mobile phone network, a PHS (Personal Handyphone System) network, a car phone network, and a satellite communication network. .

The control unit 23 accesses the map server 24 according to an instruction from the input device such as the keyboard 26 or the mouse 27 of the user, and from there, a predetermined point including a point desired by the user (a point specified by the input device). The area map data is retrieved online and displayed on the LCD 21.
Further, when the user designates an arbitrary point on the displayed map with the mouse 27 and instructs the display of a live image of a predetermined area including the point, the control unit 23 provides the live video of each live point. The video input device 25 including the computer is accessed, the live video data of the predetermined area is retrieved online, and the live video is displayed on the LCD 21 in real time.
In addition, the control unit 23, for example, inputs a place name, facility name, facility identification data, etc. of a point desired to be displayed, and wants to display a live video of the corresponding live spot or a map including the live spot. When this happens, the video input device 25 or the map server 24 is accessed, and the corresponding live video or map is retrieved online and displayed on the LCD 21.
In addition, the control unit 23 displays a live video of a live spot in the direction from the current location where the user is currently in the direction of travel to the nearest location and visible toward the travel direction. Is received as coordinate data (latitude data and longitude data) and direction data from the GPS receiver 22 and the traveling direction input unit 26, and based on the coordinate data and direction data. Then, the video input device 25 at each relevant live location is accessed, the relevant live video is provided online, and displayed on the LCD 21. In this case, as a method for the control unit 23 to receive the corresponding live video from the video input device 25, the video input device 25 in this place can be obtained by using conventional Internet browsing software (browsing software). There are various methods, such as a method of directly accessing and capturing the video data, and a method of requesting the video input device 25 to transmit the corresponding live video data as a file attached to an e-mail and receiving it by transmission. It is possible.

  In the fourth embodiment, when the user displays a live video image on the LCD 21, the control unit 23 selects only a certain part of the displayed live video image, for example, a specific building or Includes a program (program) that can be used to mark only specific parts such as a specific bridge or specific road so that they can be distinguished from other parts. It is good. The marking in this case is various, for example, a method of coloring with a different color from others, a method of performing a shading process only on that part, a method of displaying that part with a solid line thicker than the other parts, etc. There are many ways.

Next, FIG. 6 is a block diagram showing Embodiment 5 of the present invention. In FIG. 6, reference numerals 21, 22, 23, 26 and 27 are the same as those in FIG. In FIG. 6, 34 is a CD-ROM player (reproducing device) connected to the control unit 23, and 35 is a CD-ROM that can be read by the CD-ROM player 34. In this CD-ROM 35, for example, a map database is recorded in which an entire map of Japan is recorded in association with position identification data such as coordinate data (latitude / longitude data), place name, facility name, facility identification data, and the like. . In FIG. 6, reference numeral 31 denotes a video input device connected to a computer communication network 30 such as the Internet, which is the same as the video input device 25 of FIG.
The control unit 3 reads the CD-ROM 15 by the CD-ROM player 14, thereby reading a map of a predetermined area including a position desired by the user and displaying it on the LCD 1. In addition, the control unit 3 accesses the video input device 31 via the computer communication network 30 to capture the live video in the predetermined direction desired by the user from the live location desired by the user and display it on the LCD 21. be able to.
In addition, the control unit 23 displays a live video of a live spot that is in a direction from the current location where the user is currently in the direction of travel and closest to the current location, and from that location to the travel direction of the user. When the command to display the live video imaged toward the user is received as the coordinate data (latitude data and longitude data) from the GPS receiver 22, and the user inputs from the traveling direction input unit 26 The data input direction 31 is received, and the video input device 31 is accessed based on the coordinate data and the direction data. The live video of the direction is read online, and the live video is displayed on the LCD 21 in real time.

Here, among the various inventions disclosed in this specification, the effects of the invention not described in the claims of the present application will be described.
(1) According to the live video providing system according to the present invention, the user simply specifies a desired point with a pointing device (for example, clicks with a mouse) while looking at the map, and the current state of the point at that point. Can be seen in live video. Also, even if the user does not specify each with a pointing device, if the point identification data of multiple points for which live video is desired is input sequentially in advance by a computer program, the computer will respond to the desired points one after another. Live video can be displayed. Therefore, the user can also realize “virtual travel” while looking at the map and can get the same impression as if he / she did not actually go.
Also, for example, a “treasure hunting” game in the world of computer communication networks where users from all over the world look for a single treasure while watching live video from around the world from a map of the whole world. It will be possible to compete all over the world at the same time.
(2) Further, according to the live video providing system according to the present invention, the user can display the corresponding point on the map from the live video identification data while viewing the live video of the certain point. By viewing a live video, you can easily know where the live video can be seen on the map (what kind of place name, facility name, etc.).
(3) Also, according to the live video providing system according to the present invention, the user can input one or more points corresponding to the search data by inputting the search data composed of a desired character string or the like. Live video can be viewed in real time on the spot. In particular, it will be possible to provide “virtual travel” in which the actual situation at this moment in a plurality of remote locations can be sequentially viewed in real time.
(4) In the present invention, the live video identification data for specifying each live video, the position data indicating each point provided with the video input means, and the direction indicating the direction taken by the video input means If it is made up of data, it will be possible to provide live video that differs depending on the viewing direction even at the same point, and it will be possible to provide live video that can reproduce the “raw site” in more detail in real time.
(5) Further, in the present invention, by providing a marking means for marking the part specified by the user in the live video displayed on the display means to distinguish it from other parts, Since you can only mark certain parts (for example, specific buildings, bridges, roads, rivers, parks, etc.) in the video (which can be video or still images), the live video can be easily processed according to your purpose. become able to.
(6) Further, in the present invention, the video input means also includes means for inputting the sound generated at the point in real time, and these input sounds are respectively captured in real time by wireless or wired ( By browsing with an internet browser or sending it over a communications network, users can not only view live footage (live footage, video or still images), but also live footage. It becomes possible to know at the same time.
(7) In the present invention, it is further provided in the vicinity of the video input means, and includes an odor sensor and a means for converting a signal from the odor sensor into odor digital data. Odor input means for inputting the odor at or around the spot, means for converting the odor data from the odor input means into fragrance preparation data for generating an odor similar to the odor, and the display Odor generating means for generating a desired odor by preparing a fragrance from the fragrance preparation data, so that the user can obtain only the live video and the actual sound. In addition, the actual scent of the site can be sensed in a remote place in real time.

It is a figure which shows the hardware constitutions of Example 1 or 2 of this invention. It is a figure which shows the notional structure of Example 1 or 2 of this invention. It is a figure which shows the structure of the display of Example 1 of this invention. It is a figure which shows an example of the map displayed on a display in Example 1 of this invention. It is a block diagram which shows Example 4 of this invention. It is a block diagram which shows Example 5 of this invention.

Explanation of symbols

1 Personal computer
2 Control device 3 Hard disk device 4 CD-ROM
5 CD-ROM drive 5
6 Keyboard 7 Display 7a Upper half of display 7b Lower half of display 8 Speaker 10 Public line 11 Relay service computer 12, 12a, 12b Video camera 13, 13a, 13b Microphone 21 LCD. 22 GPS receiver. 23 Control unit.
24 Map database server (computer).
25 Video input device. 26 Keyboard. 27 Mouse.
30 Computer communication network. 31 Video input device.
34 CD-ROM player. 35 CD-ROM

Claims (3)

Video input means that are provided at actual points corresponding to a plurality of points on the map and that input live video around the point in real time, each of which is connected to a network;
Current position estimation means for estimating the current position of the user;
Means for obtaining a point on the map corresponding to the estimated current position obtained by the current position estimating means;
A capturing means for capturing a live video from the video input means provided at an actual point corresponding to the point determined by the means for determining a point on the map via a network;
Display means for displaying the captured live image,
A current location confirmation system using live video, characterized by having Video input means provided at each live site in order to constantly input live video of many live sites that can be disclosed to the public in real time,
Live video identification data recording means for recording live video identification data for identifying the live video from each other;
Current position estimation means for estimating the current position of the user;
Based on the estimated current position of the user estimated by the current position estimating means, the actual image of one or more actual positions near the estimated current position of the user is specified from the actual image identification data recording means. Live video identification data selection means for selecting live video identification data for,
Based on the selected live video identification data, a video capture means for capturing the live video online,
Display means for displaying the live video captured by the video capturing means in real time;
A current location confirmation system using live video. In claim 1 or 2,
The video input means captures images that can be seen in a plurality of directions from the live spots,
The live video identification data for identifying each live video from each other includes position data indicating the position of each live spot where the video input means is provided, and direction data indicating the direction in which the video input means is imaged. Configured,
The estimated current position specifying means includes means for estimating the current position of the user and means for specifying the traveling direction of the user,
The live video identification data selecting means is based on the user's estimated current position and the user's traveling direction estimated by the current position estimating means, and the live spot that exists in the direction of the user's progress from the user's estimated current position And the live video identification data consisting of position data indicating the position of the live spot close to the estimated current position of the user and direction data indicating the direction of travel of the user is selected.
A current location confirmation system using live video.

Images