JP2004070872A - Video distribution server and video distribution method - Google Patents

Abstract

A system is provided that allows a user in a remote place to easily and easily view a video of a shooting target in a manner similar to actual observation with his / her own eyes.
An entire image capturing apparatus captures an entire image of an object to be captured. The detailed image capturing terminal 2 captures a moving image that closes up from the entire capturing target object to a detailed image of a part thereof. The video distribution server 4 stores the entire image, the moving image, and link information for associating them with each other in the video DB 3. Then, the video distribution server 4 distributes the whole image and the link information to the user terminal 5 in response to a request from the user terminal 5, and displays the whole image of the photographing target. Here, when the link information is selected at the user terminal 5, the linked moving image is delivered to the user terminal 5, and a detailed image of the relevant portion is displayed in a close-up manner.
[Selection diagram] Fig. 4

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a technique for distributing an image of a shooting target such as a construction site to a user terminal installed in a remote place.
[0002]
[Prior art]
The home for the family, as shown in FIG. 22, is a place where everyone gathers and lives and is a symbol of happiness. Homes are also places where you spend a lot of time in your life and are the foundation of your family's life. In addition, building a new house requires a large investment and is an expensive asset.
[0003]
Therefore, when building a new house, the following psychology works (FIG. 23). When building a house that is a “symbol of happiness”, families have high expectations for a “happy life” in that house. In addition, since the house is the "base of life", we expect "comfortable life" in the new house in order to incorporate our wishes into the design of the house as much as possible. And, with these expectations, families can't wait to complete the house. On the other hand, considering that they will live long as the “base of life” in the future, and that they are large assets with large investments, the progress of whether they have been made properly, that is, whether the construction is proceeding as designed, has progressed. I am very worried and feel uneasy. As a result, the family's psychology is greatly frustrated by the two conflicting feelings, "I can't wait to get it" and "I'm just anxious."
[0004]
Then, in order to eliminate the "frustration", the family visits the site during construction (FIG. 24). At the construction site, you can look at the whole picture of the house under construction, realize that the house is actually completed, and satisfy the feeling of being "waiting and dying". On the other hand, by observing and turning around worrisome details such as bases and pillars and seeing and convincing with their own eyes, they can eliminate feelings that are "just anxious". Even if you are not familiar with architecture, you can get rid of anxiety by seeing and convincing yourself. In this way, the two conflicting feelings of "I can't wait for it" and "Essentially anxiety" are processed, and as a result, "Irreverence" is eliminated.
[0005]
However, there are cases where it is difficult to visit a construction site due to time or geographical restrictions, or that it is difficult to visit the building frequently. Therefore, a method of eliminating “irritability” by distributing an image of a construction site to a user terminal of a construction owner (user) can be considered.
[0006]
Heretofore, as a system for distributing an image of a building site, there is a system proposed in Japanese Patent Application Laid-Open No. 1997-261519. This system can distribute a still image of a building site taken by a fixed camera to a remote management office through a mobile phone or the like. Therefore, if this system is diverted and images of the construction site are regularly delivered to the user's home terminal, the user can easily check the appearance of the new house and the workmanship while staying at home Can be expected to be possible.
[0007]
[Problems to be solved by the invention]
However, the images that can be browsed using the above system are only still images of the entire construction site. It is thought that this does not necessarily eliminate the "frustration" of the family. This is because the purpose of the user's visit to the construction site is to look at the entire construction site and realize the progress of the construction, and to carefully check and convince the details of the places on the site. is there. Therefore, just by looking at the whole still image, the user cannot be convinced to see it with his / her own eyes, and the user cannot remove the feeling of "inevitably anxious". As a result, "frustration" remains without being eliminated (FIG. 25).
[0008]
As a method for solving such a problem, a method is conceivable in which a plurality of fixed cameras are provided in the above-described system and a detailed image of a pillar portion, a base portion, and the like is distributed along with the entire image of the building.
[0009]
However, construction sites such as pillars and bases have few features, so it is difficult for users to understand which part of the building is being magnified by looking at only the detailed image. Another problem is that even if a video of a similar construction site of another building is distributed, it is indistinguishable, and there is also a problem that a detailed image alone does not guarantee that it is a video of a location that one really wants to see.
[0010]
In addition, since the places that the user wants to check in detail are fluid things that change depending on the mood and ideas at that time, it is difficult to set a place for taking the detailed image in advance and install a fixed camera. is there. In addition, a configuration in which a plurality of fixed cameras are provided leads to an increase in the complexity of the system and an increase in cost, and thus is not realistic.
[0011]
The present invention has been made in view of the above circumstances, and allows a user in a remote place to easily and easily view an image of an object to be photographed in the same manner as actually observing with his own eyes. It is a first object to realize a system capable of performing such operations.
[0012]
A second object of the present invention is to realize a user-friendly system that makes it easy to understand which part of the entire photographing object corresponds to the detailed image.
[0013]
A third object of the present invention is to realize a highly reliable system capable of guaranteeing that a detailed image is obtained by enlarging a part of an object to be photographed.
[0014]
[Means for Solving the Problems]
As described above, in the conventional system, the user was not able to obtain the same satisfaction as seen with his / her own eyes. The present inventors have conducted intensive studies on the cause and obtained the following findings.
[0015]
When observing an object, a human first performs a general observation to roughly grasp the form and configuration of the entire object. Next, a portion to be checked in more detail is found from the entire object, and the viewpoint is moved / closed to that portion for detailed observation. At this time, the position and size of the detailed portion in the whole object are also important factors. Only after such a process does the observer understand the form and configuration of the object and can obtain satisfaction.
[0016]
Therefore, the present inventors provide a system for simulating the whole observation process of roughly grasping the whole image of an object and the detailed observation process of moving and approaching the viewpoint to a part of the whole image on a computer system. The present inventors have intensively studied a method for realizing the above, and have come up with a configuration of the present invention described below.
[0017]
That is, the video distribution system according to the present invention distributes the entire image of the object to be photographed and the moving image that closes up from the entire object to be photographed to a detailed image of a part thereof to the user terminal.
[0018]
Here, the whole image and the moving image are stored in the image storage means (image DB) together with link information for associating the moving image with the entire image.
[0019]
The video distribution server transmits the whole image and the link information to the user terminal in response to a request from the user terminal, and displays an image of the entire photographing target. The user can roughly grasp the entire configuration of the object to be photographed by first viewing the entire image.
[0020]
As a display mode for displaying an image of the entire photographing target on the user terminal, for example, there is a mode in which the entire image (image) is displayed and link information (character information such as the name of a portion) is displayed in a list. In this aspect, the link information can be selected by clicking the displayed link information with a mouse pointer or the like.
[0021]
As another display mode, for example, a mode in which only the entire image is displayed and the link information is associated with the coordinates of the display image or the like can be considered (the link information is not displayed). In this embodiment, by clicking a part of the display image with a mouse pointer or the like, link information associated with the coordinates can be selected.
[0022]
When link information is selected by the user on the display screen of the whole image, a moving image associated with the link information is transmitted to the user terminal, and a detailed image of the portion is displayed in close-up. This process is similar to the process of moving the viewpoint of the subject to a part of the whole image and approaching it to perform detailed observation. Therefore, the user can have a simulated experience as seen with his own eyes, and can obtain the same satisfaction as actually visiting the site and observing the photographing target.
[0023]
When capturing an entire image or a moving image to be distributed, it is preferable to perform alignment between the entire image and the moving image. By performing the alignment between the whole image and the moving image, the switching of the display from the whole image to the moving image on the user terminal can be smoothly performed while maintaining the continuity of the image. Then, the user can browse the video without feeling uncomfortable. In addition, the continuity and integrity of the entire image and the detailed image can be guaranteed for the user, and the reliability of the system is improved.
[0024]
As a method for performing the alignment, there are roughly two methods. The first method is a method in which the shooting angle of the first imaging device that shoots the entire image matches the shooting angle of the second imaging device that shoots a moving image. According to this method, the positions of the images themselves captured by the two imaging devices can be adjusted.
[0025]
Specifically, for example, a first image captured by the first image capturing device and a second image captured by the second image capturing device are input to a computer, and a capturing angle of one of the image capturing devices is determined based on both images. Positioning state information for adjusting (imaging start position) is generated. If the photographing start position is determined with reference to the positioning state information, the entire image and the moving image can be accurately positioned. At this time, it is preferable that the positioning state information includes an image in which both images are superimposed, since it is possible to immediately understand in which direction and how much the image is shifted. Further, when the positioning state information is displayed on the display unit of the imaging device, the position adjustment becomes easier.
[0026]
The second method is a method in which image processing such as enlargement / reduction, trimming, and movement of an image is performed to match the position of the shooting target in the entire image with the position of the shooting target in the moving image. According to this method, it is not necessary to perform strict positioning at the photographing stage, and thus there is an advantage that the photographing operation is facilitated.
[0027]
The video distribution system according to the present invention is constructed by appropriately combining the above-described configurations, means, and methods. Such a system distributes an entire image of an object to be photographed and a moving image that closes up from the entire object to be photographed to a detailed image of a part of the object, so that a user at a remote place can easily and his own It is possible to browse the image of the object to be photographed in the same way as actually observing it with the eyes.
[0028]
Further, since the link information to the detailed image can be selected on the display screen of the entire photographing object, it is possible to easily grasp which part of the entire photographing object the detailed image corresponds to.
[0029]
Furthermore, since the detailed image is displayed by a moving image that closes up from the entire object to a detailed image of a part thereof, it is possible to guarantee that the detailed image is an enlarged part of the object to be captured, System reliability is improved.
[0030]
Therefore, the present invention can be suitably used, for example, for the purpose of making it possible to view an image of a house under construction at any time on a computer (user terminal) of a construction worker. This is in consideration of the "frustration" of the construction owner who cannot visit the construction site.
[0031]
In addition, the present invention, in addition to the above objects, for example,
・ The purpose of certifying the manufacturer's responsibility of the building by making the construction process of the building visible to the construction owner and recording it as a video.
-The purpose of explaining the quality (commercial value) of a building (used property) at the time of buying and selling of the building using the recorded video of the building process,
It can also be used.
[0032]
Generally, once a building is completed, it is very difficult to identify its quality. The above uses focus on this point, and take into account the fact that by recording detailed images of the building process from the start of construction to completion, evidence that guarantees the quality of the building is left. .
[0033]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, a preferred embodiment of the present invention will be illustratively described in detail with reference to the drawings. Here, as an embodiment of the present invention, a system for selecting a house under construction (building) as an object to be photographed and distributing an image of the house to a user who is a builder is illustrated.
[0034]
However, the application range of the present invention is not limited to this, and can be applied to various other specific fields. For example, you can select a scenic scenery or a famous place as an object to be photographed and distribute the image to the user terminal to simulate a trip, or select a factory production line or the like as the object to be photographed. The present invention has a wide range of applications, such as a system for distributing to the terminal of a production manager and utilizing it for production management.
[0035]
As described above, simply distributing the still images of the entire building and the detailed places cannot provide the user with the same satisfaction as seen with his / her own eyes. In order to solve such a problem, the video distribution system according to the present embodiment has two points: providing an easy-to-understand video where the user is looking at, and guaranteeing that a desired location is projected. It is intended to be realized. Thus, the user can be convinced in the same way as seeing with his / her own eyes, and as a result, the frustration can be eliminated (FIG. 1).
[0036]
In order to achieve the above object, the present system includes a general observation process of roughly grasping the whole image of a building and a detailed observation process of moving and approaching a viewpoint to a part of the whole image of a user. Provide a mechanism to give a simulated experience on the user terminal.
[0037]
For example, as shown in FIG. 2, the present system first displays the entire image of the building on the screen of the user terminal. This corresponds to the whole observation process. Links A to C, which are link information from the whole image to the detailed image, are associated with the whole image. When the user selects one of these links A to C that is visible or invisible on the whole image, the present system distributes a moving image associated with the link information to the user terminal. This moving image is a video that closes up from the entire image to the detailed image. At this time, the display image of the user terminal switches from the whole image to the moving image, and the user moves the viewpoint smoothly from the whole image while maintaining continuity, and finally the moving image that enlarges and displays the desired detailed part Can be browsed. This corresponds to the detailed observation process.
[0038]
FIG. 3 shows an example of a display screen on the user terminal. Pillars of the building are displayed as the whole image, and links to detailed images are prepared at four places in the whole image. When the user selects the base part at the lower right of the whole image, a moving image for displaying the base part in a close-up display is delivered, and the base part is enlarged and displayed.
[0039]
According to the above mechanism, the user can easily browse the entire image and the detailed image of the building in a remote place. Therefore, by browsing the entire image, it is possible to realize how much the construction work is progressing, and by browsing the detailed image, the workmanship of the construction can be confirmed.
[0040]
In addition, when browsing the detailed image, the corresponding part can be selected from the whole image, so that it is possible to easily grasp which part of the building the detailed image corresponds to. Furthermore, since the enlarged display is performed while maintaining the continuity from the whole image to the detailed image using the moving image, the place to be seen is surely shown, that is, the enlarged detailed image is definitely displayed. It can be guaranteed that a part of the whole image is enlarged.
[0041]
Next, an example of the configuration of a video distribution system that realizes the above-described mechanism will be described with reference to the system configuration diagram of FIG.
[0042]
The video distribution system according to the present embodiment generally includes an overall image capturing apparatus 1, a detailed image capturing terminal 2, a video DB (database) 3, and a video distribution server 4. The video distribution system is configured to be able to communicate with the user terminal 5 through a computer network.
[0043]
The overall image capturing apparatus 1 is an overall image capturing unit that is installed at a building site and captures an overall image of a capturing target such as a house under construction. The whole image capturing apparatus 1 is connected to the video distribution server 4 by wire or wirelessly, and transmits the captured whole image to the video distribution server 4. This device is not limited as long as it is an imaging device having an external output such as a commercially available video camera or Web camera. The whole image captured here may be a still image or a moving image. Further, it is not always necessary to include the entire building, and any image may be used as long as the entire configuration of the building can be observed.
[0044]
The detailed image capturing terminal 2 is a detailed image capturing unit that captures a moving image that closes up from a whole house under construction to a detailed image of a part thereof (a pillar portion, a base portion, or the like). The detailed image capturing terminal 2 is a terminal that is configured to be portable and operated by a photographer at a building site to capture a detailed image. The terminal is connected to the video distribution server 4 by wire or wirelessly, and transmits the captured video to the video distribution server 4 as necessary. In addition, the detailed image capturing terminal 2 is configured to be able to transmit and receive the positioning status information, the request for the designated shooting location, and the like, to and from the video distribution server 4.
[0045]
The entire image capturing apparatus 1 and the detailed image capturing terminal 2 can be configured by separate image capturing apparatuses as in the present embodiment, or can be configured by the same image capturing apparatus (for example, a digital video camera capable of capturing a still image and a moving image). , Etc.).
[0046]
The video DB 3 is a video storage unit that stores videos captured by the overall image capturing device 1 and the detailed image capturing terminal 2. The video DB 3 includes a database device or a large-capacity storage device connected to the video distribution server 4.
[0047]
The video distribution server 4 is a video distribution unit that manages the video captured by the overall image capturing device 1 or the detailed image capturing terminal 2 and distributes the video stored in the video DB 3 in response to a request from the user terminal 5. is there. The video distribution server 4 can be configured using, for example, a workstation or a personal computer. Note that the video distribution server 4 and the video DB 3 do not necessarily need to be installed at a building site, and may be installed at a remote location as long as video and information can be transmitted and received to and from the overall image capturing device 1 and the detailed image capturing terminal 2. Absent.
[0048]
The type of the user terminal 5 is not limited as long as it is an electronic device that can be connected to a network and includes a video display unit that displays a video. For example, a personal computer, a PDA, a mobile phone, or the like can be suitably used.
[0049]
The functions and operations of the system having the above configuration will be described with reference to the functional block diagram of FIG.
[0050]
Each function shown in FIG. 5 is realized by any one of the overall image capturing device 1, the detailed image capturing terminal 2, the video DB 3, the video distribution server 4, and the user terminal 5. Which device realizes each function can be appropriately changed according to the system configuration or the like.
[0051]
The whole image of the building taken by the whole image pickup device 1 is acquired by the system by the whole image pickup function (1).
[0052]
On the other hand, when capturing a moving image using the detailed image capturing terminal 2, it is necessary to first perform positioning of the capturing start position. This is to ensure the continuity of the entire image and the moving image. For this reason, the present system has a positioning function for performing positioning between the whole image captured by the full image capturing device 1 and the moving image captured by the detailed image capturing terminal 2.
[0053]
First, the photographer uses the detailed image capturing terminal 2 to capture an entire image of the building, and transmits the video to the video distribution server 4 together with a positioning request (2).
[0054]
The video distribution server 4 receives from the detailed image capturing terminal 2 an overall image of the building (referred to as a “second overall image” in order to distinguish it from the entire image captured by the overall image capturing apparatus 1) and a positioning request. Then, the whole image received from the whole image imaging apparatus 1 is compared with the second whole image to generate alignment state information.
[0055]
The positioning state information is information for adjusting a shooting start position of a moving image by the detailed image imaging terminal 2. The video distribution server 4 transmits the positioning status information to the detailed image capturing terminal 2 (3).
[0056]
The alignment state information is displayed on the display unit of the detailed image capturing terminal 2. The photographer adjusts the imaging start position of the detailed image imaging terminal 2 with reference to the displayed alignment state information. Each time the position of the detailed image capturing terminal 2 is adjusted, a position alignment request is made, and the above processing is repeated until the image of the entire image capturing device 1 and the image of the detailed image capturing terminal 2 substantially match.
[0057]
When the adjustment is completed, the photographer starts capturing a moving image. The photographer moves the detailed image capturing terminal 2 toward the capturing location, and captures a moving image that closes up to a detailed image of the entire building from a part thereof (4). Note that a similar moving image may be captured using the zoom function of the detailed image capturing terminal 2. When the photographing is completed, the detailed image capturing terminal 2 transmits the moving image to the video distribution server 4 (5).
[0058]
The video distribution server 4 generates link information for associating a moving image captured by the detailed image capturing terminal 2 with the overall image captured by the overall image capturing device 1 (6). The link information is index information indicating a connection between the entire image and the detailed image. The link information includes information such as a file name of a moving image, coordinate information in a whole image of a part to be brought up by the moving image, a name of the part, and the like. The link information is generated by the link generation function of the video distribution server 4 based on the whole image and the moving image. Alternatively, link information may be generated based on information input when a photographer captures a detailed image.
[0059]
The whole image, moving image, and link information obtained as described above are stored in the video DB 3 by the video distribution server 4 (7).
[0060]
The video distribution server 4 has a video distribution function of distributing a video of a building stored in the video DB 3 to the user terminal 5 in response to a request from the user terminal 5.
[0061]
When the user inputs a request to view the whole image of the building using the user request input function (8), the request is transmitted to the video distribution server 4. The user request processing function of the video distribution server 4 receives a request from the user terminal 5 and notifies the video distribution function of the request. The video distribution function acquires an overall image that matches the user's request from the image DB 3, and transmits the overall image to the user terminal 5 together with link information (9). The whole image and the link information are received by the image presentation function of the user terminal 5, and the image of the entire building is displayed on the image display unit of the user terminal 5 (10). Accordingly, the user can roughly grasp the entire configuration of the building, and can grasp the progress of the construction.
[0062]
As a display mode when displaying the image of the entire building on the user terminal 5, a mode in which the entire image (image) is displayed and link information (character information such as the name of the detailed portion) is displayed in a list, or the entire image is displayed. There is a mode in which only the link information is displayed and the link information is associated with the coordinates of the display image (the link information is invisible).
[0063]
Next, when the user selects link information using the user request input function (8), the selection request is transmitted to the video distribution server 4. The selection request is notified to the video distribution function through the user request processing function. The video distribution function acquires a moving image associated with the selected link information from the video DB 3, and transmits the moving image to the user terminal 5 (9). Upon receiving the moving image, the video presentation function of the user terminal 5 switches the display from the whole image to the moving image (10). Then, a detailed image of the part selected by the user is displayed in close-up on the video display unit.
[0064]
This is similar to the process of moving the viewpoint of oneself to a part of the whole image and approaching it for detailed observation. Therefore, the user can approach the selected part of the building and have a simulated experience like seeing with his own eyes, just like visiting the building site and observing the building Satisfaction can be obtained.
[0065]
In addition, the video distribution server 4 has a photographing location designating unit that allows the user terminal 5 to designate a portion where a detailed image of a moving image is to be photographed. In the present system, a moving image is shot in advance and stored in the video DB 3 at a place where a request for browsing a detailed image is expected to be large, but a place that a user desires to view is not necessarily included therein. Because they are not always there.
[0066]
The photographing location specifying means displays the whole image on the user terminal 5 and allows the user to select a part of the displayed image to specify the photographing location. Implemented as a function.
[0067]
In a state where the whole image is displayed on the user terminal 5, the user can input a designated photographing position using the user request input function (11). The user request processing function of the video distribution server 4 determines whether or not the requested moving image of the designated shooting location is stored in the video DB 3, and if there is no moving image, captures the detailed image of the designated shooting location. The terminal 2 is notified (12).
[0068]
The photographer at the construction site confirms that the designated photographing location has been notified, and operates the detailed image capturing terminal 2 to photograph the location in the same procedure as described above. Then, when the moving image at the designated shooting location is transmitted to the video distribution server 4, it is immediately transmitted to the user terminal 5 by the video distribution function. In this way, a detailed image of a designated shooting location individually requested by the user can be delivered, so that a user-friendly system that can flexibly respond to the needs of the user can be realized.
[0069]
【Example】
Hereinafter, an embodiment for more specifically implementing the present invention will be described in detail with reference to the drawings.
[0070]
(Configuration of video distribution system)
FIG. 6 is a system configuration diagram of the video distribution system of the present embodiment.
[0071]
Here, the video camera 10 is installed at a building site, and is used as an entire image pickup device. The video camera 10 is connected to a server computer 40 constituting a video distribution server. For connection, a wired / wireless LAN, USB, IEEE 1394, composite wire, or the like is used. The detailed image capturing terminal 20 is connected to the server computer 40 via a wireless LAN, Bluetooth, or the like.
[0072]
As the server computer 40, a general computer such as a workstation or a personal computer can be used. The server computer 40 functions as a video distribution server by reading the video distribution program. A video DB is constructed on a storage medium such as a hard disk of the server computer 40. This server computer 40 is connected to the Internet.
[0073]
A remote user uses the computer 50 connected to the Internet as a user terminal.
[0074]
(Configuration of detailed image imaging terminal)
FIG. 7 is a perspective view illustrating an external configuration of the detailed image capturing terminal according to the present embodiment, and FIG. 8 is a block diagram illustrating a hardware configuration of the detailed image capturing terminal.
[0075]
As shown in FIG. 8, the detailed image capturing terminal 20 includes an MM input / output unit 21, an imaging unit 22, an arithmetic unit 23, a memory unit 24, a communication unit 25, an external storage device management unit 26, and a storage device 27. Be composed. The detailed image capturing terminal 20 is operated and managed by a photographer at a building site, and is a device that captures a moving image of a building.
[0076]
The MM (man-machine) input / output unit 21 is a part having an input / output function for the detailed image imaging terminal 20 to exchange various information with the photographer, and includes an input device and an output device.
[0077]
In the present embodiment, as shown in FIG. 7, an operation unit 21a is provided as an input device. The operation unit 21a is a part having a function of operating the detailed image capturing terminal 20 with a push button or the like. It provides functions such as ON / OFF of a switch, instruction of position alignment, start / end of shooting, input of a shooting location name and coordinates, and the like. As the input device, a touch panel, a digitizer, a keyboard, a numeric keypad, a mouse, a bar code reader, and the like can be used. If the input from the photographer can be transmitted to the detailed image imaging terminal 20 as information, the type of the input device can be used. Does not matter.
[0078]
Further, the detailed image capturing terminal 20 includes a display unit 21b as an output device. Since the display unit 21b is configured by a touch panel, it also has a function as an input device. As the output device, a display, a printer, or the like can be used, and any type can be used as long as the detailed image capturing terminal 20 can transmit information to a photographer.
[0079]
The imaging unit 22 is a part having a function of acquiring an external video and converting it into a moving image format that can be processed by a program. For example, a camera or the like is applicable.
[0080]
The calculation unit 23 is a unit having a calculation function for driving and processing each function of the detailed image capturing terminal 20 by executing a program. Generally, it is constituted by a CPU (Central Processing Unit).
[0081]
The memory unit 24 is a part of an execution area where the calculation unit 23 executes a program.
[0082]
The communication unit 25 has a function of controlling communication with an external device via a network such as a wired LAN or a wireless LAN.
[0083]
The external storage device management unit 26 is a unit having a function of controlling input and output of data with various storage devices 27. Examples of the storage device 27 include a hard disk, a flexible disk, a CD-ROM, a CD-R, a magnetic card, and an IC card.
[0084]
The storage device 27 stores a processing program. The processing program is a program necessary for achieving the purpose of use of the detailed image capturing terminal 20. An OS (Operating System) is also included in this.
[0085]
(Configuration of video distribution server)
FIG. 9 is a block diagram showing a hardware configuration of a server computer constituting the video distribution server and the video DB.
[0086]
As shown in the figure, the server computer 40 includes an MM input / output unit 41, a video input unit 42, a calculation unit 43, a memory unit 44, a communication unit 45, an external storage device management unit 46, and a storage device 47. Is done.
[0087]
The video DB 30 is constructed on the storage device 47. As the storage device 47 in which the video DB 30 is constructed, a highly reliable and large-capacity hard disk having a RAID function or the like, or a device such as a CD-R or DVD-RAM having a changer function is suitable. It is also preferable to have an automatic backup function in case of device failure or data corruption.
[0088]
The storage device 47 stores a video distribution program necessary for achieving the purpose of using the video distribution method of the present system.
[0089]
The video input unit 42 is a part having a function of converting an input from the video camera (global image capturing device) 10 into a format that can be processed by a program. That is, when the input from the video camera 10 is an analog signal, the analog signal is sampled and converted into a digital image. In addition, image compression conversion such as JPEG is also performed in order to reduce the data capacity and the distribution load through the network.
[0090]
The other components are almost the same as those of the detailed image capturing terminal 20 having the same name, and thus the description is omitted.
[0091]
(Configuration of user terminal)
FIG. 10 is a block diagram showing a hardware configuration of a computer constituting the user terminal.
[0092]
As shown in the figure, the computer 50 includes an MM input / output unit 51, a calculation unit 52, a memory unit 53, a communication unit 54, an external storage device management unit 55, and a storage device 56.
[0093]
The storage device 56 stores, for example, application software such as a word processor and a spreadsheet and data associated therewith, in addition to a processing program necessary for achieving the purpose of use of the user terminal.
[0094]
The other components are almost the same as those of the detailed image capturing terminal 20 having the same name, and thus the description is omitted.
[0095]
Next, a video acquisition process, a video distribution process, and a process of specifying a shooting location in the video distribution system having the above configuration will be described in detail.
[0096]
(Video acquisition processing)
FIG. 11 is a functional block diagram showing functions related to the video acquisition processing of the detailed image capturing terminal and the video distribution server. FIG. 12 is a flowchart related to a process of acquiring a video of the detailed image capturing terminal, and FIG. 13 is a flowchart related to a process of acquiring a video of the video distribution server.
[0097]
Each function shown in FIG. 11 and each process shown in FIGS. 12 and 13 are realized by reading a program stored in the storage device into the memory unit and executing the program by the arithmetic unit.
[0098]
A video camera 10, which is an entire image capturing apparatus installed at a building site, constantly captures an entire image of a building. The video distribution server receives the whole image from the video camera 10 at predetermined time intervals, such as once every few minutes (step S401), converts it into a digital image such as JPEG, and stores it in the video DB 30 (step S401). S402). The video distribution server causes the video DB 30 to manage the entire image together with information such as the shooting date and time.
[0099]
Next, the video distribution server checks whether or not a positioning instruction has been received from the detailed image capturing terminal (step S403). If there is no request for a positioning instruction, the process returns to step S401 again, and the entire image acquisition process is repeated. As described above, since the whole image is updated as needed, the latest video is distributed in principle when video is distributed.
[0100]
On the other hand, when the detailed image capturing terminal is activated, the detailed image capturing function is activated, and a video is obtained from the capturing unit (step S201). The acquired video is displayed on the MM input / output unit (display unit) (Step S202).
[0101]
Next, the detailed image imaging terminal checks whether or not there is a positioning instruction from the photographer (step S203). If there is no positioning instruction, the process returns to step S201 again, and the image acquisition processing is repeated. If there is a positioning instruction, the positioning instruction is transmitted to the video distribution server (step S204). The positioning instruction can be input by the photographer operating the MM input / output unit (operation unit).
[0102]
Subsequently, the detailed image capturing terminal acquires a video from the imaging unit (Step S205), and transmits the video to the video distribution server (Step S206). Since the video at this time is used for the positioning process in the video distribution server, it is preferable that the entire building be included in order to perform the positioning process accurately and quickly.
[0103]
Upon receiving the request for the positioning instruction from the detailed image capturing terminal, the video distribution server starts the positioning processing (Step S403). First, the video distribution server receives the entire image from the video camera 10 (Step S404) and stores it in the video DB 30 (Step S405). Next, a video (second overall image) transmitted from the detailed image capturing terminal is received (step S406).
[0104]
Then, the video distribution server compares the whole image with the second whole image and calculates an alignment state such as in which direction the photographing angle of the detailed image capturing terminal should be moved and whether the image should be enlarged or reduced ( Step S407). Further, the video distribution server superimposes the whole image and the second whole image, further synthesizes a guide on how to adjust the shooting angle of the detailed image capturing terminal with this image, and obtains the alignment state information. Generate.
[0105]
The video distribution server transmits the generated positioning state information to the detailed image capturing terminal (Step S408). The video distribution server repeats the processing of steps S404 to S408 until receiving a shooting start instruction from the detailed image capturing terminal.
[0106]
Upon receiving the positioning status information from the video distribution server (step S207), the detailed image capturing terminal displays the information on the MM input / output unit (display unit) (step S208). FIG. 14B shows an example of the display screen. Here, since the second whole image taken by the detailed image pickup terminal is shifted to the lower left from the whole image taken by the whole image pickup device, a guide saying "Please adjust to the upper right" is displayed. . The photographer moves the detailed image capturing terminal in accordance with the instructions of the adjustment guide to perform positioning.
[0107]
The detailed image capturing terminal repeats the processing of steps S205 to S208 until a photographing start instruction is input from the photographer (step S209). Therefore, as the photographer moves the detailed image capturing terminal, the positioning state information displayed on the display unit is also updated, and it is possible to confirm whether the current photographing position is appropriate. When the position of the whole image matches the position of the second whole image, a guide to the effect that "positioning is completed and start imaging" is displayed on the display unit. In this way, the photographing start position of the detailed image capturing terminal can be easily and accurately adjusted by referring to the alignment state information.
[0108]
Next, the photographer operates the MM input / output unit (operation unit) and inputs a photographing start instruction. At this time, the operation unit is operated to input a name of a shooting location where a detailed image is to be shot and coordinates in the whole image. Upon receiving the shooting start instruction (step S209), the detailed image imaging terminal transmits the shooting start instruction to the video distribution server (step S210).
[0109]
Then, the detailed image capturing terminal starts capturing the detailed image, and transmits the captured video to the video distribution server (steps S211 to S213). As shown in FIG. 14C, the photographer shoots a close-up video while moving the detailed image imaging terminal toward the shooting location. When the detailed image of the shooting location is completed, the operation unit is operated to input a shooting end instruction. Upon receiving the shooting end instruction (step S214), the detailed image imaging terminal transmits the shooting end instruction to the video distribution server and ends the process (step S215).
[0110]
On the other hand, when receiving the shooting start instruction from the detailed image imaging terminal, the video distribution server generates link information from the name and coordinates of the shooting location included in the information and records the link information in the video DB (step S410). Next, the video distribution server captures the whole image and records it in the video DB (steps S411 and S412), and then receives the detailed image from the detailed image capturing terminal and records it in the video DB (step S413). Step S414). Then, when receiving the photographing end instruction from the detailed image imaging terminal, the processing of acquiring the detailed image is terminated, and the process returns to the normal routine for periodically acquiring the entire image (step S415).
[0111]
As described above, the entire image capturing apparatus, the detailed image capturing terminal, and the video distribution server cooperate with each other, and the entire image of the building, a moving image that closes up from the entire building to a detailed image of a part thereof, and In addition, acquisition and generation of link information for associating a moving image with an entire image are performed.
[0112]
(Video distribution processing)
FIG. 15 is a functional block diagram illustrating functions related to video distribution processing of the video distribution server and the user terminal. FIG. 16 is a flowchart relating to video distribution processing of the video distribution server, and FIG. 17 is a flowchart relating to video distribution processing of the user terminal.
[0113]
Each function shown in FIG. 15 and each process shown in FIGS. 16 and 17 are realized by a program stored in the storage device being read into the memory unit and executed by the arithmetic unit.
[0114]
The video distribution server has a WWW server function and is always in a state of waiting for a video distribution request from a user terminal (steps S420 and S421).
[0115]
When the user performs an input to view the entire image at the user terminal, the user terminal receives the request from the MM input / output unit and requests the video distribution server to transmit the entire image (step S501). Upon receiving the whole image transmission request from the user terminal (step S422), the video distribution server extracts the whole image from the video DB based on the request, and transmits the whole image to the user terminal (step S423). The user terminal receives the whole image from the video distribution server and displays the whole image on the MM input / output unit (step S502).
[0116]
Subsequently, the user terminal requests the video distribution server to transmit link information (step S503). Upon receiving the link information transmission request from the user terminal (step S424), the video distribution server extracts link information from the video DB based on the request and transmits the link information to the user terminal (step S425). The user terminal receives the link information from the video distribution server, and displays the link information on the MM input / output unit (Step S504).
[0117]
An example of the display screen of the user terminal at this time is shown in FIG. In this example, a list of link information is displayed together with the image of the overall image of the building. The user can observe the whole building by seeing the display image.
[0118]
The link information indicates a shooting location (detailed point) where a moving image for displaying a detailed image is prepared. The user can know the detailed image that can be browsed by looking at the list of the detailed points. The link information is displayed in a selectable manner by clicking with a mouse pointer or the like. In this example, the link information is explicitly displayed. However, the link information can be made invisible information by associating the link information with the coordinates of the entire image.
[0119]
When the user selects any of the link information on the entire display screen, the user terminal receives the selection request from the MM input / output unit and transmits information indicating that the link has been selected to the video distribution server ( Step S505, step S506). Upon receiving the link selection information from the user terminal (step S426), the video distribution server extracts a detailed image (moving image) associated with the selected link information from the video DB (step S427), and extracts the detailed image. The message is transmitted to the user terminal (step S428). The user terminal receives the detailed image from the video distribution server, switches to the entire image being displayed, and reproduces and displays the moving image of the detailed image (step S507).
[0120]
An example of the display screen of the user terminal at this time is shown in FIG. In this example, the link information of the base (1) is selected from the detailed points, and the base part is displayed in an enlarged manner. The user can perform detailed observation of the building by watching a moving image that is displayed in close-up from the entire image to the detailed image of the base portion. When "Replay" on the display screen is selected, the moving image is replayed. When "Return to whole image" is selected, the screen of FIG. 18A is displayed again. By repeatedly performing the whole observation and the detailed observation, the user can have the same simulated experience as actually observing with his / her own eyes.
[0121]
(Designation of shooting location)
FIG. 19 is a functional block diagram showing functions related to a process of designating a shooting location of the video distribution server, the detailed image capturing terminal, and the user terminal. FIG. 20 is a flowchart relating to a process of designating a shooting location of the video distribution server, the detailed image capturing terminal, and the user terminal.
[0122]
Each function shown in FIG. 19 and each process shown in FIG. 20 are realized by a program stored in a storage device being read into a memory unit and executed by an arithmetic unit.
[0123]
When performing the process of designating a photographing place, first, a photographing place designation screen shown in FIG. 21 is displayed on the user terminal. On this screen, the entire image of the building is displayed, and a message indicating "Please specify a location to be photographed" is displayed. The user can specify a shooting location by selecting a part of the displayed image with a mouse pointer or the like.
[0124]
When the user terminal acquires the designation of the imaging location from the user from the MM input / output unit (step S520), the user terminal transmits the imaging location designation information to the video distribution server (step S521). Upon receiving the shooting location designation information from the user terminal (step S440), the video distribution server transmits a notification that there is a request for shooting a detailed image to the detailed image imaging terminal (step S441). Upon receiving the photographing request from the video distribution server (step S220), the detailed image photographing terminal displays a photographing location instruction screen on the MM input / output unit (display unit).
[0125]
FIG. 14A shows an example of the display screen of the detailed image imaging terminal at this time. In this example, a screen in which a mark is given at a place where a photographing request is made is displayed over the whole image of the building. By looking at this screen, the photographer can accurately grasp the place where the photographing is requested.
[0126]
When photographing a detailed image of a place where photographing is requested, the photographer first selects a mark on the display screen. When the mark is selected, the detailed image capturing terminal automatically calculates coordinates in the entire image and transmits a positioning instruction to the video distribution server. Subsequent processing is performed in the same manner as the above-described “video acquisition processing”.
[0127]
The captured detailed image is immediately transmitted to the user terminal. In this way, a detailed image of a designated shooting location individually requested by the user can be delivered, so that a user-friendly system that can flexibly respond to the needs of the user can be realized.
[0128]
【The invention's effect】
As described above, the present invention distributes an entire image of an imaging target and a moving image that closes up from the entire imaging target to a detailed image of a part thereof, so that a user at a remote location can easily In addition, the user can browse the image of the object to be photographed in the same manner as when actually observing with his own eyes.
[0129]
Further, since the link information to the detailed image can be selected on the display screen of the entire photographing object, it is possible to easily grasp which part of the entire photographing object the detailed image corresponds to.
[0130]
Furthermore, since the detailed image is displayed by a moving image that closes up from the entire object to a detailed image of a part thereof, it is possible to guarantee that the detailed image is an enlarged part of the object to be captured, System reliability is improved.
[0131]
Therefore, the present invention can be suitably used, for example, for the purpose of making it possible to view an image of a house under construction at any time on a computer (user terminal) of a construction worker. As a result, it is possible to take into account the “frustration” of the constructor who cannot visit the construction site.
[0132]
In addition, the present invention, in addition to the above objects, for example,
・ The purpose of certifying the manufacturer's responsibility of the building by making the construction process of the building visible to the construction owner and recording it as a video.
-The purpose of explaining the quality (commercial value) of a building (used property) at the time of buying and selling of the building using the recorded video of the building process,
It can also be used.
[0133]
Generally, once a building is completed, it is very difficult to identify its quality. The above applications focus on this point, and by recording in detail the images of the building process from the start of construction to completion, it is possible to consider leaving evidence to guarantee the quality of the building .
[Brief description of the drawings]
FIG. 1 is a diagram illustrating the concept of a video distribution system.
FIG. 2 is a diagram illustrating a video distributed by a video distribution system.
FIG. 3 is a diagram illustrating an example of a display screen on a user terminal.
FIG. 4 is a system configuration diagram of a video distribution system.
FIG. 5 is a functional block diagram of the video distribution system.
FIG. 6 is a system configuration diagram illustrating a configuration according to an embodiment of a video distribution system.
FIG. 7 is a perspective view illustrating an external configuration of a detailed image capturing terminal.
FIG. 8 is a block diagram illustrating a hardware configuration of a detailed image capturing terminal.
FIG. 9 is a block diagram illustrating a hardware configuration of a server computer configuring the video distribution server.
FIG. 10 is a block diagram illustrating a hardware configuration of a computer constituting the user terminal.
FIG. 11 is a functional block diagram illustrating functions related to a video acquisition process of a detailed image capturing terminal and a video distribution server.
FIG. 12 is a flowchart related to a video acquisition process of a detailed image capturing terminal.
FIG. 13 is a flowchart relating to a video acquisition process of the video distribution server.
FIG. 14 is a diagram illustrating an example of a display screen in the detailed image capturing terminal.
FIG. 15 is a functional block diagram illustrating functions related to video distribution processing of the video distribution server and the user terminal.
FIG. 16 is a flowchart related to a video distribution process of a video distribution server.
FIG. 17 is a flowchart related to a video distribution process of a user terminal.
FIG. 18 is a diagram illustrating an example of a display screen related to a video distribution process of a user terminal.
FIG. 19 is a functional block diagram illustrating functions related to a process of designating a shooting location of a video distribution server, a detailed image capturing terminal, and a user terminal.
FIG. 20 is a flowchart relating to a process of designating a shooting location of a video distribution server, a detailed image capturing terminal, and a user terminal.
FIG. 21 is a diagram illustrating an example of a display screen related to a process of designating a shooting location of a user terminal.
FIG. 22 is a diagram illustrating the positioning of a house for a family.
FIG. 23 is a diagram illustrating a psychological state of a family when a new house is built.
FIG. 24 is a diagram illustrating the purpose of a family visiting a construction site.
FIG. 25 is a diagram illustrating a problem of a conventional video distribution system.
[Explanation of symbols]
1 Whole image imaging device
2 Detailed image imaging terminal
3 Video DB
4 Video distribution server
5 User terminals
10 Video camera
20 Detailed image imaging terminal
21 MM input / output unit
21a Operation unit
21b Display section
22 Imaging unit
23 arithmetic unit
24 Memory section
25 Communication unit
26 External storage device management unit
27 Storage
30 Video DB
40 server computer
41 MM input / output unit
42 Video input section
43 Arithmetic unit
44 Memory section
45 Communication unit
46 External storage device management unit
47 storage device
50 Computer
51 MM input / output unit
52 arithmetic unit
53 Memory section
54 Communication unit
55 External storage device management unit
56 storage devices

Claims (17)

The whole image of the photographing object, a moving image that closes up from the whole photographing object to a detailed image of a part thereof, and a video storage unit that stores link information that associates the moving image with the whole image,
Sending the whole image and the link information stored in the video storage means to the user terminal in response to a request from the user terminal, and displaying an image of the entire shooting target,
A video distribution server that, when the link information is selected at the user terminal, transmits the associated moving image to the user terminal and displays a detailed image of the part in a close-up view. 2. The video distribution server according to claim 1, further comprising a positioning unit for performing positioning between the whole image and the moving image. The positioning means,
Based on the whole image and the second whole image captured by the detailed image capturing unit that captures the moving image, alignment state information for adjusting the shooting start position of the moving image by the detailed image capturing unit is provided. The video distribution server according to claim 2, which generates the video. The video distribution server according to claim 3, wherein the positioning state information includes an image obtained by superimposing the whole image and the second whole image. The video distribution server according to any one of claims 1 to 4, further comprising: a photographing location specifying unit configured to specify a portion of the moving image at which the detailed image is to be captured by the user terminal. 6. The video distribution server according to claim 5, wherein the photographing location specifying means displays the whole image on the user terminal and designates a photographing location by selecting a part of a display image. A video distribution server according to claim 1 or 2, which is communicably connected to the video distribution server,
Means for shooting the moving image to close up from the entire shooting target to a detailed image of a part thereof,
Means for transmitting the captured moving image to the video distribution server,
A detailed image imaging terminal comprising: Is connected communicably to the video distribution server according to claim 2,
Means for photographing a second overall image of the photographing object;
Means for transmitting the captured second overall image to the video distribution server;
Means for receiving positioning state information for adjusting the shooting start position of the moving image by the detailed image imaging terminal, wherein the positioning means is generated based on the whole image and the second whole image;
Display means for displaying the received alignment status information;
Means for shooting the moving image to close up from the entire shooting target to a detailed image of a part thereof,
Means for transmitting the captured moving image to the video distribution server,
A detailed image imaging terminal comprising: A video distribution server according to claim 1 or 2, which is communicably connected to the video distribution server,
Means for photographing the entire image of the photographing object;
Means for transmitting the photographed whole image to the video distribution server,
An overall image pickup device comprising: It is connected to a video storage unit that stores an entire image of the imaging target, a moving image that closes up from the entire imaging target to a detailed image of a part thereof, and link information that associates the moving image with the entire image. It is configured to be able to communicate with a video distribution server, receives the whole image and the link information stored in the video storage means from the video distribution server, and displays an image of the entire photographing target,
A user terminal that receives the moving image associated with the video distribution server by selecting the link information, and displays a detailed image of the part in a close-up view. The user terminal according to claim 10, wherein a portion where a detailed image of the moving image is to be photographed can be specified for the video distribution server. 12. The user terminal according to claim 11, wherein the photographing location can be designated by displaying the whole image and selecting a part of the display image. It is connected to a video storage unit that stores an entire image of the imaging target, a moving image that closes up from the entire imaging target to a detailed image of a part thereof, and link information that associates the moving image with the entire image. Computer
Transmitting the whole image and the link information stored in the video storage unit to the user terminal in response to a request from the user terminal, and displaying an image of the entire photographing target;
When the link information is selected at the user terminal, transmitting the associated moving image to the user terminal, and a close-up display of a detailed image of the portion,
Video delivery method to do. Said computer,
A step of receiving a moving image that closes up the entire image of the imaging target and a detailed image of a part of the entire imaging target,
Generating link information that associates the moving image with the overall image;
Storing the overall image, the moving image, and the link information in video storage means;
14. The video distribution method according to claim 13, wherein the method is performed. Said computer,
Receiving a second overall image of the object to be photographed from detailed image capturing means for capturing the moving image;
Based on the received whole image and the second whole image, generating alignment state information for adjusting a shooting start position of the moving image by the detailed image capturing unit;
Transmitting the alignment state information to the detailed image capturing means;
The video distribution method according to claim 13, wherein the video distribution is performed. Transmitting, to a computer, a first image of the photographing target photographed by the first imaging device;
Transmitting, to the computer, a second image of the object to be captured, which is captured by a second imaging device capable of capturing a moving image;
The computer generates, based on the first image and the second image, alignment state information for adjusting a shooting start position of a moving image by the second imaging device, and stores the alignment state information in the second image. (2) transmitting to the imaging device;
Displaying the positioning information on a display unit of the second imaging device to perform positioning of a shooting start position of a moving image;
Image alignment method including Transmitting, to a computer, a first image of the photographing target photographed by the first imaging device;
Transmitting, to the computer, a second image of the object to be captured, which is captured by a second imaging device capable of capturing a moving image;
The computer generates, based on the first image and the second image, alignment state information for adjusting a shooting start position of a moving image by the second imaging device, and stores the alignment state information in the second image. (2) transmitting to the imaging device;
Displaying the positioning information on a display unit of the second imaging device to perform positioning of a shooting start position of a moving image;
After determining a shooting start position, shooting a moving image of the shooting target by the second imaging device;
A moving image capturing method including:

Images