JP2007166036A - Video generation program, video generation support program, and event video generation method - Google Patents

Abstract

An object of the present invention is to make it possible to generate a multifaceted image only when a target event occurs by linking a plurality of photographing devices.
[Solution]
The video device encodes the video received from the imaging means and stores it in the storage means as video information, and a predetermined event occurs based on event detection index information defined for each event type and detection information received from various sensors. The video generation request information generated based on the video generation conditions stored in the storage means in advance corresponding to the event detection index is transmitted to another video device, and the position and orientation are detected at a predetermined time interval. When the position and orientation information received from the means is stored in the storage means, and it is determined that the own image generation device is the target device for the image generation request based on the image generation request and the position and orientation information received from the other image generation device In this case, the partial video information corresponding to the video generation request is cut out from the video information and transmitted to the video generation request source.
[Selection] Figure 1

Description

  The present invention relates to event video generation, and more particularly to a technique for generating only video related to a predetermined event from videos taken by a plurality of imaging devices.

  Depending on various conditions such as the distance / direction to the object to be imaged, obstacles, weather, and lens characteristics, there is a limit to the images that can be captured by a single image capturing device. In addition, it is very difficult to capture an image related to an event that cannot be predicted such as a traffic accident with a single imaging device. Therefore, the images you want to keep as a scoop or personal memories can be used not only with images taken with one specific shooting device, but also with images taken with shooting devices in other places. Convenient.

  As a related prior art, when the water level at a specific location in a river rises above a preset level during rain, not only the water level at this specific location but also the water level at other locations To be able to grasp at the same time, or when a person or a car enters the area that needs to be monitored, not only the situation of that area but also the situation of areas other than that area can be grasped In addition, when a plurality of photographing devices and a monitoring device are connected via a communication network and the existence of a monitoring target is determined by the photographing device, a plurality of photographing devices managed by one group set in advance by the monitoring device are used. The image information is stored in the hard disk of the image capturing device, and after the storage is started, the request information is transmitted from the monitoring unit, whereby each image capturing device is stored. Technology related monitoring system configured to simultaneously display the image information stored to the display device of the monitoring device is disclosed in (for example, see Patent Document 1).

Also, when the moving body moves, image data around the moving body is stored, each image data indicates the situation around the moving body at which position, and image data representing the situation around the moving body at a certain position In order to be able to easily and accurately know which is the image, the photographing means attached to the moving body so that the image around the moving body can be photographed, and the image capture for capturing image data from the photographing means. Capturing means, position data generating means for providing position data of the moving body, capture signal generating means for generating a capture signal for instructing the image capture means to capture, and capture by the image capture means Disclosed is a technique relating to a monitoring system for a moving body having storage means for associating and storing image data and position data given by the position data generating means at the time of capture. That (for example, see Patent Document 2).
JP 2003-284062 A (page 2-3) JP 2000-172982 A (Page 5-6)

  The technique disclosed in Patent Document 1 includes a plurality of photographing devices having a communication unit and a monitoring device. When one of the photographing devices determines a monitoring target, the photographing device in the group preset by the monitoring device performs photographing. It is what you do. However, only shooting devices in a preset group are allowed to perform shooting, and other shooting devices are appropriately set based on information such as the position of the shooting device that requested the shooting and the shooting direction of the shooting camera. There is no mechanism to select or prevent unnecessary video generation.

  The technique disclosed in Patent Document 2 is a monitoring system for a moving body that captures a situation around the moving body. When the operation of the occupant of the moving body or the value of acceleration exceeds a threshold, video capture is performed. Is possible. However, the technique disclosed in Patent Document 2 can only use an image taken by a photographing device installed in one moving body, and cannot take an image that becomes a blind spot around the moving body.

  In order to solve the above-described problems, an object of the present invention is to make it possible to generate a multifaceted image only when a target event occurs by linking a plurality of photographing apparatuses.

  1 and 2 are diagrams showing the overall configuration of an embodiment of the present invention. The event video generation program of the present invention is a program that operates on a computer that behaves as the video generation device 10 provided in the mobile body 1 or the permanent facility shown in FIG. 1, and is an encoding unit 12 (the encoding step in claim 1 is performed). Executes.) Encodes the video received from the photographing means 3 and stores it in the storage means 2 as video information, and the event detection means 15 (executes the event detection step in claim 1) stores in the storage means 2 in advance. Event detection index information defined for each type of event, detection information received from various sensors such as the position / orientation detection means 4 and the acceleration detection means 5, and input from the image generation request input means 6 Based on the event occurrence information, the occurrence of a predetermined event is detected, and video generation requesting means 1 According to the event detected by the event detection means 15 based on the video generation conditions stored in the storage means 2 in advance corresponding to the event detection index. Generated video generation request information.

  The movement history management means 11 (execution of the movement history management step in claim 1) stores the position and orientation information received from the position and orientation detection means 4 at predetermined time intervals in the storage means 2, and the request target determination means 17 ( (The request target determination step in claim 1 is executed.) Is based on the video generation request information received from another video generation device and the position and orientation information, whether the own video generation device is the target device of the video generation request. The video cutout means 13 (executes the video cutout step in claim 1) determines the video generation request information received from another video generation device or the partial video information corresponding to the video generation conditions as the video information. The communication means 16 (executes the communication step in claim 1) sends and receives video generation request information to other video generation devices, By transmitting the partial video clipped by the video cutout means 13 or the holding information of the partial video to the video generation request source video generation device and receiving the video corresponding to the video generation request information transmitted from the own video generation device If there is a mobile body or a permanent facility with the same function in the vicinity, it is possible to generate a multifaceted video at the time of the event occurrence, and it is possible to acquire a video with high utility value.

  The request target determination unit 17 is shorter than the designated value set in advance at the video generation request time at the video generation request time and the video generation request source exists in the shooting direction of the shooting unit, or By generating video when the subject that the video generation request source is shooting is included in the shooting area of the shooting means, it is possible to extract only appropriate ones from a plurality of moving bodies, permanent facilities, etc. Only an image including the subject can be generated.

Further, the movement history management means 11 of the video generation program stores the position and orientation information received from the position and orientation detection means at a predetermined time interval in the storage means, and the position and orientation information corresponds to the identification information of the own video generation device. The video cutout means 13 cuts out the video generation request information received from the server 7 or the partial video information corresponding to the video generation conditions from the video information, and the communication means 16 generates the video for the server 7. Transmission / reception of request information, transmission of the partial video clipped by the video cutout means 13 or the holding information of the partial video to the server 7, and reception of video corresponding to the video generation request information transmitted from the self-video generation device; The image generation request receiving means 71 of the image generation support program 70 operating on the server 7 shown in FIG. Receiving a video generation request from a plurality of video generation apparatuses, and a position / orientation information receiving means 72 (executing the position / orientation information receiving step in claim 4). Position / orientation information is received from the generating apparatus at predetermined time intervals, the position / orientation information is stored in a storage unit in association with the received identification information of the image generating apparatus, and a request destination determining unit 73 (request in claim 4). The first determination step is executed). The distance from the video generation request source at the video generation request time specified in the video generation request is shorter than the specified value, and the video generation request source exists in the shooting direction of the shooting camera. The video generation request destination is a moving body, permanent equipment, or the like, or a moving body or permanent equipment that is included in the shooting area of the shooting camera. The video generation request transmission means 74 (executes the request destination determination step in claim 4) determines the video generation request received by the video generation request reception step by the request destination determination means 73. The video receiving means 75 (executes the video receiving step in claim 4) receives the video from the video generation request destination and executes the video distributing means 76 (executes the video receiving step in claim 4). ) Transmits the video received by the video reception means to the video generation request source, so that the server can collectively manage the position and orientation information of each video generation device, so that the video generation requirement in the video generation request is simply satisfied. Not only that, it is possible to determine the optimal video generation device that meets the video generation requirements, and to generate the optimal video for each event It can become.

  It is possible to generate a multifaceted image only when a target event occurs by linking a plurality of photographing devices.

(Example)
1 and 2 are diagrams showing the overall configuration of an embodiment of the present invention. The event video generation program of the present invention is a program that operates on a computer that behaves as the video generation device 10 provided in the mobile unit 1 or a permanent facility shown in FIG. 1, and the encoding unit 12 is a photographing unit such as a video camera. The video received from 3 is encoded and stored in the storage means 2 as video information, and the event detection means 15 is an event defined for each event type as shown in FIG. The occurrence of a predetermined event based on the detection index information and detection information received from various sensors such as the position / orientation detection means 4 and the acceleration detection means 5 and event generation information input from the video generation request input means 6. The video generation requesting means 14 is stored in advance in the storage means 2 in association with the event detection index. It was based on the video generation conditions shown in Figure 4, the event detecting unit 15 generates a video generation request information corresponding to the event detected.

  The movement history management means 11 stores the position and orientation information received from the position and orientation detection means 4 at a predetermined time interval in the storage means 2, and the request target determination means 17 receives the video generation request information received from the other video generation device. Based on the position and orientation information, it is determined whether or not the own video generation device is the target device for the video generation request, and the video cutout means 13 receives the video generation request information received from another video generation device or the video The partial video information corresponding to the generation conditions is cut out from the video information, and the communication unit 16 transmits / receives video generation request information to / from another video generation device, and the partial video clipped by the video cut-out unit 13 or the holding information of the partial video By transmitting to the image generation request source image generation device and receiving the image corresponding to the image generation request information transmitted from the own image generation device If there is mobile or permanent facility or the like having the same functions in the neighborhood, can be multi-faceted generate video at the time of the event, can be obtained with high utility value image.

  The request target determining unit 17 determines that the distance from the video generation request source at the video generation request time is shorter than a specified value and the video generation request source exists in the shooting direction of the shooting unit, or the video generation request source is When a subject to be photographed is included in the photographing area of the photographing means, by generating a video, it is possible to extract only appropriate ones from a plurality of moving bodies, permanent facilities, etc., and a video including the target subject Can only be generated.

The movement history management means 11 of the video generation program stores the position and orientation information received from the position and orientation detection means at predetermined time intervals in the storage means, and the position and orientation information is used as identification information of the own video generation device. The video cutout unit 13 cuts out the video generation request information received from the server 7 or the partial video information corresponding to the video generation condition from the video information, and the communication unit 16 Transmission / reception of video generation request information to the server, transmission of the partial video clipped by the video cutout means 13 or the holding information of the partial video to the server 7, and reception of video corresponding to the video generation request information transmitted from the self-video generation device The video generation request receiving means 71 of the video generation support program 70 operating on the server 7 shown in FIG. The image generation request is received from the image generation device, and the position / orientation information receiving means 72 receives the position / orientation information from the plurality of image generation devices at a predetermined time interval and associates the received information with the received identification information of the image generation device. The location information is stored in a storage unit, and the request destination determination unit 73 has a distance from the video generation request source at the video generation request time specified in the video generation request that is shorter than a specified value, and Video generation request destination is a moving body or permanent equipment that has a video generation request source in the shooting direction, or a moving body or permanent equipment that has a subject to be shot by the video generation request source in the shooting area of the shooting camera. The video generation request transmitting unit 74 transmits the video generation request received in the video generation request receiving step to the video generation request destination determined by the request destination determining unit 73, and The receiving means 75 receives the video from the video generation request destination, and the video distribution means 76 transmits the video received by the video receiving means to the video generation request source, so that the server Since azimuth information can be managed collectively, it is possible not only to satisfy the video generation requirements in the video generation request, but also to determine the optimal video generation device that meets the video generation requirements, and the optimal for each event An image can be generated.

  FIG. 3 shows an example of movement history data in the present invention. The movement history data includes position information and azimuth information received from position / azimuth detection means composed of a position sensor (for example, GPS (Global Positioning System)) and a direction sensor (for example, gyrocompass) connected to the video generation device. Is stored together with the time when is detected. It is assumed that the position sensor and the direction sensor are set so that the measurement times are synchronized with each other.

  The date and time measured in the date and time column, and the value of the X coordinate corresponding to the measured date and time (the value obtained directly from the position sensor, the unit is not particularly limited) in the place: X coordinate column are the location: Y The coordinate field stores the value of the Y coordinate corresponding to the measured date and time (a value obtained directly from the position sensor, the unit is not particularly limited), and the direction field stores the azimuth corresponding to the measured date and time as an angle. .

  FIG. 4 shows an example of event definition data in the present invention. The event definition data stores an event detection index and a video generation condition when an event occurs in advance before operating the event video generation system using the video generation apparatus of the present invention. The event detection index defines what conditions the video generation device recognizes when an event has occurred, and the one shown in FIG. 4 is merely an example and can be arbitrarily defined. is there. In the present embodiment, when “collision” is defined as the event type, “acceleration change” is used as the event detection index. When the impact acceleration detected by the acceleration detection means connected to the video generation device is larger than a preset threshold, the video generation device recognizes “collision”.

  In this embodiment, in addition to “collision”, when input from the video generation request input means connected to the video generation device (“Video generation request input” field is “ON”), “video generation command”, When a video generation request is received from the camera (“Video generation request from other device” field is “Yes”), “Video generation request from other device”, pre-specified time (“Video generation time” field) “Date and time” is set), “Advance video generation command 1”, when the mobile body reaches a preset position (position information is set in the “Video generation point” field) This indicates that it is recognized that the event “preliminary video generation command 2” has occurred.

  Further, the video generation condition defines a condition for what video is generated when an event occurs. In this embodiment, “Pre-video generation time”, “Post-video generation time”, and “Video generation request to other device” columns are provided, but any video generation condition can be defined. In the “Pre-video generation time” column, define how long before video generation starts from the time when the event occurred, and in the “Post-video generation time” column, define how long video generation should start from the time when the event occurred To do. As a result, the circumstances before and after the occurrence of the event can be known, and a more effective event video can be generated. For example, when a “collision” event occurs, video generation is started from T1b (time) before “collision” and video generation is performed until T1a (time) after “collision”. For example, it is possible to generate a video from when it is stopped until it stops, which is very effective in investigating the cause of “collision”. The “video generation request to other device” column indicates whether a video generation request is made to the other device according to the event.

  FIG. 5 is a flowchart showing an event detection processing procedure according to the present invention. First, the predefined event definition data shown in FIG. 4 is read from the storage means 2 (S501). Position / orientation information detected by the position / orientation detection means 4 every predetermined time, acceleration information detected by the acceleration detection means 5, a video generation command input from the video generation request input means 6, and a video generation request from another device are received. Then, it is determined whether or not the received information satisfies the event detection index of the event definition data (S502). If not, the process returns to S502 and waits until detection information from each sensor is received or a video generation command is input.

  If it is satisfied, it is determined whether or not the video generation request is from another device based on the “video generation request source ID” set in the video generation request (S503), and the video generation request from the other device is determined. If not, the video generation request process shown in FIG. 6 is CALLed (S505). At this time, the video generation condition corresponding to the event determined in S502 and the video generation request are set in the parameters notified to the video generation request process. When the video generation request process is CALLed, it is confirmed whether or not an end notification command has been received from the outside to the event generation program (S512). If it has been received, this process ends. If not, the process returns to S502. Wait until detection information from each sensor is received or a video generation command is input.

  If it is a video generation request from another device in S503, it is determined whether the request is from the server based on the “video generation request source ID” set in the video generation request (S504). If there is, the process proceeds to S511. If there is no request from the server, the position / orientation information of the own device at the “event detection time” set in the video generation request is calculated from the movement history data (S506). Next, the distance from the video generation request source is calculated from the position / direction information of the own device and the “position / direction at the time of event detection” set in the video generation request (S507), and the video generation support conditions set in advance are calculated. (S508). If the allowable value δ is exceeded, the device does not become a target of video generation support, and the process proceeds to S512. The distance between the device itself and the image generation request source can be calculated by, for example, (Equation 1).

((X _B −X _A ) ² + (Y _B −Y _A ) ² ) ^1/2 (Formula 1)

If the allowable value δ is not exceeded, it is checked whether or not a video generation request source exists in the photographing direction of the own device, which is the next video generation support condition. First, the direction φ of the other machine that is the video generation request source for the own machine is calculated (S509). For example, if the direction of the moving body B in the moving body A is determined by arc tangent, (Formula 2) is obtained.

arctan ((Y _B −Y _A ) / (X _B −X _A )) (Equation 2)

If this value is between the shooting directions θ _A1 and θ _A2 of the moving object A, the requesting moving object B exists in the own shooting direction. The permissible value δ may be set in advance from the distance that can be photographed by the photographing means, the usage scene, or the like as in the present embodiment, or may be notified to each moving body from the video generation request source. .

  It is determined whether or not there is a video generation request source in the shooting direction of the own device (S510), and if it does not exist, the own device is not a target for video generation support, and the process proceeds to S512. If it exists, it will be the target of video generation support, so the video generation condition / video generation request from another device is set in the parameter, and the video generation request processing shown in FIG. The process proceeds to S511) and S512. In S512, it is determined whether or not a processing end notification is input to the video generation program. If the notification is received, the processing is ended. WAIT until a video generation command is input.

FIG. 6 is a flowchart showing the processing procedure of the video generation request processing in the present invention. In order to cut out the video from the calling parameters, the event detection time, the pre-video generation time, and the post-video generation time are extracted, and the video start time and video end time are calculated (S601). Video start time at the time of the cut-out of the video: T _in the video end time: T _out is comprised of the event detection time T _e, the video generation before time t _pre, the post-video generation time as follows and t _post .

Video start time T _in: T _e -t _pre
Video end time T _out : _Te + t _post
Subsequently, the video corresponding to the video start time and video end time is cut out from all the videos accumulated and stored in the storage means, and after setting the video ID for identifying the video (S602), the call parameter is sent to the other device. It is determined whether or not a video generation request is set (S603).

  If the video generation request to the other device is set, the video generation request to the other device is set, the video generation request is transmitted to the other peripheral device or the server, and the video generation response from the other device is sent. WAIT to receive (S604). When a video generation response is received from another device (S605), the video acquired based on the video storage destination information set in the video generation response or the video set in the video generation response is stored in the storage unit (S606).

  When the video generation request to the other device is not set, it is determined whether the video generation request from the other device is set in the calling parameter (S607), and the video generation request from the other device is not set. If so, the process ends. If a video generation request from another device is set, a video generation response as shown in FIG. 13 is generated and transmitted to the video generation request source (S608), and the process ends. Whether to send a video generation request to the server or to another device, attach the video as it is in the video generation response, or set the video save information is defined in advance when customizing the video generation program etc. To do.

  FIG. 7 is a flowchart showing the processing procedure of the server in the present invention. It is determined whether or not a processing end notification has been input to the video generation support program (S701). If notified, the processing ends, and if not, the position and orientation information of all the moving objects is acquired (S702). ) And stored in the mobile object information DB (S703). As for the acquisition method, it may be acquired by polling from the server at a preset time interval for each moving object, or from the moving object at a preset time interval. Information may be transmitted. Since this process is not an essential part of the present invention, the details of the process are omitted. The moving body information DB is a database in which a set of moving body history data of each moving body shown in FIG. 2 is associated with identification information (ID) of each moving body.

  It is determined whether or not a video generation request from the mobile unit has been received (S704). If a video generation request from the mobile unit has not been received, the process returns to S701, which is the head of the process. If it is received, the video generation request processing is performed as follows for all moving objects. First, the variable j is initialized to 0 (S705). In order to process the next mobile object, the value of the variable j is updated by adding 1 (S706), and it is determined whether or not the value of the variable j exceeds N, which is the total number of mobile objects (S707). If it has exceeded, it means that the video generation request processing has already been completed for all the mobile bodies, so the video generation responses received from each mobile body are collectively transmitted to the video generation request source (S709), and the process proceeds to S701. Return.

  Whether or not the moving object being processed is a video generation request source is compared with the value of j and the video generation source ID (in this embodiment, the moving object ID for identifying the moving object is a natural number from 1 to N). (S708). If it is a video generation source, the process returns to S706. If it is not the video generation source, the position / orientation information of the moving body j at the “event detection time” set in the video generation request is calculated from the moving body information DB (S710). Next, the distance from the image generation request source is calculated from the position and orientation information of the moving body j and the “position direction at the time of event detection” set in the image generation request (S711), and the image generation support set in advance is calculated. The condition is compared with an allowable value δ (S712). If the allowable value δ is exceeded, the moving object j is not a target for video generation support, and the process returns to S706.

  If the allowable value δ is not exceeded, it is checked whether a video generation request source exists in the shooting direction of the moving object j, which is the next video generation support condition. First, the direction φ of the video generation request source for the moving object j is calculated (S713). Next, it is determined whether or not there is a video generation request source in the shooting direction of the moving body j (S714). If it exists, it is set as a video generation request because it is an object of mobile j video generation support, and the video generation request shown in FIG. 6 is transmitted to the mobile j and WAIT is performed (S715). When a video generation response is received from the mobile object j, the result is stored in the storage means to notify the video generation request source of the result (S716), and then the process returns to S706 for processing of the next mobile object.

  FIG. 8 shows a description of video segmentation in the present invention. The moving body or the like is provided with a photographing means for photographing a video, and is provided with a video generating means for encoding and storing the photographed video there. The video generation means stores the past video for at least a predetermined time so that the past video can be cut out, and is designated from the stored video in response to the video generation request as shown in FIG. It is possible to cut out the video at the time and generate a new video according to the event.

  FIG. 9 is an explanatory diagram of Embodiment 1 according to the present invention. In this embodiment, there are six moving bodies (A, B, C, D, E, F) that implement the mechanism of FIG. 1, and the shooting direction of the shooting means installed in each moving body is set to the front (of the shooting means). The shooting area is shown as a semicircle at 180 degrees (equal to the left and right with respect to the front direction). Note that the position coordinates of each moving object are as shown in FIG. Here, the case where the moving body A collides with the moving body B and the event detection means of the moving body B detects the collision will be described as an example.

  When the moving object B detects an event such as a collision with another moving object, the moving object receives the image generation request ID, the event detection time, the own moving object ID and the position and orientation information at that time, as an image generation request, and Set the time before video generation and the time after video formation, and send them to surrounding mobile units. Do other mobile units (A, C, D, E, F) that have received the information respond to the video generation request based on the notified video generation request and the video generation support conditions as shown in FIGS. To decide.

  FIG. 10 shows the position coordinates of each moving body in Embodiment 1 of the present invention and the contents of a video generation request transmitted from the moving body B to another moving body or server. Refer to FIG. 3 for how to express the position coordinates of each moving object. In the video generation request, “video generation request ID” for identifying the video generation request, “event detection time” when the mobile unit B detected the event occurrence, and for identifying the video generation device that is the transmission source of the video generation request “Image generation request source ID”, “position and orientation at the time of event detection” as the position and orientation information when the moving object B detects the event, and how long before the event occurs according to the event detected by the moving object B “Time before video generation” and “time after video generation” are set to specify how long the video is cut out from the time until the event occurs.

  FIG. 11 shows an example of the video generation support condition according to the first embodiment of the present invention. The video generation support condition refers to whether the video generation device that received the video generation request is the target device for the video generation request, or the video generation that the server that received the video generation request should send the video generation request This is a condition used when determining whether or not the device is a device. In the present embodiment, it is indicated that the mobile body whose distance from the video generation request source B is within δ is a mobile body that supports video generation in response to the video generation request of the mobile body B.

FIG. 12 shows an example of the video generation support condition according to the first embodiment of the present invention. When the moving body A that has transmitted the video generation request exists in the shooting direction of the imaging means installed in the moving body A that has received the video generation request, the mobile body A satisfies the video generation support condition. . In the first embodiment, a moving object that satisfies both the video generation support condition shown in FIG. 11 and the video generation support condition shown in FIG. 12 performs video generation support. In this embodiment, if the moving body B exists between the front direction left θ _A1 and the right direction θ _A2 of the photographing means of the moving body A, the moving body A supports the image generation in response to the video generation request of the moving body B. Indicates that the condition is met.

  FIG. 13 shows the contents of the video generation response transmitted by each mobile unit to the mobile unit B that is the video generation request source and the video group generated by the mobile unit B in Example 1 of the present invention. The video generation response includes a “video generation request ID” specified in the video generation request, a “video ID” of the video generated in response to the video generation request, and a “video generation source” for identifying the moving body that generated the video. The “ID”, “video storage destination information” that is information on the storage location of the generated video, or the generated “video” itself is stored. The moving body B that has detected the event stores a video group generated based on the video generation conditions by each moving body that satisfies a predefined video generation support condition. In this embodiment, the same video generation support condition is applied to all events. However, the video generation support condition corresponding to the event is defined by incorporating the video generation support condition into a part of the video generation condition. You may make it do. In this embodiment, the moving body ID for identifying the moving body is a natural number from 1 to N for convenience.

  FIG. 14 is an explanatory diagram of Embodiment 2 of the present invention. In this embodiment, it is assumed that a child runs on a track at a school athletic meet or the like, and a pair of a parent and a child is shown as parent 1 / child 1, parent 2 / child 2,. For example, each parent has a device incorporating the video generation device 10, the photographing means 3, the position / orientation detection means 4, and the video generation request input means 6 shown in FIG. 1, and photographs each child's goal scene. I will explain. When the event detection means of the device 3 detects that the parent 3 decided to photograph the goal scene of the child 3, the device 3 sends the video generation request, the mobile body ID, the event detection time and the position at that time, Information such as importance is notified to peripheral devices (1, 2, 4) in the venue. The importance level indicates the importance level of the video generation request, and is determined in consideration of the type of acquisition event and the scene used. For example, when the importance is divided into three levels of high, normal, and low, in the case of a video for such an athletic meet, when the importance is normal or when video is generated by an event such as an accident The importance is high. Here, the importance is divided into three levels of high, normal, and low, the video generation allowable importance is two types, high and normal, and the importance of the video generation request is normal. Each device (1, 2, 4) that has received the information determines whether or not it includes an image as a subject from the shooting direction and shooting area as in the first embodiment. Since the allowable importance of the moving object in this example is high and normal and satisfies the condition regarding importance, the moving object including the image in the area cuts out the image of the image request, and the requesting device 3 Send video to. In this example, the device 4 is applicable. In this way, it is possible to acquire a video image taken by another moving body.

  FIG. 15 is an explanatory diagram of Embodiment 3 according to the present invention. In the present embodiment, there are six moving bodies (A, B, C, D, E, F) that implement the mechanism of FIG. 1, and the shooting area of each moving body is indicated by a semicircle. Here, a case where the moving body A collides with the moving body B and the event detection means of the moving body B detects the collision will be described as an example (see FIG. 14). First, when the moving object B detects an event, the moving object transmits a video generation request and information such as a moving object ID, an event detection time and a position at that time to the server. The server that has received the information notifies the video generation request ID (mobile B) to the video generation request ID. The server uses information management means such as the ID, position, shooting direction, etc. of each moving body or permanent facility, etc., so that the moving body is close to the moving body B at the transmission source and has the requesting moving body B in the shooting direction. select. Specifically, as in the first embodiment, the mobile body whose transmission source is included in the shooting area is selected from the distance from the requesting mobile body B and the shooting direction of each mobile body. Then, the server transmits the video generation request at the designated time and the video generation request ID to the selected mobile body (A, C, D). Upon receipt of the notification, the mobile unit (A, C, D) cuts out the video at the designated time, and transmits the video generation request ID, video ID / video storage destination, video, or the like to the server. In this way, it is possible to acquire a video image taken by another moving body. The embodiments described above are merely examples, and the present invention is not limited to the contents of the drawings and the like described here.

Overall configuration diagram of the embodiment 1 Overall configuration diagram of the embodiment 2 Example of movement history data Event definition data example Event detection process Video generation request processing procedure Server processing procedure Illustration of video cropping Explanatory drawing (1) of Example 1 of this invention Explanatory drawing (2) of Example 1 of this invention Explanatory drawing (3) of Example 1 of this invention Explanatory drawing (4) of Example 1 of this invention. Explanatory drawing (5) of Example 1 of this invention. Explanatory drawing of Example 2 of this invention Explanatory drawing of Example 3 of this invention

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Mobile body 2 External storage device 3 Imaging | photography means 4 Position / orientation detection means 5 Acceleration detection means 6 Image | video production | generation request | requirement input means 7 Server 8 Memory | storage means 10 Image | video production | generation apparatus 11 Movement history management means 12 Encoding means 13 Image | video clipping means 14 Image | video cut-out request | requirement 14 Means 15 Event detection means 16 Communication means 17 Request target judgment means 70 Video generation support program 71 Video generation request reception means 72 Location direction information reception means 73 Request destination judgment means 74 Video generation request transmission means 75 Video reception means 76 Video distribution means 81 Movement history data

Claims (5)

A video generation program executed on each video generation device in a video generation system for generating a predetermined event video by a plurality of video generation devices provided in a mobile object or a permanent facility in cooperation with each other There,
On the computer,
An encoding step of encoding the video received from the imaging means and storing it in the storage means as video information;
An event detection step for detecting that a predetermined event has occurred based on event detection index information defined for each type of event stored in the storage means in advance and detection information received from various sensors;
A video generation request step for generating video generation request information corresponding to the event detected by the event detection step, based on the video generation conditions stored in the storage means in advance corresponding to the event detection index;
A movement history management step for storing in the storage means the position and orientation information received from the position and orientation detection means at a predetermined time interval;
A request target determination step for determining whether the self-video generation device is a target machine of the video generation request, based on the video generation request information received from another video generation device and the position and orientation information;
Video generation request information received from another video generation device, or a video cutout step of cutting out partial video information corresponding to the video generation conditions from the video information, transmission / reception of video generation request information to the other video generation device, and the video cutout step include A video generation for executing a cut-out partial video or holding information of the partial video to a video generation request source video generation device and receiving a video corresponding to the video generation request information transmitted from the own video generation device; program.   In the request target determination step, when the distance from the video generation request source at the video generation request time is shorter than a specified value and the video generation request source exists in the shooting direction of the shooting unit, or the video generation request source 2. The video generation program according to claim 1, wherein when the subject to be imaged is included in the imaging area of the imaging means, the self-video generation device determines that the video generation request information is a target. Executed on each video generation device in a video generation system for generating a predetermined event video by a plurality of video generation devices provided in a mobile body or a permanent facility, etc., mutually linked via a server A video generation program,
On the computer,
An encoding step of encoding the video received from the imaging means and storing it in the storage means as video information;
An event detection step for detecting the occurrence of a predetermined event based on event detection index information defined for each type of event stored in advance in the storage means and detection information received from various sensors;
A video generation request step for generating video generation request information corresponding to the event detected by the event detection step, based on the video generation conditions stored in the storage means in advance corresponding to the event detection index;
A movement history management step of storing the position and orientation information received from the position and orientation detection means at a predetermined time interval in the storage means, and transmitting the position and orientation information to the server in association with the identification information of the self-video generating device;
Video generation request information received from the server, or a video cutout step for cutting out the partial video information corresponding to the video generation conditions from the video information, transmission / reception of the video generation request information to the server, the partial video cut out by the video cutout step or the A video generation program that executes a communication step of transmitting partial video holding information to a server or a video generation request source video generation apparatus and receiving a video corresponding to the video generation request information transmitted from the self-video generation apparatus. Video generation support executed on a server in a video generation system for generating a predetermined event video by a plurality of video generation devices installed in a mobile body or a permanent facility, etc., mutually linked via a server A program,
A video generation request receiving step for receiving video generation requests from a plurality of video generation devices in a computer;
A position and orientation information receiving step of receiving position and orientation information from a plurality of video generation devices at a predetermined time interval, and storing the position and orientation information in a storage unit in association with the received identification information of the video generation device;
A moving object or a permanent facility where the distance from the video generation request source at the video generation request time specified in the video generation request is shorter than a specified value and the video generation request source exists in the shooting direction of the shooting camera, or A request destination determination step for determining a moving object or a permanent facility, etc., in which the subject of the video generation request source is a shooting target included in the shooting area of the shooting camera as a video generation request destination;
A video generation request transmission step of transmitting the video generation request received by the video generation request reception step to the video generation request destination determined by the request destination determination step;
Video receiving means for receiving video from the video generation request destination;
A video generation support program for executing a video distribution step of transmitting the video received by the video receiving means to the video generation request source. A video generation method for generating a predetermined event video by a plurality of video generation devices provided in a mobile object or a permanent facility in cooperation with each other,
An encoding step of encoding the video received from the imaging means and storing it in the storage means as video information;
An event detection step for detecting that a predetermined event has occurred based on event detection index information defined for each type of event stored in the storage means in advance and detection information received from various sensors;
A video generation request step for generating video generation request information corresponding to the event detected by the event detection step, based on the video generation conditions stored in the storage means in advance corresponding to the event detection index;
A movement history management step for storing in the storage means the position and orientation information received from the position and orientation detection means at a predetermined time interval;
Based on the video generation request information received from the other video generation device and the position and orientation information, a request target determination step for determining whether the own video generation device is a target machine of the video generation request information;
Video generation request information received from another video generation device, or a video cutout step of cutting out partial video information corresponding to the video generation conditions from the video information, transmission / reception of video generation request information to the other video generation device, and the video cutout step include An event video generation method comprising: a communication step of transmitting the clipped partial video or the holding information of the partial video to a video generation device that is a video generation request source.

Images