JPH11339009A - Analysis data generator - Google Patents

Abstract

(57) [Summary] [Problem] To analyze data of a moving image captured by a camera and automatically and in detail generate analysis data indicating a game content and a game result. SOLUTION: One or more image pickup means 2 for picking up an image of a game accompanied by a movement, an image storage means 3 for storing an image picked up by the image pickup means 2, and a motion information of the image stored in the image storage means 3 are analyzed. Analysis data generating means 4 for generating analysis data, analysis data storage means 6 for storing the analysis data generated by analysis data generation means 4, and generating analysis condition data indicating analysis conditions for analysis data generation means 4. And an analysis condition data generating unit 5 for generating analysis data based on the analysis condition data from the analysis condition data generating unit 5.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an analysis data generating apparatus for analyzing motion information of a player or the like based on an image taken by a camera arranged in an athletic stadium and generating analysis data.

[0002]

2. Description of the Related Art Hitherto, as a means of knowing the results and contents of a sports game or a game, for example, the results of the game and the like have often been known by watching a moving image captured by a camera. Also, as a means to know the details of the competition,
In addition to watching moving images as described above, they often saw newspapers, magazines, and personally created score notes.

[0003] As a service that can be provided by a person presenting a video such as a television station or a video production company, the content of the competition is captured by a camera, so that a moving image indicating the content of the competition can be provided as it is or edited. In many cases, information such as commentators and commentators for moving images is added.

When athletes, such as athletes and their instructors, analyze a competition, they often analyze tactics and the like by viewing moving images captured by a camera in the past.

[0005]

However, for those who watch sports, video creators, competitors, etc., not only when a moving image showing the contents of the game is provided, but also the contents of the game automatically and in detail. In some cases, it may be desirable to provide the information analyzed.

On the other hand, conventionally, there is no means for making the contents of the game and the results of the game a standard database or the like based on a moving image, and means for automatically generating detailed analysis data according to the contents of the game. Was.

[0007] Conventionally, the result of a game and the contents of a game are recorded and stored as a moving image. Therefore, when storing the contents and results of a past game, the amount of data to be stored is enormous. Inconvenience also occurred.

Therefore, the present invention has been proposed in view of the above-mentioned circumstances, and automatically and in detail a game content and a game result by analyzing motion information of a moving image captured by a camera. An object of the present invention is to provide an analysis data generation device capable of generating analysis data indicating the following.

[0009]

An analysis data generating apparatus according to the present invention for solving the above-mentioned problems includes at least one image pickup means for picking up an image of a game with a motion, and an image storage for storing an image picked up by the image pickup means. Means, analysis data generation means for generating analysis data by analyzing motion information of an image stored in the image storage means, analysis data storage means for storing analysis data generated by the analysis data generation means, The data generation means includes analysis condition data generation means for generating analysis condition data indicating analysis conditions, and the analysis data generation means generates analysis data based on the analysis condition data from the analysis condition data generation means. It is a feature.

[0010] Such an analysis data generating apparatus generates analysis data by analyzing motion information of an image captured by the imaging means in accordance with the analysis condition data from the analysis condition data generating means.

[0011]

Embodiments of the present invention will be described below in detail with reference to the drawings.

FIG. 1 is a diagram showing an example of an analysis data generating apparatus to which the present invention can be applied. The analysis data generating device 1 includes a plurality of camera units 2 (2a, 2b) arranged in a soccer stadium for capturing the contents of a soccer game, and a camera unit 2
A video recording unit 3 for recording the image data captured in step 1, an analysis data generation unit 4 for generating analysis data using the image data recorded on the video recording unit 3, and analysis conditions when the analysis data generation unit 4 performs the analysis. An analysis condition data generation unit 5 for generating data, an analysis data recording unit 6 for recording the analysis data generated by the analysis data generation unit 4, and an analysis data correction for correcting the analysis data recorded in the analysis data recording unit 6. Unit 7 and a score data generation unit 8 that generates score data using the analysis data recorded in the analysis data recording unit 6
A score data recording unit 9 for recording the score data generated by the score data generation unit 8, a score data correction unit 10 for correcting the score data recorded in the score data recording unit 9, and at least an image captured by the camera 2. And an image display unit 11 for displaying an image. The image display unit 11 inputs image data, analysis data, and score data from the camera unit 2, the analysis data recording unit 6, and the score data recording unit 9 and displays them on the screen. Such an analysis data generation device 1 is called, for example, a visual scoring system, a visual scoring system, or a video scoring system or a video scoring system.

The camera section 2 comprises a plurality of cameras,
This is an image of a soccer game. More specifically, the camera unit 2 generates image data by capturing an object having no movement such as a line or a goal mouse, including an object having movement such as a player or a ball. Here, an example in which a soccer game is imaged with two camera units 2 will be described. However, the number of camera units 2 may be one, and further, a soccer game may be imaged with two or more cameras. Is also good. Further, the camera unit 2 is not limited to the case where the camera unit 2 is fixedly arranged at a predetermined position, and may be a moving state or may generate image data with a zoom or pan effect.

The video recording section 3 has a recording medium for recording image data generated by imaging with the camera section 2. The video recording unit 3 records respective image data generated by imaging with the cameras 2a and 2b. The video recording unit 3
When the camera unit 2 detects not only an image but also sound accompanying the image, the camera unit 2 also records sound data accompanying the image data.

The analysis condition data generator 5 is operated by a control command from a user or the like, for example, to generate analysis condition data. This analysis condition data generation unit 5
In response to the control command, for example, conditions for obtaining the trajectory of the player and the ball, conditions for identifying the player, conditions for identifying the judge of the referee, and the like are generated as analysis condition data, and the analysis data generation unit 4 Output to Thus, the user can arbitrarily set and change the conditions for generating the analysis data by inputting a control command to the analysis condition data generation unit 5 according to the analysis data.

The analysis data generation section 4 generates analysis data according to the analysis condition data from the analysis condition data generation section 5. The analysis data includes, for example, player trajectory data, player identification data, ball identification data, and the like. As shown in FIG. 2, the analysis data generation unit 4 inputs the image data from the video recording unit 3 in step ST1, and proceeds to step ST2, step ST3, and step ST4. Then, the analysis data generator 4 generates player trajectory data in step ST2, generates player identification data in step ST3, and generates ball trajectory data in step ST4.

More specifically, the analysis data generation unit 4
When generating the analysis data in steps ST2 to ST4, a player, a ball, and the like having a movement are identified, and a line, a goal mouse, and the like having no movement information are identified. At this time, the analysis data generation unit 4
For example, the player or the ball is identified by recognizing the color information of the player or the ball, the picture pattern such as the player's uniform number, or the like. As a result, the analysis data generation unit 4 generates player identification data, ball identification data, and the like.

The analysis data generating section 4 tracks the player and the ball by performing tracking on an image using the player identification data, the ball identification data, and the like, and analyzes the player trajectory data, the ball trajectory data, and the like. Generate data. As means for realizing the tracking of a player, a ball, and the like, for example, performing template matching for determining a similarity between small areas of an image and detecting corresponding points can be mentioned. For example, when performing template matching between frames of image data, the analysis data generation unit 4 uses a certain frame as a reference, sets a small area in the reference frame as a template, and has the most similarity to this template in another frame. Search (match) the area.

Thus, the analysis data generation unit 4 can determine not only the player trajectory data and the ball trajectory data but also the absolute position of a line or the like indicated by the captured image, the positional relationship between the line and the player or the ball, Analysis data indicating the speed of movement of the ball or the like can also be generated.

The above-described analysis data generation unit 4 has been described as an example of generating analysis data in accordance with the analysis condition data from the analysis condition data generation unit 5. However, the analysis data generation unit 4 includes a memory therein and generates the analysis data stored in the memory. The analysis program may be started automatically in response to the input of the image data to automatically generate the analysis data.

The analysis data generator 4 may generate analysis data by synthesizing both image data recorded in the video recorder 3 from the two cameras 2a and 2b.
Furthermore, each analysis data is generated corresponding to each image data from each camera 2a, 2b, and both analysis data are compared to generate analysis data to be output to the image display unit 11 or the analysis data recording unit 6. Is also good.

The analysis data recording unit 6 records the analysis data generated by the analysis data generation unit 4. The analysis data recording unit 6 outputs analysis data in response to a command from the image display unit 11 and outputs analysis data in response to a command from the analysis data correction unit 7. Record the data.

As shown in FIG. 3, the image display unit 11 to which the analysis data is input from the analysis data recording unit 6 uses the player A to I and the player trajectory data within a certain period of time for each of the players A to I. Display the trajectory. Thereby, the user can recognize the analysis data generated based on the image data generated by the camera unit 2.

The analysis data correction unit 7 receives a control command from a user, for example, and inputs analysis data from the analysis data recording unit 6. The control command from the user is generated according to the analysis data displayed on the image display unit 11 by the user. That is, when the analysis data generated by the analysis data generation unit 4 is displayed on the image display unit 11, a control command is input from the user to the analysis data correction unit 7 when the user notices that there is an error in the analysis data. Is done. The analysis data correction unit 7 corrects the analysis data in response to such a control command, and generates new analysis data.

For example, the analysis data correction unit 7
As shown in (a), the player A moves along a locus indicated by a dotted line, the player B moves along a locus indicated by a solid line, and the player A and the player B It is assumed that the analysis data indicating the intersection and overlap is displayed on the image display unit 11. At this time, when a control command indicating that the user designates an erroneous portion and performs a correction process by using a pointing device such as a mouse is input to the analysis data correction unit 7,
The analysis data correction unit 7 performs a correction process on the analysis data indicating the player identification data and the player trajectory data according to the control command, and records the analysis data on which the correction process has been performed in the analysis data recording unit 6. As a result, the image display unit 1
The analysis data displayed in 1 will be corrected as shown in FIG.

In the above description of the analysis data correction section 7, an example of processing for correcting analysis data in accordance with a user's instruction has been described. However, a memory is provided internally, and a correction program stored in the memory is automatically executed. The analysis data may be corrected at any time by starting the analysis data.

The score data generating section 8 generates score data indicating the result and contents of the game using the analysis data recorded in the analysis data recording section 6 in response to a control command from the user. That is, the score data generation unit 8 generates score data including not only the score and the score of the result of the game and the progress of the game but also the progress of the game as to which player scored the score in accordance with the control command. I do. As a control command from the user, for example, there is a command indicating what kind of score data is to be generated among the score data exemplified below.

For example, as shown in FIG. 5, the score data generator 8 uses the player identification data, the player trajectory data, and the ball trajectory data to execute step ST.
In step 5, the ball occupation time is calculated for each team or player, and thereby the ball occupation time data is generated. In step ST6, the score data generating unit 8 calculates the speed of the ball at the time of shooting or the like using the ball trajectory data, thereby generating ball speed data. Further, the score data generation unit 8 extracts the motion information of each player in step ST7 using the player identification data, the player trajectory data, and the ball trajectory data, determines a judge by referring to, for example, rules, and determines the judge data. Generate score data, foul data, and the like.
Furthermore, the score data generation unit 8 counts the number of corner kicks in step ST8 using the player identification data and the ball trajectory data, and generates corner kick number data. Furthermore, the score data generation unit 8
Calculates the distance moved by each player in step ST9 using the player identification data and the player trajectory data, thereby generating movement amount data.

The score data generator 8 generates the ball occupancy time data, ball speed data, judge data, score data, offense data, corner kick number data and movement amount data obtained as described above as score data. Then, it outputs to the score data recording unit 9.

The ball occupancy time data and the like obtained using the player identification data, the player trajectory data, the ball trajectory data, and the like described with reference to FIG. 5 are simply generated by the score data generator 8 as score data. , And scoring, annotation, and the like of a game can be generated as score data in addition to or based on the above.
Here, the annotation generates, for example, a sentence "a certain player has taken out of three defenders and ran for 30 m and shot by using the above-mentioned player identification data, player trajectory data, and ball trajectory data". Processing.

The score data generator 8 may also generate, as judge data, data indicating offside, hand, keeper charge, goal kick / corner kick, free kick / penalty kick, and the like.

Further, the score data generating section 8 has not only a function of generating score data obtained by analyzing the contents of the game, but also a function of converting the generated score data to be used for data input for creating a computer game. You may have. Further, the score data generation unit 8
May have a function of converting the generated score data so that the contents of the game can be reproduced in computer graphics.

Further, the score data generating unit 8
Not only when various kinds of score data are generated according to the above-mentioned control commands, but also the above-mentioned various kinds of score data may be automatically generated. At this time, the score data generation unit 8
Starts a score data generation program stored in a memory provided therein, for example, and performs processing for automatically generating predetermined score data.

The score data recording section 9 records score data from the score data generating section 8 and also records score data from a score data correcting section 10 described later.
Further, the score data recording section 9 outputs the recorded score data to the image display section 11.

The image display section 11 to which the score data is inputted from the score data recording section 9 is provided with ball occupancy time data,
Score data such as movement amount data is displayed on the screen as numerical values, charts, databases, or the like. Thereby, the user can recognize the score data generated based on the analysis data.

The score data correction unit 10 receives, for example, a control command from a user and inputs analysis data from the score data recording unit 9. The control command from the user is generated according to the score data displayed on the image display unit 11 by the user. That is, when the score data generated by the score data generation unit 8 is displayed on the image display unit 11 and the user notices that there is an error in the score data, a control command is input from the user to the score data correction unit 10. Is done. The score data correction unit 10 corrects the score data according to such a control command,
New score data is generated and recorded in the score data recording unit 9.

For example, when the judgment data displayed on the image display unit 11 is different from the judgment of the actual judge, it is necessary to match the judgment of the actual judge with the judgment data, and the score data The correction unit 10 can correct the above-described error according to a control command from a user. Further, when a condition for generating judge data is specified by a previously input control command, the score data correction unit 10 compares the control command with the score data generated by the score data generation unit 8. Judge data may be generated.

In the above description of the score data correcting section 10, an example of processing for correcting score data in accordance with a user's instruction has been described. However, a memory is provided internally, and the correction program stored in the memory is automatically executed. The program may be activated and the score data may be corrected at any time.

The score data correcting section 10 may have a function of converting the score data into a standard database in response to a control command from the user or automatically. At this time, the score data correction unit 10 generates a score data by activating a database creation program stored in a memory provided therein, and creates a standard database using the score data.

The analysis data generating apparatus 1 configured as described above generates analysis data from the image data generated by the camera unit 2 in the analysis data generation unit 4, and uses the analysis data to generate the score data in the score data generation unit 8. Can be visually and quantitatively shown to the user in terms of both the game content / results and the topics. At this time, the analysis data generation device 1 can show the user the game content / results in more detail by making the score data into a standard database by the score data correction unit 10 and presenting it to the user. Therefore, according to the analysis data generation device 1, for example, a television station, a video production company, or the like that provides videos can be provided with enhanced services, which can be used to improve the audience rating.

According to the analysis data generating apparatus 1, a score book or the like created by an athlete, such as a player or an instructor, actually watching the competition can be obtained by using the analysis data in response to a control command or It can be created automatically.

Further, since the analysis data generating apparatus 1 can convert the score data into a standard database, for example, records the contents of the competition and the results of the year can be recorded on a communication service such as the Internet, a CD-ROM (Compact Disc-Read Only M
emory) and DVD (Digital Video Disc / Digital Versa)
It can be provided as package software such as tile disc) software. Further, by making the contents and results of the game into a standard database by the analysis data generating device 1, it can be used as, for example, a game software material.

Furthermore, according to the analysis data generating device 1, since the analysis data recording unit 6 and the score data recording unit 9 are provided, the analysis data or the score data can be stored as data indicating the contents and results of the game. So you can
The image data generated by the camera unit 2 can be stored with a smaller data amount than when the image data itself is stored, resulting in data compression.

In the above example, an example in which the analysis data generation device 1 is applied to a soccer game has been described.
The present invention can be applied in any field as long as it can generate analysis data on the contents and results by detecting movements in the image. In the field of martial arts such as professional wrestling, the present invention can be applied to each player as data that can be analyzed. By detecting the motion information and the like, it is possible to generate analysis data indicating the position, posture, facial expression, and the like of each player on the ring. Then, the analysis data generation device 1 can use the analysis data in the score data generation unit 8 to automatically or in response to a user's command perform a replay of a match using an annotation, a referee system, or computer graphics.

In the above description of the analysis data generation unit 4 and the score data generation unit 8, an example of generating the analysis data and the score data using the image data and the analysis data has been described. Analysis data and score data may be generated. Thereby, the analysis data generation unit 4 and the score data generation unit 8 can further improve the accuracy of the analysis data and the score data.

Further, the analysis data generation apparatus 1 can generate analysis data by generating not only athletic competitions but also game contents such as go and shogi as image data using the camera unit 2. .

Furthermore, in the above-described example, the analysis data generation device 1 not only generates the analysis data using the image data actually generated by the camera unit 2 but also generates the analysis data using the camera in the past. The same processing as described above can be performed even for image data generated by the above. At this time, the recording medium stored in the video recording unit 3 may be a disk, a tape, or a card.

[0048]

As described in detail above, according to the analysis data generating apparatus of the present invention, the motion information of the image captured by the imaging means is analyzed based on the analysis condition data from the analysis condition data generating means. Analysis data generating means for generating the analysis data by analyzing the motion information of the image captured by the imaging means, for example, it is possible to quantitatively and in detail present the sports content and results to the user. it can. Further, according to the analysis data generation device 1, by providing the analysis data generation means for automatically generating the analysis data, it is possible to automatically and in detail generate the analysis data indicating the content of the game and the result of the game. .

[Brief description of the drawings]

FIG. 1 is a block diagram showing an analysis data generation device to which the present invention can be applied.

FIG. 2 is a diagram for explaining an example of processing contents of an analysis data generation unit.

FIG. 3 is a diagram illustrating an example when analysis data generated by an analysis data generation unit is displayed on an image display unit;

FIG. 4A is a diagram illustrating an example of a case where analysis data before being subjected to a correction process by an analysis data correction unit is displayed on an image display unit, and FIG. FIG. 9 is a diagram illustrating an example when analysis data after the application is displayed on an image display unit.

FIG. 5 is a diagram for explaining an example of processing contents of a score data generation unit.

[Explanation of symbols]

Reference Signs List 1 analysis data generation device, 2 camera unit, 3 video recording unit, 4 analysis data generation unit, 5 analysis condition data generation unit, 6 analysis data recording unit, 7 analysis data correction unit, 8
Score data generation unit, 10 Score data correction unit, 1
1 Image display section

Claims (6)

[Claims] 1. An image capturing means for capturing an image of a game with a motion, an image storing means for storing an image captured by the image capturing means, and analyzing motion information of the image stored in the image storing means. Analysis data generating means for generating analysis data according to the above, analysis data storage means for storing the analysis data generated by the analysis data generation means, and analysis condition for generating analysis condition data indicating the analysis conditions in the analysis data generation means An analysis data generation device, comprising: data generation means; wherein the analysis data generation means generates analysis data based on the analysis condition data from the analysis condition data generation means. 2. The analysis data generation apparatus according to claim 1, wherein said analysis condition data generation means generates analysis condition data in response to a control command indicating an analysis condition. 3. The apparatus according to claim 1, wherein at least an image taken by said image pickup means is displayed and analysis data generated by said analysis data generation means is displayed.
An analysis data generation device as described. 4. The analysis data generation device according to claim 1, further comprising a correction unit that corrects the analysis data stored in the analysis data storage unit according to a control command. 5. A game machine comprising: score data generating means for generating score data indicating a game result and content; wherein the score data generating means generates score data using the analysis data stored in the analysis data storage means. The analysis data generation device according to claim 1, wherein: 6. The system according to claim 1, further comprising: a database generating unit configured to generate a database from a game content, wherein the database generating unit generates a database using the analysis data stored in the analysis data storage unit. An analysis data generation device as described.