JP2014094029A - Motion evaluation support device, motion evaluation support system, motion evaluation support method and program - Google Patents

Abstract

An operation evaluation support apparatus and the like that allow a user to easily and objectively evaluate an operation are provided.
A model still image 121 indicating an operation state at a plurality of timings of a predetermined operation stored in a storage unit 120 is displayed on a display unit 140. A plurality of photographed still images 123 extracted from the photographed moving image 122 photographed by the photographing unit 150 when the player is performing the predetermined operation are displayed on the display unit 140. The image selected as the corresponding still image 124 corresponding to the model still image 121 from the photographed still image 123 by the operator is displayed side by side with the model still image 121. When frame-by-frame playback of the model still image and the corresponding still image is performed, the frame-by-frame playback unit 115 performs frame-by-frame playback so that the corresponding model still image and the corresponding still image are displayed at the same time. To display.
[Selection] Figure 1

Description

  The present invention relates to an operation evaluation support apparatus, an operation evaluation support system, an operation evaluation support method, and a program.

  2. Description of the Related Art In recent years, a technique has been utilized in which an action such as a sports competition is photographed and the action is evaluated based on a photographed moving image. In addition, portable information terminals such as smartphones, tablet terminals, and notebook personal computers may be used as methods for evaluating these operations.

  For example, a method has been proposed in which videos of the exercises of the instructor and the instructor are simultaneously displayed on one screen, and still images captured from each video are displayed side by side, and these are compared and evaluated. (For example, Patent Documents 1 and 2).

  In the teaching method described in Patent Document 1, sports, performances or acts performed by a leader and a trainee are taken with a video camera from substantially the same place, and the captured images are displayed on the same screen. By comparing and examining two images at the same time, the instructor is made to understand the difference between the two. Also, either the instructor or the instructor is a moving image, the other is a still image, and the student understands the relationship.

  The basic exercise training support device described in Patent Document 2 reads moving image data obtained by photographing a student's performance with a video camera, reads moving image data performed by a model actor, and monitors each of them with different monitors. This is a device for simultaneously reproducing images on a reproduction window provided at a position and displaying a plurality of images captured at a plurality of points in time on a display unit arranged in the vicinity of each reproduction window.

JP-A-7-144038 JP 2007-097927 A

  The teaching method described in Patent Document 1 supports guidance by understanding the difference between the simultaneously played videos and the relationship between the still picture and the moving picture. There was a problem that was difficult to evaluate objectively. On the other hand, in the case of still images, there is a problem that it is difficult to compare the flow of continuous operations and it is difficult to compare them.

  The support device described in Patent Document 2 compares a simultaneously played video and a still image captured from the video, but if the capture from the video is performed manually, the subjectivity of the person performing the capture operation is There was a problem that objective evaluation was difficult due to influence. In addition, when capturing automatically at the same timing, there is also a problem that it is difficult to obtain a still image that can be compared when the speed of movement differs between the instructor and the instructor.

  The present invention has been made in view of the above circumstances, and an object thereof is to provide an operation evaluation support apparatus and the like that allow a user to easily and objectively evaluate an operation.

In order to achieve the above object, an operation evaluation support apparatus according to the first aspect of the present invention provides:
A motion evaluation support device for supporting the evaluation of a predetermined motion,
Storage means for storing a plurality of example still images, which are still images indicating operation states at a plurality of timings of the predetermined operation as examples;
Shooting moving image acquisition means for acquiring a shooting moving image that is a moving image obtained by shooting an operation including the predetermined operation;
Shooting still image acquisition means for acquiring a plurality of still images as shooting still images from the shooting moving image acquired by the shooting moving image acquisition means;
Display means for displaying the example still image stored in the storage means and the captured still image acquired by the captured still image acquisition means;
Operation input detecting means for detecting an operation input by a user,
When the operation input detecting means detects the operation input for selecting a corresponding still image corresponding to each of the model still images from the photographed still images displayed on the display means, the display means The model still image and the corresponding still image associated therewith are displayed in a comparable manner.
It is characterized by that.

When the operation input detecting means detects the operation input that instructs frame-by-frame playback of the model still image and the corresponding still image, a plurality of the model still images and a plurality of the corresponding still images are A first frame advance reproduction means for performing frame advance reproduction so that images corresponding to each other are reproduced simultaneously;
The display unit may display the sample still image reproduced by the first frame advance reproduction unit and the corresponding still image in a comparable manner.

The storage means further stores display time information indicating a display time of each of the model still images and shooting time information associated with each of the shot still images acquired by the shot still image acquisition means,
When the operation input detecting unit detects the operation input instructing frame-by-frame playback of the model still image and the corresponding still image, the display time of the model still image is displayed for the model still image. Reproduced during the display time indicated by the information, and the corresponding still image is calculated from the shooting time information associated with the corresponding still image and the captured still image selected as the next corresponding still image in time series A second frame-by-frame playback unit for frame-by-frame playback of the model still image and the corresponding still image so as to play back during the displayed time period;
The display means may display the sample still image reproduced by the second frame advance reproduction means and the corresponding still image so that they can be compared.

The storage means further stores display time information indicating the display time of each of the model still images and shooting time information associated with each of the shot still images acquired by the shot still image acquisition means,
First display time ratio calculation for calculating the ratio of the display time of each model still image to the total model time from the start of displaying the first image of the model still image to the start of displaying the last image Means,
The shooting time information associated with the shooting still image selected as the corresponding still image corresponding to the first image of the model still image and the corresponding still image corresponding to the last image of the model still image The shooting time information associated with the selected photographed still image and the shooting time information associated with each corresponding still image and the selected still image selected as the next corresponding still image in time series. Based on a second display time ratio calculating means for calculating a ratio of the display time of each corresponding still image;
When the operation input detection unit detects the operation input instructing frame-by-frame playback of the model still image and the corresponding still image, the first image of the model still image and the corresponding still image is played back The total time from the start time to the start of playback of the last image is the same, and each model still image is played back at the display time ratio calculated by the first display time ratio calculation unit, The image further includes third frame advance playback means for performing frame advance playback so that the image is played back at the rate of the display time calculated by the second display time rate calculation unit,
The display means may display the sample still image reproduced by the third frame advance reproduction means and the corresponding still image in a comparable manner.

Display time information changing means for changing the display time information indicating the display time of the model still image based on the timing of the tap when detecting that the plurality of model still images are tapped in order,
Furthermore, you may have.

Time difference information obtained from the shooting time information of the taken still image selected as the corresponding still image corresponding to each of the specified still image and the next still image in time series, and the specific still image An operation timing deviation detecting means for detecting a deviation in timing of the predetermined operation based on a result of comparing the display time of the model still image;
The display unit may display information indicating a shift in operation timing detected by the operation timing shift detection unit.

The storage means further stores character information indicating an evaluation criterion of the predetermined action associated with each of the model still images.
The display means displays the character information in the vicinity of the associated model still image,
An evaluation indicating an evaluation made by a user based on the example still image displayed on the display unit, the captured still image associated therewith, and the character information. When the input of information is detected, the display means may display the evaluation information, and the storage means may store the evaluation information.

An operation evaluation support system according to the second aspect of the present invention is:
An operation evaluation support system comprising: a plurality of operation evaluation support devices that support evaluation of a predetermined operation; and a server that is communicably connected to the operation evaluation support device,
The server
Storage means for storing a plurality of example still images, which are still images indicating operation states at a plurality of timings of the predetermined operation as examples;
Transmission means for transmitting the model still image stored in the storage means to the motion evaluation support device,
The operation evaluation support device includes:
Receiving means for receiving the model still image transmitted by the transmitting means of the server;
Storage means for storing the model still image received by the receiving means;
Shooting moving image acquisition means for acquiring a shooting moving image that is a moving image obtained by shooting an operation including the predetermined operation;
Shooting still image acquisition means for acquiring a plurality of still images as shooting still images from the shooting moving image acquired by the shooting moving image acquisition means;
Display means for displaying the example still image stored in the storage means and the captured still image acquired by the captured still image acquisition means;
Operation input detecting means for detecting an operation input by a user,
When the operation input detecting means detects the operation input for selecting a corresponding still image corresponding to each of the model still images from the photographed still images displayed on the display means, the display means The model still image and the corresponding still image associated therewith are displayed in a comparable manner.
It is characterized by that.

The operation evaluation support device includes:
When the operation input detecting means detects the operation input that instructs frame-by-frame playback of the model still image and the corresponding still image, a plurality of the model still images and a plurality of the corresponding still images are A first frame advance reproduction means for performing frame advance reproduction so that images corresponding to each other are reproduced simultaneously;
The display unit may display the sample still image reproduced by the first frame advance reproduction unit and the corresponding still image in a comparable manner.

The storage means of the motion evaluation support apparatus includes display time information indicating a display time of each of the model still images, and shooting time information associated with each of the captured still images acquired by the captured still image acquisition means. , Remember more,
When the operation input detection unit detects the operation input instructing frame-by-frame playback of the sample still image and the corresponding still image, the operation evaluation support device The sample still image is reproduced during the display time indicated by the display time information, and the corresponding still image is selected as the corresponding still image and the captured still image selected as the next corresponding still image in time series. A second frame advance playback means for performing frame advance playback of the model still image and the corresponding still image so as to be played back during a display time calculated from the associated shooting time information;
The display means may display the sample still image reproduced by the second frame advance reproduction means and the corresponding still image so that they can be compared.

The storage means of the motion evaluation support apparatus includes display time information indicating a display time of each of the model still images, and shooting time information associated with each of the captured still images acquired by the captured still image acquisition means. Remember more,
The operation evaluation support device includes:
First display time ratio calculation for calculating the ratio of the display time of each model still image to the total model time from the start of displaying the first image of the model still image to the start of displaying the last image Means,
The shooting time information associated with the shooting still image selected as the corresponding still image corresponding to the first image of the model still image and the corresponding still image corresponding to the last image of the model still image The shooting time information associated with the selected photographed still image and the shooting time information associated with each corresponding still image and the selected still image selected as the next corresponding still image in time series. Based on a second display time ratio calculating means for calculating a ratio of the display time of each corresponding still image;
When the operation input detection unit detects the operation input instructing frame-by-frame playback of the model still image and the corresponding still image, the first image of the model still image and the corresponding still image is played back The total time from the start time to the start of playback of the last image is the same, and each model still image is played back at the display time ratio calculated by the first display time ratio calculation means, Third frame advance playback means for performing frame advance playback so that the still image is played back at the ratio of the display time calculated by the second display time ratio calculation means,
The display means may display the sample still image reproduced by the third frame advance reproduction means and the corresponding still image in a comparable manner.

The operation evaluation support device includes:
Display time information changing means for changing the display time information indicating the display time of the model still image based on the timing of the tap when detecting that the plurality of model still images are tapped in order,
Furthermore, you may have.

The operation evaluation support device includes:
Time difference information obtained from the shooting time information of the taken still image selected as the corresponding still image corresponding to each of the specified still image and the next still image in time series, and the specific still image An operation timing deviation detecting means for detecting a deviation in timing of the predetermined operation based on a result of comparing the display time of the model still image;
The display unit may display information indicating a shift in operation timing detected by the operation timing shift detection unit.

The operation evaluation support apparatus further includes a transmission unit that transmits an evaluation result of the predetermined operation,
The server further comprises receiving means for receiving the evaluation result transmitted by the transmitting means of the operation evaluation support apparatus,
The transmission means of the operation evaluation support apparatus transmits information indicating a shift in the operation timing as the evaluation result,
The receiving unit of the server may receive information indicating the deviation of the operation timing as the evaluation result.

The operation evaluation support apparatus further includes a transmission unit that transmits an evaluation result of the predetermined operation,
The server further comprises receiving means for receiving the evaluation result transmitted by the transmitting means of the operation evaluation support apparatus,
The storage means of the motion evaluation support apparatus further stores character information indicating an evaluation criterion of the predetermined motion, which is associated with each of the model still images,
The display means displays the character information in the vicinity of the associated model still image,
The operation input detection unit of the motion evaluation support apparatus is configured so that a user can perform the operation based on the sample still image displayed on the display unit, the captured still image associated therewith, and the character information. When the input of the evaluation information indicating the judged evaluation is detected, the display means displays the evaluation information, the storage means of the motion evaluation support apparatus stores the evaluation information, and the transmission of the motion evaluation support apparatus The means may transmit the evaluation information as the evaluation result, and the receiving means of the server may receive the evaluation information as the evaluation result.

The operation evaluation support system further includes a terminal for an instructor that is communicably connected to the server,
The transmitting means of the server transmits the evaluation result received by the receiving means and the evaluated person identification information for identifying the evaluated person related to the evaluation result to the instructor terminal,
The instructor terminal may include receiving means for receiving the evaluation result and the evaluated person identification information transmitted by the transmitting means of the server.

An operation evaluation support method according to the third aspect of the present invention is:
A motion evaluation support method for supporting evaluation of a predetermined motion,
A storage step of storing a plurality of example still images, which are still images indicating operation states at a plurality of timings of the predetermined operation as examples;
A captured moving image acquisition step of acquiring a captured moving image that is a moving image obtained by capturing an operation including the predetermined operation;
A shooting still image acquisition step of acquiring a plurality of still images as shooting still images from the shooting moving image acquired in the shooting moving image acquisition step;
A first display step for displaying the example still image stored in the storage step and the captured still image acquired in the captured still image acquisition step;
When an operation input for selecting a corresponding still image corresponding to each of the sample still images from the photographed still images displayed in the first display step is detected, the example still image and the corresponding still image are associated with it. A second display step for displaying the corresponding still image in a comparable manner;
It is characterized by having.

A program according to the fourth aspect of the present invention is:
To a computer that supports the evaluation of a predetermined action,
A storage procedure for storing a plurality of example still images, which are still images indicating operation states at a plurality of timings of the predetermined operation as examples;
A shooting moving image acquisition procedure for acquiring a shooting moving image that is a moving image obtained by shooting an operation including the predetermined operation;
A shooting still image acquisition procedure for acquiring a plurality of still images as shooting still images from the shooting moving image acquired in the shooting moving image acquisition procedure;
A first display procedure for displaying the example still image stored in the storage procedure and the captured still image acquired in the captured still image acquisition procedure;
When an operation input for selecting a corresponding still image corresponding to each of the sample still images from the captured still images displayed in the first display procedure is detected, the corresponding still image of the example is associated with the still image. A second display procedure for displaying the corresponding still image in a comparable manner;
Is executed.

  According to the present invention, the user can evaluate the operation easily and objectively.

It is a block diagram which shows the internal structure of the operation | movement evaluation assistance apparatus which concerns on Embodiment 1. FIG. It is a flowchart which shows the procedure of an operation | movement evaluation process. It is a flowchart which shows the procedure of an operation | movement evaluation process. (A) It is a figure which shows the player and assignment selection screen which concerns on embodiment. (B) It is a figure which shows the pop-up window of player selection. (C) It is a figure which shows the pop-up window of assignment selection. It is a figure which shows the example display screen which concerns on Embodiment 1. FIG. It is a figure which shows the frame advance reproduction | regeneration screen which concerns on Embodiment 1. FIG. It is a figure which shows the imaging | photography screen which concerns on embodiment. It is a figure which shows the imaging | photography confirmation screen which concerns on embodiment. (A) It is a figure which shows the frame selection screen which concerns on Embodiment 1. FIG. (B) It is a figure which shows the pop-up window of evaluation input. It is a figure which shows the comparison reproduction screen which concerns on Embodiment 1. FIG. It is a figure which shows the evaluation result display screen which concerns on Embodiment 1. FIG. It is a figure which shows the structure of the operation | movement evaluation assistance system which concerns on embodiment. It is a figure which shows the example display screen which concerns on Embodiment 1. FIG. It is a figure which shows the example display screen which concerns on Embodiment 2. FIG. 10 is a diagram showing a frame advance playback screen according to Embodiment 2. FIG. It is a figure which shows the frame selection screen which concerns on Embodiment 2. FIG. FIG. 10 is a diagram showing a comparative playback screen according to the second embodiment. It is a block diagram which shows the internal structure of the operation | movement evaluation assistance apparatus which concerns on Embodiment 2. FIG. It is a figure which shows the timing change screen which concerns on Embodiment 2. FIG.

(Embodiment 1)
Hereinafter, Embodiment 1 of the present invention will be described in detail with reference to FIGS.

  The operation evaluation support apparatus 10 according to the first embodiment is an information terminal for supporting an evaluation of an operation by comparing a model operation and an operation to be evaluated. The motion evaluation support apparatus 10 is configured by an information terminal such as a smartphone, a tablet terminal, or a personal computer.

  As illustrated in FIG. 1, the motion evaluation support apparatus 10 includes a control unit 110, a storage unit 120, a communication unit 130, a display unit 140, a photographing unit 150, and an operation unit 160.

  The storage unit 120 includes a readable / writable nonvolatile semiconductor memory such as a flash memory, a hard disk, and the like. The storage unit 120 stores various data such as a model still image 121, a captured moving image 122, a captured still image 123, a corresponding still image 124, and player information 125. In addition, the storage unit 120 also stores a control program executed by the control unit 110.

  The model still image 121 is an image obtained by capturing an action as a model or a drawn image, and is a plurality of still images showing operation states at a plurality of different timings. In association with each example still image 121, character information 1211 indicating the evaluation criteria for the operation as shown in FIG. 5 may be further stored in the storage unit 120.

  The photographed moving image 122 is a moving image obtained by photographing an action performed by the player following the action of the model still image 121 by the photographing unit 150. Here, the operator who operates the motion evaluation support apparatus 10 and the player may be the same person or different persons. The user of the motion evaluation support apparatus 10 includes an operator and a player.

  The captured still image 123 is an image obtained by extracting still images at predetermined time intervals from the captured moving image 122. The extracted still image may be an entire frame image of a moving image or an image for every predetermined number of frames. For example, when all frames are extracted from a 30 fps moving image, still images at 1/30 second intervals are extracted as captured still images 123. On the other hand, when still images are extracted every three frames, still images at intervals of 1/10 second are extracted as captured still images 123. In the present embodiment, an example in which still images are extracted at regular intervals is illustrated, but the predetermined interval does not necessarily have to be a regular interval as long as it can be automatically extracted according to a predetermined condition.

  The corresponding still image 124 is an image selected by the operator as an image corresponding to each model still image 121 among the captured still images 123. In order to further enhance the learning effect, it is desirable that the player himself performs the selection operation of the corresponding still image 124.

  The player information 125 is information including identification information such as the name and affiliation of the player, evaluation results, and the like. The player information 125 is configured by information input to the operation unit 160 by the operator.

  Here, the captured moving image 122, the captured still image 123, the corresponding still image 124, and the player information 125 are stored separately for each player. In FIG. 1, only the stored information of the player A is shown, but when performing the operation evaluation of a plurality of players, images and information of each player are stored.

  The communication unit 130 communicates with other devices using a predetermined communication method. For example, the model still image 121 is downloaded from a server that stores the model still image 121.

  The display unit 140 is composed of a display device such as an LCD (Liquid Crystal Display), for example, and performs information display output of figures, characters, symbols, and the like. This embodiment demonstrates the case where the form of the touchscreen which has the function of the operation part 160 is taken.

  The photographing unit 150 is composed of a video camera or the like having a moving image photographing function, and photographs the operation of the player.

  The operation unit 160 detects an operation input by the operator, and outputs a signal related to the detected operation input to the control unit 110. The operation unit 160 includes a touch panel, a keyboard including a character key, a numeric keypad, a direction key, a determination key, and the like. In the present embodiment, a case where a touch panel is used will be described.

  The control unit 110 includes an arithmetic processing unit, an internal memory, and the like. By executing a control program stored in the storage unit 120, the model still image acquisition unit 111, the still image display control unit 112, and the captured moving image It functions as each functional unit such as an acquisition unit 113, a still image extraction unit 114, a frame advance reproduction unit 115, a corresponding still image selection unit 116, and a player information generation unit 117.

  The model still image acquisition unit 111 acquires the model still image 121 received by the communication unit 130 and stores it in the storage unit 120. In addition, the model still image 121 stored in the storage unit 120 is read and output to the frame advance playback unit 115.

  The still image display control unit 112 reads the model still image 121 read from the storage unit 120, the captured still image 123 extracted by the still image extraction unit 114, and the corresponding still image 124 selected by the corresponding still image selection unit 116. Control to be displayed on the display unit 140 is performed. At that time, the player name and evaluation results generated by the player information generation unit 117 are also displayed on the display unit 140.

  The captured moving image acquisition unit 113 acquires the captured moving image 122 captured by the capturing unit 150 and stores it in the storage unit 120.

  The still image extraction unit 114 extracts a still image at a predetermined time interval from the captured moving image 122, outputs the still image to the still image display control unit 112, and stores the captured image as the captured still image 123 in the storage unit 120.

  The corresponding still image selection unit 116 selects the selected image as a still image display control unit 112 when the player performs an operation on the operation unit 160 to select an image corresponding to the model still image 121 from the captured still image 123. And stored as a corresponding still image 124 in the storage unit 120. Further, the selected corresponding still image 124 is output to the frame advance playback unit 115.

  The player information generation unit 117 reads the player information 125 stored in the storage unit 120 and outputs it to the still image display control unit 112. Also, player information 125 is generated based on the operation input by the operator input to the operation unit 160, output to the still image display control unit 112, and stored in the storage unit 120.

  The frame advance playback unit 115 includes images corresponding to each of the plurality of example still images 121 output from the example still image acquisition unit 111 and the plurality of corresponding still images 124 output from the corresponding still image selection unit 116. In order to be displayed at the same time, frame-by-frame playback that sequentially plays is executed and displayed on the display unit 140.

  The operation of the operation evaluation support apparatus 10 configured as described above will be described with reference to the flowcharts shown in FIGS.

  The operation evaluation process shown in FIGS. 2 and 3 is a process executed by the control unit 110, and when the operation evaluation support apparatus 10 is turned on or an operation input by an operator for starting the operation evaluation process is performed. When detected by the unit 160, the processing is started.

  First, a login screen is displayed on the display unit 140, and a login process is performed when the user inputs a user name, a password, and the like (step S101). In the login process here, a process using a known authentication method is performed.

  If the login process is successful, the player / task selection screen 20 as shown in FIG. 4A is displayed on the display unit 140 (step S102). On the other hand, it is determined whether or not the place where the operator touches the operation unit 160, that is, the touch panel, is the “player selection” selection button (step S103).

  If the operator touches “Select Player” (step S103: Yes), a pop-up window showing a list of players is displayed as shown in FIG. 4B (step S104). On the other hand, the player selected by the operator is determined as the subject of motion evaluation (step S105). Here, it is assumed that “Taro Tsukuba” is selected.

  When the operator touches “logout” instead of “player selection” and “task selection” (step S103: No, step S106: No, step S107: Yes), the user logs out and ends the process. Note that the “Logout” selection button is not shown in the screens after the player / task selection screen 20 in FIG. 4, but a “Logout” selection button is provided on any screen, and the user can logout at any timing. Then, the process can be finished.

  On the other hand, when the place touched by the operator is not “player selection”, “task selection”, or “logout” (steps S103, S106, S107: No), the process returns to step S103 until the operator operates. stand by.

  When the operator touches “select task” (step S103: No, step S106: Yes), a pop-up window showing a list of tasks is displayed as shown in FIG. 4C (step S108). The list of issues is represented in an arbitrary number of hierarchical structures. FIG. 4C is composed of two layers, and shows a state in which “matt” and “forward” are sequentially selected.

  Next, the still image display control unit 112 reads the model still image 121 of the task selected from the task list displayed in step S <b> 108 from the storage unit 120, and the model display screen 21 including the model still image 121. Is displayed on the display unit 140 (step S109). As shown in FIG. 5, the model display screen 21 displays the model still images 121 of the selected tasks out of the model still images 121 of the storage unit 120 side by side in time series. “Return to”, “Check the movement of the task”, and “Demonstrate and shoot the task” are displayed. The task displayed in FIG. 5 is “forward” of “mat”.

  Of the displayed selection buttons, when “confirm movement of task” is touched by the operator, shooting execution is not selected and task confirmation is selected (step S110: No, step S111: Yes). Then, a frame advance playback screen 215 as shown in FIG. 6 is displayed (step S112). In step S112, the frame advance playback unit 115 performs frame advance playback that sequentially displays the model still images 121 of the selected problem stored in the storage unit 120 for a predetermined time.

On the frame advance playback screen 215, operation buttons 2151 such as playback, pause, and reverse playback are displayed, and an arbitrary playback operation can be executed by the operation of the operator. The other operation buttons 2152 can be used to select how many frames of still images are to be displayed. FIG. 6 shows that the still image of the first frame out of 10 frames is displayed. In addition, the other operation buttons 2153 can be used to select how many frames are displayed per second when frame-by-frame playback is performed. FIG. 6 shows that two frames are displayed per second.

  When the operator performs an operation to close the playback screen after frame-by-frame playback is finished (step S113: Yes), or when task confirmation is not selected in step S111 (step S111: No), the task is reselected. It is determined whether or not an operation to be performed has been performed (step S114). When “return to task selection” is touched by the operator and the task is reselected (step S114: Yes), the process returns to step S108.

  On the other hand, when none of the three selection buttons shown on the model display screen 21 is touched (steps S110, S111, S114: No), the process returns to step S110 and waits until the operator operates. .

  In the example display screen 21, when “execution of a subject and shooting” is touched by the operator and shooting execution is selected (step S <b> 110: Yes), the shooting unit 150 is activated and shown in FIG. 7. Such a shooting screen 22 is displayed on the display unit 140 (step S115).

  On the shooting screen 22, an image currently being shot by the shooting unit 150 is displayed on the central monitor screen 221. Based on the operation of touching “start shooting” and “stop shooting” displayed on the shooting screen 22, the start and stop of shooting are controlled.

  In addition, although the selection buttons of “return to assignment confirmation” and “change to past video” are displayed on the shooting screen 22, when the operator touches “return to assignment confirmation”, an example display screen is displayed. Return to 21. In addition, when the operator touches “change to past moving image”, a process of reading a previously captured moving image (the captured moving image 122 stored in the storage unit 120 or the like) is performed.

  When the operator touches “confirm the captured video” after the photographing by the photographing unit 150 is finished, a photographed image confirmation screen 23 as shown in FIG. 8 is displayed on the display unit 140 (step S116). .

  In the captured image confirmation screen 23, operation buttons 2311 such as playback, pause, and reverse playback are displayed in addition to the monitor screen 231, and an arbitrary playback operation can be executed by an operator's touch operation. When the operator who has confirmed the captured image touches “Redo Shooting” and selects to restart the shooting (step S117: Yes), the process returns to step S115 and the shooting is performed again.

  On the other hand, when the operator does not select re-execution of shooting but touches “save this image and proceeds to frame selection” and selects to save the shot video (step S117: No, step S118: Yes), the captured moving image 122 is stored in the storage unit 120 (step S119).

  Thereafter, the still image extraction unit 114 extracts still images at predetermined time intervals from the captured moving image 122 stored in the storage unit 120 (step S201). For example, a still image of all frames of the captured moving image 122 is extracted and stored in the storage unit 120 as the captured still image 123.

  Next, the still image display control unit 112 displays the frame selection screen 24 as shown in FIG. 9A on the display unit 140 (step S202). The frame selection screen 24 includes a display frame 241 in which the model still image 121 is displayed, a blank display frame 242 for applying an image corresponding to the model still image 121, and a display frame in which the captured still image 123 is displayed. 243.

  On the frame selection screen 24, the operator selects the corresponding still image 124 corresponding to each of the model still images 121 from the photographed still images 123, and displays the selected corresponding still image 124 in the display frame 242. The operation unit 160 is operated. Specifically, while the selected still image 123 is touched with a finger, the finger is slid to move the captured still image 123 into the display frame 242. Here, the still image “corresponding” to the model still image 121 means, for example, a still image showing an operation phase similar to the operation phase indicated by the model still image 121.

  Based on such an operation on the operation unit 160, the corresponding still image selection unit 116 stores the corresponding still image 124 in the storage unit 120 and outputs it to the still image display control unit 112 or the frame advance / playback unit 115 (step). S203).

  In the frame selection screen 24 shown in FIG. 9A, selection buttons of “evaluation input”, “redo photographing”, and “to comparison reproduction” are displayed. When the operator touches “Redo Shooting” (step S204: No, step S205: Yes), the process returns to step S115, and the moving image is shot again.

  When the operator touches “evaluation input” (step S206: Yes), the evaluation input pop-up window 25 shown in FIG. 9B is displayed. On the other hand, the operator displays a model still image. Evaluation can be input based on the result of comparing 121 and the corresponding still image 124. In FIG. 9B, if the model operation can be carried out, it can be checked if it can be done, and if it can be carried out, it can be checked if it can be done. Can check "I didn't know" or "I didn't know" if you didn't understand. The evaluation result input by the operator is stored as player information 125 in the storage unit 120 (step S207). Thereafter, the process returns to step S204.

  When the corresponding still image 124 is changed at this time (step S208: Yes), the process returns to step S203, and the operation unit 160 is operated so that the corresponding still image 124 newly selected by the operator is superimposed on the display frame 242. Thus, the corresponding still image 124 can be changed.

  If “comparative playback” is selected (step S204: Yes), a comparative playback screen 26 as shown in FIG. 10 is displayed, and the frame advance playback unit 115 executes comparative playback (step S209). . On the comparative reproduction screen 26, a frame advance reproduction screen 261 of the model still image 121 and a frame advance reproduction screen 262 of the corresponding still image 124 are displayed side by side so that they can be compared with each other.

  Each frame advance playback screen 261, 262 has operation buttons 2611, 2621 similar to the frame advance playback screen 215 shown in FIG. 6, and the playback operation is controlled by the operator touching these buttons.

  An operation button 2631 for simultaneous operation is also displayed. By operating this button, the corresponding model still image 121 and the corresponding still image 124 can be simultaneously displayed and frame-by-frame reproduced. Accordingly, it is possible to confirm the difference between the model and the player's operation at various timings during the operation, and the difference in the flow of the operation, and it is possible to easily grasp the problem of the player's operation.

  If it is desired to input an evaluation at this time (step S210: Yes), the evaluation can be registered by touching the evaluation button 264 (step S211).

  Evaluation input is performed in step S207, and it is not necessary to input the evaluation again (step S210: No). When the evaluation is to be ended (step S212: Yes), the operator touches “Next”. Thus, the evaluation result display screen 27 as shown in FIG. 11 is displayed, and the evaluation results input in steps S207 and S211 are displayed (step S214).

  If the corresponding still image is selected again by touching “Reselect” (step S213: Yes) without ending the evaluation (step S212: No), the process returns to step S203. On the other hand, if neither “next” or “redo selection” is touched (steps S212 and S213: No), the process returns to step S210 and waits until the operator operates.

  On the evaluation result display screen 27, selection buttons displaying “return to comparison playback”, “to player / task selection”, and “to next task” are displayed. If “return to comparison playback” is touched by the operator (step S215: Yes), the process returns to step S209.

  If “to player / task selection” is touched (step S216: Yes), the process returns to step S102, and if “to next task” is touched (step S217: Yes), the process returns to step S109. That is, each task is assigned with order information and stored in the storage unit 120. When “to next task” is input, the task is selected according to the order information, and the process proceeds to step S109. Processing continues. On the other hand, when none of “return to comparative playback”, “to player / task selection”, and “to next task” is touched (steps S215, S216, S217: No), the process returns to step S215, and the operator Wait until the operation.

  As described above, the motion evaluation process in the motion evaluation support device 10 is executed.

  The motion evaluation support apparatus 10 may be connected to the server 40 via an arbitrary network. For example, as shown in FIG. 12, the wireless LAN router 50 and the operation evaluation support apparatus 10 may be connected by wireless communication, and the server 40 and the wireless LAN router 50 may be connected by wired communication. In addition, the leader terminal 30 used by the leader may be connected to the server 40 via the wireless LAN router 50. At this time, the motion evaluation support system 1 is constructed by the plurality of motion evaluation support devices 10, the instructor terminal 30, and the server 40.

  In the storage unit of the server 40, character information indicating a description including an example still image 121 and an evaluation criterion for the operation of the task is stored for the task of the operation to be evaluated. For example, the model still image 121 may be transmitted from the instructor terminal 30 to the server 40.

  The model still image 121 and the like stored in the storage unit of the server 40 are downloaded to the motion evaluation support apparatus 10.

  The player information 125 stored in the storage unit 120 of the motion evaluation support apparatus 10 includes evaluation result information. The player information 125 is stored in the motion information when the motion evaluation support apparatus 10 is communicatively connected to the server 40. Uploaded from the evaluation support apparatus 10 to the server 40. That is, the server 40 collects and summarizes evaluation result information from the operation evaluation support apparatus 10 used by each user.

  The instructor terminal 30 acquires evaluation result information from the server 40. The leader who uses the terminal 30 for leaders can know the proficiency level of the player's action from the acquired evaluation result information, and can feed back the proficiency level information to the creation of the next task.

  Further, the captured still image 123 stored in the storage unit 120 of the motion evaluation support apparatus 10 may be uploaded to the server 40. The captured still images 123 of each player collected in the server 40 may be shared by a plurality of motion evaluation support apparatuses 10. As a result, it is possible to display the photographed still image 123 of the player demonstrating the excellent operation as the model still image 121 on the model display screen 21, the frame selection screen 24, the comparison playback screen 26, and the like.

  When the captured still image 123 of each player is shared, for example, as shown in FIG. 13, a selection button “Change Model” is provided on the model display screen 21, and the operator touches “Change Model”. By selecting a player's name and shooting time (a thumbnail image may be displayed at the time of selection), an image of an excellent performance of another player can be selected as a model. It is also possible to select an image of his past performance as a model.

  As described above, in the present embodiment, the captured still image 123 extracted at a predetermined time interval is acquired from the captured moving image 122 capturing the action of the player, and the sample still image 123 is acquired from the captured still image 123. The corresponding still image 124 corresponding to 121 is selected, the model still image 121 and the corresponding still image 124 are displayed side by side, and images corresponding to the model still image 121 and the corresponding still image 124 are simultaneously displayed. Frame-by-frame playback was decided.

  Thereby, it is possible to confirm the difference between the model and the player's operation at various timings during the operation and the difference in the operation flow, and it is possible to easily grasp the problem of the player's operation. In particular, by causing the player to perform an operation of selecting the corresponding still image 124 corresponding to the model still image 121 from the captured still images 123 (divided images of his / her performance), the learning effect is dramatically improved. Can be increased. As described above, the captured still image 123 is acquired at intervals of, for example, 1/10 seconds, so that even if the performance is about 5 seconds, the still images 123 are divided into 50 still images. It is very important that the player himself chooses an image in the operation phase that most closely resembles the model still image 121 from such a relatively large amount of images (divided images of his / her performance). Yes, by experiencing this process, the player can better understand his / her movement and understand the differences from the model. In learning sports and other movements, being able to image your own movements is a very important factor for your progress. According to the motion evaluation support apparatus 10 of the present embodiment, there is no conventional technique that “the player himself performs the operation of selecting an image that most closely approximates the model while viewing a large number of divided images of his / her performance”. Since it is possible to provide a product, it is possible to effectively support “being able to image one's own movement” by itself, which has an excellent effect that cannot be obtained in the past.

(Embodiment 2)
Hereinafter, Embodiment 2 of the present invention will be described in detail with reference to FIGS.

  The operation evaluation support system 1 according to the present embodiment has the same configuration as that of the first embodiment. The operation evaluation support apparatus 10 has substantially the same configuration as that of the first embodiment, but the display contents of the example display screen 51 and the frame selection screen 54, the part related to the frame advance playback method, and the like are the first embodiment. And different.

  In the present embodiment, display time information is associated with the model still image 121 and stored in the storage unit 120. On the model display screen 51, as shown in FIG. 14, a display frame 511 on which information on the number of beats related to the timing of the operation is displayed is provided on the display frame 512 of the model still image 121. Here, the circle shown in the display frame 511 indicates 1 beat, and the semicircle indicates 0.5 beat, and the information on the number of beats is based on the display time information. The still image display control unit 112 places the m + 1 frame still image 121 on the mth frame example still image 121 from the m + 1 frame still image 121 operation phase. The number of beats up to is calculated and displayed on the model display screen 51. For example, the number of beats from the operation phase indicated by the example still image 121 of the first frame to the operation phase indicated by the example still image 121 of the second frame is one beat. The number of beats from the operation phase indicated by the still image 121 to the operation phase indicated by the model still image 121 of the fourth frame is two. The beat number information is information based on the timing of actual operation (or desirable operation). In other words, the model still image 121 extracted from the model motion is not necessarily extracted at regular intervals, and therefore the actual motion timing (or desirable motion) with respect to the model still image 121 after extraction. Display time information based on (timing) is added.

  The frame advance reproduction performed by the frame advance reproduction unit 115 in step S112 is displayed on a frame advance reproduction screen 515 as shown in FIG. The display time of each example still image 121 during frame-by-frame playback is proportional to the number of beats indicated by the circle and semicircle displayed in the display frame 511. Specifically, the display time of each example still image 121 is a value obtained by dividing the number of circles displayed in the display frame 511 by the number of beats per second. The number of beats per second is set with the operation button 5153. For example, in the case of FIG. 15, since the number of beats per second is 2, the display time of the model still image 121 of the first frame is 0.5 seconds, and the model still image 121 of the third frame is displayed. Is displayed for 1 second. As described above, when the frame-by-frame playback is performed, it is easy to grasp the flow of the operation by changing the display time of each sample still image 121.

  As shown in FIG. 16, the still image display control unit 112 also displays the beat number on the model still image 121 on the frame selection screen 54. In the frame selection screen 54, in order to make the timing of each operation easier to understand, the timing of each operation phase is displayed together with the time represented from the operation phase of the model still image 121 of the first frame. Yes.

  The numbers in the upper left of each example still image 121 displayed in the display frame 541 in FIG. 16 indicate the timing of each operation phase in time. That is, when the timing of the operation phase represented by the model still image 121 of the first frame is 0.00 seconds, the operation phase of the model still image 121 of the second frame is 0.5 seconds after the first frame ( Therefore, the timing of this operation phase is 0.50 seconds. Further, the operation phase of the model still image 121 of the third frame is one second after the first frame (after two beats), and the timing of this operation phase is 1.00 seconds.

  In the present embodiment, information on photographing time relating to photographing such as an elapsed time from photographing start or photographing time is also associated with the photographed still image 123 and stored in the storage unit 120. The still image display control unit 112 also displays shooting time information of the shot still image 123 on the frame selection screen 54. In FIG. 16, since the captured still image 123 is an image every (1/30) second, the time at the upper left of each captured still image 123 in the display frame 543 is from (1/30) from the capturing time of 4.00 seconds. It is time per second.

  Further, when the photographed still image 123 corresponding to each model still image 121 is selected as the corresponding still image 124 and displayed in the display frame 542 on the frame selection screen 54, the still image display control unit 112 displays 1 The shooting time information converted with the timing of the corresponding still image 124 of the frame as 0.00 seconds is displayed. That is, in FIG. 16, the difference in shooting time from the corresponding still image 124 of the first frame to the corresponding still image 124 of the second frame is 0.57 seconds, so the corresponding still image of the second frame in the display frame 542 is displayed. “0:57” is displayed on the upper left of 124.

Further, the still image display control unit 112 detects a shift in timing of each operation phase displayed on each corresponding still image 124 with respect to a timing of each operation phase displayed on each sample still image 121. May be calculated and displayed. For example, the time difference between the m-th frame and the (m + 1) -th frame example still image 121 is ΔT _e−m, and the time difference between the m-th frame and the (m + 1) -th frame corresponding still image 124 is ΔT _p. when the _-m, determined by calculating the _{(ΔT p-m -ΔT e-} m) / ΔT e-m or the like. Here, ΔT _e-m corresponds to the display time obtained from the number of beats of the sample still image 121 of the m-th frame. In FIG. 16, the timing shift of the operation phase of the second frame is shown as + 14%.

In addition, the total time T _e-all from the operation phase timing of the first image of the model still image 121 to the operation phase timing of the last image, and the shooting time of the first image of the corresponding still image 124 to the last image. A value obtained by (T _p-all -T _e-all ) / T _{e -all} from the total time T _p-all up to the imaging time may be displayed as an overall timing shift. Since FIG. 16 is a screen at the time when selection of the corresponding still image 124 up to the third frame is completed, the total deviation of the operation time up to the third frame + 17% is displayed.

  The comparative playback executed in step S209 is displayed on the comparative playback screen 56 as shown in FIG. 17, but the model still image 121 and the corresponding still image 124 corresponding to each other can be played back in a comparable state. The display time of the model still image 121 is proportional to the number of beats indicated by a circle or a semicircle displayed in the display frame 511. For example, similar to the frame-by-frame playback on the frame-by-frame playback screen 515, the display time of the model still image 121 is 0.5 seconds for the first frame and 1 second for the third frame. .

  On the other hand, since the corresponding still image 124 is selected from the photographed still image 123, the display time based on the information of the photographing time related to photographing such as the elapsed time from the photographing start or the photographing time stored in the storage unit 120. Is displayed. The display time corresponding to the time difference between the shooting time of each corresponding still image 124 and the shooting time of the corresponding still image 124 of the next frame in time series is displayed. That is, the corresponding still image 124 can be displayed in the time actually taken from the operation phase indicated by each corresponding still image 124 to the operation phase indicated by the corresponding still image 124 of the next frame.

  In this embodiment, the frame-by-frame playback unit 115 performs frame-by-frame playback in a mode selected from the synchronous mode, real-time playback mode, and total time adjustment mode as the comparative playback mode. When the user checks any mode of the operation buttons 5631, the mode is selected.

  When the synchronous mode is selected as the comparative playback mode, as in the comparative playback of the first embodiment, the frame advance playback unit 115 displays the model still image 121 and the corresponding still image 124 corresponding to each other. Frame-by-frame playback so that it is displayed simultaneously.

  When the real-time playback mode is selected as the comparative playback mode, for the example still image 121, the number of beats associated with each example still image 121 is the same as the frame advance playback executed in step S112. Frame-by-frame playback unit 115 performs frame-by-frame playback so as to display during the display time required from The frame-by-frame playback unit 115 performs frame-by-frame playback so that the corresponding still image 124 is displayed for a display time based on the photographing time difference.

  The frame-by-frame playback of the corresponding still image 124 in the real-time playback mode will be specifically described. By reading the shooting time information of each captured still image 123 from the storage unit 120, the operation phase of each corresponding still image 124 is actually changed to the operation phase of the corresponding still image 124 of the next frame in time series. Calculate how long it took. Then, the corresponding still image 124 is frame-by-frame reproduced by using the obtained time as the display time of each frame of the corresponding still image 124.

  For example, based on the fact that the time difference from the shooting time of the corresponding still image 124 of the first frame to the shooting time of the corresponding still image 124 of the second frame is 0.57 seconds, the corresponding still image 124 of the first frame is It is displayed for 0.57 seconds. In the real-time playback mode, the model still image 121 and the corresponding still image 124 can be started at the same time by the operation button 5631 for simultaneous operation, so that the timing shift between the model and one's own operation can be easily recognized. It is.

  When the total time adjustment mode is selected as the comparative playback mode, as in the real time playback mode, the model still image 121 is played back with a display time based on the number of beats, and the corresponding still image 124 is displayed with a difference in shooting time. The reproduction is performed based on the display time based on the display, but the reproduction is performed by adjusting the total time required for the entire operation of the model still image 121 and the corresponding still image 124 to be the same.

  In order to realize the comparative reproduction function in the total time adjustment mode, the control unit 110 further includes functional units such as a model display time ratio calculation unit 1101 and a corresponding display time ratio calculation unit 1102, as shown in FIG.

The model display time ratio calculation unit 1101 obtains the total time T _e-all from the time when the first image of the model still image 121 starts to be displayed to the time when the last image starts to display, and the mth frame of the model still image. A ratio ΔT _e−m / T _e−all with respect to the total time T _e−all of the display time ΔT _e−m obtained from the number of beats of the image is calculated and output to the frame advance playback unit 115.

The corresponding display time ratio calculation unit 1102 corresponds to the shooting time of the shot still image 123 selected as the corresponding still image 124 corresponding to the first image of the model still image 121 and the last image of the model still image 121. The total time T _p-all from the operation phase of the first image of the corresponding still image 124 to the operation phase of the last image is obtained from the time difference with the shooting time of the shooting still image 123 selected as the corresponding still image 124. The time from the operation phase of the m-th corresponding still image 124 to the operation phase of the (m + 1) -th corresponding still image 124 is obtained as the display time ΔT pm of the _m-th corresponding still image 124. Then, the display time of each corresponding still image 124, and calculates the ratio _{ΔT p-m / T p-} all to total time _{T p-all,} and outputs the frame playback unit 115.

The frame advance playback unit 115 adjusts and plays back the sample still image 121 and the corresponding still image 124 so that the total time required for the entire operation is the same. For example, when matching the total time _{T e-all,} is input _{ΔT e-m / T e-} all from model display time ratio calculating unit 1101, from the corresponding display time ratio calculating unit 1102 ΔT _p-m / _{T p} If _-all is input, model still image 121 of m-th frame during the display time [Delta] T _e-m, reproduced, m-th frame of the corresponding still image 124 display time (ΔT _{p-m / T p- all} ) × T _e-all .

  With the above configuration, when the total time adjustment mode is selected as the comparative playback mode, the total time required for the entire operation of the model still image 121 and the corresponding still image 124 is adjusted to be the same. Since the model still image 121 is reproduced in accordance with the proportion of the display time based on the number of beats, and the corresponding still image 124 is reproduced in accordance with the proportion of the display time based on the real time, the timing is determined in any operation phase. It is possible to easily grasp whether there is a deviation.

  Further, the timing difference displayed on the frame selection screen 54 may be displayed on the comparison playback screen 56. As shown in FIG. 17, the overall timing shift may be displayed, or the frame having the largest shift among the shifts for each frame may be specified and output.

  For example, the ideal time from the operation phase of the third frame to the operation phase of the fourth frame of the model still image 121, that is, the display time of the model still image 121 of the third frame is 1 for two circles. In contrast, if the time actually taken from the operation phase of the third frame to the operation phase of the fourth frame of the corresponding still image 124 is 1.25 seconds, it can be said that the difference is + 25%. . When the difference in timing from the 3rd frame to the 4th frame is the largest, the timing for entering the operation phase of the 4th frame is displayed so that it can be seen that it is the most delayed and + 25% delayed.

  In addition, the ratio of each action phase to the time of the whole model movement (from the start of action to the end of action) is compared with the ratio of each action phase to the time of the whole action of the player, and output as an evaluation result. Also good. That is, for example, the entire movement of the model is 4 seconds, and the time from the operation phase of the third frame of the model still image 121 to the operation phase of the fourth frame is 1 second, and the entire movement of the player is 6 seconds. When the time from the third phase operation phase to the fourth frame operation phase of the image 124 is 1.5 seconds, there is no deviation in the operation timing because the two are equal in proportion to the total operation ( The same as the model).

  The calculation result of the operation timing deviation is displayed as an evaluation result. FIG. 17 shows that the sum of timing deviations is + 45%. The calculation result is stored in the player information 125 together with an evaluation such as “completed” by the operator's judgment. When the operation evaluation support apparatus 10 is connected to the server 40 by communication, an evaluation result including a timing shift calculation result is transmitted to the server 40.

  Further, when the “change timing” button is selected on the comparison playback screen 56, the display time information of the model still image 121 can be changed.

  In order to realize the timing changing function, the control unit 110 further includes a function unit of a timing changing unit 1103 as shown in FIG. The timing changing method by the timing changing unit 1103 is arbitrary, and the timing may be manually input in seconds by hand.

  As another timing input method, on the timing input screen as shown in FIG. 19, the display time based on the tapping time interval is input by sequentially tapping on the continuous sample still image 121 whose operation timing is to be changed. There is a way.

  In FIG. 19, the upper row is a continuous example still image 121, and the example still image 121 surrounded by a thick frame is an image waiting for tap input. The lower row is two consecutive images extracted from the upper model still image 121, and the sample still image 121 surrounded by a thick frame is an image waiting for tap input. When the model still image 121 surrounded by a thick frame is tapped, the image is switched to the image on the right.

  That is, by continuously tapping the position of the model still image 121 surrounded by the lower thick frame, the display time of each model still image 121 based on the tapping time interval can be input. The input display time may be indicated by a circle or a part of the circle shown in the upper part of FIG. 19, or may be the number of seconds.

  In this way, the display time of the model still image 121 can be changed, and the model timing can be changed to a timing suitable for the user. In particular, when an image of his / her past performance is selected as a model, the timing suitable for his / her operation can be determined.

  As described above, in the present embodiment, the display time of the specific example still image 121 and the captured still image 123 selected as the corresponding still image 124 associated with the specific example still image 121 are displayed. Corresponds to the sample still image 121 based on the shooting time information such as the shooting time of the captured still image 123 selected as the corresponding still image 124 associated with the captured still image 121 and the corresponding still image 124 of the next frame. The still image 124 is comparatively reproduced, the shift in the operation timing is measured, and the measurement result is displayed.

  Thereby, it is possible to grasp which movement causes a timing shift in a series of operations.

  As described above, the present invention acquires a plurality of captured still images from a captured moving image obtained by capturing a predetermined operation, selects a corresponding still image corresponding to the model still image from the captured still images, The corresponding still images are displayed side by side, and frame-by-frame playback is performed so that the corresponding model still images and the corresponding still images are displayed in a comparable manner. Thereby, a user can evaluate operation | movement easily and objectively.

  In addition, this invention is not limited to the said embodiment, Of course, the various change in the range which does not deviate from the summary of this invention is possible.

  In the above embodiment, the model still image 121 is downloaded from the server 40 via the network. However, the model 40 may be downloaded by directly connecting the server 40 and the operation evaluation support apparatus 10 using a USB cable or the like. Good. Further, when the server 40 and the motion evaluation support apparatus 10 are directly connected, file synchronization is performed between the server 40 and the motion evaluation support apparatus 10 for information including the model still image 121, the captured still image 123, and the player information 125. In this way, the latest model still image 121 and the evaluation result may be shared. Alternatively, the data such as the model still image 121 may be copied to a removable recording medium such as an SD card, and the data may be provided to another operation evaluation support apparatus 10.

  In addition, the motion evaluation support apparatus 10 includes the photographing unit 150 and acquires a moving image photographed by the photographing unit 150. Alternatively, it may be acquired via a storage medium that can be connected to the motion evaluation support apparatus 10.

  In the second embodiment, the number of beats of the display time of the model still image 121 is represented by a circle. However, the time interval may be displayed as it is, and the timing time may not be displayed, or other display formats ( It may be an icon or words). Furthermore, at the time of frame-by-frame playback, the timing is recognized by outputting a sound corresponding to the number of beats, or a function such as “timing sound playback” is separately provided on the model display screen 51 etc. By outputting a sound corresponding to the timing, the timing may be recognized by the ear.

  In addition, by applying the program executed by the control unit 110 of the above-described embodiment to an information terminal such as an existing smartphone or tablet terminal, the terminal can also function as the operation evaluation support apparatus 10 according to the present invention. is there.

  The distribution method of such a program and necessary information (various information that can be distributed such as the model still image 121 separately from the program) is arbitrary. For example, a CD-ROM (Compact Disk Read-Only Memory), a DVD ( Digital Versatile Disk (MO), MO (Magneto Optical Disk), memory card or other computer-readable recording medium may be distributed for distribution, or may be distributed via a communication network such as a mobile phone network or the Internet. .

DESCRIPTION OF SYMBOLS 1 ... Motion evaluation support system 10 ... Motion evaluation support apparatus 110 ... Control part 111 ... Model still image acquisition part 112 ... Still image display control part 113 ... Shooting moving image acquisition part 114 ... Still image extraction part 115 ... Frame advance reproduction | regeneration part DESCRIPTION OF SYMBOLS 116 ... Corresponding still image selection part 117 ... Player information generation part 120 ... Memory | storage part 121 ... Example still image 1211 ... Character information 122 ... Shooting moving image 123 ... Shooting still image 124 ... Corresponding still image 125 ... Player information 130 ... Communication part DESCRIPTION OF SYMBOLS 140 ... Display part 150 ... Shooting part 160 ... Operation part 20 ... Player and assignment selection screen 21 ... Example display screen 215 ... Frame advance reproduction screen 2151, 2152, 2153 ... Operation button 22 ... Shooting screen 221 ... Monitor screen 23 ... Shooting Image confirmation screen 231 ... Monitor screen 2311 ... Operation buttons 24 ... Frame selection Screens 241, 242, 243 ... display frame 25 ... pop-up window for evaluation input 26 ... comparison playback screen 261, 262 ... frame advance playback screen 2611, 2621, 2631 ... operation button 264 ... evaluation button 27 ... evaluation result display screen 30 ... instruction Terminal for user 40 ... Server 50 ... Wireless LAN router 51 ... Model display screen 511, 512 ... Display frame 515 ... Frame advance playback screen 5151, 5152, 5153 ... Operation button 54 ... Frame selection screen 541, 542, 543 ... Display frame 56 ... Comparative playback screen 5631 ... Operation buttons 58 ... Timing change screen 1101 ... Model display time ratio calculation unit 1102 ... Corresponding display time ratio calculation unit 1103 ... Timing change unit

Claims (18)

A motion evaluation support device for supporting the evaluation of a predetermined motion,
Storage means for storing a plurality of example still images, which are still images indicating operation states at a plurality of timings of the predetermined operation as examples;
Shooting moving image acquisition means for acquiring a shooting moving image that is a moving image obtained by shooting an operation including the predetermined operation;
Shooting still image acquisition means for acquiring a plurality of still images as shooting still images from the shooting moving image acquired by the shooting moving image acquisition means;
Display means for displaying the example still image stored in the storage means and the captured still image acquired by the captured still image acquisition means;
Operation input detecting means for detecting an operation input by a user,
When the operation input detecting means detects the operation input for selecting a corresponding still image corresponding to each of the model still images from the photographed still images displayed on the display means, the display means The model still image and the corresponding still image associated therewith are displayed in a comparable manner.
An operation evaluation support apparatus characterized by that. When the operation input detecting means detects the operation input that instructs frame-by-frame playback of the model still image and the corresponding still image, a plurality of the model still images and a plurality of the corresponding still images are A first frame advance reproduction means for performing frame advance reproduction so that images corresponding to each other are reproduced simultaneously;
The display means displays the sample still image reproduced by the first frame advance reproduction means and the corresponding still image in a comparable manner;
The motion evaluation support apparatus according to claim 1. The storage means further stores display time information indicating the display time of each of the model still images and shooting time information associated with each of the shot still images acquired by the shot still image acquisition means,
When the operation input detecting unit detects the operation input instructing frame-by-frame playback of the model still image and the corresponding still image, the display time of the model still image is displayed for the model still image. Reproduced during the display time indicated by the information, and the corresponding still image is calculated from the shooting time information associated with the corresponding still image and the captured still image selected as the next corresponding still image in time series A second frame-by-frame playback unit for frame-by-frame playback of the model still image and the corresponding still image so as to play back during the displayed time period;
The display means displays the sample still image reproduced by the second frame advance reproduction means and the corresponding still image in a comparable manner;
The motion evaluation support apparatus according to claim 1. The storage means further stores display time information indicating the display time of each of the model still images and shooting time information associated with each of the shot still images acquired by the shot still image acquisition means,
First display time ratio calculation for calculating the ratio of the display time of each model still image to the total model time from the start of displaying the first image of the model still image to the start of displaying the last image Means,
The shooting time information associated with the shooting still image selected as the corresponding still image corresponding to the first image of the model still image and the corresponding still image corresponding to the last image of the model still image The shooting time information associated with the selected photographed still image and the shooting time information associated with each corresponding still image and the selected still image selected as the next corresponding still image in time series. Based on a second display time ratio calculating means for calculating a ratio of the display time of each corresponding still image;
When the operation input detection unit detects the operation input instructing frame-by-frame playback of the model still image and the corresponding still image, the first image of the model still image and the corresponding still image is played back The total time from the start time to the start of playback of the last image is the same, and each model still image is played back at the display time ratio calculated by the first display time ratio calculation unit, The image further includes third frame advance playback means for performing frame advance playback so that the image is played back at the rate of the display time calculated by the second display time rate calculation unit,
The display means displays the sample still image reproduced by the third frame advance reproduction means and the corresponding still image in a comparable manner;
The motion evaluation support apparatus according to claim 1. Display time information changing means for changing the display time information indicating the display time of the model still image based on the timing of the tap when detecting that the plurality of model still images are tapped in order,
The operation evaluation support apparatus according to claim 3, further comprising: Time difference information obtained from the shooting time information of the taken still image selected as the corresponding still image corresponding to each of the specified still image and the next still image in time series, and the specific still image An operation timing deviation detecting means for detecting a deviation in timing of the predetermined operation based on a result of comparing the display time of the model still image;
The display means displays information indicating a deviation in operation timing detected by the operation timing deviation detection means;
The motion evaluation support device according to claim 3, wherein the motion evaluation support device is a device. The storage means further stores character information indicating an evaluation criterion of the predetermined action associated with each of the model still images.
The display means displays the character information in the vicinity of the associated model still image,
An evaluation indicating an evaluation made by a user based on the example still image displayed on the display unit, the captured still image associated therewith, and the character information. When the input of information is detected, the display means displays the evaluation information, and the storage means stores the evaluation information;
The motion evaluation support apparatus according to any one of claims 1 to 6. An operation evaluation support system comprising: a plurality of operation evaluation support devices that support evaluation of a predetermined operation; and a server that is communicably connected to the operation evaluation support device,
The server
Storage means for storing a plurality of example still images, which are still images indicating operation states at a plurality of timings of the predetermined operation as examples;
Transmission means for transmitting the model still image stored in the storage means to the motion evaluation support device,
The operation evaluation support device includes:
Receiving means for receiving the model still image transmitted by the transmitting means of the server;
Storage means for storing the model still image received by the receiving means;
Shooting moving image acquisition means for acquiring a shooting moving image that is a moving image obtained by shooting an operation including the predetermined operation;
Shooting still image acquisition means for acquiring a plurality of still images as shooting still images from the shooting moving image acquired by the shooting moving image acquisition means;
Display means for displaying the example still image stored in the storage means and the captured still image acquired by the captured still image acquisition means;
Operation input detecting means for detecting an operation input by a user,
When the operation input detecting means detects the operation input for selecting a corresponding still image corresponding to each of the model still images from the photographed still images displayed on the display means, the display means The model still image and the corresponding still image associated therewith are displayed in a comparable manner.
A motion evaluation support system characterized by that. The operation evaluation support device includes:
When the operation input detecting means detects the operation input that instructs frame-by-frame playback of the model still image and the corresponding still image, a plurality of the model still images and a plurality of the corresponding still images are A first frame advance reproduction means for performing frame advance reproduction so that images corresponding to each other are reproduced simultaneously;
The display means displays the sample still image reproduced by the first frame advance reproduction means and the corresponding still image in a comparable manner;
The motion evaluation support system according to claim 8, wherein: The storage means of the motion evaluation support apparatus includes display time information indicating a display time of each of the model still images, and shooting time information associated with each of the captured still images acquired by the captured still image acquisition means. , Remember more,
When the operation input detection unit detects the operation input instructing frame-by-frame playback of the sample still image and the corresponding still image, the operation evaluation support device The sample still image is reproduced during the display time indicated by the display time information, and the corresponding still image is selected as the corresponding still image and the captured still image selected as the next corresponding still image in time series. A second frame advance playback means for performing frame advance playback of the model still image and the corresponding still image so as to be played back during a display time calculated from the associated shooting time information;
The display means displays the sample still image reproduced by the second frame advance reproduction means and the corresponding still image in a comparable manner;
The motion evaluation support system according to claim 9. The storage means of the motion evaluation support apparatus includes display time information indicating a display time of each of the model still images, and shooting time information associated with each of the captured still images acquired by the captured still image acquisition means. Remember more,
The operation evaluation support device includes:
First display time ratio calculation for calculating the ratio of the display time of each model still image to the total model time from the start of displaying the first image of the model still image to the start of displaying the last image Means,
The shooting time information associated with the shooting still image selected as the corresponding still image corresponding to the first image of the model still image and the corresponding still image corresponding to the last image of the model still image The shooting time information associated with the selected photographed still image and the shooting time information associated with each corresponding still image and the selected still image selected as the next corresponding still image in time series. Based on a second display time ratio calculating means for calculating a ratio of the display time of each corresponding still image;
When the operation input detection unit detects the operation input instructing frame-by-frame playback of the model still image and the corresponding still image, the first image of the model still image and the corresponding still image is played back The total time from the start time to the start of playback of the last image is the same, and each model still image is played back at the display time ratio calculated by the first display time ratio calculation means, Third frame advance playback means for performing frame advance playback so that the still image is played back at the ratio of the display time calculated by the second display time ratio calculation means,
The display means displays the sample still image reproduced by the third frame advance reproduction means and the corresponding still image in a comparable manner;
The motion evaluation support system according to claim 9. The operation evaluation support device includes:
Display time information changing means for changing the display time information indicating the display time of the model still image based on the timing of the tap when detecting that the plurality of model still images are tapped in order,
The operation evaluation support system according to claim 10 or 11, further comprising: The operation evaluation support device includes:
Time difference information obtained from the shooting time information of the taken still image selected as the corresponding still image corresponding to each of the specified still image and the next still image in time series, and the specific still image An operation timing deviation detecting means for detecting a deviation in timing of the predetermined operation based on a result of comparing the display time of the model still image;
The display means displays information indicating a deviation in operation timing detected by the operation timing deviation detection means;
The motion evaluation support system according to claim 10, wherein: The operation evaluation support apparatus further includes a transmission unit that transmits an evaluation result of the predetermined operation,
The server further comprises receiving means for receiving the evaluation result transmitted by the transmitting means of the operation evaluation support apparatus,
The transmission means of the operation evaluation support apparatus transmits information indicating a shift in the operation timing as the evaluation result,
The receiving means of the server receives information indicating the deviation of the operation timing as the evaluation result;
The operation evaluation support system according to claim 13, wherein: The operation evaluation support apparatus further includes a transmission unit that transmits an evaluation result of the predetermined operation,
The server further comprises receiving means for receiving the evaluation result transmitted by the transmitting means of the operation evaluation support apparatus,
The storage means of the motion evaluation support apparatus further stores character information indicating an evaluation criterion of the predetermined motion, which is associated with each of the model still images,
The display means displays the character information in the vicinity of the associated model still image,
The operation input detection unit of the motion evaluation support apparatus is configured so that a user can perform the operation based on the sample still image displayed on the display unit, the captured still image associated therewith, and the character information. When the input of the evaluation information indicating the judged evaluation is detected, the display means displays the evaluation information, the storage means of the motion evaluation support apparatus stores the evaluation information, and the transmission of the motion evaluation support apparatus The means transmits the evaluation information as the evaluation result, and the receiving means of the server receives the evaluation information as the evaluation result.
The motion evaluation support system according to claim 8, wherein the system is an operation evaluation support system. The operation evaluation support system further includes a terminal for an instructor that is communicably connected to the server,
The transmitting means of the server transmits the evaluation result received by the receiving means and the evaluated person identification information for identifying the evaluated person related to the evaluation result to the instructor terminal,
The instructor terminal includes receiving means for receiving the evaluation result and the evaluated person identification information transmitted by the transmitting means of the server.
The operation evaluation support system according to claim 14 or 15, wherein A motion evaluation support method for supporting evaluation of a predetermined motion,
A storage step of storing a plurality of example still images, which are still images indicating operation states at a plurality of timings of the predetermined operation as examples;
A captured moving image acquisition step of acquiring a captured moving image that is a moving image obtained by capturing an operation including the predetermined operation;
A shooting still image acquisition step of acquiring a plurality of still images as shooting still images from the shooting moving image acquired in the shooting moving image acquisition step;
A first display step for displaying the example still image stored in the storage step and the captured still image acquired in the captured still image acquisition step;
When an operation input for selecting a corresponding still image corresponding to each of the sample still images from the photographed still images displayed in the first display step is detected, the example still image and the corresponding still image are associated with it. A second display step for displaying the corresponding still image in a comparable manner;
An operation evaluation support method characterized by comprising: To a computer that supports the evaluation of a predetermined action,
A storage procedure for storing a plurality of example still images, which are still images indicating operation states at a plurality of timings of the predetermined operation as examples;
A shooting moving image acquisition procedure for acquiring a shooting moving image that is a moving image obtained by shooting an operation including the predetermined operation;
A shooting still image acquisition procedure for acquiring a plurality of still images as shooting still images from the shooting moving image acquired in the shooting moving image acquisition procedure;
A first display procedure for displaying the example still image stored in the storage procedure and the captured still image acquired in the captured still image acquisition procedure;
When an operation input for selecting a corresponding still image corresponding to each of the sample still images from the captured still images displayed in the first display procedure is detected, the corresponding still image of the example is associated with the still image. A second display procedure for displaying the corresponding still image in a comparable manner;
A program for running