JP2019023770A - Video generation apparatus, video generation method, and video generation program - Google Patents

Abstract

An image generation apparatus guides a user's running with visual information. An image generation device for generating a 3D pseudo-space image, the control unit for controlling the image generation device, a sensor unit for acquiring sensor data, and the image generation device based on the sensor data. A positioning unit that calculates positioning data of a user wearing the camera, a camera data generation unit that generates camera data including at least one of camera coordinates, camera orientation, and camera angle of view in 3D pseudo space; An avatar data generation unit that generates avatar data including avatar coordinates and avatar motion in the 3D pseudo space, generates the avatar coordinates based on pace data, and the 3D pseudo space based on the camera data and the avatar data. A 3D video generation unit that generates video, and a video display unit that displays the 3D pseudo-space video. Obtain. [Selection] Figure 2

Description

  The present invention relates to a video generation device, a video generation method, and a video generation program.

  In recent years, with the advancement of sensor technology, the use of sensor technology for sports training has been studied. Patent Document 1 describes a method for selecting music to be played back during a training program.

JP2015-91350A

  However, the method described in Patent Document 1 has a problem that the user cannot visually grasp the accurate distance when the set distance is guided by the set time.

  The present invention has been made in view of such circumstances, and an object of the present invention is to provide a video generation apparatus, a video generation method, and video generation that guide a running user to run a set distance that is a set time. To provide a program.

  In order to solve the above-described problems, the configuration of a video generation device, a video generation method, and a video generation program according to the present invention is as follows.

  The video generation device of the present invention is a video generation device that generates a 3D pseudo-space video, a control unit that controls the video generation device, a sensor unit that acquires sensor data, and the sensor data based on the sensor data, Camera data for generating camera data including a positioning unit for calculating positioning data of a user wearing the video generation device and at least one of camera coordinates, camera orientation, and camera angle of view in 3D pseudo space Based on the generating unit, the avatar data generating unit that generates the avatar data including the avatar coordinates and the avatar motion in the 3D pseudo space, and generating the avatar coordinates based on the pace data, based on the camera data and the avatar data, 3D video generation unit for generating the 3D pseudo-space video, and video for displaying the 3D pseudo-space video Includes a radical 113, the.

  In the video generation device of the present invention, the pace data includes at least one of the position, speed, or acceleration of the avatar with respect to time.

  In the video generation device of the present invention, the camera data is set based on the positioning data and the user motion data.

  The video generation apparatus of the present invention further includes a motion detection unit that calculates user motion data of the user based on the sensor data.

  In the video generation device of the present invention, the positioning data is the speed of the user or the speed of the user.

  In the video generation device of the present invention, the motion data includes the user's ground contact, and the positioning unit changes the user speed or the user speed when the user ground contact is detected.

  In the video generation device of the present invention, the sensor data includes information indicating whether or not the user is climbing, and the avatar data generation unit determines the speed or acceleration of the avatar when the user is climbing. Decrease.

  In the video generation device of the present invention, the sensor data includes information indicating whether or not the user is down, and the avatar data generation unit calculates the speed or acceleration of the avatar when the user is down. increase.

  In the video generation device of the present invention, the sensor data includes vital data of the user, and the avatar data generation unit further generates the avatar coordinates based on the vital data.

  In the video generation apparatus of the present invention, the control unit has a function of setting a track mode optimal for a track and a load mode optimal for loading.

  In the video generation device of the present invention, the avatar data generated by the avatar data generation unit differs depending on whether the mode set by the control unit is the track mode or the load mode.

  In the video generation device of the present invention, the positioning unit generates the positioning data using matching with map information.

  In the video generation device of the present invention, when the control unit sets the track mode, the positioning unit detects the circulation information of the user, and the camera data generation unit is based on the rotation information. The camera position is corrected.

  In the video generation device of the present invention, the control unit further has a function of setting a running mode and a cycling mode in the road mode, and the avatar data generated by the avatar data generation unit is The running mode is different from the cycling mode.

  The video generation method of the present invention is a video generation method for generating a 3D pseudo-space video, wherein a control process for controlling the video generation apparatus, a sensor process for acquiring sensor data, and the sensor data, Camera data for generating camera data including at least one of a positioning process for calculating positioning data of a user wearing the video generation device and camera coordinates, camera orientation, and camera angle of view in 3D pseudo space Based on the generation process, the avatar data generation process for generating the avatar data including the avatar coordinates and the avatar motion in the 3D pseudo space, and generating the avatar coordinates based on the pace data, the camera data and the avatar data, A 3D image generation process for generating the 3D pseudo-space image; Comprising a Shimesuru image display process, the.

  The video generation program of the present invention causes a computer to execute the above-described video generation method.

  According to the present invention, the video generation apparatus can guide the user's running with visual information.

It is a schematic block diagram which shows the structure of the video generation apparatus which concerns on this embodiment. It is a figure which shows an example of the function in this embodiment. It is a figure which shows an example of the pace data in this embodiment. It is a figure which shows an example of the function in this embodiment.

(First embodiment)
FIG. 1 is a diagram illustrating an example of a video generation apparatus 10 according to the present embodiment. As shown in FIG. 1, the video generation apparatus 10 in this embodiment includes an operation unit (operation step) 101, a control unit (control step) 102, a sensor unit (sensor step) 103, a positioning unit (positioning step) 104, motion Detection unit (motion detection step) 105, camera data generation unit (camera data generation step) 106, avatar data generation unit (avatar data generation step) 107, 3D video generation unit (3D video generation step) 108, video display unit (video) Display step) 109. For example, the video generation device 10 can be realized by a glasses-type terminal. Note that the video generation device 10 may not include the video display unit 109. For example, the video generation device 10 may simply output a signal from the 3D video generation unit 108. In that case, for example, the video display unit 109 can be a glasses-type terminal.

  The operation unit 101 outputs data generated by a user operation to the control unit 102.

  The control unit 102 controls the camera data generation unit 106, the avatar data generation unit 107, and the 3D video generation unit 108.

The sensor unit 103 includes a position sensor, a speed sensor, an acceleration sensor, a gyro sensor, a geomagnetic sensor, an atmospheric pressure sensor, a stride sensor, and a vital sensor. Position sensors include GPS (Global Positioning System) sensors, GNSS (Global Navigation Satellite System) sensors, IMES (Indoor Messaging System) sensors, Bluetooth (registered trademark) sensors, UWB (Ultra Wide Band) sensors, wireless LAN sensors, and acoustic wave sensors. It can be realized by a visible light sensor, an infrared sensor, a rotation detection sensor, or the like. A speed sensor can also be realized using these. For example, by detecting the Doppler frequency of the radio wave from the GPS satellite, the sensor unit 103 can detect the speed (Velocity) or the speed (Speed) of the video generation device 10. In addition, the sensor unit 103 can detect the speed from the position variation at a certain elapsed time. Also, the speed sensor can be realized by a stride sensor. The vital sensor uses, for example, an infrared sensor and measures vital data of the user wearing the video generation device 10. The vital data is, for example, a pulse, a heartbeat, a blood pressure, a blood sugar level, and the like. The sensor unit 103 outputs sensor data obtained from the sensor to the positioning unit 104 and the motion detection unit 105.

  The positioning unit 104 uses the sensor data obtained from the sensor unit to calculate positioning data such as the moving distance, moving path, speed, speed, direction, and current position of the video generation device 10. For example, the movement distance calculated by the positioning unit 104 can be the cumulative movement distance after the start of training is notified from the control unit 102. For example, the positioning unit 104 can change the speed of the video generation device 10 only when the contact of the foot of the user wearing the video generation device 10 is detected. The positioning unit 104 outputs the calculated positioning data to the camera data generation unit 106 and the avatar data generation unit 107.

The motion detection unit 105 detects the motion of the user wearing the video generation device 10 based on the sensor data obtained from the sensor unit 103, and uses it as user motion data. An example of this user motion data is the orientation of the head of the user of the video generation device 10, whether the user of the video generation device 10 is just before the start of running, and whether the user of the video generation device 10 is a grounding operation for running. Or may be. The motion detection unit 105 outputs the generated user motion data to the camera data generation unit 106 and the avatar data generation unit 107. Further, data further generated based on the generated user motion data may be used in place of data generated by the operation unit 101 as data generated by a user operation.

The camera data generation unit 106 obtains camera data such as camera coordinates, camera orientation, and camera angle of view in a pseudo space for generating 3D video, positioning data obtained from the positioning unit 104, and user motion obtained from the motion detection unit 105. Determine based on the data. When the training is not started, the camera data generation unit 106 sets the camera position to the initial position, for example, the position and direction in which the entire image of the avatar appears on the display device when the avatar is placed 5 meters ahead of the user. , Can be set as the angle of view. The camera data generation unit 106 can move the user wearing the video generation apparatus 10 from the initial position by a movement distance after starting training. For example, in the pseudo space, when the y-axis is taken as the vertical direction and the x-axis and the z-axis are taken as the orthogonal coordinates in the plane direction, the camera position can be moved by increasing the z-axis coordinates. Alternatively, it may be reflected in the x coordinate and the z coordinate in consideration of the movement route. Further, the coordinate management of the user, camera position, and avatar position may be an absolute coordinate system or a relative coordinate system. Alternatively, the height may be taken into consideration and reflected in the y coordinate. Also, the camera data generation unit 106 can determine the camera direction in the pseudo space based on the user orientation obtained from the positioning unit 104 and the user head orientation obtained from the motion detection unit 105. Various techniques used for so-called match move can be used for these operations. Note that only the pitching (pitch) of the user's head may be reflected on the camera. Here, pitching is rotation about the x axis when the movement of the camera coordinates is reflected only on the z axis. The camera data generation unit 106 outputs the camera data to the 3D video generation unit 108.

  The avatar data generation unit 107 generates an avatar position, orientation, speed, speed, motion, and the like to be displayed on the video display unit 109 in order to guide training. For example, the control unit 102 can output the avatar movement pace data to the avatar data generation unit 107. For example, when a training guide is realized by increasing the avatar's z-coordinate, the z-coordinate may be determined according to the set time. In addition, the avatar data generation unit 107 may control the movement of the avatar using vital data obtained by the sensor unit 103. The avatar data generation unit 107 may change the motion of the avatar based on the speed of the user. The avatar data generation unit 107 outputs avatar data including the avatar coordinates and motion data to the 3D video generation unit 108.

  The 3D video generation unit 108 generates a 3D video based on the camera position and camera direction input from the camera data generation unit 106, the avatar position input from the avatar data generation unit 107, and motion data. Specifically, the 3D video generation unit 108 can set model data including motion data for bones, bones and polygons, texture data, rigid body data for physical operations, and the like. The display of the avatar on the video display unit 109 can be changed by the 3D video generation unit 108 changing the model data. Specifically, when an avatar in a 3D pseudo space is projected onto the camera, one image that is reflected on the camera is generated. When the video display unit 109 supports stereo display, two cameras are set from the camera position input from the camera data generation unit 106, and two images with parallax for the left eye and the right eye are generated. You may do it. The 3D video generation unit 108 outputs the generated one or two videos to the video display unit 109.

The video display unit 109 displays the video input from the 3D video generation unit 108. For example, the video display unit 109 is mounted on a glasses-type terminal. By doing in this way, the glasses-type terminal can realize an AR (Augmented Reality) display of the avatar. When the glasses-type terminal has displays for both eyes and two images are input from the 3D image generation unit 108, the images can be displayed on the left eye and right eye displays.

  FIG. 2 is an example of functions provided by the video generation device 10. FIG. 2 shows a state where the user 202 has run on the route 201. The user 202 is wearing a glasses-type terminal 203 as an example of the video generation device 10. The video to be displayed on the display (video display unit 109) of the glasses-type terminal 203 is generated based on the 3D pseudo space 21. In the pseudo space 21, the x axis is horizontal, the y axis is vertical, and the z axis is front. The camera 211 represents the position and orientation of the glasses-type terminal 203 in the pseudo space. The avatar 212 moves in the z-axis direction in the pseudo space at the set pace. A coordinate 213 is the z coordinate of the camera 211. For example, the value of the coordinate 213 can be the distance of the route 201 obtained by the positioning unit 104. For example, when the path 201 is composed of a plurality of discrete positioning points, the total distance between the positioning points can be set as the value of the coordinate 213. The coordinate 214 is the z coordinate of the avatar 212 and changes at a set pace. By displaying the video obtained by the camera 211 on the display of the glasses-type terminal 203, the user 202 can perform running such as chasing the avatar 212 in real space. In addition, the avatar 212 can set the initial z coordinate to 3 m, for example. The avatar 212 runs in front of the user 202 and performs pacemaking, and the user 202 can be prevented from overlapping the avatar 212. Alternatively, the forward view of the user 202 can be opened by setting the initial x-coordinate slightly to 1 m, such as 1 m.

  FIG. 3 is an example of pace data when the avatar 212 is operated as a pacemaker of 100 m running. The speed table 31 represents the speed at which the avatar 212 moves at a certain time. For example, the avatar 212 moves at 2.2 m / s until 0.5 seconds after the training start time. The distance table 32 represents the moving distance of the avatar 212 at a certain time. For example, after 2.5 seconds from the training start time, the avatar 212 has moved by 9.55 m. The pace data may use speed as shown in the speed table 31 or may use movement distance as shown in the distance table 32. In this example, the avatar 212 operates as a pacemaker that runs 100 m at a time of 11 seconds 98. In FIG. 3, the speed and distance are changed every 0.5 seconds, but the present invention is not limited to this, and it may be finer. The time may be an absolute time or a relative time based on a certain time.

  The pace data is not only determined by the time and speed, but may be defined by the acceleration avatar's acceleration (acceleration) with respect to the user's speed. For example, when the user's speed is equal to or lower than the target speed, the avatar's acceleration is a positive value, and when the user's speed reaches the target speed, the avatar's acceleration is zero. By defining the relationship as a curve, the avatar can run at the target speed. If the user's speed is slower than a certain value, the target speed at which the acceleration of the avatar is reduced to 0, the acceleration is set to a negative value to match the user's running pace, or if the user is loaded on a slope, The speed at which the acceleration becomes 0 may be lowered and the slope of the acceleration curve may be set to be small so as to slow down the avatar's running pace. Further, when the distance between the user and the avatar is a predetermined value or more, a method in which the avatar speed is set to approximately 0 and the avatar waits temporarily may be used. In this case, the avatar may be automatically restarted when the avatar approaches the predetermined value.

Returning to FIG. 2, another service example will be described. The pace of the avatar 212 may not be planned in advance as shown in FIG. 3, but may be changed in real time. For example, the pace of the avatar 212 can be changed based on the user's vital data.
For example, it is possible to create a pace for running while keeping the user's heart rate constant. When the heart rate exceeds the target heart rate, the speed of the avatar 212 can be decreased, and when the heart rate is lower than the target heart rate, the speed of the avatar 212 can be increased. Further, when the heart rate exceeds the target heart rate, the motion of the avatar 212 can be reduced so that the exercise load on the user 202 is reduced. When the heart rate falls below the target heart rate, the motion of the avatar 212 can increase the exercise load on the user 202. A pulse rate may be used instead of the heart rate. The vital data may be blood pressure or blood glucose level. Note that when the vital data of the user 202 reaches a value at which exercise should be stopped, the avatar 212 may perform an operation for prompting the user to stop running.

  FIG. 4 is an example of functions provided by the video generation device 10. In FIG. 2, only the movement distance of the user is used, but in FIG. 4, the movement route is also considered. FIG. 4 shows a state in which the user 402 has run on the route 401. The user 402 is wearing a glasses-type terminal 403 as an example of the video generation device 10. The video to be displayed on the display (video display unit 109) of the glasses-type terminal 403 is generated based on the 3D pseudo space 41. In the pseudo space 41, the y axis represents the height, and the x axis and the z axis represent the ground. The camera 411 represents the position and orientation of the glasses-type terminal 403 in the pseudo space. The avatar 412 moves in the xz plane based on the set pace and route. In this figure, the route starts from the origin in the positive z-axis direction, turns to the left in the middle, and takes the negative x-axis direction as the path. A coordinate 413 is a coordinate of the camera 411 and reproduces a path 401 obtained by positioning in the xz plane. For example, the initial point can be the origin. The coordinates 414 are the coordinates of the avatar 412, and move based on the set pace and route. For example, the z-axis can be north obtained by a geomagnetic sensor or the like. In this case, the pace data of the avatar 412 needs to be two-dimensional coordinates, unlike FIG. Note that the height may be considered in consideration of a slope or the like.

  Note that when the positioning unit 104 detects that the user wearing the video generation device 10 is running on a slope, the avatar data generation unit 107 may change the pace data. For example, the avatar data generation unit 107 can reduce the avatar's pace when the user is running uphill. For example, the avatar data generation unit 107 can increase the avatar's pace when the user is running downhill. By doing so, it is possible to balance running. To determine whether the user is going up or down a hill, use an acceleration sensor to measure the user's vertical acceleration, or if you have map data, Various methods such as a method of referring to terrain data may be used.

  Note that the avatar data generation unit 107 may change the motion of the avatar based on the speed of the avatar. For example, when the acceleration is large, the avatar data generation unit 107 can reduce the pitch of the motion of the avatar. By doing in this way, the motion of an avatar can approach the motion of an actual runner.

(Second Embodiment)
In the first embodiment, the method of displaying an avatar that operates as a running pacemaker on the video display unit 109 has been described. This embodiment demonstrates the case where the video production | generation apparatus 10 has a track (Track, stadium, Arena, Stadium) mode and a road (Road, Street) mode.

  Returning to FIG. The operation unit 101 can change between the track mode and the load mode of the video generation device 10 based on data generated by a user operation. Further, the positioning unit 104 can change the track mode and the load mode of the video generation device 10 based on the position of the video generation device 10.

  The avatar data generation unit 107 can change the avatar coordinates based on the track mode or the load mode. For example, the avatar data generation unit 107 can set the avatar coordinates in the track mode to be next to the user. For example, the avatar data generation unit 107 can set the avatar coordinates in the load mode in front of the user. By doing in this way, a user's side view can be cleared.

  In the case of the track mode, the positioning unit 104 may correct the travel distance of the user using the fact that the user goes around. For example, when it is detected that the user has made a round of a 400 m track, the travel distance of the user may be 400 m. For example, when the user avoids other users, the distance for one lap may increase if the travel distance is calculated based only on the user's positioning data. By detecting one round of the user and correcting the travel distance, the problem that the distance increases can be avoided. For example, the positioning unit 104 can detect one round by temporarily recording the position of the user and determining that the user has returned to that position. Alternatively, the positioning unit 104 can detect one round by receiving a signal from a wireless device such as a beacon arranged at the reference position. Arrangement When the user detects that the user has made a half turn of the 400 m track, the user's travel distance may be 200 m, and is not limited.

  The avatar data generation unit 107 can change the motion of the avatar based on the track mode or the load mode. For example, the avatar data generation unit 107 can make the avatar motion in the load mode not occupy the screen. Moreover, you may make settings, such as changing avatar model data, displaying an avatar translucently, or making an avader small. In this way, the user's field of view on the road can be cleared.

  In the load mode, the positioning unit 104 can perform matching with map data. For example, the positioning unit 104 can calculate the latitude and longitude of the video generation device 10 based on road information or the like of map data. By doing so, the accuracy of latitude and longitude can be improved. In addition, the positioning unit 104 can calculate the altitude of the video generation device 10 from the latitude, longitude, and map data of the video generation device 10.

  In the load mode, the 3D video generation unit 108 can output a video including a map image to the video display unit 109. The map image may include information indicating the position of the user. By doing in this way, the user can grasp where he is running.

As a kind of road mode, a cycling mode with a faster moving speed may be set. In the cycling mode, the (virtual) position of the avatar displayed on the video generation device 10 may be set far from the user. Thereby, the field of view of the moving direction seen from the user is ensured from the load mode. Also, when the avatar's virtual position approaches the user, set the avatar's virtual position to run parallel with the user in the road mode, and make the avatar translucent and overlap with the user in the cycling mode. May be. Further, another window may be displayed on the screen edge or the like, and an image of another viewpoint may be displayed there. Thereby, it can prevent that a user's eyes | visual_axis remove | deviates from a front at the time of the high-speed movement of cycling mode. Also, an operation such as changing the acceleration curve of the avatar according to the gradient of the running position or the (virtual) position of the avatar may be performed. The motion of the avatar may be changed according to these gradients. When the speed limit information of the current location can be acquired from the map data, the acceleration curve may be changed so that the moving speed of the avatar does not exceed the speed limit.

  The video generation apparatus, the video generation method, and the program that operates in the video generation program according to the present invention are a program that controls a CPU or the like (a computer is caused to function) so as to realize the functions of the above-described embodiments. Program). Information handled by these devices is temporarily stored in the RAM at the time of processing, then stored in various ROMs and HDDs, read out by the CPU, and corrected and written as necessary. As a recording medium for storing the program, a semiconductor medium (for example, ROM, nonvolatile memory card, etc.), an optical recording medium (for example, DVD, MO, MD, CD, BD, etc.), a magnetic recording medium (for example, magnetic tape, Any of a flexible disk etc. may be sufficient. In addition, by executing the loaded program, not only the functions of the above-described embodiment are realized, but also based on the instructions of the program, the processing is performed in cooperation with the operating system or other application programs. The functions of the invention may be realized.

  In the case of distribution in the market, the program can be stored and distributed in a portable recording medium, or transferred to a server computer connected via a network such as the Internet. In this case, the storage device of the server computer is also included in the present invention. Further, part or all of the video generation apparatus, the video generation method, and the video generation program in the above-described embodiments may be realized as an LSI that is typically an integrated circuit. Each functional block of the receiving apparatus may be individually formed as a chip, or a part or all of them may be integrated into a chip. When each functional block is integrated, an integrated circuit controller for controlling them is added.

  Further, the method of circuit integration is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor. In addition, when an integrated circuit technology that replaces LSI appears due to progress in semiconductor technology, an integrated circuit based on the technology can also be used.

  In addition, this invention is not limited to the above-mentioned embodiment. It goes without saying that the video generation device of the present invention is not limited to application to a mobile station device, but can be applied to portable devices, wearable devices, and the like.

  The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and the design and the like within the scope not departing from the gist of the present invention are also claimed. Included in the range.

  The present invention is suitable for use in a video generation device, a video generation method, and a video generation program.

DESCRIPTION OF SYMBOLS 10 Video generation apparatus 101 Operation part 102 Control part 103 Sensor part 104 Positioning part 105 Motion part 106 Camera data generation part 107 Avatar data generation part 108 3D video generation part 109 Video display part 201 Path | route 202 User 203 Glasses type terminal 21 Pseudo space 211 Camera 212 Avatar 213, 214 Coordinate 31 Speed table 32 Distance table 401 Path 402 User 403 Glasses type terminal 41 Pseudo space 411 Camera 412 Avatar 413, 414 Coordinate

Claims (16)

A video generation device that generates a 3D pseudo-space video,
A control unit for controlling the video generation device;
A sensor unit for obtaining sensor data;
Based on the sensor data, a positioning unit that calculates positioning data of the user wearing the video generation device;
A camera data generation unit that generates camera data including at least one of camera coordinates, camera orientation, and camera angle of view in 3D pseudo space;
An avatar data generating unit that generates avatar data including avatar coordinates and avatar motion in the 3D pseudo space, and generates the avatar coordinates based on pace data;
Based on the camera data and the avatar data, a 3D video generation unit that generates the 3D pseudo-space video;
An image display unit for displaying the 3D pseudo-space image;
A video generation apparatus comprising:   The video generation apparatus according to claim 1, wherein the pace data includes at least one of an avatar position, speed, or acceleration with respect to time.   The video generation apparatus according to claim 1, further comprising a motion detection unit that calculates user motion data of the user based on the sensor data.   The video generation apparatus according to claim 3, wherein the camera data is set based on the positioning data and the user motion data.   The video generation apparatus according to claim 1, wherein the positioning data is a speed of the user or a speed of the user. The user motion data includes a ground contact of the user;
The positioning unit changes the speed of the user or the speed of the user when the ground contact of the user is detected.
The video generation device according to claim 4. The sensor data includes information on whether or not the user is climbing,
The avatar data generation unit reduces the speed or acceleration of the avatar when the user is climbing,
The video production | generation apparatus in any one of Claim 1 to 6. The sensor data includes information on whether the user is down,
The avatar data generation unit increases the speed or acceleration of the avatar when the user is down,
The video production | generation apparatus in any one of Claim 1 to 6. The sensor data includes vital data of the user,
The avatar data generation unit further generates the avatar coordinates based on the vital data.
The video generation device according to claim 1. The control unit has a function of setting a track mode optimal for a track and a load mode optimal for loading.
The video production | generation apparatus in any one of Claim 1 to 9. In the case where the mode set by the control unit is the track mode and the load mode,
The avatar data generated by the avatar data generation unit is different.
The video generation device according to claim 10. The positioning unit generates the positioning data using matching with map information.
The video generation device according to claim 1. When the control unit sets the track mode,
The positioning unit detects the circulation information of the user,
The camera data generation unit corrects the camera data based on the circulation information.
The video generation device according to claim 10 or 11. The control unit has a function of further setting a running mode and a cycling mode when in the road mode,
The avatar data generated by the avatar data generation unit is different between the running mode and the cycling mode.
The video generation device according to claim 10 or 11. A video generation method for generating a 3D pseudo-space video,
A control process for controlling the video generation method;
A sensor process for obtaining sensor data;
A positioning process for calculating positioning data of a user wearing the video generation device based on the sensor data;
A camera data generation process for generating camera data including at least one of camera coordinates, camera orientation, and camera angle of view in 3D pseudo space;
Avatar data generation process of generating avatar data including avatar coordinates and avatar motion in the 3D pseudo space, and generating the avatar coordinates based on pace data;
A 3D image generation process for generating the 3D pseudo-space image based on the camera data and the avatar data;
An image display process for displaying the 3D pseudo-space image;
A video generation method comprising:   A video generation program for causing a computer to execute the video generation method according to claim 15.

Images