JP2001299975A - Bodily sensing device and bodily sensing system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a dance game device for evaluating a dance by a movement of the whole body. SOLUTION: A 3D image of a character being a model is displayed on a second divided image screen 11b of a monitor device 2, and a continuous photographic auxiliary image for indicating a flow of the dance is displayed on a lower side auxiliary image screen 12 of the monitor device 2. A player recognizes the flow of the dance by this auxiliary image, and performs the dance by imitating the 3D image of the character. This posture is picked up by a front camera device 13 to be displayed on a first divided image screen 11a. A plurality of infrared lasers 17 and infrared ray sensors 18 arranged on a stage 1 detect a step position and the step timing of the player. A back camera device 7 picks up a back face image of the player. This back face image is processed so as to match with the 3D image of the character. The dance of the player is comprehensively evaluated on the basis of detecting output from the infrared ray sensors 18 and this matching error.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a bodily sensation device and a bodily sensation system suitable for use in, for example, a dance game apparatus, a technique acquisition apparatus for acquiring techniques such as baseball pitching and batting forms, and the like.

[0002]

2. Description of the Related Art In today's game machines, players
While the mainstream is to enjoy a game by operating a controller connected to a computer device with a fingertip, recently, a “bodily sensation game machine” in which a player enjoys a game using the whole body has become popular.

[0003] As one of the bodily sensation game machines, there is a dance game apparatus which counts how much the player steps on the steps in accordance with the step instructions displayed on the monitor screen and counts the number of steps performed according to the instructions. Are known.

More specifically, this dance game apparatus is installed in a game center, an amusement park, or the like, and displays a three-dimensional image 300 or a step instruction image 301 as a model as shown in FIG. Device 302
And a computer device 303 provided on the back side of the monitor device 302, and a stage 304 on which a player rides and dances.

[0005] Step instruction image 30 of the monitor device 302
1, for example, is scrolled from the lower side of the screen toward the upper side. Among them, the uppermost step instruction image 301U is a step instruction image for instructing the current step, and is blinked or lit.

A three-dimensional image 30 displayed adjacent to the step instruction image 301 in the form of a divided screen is displayed.
Numeral 0 is, for example, a three-dimensional animation image of a human, and shows a typical dance for the player by taking the steps indicated by the step instruction image 301 while taking a pose as a model of the player. It has become.

On the other hand, on the stage 303, there is provided a step section 304 for indicating the vertical, horizontal and step positions. The step unit 304 has a built-in pressure sensor. The pressure sensor detects the stepping pressure at the timing when the player steps on the step, and outputs the detection output via the bus line 306 to the computer 303.
To be supplied.

In such a dance game device, when a game is started, a step instruction image 301 on a monitor device 302 is scroll-displayed from the lower side to the upper side of the screen,
A step instruction is issued to the player, and a three-dimensional image 300 synchronized with the step instruction is displayed.

The player takes the pose of the three-dimensional image 300 as an example and scrolls and displays the step instruction image 30.
The step unit 304 corresponding to the step designated by the uppermost step instruction image 301U is recognized while recognizing the step to be performed next from step 1 onward. When the step portion 304 is depressed by the player's step, a built-in pressure sensor detects this, and outputs this detection output to the bus line 30.
6 to the computer device 303.

The computer device 303 detects the currently designated step direction and the timing of the step, and the currently supplied detection output is the pressure sensor of the step section 304 corresponding to the currently designated step direction. Or not, and whether or not a step has been performed at a timing within a predetermined error range (= whether or not a detection output has been supplied at a timing within a predetermined error range). Judge.

When the supplied detection output is in the step direction as instructed and indicates that the step has been performed at a timing within a predetermined error range, the player outputs It is determined that the step as instructed has been performed, and the evaluation score is added. The evaluation points are displayed on the monitor device 302 in real time during the game (or after the game is over), and each player competes for the level of the evaluation points.

[0012]

However, in the conventional dance game apparatus, as described above, the evaluation score is determined by how much the step in the direction instructed by the computer device 303 is performed without causing a timing shift. (Only steps are evaluated.)

[0013] For this reason, the movement of the upper body is not an object to be evaluated, and if the order of the steps in the entire game is memorized, the difficulty decreases, and the game becomes a mere stepping game, which is not interesting. was there.

[0014] The present invention has been made in view of the above-mentioned problems, and is intended to evaluate not only the steps but also the movements of the entire body, so that it is difficult to play a game, and an interesting sensation device is provided. The purpose is to provide.

[0015]

In order to solve the above-mentioned problems, a bodily sensation device according to the present invention has a front image capturing means for capturing a front image of a player and a rear image capturing means for capturing a rear image of the player. Storage means for storing a moving image of a predetermined character and an auxiliary image indicating the movement of the character; and dividing the display area of the display means into at least three divided areas, and capturing the front image in a first divided area. Means for controlling display of a front image of the player captured by the means, controlling display of a moving image of the character read from the storage means in a second divided area, and reading and controlling the moving image of the character read from the storage means in a third divided area. Display control means for controlling the display of the plurality of auxiliary images in time series, a back image of the player captured by the back image capturing means, and a character read from the storage means. A matching error detecting means for performing image matching processing on the moving image to detect a matching error between the two, a step position and a step timing of the player are detected, and a step position and a step position of the moving image of the character read from the storage means are detected. All means including a step error detecting means for detecting an error between the two by comparing with the timing of the step, and an evaluating means for evaluating a movement of the player based on each detection output from the matching error detecting means and the step error detecting means. Or selectively have these means.

In the present invention, the matching error detecting means detects the movement of the player's body, and the step error detecting means detects the player's step position and step timing. Then, the evaluation means comprehensively evaluates the movement of the player based on each of the detection outputs.

[0017]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS First Embodiment First, a bodily sensation device according to the present invention is applied to a dance game device having an external appearance as shown in FIG. 1 installed in an amusement park or a game center, for example. be able to.

[Configuration of First Embodiment] (External Configuration of Dance Game Apparatus) In FIG.
The dance game device according to the first embodiment of the present invention includes:
It has a stage 1 on which a player rides, a monitor device 2 for displaying a captured image of the player and the like, and a computer device 3 provided on the back side of the monitor device.

The stage 1 has a substantially rectangular floor shape with an upper surface raised one step in parallel with the ground, and a short side of the short side has a wall-shaped monitor standing upright with respect to the ground. The device 2 (and the computer device 3) is provided, and on the other short side, a wall-shaped half mirror 4 is provided so as to stand vertically to the ground.

At the four corners on the bottom side (ground contact side) of the stage 1, for example, columnar legs 5 are provided, and the dance game apparatus is connected to each of the four legs 5 via these four legs. It is designed to be placed on the ground. For this reason, the stage 1 is substantially in a floating state, and has a structure in which vibrations and the like caused by the steps of the player are hardly transmitted to the ground because the ground contact area with the ground is small.

Without providing these legs 5,
The stage 1 may be installed directly on the ground. In this case, it may be preferable to provide a shock absorbing member or the like between the stage 1 and the ground so that vibrations or the like caused by the steps of the player are hardly transmitted to the ground.

Each leg 5 has a carrier 6
Is provided in a built-in manner. Each carrier 6 includes a parallel rotation mechanism that enables the wheels to rotate 360 degrees in a direction parallel to the ground, a rolling mechanism that supports the wheels so as to roll about a rotation axis parallel to the ground, and And a lock mechanism for suppressing the rotation of the wheel by the rotation mechanism and the rolling of the wheel by the rolling mechanism.

When the dance game apparatus is moved to a desired place, the wheels of each carrier 6 are rotated by pushing the dance game apparatus in a desired direction in a state where the lock mechanism of each carrier 6 is removed. The dance game device can be easily moved to a desired place by force. Further, after the dance game apparatus is moved to a desired place, the rotation and rolling of each wheel are locked by a lock mechanism, so that the dance game apparatus can be fixedly installed at the place. ing.

A pair of rear speaker devices 7 are provided at both corners of the stage 1 on the half mirror 4 side so as to be in contact with the half mirror 4. As will be described later, since the player generally dances toward the monitor device 2 side, a normal speaker device for high / middle / low frequency may be provided as the rear speaker device 7, It may be preferable to provide a speaker device.
By providing the speaker device for heavy bass, the sound pressure of heavy bass is applied from behind the player dancing on the stage, so that the player's willingness to play the game can be improved.

It should be noted that, as shown in FIG. 1, the stage 1 is built in, for example, at four corners or the like, instead of or together with the rear speaker device 7.
A plurality of speaker devices 8 for heavy bass may be provided. In this case, it is preferable that the heavy bass speaker device 8 be firmly attached to the stage 1 so that the player can sufficiently withstand the stepping pressure when the player steps on the stage.

As a result, since the sound pressure of the heavy bass is applied from below the feet of the player dancing on the stage 1, the player's willingness to play the game can be further improved. Further, when the speaker device 8 for heavy bass is provided in the form of being built in the stage 1 instead of the rear speaker device 7,
The installation area of the rear speaker device 7 can be reduced, and the movable range of the player on the stage 1 can be expanded.

Next, on the half mirror 4 side of the stage 1, a rear camera device 9 is provided at a position substantially in the middle of each of the rear speaker devices 7 so as to be in contact with the half mirror 4. As will be described later, the rear camera device 9 includes, for example, an automatic focus adjustment mechanism such as a so-called three-point distance measurement or a six-point distance measurement, an automatic angle correction mechanism, and a shooting shake correction mechanism (optical or memory reading area variable Any of the formulas may be provided.), And the back of the player who dances toward the monitor device 2 can be photographed at the optimum angle and in focus without blurring.

As the rear camera device, FIG.
The half mirror 4 as shown in FIG.
May be provided with a certain height at a substantially central portion or the like. In this case, since the player on the stage 1 can be photographed substantially in parallel, the automatic angle correction mechanism can be simplified or omitted. Further, since the distance between the stage 1 on which the player dances and the rear camera device 10 is large, the vibration generated by the dance of the player becomes difficult to be transmitted to the rear camera device 10, and the photographing shake correction mechanism can be simplified or omitted. It can be. Further, since no rear camera is provided on the stage 1, the movable range of the player on the stage 1 can be expanded.

Then, instead of the rear speaker device 7, the speaker device 8 for heavy bass is provided in the form of being built in the stage 1, and the rear camera device 10 is provided on the half mirror 4, whereby the original floor area of the stage 1 is provided. Can be all within the movable range of the player without erosion.

Next, the half mirror 4 has a height equal to or greater than the height of the player on the stage 1, reflects light from the player on the stage 1, and reflects the light from the player's side on the stage 1 The stage 1 is provided on the other short side so as to transmit light from the monitor device 2). For this reason, a spectator or the like located behind the dance game device can see the player on the stage 1 through the half mirror 4, but the player on the stage 1 can use the half mirror. The audience or the like located behind the dance game device is not visible through the fourth game device.

By providing such a half mirror 4, the player can concentrate on the dance without worrying about the line of sight of the spectator and the like. Can be satisfied at the same time.

Next, the monitor device 2 has a main screen 11 and an auxiliary screen 12 located below the main screen 11. The main screen 11 has first and second divided screens 11a and 11b divided into two equal parts on the left and right.
A divided image 11a of the player on the stage 1 is displayed on the divided screen 11a, and a three-dimensional image of a character performing a model dance is displayed as an animation on the second divided screen 11b (even if a real image is displayed). Good.)

The auxiliary screen 12 includes the second screen of the main screen 11.
3D image (auxiliary image) showing the current dance (movement) including the present of the character displayed on the divided screen 11b
Are displayed in chronological order. That is, for example, the 3D image 12 on the right side of the auxiliary screen 12
R indicates the current pose of the character, and an auxiliary image indicating the future dance (movement) of the character is displayed along the left direction.

In other words, each auxiliary image on the auxiliary screen 12 is like a continuous photograph. In addition, an auxiliary image that is a so-called “fixed pose” is displayed differently from other poses (to be prominent), for example, the outline of the pose is displayed in a conspicuous color. It has become. The player recognizes the movement of the character from now on by looking at the auxiliary image on the auxiliary screen, and dances by imitating the movement.

Although the main screen 11 of the monitor device 2 is divided into two equal parts, first and second divided screens 11a and 11b, this is divided into three or more divided screens, each of which is a player. And a 3D image of the character may be displayed.

The auxiliary screen 12 may be provided above the main screen 11, or may be provided on the left or right side of the main screen 11. However, since the aspect ratio of the current monitor device is “4: 3 (SD: standard)” or “16: 9 (HD: high definition)” in the horizontal and vertical directions, the lower or upper side of the main screen 11 is used. By providing the auxiliary screen 12, a large number of auxiliary images showing the flow of the dance can be displayed using a wide display area in the horizontal direction. For this reason, the player can dance while recognizing the flow of the dance to the end.

Next, a front camera device 13 for photographing a front image of the player is provided at a substantially central portion on the upper side of the monitor device 2. As will be described later, the front camera device 13 includes, for example, an automatic focus adjustment mechanism such as a so-called three-point distance measurement and a six-point distance measurement, an automatic angle correction mechanism, and a shooting shake correction mechanism (optical or memory reading area variable). Any one of the formulas may be provided.), So that the player who dances toward the monitor device 2 can be photographed in an optimal angle and focused state without blurring.

Next, a left channel speaker device 14L (L channel speaker device) and a right channel speaker device 14R are provided on both left and right sides of the monitor device 2.
(R channel speaker device). The speaker devices 14L and 14R for the respective channels incorporate speaker devices for the high band, the middle band, and the low band, respectively, so that a balanced high, middle, and low sound output can be obtained. ing.

Here, as will be described later, in the dance game device of the present embodiment, the rear camera device 9 is used.
(Or the rear camera device 10) Trimming only the captured image of the player from the entire captured image, and scoring the dance of the player by performing image matching processing of the captured image of the player and the 3D image as a model. However, it is necessary to facilitate the trimming process on the computer device 3 side (it is necessary to perform an accurate trimming process).

For this reason, in the dance game apparatus, for example, lighting devices 15 are provided at both ends on the upper surface of the monitor device 2 and at both ends on the upper side of the half mirror 4, respectively. In this case, the player is irradiated with light having a complementary color relationship. Thus, the trimming process can be performed accurately, and the dance of the player can be accurately scored.

Next, an outer frame 16 having a height of, for example, about 2 cm is provided on the upper surface side of the stage 1 so as to surround four sides. In the outer frame 16, a plurality of infrared lasers 17 are provided at an interval of, for example, 5 cm in an outer frame 16a on one long side.
A plurality of infrared sensors 18 for detecting infrared beams emitted from the outer frame 16a on the other long side, respectively, are provided on the outer frame 16b on the other long side opposite to a.

Similarly, a plurality of infrared lasers 17 are provided at an interval of 5 cm, for example, on the outer frame 16c on one short side of the outer frame 16, and the outer frame 16c on the one short side is provided. A plurality of infrared sensors 18 for detecting infrared beams emitted from the outer frame 16c on the other short side are provided on the outer frame 16d on the other short side opposite to the other.

Therefore, on the stage 1, a large number of lattice-shaped infrared detection areas each having a side of, for example, 5 cm are formed. As will be described later, each infrared sensor 18
Are output to the computer device 3, and the computer device 3 detects the position of the infrared sensor 18 at which the detection output becomes low level when the infrared beam is shielded by the player's feet or the like. hand,
The timing of the step and the like are determined by detecting the position of the player's feet and the like and detecting the timing when the detection output becomes low level.

(Electrical Configuration of Dance Game Apparatus)
The dance game device has an electrical configuration as shown in FIG. FIG. 2 mainly shows an electrical configuration of an image data processing system of the computer device 3, the rear speaker device 7, the speaker device 8 for heavy bass, and the speaker devices 14R and 14L for left and right channels. Also, illustration of an acoustic system such as these control units is omitted.

In FIG. 2, the dance game apparatus has three-dimensional image data of a character displayed on the second divided screen 11 b of the main screen 11 of the monitor device 2 and an auxiliary image displayed on the auxiliary screen 12. A database 20 storing auxiliary image data and the like;
Controls the display of the image of the player captured on the first divided screen 11a of the main screen 11 of the monitor device 2,
The three-dimensional image data and the auxiliary image data of the character are read from the database 20 and read from the main screen 11.
And a display control unit 21 for controlling the display on the second divided screen 11b and the auxiliary screen 12.

Further, the dance game device includes a background image memory 22 for storing a background image captured by the rear camera device 9 (or the rear camera device 10) in a state where the player is not on the stage 1; An image memory 23 for storing a rear image of the player;
3 has a trimming processing unit 24 for trimming only the player's person image by subtracting the player's background image stored in the background image memory 22 from the player's back image stored in the player's back image.

As described above, the rear camera device 9
The back side of the player on stage 1 (half mirror 4 side)
It is provided in. For this reason, as the background image stored in the background image memory 22, a captured image of the monitor device 2 is mainly stored. Then, the trimming processing unit 24 subtracts a background image captured when the player is not on the stage 1 from an image captured from the back of the player dancing on the stage 1, so that only the image of the player dancing on the stage 1 is obtained. Is to be extracted.

Further, the dance game apparatus performs a matching process between the player image extracted by the trimming processing unit 24 and the character image stored in the database 20 to determine the player movement and the character movement. When the difference is within a predetermined range, the matching determination unit 25 that determines that the player and the character are performing the same movement (dance), and the outer frame 1 of the stage 1
A step position for determining a player's step position and timing based on detection outputs from a plurality of infrared sensors 18 provided in 6b and 16d and data indicating the character's step position and timing read from the database 20. And a timing determination unit 35.

Further, the dance game apparatus has a matching determination section 25 and a step position / timing determination section 35.
, A difference between the movement of the player and the movement of the character is detected, and a predetermined score is added each time the difference is within a predetermined allowable range, and the processing is performed in real time during the game (or after the game ends). And a counting section 26 for forming point image data for displaying the points subjected to the addition processing and supplying the point image data to the display control section 21. The display control unit 21 controls the display of the point image data from the counting unit 26 on the monitor device 2 in real time during the game (or after the game ends).

Further, prior to the start of the game, the dance game device detects the color of the clothing of the player from the person image of the player extracted by the trimming processing section 24 and determines the relationship between the color of the clothing of the player and the complementary color. And a lighting device 15 that performs lighting of the complementary color detected by the complementary color detection unit 27.
Based on a lighting control unit 28 that controls the camera and a captured image of the player captured by the front camera device 13,
The image pickup adjustment unit 33 that adjusts the automatic focus adjustment mechanism, the automatic angle correction mechanism, and the image blur correction mechanism of the front camera device 13 and the rear image of the player captured by the rear camera device 9 (10). Rear camera device 9
(10) automatic focus adjustment mechanism, automatic angle correction mechanism,
And an imaging adjustment unit 34 that adjusts a shooting shake correction mechanism.

Further, the dance game device transmits and receives data of each other's dance game devices via a communication network such as the Internet, so that a plurality of players compete for dance and score, that is, a so-called “net battle”. In order to enable this, the front image data of the front image of the player captured by the front camera device 13 from the display control unit 21, the score image data for displaying the score of the player calculated by the counting unit 26, and the like, For example, a compression encoding unit 29 that performs a compression encoding process using an image compression encoding technology such as an MPEG technology, and the image data and the like that have been compression encoded by the compression encoding unit 29 are converted into, for example, predetermined data. And a transmission unit 30 for packetizing the packet into a long packet and transmitting the packet over a communication network.

Further, the dance game apparatus has a front face image data of another player which has been compression-encoded from another dance game apparatus and transmitted as a packet via a communication network, and a score of the player calculated by the counting section 26. Receiving section 31 for receiving point image data or the like for displaying
And a decompression decoding unit 32 that decompresses and decodes the front image data and the score image data of the other players received in 1 and supplies the data to the display control unit 21.

During the online match, the display control unit 21 displays the front image of the player captured by the front camera device 13 on the monitor device 2, for example, in the first split screen 11a.
And displays the front image of the other player received by the receiving unit 31 on the second divided screen 11 of the monitor device 2.
b, and the score of each player is displayed on the divided screens 11a, 11a,
The display is controlled at 11b.

[Operation of First Embodiment] Next, the operation of the dance game apparatus according to the first embodiment having such a configuration will be described. This dance game device is capable of "single play" in which the player enjoys dancing alone, and "net battle play" in which players in different places compete with each other while communicating with each other.

(Operation in Single Play) First, in a single play, when a player gets on the stage 1 and starts playing, the acoustic control unit (not shown) sets the rear speaker device 7 and the speaker device for heavy bass. 8 and the left and right channel speaker devices 14R and 14L are driven to control the generation of predetermined dance music, and the display control unit 21 shown in FIG. The two-dimensional image is read out and displayed on the second divided screen 11b of the main screen 11 of the monitor device 2 shown in FIG.

Note that a three-dimensional image of a character in a so-called “determined pose” is displayed so as to be prominent, for example, the outline of the pose is displayed in a conspicuous color. .

The display control unit 21 also reads out a 3D image (auxiliary image) indicating the current dance (movement) of the character including the current one from the database 20 and scrolls it in time series. A plurality of displays are controlled on the auxiliary screen 12 of the monitor device 2.

As described above, this auxiliary image is like a continuous photograph, and the auxiliary image 12R on the right side shows the current pose of the character.
Then, the dance (movement) of the character from now on is shown along the left direction. For this reason, the player can dance by watching the auxiliary image on the auxiliary screen while recognizing the future movement of the character.

The auxiliary image that is a so-called “determined pose” is displayed differently from other poses (for example, in a conspicuous manner), for example, the outline of the pose is displayed in a conspicuous color. It is supposed to be. For this reason, the player can recognize in advance the timing for taking the “fixed pose”.

Next, the front camera device 13 provided at a substantially central portion on the upper side of the monitor device 2 takes an image of the player dancing on the stage 1 from the front in this way, and adjusts the front image. Unit 33 and display control unit 21
To supply.

The imaging adjustment unit 33 is provided with the front camera device 1.
Based on the front image from No. 3, focus adjustment, angle correction and image blur correction of the front camera device 13 are performed. In the case of the dance game device, since the player dances while stepping on the stage 1, the vibration due to the dance may be transmitted to the front camera device 13 via the stage 1 and the monitor device 2. By providing the imaging adjustment unit 33, it is possible to clearly capture an image of the player on the stage 1 even when vibrations due to dance are transmitted to the front camera device 13.

When the captured image is supplied from the front camera device 13, the display control unit 21 controls the display of the captured image on the first divided screen 11a of the main screen 11 of the monitor device 2. Thereby, as shown in FIG. 1, the front image of the player who dances on the stage 1 can be displayed in real time on the first split screen 11a of the main screen 11, and the second split screen can be displayed side by side with this. A character dancing a model dance can be displayed on 11b. Therefore, the player can easily compare his or her own dance with the example dance, and can acquire steps and poses more accurately and quickly.

Further, the back side of the player (the anti-monitor device 2)
Side), a half mirror 4 is provided. With this half mirror 4, a player outside the apparatus can see the player on the stage 1, but cannot see the crowd from the player side. ing. Therefore, the player can concentrate on the dance without worrying about the eyes of the audience. Since the front camera device 13 does not capture an image of the audience through the half mirror 4, the front image of the player displayed on the first split screen 11a includes:
It is possible to prevent the inconvenience in which the figure of the audience is reflected, and to concentrate the player on the dance.

On the other hand, when the play is started, the rear camera device 9 images the rear surface of the player on the stage 1 and supplies this rear image to the imaging adjustment unit 34, the image memory 23, and the complementary color detection unit 27.

The imaging adjustment unit 34 performs focus adjustment, angle correction, and image blur correction of the rear camera device 9 based on the captured image supplied from the rear camera device 9. As described above, in the case of the dance game device, since the player dances while performing steps on the stage 1,
Vibration due to this dance may be transmitted to the rear camera device 9 via the stage 1 and the monitor device 2,
By providing the imaging adjustment unit 34, even if vibrations due to dance are transmitted to the rear camera device 9, the stage 1
The upper player can be clearly imaged.

The complementary color detecting section 27 detects the color of the clothing of the player based on the rear image, detects the complementary color corresponding to the color of the clothing, and supplies the complementary color detection output to the lighting control section 28. When the player wears clothes having a plurality of colors such as a pattern, the complementary color detection unit 27 detects the largest color among the colors as the color of the clothes of the player, and corresponds to the color. The complementary color to be detected is detected.

Based on the complementary color detection output, the lighting control unit 28 drives the lighting device 15 to emit light to the player on the stage 1 so as to emit light of a color complementary to the color of the clothes. I do.

As will be described below, in the dance game apparatus of the present embodiment, the player itself is extracted (trimmed) from the image in which the background and the player are mixed in the trimming processing section 24, and the matching determination section 25 performs The image is subjected to image matching processing with the 3D image of the model character, and the dance is determined. In this manner, the player is irradiated with light of a color complementary to the color of the clothes. By doing so, the trimming processing unit 2
4 can facilitate the player's own trimming, thereby enabling more accurate dance determination.

Here, in the dance game apparatus, a background image is previously captured by the rear camera device 9 (or the rear camera device 10) in a state where the player is not on the stage 1, and this is, for example, a frame memory. It is stored in the background image memory 22 (FIG. 2).
See the dotted arrow signal line. This background image memory 2
The back image stored in 2 is repeatedly read, for example, in the form of a frame from the start of play to the end of play, and is supplied to the trimming processing unit 24.

As can be seen from FIG. 1, since the rear camera device 9 is provided behind the stage 1 (on the half mirror 4 side), the background image stored in the background image memory 22 is a monitor. The front image of the device 2 is stored.

Next, the image memory 23 is, for example, a frame memory, and stores a mixed image of the player and the background captured by the background camera device 9 for each frame. This mixed image is read out in frame units and supplied to the trimming processing unit 24.

The trimming processor 24 extracts only the player's own image based on the background image read from the background image memory 22 and the mixed image of the player and the background read from the image memory 23. This player image is supplied to the matching determination unit 25.

Specifically, the trimming processing section 24
Considers the player itself as one object, extracts the contour of this object using a fractal curve, extracts the image of the player itself, and supplies the image to the matching determination unit 25. By using this fractal curve, a contour of a complicated shape can be extracted with high accuracy. The method of the trimming process is an example, and another method may be used.

Next, in addition to the player image, an image of the current dance pose of the character read from the database 20 is supplied to the matching determination section 25. The matching determination unit 25 performs a matching process between the player image and the image indicating the current dance pose of the character read from the database 20 to form error information indicating an error between the two. Supply.

Here, as described above, the stage 1 is scanned by a plurality of infrared lasers 17 so as to form a lattice having a side of 5 cm, for example. Infrared sensor 18
, Respectively.

The player performs various steps by performing a dance on the stage 1. By performing these steps, the infrared beam from the infrared laser 17 corresponding to the step position is transmitted to the foot or the like. , And the detection output of the infrared sensor 18 corresponding to the shielded infrared beam becomes low level. Therefore, the infrared sensor 1 whose detection output becomes low level
By detecting 8, the step position of the player can be detected. Further, by detecting the timing when the detection output of the infrared sensor 18 becomes low level, the timing of the step of the player can be detected.

The detection output from each infrared sensor 18 is supplied to a step position / timing determination section 35 shown in FIG. 2, and the step position / timing determination section 35 detects the detection output as described above. The position and the timing of the step of the player are detected by detecting the infrared sensor 18 which has become the low level and its timing.

This step position / timing judging section 35
In addition to the detection output of the infrared sensor 18, step position information read from the database 20 and indicating the current step position of the character is supplied.

The step position / timing determination unit 35
By comparing the step position of the character indicated by the step position information with the step position of the player detected based on the detection output from the infrared sensor 18, error information indicating an error between the two is formed. It is supplied to the counting section 26.

The step position / timing determination section 3
5 detects a difference between the timing at which the step position information is supplied from the database 20 and the timing at which the step position of the player is detected, forms error information indicating an error between the two, and counts this. To the unit 26.

The counting section 26 calculates error information between the player image supplied from the matching determining section 25 and the image indicating the current dance pose of the character, and the step position of the player supplied from the step position / timing determining section 35. And a point corresponding to the timing error information is detected, and point information indicating the point is supplied to the display control unit 21. The display control unit 21 adds the point information supplied one after another during the play, and forms image information corresponding to the added point information, that is, image information indicating the current acquired point of the player. The display is controlled on the monitor device 2.

The player can recognize the accuracy of his or her dance by looking at the acquired points displayed on the monitor device 2. Note that this score may be displayed on an electronic bulletin board or the like above the monitor device 2 or the like, and displayed here.

As described above, during single play, the 3D image of the model character and the auxiliary image indicating the dance flow are displayed on the monitor device 2 and the front image of the player himself is displayed.

The player dances while comparing his or her own dance image displayed on the monitor device 2 with the 3D image of the model character. And 3D as a model
Take steps and pose at the same time as the dance in the image. As a result, the acquired points are added, and the progress of the dance can be recognized based on the finally displayed acquired points.

(Operations in Playing Net Competition) The above description has been given of the operations in the case of a single play in which the player enjoys dancing alone. However, the dance game apparatus performs communication between players in different places. However, it is possible to play "net match play" in which each other competes in dance.

When performing the net battle play, the dance game apparatuses are installed at different places such as a competition venue in each region, for example, and each dance game apparatus is connected to a communication network such as the Internet.

When the net battle is started, the sound control unit drives the rear speaker device 7, the loudspeaker speaker device 8, and the left and right channel speaker devices 14R and 14L in the same manner as in the above-mentioned single play. Then, the front camera device 13 captures the front of the player on the stage 1 and supplies this front image to the display control unit 21. Further, the rear camera device 9 captures the rear surface of the player on the stage 1 and supplies the rear image to the trimming processing unit 24 via the image memory 23.

The display control unit 21 does not display the 3D image of the model character on the monitor device during the net battle play, and the image is captured by the front camera device 13 instead of the 3D image of the character. The front image of the player is controlled to be displayed on the first divided screen 11a of the main screen 11 of the monitor device 2 and is also supplied to the compression encoding processing unit 29. Further, the display control unit 21 stores the database 2
Auxiliary images are sequentially read from 0, and the display is controlled on the auxiliary screen 12 of the monitor device 2.

Note that, in the online battle play, the 3D image of the model character is not displayed on the monitor, but is supplied to the matching determination section 25 and used for the matching process with the player image.

Further, during the online battle play, the 3D image of the model character is not displayed on the monitor. This is because, for example, the main screen 11 is divided into three divided screens so as to be arranged in the horizontal direction. The 3D image of the model character may be displayed and controlled on the center split screen, and the front images of the players who are fighting may be displayed and controlled on the left and right split screens.

On the other hand, the trimming processing section 24 extracts only the player's image from the mixed image from the image memory 23 based on the background image stored in the background image memory 22, and matches this player image with the matching judgment section 25. To supply. The matching determination unit 25 detects an error of the player image with respect to the 3D image of the model character read from the database 20 and uses this error information as the counting unit 2.
6

The counting section 26 calculates the error information between the player image supplied from the matching determination section 25 and the image indicating the current dance pose of the character, and the step position of the player supplied from the step position / timing determination section 35. And a point corresponding to the timing error information is detected, and point information indicating the point is supplied to the display control unit 21.

The display control section 21 adds the point information continuously supplied during the play and forms image information corresponding to the added point information, that is, image information indicating the current acquired points of the player. And this is the monitor 2
And supplies it to the compression / encoding processing unit 29.

The compression / encoding processing section 29 includes a display control section 21
Image information corresponding to the score information of the player supplied from the counting section 26 is superimposed on the front image of the player supplied from the player, and the composite image is subjected to a high-efficiency image compression encoding technique such as MPEG1, 2, 4, or the like. , And packetizes the data into data of a predetermined size, and transmits the data to a dance game device provided at another competition venue via a communication network such as the Internet.

Similarly, a composite image of the battle player is transmitted from the dance game apparatus provided at another battle venue, and the composite image is received by the receiving unit 31 and transmitted to the decompression decoding processing unit 32. Supplied.

The decompression / decoding processing section 32 performs decompression / decoding processing corresponding to the compression / encoding processing applied to the composite image of the opponent player and reproduces it.
To supply. The display control unit 21 controls the display of the front image and the obtained score image of the battle player, which have been subjected to the decompression decoding processing, on the second divided screen 11 b of the main screen 11 of the monitor device 2.

As a result, the front image (and the acquired points) of the player and the front image (and the acquired points) of the opponent player are displayed side by side on the monitor device 2, so that the players can stay at a distance from each other. You can compete with each other.

[Effects of the First Embodiment] As is clear from the above description, the dance game device of the first embodiment is displayed on the monitor device 2 during single play.
By displaying the 3D image of the model character together with the front image of the player captured by the front camera device 13, the player can compare his / her current pose and steps with the model 3D image while performing dance. Can dance. For this reason, by comparing the two images, it is possible to clearly recognize a defect such as a difference in one's own pose or a difference in the timing of the step, and to quickly learn the dance.

[0099] Further, the auxiliary image showing the flow of the dance continuously is displayed in time series on the auxiliary screen 12 of the monitor device 2, so that the player can clearly recognize the flow of the dance from now on. Can make it possible to dance in the flow.

For example, in a ballroom dance, the back style, such as whether the back is stretched, is to be evaluated more than the front style, and the matching process of the matching determination unit 25 is performed more rearward than in the front style. Performing with the style enables more accurate matching processing.

In the dance game device of the first embodiment, a rear camera device 9 (or 10) for scoring is provided separately from the front camera device 13 for monitor display. The dance style of the player is evaluated on the basis of the back image of the player captured by the player. Therefore, the matching determination unit 25 can perform an accurate matching process with the 3D image of the character, and can accurately evaluate the dance style.

Also, since the dance of the player is comprehensively evaluated based on the dance style, the step position, and the timing of the step, a dance game apparatus having a high level of difficulty in the game and having an interest is provided. Can be provided.

Further, the dance style of the player is determined by the rear image captured by the rear camera device 9 (or 10), and the step position and the step timing of the player are determined by the infrared laser 17 and the infrared sensor 18. Therefore, the player does not need to wear a special device for dance style and step detection. For this reason, the player can freely dance on the stage 1 without any restrictions.

Further, the color of the clothes of the player is detected before the start of the play, and light of a color complementary to the color of the clothes is emitted to the player. From the mixed image of
An image of only the player (player image) can be accurately extracted. Therefore, more accurate matching processing can be performed, and more accurate dance style evaluation can be performed.

The step position of the player and the timing of the step are detected by scanning an infrared laser 17 provided to scan the stage 1 in a grid pattern of several centimeters square.
In addition, since the detection is performed by the infrared sensor 18, the step position and the timing of the step of the player can be accurately detected, and the dance of the player can be more accurately evaluated.

In the above description of the first embodiment, the step position and the step timing of the player are detected by using the infrared laser 17 and the infrared sensor 18. A large number of pressure sensors may be provided in a grid at intervals (for example, 3 cm or 5 cm), and the step position and the step timing of the player may be detected based on the pressure detection output that changes at the step position and the timing of the player. .

Further, the infrared laser 1 arranged two-dimensionally
The step position and the step timing of the player are detected by the infrared sensor 7 and the infrared sensor 18. This is achieved by enclosing the four sides of the stage 1 with a half mirror or a glass plate, etc. 17 and an infrared sensor 18 may be provided to scan the stage 1 three-dimensionally. In this case, since not only the position and timing of the step of the player but also the position of the arm and head can be detected, the dance output style is determined by using the detection output and the image matching process together. Accurate determination can be made.

Further, the stage 1 is divided into a plurality of grids (or predetermined shapes), and a light source is built in the stage 1 corresponding to each grid, and the light source in the grid corresponding to the step position of the model character is set. May be driven to light or blink. As a result, it is possible to clearly indicate the step position of the player.

The light sources incorporated in each lattice may be turned on or off for each color such as red, yellow and blue. In this case, for example, the position of the grid where the red light source is lit (or blinking) indicates the current step position, the position of the grid where the yellow light source is lit (or blinking) indicates the next step position, The position of the grid where the blue light source is lit (or flashes) gives meaning to the color to be lit (or flashes), such as indicating the next next step position, so that the step position is given to the player. You can give clear instructions.

Further, an infrared camera device may be provided in place of the rear camera device 9 (or 10), and the above-described matching processing may be performed based on the infrared image to determine the dance style of the player. In particular, the arm and head are exposed from the clothing, and because it is a part where the body temperature is likely to increase, using an infrared camera device,
The player's arm position and head position can be accurately determined, and a more accurate dance style determination can be made.

[Second Embodiment] Next, a description will be given of a second embodiment of the sensation device according to the present invention. The first mentioned above
In the second embodiment, the bodily sensation device according to the present invention is applied to a dance game device installed in, for example, an amusement park or a game center. The device is applied to a home dance game device.

When the dance game apparatus is used at home, large-scale devices and devices that increase costs are omitted, but in the following description of the second embodiment, the above-described first embodiment will be described. The same reference numerals are given to portions indicating the same operations as those of the dance game apparatus of the embodiment, and detailed description thereof will be omitted.

[Structure of Second Embodiment] (External Structure of Household Dance Game Apparatus) FIG. 3 is a diagram showing an external structure of a home dance game apparatus according to the second embodiment. However, as can be seen from FIG. 3, the dance game device is provided on a television receiver 50 as a substitute for the monitor device 2 and, for example, on a top plate of the television receiver 50, and a front image of the player is displayed. Camera device 51 for taking an image of a person and a dance sheet 5 provided with a large number of pressure sensors in a lattice shape of, for example, 3 cm square.
2 and a computer device 53 that performs display control, counting control, and the like of the dance game device.

The computer device 53 includes a connection line 54
, The detection output from the pressure sensor provided on the dance sheet 52 is taken in, and the front image of the player taken by the front camera device 51 is taken in through the connection line 55. I have.

The computer device 53 is connected to the television receiver 50 via a connection line 56, and the front image of the player captured by the front camera device 51, the 3D image of the model character, etc. , And also controls the sound production of dance music and the like via a speaker device provided in the television receiver 50.

Further, the computer device 53 is connected to a communication line network 57 such as the Internet, for example, via a telephone line in the home, so that the above-described online battle is also possible.

(Electrical Configuration of Household Dance Game Apparatus)
FIG. 4 is a block diagram mainly showing an electrical configuration of the computer device 53 of the home dance game device. As can be seen from FIG. 4, in the case of the home dance game apparatus, the complementary color detection section 27, the lighting control section 28, and the writing apparatus 15 are omitted from the dance game apparatus shown in FIG. 9 (or 1
0) is omitted.

The trimming process and the matching judgment are performed based on the front image of the player from the front camera device 51. The other points are the same as those in the first embodiment.

Note that this home-use dance game device has
The above-mentioned rear camera device 9 (or 10) and a lighting control system (the complementary color detection unit 27, the lighting control unit 28)
And a lighting device 15) is not provided. These may be provided, but it is preferable to omit them in view of cost.

[Operation of the Second Embodiment] Next, the operation of the home dance game apparatus according to the second embodiment having such a configuration will be described. In this home-use dance game apparatus, similarly to the dance game apparatus of the above-described first embodiment, "single play" in which the player enjoys dancing alone.
Thus, it is possible to perform "net battle play" in which players in different places communicate with each other while communicating with each other.

(Operation during Single Play) In the home dance game apparatus, before a single play and a net battle play, a background image is previously captured by the front camera device 51 in a state where the player is not on the dance sheet 52. Do
This is stored in a background image memory 22 which is a frame memory, for example.
(See the signal line indicated by the dotted arrow in FIG. 2). The back image stored in the background image memory 22 is repeatedly read, for example, in the form of a frame from the start of play to the end of play, and the trimming processing unit 24
Supplied to

Next, when the player gets on the dance sheet 52 and starts playing, the sound control unit (not shown) supplies an audio signal such as dance music from the database 20 to the speaker device of the television receiver 50. The display control unit 21 reads out a three-dimensional image of a character performing a model dance from the database 20. Then, as shown in FIG. 3, the main screen 60 of the television receiver 50 is divided into two equal parts, and the three-dimensional image of the character is displayed and controlled on the second divided screen 60b.

It should be noted that a three-dimensional image of a character in a so-called “determined pose” is displayed so as to be prominent, for example, the outline of the pose is displayed in a conspicuous color. .

The display control unit 21 reads a 3D image (auxiliary image) indicating the current dance (movement) of the character, including the current one, from the database 20 and scrolls it in time series. A plurality of display controls are performed on the auxiliary screen 61 of the television receiver 50.

As described above, this auxiliary image is like a continuous photograph, and the auxiliary image 61R on the right side shows the current pose of the character.
Then, the dance (movement) of the character from now on is shown along the left direction. For this reason, the player can dance by watching the auxiliary image on the auxiliary screen while recognizing the future movement of the character.

The auxiliary image which is a so-called “fixed pose” is displayed differently from the other poses (for example, in a conspicuous manner), for example, by displaying the outline of the pose in a conspicuous color. It is supposed to be. For this reason, the player can recognize in advance the timing for taking the “fixed pose”.

Next, the front camera device 51 provided on the top plate of the television receiver 50 takes an image of the player dancing on the dance sheet 52 from the front, and adjusts the front image. It is supplied to the unit 33, the image memory 23 and the display control unit 21.

The imaging adjustment section 33 is provided with the front camera device 5.
Based on the front image from 1, focus adjustment, angle correction, and shooting blur correction of the front camera device 51 are performed. In the case of the dance game apparatus, since the player dances while stepping on the dance sheet 52, the vibration caused by the dance may be transmitted to the front camera apparatus 51 via the television receiver 50. By providing the imaging adjustment unit 33, it is possible to clearly capture the image of the player on the dance sheet even when the vibration caused by the dance is transmitted to the front camera device 51.

When the captured image is supplied from the front camera device 51, the display control section 21 controls the display on the first divided screen 60a of the main screen 60 of the television receiver 50. As a result, as shown in FIG.
A real-time display of a front image of a player who dances on the dance sheet 52 can be displayed on the split screen 60a, and a model dancing character can be displayed side by side on the second split screen 60b. Can be.
Therefore, the player can easily compare his or her own dance with the example dance, and can acquire steps and poses more accurately and quickly.

Next, as described above, the background image captured in a state where the player is not on the dance sheet 52 is stored in the background image memory 22. The back image stored in the background image memory 22 is repeatedly read, for example, in the form of a frame from the start of play to the end of play, and is supplied to the trimming processing unit 24.

The image memory 23 is, for example, a frame memory, and stores a mixed image of the player and the background captured by the front camera device 51 for each frame.
This mixed image is read out in frame units and supplied to the trimming processing unit 24.

The trimming processor 24 extracts only the player's own image based on the background image read from the background image memory 22 and the mixed image of the player and the background read from the image memory 23. This player image is supplied to the matching determination unit 25.

Next, in addition to the player image, an image of the current dance pose of the character read from the database 20 is supplied to the matching determination section 25. The matching determination unit 25 performs a matching process between the player image and the image indicating the current dance pose of the character read from the database 20 to form error information indicating an error between the two. Supply.

Here, as described above, a large number of pressure sensors are built in the dance sheet 52, and the step position and timing of the player are detected by the pressure sensors. This detection output is supplied to the step position / timing determination section 35 shown in FIG.
Detects the position and timing of the step of the player by detecting the position of the pressure sensor at which the detection output has changed and the timing of this change.

The step position / timing determination unit 35 is supplied with step position information indicating the current step position of the character read from the database 20 in addition to the detection output of the pressure sensor. It has become.

The step position / timing determination unit 35
By comparing the step position of the character indicated by the step position information with the player's step position detected based on the detection output from the pressure sensor, error information indicating an error between the two is formed and counted. To the unit 26.

The step position / timing determination section 3
5 detects a difference between the timing at which the step position information is supplied from the database 20 and the timing at which the step position of the player is detected, forms error information indicating an error between the two, and counts this. To the unit 26.

The counting section 26 calculates error information between the player image supplied from the matching determination section 25 and the image indicating the current dance pose of the character, and the step position of the player supplied from the step position / timing determination section 35. And a point corresponding to the timing error information is detected, and point information indicating the point is supplied to the display control unit 21. The display control unit 21 adds the point information supplied one after another during the play, and forms image information corresponding to the added point information, that is, image information indicating the current acquired point of the player. Television receiver 50
Display control.

The player uses the television receiver 50
By looking at the acquired points displayed in, the user can recognize the accuracy of his or her dance. In addition, this score is provided on an electric bulletin board or the like on a top plate or the like of the television receiver 50,
It may be displayed here.

As described above, in the single play mode, the 3D model character is displayed on the television receiver 50.
The image and the auxiliary image showing the flow of the dance are displayed, and the front image of the player itself is displayed.

The player dances while comparing his own dance image displayed on the television receiver 50 with the 3D image of the model character. Then, steps are taken at the same timing as the dance of the model 3D image, and a pose is taken. As a result, the acquired points are added, and the progress of the dance can be recognized based on the finally displayed acquired points.

(Operations during Net Competitive Play) The above description has been given of the operations during a single play in which the player enjoys dancing alone. However, the home dance game apparatus communicates with players in different places. "Net battle play" where each other competes for dance while performing.

[0143] In the case of performing the net battle play, the home dance game apparatuses are installed in different homes, for example, and each dance game apparatus is connected to a communication network such as the Internet.

When the online match is started, the sound control unit sets the television receiver 50 in the same manner as in the above-mentioned single play.
The sound signal of a predetermined dance music is supplied to the speaker device of and the sound generation is controlled.
An image of the player on the dance sheet 52 is taken, and the front image is supplied to the display control unit 21 and supplied to the trimming processing unit 24 via the image memory 23.

The display control section 21 does not display the model 3D image of the model character on the monitor device during the net battle play, and the image is taken by the front camera device 51 instead of the 3D image of the character. The front image of the player is displayed on the first screen 60 of the main screen 60 of the television receiver 50.
Is displayed on the divided screen 60a, and this front image is also supplied to the compression encoding processing unit 29. The display control unit 21 sequentially reads the auxiliary image from the database 20 and controls the display of the auxiliary image on the auxiliary screen 61 of the monitor device 2.

[0146] During the online battle play, the 3D image of the model character is not displayed on the monitor, but is supplied to the matching determination section 25 and used for the matching process with the player image.

[0147] In the online play, the 3D image of the model character is not displayed on the monitor. For example, the main screen 60 is divided into three divided screens so as to be arranged in the horizontal direction. The 3D image of the model character may be displayed and controlled on the center split screen, and the front images of the players who are fighting may be displayed and controlled on the left and right split screens.

On the other hand, the trimming processing section 24 extracts only the player's image from the mixed image from the image memory 23 based on the background image stored in the background image memory 22, and matches this player image with the matching judgment section 25. To supply. The matching determination unit 25 detects an error of the player image with respect to the 3D image of the model character read from the database 20 and uses this error information as the counting unit 2.
6

The counting section 26 calculates error information between the player image supplied from the matching determination section 25 and the image indicating the current dance pose of the character, and the step position of the player supplied from the step position / timing determination section 35. And a point corresponding to the timing error information is detected, and point information indicating the point is supplied to the display control unit 21.

The display control section 21 adds the point information continuously supplied during the play and forms image information corresponding to the added point information, that is, image information indicating the current acquired points of the player. This is displayed on the television receiver 50 and the compression / encoding processing section 29
To supply.

The compression / encoding processing unit 29 includes the display control unit 21
Image information corresponding to the score information of the player supplied from the counting section 26 is superimposed on the front image of the player supplied from the player, and the composite image is subjected to a high-efficiency image compression encoding technique such as MPEG1, 2, 4, etc. , And into a packet of data of a predetermined size, which is transmitted to a dance game device provided in another home via a communication network 57 such as the Internet.

Similarly, a composite image of the opponent player is transmitted from the dance game apparatus provided in the other home, and the composite image is received by the receiving section 31 and transmitted to the decompression decoding processing section 32. Supplied.

The decompression / decoding processing section 32 performs decompression / decoding processing corresponding to the compression / encoding processing applied to the composite image of the opponent player and reproduces it.
To supply. The display control unit 21 displays the front image of the battle player and the image of the acquired score, which have been subjected to the decompression decoding processing, on the second divided screen 60 of the main screen 60 of the television receiver 50.
b is displayed.

As a result, the front image of the player (and the number of obtained points) and the front image of the opponent player (and the number of obtained points) are displayed side by side on the television receiver 50. You can compete with each other.

[Effects of Second Embodiment] As is clear from the above description, the home dance game apparatus of the second embodiment is provided on a television receiver 50 by a front camera device 51. By displaying the 3D image of the model character together with the front image of the captured player, the player can describe his / her current pose and steps.
You can dance while comparing with a 3D image that is a model. For this reason, by comparing the two images, it is possible to clearly recognize a defect such as a difference in one's own pose or a difference in the timing of the step, and to quickly learn the dance.

In addition, the auxiliary screen 61 of the television receiver 50 displays an auxiliary image showing the dance flow continuously in a time-series manner, so that the player can clearly understand the dance flow from now on. It is possible to perform a dance on the flow.

Further, since it can be formed by the front camera device 51, the dance sheet 52 having a built-in pressure sensor, and the drive device (computer device 53) of a recording medium such as an optical disk in which the dance program is stored. In addition to being able to be formed at a lower cost than the dance game device of the above-described first embodiment, the same effects as those of the above-described dance game device of the first embodiment can be obtained.

[Other application examples of the present invention] In the above-described embodiment, an example in which the sensation device and the sensation system according to the present invention are applied to a dance game device has been described. The present invention can also be applied to a technology acquisition device for acquiring a pitching form, a batting form, or a soccer shooting technique.

For example, when the present invention is applied to a skill learning device for learning a baseball pitching form, a pitching form of a model player is displayed on the second divided screen 11b of the monitor device 2 as a 3D image of the character. At the same time, the decomposition image of the pitching form of the model player is displayed in chronological order on the auxiliary screen 12 below the display screen of the monitor device 2.

The player performs shadow pitching while watching the auxiliary image so as to make the same movement as the 3D image. A front image of the pitching form of the player is captured by the front camera device 13 and the first
Of the rear camera device 9
By (or 10), a back image is captured, and the matching process is performed with the pitching form of the model player.

The counting section 26 scores and displays the error between the two pitching forms due to the matching process. The player performs shadow pitching by imitating the pitching form of the model player who repeatedly sets the model so as to obtain a high score.

Thus, the pitching form of the model player can be learned efficiently and accurately in a short time, and the level of each player can be improved.

This example is based on the above-described first embodiment. However, as described in the second embodiment, the rear camera 9 (or 10) is omitted, and the pressure sensor is not used. The player performs shadow pitching on the provided sheet (the dance sheet 52 in the example of the second embodiment), images the shadow pitching with the front camera device 51, and the player's pitching form imaged with the front camera device 51. The matching process may be performed on the front image of the above. In this case, an inexpensive technology acquisition device suitable for home use can be provided.

Lastly, the present invention is not limited to the above-described embodiments described as examples, and various other embodiments may be used without departing from the technical spirit of the present invention. Can be changed.

[0165]

The sensation device and the sensation system according to the present invention can evaluate not only the steps but also the movements of the whole body, and provide a device which is difficult to play and which is interesting. be able to.

[Brief description of the drawings]

FIG. 1 is a perspective view showing an appearance of a dance game apparatus according to a first embodiment to which a bodily sensation device and a bodily sensation system according to the present invention are applied.

FIG. 2 is a block diagram of the dance game device according to the first embodiment.

FIG. 3 is a perspective view illustrating an appearance of a home dance game apparatus according to a second embodiment to which the sensation device and the sensation system according to the present invention are applied.

FIG. 4 is a block diagram of a home dance game apparatus according to the second embodiment.

FIG. 5 is a perspective view showing an appearance of a conventional dance game device.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... Stage, 2 ... Monitoring device, 3 ... Computer device, 4 ... Half mirror, 5 ... Leg, 6 ... Carrier, 7 ...
Rear speaker device, 8 ... Speaker device for heavy bass, 9 ...
Rear camera device, 10: rear camera device, 11: main screen of monitor device, 11a: first split screen, 11b: second
, An auxiliary screen, 12R ... a 3D image on the right side, 13 ... a front camera device, 14L ... a speaker device for the left channel, 14R ... a speaker device for the right channel, 15 ... a lighting device, 16 ... outside the stage frame,
17 infrared laser, 18 infrared sensor, 20 database, 21 display control unit, 22 background image memory,
23 image memory, 24 trimming processing unit, 25 matching judgment unit, 26 counting unit, 27 complementary color detection unit, 2
8: lighting control unit, 29: compression / encoding processing unit, 3
0: transmission unit, 31: reception unit, 32: decompression decoding processing unit,
33: imaging adjustment unit, 34: imaging adjustment unit, 35: step position / timing determination unit, 50: television receiver,
51: front camera device, 52: dance sheets 52, 53
... Computer device, 54 ... Connection line, 55 ... Connection line, 56 ... Connection line, 57 ... Communication network

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04N 7/18 H04N 7/18 K P F term (Reference) 2C001 AA00 AA03 AA16 BA05 BA06 BB00 BB01 BB04 BB10 BC06 CA00 CA01 CA08 CB01 CC02 CC06 CC08 5C054 AA05 CA04 CC02 CF06 CG02 EA01 EA05 FB03 FC01 FC12 FC13 FC14 FE13 FE18 FF02 HA15 9A001 HH30 JJ76 KK45

Claims (11)

[Claims] 1. An image pickup means for picking up an image of a player, a storage means for storing a moving image of a predetermined character, a display area of a display means being divided into a plurality of areas, and a player imaged by the image pickup means in a predetermined divided area A display control means for controlling the display of the captured image and displaying the moving image of the character read from the storage means in a divided area other than the divided area. 2. The display control means divides a display screen of a display means into two parts, controls display of an image of a player taken by the image pickup means in one divided area, and stores the storage means in another divided area. 2. The sensation device according to claim 1, wherein a display of the moving image of the character read from the device is controlled. 3. An image pickup means for picking up an image of a player; a storage means for storing a moving image of a predetermined character and an auxiliary image indicating the movement of the character; and dividing the display area of the display means into at least three divided areas. Controlling the display of a captured image of the player captured by the imaging means in the first divided area, controlling the display of the moving image of the character read from the storage means in the second divided area, and controlling the third divided area. A bodily sensation device having display control means for time-sequentially controlling display of a plurality of auxiliary images read from the storage means in an area. 4. A back image capturing means for capturing a back image of the player, a storage means for storing a moving image of a predetermined character, a back image of the player captured by the back image capturing means, and the storage means An image matching process for a moving image of the character read from the game device and evaluating means for evaluating the movement of the player based on the matching error. 5. A back-side image pickup means for picking up a back-side image of a player; a storage means for storing a moving image of a predetermined character; a back-side image of the player picked up by the back-side image pickup means; A matching error detecting means for performing an image matching process on the moving image of the character read from the CPU to detect a matching error between the two, a step position and a step timing of the player, and a step position and a step timing of the player And a step error detecting means for comparing the step position and the step timing of the moving image of the character read from the storage means to detect an error between the two, and from the matching error detecting means and the step error detecting means. Evaluation means for evaluating the movement of the player based on each detection output Sensitive equipment. 6. An infrared laser generating means for generating a plurality of infrared lasers for scanning under a player's feet, and a plurality of infrared laser generating means for detecting a light receiving level of the infrared laser from each of the infrared laser generating means. 6. The sensation device according to claim 5, further comprising an infrared sensor, wherein a step position and a step timing of the player are detected based on a change in a light reception level detected by each of the infrared sensors. 7. The step error detecting means has a plurality of pressure sensors arranged two-dimensionally at a predetermined interval, and based on detection outputs from the respective pressure sensors which change when pressed by a player. 6. The sensation device according to claim 5, wherein a step position and a step timing of the player are detected. 8. A front image capturing means for capturing a front image of the player; a storage means for storing a moving image of a predetermined character and an auxiliary image indicating the movement of the character; Dividing into divided regions, controlling display of a front image of the player captured by the front image capturing unit in a first divided region, and displaying a moving image of a character read from the storage unit in a second divided region 8. A display control means for controlling and displaying a plurality of auxiliary images read out from said storage means in a time series in a third divided area.
The sensation device according to any one of the above. 9. A front image capturing means for capturing a front image of the player; a storage means for storing a moving image of a predetermined character; a front image of the player captured by the front image capturing means; A matching error detecting means for performing an image matching process on the moving image of the character read from the CPU to detect a matching error between the two, a step position and a step timing of the player, and a step position and a step timing of the player A step error detecting means for comparing a step position and a step timing of the moving image of the character read from the storage means to detect an error between the two, and from the matching error detecting means and the step error detecting means. Evaluation means for evaluating the movement of the player based on each detection output Sensitive equipment. 10. A device according to claim 4, further comprising a complementary light irradiating means for irradiating the player with light of a color complementary to the color of the clothes of the player.
The sensation device according to any one of the preceding claims. 11. The system according to claim 1, wherein the communication network is connected to a communication network.
11. A plurality of sensation devices according to any one of claims 3 to 8 or claims 8 to 10, and a captured image of a player captured by an imaging unit provided in any of the sensation devices Or transmitting means for transmitting a front image of the player imaged by the front image imaging means to another sensation device via the communication network; provided in each of the sensation devices; A communication image display unit for controlling display of the captured image or the front image of the player transmitted through the display unit on any of the divided areas of the display unit.