JP2002042168A - Dance image enhancement composition device - Google Patents
Dance image enhancement composition deviceInfo
- Publication number
- JP2002042168A JP2002042168A JP2000230637A JP2000230637A JP2002042168A JP 2002042168 A JP2002042168 A JP 2002042168A JP 2000230637 A JP2000230637 A JP 2000230637A JP 2000230637 A JP2000230637 A JP 2000230637A JP 2002042168 A JP2002042168 A JP 2002042168A
- Authority
- JP
- Japan
- Prior art keywords
- dance
- dancer
- image
- pattern
- accompaniment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 239000000203 mixture Substances 0.000 title claims abstract 5
- 230000033001 locomotion Effects 0.000 claims abstract description 29
- 230000002708 enhancing effect Effects 0.000 claims abstract description 5
- 230000015572 biosynthetic process Effects 0.000 claims description 14
- 238000003786 synthesis reaction Methods 0.000 claims description 14
- 230000002194 synthesizing effect Effects 0.000 claims description 14
- 230000033764 rhythmic process Effects 0.000 claims description 6
- 239000002131 composite material Substances 0.000 abstract 1
- 238000010586 diagram Methods 0.000 description 8
- 238000001514 detection method Methods 0.000 description 7
- 238000005452 bending Methods 0.000 description 4
- 210000001015 abdomen Anatomy 0.000 description 3
- 101100326509 Catharanthus roseus CYP76B6 gene Proteins 0.000 description 2
- 101100326510 Swertia mussotii CYP76B10 gene Proteins 0.000 description 2
- 210000002784 stomach Anatomy 0.000 description 2
- 101100321669 Fagopyrum esculentum FA02 gene Proteins 0.000 description 1
- 125000002066 L-histidyl group Chemical group [H]N1C([H])=NC(C([H])([H])[C@](C(=O)[*])([H])N([H])[H])=C1[H] 0.000 description 1
- 230000003187 abdominal effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000000034 method Methods 0.000 description 1
- GDOPTJXRTPNYNR-UHFFFAOYSA-N methyl-cyclopentane Natural products CC1CCCC1 GDOPTJXRTPNYNR-UHFFFAOYSA-N 0.000 description 1
Landscapes
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Electrophonic Musical Instruments (AREA)
- Image Analysis (AREA)
- Processing Or Creating Images (AREA)
- Image Processing (AREA)
Abstract
Description
【０００１】[0001]
【発明の属する技術分野】本発明は、踊る人の映像の動
きを、元となる踊りパターンに加え画像を合成する装
置、さらに詳しくいえば、エンターテーメント機器とし
て有効な踊り映像強調合成装置に関する。BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an apparatus for synthesizing an image by adding the movement of a dancer's image to an original dance pattern, and more particularly to a dance image enhancement and synthesis apparatus effective as an entertainment device. .
【０００２】[0002]
【従来の技術】踊る人の動きに基づいて踊りパターンを
強調する画像を合成するような装置は存在しない。2. Description of the Related Art There is no device that synthesizes an image that emphasizes a dance pattern based on the motion of a dancer.
【０００３】[0003]
【発明が解決しようとする課題】本発明の目的は、音楽
に合わせて踊る人の映像をカメラで取り込み、この映像
に基づきＣＧ映像による仮想のダンサーがその踊りを強
調して、より高度な踊りを踊るように画像を合成する踊
り映像強調合成装置を提供することにある。SUMMARY OF THE INVENTION It is an object of the present invention to capture an image of a person dancing to music with a camera, and based on this image, a virtual dancer based on CG images emphasizes the dance, thereby providing a more advanced dance. It is an object of the present invention to provide a dance video enhancement synthesizing device for synthesizing an image as if to dance.
【０００４】[0004]
【課題を解決するための手段】前記目的を達成するため
に本発明による踊り映像強調合成装置は、踊り手の画像
を取り込むカメラ部と、前記取り込んだ画像から踊り手
の複数個所の位置を検出する３次元位置検出器と、１以
上の踊りパターンを記憶する記憶装置と、伴奏曲を発生
する音楽発生装置と、前記伴奏曲を再生するスピーカ
と、表示装置と、前記伴奏曲に従って踊り手が踊ること
により前記カメラ部から取り込まれる踊り手の各個所の
動きと伴奏曲の拍子を比較し、前記動きが音楽テンポに
合った踊りパターンを前記記憶装置から読み出し、踊り
手の各個所の基準位置からの変化量と前記読み出された
踊りパターンを合成し、前記表示装置に表示する演算・
合成装置とから構成してある。本発明における、前記記
憶装置から読み出される踊りパターンは、伴奏曲のリズ
ムから再生速度が決定されるように構成してある。本発
明における、前記踊りパターンと踊り手の各個所の基準
位置からの変化量との合成は、前記踊りパターンと前記
踊り手の各個所の基準位置からの変化量にそれぞれ重み
付けをして加算するように構成してある。In order to achieve the above object, a dance image enhancing and synthesizing apparatus according to the present invention detects a dancer's image, and detects a plurality of positions of the dancer from the captured image. A three-dimensional position detector, a storage device for storing one or more dance patterns, a music generator for generating an accompaniment, a speaker for reproducing the accompaniment, a display device, and a dancer according to the accompaniment. The movement of each part of the dancer taken from the camera unit by dancing is compared with the time signature of the accompaniment, the dance pattern whose movement matches the music tempo is read out from the storage device, and the reference position of each part of the dancer is read. Calculation of synthesizing the amount of change from and the read dance pattern and displaying the same on the display device.
And a synthesizer. In the present invention, the dance pattern read from the storage device is configured so that the reproduction speed is determined from the rhythm of the accompaniment music. In the present invention, the combination of the dance pattern and the change amount of each part of the dancer from the reference position is weighted and added to the dance pattern and the change amount of each part of the dancer from the reference position. It is configured as follows.
【０００５】[0005]
【作用】上記構成によれば、従来にない、形式のエンタ
ーテーメント機器を実現できる。According to the above construction, an entertainment device of a type which has not existed conventionally can be realized.
【０００６】[0006]
【発明の実施の形態】以下、図面を参照して本発明の実
施の形態を詳しく説明する。図１は、本発明による踊り
映像強調合成装置の実施の形態を示すブロック図であ
る。カメラ２ａ，２ｂ，スピーカ３および踊り映像強調
合成装置部９より構成されている。踊り映像強調合成装
置部９は、３次元位置検出器４，演算・合成装置５，音
楽発生装置６，表示装置７および記憶装置８より構成さ
れている。Embodiments of the present invention will be described below in detail with reference to the drawings. FIG. 1 is a block diagram showing an embodiment of a dance video enhancement synthesizing apparatus according to the present invention. It is composed of cameras 2a, 2b, a speaker 3, and a dance video enhancement synthesizing unit 9. The dance video enhancement / synthesis unit 9 includes a three-dimensional position detector 4, an arithmetic / synthesis unit 5, a music generation unit 6, a display unit 7, and a storage unit 8.
【０００７】踊り映像強調合成装置部９の電源を投入
し、表示装置７に表示される複数の伴奏曲の中から１つ
を図示しない選択手段により選択すると、音楽発生装置
６は、選択された伴奏曲をスピーカ３から出力するとと
もにその伴奏曲（音楽）のデータ情報を演算・合成装置
５に送出する。踊り手１は、スピーカ３から奏でる音楽
に合わせて踊ることとなる。この踊り手１の動きは、カ
メラ２によって動きの全体像が撮像される。When the power of the dance video enhancement synthesizing unit 9 is turned on and one of a plurality of accompaniments displayed on the display unit 7 is selected by a selecting means (not shown), the music generating device 6 The accompaniment is output from the speaker 3 and the data information of the accompaniment (music) is sent to the arithmetic / synthesis device 5. The dancer 1 will dance to the music played from the speaker 3. The entire image of the movement of the dancer 1 is captured by the camera 2.
【０００８】３次元位置検出器３は、カメラ２ａ，２ｂ
からの踊り手の画像情報より輪郭を切り出し、踊り手１
の両手先１ａ，頭部の先１ｂおよび腹部の中心位置１ｃ
を３次元検出する。なお、３台以上設置すれば、さらに
精度よく位置情報を得ることができる。図５に検出位置
の移動量の変化例を示す。The three-dimensional position detector 3 includes cameras 2a, 2b
The outline is cut out from the image information of the dancer from
Hands 1a, head tip 1b and abdominal center 1c
Is three-dimensionally detected. If three or more units are installed, position information can be obtained more accurately. FIG. 5 shows an example of a change in the amount of movement of the detection position.
【０００９】記憶装置８には多数の踊りパターンが記憶
されている。演算・合成装置５は、３次元位置検出器４
からの各部の位置情報と音楽発生装置６からの伴奏曲の
リズム情報とを照らし合わせ、記憶装置８より、伴奏曲
に適合する音楽テンポに合った踊りパターンを読み出
す。すなわち、カメラから検出した位置情報に近く、か
つ、伴奏曲にマッチする踊りパターンを読み出す。踊り
パターンは両手先，頭部の先およびお腹の中心位置の情
報を有し、踊りパターンの各位置の情報に踊り手の検出
した両手先，頭部の先およびお腹の中心位置の情報を加
える。これらの動作は所定時間毎に繰り返えされる。[0009] The storage device 8 stores a large number of dance patterns. The arithmetic / synthesis device 5 includes a three-dimensional position detector 4
The position information of each part from the music generator 6 is compared with the rhythm information of the accompaniment music from the music generator 6, and a dance pattern matching the music tempo matching the accompaniment music is read out from the storage device 8. That is, a dance pattern that is close to the position information detected from the camera and matches the accompaniment is read. The dance pattern has information on both hands, the head and the center of the stomach, and adds information on the detected both hands, the head and the center of the stomach to the information on each position of the dance pattern. . These operations are repeated every predetermined time.
【００１０】図２は、本発明による踊り映像強調合成装
置の動作を説明するためのフローチャートである。踊り
合成操作開始によって選択された音楽がスピーカ３より
再生される（ステップ（以下「Ｓ」という）２０１，Ｓ
２０２） 演算・合成装置５は、３次元位置検出器４から出力され
る踊り手の両手先，頭部の先及び腹部の位置の動きと演
奏曲の拍子を比較する（Ｓ２０３）。そして、予め記憶
装置８に格納されている多数の踊りのパターンから適当
なパターンを音楽テンポに合わせて読み出す（Ｓ２０
４）。踊りパターンの再生速度（パターンの読み出し間
隔）は、伴奏のリズムに合わせるように調整される。こ
の再生速度は、踊りパターンが例えば一小節（４拍）で
あれば、伴奏曲のリズムから次の式で求めることができ
る。 δｔ＝（６０／TEMPO ）×（１小節中の拍数）×（パターンの小節数）×（パ ターンのデータ数）-1 ・・・（１）FIG. 2 is a flowchart for explaining the operation of the dance video emphasizing and synthesizing apparatus according to the present invention. The music selected by the start of the dance synthesis operation is reproduced from the speaker 3 (steps (hereinafter referred to as “S”) 201, S
202) The arithmetic / synthesis device 5 compares the movements of the positions of both hands, head and abdomen of the dancer output from the three-dimensional position detector 4 with the time signature of the music piece (S203). Then, an appropriate pattern is read from a large number of dance patterns stored in advance in the storage device 8 in accordance with the music tempo (S20).
4). The reproduction speed of the dance pattern (pattern readout interval) is adjusted to match the rhythm of the accompaniment. If the dance pattern is, for example, one measure (four beats), the reproduction speed can be obtained from the rhythm of the accompaniment by the following equation. δt = (60 / TEMPO) × (number of beats in one bar) × (number of bars in pattern) × (number of data in pattern) -1 (1)
【００１１】読み出された踊りパターンの両手先，頭部
の先及び腹部位置の情報に、踊り手１から検出したそれ
ぞれの位置情報が加えられる（Ｓ２０５）。踊りパター
ンの選択は、比較的粗く、例えば４〜８小節ごとに行わ
れ、カメラから検出した位置情報の加算演算は、常に更
新される。演算・合成装置５は、このように合成演算し
た後、人間のリンクに基づき踊りパターンを補間して３
次元ＣＧを作成し表示装置７にダンサーを表示する（Ｓ
２０６）。踊り映像強調合成装置部９は、伴奏曲が終了
したか否か判断し（Ｓ２０７）、終了していな場合には
Ｓ２０３〜Ｓ２０６の動作を繰り返す。伴奏曲が終了し
た場合には踊りの合成処理を終了する（Ｓ２０８）。The position information detected from the dancer 1 is added to the information on both hands, head and abdomen of the read dance pattern (S205). The selection of the dance pattern is relatively coarse, for example, performed every 4 to 8 bars, and the addition calculation of the position information detected from the camera is constantly updated. The arithmetic / synthesizing device 5 interpolates the dance pattern based on the link of the person after performing the synthetic operation in this way, and
A dimension CG is created and dancers are displayed on the display device 7 (S
206). The dance video enhancing / synthesizing unit 9 determines whether or not the accompaniment has ended (S207), and if not, repeats the operations of S203 to S206. When the accompaniment has ended, the dance synthesis processing ends (S208).
【００１２】つぎに記憶装置に予め記憶されている踊り
パターンの構成例の一例を説明する。踊りパターンを形
成する情報は、からだの中心真下の床上の一点などを基
準にした、時間に関するからだ各部の絶対位置情報列
（踊りのモーションキャプチャーや、机上の合成で予め
製作する）であり、絶対位置のポイント数は必要に応じ
て決定される。カメラによる検出点数以上が必須であ
る。踊りパターンはリズムパターン分の拍数（長さ）を
有し、これを繰り返し再生すると、ダンスパターンにな
るものである。そして、いくつかの踊りの種類と、同一
種類のなかで、抑揚を段階的に小から大までの数種類が
用意されている。踊りパターンの位置情報列は、それぞ
れが、人間をモデル化したリンクで接合されている。Next, an example of the configuration of a dance pattern stored in the storage device in advance will be described. The information that forms the dance pattern is a sequence of absolute position information of each part of the body with respect to time, based on a point on the floor directly below the center of the body (prepared by motion capture of dance or synthesis on a desk). The number of points in the position is determined as needed. The number of points detected by the camera must be equal to or greater than the number of detection points. The dance pattern has the number of beats (length) corresponding to the rhythm pattern, and when this is repeatedly reproduced, it becomes a dance pattern. There are several types of dance, from small to large, with the same type of dance. Each position information sequence of the dance pattern is joined by a link that models a human.
【００１３】具体的には、体全体を２０くらいの部分に
別け、それぞれの部分に３次元位置情報を与えて構成す
るか、または各リンク（細分化した体の部分のつながる
ところ）の３次元位置情報とその３次元の回転情報の時
間変化列の情報で構成することができる。時間の分解能
は秒当たり１０〜３０程度，位置情報の分解能は５ｍｍ
〜３０ｍｍ程度，回転の分解能は１度〜５度程度が実用
レベルである。これをダウンサンプルしてデータの縮小
化を図ったものである。図３Ａ〜図３Ｆに腰部分のｘ移
動，ｙ移動，ｚ移動，軸回転，屈伸，横屈伸の移動デー
タ曲線の一例を示す。More specifically, the whole body is divided into about 20 parts, and each part is provided with three-dimensional position information, or each link (where the subdivided body parts are connected) is three-dimensional. It can be composed of information of a time change sequence of the position information and its three-dimensional rotation information. The resolution of time is about 10 to 30 per second, and the resolution of position information is 5 mm
The practical level is about 30 mm and the rotation resolution is about 1 degree to 5 degrees. This is down-sampled to reduce the data. 3A to 3F show examples of the movement data curves of the x-movement, the y-movement, the z-movement, the axial rotation, the bending / extension, and the lateral bending / extension of the waist.
【００１４】合成は以下の手法を用いて行われる。手先
の位置情報は、踊りパターンよりも、検出された手先の
位置情報を優先してその位置に近づけるように加算され
る。腹部に関しては、踊りパターンのデータを優先する
ように処理される。踊りパターンと各位置情報のそれぞ
れの重み付けは、測定をしてそれらデータから最適値を
選ぶことが必要である。合成の式を以下に示す。 Ｃ1 ＝ν( Ｐ1 −Ｐ0)＋( １−ν)(Ｄ1 −Ｄ0) ・・・（２） 但し Ｐ0 : 基準位置 Ｄ0 : 基準位置 ν : 重み付け定数The synthesis is performed using the following method. The position information of the hand is added so that the detected position information of the hand is brought closer to the position with priority over the dance pattern. The abdomen is processed so that the dance pattern data is prioritized. It is necessary to measure the weights of the dance pattern and each piece of position information and select the optimum value from the data. The synthesis formula is shown below. C 1 = ν (P 1 -P 0) + (1-ν) (D 1 -D 0) ··· (2) where P 0: the reference position D 0: the reference position [nu: weighted constant
【００１５】図４は、踊りパターンと検出位置の合成モ
デルの一例を示すグラフである。例えば、時刻ｔa にお
いて踊りパターン（ａ）の時間軸に対する移動量Ｐa と
基準位置Ｐ0 の差( Ｐa −Ｐ0)を算出する。また、検出
位置（ｂ）の時間軸に対する移動量Ｄa と基準位置Ｄ0
の差( Ｄa −Ｄ0)を算出する。そして、時刻ｔaにおけ
る踊りパターンの重み付けをνa とすると、検出位置の
重み付けは( １−νa ) となる。踊りパターンと検出位
置の差( Ｐa −Ｐ0)，( Ｄa −Ｄ0)それぞれにνa ，
（１−νa ）を掛け、加算した点がＣa となる。FIG. 4 is a graph showing an example of a synthetic model of a dance pattern and a detected position. For example, to calculate the difference between the amount of movement P a and the reference position P 0 with respect to the time axis of the dance patterns (a) (P a -P 0 ) at time t a. In addition, the movement amount Da with respect to the time axis of the detection position (b) and the reference position D 0.
Is calculated (D a −D 0 ). Then, assuming that the weight of the dance pattern at time t a is ν a , the weight of the detection position is (1−ν a ). The difference between the dance pattern and the detection position (P a −P 0 ) and (D a −D 0 ) are ν a ,
The point obtained by multiplying (1−ν a ) and adding the result is C a .
【００１６】[0016]
【発明の効果】本発明は以上のように構成されているの
で、 １）自分の動きが、リアルタイムに人形と入れ替わっ
て、すばらしい踊りになり、これまでにない新規なエン
ターティメント性のある機器を提供できる。 ２）画面の映像を自分自身の動きで操作できる新しい遊
びの要素を提供できる。 ３）結果を記録しておけば、繰り返し見ることができ
る。 ４）ＣＧ映像であるので、自由なシチュエーション（背
景環境）や登場する人形を自由に選択でき、楽しみ方が
さらに拡大する。 ５）ゲームやカラオケとの組み合わせで、さまざまな応
用が可能である。 ６）自分自身が画面に出ると恥ずかしい人も、嫌悪感無
く、参加できる。 などの種々の効果が得られる。As described above, the present invention is constituted as described above. 1) The player's own movement is replaced with a doll in real time, which makes a wonderful dance, and a new entertainment device which has never been seen before. Can be provided. 2) It is possible to provide a new play element that allows the user to operate the screen image by his / her own movement. 3) If you record the result, you can see it repeatedly. 4) Since it is a CG image, a free situation (background environment) and a doll appearing can be freely selected, thereby further expanding the way of enjoying. 5) Various applications are possible in combination with games and karaoke. 6) Embarrassing people can participate without disgust when they appear on the screen. Various effects can be obtained.
【図１】本発明による踊り映像強調合成装置の実施の形
態を示すブロック図である。FIG. 1 is a block diagram illustrating an embodiment of a dance video enhancement and synthesis device according to the present invention.
【図２】本発明による踊り映像強調合成装置の動作を説
明するためのフローチャートである。FIG. 2 is a flowchart for explaining the operation of the dance image enhancing and synthesizing apparatus according to the present invention;
【図３Ａ】腰部の移動曲線の一例を示す図で、ｘ方向移
動を示すものである。FIG. 3A is a diagram showing an example of a movement curve of a waist, showing an x-direction movement.
【図３Ｂ】腰部の移動曲線の一例を示す図で、ｙ方向移
動を示すものである。FIG. 3B is a diagram showing an example of a movement curve of the waist, showing movement in the y direction.
【図３Ｃ】腰部の移動曲線の一例を示す図で、ｚ方向移
動を示すものである。FIG. 3C is a diagram showing an example of a movement curve of the waist, showing movement in the z direction.
【図３Ｄ】腰部の移動曲線の一例を示す図で、軸回転方
向を示すものである。FIG. 3D is a diagram showing an example of the movement curve of the waist, showing the rotation direction of the shaft.
【図３Ｅ】腰部の移動曲線の一例を示す図で、屈伸移動
を示すものである。FIG. 3E is a diagram showing an example of a movement curve of a waist, showing bending and extension movement.
【図３Ｆ】腰部の移動曲線の一例を示す図で、横屈伸移
動を示すものである。FIG. 3F is a view showing an example of a movement curve of the waist, showing lateral bending and extension movement.
【図４】踊りパターンと検出位置の合成モデルの一例を
示すグラフである。FIG. 4 is a graph showing an example of a synthetic model of a dance pattern and a detection position.
【図５】検出位置の移動量の一例を示す図である。FIG. 5 is a diagram illustrating an example of a movement amount of a detection position.
１…踊り手 ２ａ，２ｂ…カメラ ３…スピーカ ４…３次元位置検出器 ５…演算装置 ６…音楽発生装置 ７…表示装置 ８…記憶装置 ９…踊り映像強調合成装置部 DESCRIPTION OF SYMBOLS 1 ... Dancer 2a, 2b ... Camera 3 ... Speaker 4 ... Three-dimensional position detector 5 ... Arithmetic device 6 ... Music generator 7 ... Display device 8 ... Storage device 9 ... Dance image enhancement synthesizing unit
───────────────────────────────────────────────────── フロントページの続き (51)Int.Cl.7 識別記号 ＦＩ テーマコート゛(参考） Ｇ１０Ｈ 1/00 Ｇ１０Ｈ 1/00 Ｚ １０２ １０２Ｚ 1/40 1/40 // Ｈ０４Ｎ 13/00 Ｈ０４Ｎ 13/00 Ｆターム(参考） 2C001 AA00 AA16 BA00 BA07 BC00 BC05 CA00 CA08 CB01 CC02 CC08 5B050 AA10 BA07 BA08 BA12 EA06 EA07 EA13 EA19 EA24 FA02 FA10 GA08 5B057 CD11 CE08 CH09 DA07 DB03 5C061 AA20 AB04 AB12 5D378 LB12 LB27 MM14 MM65 MM67 MM94 ──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. 7 Identification symbol FI Theme coat ゛ (Reference) G10H 1/00 G10H 1/00 Z 102 102Z 1/40 1/40 // H04N 13/00 H04N 13/00 F-term (reference) 2C001 AA00 AA16 BA00 BA07 BC00 BC05 CA00 CA08 CB01 CC02 CC08 5B050 AA10 BA07 BA08 BA12 EA06 EA07 EA13 EA19 EA24 FA02 FA10 GA08 5B057 CD11 CE08 CH09 DA07 DB03 5C061 AA20 AB04 BB12 MMMM MM67
Claims (3)
する３次元位置検出器と、 １以上の踊りパターンを記憶する記憶装置と、 伴奏曲を発生する音楽発生装置と、 前記伴奏曲を再生するスピーカと、 表示装置と、 前記伴奏曲に従って踊り手が踊ることにより前記カメラ
部から取り込まれる踊り手の各個所の動きと伴奏曲の拍
子を比較し、前記動きが音楽テンポに合った踊りパター
ンを前記記憶装置から読み出し、踊り手の各個所の基準
位置からの変化量と前記読み出された踊りパターンを合
成し、前記表示装置に表示する演算・合成装置と、 から構成したことを特徴とする踊り映像強調合成装置。1. A camera unit that captures an image of a dancer, a three-dimensional position detector that detects a plurality of positions of the dancer from the captured image, a storage device that stores one or more dance patterns, and an accompaniment. A music generating device for generating a song, a speaker for playing the accompaniment, a display device, a movement of each part of the dancer taken from the camera unit by the dancer dancing according to the accompaniment, and a time signature of the accompaniment And reads the dance pattern whose movement matches the music tempo from the storage device, synthesizes the amount of change from the reference position of each part of the dancer with the read dance pattern, and displays it on the display device. A dance image enhancement / synthesis apparatus, comprising:
ーンは、伴奏曲のリズムから再生速度が決定されること
を特徴とする請求項１記載の踊り映像強調合成装置。2. The dance image enhancement and synthesis apparatus according to claim 1, wherein a reproduction speed of the dance pattern read from the storage device is determined from a rhythm of an accompaniment.
準位置からの変化量との合成は、前記踊りパターンと前
記踊り手の各個所の基準位置からの変化量にそれぞれ重
み付けをして加算することを特徴とする請求項１記載の
踊り映像強調合成装置。3. The composition of the dance pattern and the change amount of each part of the dancer from the reference position is weighted and added to the dance pattern and the change amount of each part of the dancer. 2. The dance video enhancing and synthesizing apparatus according to claim 1, wherein
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2000230637A JP4278288B2 (en) | 2000-07-31 | 2000-07-31 | Dance image emphasis synthesizer |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2000230637A JP4278288B2 (en) | 2000-07-31 | 2000-07-31 | Dance image emphasis synthesizer |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| JP2002042168A true JP2002042168A (en) | 2002-02-08 |
| JP4278288B2 JP4278288B2 (en) | 2009-06-10 |
Family
ID=18723568
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2000230637A Expired - Fee Related JP4278288B2 (en) | 2000-07-31 | 2000-07-31 | Dance image emphasis synthesizer |
Country Status (1)
| Country | Link |
|---|---|
| JP (1) | JP4278288B2 (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006514366A (en) * | 2003-02-11 | 2006-04-27 | 株式会社ソニー・コンピュータエンタテインメント | Real-time motion capture method and apparatus |
| US7209577B2 (en) | 2005-07-14 | 2007-04-24 | Logitech Europe S.A. | Facial feature-localized and global real-time video morphing |
| US8416185B2 (en) | 2008-04-23 | 2013-04-09 | International Business Machines Corporation | Operational object controlling device, system, method and program |
| JP2016183989A (en) * | 2015-03-25 | 2016-10-20 | ブラザー工業株式会社 | Information processing apparatus and program |
| WO2021131772A1 (en) * | 2019-12-24 | 2021-07-01 | ソニーグループ株式会社 | Information processing device, and information processing method |
-
2000
- 2000-07-31 JP JP2000230637A patent/JP4278288B2/en not_active Expired - Fee Related
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006514366A (en) * | 2003-02-11 | 2006-04-27 | 株式会社ソニー・コンピュータエンタテインメント | Real-time motion capture method and apparatus |
| US7209577B2 (en) | 2005-07-14 | 2007-04-24 | Logitech Europe S.A. | Facial feature-localized and global real-time video morphing |
| US7397932B2 (en) | 2005-07-14 | 2008-07-08 | Logitech Europe S.A. | Facial feature-localized and global real-time video morphing |
| US8416185B2 (en) | 2008-04-23 | 2013-04-09 | International Business Machines Corporation | Operational object controlling device, system, method and program |
| JP2016183989A (en) * | 2015-03-25 | 2016-10-20 | ブラザー工業株式会社 | Information processing apparatus and program |
| WO2021131772A1 (en) * | 2019-12-24 | 2021-07-01 | ソニーグループ株式会社 | Information processing device, and information processing method |
| US12394248B2 (en) | 2019-12-24 | 2025-08-19 | Sony Group Corporation | Information processing device and information processing method for specifying parts related to body motion |
Also Published As
| Publication number | Publication date |
|---|---|
| JP4278288B2 (en) | 2009-06-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP3601350B2 (en) | Performance image information creation device and playback device | |
| US6738067B2 (en) | Image processing device, image processing method and recording medium | |
| CN102822869B (en) | Capture view and the motion of the performer performed in the scene for generating | |
| JP6137935B2 (en) | Body motion evaluation apparatus, karaoke system, and program | |
| CN105405436B (en) | Scoring apparatus and methods of marking | |
| JP6699677B2 (en) | Information processing method, information processing apparatus, and program | |
| JPH11224084A (en) | Musical-sound responding image generation system, method and device and recording medium therefor | |
| WO2009007512A1 (en) | A gesture-controlled music synthesis system | |
| ES2356386T3 (en) | METHOD FOR SUPPLYING AN AUDIO SIGNAL AND METHOD FOR GENERATING BACKGROUND MUSIC. | |
| JP6431259B2 (en) | Karaoke device, dance scoring method, and program | |
| JP4238270B2 (en) | Game terminal, difficulty setting device, program, and recording medium | |
| JP2014023745A (en) | Dance teaching device | |
| JP3817878B2 (en) | Control device and karaoke device | |
| JP2002041038A (en) | Virtual musical instrument playing device | |
| JP4917446B2 (en) | Image generation apparatus, image generation program, data interpolation apparatus, and data interpolation program | |
| JP2012194241A (en) | Evaluation device | |
| JP3895014B2 (en) | Video playback device and karaoke device | |
| JP4278288B2 (en) | Dance image emphasis synthesizer | |
| JP2015185020A (en) | Event method, concert throwing method, event venue and content trading method | |
| JP3815938B2 (en) | GAME DEVICE AND INFORMATION STORAGE MEDIUM | |
| JP7144931B2 (en) | Program and game system | |
| JP5928279B2 (en) | Exercise support apparatus and program | |
| JP2001269483A (en) | Moving image reproducing method and music game device | |
| JPH09160575A (en) | Karaoke display device | |
| JP2015060061A (en) | Karaoke apparatus, image output method, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20041124 |
|
| A711 | Notification of change in applicant |
Free format text: JAPANESE INTERMEDIATE CODE: A712 Effective date: 20060609 |
|
| A977 | Report on retrieval |
Free format text: JAPANESE INTERMEDIATE CODE: A971007 Effective date: 20070607 |
|
| A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20070612 |
|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20070802 |
|
| A02 | Decision of refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A02 Effective date: 20071009 |
|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20071203 |
|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20071112 |
|
| A911 | Transfer to examiner for re-examination before appeal (zenchi) |
Free format text: JAPANESE INTERMEDIATE CODE: A911 Effective date: 20071217 |
|
| A912 | Re-examination (zenchi) completed and case transferred to appeal board |
Free format text: JAPANESE INTERMEDIATE CODE: A912 Effective date: 20080118 |
|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20090217 |
|
| A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 |
|
| A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20090310 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20120319 Year of fee payment: 3 |
|
| R150 | Certificate of patent or registration of utility model |
Ref document number: 4278288 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 Free format text: JAPANESE INTERMEDIATE CODE: R150 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20120319 Year of fee payment: 3 |
|
| S111 | Request for change of ownership or part of ownership |
Free format text: JAPANESE INTERMEDIATE CODE: R313111 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20120319 Year of fee payment: 3 |
|
| R350 | Written notification of registration of transfer |
Free format text: JAPANESE INTERMEDIATE CODE: R350 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20120319 Year of fee payment: 3 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20130319 Year of fee payment: 4 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20130319 Year of fee payment: 4 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20140319 Year of fee payment: 5 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20140319 Year of fee payment: 5 |
|
| S531 | Written request for registration of change of domicile |
Free format text: JAPANESE INTERMEDIATE CODE: R313531 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20140319 Year of fee payment: 5 |
|
| R350 | Written notification of registration of transfer |
Free format text: JAPANESE INTERMEDIATE CODE: R350 |
|
| LAPS | Cancellation because of no payment of annual fees |