[go: up one dir, main page]

CN1629889A - 3D Plant Music Animation System - Google Patents

3D Plant Music Animation System Download PDF

Info

Publication number
CN1629889A
CN1629889A CN 200310120622 CN200310120622A CN1629889A CN 1629889 A CN1629889 A CN 1629889A CN 200310120622 CN200310120622 CN 200310120622 CN 200310120622 A CN200310120622 A CN 200310120622A CN 1629889 A CN1629889 A CN 1629889A
Authority
CN
China
Prior art keywords
dance
unit
music
real
video display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN 200310120622
Other languages
Chinese (zh)
Other versions
CN100454342C (en
Inventor
李昌智
胡包钢
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Institute of Automation of Chinese Academy of Science
Original Assignee
Institute of Automation of Chinese Academy of Science
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Institute of Automation of Chinese Academy of Science filed Critical Institute of Automation of Chinese Academy of Science
Priority to CNB200310120622XA priority Critical patent/CN100454342C/en
Publication of CN1629889A publication Critical patent/CN1629889A/en
Application granted granted Critical
Publication of CN100454342C publication Critical patent/CN100454342C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Landscapes

  • Processing Or Creating Images (AREA)

Abstract

一种三维植物体音乐动画系统,包括计算机单元、音频播放单元和视频显示单元,所述计算机单元能够通过内置软件,分析存储在音乐库中的音乐文件;所述计算机单元还能够通过内置软件,计算并自动生成连续的动画视频,并将视频信号输出到视频显示单元;所述音频播放单元,用于播放音频信号;所述视频显示单元,用于显示音频数据;三维图形库,用于存储各种三维植物的模型;实时动画序列生成和实时渲染模块,用于自动生成并渲染实时的舞蹈动作;舞蹈姿态库,用于存储各种舞蹈姿态;自动舞蹈规则模块,用于产生舞蹈动作规划数据;舞蹈动作脚本模块,用于编辑和存储舞蹈动作数据。

Figure 200310120622

A three-dimensional plant body music animation system, including a computer unit, an audio playback unit and a video display unit, the computer unit can analyze music files stored in the music library through the built-in software; the computer unit can also use the built-in software, Calculate and automatically generate continuous animation video, and output the video signal to the video display unit; the audio playback unit is used to play the audio signal; the video display unit is used to display audio data; the three-dimensional graphics library is used to store Models of various 3D plants; real-time animation sequence generation and real-time rendering module, used to automatically generate and render real-time dance movements; dance gesture library, used to store various dance gestures; automatic dance rule module, used to generate dance movement planning Data; dance action script module, used to edit and store dance action data.

Figure 200310120622

Description

三维植物体音乐动画系统3D Plant Music Animation System

技术领域technical field

本发明涉及计算机多媒体系统和三维计算机图形动画系统,特别涉及三维植物体的音乐动画系统。The invention relates to a computer multimedia system and a three-dimensional computer graphic animation system, in particular to a music animation system for a three-dimensional plant body.

背景技术Background technique

关于植物的建模和真实感绘制一直是图形学领域研究的热点之一。人们做了大量的卓有成效的工作,然而有关植物动画的研究却不多见,而且多关注于植物的生长动画,具有真实感的植物运动模拟由于具有较高的运动复杂度和场景复杂度,对这类运动的描述、控制和实现具有较大的难度。而且,由于植物具有较高的运动自由度,给求解运动方程带来了很大的难度,实时动画就更加难以实现。现有的大多数虚拟舞蹈系统采用虚拟人作为其动画角色,并且大多数是运用运动捕捉技术,通过运动捕捉装置(磁电式或光电式)捕捉真实世界的人的动作信息,然后通过各种运动合成方法,将运动重定位到虚拟舞蹈角色,生成逼真的运动动画序列。这种方法需要较为复杂而昂贵的运动捕捉装置,并且需要采集大量的真实人物的运动数据,而且合成新的运动较为困难,合成的运动往往只是所捕捉到的真实运动的简单重复,难免给人单调乏味的感觉。The modeling and realistic rendering of plants has always been one of the hotspots in the field of graphics research. People have done a lot of fruitful work, but the research on plant animation is rare, and more attention is paid to the growth animation of plants. Realistic plant motion simulation has high motion complexity and scene complexity. The description, control and realization of this kind of motion are quite difficult. Moreover, because plants have a high degree of freedom of movement, it is very difficult to solve the equation of motion, and real-time animation is even more difficult to achieve. Most of the existing virtual dance systems use virtual people as their animation characters, and most of them use motion capture technology to capture the motion information of people in the real world through motion capture devices (magnetism or photoelectric), and then use various A motion synthesis method that retargets motion to a virtual dancing character to generate realistic motion animation sequences. This method requires a relatively complex and expensive motion capture device, and needs to collect a large amount of motion data of real people, and it is difficult to synthesize new motions. The synthesized motions are often just simple repetitions of the captured real motions, which inevitably gives people The feeling of monotony.

发明内容Contents of the invention

本发明的目的在于提供一种三维植物体音乐动画系统。The object of the present invention is to provide a three-dimensional plant music animation system.

为实现上述目的,一种三维植物体音乐动画系统,包括计算机单元、音频播放单元和视频显示单元;In order to achieve the above object, a three-dimensional plant music animation system includes a computer unit, an audio playback unit and a video display unit;

所述计算机单元能够通过内置软件,分析存储在音乐库中的音乐文件;The computer unit is capable of analyzing music files stored in the music library through built-in software;

所述计算机单元还能够通过内置软件,计算并自动生成连续的动画视频,并将视频信号输出到视频显示单元;The computer unit can also calculate and automatically generate continuous animation video through built-in software, and output the video signal to the video display unit;

所述音频播放单元,用于播放音频信号;The audio playback unit is used to play audio signals;

所述视频显示单元,用于显示音频数据;The video display unit is used to display audio data;

其特征在于所述计算机单元包括:It is characterized in that the computer unit includes:

三维图形库,用于存储各种三维植物的模型;3D graphics library for storing models of various 3D plants;

实时动画序列生成和实时渲染模块,用于自动生成并渲染实时的舞蹈动作;Real-time animation sequence generation and real-time rendering module, used to automatically generate and render real-time dance movements;

舞蹈姿态库,用于存储各种舞蹈姿态;Dance gesture library, used to store various dance gestures;

自动舞蹈规则模块,用于产生舞蹈动作规划数据;Automatic dance rule module, used to generate dance movement planning data;

舞蹈动作脚本模块,用于存储舞蹈动作数据。The dance action script module is used to store dance action data.

本发明在不需要运动捕捉装置的情况下,逼真地模拟植物体的运动,实时地生成三维植物体的舞蹈运动动画序列。本发明还能让用户自己编辑舞蹈姿态和动作,从而能够编排生成与音乐风格和谐统一的舞蹈动画。为用户提供一个集音乐、舞蹈、三维计算机图形学、三维计算机动画等多项技术于一体的智能娱乐系统。本发明所用的方法在多媒体影视制作,多媒体娱乐游戏开发和多媒体广告制作等领域具有应用前景。The invention realistically simulates the motion of the plant body without the need of a motion capture device, and generates a three-dimensional dance motion animation sequence of the plant body in real time. The invention can also allow users to edit dance gestures and movements by themselves, so that dance animations that are harmonious and unified with music styles can be programmed and generated. Provide users with an intelligent entertainment system integrating music, dance, 3D computer graphics, 3D computer animation and other technologies. The method used in the invention has application prospects in the fields of multimedia film and television production, multimedia entertainment game development, multimedia advertisement production and the like.

附图说明Description of drawings

图1是本发明三维植物体音乐动画系统组成框图。Fig. 1 is a composition block diagram of the three-dimensional plant music animation system of the present invention.

具体实施方式Detailed ways

附图1为本发明的系统结构框图。整个系统分为三个单元:计算机单元10、音响输出单元20和视频显示单元30。计算机单元包括由各种音乐文件、CD光盘、唱片等组成的一个音乐库101;计算机单元内置有音乐信号处理模块102用于处理和识别音乐信号,以便控制舞蹈动作的时间、风格、力度等要素;音乐播放模块103用于播放音乐,将音频信号输出给音频播放单元20。计算机单元内还内置有三维图形库111,存储各种三维植物的模型用于舞蹈动画;实时动画序列生成和实时渲染模块112,将从舞蹈姿态库113中提取姿态数据,从自动舞蹈规则114模块产生舞蹈动作规划数据,或从舞蹈动作脚本115中提取舞蹈动作数据,自动生成并渲染实时的舞蹈动画。计算机单元还提供三维建模121、舞蹈姿态编辑122、舞蹈动作编排123三个与用户交换的接口,以使系统能够由用户自己定义生成植物模型、舞蹈姿态和舞蹈动作。计算机单元的乐曲输出音频信号和动画输出视频信号分别连接到音频播放单元20和视频显示单元30,以播放音乐和显示动画。Accompanying drawing 1 is a system structure block diagram of the present invention. The whole system is divided into three units: a computer unit 10 , an audio output unit 20 and a video display unit 30 . The computer unit includes a music library 101 composed of various music files, CD discs, discs, etc.; the computer unit has a built-in music signal processing module 102 for processing and identifying music signals, so as to control elements such as time, style, and dynamics of dance movements. The music playing module 103 is used to play music, and output the audio signal to the audio playing unit 20 ; Also built-in three-dimensional graphics storehouse 111 in the computer unit, the model of storing various three-dimensional plants is used for dance animation; Real-time animation sequence generation and real-time rendering module 112, will extract gesture data from dance gesture storehouse 113, from automatic dance rule 114 module Generate dance action planning data, or extract dance action data from the dance action script 115, automatically generate and render real-time dance animation. The computer unit also provides 3D modeling 121, dance posture editor 122, and dance movement choreography 123, three interfaces for exchange with users, so that the system can be defined by the user to generate plant models, dance postures and dance movements. The music output audio signal and the animation output video signal of the computer unit are respectively connected to the audio playback unit 20 and the video display unit 30 to play music and display animation.

实施实例Implementation example

将音乐文件直接存放在计算机单元的数据存储部件中,如硬盘,只读储存器,可擦除储存器,或闪存等,形成一个音乐库;或者可以通过CD装置或外部其它音乐播放装置来实现音乐的播放。例如,我们存储了柴可夫斯基的《天鹅湖》作为舞蹈表演的音乐。在本系统的内建立包括各种植物体三维数据的图形库。例如,我们通过三维建模模块,建立一个三维的百合花模型,作为舞蹈动画的主角,它由一根主茎、四片叶和位于顶端的一朵花组成。这些器官在舞蹈时均可以运动,并模拟人的躯干和四肢的作出各种各样千姿百态的运动。在本系统内建立与各种植物体模型相对应的舞蹈姿态库。例如,我们将动画角色百合花的姿态分为花朵、主茎和四片枝叶六个部分,每个部分又分别建立具有代表性的姿态若干种(比如,对于花朵部分可以有:花朵的低垂、高昂、侧偏和扭转等)。在本系统内建立包括各种植物体舞蹈动作序列的舞蹈动作的动作脚本文件。例如,我们按照音乐的自然节拍建立每一节拍的目标姿态,系统会根据基于物理的动力学模型自动实现姿态间的转移和转换,从而生成各式各样的舞蹈动作。再加上一些全局性的控制舞蹈的动作,如移动、跳跃、旋转等,便可以形成一个完整的舞蹈脚本文件,舞蹈动画角色便可以按照所写的舞蹈脚本进行连贯流畅的舞蹈。在本系统的内置软件建立音乐要素(如节拍、高音、低音、鼓点等)提取和识别的音频信号处理单元。例如,我们可以采用频谱分析的方法,提取和识别音调的高低。对于音源采用MIDI的情况,我们可以建立MIDI分析单元,提取MIDI音乐信号种所含的音高、音长、节拍等信息,以更准确地控制动画角色的舞蹈。用户通过计算机屏幕显示中人机交互的软件界面方式,选择植物体动画配曲方式,可以人工手动配曲或者全自动配曲。例如,我们选择人工手动配曲的方式,那么就还需进一步选择舞蹈脚本,我们可以按照第4步中介绍的方式编写舞蹈脚本保存起来并选作当前舞蹈脚本。在用户点击开始指令后,系统将播放所选择的乐曲,并同时生成与乐曲相对应的舞蹈动画,并将音频及视频信号输出于音频播放单元和视频显示单元。音频播放单元包括功率放大器、扬声器件、音箱。视频显示单元包括液晶显示器、等离子体显示器、背投或前投式显示器。显示器可以单机显示或多机组合显示。Store music files directly in the data storage components of the computer unit, such as hard disk, read-only memory, erasable memory, or flash memory, etc., to form a music library; or it can be realized through CD devices or other external music playback devices Music playback. For example, we stored Tchaikovsky's "Swan Lake" as music for a dance performance. In this system, a graphics library including three-dimensional data of various plants is established. For example, we use the 3D modeling module to build a 3D lily model as the protagonist of the dance animation, which consists of a main stem, four leaves and a flower at the top. These organs can move during dance, and simulate the movements of the human trunk and limbs in various poses and with different expressions. In this system, a library of dance gestures corresponding to various plant models is established. For example, we divide the posture of the animation character lily into six parts: the flower, the main stem and four branches and leaves, and each part establishes several representative postures (for example, for the flower part, there can be: , high, yaw and twist, etc.). In this system, an action script file including dance actions of various plant dance action sequences is established. For example, we establish the target posture of each beat according to the natural rhythm of the music, and the system will automatically realize the transfer and conversion between postures according to the dynamic model based on physics, thereby generating various dance movements. Coupled with some overall dance control movements, such as moving, jumping, rotating, etc., a complete dance script file can be formed, and the dance animation characters can perform coherent and smooth dances according to the written dance script. The built-in software of this system establishes an audio signal processing unit for extracting and identifying music elements (such as beat, treble, bass, drum, etc.). For example, we can use the method of frequency spectrum analysis to extract and identify the pitch of the pitch. For the case where MIDI is used as the sound source, we can establish a MIDI analysis unit to extract information such as pitch, sound length, and beat contained in MIDI music signals, so as to more accurately control the dance of animated characters. Through the human-computer interaction software interface mode displayed on the computer screen, the user can select the way of arranging music for plant body animation, which can be arranging manually or automatically. For example, if we choose the method of manually arranging music, then we need to further select the dance script. We can write the dance script according to the method introduced in step 4, save it and select it as the current dance script. After the user clicks the start command, the system will play the selected music, and at the same time generate a dance animation corresponding to the music, and output the audio and video signals to the audio playback unit and the video display unit. The audio playback unit includes a power amplifier, a loudspeaker piece, and a sound box. Video display units include liquid crystal displays, plasma displays, rear projection or front projection displays. The display can be displayed on a single machine or combined with multiple machines.

Claims (7)

1. a three-dimensional plant body music animation system comprises computer unit, audio playing unit and video display unit, and described computer unit can pass through embedded software, the music file of analyzing stored in music libraries;
Described computer unit can also pass through embedded software, calculates and the continuous animated video of automatic generation, and vision signal is outputed to video display unit;
Described audio playing unit is used for playing audio signal;
Described video display unit is used to show voice data;
It is characterized in that described computer unit comprises:
3 d graphic library is used to store the model of various three-dimensional plants;
The real-time animation sequence generates and the real-time rendering module, is used for generating automatically and playing up real-time dance movement;
Dancing attitude storehouse is used to store various dancing attitudes;
Automatically the dancing rule module is used to produce the dance movement layout data;
The dance movement script module is used to store the dance movement data.
2. system according to claim 1 is characterized in that described computer unit also comprises;
The three-dimensional modeling interface generates plant model by user oneself definition;
Dancing attitude edition interface generates the dancing attitude by user oneself definition;
The dance movement choreography interface generates dance movement by user oneself definition.
3. system according to claim 1 is characterized in that described computer unit also comprises:
The music signal processing unit is used for handling the music signal of music libraries;
The music unit is used to play the music signal from the music signal processing unit.
4. system according to claim 1 is characterized in that described music libraries is made of external memory devices such as hard disc of computer, CD CD, discs.
5. system according to claim 1 is characterized in that described audio playing unit comprises power amplifier, loudspeaker, audio amplifier.
6. system according to claim 1 is characterized in that described video display unit comprises LCD, plasma scope, rear-projection or pre-projecting type display.
7. system according to claim 6 is characterized in that described display can show or multimachine combination demonstration by unit.
CNB200310120622XA 2003-12-15 2003-12-15 3D Plant Music Animation System Expired - Fee Related CN100454342C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB200310120622XA CN100454342C (en) 2003-12-15 2003-12-15 3D Plant Music Animation System

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB200310120622XA CN100454342C (en) 2003-12-15 2003-12-15 3D Plant Music Animation System

Publications (2)

Publication Number Publication Date
CN1629889A true CN1629889A (en) 2005-06-22
CN100454342C CN100454342C (en) 2009-01-21

Family

ID=34843950

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB200310120622XA Expired - Fee Related CN100454342C (en) 2003-12-15 2003-12-15 3D Plant Music Animation System

Country Status (1)

Country Link
CN (1) CN100454342C (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100407192C (en) * 2005-09-09 2008-07-30 腾讯科技(深圳)有限公司 A method for realizing interaction between animation and music and a playback device
WO2009143758A1 (en) * 2008-05-28 2009-12-03 深圳华为通信技术有限公司 Method and media player for playing image in synchronism with audio file
CN101661628B (en) * 2008-08-28 2012-03-28 中国科学院自动化研究所 Fast Rendering and Roaming Method of Plant Scene
CN104820583A (en) * 2014-01-30 2015-08-05 塔米拉 Application software for stage, dance drama, dance, study and arrangement research
CN104850637A (en) * 2015-05-25 2015-08-19 杭州云昀网络科技有限公司 Method for displaying multimedia business card by using 3D imaging and virtual reality technologies
CN111179385A (en) * 2019-12-31 2020-05-19 网易(杭州)网络有限公司 Dance animation processing method and device, electronic equipment and storage medium
CN111722896A (en) * 2019-03-21 2020-09-29 华为技术有限公司 Animation playback method, device, terminal, and computer-readable storage medium
CN111798549A (en) * 2020-07-15 2020-10-20 广州微咔世纪信息科技有限公司 Dance editing method, device and computer storage medium
CN113556578A (en) * 2021-08-03 2021-10-26 广州酷狗计算机科技有限公司 Video generation method, device, terminal and storage medium
CN116993872A (en) * 2023-07-27 2023-11-03 湖北工程学院 A human body animation generation system, method, device and storage medium based on Labanotation

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5969770A (en) * 1995-05-24 1999-10-19 Thomson Consumer Electronics, Inc., Animated "on-screen" display provisions for an MPEG video signal processing system
US6314569B1 (en) * 1998-11-25 2001-11-06 International Business Machines Corporation System for video, audio, and graphic presentation in tandem with video/audio play

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100407192C (en) * 2005-09-09 2008-07-30 腾讯科技(深圳)有限公司 A method for realizing interaction between animation and music and a playback device
WO2009143758A1 (en) * 2008-05-28 2009-12-03 深圳华为通信技术有限公司 Method and media player for playing image in synchronism with audio file
CN101593541B (en) * 2008-05-28 2012-01-04 华为终端有限公司 Method and media player for synchronously playing images and audio file
CN101661628B (en) * 2008-08-28 2012-03-28 中国科学院自动化研究所 Fast Rendering and Roaming Method of Plant Scene
CN104820583A (en) * 2014-01-30 2015-08-05 塔米拉 Application software for stage, dance drama, dance, study and arrangement research
CN104850637A (en) * 2015-05-25 2015-08-19 杭州云昀网络科技有限公司 Method for displaying multimedia business card by using 3D imaging and virtual reality technologies
CN104850637B (en) * 2015-05-25 2018-10-19 张热滨 A method of showing multimedia business card using 3D imagings and virtual reality technology
CN111722896A (en) * 2019-03-21 2020-09-29 华为技术有限公司 Animation playback method, device, terminal, and computer-readable storage medium
CN111722896B (en) * 2019-03-21 2021-09-21 华为技术有限公司 Animation playing method, device, terminal and computer readable storage medium
CN111179385A (en) * 2019-12-31 2020-05-19 网易(杭州)网络有限公司 Dance animation processing method and device, electronic equipment and storage medium
CN111798549A (en) * 2020-07-15 2020-10-20 广州微咔世纪信息科技有限公司 Dance editing method, device and computer storage medium
CN111798549B (en) * 2020-07-15 2024-02-20 广州微咔世纪信息科技有限公司 Dance editing method, device and computer storage medium
CN113556578A (en) * 2021-08-03 2021-10-26 广州酷狗计算机科技有限公司 Video generation method, device, terminal and storage medium
CN113556578B (en) * 2021-08-03 2023-10-20 广州酷狗计算机科技有限公司 Video generation method, device, terminal and storage medium
CN116993872A (en) * 2023-07-27 2023-11-03 湖北工程学院 A human body animation generation system, method, device and storage medium based on Labanotation
CN116993872B (en) * 2023-07-27 2024-01-30 湖北工程学院 Labanotation-based human body animation generation system, method, equipment and storage medium

Also Published As

Publication number Publication date
CN100454342C (en) 2009-01-21

Similar Documents

Publication Publication Date Title
US9888333B2 (en) Three-dimensional audio rendering techniques
MacIntyre et al. DART: a toolkit for rapid design exploration of augmented reality experiences
CN110213613B (en) Image processing method, device and storage medium
Hamilton et al. Gesture-based collaborative virtual reality performance in carillon
CN100454342C (en) 3D Plant Music Animation System
Parent Computer animation complete: all-in-one: learn motion capture, characteristic, point-based, and Maya winning techniques
Böttcher Current problems and future possibilities of procedural audio in computer games
Schertenleib et al. Conducting a virtual orchestra
Magalhäes et al. Physics-based concatenative sound synthesis of photogrammetric models for aural and haptic feedback in virtual environments
CN115631287A (en) Digital virtual stage figure display system
Jeon et al. Constructing the immersive interactive sonification platform (iISoP)
CN110992450B (en) Music fountain simulation system based on OpenGL
Wang et al. Computer Aided Animation Art Design and Production Based on Virtual Reality Technology
Töpfer et al. Moving Experiences-Towards a Conceptual Framework for Performative Artefacts in Museums
Kunze et al. SEE-A Structured Event Editor: visualizing compositional data in common music
Brito et al. Towards music-driven procedural animation
Paul Granulation of sound in video games
CN1193145A (en) Animation Interface Editing Method
CN110767031A (en) Music teaching platform of VR technique
Eloul et al. Motion Tracking of a Fish as a Novel Way to Control Electronic Music Performance
Greuel et al. Sculpting 3D worlds with music: advanced texturing techniques
Yılmaz et al. Music driven real-time 3D concert simulation
Moore et al. Interactive Real-time Concatenative Synthesis in Virtual Reality
Schnug et al. Exploring Magical Musical Interactions In Web Based Virtual Environments
Güdükbay et al. Tradition offers artistic possibilities for new media technologies: an animation system for shadow theatre

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20090121

Termination date: 20171215

CF01 Termination of patent right due to non-payment of annual fee