CN1629889A - 3D Plant Music Animation System - Google Patents
3D Plant Music Animation System Download PDFInfo
- Publication number
- CN1629889A CN1629889A CN 200310120622 CN200310120622A CN1629889A CN 1629889 A CN1629889 A CN 1629889A CN 200310120622 CN200310120622 CN 200310120622 CN 200310120622 A CN200310120622 A CN 200310120622A CN 1629889 A CN1629889 A CN 1629889A
- Authority
- CN
- China
- Prior art keywords
- dance
- unit
- music
- real
- video display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Processing Or Creating Images (AREA)
Abstract
一种三维植物体音乐动画系统,包括计算机单元、音频播放单元和视频显示单元,所述计算机单元能够通过内置软件,分析存储在音乐库中的音乐文件;所述计算机单元还能够通过内置软件,计算并自动生成连续的动画视频,并将视频信号输出到视频显示单元;所述音频播放单元,用于播放音频信号;所述视频显示单元,用于显示音频数据;三维图形库,用于存储各种三维植物的模型;实时动画序列生成和实时渲染模块,用于自动生成并渲染实时的舞蹈动作;舞蹈姿态库,用于存储各种舞蹈姿态;自动舞蹈规则模块,用于产生舞蹈动作规划数据;舞蹈动作脚本模块,用于编辑和存储舞蹈动作数据。
A three-dimensional plant body music animation system, including a computer unit, an audio playback unit and a video display unit, the computer unit can analyze music files stored in the music library through the built-in software; the computer unit can also use the built-in software, Calculate and automatically generate continuous animation video, and output the video signal to the video display unit; the audio playback unit is used to play the audio signal; the video display unit is used to display audio data; the three-dimensional graphics library is used to store Models of various 3D plants; real-time animation sequence generation and real-time rendering module, used to automatically generate and render real-time dance movements; dance gesture library, used to store various dance gestures; automatic dance rule module, used to generate dance movement planning Data; dance action script module, used to edit and store dance action data.
Description
技术领域technical field
本发明涉及计算机多媒体系统和三维计算机图形动画系统,特别涉及三维植物体的音乐动画系统。The invention relates to a computer multimedia system and a three-dimensional computer graphic animation system, in particular to a music animation system for a three-dimensional plant body.
背景技术Background technique
关于植物的建模和真实感绘制一直是图形学领域研究的热点之一。人们做了大量的卓有成效的工作,然而有关植物动画的研究却不多见,而且多关注于植物的生长动画,具有真实感的植物运动模拟由于具有较高的运动复杂度和场景复杂度,对这类运动的描述、控制和实现具有较大的难度。而且,由于植物具有较高的运动自由度,给求解运动方程带来了很大的难度,实时动画就更加难以实现。现有的大多数虚拟舞蹈系统采用虚拟人作为其动画角色,并且大多数是运用运动捕捉技术,通过运动捕捉装置(磁电式或光电式)捕捉真实世界的人的动作信息,然后通过各种运动合成方法,将运动重定位到虚拟舞蹈角色,生成逼真的运动动画序列。这种方法需要较为复杂而昂贵的运动捕捉装置,并且需要采集大量的真实人物的运动数据,而且合成新的运动较为困难,合成的运动往往只是所捕捉到的真实运动的简单重复,难免给人单调乏味的感觉。The modeling and realistic rendering of plants has always been one of the hotspots in the field of graphics research. People have done a lot of fruitful work, but the research on plant animation is rare, and more attention is paid to the growth animation of plants. Realistic plant motion simulation has high motion complexity and scene complexity. The description, control and realization of this kind of motion are quite difficult. Moreover, because plants have a high degree of freedom of movement, it is very difficult to solve the equation of motion, and real-time animation is even more difficult to achieve. Most of the existing virtual dance systems use virtual people as their animation characters, and most of them use motion capture technology to capture the motion information of people in the real world through motion capture devices (magnetism or photoelectric), and then use various A motion synthesis method that retargets motion to a virtual dancing character to generate realistic motion animation sequences. This method requires a relatively complex and expensive motion capture device, and needs to collect a large amount of motion data of real people, and it is difficult to synthesize new motions. The synthesized motions are often just simple repetitions of the captured real motions, which inevitably gives people The feeling of monotony.
发明内容Contents of the invention
本发明的目的在于提供一种三维植物体音乐动画系统。The object of the present invention is to provide a three-dimensional plant music animation system.
为实现上述目的,一种三维植物体音乐动画系统,包括计算机单元、音频播放单元和视频显示单元;In order to achieve the above object, a three-dimensional plant music animation system includes a computer unit, an audio playback unit and a video display unit;
所述计算机单元能够通过内置软件,分析存储在音乐库中的音乐文件;The computer unit is capable of analyzing music files stored in the music library through built-in software;
所述计算机单元还能够通过内置软件,计算并自动生成连续的动画视频,并将视频信号输出到视频显示单元;The computer unit can also calculate and automatically generate continuous animation video through built-in software, and output the video signal to the video display unit;
所述音频播放单元,用于播放音频信号;The audio playback unit is used to play audio signals;
所述视频显示单元,用于显示音频数据;The video display unit is used to display audio data;
其特征在于所述计算机单元包括:It is characterized in that the computer unit includes:
三维图形库,用于存储各种三维植物的模型;3D graphics library for storing models of various 3D plants;
实时动画序列生成和实时渲染模块,用于自动生成并渲染实时的舞蹈动作;Real-time animation sequence generation and real-time rendering module, used to automatically generate and render real-time dance movements;
舞蹈姿态库,用于存储各种舞蹈姿态;Dance gesture library, used to store various dance gestures;
自动舞蹈规则模块,用于产生舞蹈动作规划数据;Automatic dance rule module, used to generate dance movement planning data;
舞蹈动作脚本模块,用于存储舞蹈动作数据。The dance action script module is used to store dance action data.
本发明在不需要运动捕捉装置的情况下,逼真地模拟植物体的运动,实时地生成三维植物体的舞蹈运动动画序列。本发明还能让用户自己编辑舞蹈姿态和动作,从而能够编排生成与音乐风格和谐统一的舞蹈动画。为用户提供一个集音乐、舞蹈、三维计算机图形学、三维计算机动画等多项技术于一体的智能娱乐系统。本发明所用的方法在多媒体影视制作,多媒体娱乐游戏开发和多媒体广告制作等领域具有应用前景。The invention realistically simulates the motion of the plant body without the need of a motion capture device, and generates a three-dimensional dance motion animation sequence of the plant body in real time. The invention can also allow users to edit dance gestures and movements by themselves, so that dance animations that are harmonious and unified with music styles can be programmed and generated. Provide users with an intelligent entertainment system integrating music, dance, 3D computer graphics, 3D computer animation and other technologies. The method used in the invention has application prospects in the fields of multimedia film and television production, multimedia entertainment game development, multimedia advertisement production and the like.
附图说明Description of drawings
图1是本发明三维植物体音乐动画系统组成框图。Fig. 1 is a composition block diagram of the three-dimensional plant music animation system of the present invention.
具体实施方式Detailed ways
附图1为本发明的系统结构框图。整个系统分为三个单元:计算机单元10、音响输出单元20和视频显示单元30。计算机单元包括由各种音乐文件、CD光盘、唱片等组成的一个音乐库101;计算机单元内置有音乐信号处理模块102用于处理和识别音乐信号,以便控制舞蹈动作的时间、风格、力度等要素;音乐播放模块103用于播放音乐,将音频信号输出给音频播放单元20。计算机单元内还内置有三维图形库111,存储各种三维植物的模型用于舞蹈动画;实时动画序列生成和实时渲染模块112,将从舞蹈姿态库113中提取姿态数据,从自动舞蹈规则114模块产生舞蹈动作规划数据,或从舞蹈动作脚本115中提取舞蹈动作数据,自动生成并渲染实时的舞蹈动画。计算机单元还提供三维建模121、舞蹈姿态编辑122、舞蹈动作编排123三个与用户交换的接口,以使系统能够由用户自己定义生成植物模型、舞蹈姿态和舞蹈动作。计算机单元的乐曲输出音频信号和动画输出视频信号分别连接到音频播放单元20和视频显示单元30,以播放音乐和显示动画。Accompanying drawing 1 is a system structure block diagram of the present invention. The whole system is divided into three units: a computer unit 10 , an audio output unit 20 and a video display unit 30 . The computer unit includes a music library 101 composed of various music files, CD discs, discs, etc.; the computer unit has a built-in music signal processing module 102 for processing and identifying music signals, so as to control elements such as time, style, and dynamics of dance movements. The music playing module 103 is used to play music, and output the audio signal to the audio playing unit 20 ; Also built-in three-dimensional graphics storehouse 111 in the computer unit, the model of storing various three-dimensional plants is used for dance animation; Real-time animation sequence generation and real-time rendering module 112, will extract gesture data from dance gesture storehouse 113, from automatic dance rule 114 module Generate dance action planning data, or extract dance action data from the dance action script 115, automatically generate and render real-time dance animation. The computer unit also provides 3D modeling 121, dance posture editor 122, and dance movement choreography 123, three interfaces for exchange with users, so that the system can be defined by the user to generate plant models, dance postures and dance movements. The music output audio signal and the animation output video signal of the computer unit are respectively connected to the audio playback unit 20 and the video display unit 30 to play music and display animation.
实施实例Implementation example
将音乐文件直接存放在计算机单元的数据存储部件中,如硬盘,只读储存器,可擦除储存器,或闪存等,形成一个音乐库;或者可以通过CD装置或外部其它音乐播放装置来实现音乐的播放。例如,我们存储了柴可夫斯基的《天鹅湖》作为舞蹈表演的音乐。在本系统的内建立包括各种植物体三维数据的图形库。例如,我们通过三维建模模块,建立一个三维的百合花模型,作为舞蹈动画的主角,它由一根主茎、四片叶和位于顶端的一朵花组成。这些器官在舞蹈时均可以运动,并模拟人的躯干和四肢的作出各种各样千姿百态的运动。在本系统内建立与各种植物体模型相对应的舞蹈姿态库。例如,我们将动画角色百合花的姿态分为花朵、主茎和四片枝叶六个部分,每个部分又分别建立具有代表性的姿态若干种(比如,对于花朵部分可以有:花朵的低垂、高昂、侧偏和扭转等)。在本系统内建立包括各种植物体舞蹈动作序列的舞蹈动作的动作脚本文件。例如,我们按照音乐的自然节拍建立每一节拍的目标姿态,系统会根据基于物理的动力学模型自动实现姿态间的转移和转换,从而生成各式各样的舞蹈动作。再加上一些全局性的控制舞蹈的动作,如移动、跳跃、旋转等,便可以形成一个完整的舞蹈脚本文件,舞蹈动画角色便可以按照所写的舞蹈脚本进行连贯流畅的舞蹈。在本系统的内置软件建立音乐要素(如节拍、高音、低音、鼓点等)提取和识别的音频信号处理单元。例如,我们可以采用频谱分析的方法,提取和识别音调的高低。对于音源采用MIDI的情况,我们可以建立MIDI分析单元,提取MIDI音乐信号种所含的音高、音长、节拍等信息,以更准确地控制动画角色的舞蹈。用户通过计算机屏幕显示中人机交互的软件界面方式,选择植物体动画配曲方式,可以人工手动配曲或者全自动配曲。例如,我们选择人工手动配曲的方式,那么就还需进一步选择舞蹈脚本,我们可以按照第4步中介绍的方式编写舞蹈脚本保存起来并选作当前舞蹈脚本。在用户点击开始指令后,系统将播放所选择的乐曲,并同时生成与乐曲相对应的舞蹈动画,并将音频及视频信号输出于音频播放单元和视频显示单元。音频播放单元包括功率放大器、扬声器件、音箱。视频显示单元包括液晶显示器、等离子体显示器、背投或前投式显示器。显示器可以单机显示或多机组合显示。Store music files directly in the data storage components of the computer unit, such as hard disk, read-only memory, erasable memory, or flash memory, etc., to form a music library; or it can be realized through CD devices or other external music playback devices Music playback. For example, we stored Tchaikovsky's "Swan Lake" as music for a dance performance. In this system, a graphics library including three-dimensional data of various plants is established. For example, we use the 3D modeling module to build a 3D lily model as the protagonist of the dance animation, which consists of a main stem, four leaves and a flower at the top. These organs can move during dance, and simulate the movements of the human trunk and limbs in various poses and with different expressions. In this system, a library of dance gestures corresponding to various plant models is established. For example, we divide the posture of the animation character lily into six parts: the flower, the main stem and four branches and leaves, and each part establishes several representative postures (for example, for the flower part, there can be: , high, yaw and twist, etc.). In this system, an action script file including dance actions of various plant dance action sequences is established. For example, we establish the target posture of each beat according to the natural rhythm of the music, and the system will automatically realize the transfer and conversion between postures according to the dynamic model based on physics, thereby generating various dance movements. Coupled with some overall dance control movements, such as moving, jumping, rotating, etc., a complete dance script file can be formed, and the dance animation characters can perform coherent and smooth dances according to the written dance script. The built-in software of this system establishes an audio signal processing unit for extracting and identifying music elements (such as beat, treble, bass, drum, etc.). For example, we can use the method of frequency spectrum analysis to extract and identify the pitch of the pitch. For the case where MIDI is used as the sound source, we can establish a MIDI analysis unit to extract information such as pitch, sound length, and beat contained in MIDI music signals, so as to more accurately control the dance of animated characters. Through the human-computer interaction software interface mode displayed on the computer screen, the user can select the way of arranging music for plant body animation, which can be arranging manually or automatically. For example, if we choose the method of manually arranging music, then we need to further select the dance script. We can write the dance script according to the method introduced in step 4, save it and select it as the current dance script. After the user clicks the start command, the system will play the selected music, and at the same time generate a dance animation corresponding to the music, and output the audio and video signals to the audio playback unit and the video display unit. The audio playback unit includes a power amplifier, a loudspeaker piece, and a sound box. Video display units include liquid crystal displays, plasma displays, rear projection or front projection displays. The display can be displayed on a single machine or combined with multiple machines.
Claims (7)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB200310120622XA CN100454342C (en) | 2003-12-15 | 2003-12-15 | 3D Plant Music Animation System |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB200310120622XA CN100454342C (en) | 2003-12-15 | 2003-12-15 | 3D Plant Music Animation System |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1629889A true CN1629889A (en) | 2005-06-22 |
| CN100454342C CN100454342C (en) | 2009-01-21 |
Family
ID=34843950
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB200310120622XA Expired - Fee Related CN100454342C (en) | 2003-12-15 | 2003-12-15 | 3D Plant Music Animation System |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100454342C (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100407192C (en) * | 2005-09-09 | 2008-07-30 | 腾讯科技(深圳)有限公司 | A method for realizing interaction between animation and music and a playback device |
| WO2009143758A1 (en) * | 2008-05-28 | 2009-12-03 | 深圳华为通信技术有限公司 | Method and media player for playing image in synchronism with audio file |
| CN101661628B (en) * | 2008-08-28 | 2012-03-28 | 中国科学院自动化研究所 | Fast Rendering and Roaming Method of Plant Scene |
| CN104820583A (en) * | 2014-01-30 | 2015-08-05 | 塔米拉 | Application software for stage, dance drama, dance, study and arrangement research |
| CN104850637A (en) * | 2015-05-25 | 2015-08-19 | 杭州云昀网络科技有限公司 | Method for displaying multimedia business card by using 3D imaging and virtual reality technologies |
| CN111179385A (en) * | 2019-12-31 | 2020-05-19 | 网易(杭州)网络有限公司 | Dance animation processing method and device, electronic equipment and storage medium |
| CN111722896A (en) * | 2019-03-21 | 2020-09-29 | 华为技术有限公司 | Animation playback method, device, terminal, and computer-readable storage medium |
| CN111798549A (en) * | 2020-07-15 | 2020-10-20 | 广州微咔世纪信息科技有限公司 | Dance editing method, device and computer storage medium |
| CN113556578A (en) * | 2021-08-03 | 2021-10-26 | 广州酷狗计算机科技有限公司 | Video generation method, device, terminal and storage medium |
| CN116993872A (en) * | 2023-07-27 | 2023-11-03 | 湖北工程学院 | A human body animation generation system, method, device and storage medium based on Labanotation |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5969770A (en) * | 1995-05-24 | 1999-10-19 | Thomson Consumer Electronics, Inc., | Animated "on-screen" display provisions for an MPEG video signal processing system |
| US6314569B1 (en) * | 1998-11-25 | 2001-11-06 | International Business Machines Corporation | System for video, audio, and graphic presentation in tandem with video/audio play |
-
2003
- 2003-12-15 CN CNB200310120622XA patent/CN100454342C/en not_active Expired - Fee Related
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100407192C (en) * | 2005-09-09 | 2008-07-30 | 腾讯科技(深圳)有限公司 | A method for realizing interaction between animation and music and a playback device |
| WO2009143758A1 (en) * | 2008-05-28 | 2009-12-03 | 深圳华为通信技术有限公司 | Method and media player for playing image in synchronism with audio file |
| CN101593541B (en) * | 2008-05-28 | 2012-01-04 | 华为终端有限公司 | Method and media player for synchronously playing images and audio file |
| CN101661628B (en) * | 2008-08-28 | 2012-03-28 | 中国科学院自动化研究所 | Fast Rendering and Roaming Method of Plant Scene |
| CN104820583A (en) * | 2014-01-30 | 2015-08-05 | 塔米拉 | Application software for stage, dance drama, dance, study and arrangement research |
| CN104850637A (en) * | 2015-05-25 | 2015-08-19 | 杭州云昀网络科技有限公司 | Method for displaying multimedia business card by using 3D imaging and virtual reality technologies |
| CN104850637B (en) * | 2015-05-25 | 2018-10-19 | 张热滨 | A method of showing multimedia business card using 3D imagings and virtual reality technology |
| CN111722896A (en) * | 2019-03-21 | 2020-09-29 | 华为技术有限公司 | Animation playback method, device, terminal, and computer-readable storage medium |
| CN111722896B (en) * | 2019-03-21 | 2021-09-21 | 华为技术有限公司 | Animation playing method, device, terminal and computer readable storage medium |
| CN111179385A (en) * | 2019-12-31 | 2020-05-19 | 网易(杭州)网络有限公司 | Dance animation processing method and device, electronic equipment and storage medium |
| CN111798549A (en) * | 2020-07-15 | 2020-10-20 | 广州微咔世纪信息科技有限公司 | Dance editing method, device and computer storage medium |
| CN111798549B (en) * | 2020-07-15 | 2024-02-20 | 广州微咔世纪信息科技有限公司 | Dance editing method, device and computer storage medium |
| CN113556578A (en) * | 2021-08-03 | 2021-10-26 | 广州酷狗计算机科技有限公司 | Video generation method, device, terminal and storage medium |
| CN113556578B (en) * | 2021-08-03 | 2023-10-20 | 广州酷狗计算机科技有限公司 | Video generation method, device, terminal and storage medium |
| CN116993872A (en) * | 2023-07-27 | 2023-11-03 | 湖北工程学院 | A human body animation generation system, method, device and storage medium based on Labanotation |
| CN116993872B (en) * | 2023-07-27 | 2024-01-30 | 湖北工程学院 | Labanotation-based human body animation generation system, method, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN100454342C (en) | 2009-01-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9888333B2 (en) | Three-dimensional audio rendering techniques | |
| MacIntyre et al. | DART: a toolkit for rapid design exploration of augmented reality experiences | |
| CN110213613B (en) | Image processing method, device and storage medium | |
| Hamilton et al. | Gesture-based collaborative virtual reality performance in carillon | |
| CN100454342C (en) | 3D Plant Music Animation System | |
| Parent | Computer animation complete: all-in-one: learn motion capture, characteristic, point-based, and Maya winning techniques | |
| Böttcher | Current problems and future possibilities of procedural audio in computer games | |
| Schertenleib et al. | Conducting a virtual orchestra | |
| Magalhäes et al. | Physics-based concatenative sound synthesis of photogrammetric models for aural and haptic feedback in virtual environments | |
| CN115631287A (en) | Digital virtual stage figure display system | |
| Jeon et al. | Constructing the immersive interactive sonification platform (iISoP) | |
| CN110992450B (en) | Music fountain simulation system based on OpenGL | |
| Wang et al. | Computer Aided Animation Art Design and Production Based on Virtual Reality Technology | |
| Töpfer et al. | Moving Experiences-Towards a Conceptual Framework for Performative Artefacts in Museums | |
| Kunze et al. | SEE-A Structured Event Editor: visualizing compositional data in common music | |
| Brito et al. | Towards music-driven procedural animation | |
| Paul | Granulation of sound in video games | |
| CN1193145A (en) | Animation Interface Editing Method | |
| CN110767031A (en) | Music teaching platform of VR technique | |
| Eloul et al. | Motion Tracking of a Fish as a Novel Way to Control Electronic Music Performance | |
| Greuel et al. | Sculpting 3D worlds with music: advanced texturing techniques | |
| Yılmaz et al. | Music driven real-time 3D concert simulation | |
| Moore et al. | Interactive Real-time Concatenative Synthesis in Virtual Reality | |
| Schnug et al. | Exploring Magical Musical Interactions In Web Based Virtual Environments | |
| Güdükbay et al. | Tradition offers artistic possibilities for new media technologies: an animation system for shadow theatre |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20090121 Termination date: 20171215 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |