[go: up one dir, main page]

CN108810436A - A kind of video recording method and system based on the He Zou of full-automatic musical instrument - Google Patents

A kind of video recording method and system based on the He Zou of full-automatic musical instrument Download PDF

Info

Publication number
CN108810436A
CN108810436A CN201810510795.9A CN201810510795A CN108810436A CN 108810436 A CN108810436 A CN 108810436A CN 201810510795 A CN201810510795 A CN 201810510795A CN 108810436 A CN108810436 A CN 108810436A
Authority
CN
China
Prior art keywords
musical instrument
video
image
target
instrumental
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810510795.9A
Other languages
Chinese (zh)
Inventor
冯山
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Music-Cat Musical Instrument Technology Co Ltd
Original Assignee
Guangzhou Music-Cat Musical Instrument Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Music-Cat Musical Instrument Technology Co Ltd filed Critical Guangzhou Music-Cat Musical Instrument Technology Co Ltd
Priority to CN201810510795.9A priority Critical patent/CN108810436A/en
Publication of CN108810436A publication Critical patent/CN108810436A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00Details of electrophonic musical instruments
    • G10H1/0033Recording/reproducing or transmission of music for electrophonic musical instruments
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265Mixing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/91Television signal processing therefor
    • H04N5/92Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N5/9201Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving the multiplexing of an additional signal and the video signal
    • H04N5/9202Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving the multiplexing of an additional signal and the video signal the additional signal being a sound signal
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/031Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/155Musical effects
    • G10H2210/245Ensemble, i.e. adding one or more voices, also instrumental voices

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Electrophonic Musical Instruments (AREA)

Abstract

The invention discloses a kind of video recording methods instrumental ensembled based on full-automatic musical instrument, include the following steps:The environmental audio in facial image in region, musical instrument image and pickup He Zou region is instrumental ensembled in acquisition in real time;The facial image and musical instrument image are sheared according to excellent degree and synthesize target video;It will increase in target video with the target video time upper corresponding environmental audio, and form final recorded video.The invention also discloses a kind of video recording systems that full-automatic musical instrument is instrumental ensembled.All splendid moments during (instrumental) ensemble can be carried out shearing one complete video of synthesis by the present invention, so that player watches and shares.

Description

A kind of video recording method and system based on the He Zou of full-automatic musical instrument
Technical field
The present invention relates to electronic musical instrument technical field, specially a kind of video recording method instrumental ensembled based on full-automatic musical instrument And system.
Background technology
Used in the places such as existing qin room or singing-hall, KTV generally amusement or practice, it cannot realize well each The interaction of kind musical instrument, i.e., it is enabled to realize, and during (instrumental) ensemble, and the effect of (instrumental) ensemble can not be known, it is interesting not high. Some places may increase camera to record a video to whole process, although this mode to a certain extent may be subsequent It is checked, but this panorama type cannot know Highlights content well, can not obtain the happy sense shared.
Invention content
For overcome the deficiencies in the prior art, one of the objects of the present invention is to provide one kind is instrumental ensembled based on full-automatic musical instrument Video recording method, all splendid moments during (instrumental) ensemble can be carried out shearing synthesis one complete video, for Player watches and shares.
The second object of the present invention is to provide a kind of video recording system instrumental ensembled based on full-automatic musical instrument, can incited somebody to action All splendid moments during (instrumental) ensemble carry out shearing one complete video of synthesis, so that player watches and shares.
One of to achieve the above object, the present invention provides the following technical solutions:
A kind of video recording method instrumental ensembled based on full-automatic musical instrument, is included the following steps:
The environmental audio in facial image in region, musical instrument image and pickup He Zou region is instrumental ensembled in acquisition in real time;
The facial image and musical instrument image are sheared according to excellent degree and synthesize target video;
It will increase in target video with the target video time upper corresponding environmental audio, and form final recording and regard Frequently.
Further, the real-time acquisition instrumental ensembles facial image in region, musical instrument video image and pickup and instrumental ensembles region Interior environmental audio, including:
The musical instrument track of the corresponding each musical instrument of target music is obtained according to the target music analysis of selection;
Drop point is played according to what the musical instrument track generated each musical instrument;
After the startup of target music, facial image, musical instrument that instrument playing personnel in region are instrumental ensembled in acquisition play drop point figure Environmental audio image in picture and He Zou region.
Further, described that the facial image and musical instrument image are sheared according to excellent degree and synthesize target Video, including:
The facial image and musical instrument image are sheared according to excellent degree, multiple videos is formed and divides mirror, video Mirror is divided to be sheared one by one with the reproduction time sequence of target music, each video divides mirror to include one or more faces Image or/and musical instrument image;
Mirror is divided to synthesize target video, the total time of target video according to the reproduction time sequence of target music multiple videos It is identical as the reproduction time of target music.
Further, each video divides the reproduction time section that mirror corresponds to a target music, and any two video divides mirror It is not overlapped between corresponding reproduction time section.
Further, when it includes multiple facial images or/and musical instrument image that a video, which divides mirror, split screen display available is carried out Or picture-in-picture is shown.
Further, the excellent degree includes below one or more:
Musical instrument plays the intensive segment of drop point, plays the high segment of drop point accuracy, the segment of target music climax parts And the segment that human face action frequency is high.
Further, it will increase in target video with the target video time upper corresponding environmental audio, be formed most Whole recorded video, including:
Based on the broadcasting of target music, by the reproduction time axis of the reproduction time axis of target video and environmental audio with The reproduction time axis of target music corresponds to consistent;
Increase to described in target video with environmental audio, forms final recorded video.
Further, the musical instrument is one or more in electronic organ, electronic drum and bowed stringed instrument.
Further, the environmental audio includes the performance wave audio of musical instrument sound audio and target music.
To achieve the above object two, the present invention provides the following technical solutions:
A kind of video recording system instrumental ensembled based on full-automatic musical instrument, including:
Collecting device instrumental ensembles facial image and musical instrument image in region for acquiring in real time;
Sound pick-up, for picking up the environmental audio instrumental ensembled in region in real time;
Processor, for receiving the facial image, musical instrument image and environmental audio, and according to excellent degree to described Facial image and musical instrument image are sheared and are synthesized target video and will be with the target video time upper corresponding ring Border audio increases in target video, forms final recorded video.
Compared with prior art, the present invention is based on the video recording methods and system of the He Zou of full-automatic musical instrument, beneficial to effect Fruit is:
The present invention is picked up entire by being acquired respectively to each facial image, the musical instrument image played in region Environmental audio signal in region regards to carry out cutting synthesis target to facial image and musical instrument image according to excellent degree Frequently, and environmental audio is corresponded to according to the target video time and is superimposed upon in target video, form recorded video, which has Each splendid moment of entire playing procedure, the interest of (instrumental) ensemble is increased, while being also convenient for player and watching and share.
Description of the drawings
Fig. 1 is the flow chart for the video recording method instrumental ensembled the present invention is based on full-automatic musical instrument;
Fig. 2 is the structure diagram for the video recording system instrumental ensembled the present invention is based on full-automatic musical instrument;
Fig. 3 is one of a kind of implementation structure chart that the present invention plays region;
Fig. 4 is the two of a kind of implementation structure chart that the present invention plays region.
Specific implementation mode
In the following, in conjunction with attached drawing and specific implementation mode, the present invention is described further, it should be noted that not Under the premise of conflicting, new implementation can be formed between various embodiments described below or between each technical characteristic in any combination Example.
A kind of video recording method instrumental ensembled based on full-automatic musical instrument, is please referred to shown in Fig. 1 comprising following steps:
110, the environmental audio in facial image in region, musical instrument image and pickup He Zou region is instrumental ensembled in acquisition in real time.
It instrumental ensembles region and instrumental ensembles place, can be qin room, singing-hall, KTV etc., can be that multiple people participate in, if only One people plays, and can also carry out video record to it.The collecting device of facial image and musical instrument image can be camera or Video camera, facial image here is the facial image for participating in (instrumental) ensemble personnel, does not include viewing personnel, and facial image can be packet The entire body image for participating in (instrumental) ensemble personnel containing face can also be topography's (such as upper part of the body) of (instrumental) ensemble personnel. Similarly, musical instrument image is the musical instrument played, if idle, is not involved in Image Acquisition.To facial image and musical instrument image It to be acquired respectively, i.e., each collecting device instrumental ensembles personnel or musical instrument, the facial image finally obtained in this way just for one It is multiple with musical instrument image, following shearings are sheared respectively to multiple facial image and musical instrument image, are then synthesized again.
It is mainly the sound that musical instrument is sent out to instrumental ensemble the environmental audio in region, if having performance instrumental ensembling in region, Similarly the facial image of singer can be also acquired including singing sound.
Specifically, the ambient sound in facial image in region, musical instrument image and pickup He Zou region is instrumental ensembled in acquisition in real time Frequently, include the following steps:
A, the musical instrument track of the corresponding each musical instrument of target music is obtained according to the target music analysis of selection.
(instrumental) ensemble person chooses target music, that is, the music to be instrumental ensembled, which is preferably MID formats, why uses MID lattice Formula to facilitate the music track for obtaining target music, and then obtains each musical instrument corresponding musical instrument rail on the basis of music track Road also generates subtitle track here if being related to singing.What the present invention referred to automatically has two layers of meaning:One is instrumental ensemble Musical instrument can be anyone to operate, because the musical instrument track that analysis obtains can generate the drop point of playing of each musical instrument, operation Person only need according to play drop point go on corresponding key or drum or string operate, it is equally applicable for beginner, (instrumental) ensemble Musical instrument can be electronic organ, electronic drum or bowed stringed instrument, can also include other musical instruments certainly, and the instruction to playing drop point can be with It is completed by LED light.This part concrete implementation mode be referred to applicant preceding application scheme (such as application No. is 201410312842.0 bowed stringed instrument plays guiding device and its control method, and application No. is 201410091175.8 electronics Musical instrument ensemble system, electronic musical instrument play guiding device, and application No. is 201120249007.9 Instrumental playing guiding device, Shens Number please beat a drum the device etc. played music for a guidance of 201420112807.X), similarly, for how to the acquisition of target music analysis Musical instrument track also relates in front of this in case, only borrows these guiding devices to realize that the foundation-free of musical instrument is played here. The second is video record process is automatically performed, final recording is generally produced in a few minutes after the completion of (instrumental) ensemble regards Frequently.
B, drop point is played according to what the musical instrument track generated each musical instrument.
After musical instrument track determines, then the drop point of playing that each musical instrument is generated according to musical instrument track namely controls instruction dress It sets and carries out indicating also to make it easy to realize accordingly in the suitable time, this partial content equally can be in above-mentioned applicant preceding It is referred in application, which is not described herein again.
C, after music startup, facial image, musical instrument that instrument playing personnel in region are instrumental ensembled in acquisition play drop point image And the environmental audio image in He Zou region.
After target music starts, each instruction device starts to indicate the drop point of playing of each musical instrument, that is, plays and open Begin, facial image, the musical instrument of instrument playing personnel, which is played, during the entire process of music, in the region of acquisition He Zou in real time falls Environmental audio image in point image and He Zou region.
It (is in fact playing in region on the entire musical instrument of acquisition that facial image, the musical instrument of acquisition, which play drop point image, Image) it is corresponding with music track, in order to the later stage shear.
120, the facial image and musical instrument image are sheared according to excellent degree and synthesizes target video.
The facial image and musical instrument image are sheared according to excellent degree, multiple videos is formed and divides mirror, each Video divides mirror about 5-20s, for the vision signal of continuous image composition.Video divides mirror with the reproduction time sequence of target music It is sheared one by one, each video divides the reproduction time section that mirror corresponds to a target music, and any two video divides mirror to correspond to Reproduction time section between be not overlapped.
Mirror is divided to synthesize target video according to the reproduction time sequence of target music multiple videos, synthesis mode may be used Existing shearing composite software is realized.The total time of target video is identical as the reproduction time of target music.I.e. according to target sound Happy music track chooses the higher image of excellent degree in each facial image and musical instrument image, these excellent degree are higher The target video that is formed of image fill the reproduction time of entire target music.In other words, target video is in time It is continuous, is that the broadcasting with target music is mapped.
Each video divides mirror to include one or more facial images or/and musical instrument image.Because in target music There may be multiple excellent higher image frames of degree, especially target music on some or the multiple timing nodes played Climax parts, the image of one of collecting device acquisition if only shearing is entered, then can cause (instrumental) ensemble person larger something lost Therefore regret with multiple images and can deposit, in this case, it is preferred to use split screen mode or picture-in-picture mode in excellent part It completes.If some video, which divides in mirror, there is multiple facial images or/and musical instrument image, multiple facial image or/and pleasure One of in device image or multiple facial images or/and musical instrument image divide mirror be overlapped with having time with adjacent video, It is preferred that multiple facial image or/and musical instrument image at least in the presence of one do not divide with other videos the image in mirror when Between on have overlapping.
So-called excellent degree, mainly musical instrument play the intensive segment of drop point, play the high segment of drop point accuracy, mesh The high segment of the segment and human face action frequency of the happy climax parts of mark with phonetic symbols.Will meet musical instrument play the intensive segment of drop point, Play one in the high segment of drop point accuracy, the segment of target music climax parts and the high segment of human face action frequency Or it is multiple according to music track be cut out come, obtain multiple videos and divide mirror, then divide mirror to be synthesized multiple video.Musical instrument It is to analyze to obtain according to the drop point of playing of musical instrument to play the intensive segment of drop point, and it is practical when will play fall to play accurate placement rate The point time with play the drop point corresponding time on musical instrument track and be compared, the ratio data of acquisition is referred to applicant and exists Preceding application application No. is the contents of 201610772256.3 (piano study instructs system), play the high segment of drop point accuracy It can as needed (such as being defined as playing the high segment of drop point accuracy by the segment that drop point accuracy is more than 90% is played) It is configured, or the segment that accuracy rate is relatively high in multiple musical instruments is chosen after comparing.The segment of target music climax parts It is realized according to music track, the high segment of human face action frequency is realized according to the gathered data of collecting device, can close The person of playing (also including singer when having singer) high relatively high segment of human face action frequency.
130, it will increase in target video with the target video time upper corresponding environmental audio, and form final record Video processed.
Based on the broadcasting of target music, by the reproduction time axis of the reproduction time axis of target video and environmental audio with The reproduction time axis of target music corresponds to unanimously, in this way, on the one hand ensure that the same of target video, environmental audio and target music On the other hand step reduces environmental audio and is added to difficulty on target video.
Increase to described in target video with environmental audio, final recorded video is formed, in addition, in final recording Caption information can also be increased in video, caption information is equally synchronized with the broadcasting of target music.
Above-mentioned whole process is based on the music track of target music, by shearing corresponding temporal excellent figure Then picture is matching corresponding audio-frequency information and caption information, is constituting final recorded video, whole process is automatically realized, It watches and shares convenient for (instrumental) ensemble person, improve interesting.
The video recording system for the full-automatic musical instrument He Zou based on the above method that the present invention also provides a kind of, please refers to Fig. 2 It is shown comprising collecting device 210, sound pick-up 220 and processor 230:
Collecting device 210 is used for the real-time facial image acquired in He Zou region and musical instrument image, collecting device Camera or video camera etc., collecting device are arranged to multiple, and each facial image and musical instrument image are acquired respectively.Such as Fig. 3 Shown in one play region and be related to the structure chart of man face image acquiring camera.It plays and is provided with electronic organ 311, electricity in region Sub- drum 312 and performance microphone 313, setting electronic organ 311, electronic drum 312 here and singing microphone 313 has accordingly Personnel operate.There are three (be referred to as first with the collecting device (selecting camera here) being acquired to facial image Camera 310, second camera 320, third camera 330), it is preferably provided with the top of display screen and towards each position Seat position, certainly, acquisition angles can have the range of bigger.Wherein, the first camera 310 plays electricity in region for acquiring The facial image of the player of sub- qin 311, second camera 320, which is used to acquire, plays the player of electronic drum 312 in region Facial image, third camera 330 are used to acquire the facial image for playing singer in region.A performance as shown in Figure 4 Region is related to the structure chart of musical instrument Image Acquisition camera, and the collecting device being acquired to musical instrument image (selects camera shooting here Head) have two (being referred to as the 4th camera 340, the 5th camera 350), wherein the 4th camera 340 is played for acquiring The musical instrument image of electronic organ 311 in region is preferably attached to play fixing piece (such as the smallpox of the top of electronic organ 311 in region Plate), the 5th camera 350 is used to acquire the musical instrument image for playing electronic drum 312 in region, is preferably attached to play electricity in region The fixing piece (such as ceiling) of 312 top of sub- drum.
Sound pick-up 220 is mainly used for picking up the environmental audio instrumental ensembled in region in real time, including the sound letter that each musical instrument is sent out Number and the voice signal (or the voice signal sent out by corresponding speaker) that sends out of singer's microphone, sound pick-up 220 lead To be made of radio reception microphone, inside is additionally provided with signal processing circuit, the voice signal for picking up to radio reception microphone into The processing such as row filtering, noise reduction.
Processor 230 is connected with collecting device 210 and the communication of sound pick-up 220, and face is acquired for receiving collecting device 210 The environmental audio signal that picture signal and musical instrument picture signal and sound pick-up 220 pick up, meanwhile, processor 230 is according further to essence When color degree is sheared and is synthesized target video to the facial image and musical instrument image and will be with the target video Between upper corresponding environmental audio increase in target video, form final recorded video.Detailed process please refers to the above method Described in part.
The above embodiment is only the preferred embodiment of the present invention, and the scope of protection of the present invention is not limited thereto, The variation and replacement for any unsubstantiality that those skilled in the art is done on the basis of the present invention belong to institute of the present invention Claimed range.

Claims (10)

1. a kind of video recording method instrumental ensembled based on full-automatic musical instrument, it is characterised in that include the following steps:
The environmental audio in facial image in region, musical instrument image and pickup He Zou region is instrumental ensembled in acquisition in real time;
The facial image and musical instrument image are sheared according to excellent degree and synthesize target video;
It will increase in target video with the target video time upper corresponding environmental audio, and form final recorded video.
2. the video recording method according to claim 1 instrumental ensembled based on full-automatic musical instrument, it is characterised in that:It is described real-time The environmental audio in facial image in region, musical instrument video image and pickup He Zou region is instrumental ensembled in acquisition, including:
The musical instrument track of the corresponding each musical instrument of target music is obtained according to the target music analysis of selection;
Drop point is played according to what the musical instrument track generated each musical instrument;
Target music startup after, acquisition instrumental ensemble region in instrument playing personnel facial image, musical instrument play drop point image with And the environmental audio image in He Zou region.
3. the video recording method according to claim 2 instrumental ensembled based on full-automatic musical instrument, it is characterised in that:It is described according to Target video is sheared and synthesized to excellent degree to the facial image and musical instrument image, including:
The facial image and musical instrument image are sheared according to excellent degree, multiple videos is formed and mirror, video is divided to divide mirror It is sheared one by one with the reproduction time sequence of target music, each video divides mirror to include one or more facial images Or/and musical instrument image;
Mirror is divided to synthesize target video, the total time of target video and mesh according to the reproduction time sequence of target music multiple videos The reproduction time of mark with phonetic symbols pleasure is identical.
4. the video recording method according to claim 3 instrumental ensembled based on full-automatic musical instrument, it is characterised in that:Each video Point mirror corresponds to the reproduction time section of a target music, and any two video divide the corresponding reproduction time section of mirror between do not weigh It is folded.
5. the video recording method according to claim 3 instrumental ensembled based on full-automatic musical instrument, it is characterised in that:It is regarded when one When frequency division mirror includes multiple facial images or/and musical instrument image, carries out split screen display available or picture-in-picture is shown.
6. the video recording method according to claim 3 instrumental ensembled based on full-automatic musical instrument, it is characterised in that:It is described excellent Degree includes below one or more:
Musical instrument play the intensive segment of drop point, play the high segment of drop point accuracy, the segment of target music climax parts and The high segment of human face action frequency.
7. the video recording method according to claim 3 instrumental ensembled based on full-automatic musical instrument, it is characterised in that:Will with it is described The target video time, upper corresponding environmental audio increased in target video, formed final recorded video, including:
Based on the broadcasting of target music, by the reproduction time axis and target of the reproduction time axis of target video and environmental audio The reproduction time axis of music corresponds to consistent;
Increase to described in target video with environmental audio, forms final recorded video.
8. the video recording method instrumental ensembled based on full-automatic musical instrument according to claim 2-7 any one of them, it is characterised in that: The musical instrument is one or more in electronic organ, electronic drum and bowed stringed instrument.
9. the video recording method instrumental ensembled based on full-automatic musical instrument according to claim 2-7 any one of them, it is characterised in that: The environmental audio includes the performance wave audio of musical instrument sound audio and target music.
10. a kind of video recording system instrumental ensembled based on full-automatic musical instrument, it is characterised in that including:
Collecting device instrumental ensembles facial image and musical instrument image in region for acquiring in real time;
Sound pick-up, for picking up the environmental audio instrumental ensembled in region in real time;
Processor, for receiving the facial image, musical instrument image and environmental audio, and according to excellent degree to the face Image and musical instrument image are sheared and are synthesized target video and will be with the target video time upper corresponding ambient sound Frequency increases in target video, forms final recorded video.
CN201810510795.9A 2018-05-24 2018-05-24 A kind of video recording method and system based on the He Zou of full-automatic musical instrument Pending CN108810436A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810510795.9A CN108810436A (en) 2018-05-24 2018-05-24 A kind of video recording method and system based on the He Zou of full-automatic musical instrument

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810510795.9A CN108810436A (en) 2018-05-24 2018-05-24 A kind of video recording method and system based on the He Zou of full-automatic musical instrument

Publications (1)

Publication Number Publication Date
CN108810436A true CN108810436A (en) 2018-11-13

Family

ID=64091631

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810510795.9A Pending CN108810436A (en) 2018-05-24 2018-05-24 A kind of video recording method and system based on the He Zou of full-automatic musical instrument

Country Status (1)

Country Link
CN (1) CN108810436A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109256010A (en) * 2018-12-03 2019-01-22 上和弦(北京)音乐科技有限公司 A kind of music teaching demo system
CN109462776A (en) * 2018-11-29 2019-03-12 北京字节跳动网络技术有限公司 A kind of special video effect adding method, device, terminal device and storage medium
CN110070849A (en) * 2019-03-22 2019-07-30 福建星网视易信息系统有限公司 Audio performance method and computer readable storage medium
CN113194382A (en) * 2021-04-29 2021-07-30 张壬招 Internal recording pickup, and remote synchronous ensemble method and device based on internal recording pickup
CN113286183A (en) * 2021-05-10 2021-08-20 小叶子(北京)科技有限公司 Method, device and equipment for synchronously displaying performance process and music score and storage medium

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0419796A (en) * 1990-05-15 1992-01-23 Brother Ind Ltd Musical sound generating device
JPH1185170A (en) * 1997-09-01 1999-03-30 Taito Corp Karaoke sing-along improvisation system
US5990405A (en) * 1998-07-08 1999-11-23 Gibson Guitar Corp. System and method for generating and controlling a simulated musical concert experience
TW386654U (en) * 1992-10-09 2000-04-01 Yamaha Corp With skip and repeat operation of orchestra assompanimentadditional application
US20020007723A1 (en) * 1998-05-15 2002-01-24 Ludwig Lester F. Processing and generation of control signals for real-time control of music signal processing, mixing, video, and lighting
CN1720670A (en) * 2002-12-06 2006-01-11 摩托罗拉公司 Multimedia editor for wireless communication devices and method therefor
US20060130635A1 (en) * 2004-12-17 2006-06-22 Rubang Gonzalo R Jr Synthesized music delivery system
US20060180007A1 (en) * 2005-01-05 2006-08-17 Mcclinsey Jason Music and audio composition system
WO2012014048A2 (en) * 2010-07-26 2012-02-02 Balea Musika Ideiak, S. L. Multimedia content management system
TWM484160U (en) * 2014-03-17 2014-08-11 Chung-Jung Hu Music score playback system and tools for education with virtual 3d animation performing musical instruments
CN104658529A (en) * 2015-02-11 2015-05-27 牟晓勇 Electronic music synthesis method and device
CN104967900A (en) * 2015-05-04 2015-10-07 腾讯科技(深圳)有限公司 Video generating method and video generating device
US20170366896A1 (en) * 2016-06-20 2017-12-21 Gopro, Inc. Associating Audio with Three-Dimensional Objects in Videos
CN108040497A (en) * 2015-06-03 2018-05-15 思妙公司 Content based on the performing artist's capture being distributed from strange land automatically generates the audio-video work of coordination

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0419796A (en) * 1990-05-15 1992-01-23 Brother Ind Ltd Musical sound generating device
TW386654U (en) * 1992-10-09 2000-04-01 Yamaha Corp With skip and repeat operation of orchestra assompanimentadditional application
JPH1185170A (en) * 1997-09-01 1999-03-30 Taito Corp Karaoke sing-along improvisation system
US20020007723A1 (en) * 1998-05-15 2002-01-24 Ludwig Lester F. Processing and generation of control signals for real-time control of music signal processing, mixing, video, and lighting
US5990405A (en) * 1998-07-08 1999-11-23 Gibson Guitar Corp. System and method for generating and controlling a simulated musical concert experience
CN1720670A (en) * 2002-12-06 2006-01-11 摩托罗拉公司 Multimedia editor for wireless communication devices and method therefor
US20060130635A1 (en) * 2004-12-17 2006-06-22 Rubang Gonzalo R Jr Synthesized music delivery system
US20060180007A1 (en) * 2005-01-05 2006-08-17 Mcclinsey Jason Music and audio composition system
WO2012014048A2 (en) * 2010-07-26 2012-02-02 Balea Musika Ideiak, S. L. Multimedia content management system
TWM484160U (en) * 2014-03-17 2014-08-11 Chung-Jung Hu Music score playback system and tools for education with virtual 3d animation performing musical instruments
CN104658529A (en) * 2015-02-11 2015-05-27 牟晓勇 Electronic music synthesis method and device
CN104967900A (en) * 2015-05-04 2015-10-07 腾讯科技(深圳)有限公司 Video generating method and video generating device
CN108040497A (en) * 2015-06-03 2018-05-15 思妙公司 Content based on the performing artist's capture being distributed from strange land automatically generates the audio-video work of coordination
US20170366896A1 (en) * 2016-06-20 2017-12-21 Gopro, Inc. Associating Audio with Three-Dimensional Objects in Videos

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109462776A (en) * 2018-11-29 2019-03-12 北京字节跳动网络技术有限公司 A kind of special video effect adding method, device, terminal device and storage medium
CN109462776B (en) * 2018-11-29 2021-08-20 北京字节跳动网络技术有限公司 Video special effect adding method and device, terminal equipment and storage medium
CN109256010A (en) * 2018-12-03 2019-01-22 上和弦(北京)音乐科技有限公司 A kind of music teaching demo system
CN110070849A (en) * 2019-03-22 2019-07-30 福建星网视易信息系统有限公司 Audio performance method and computer readable storage medium
CN113194382A (en) * 2021-04-29 2021-07-30 张壬招 Internal recording pickup, and remote synchronous ensemble method and device based on internal recording pickup
CN113286183A (en) * 2021-05-10 2021-08-20 小叶子(北京)科技有限公司 Method, device and equipment for synchronously displaying performance process and music score and storage medium
CN113286183B (en) * 2021-05-10 2022-11-01 小叶子(北京)科技有限公司 Method, device and equipment for synchronously displaying performance process and music score and storage medium

Similar Documents

Publication Publication Date Title
CN108766408A (en) A kind of electronic musical instrument ensemble system and method
CN108810436A (en) A kind of video recording method and system based on the He Zou of full-automatic musical instrument
US6184937B1 (en) Audio enhanced electronic insertion of indicia into video
JP4934580B2 (en) Video / audio recording apparatus and video / audio reproduction apparatus
CN108200445A (en) The virtual studio system and method for virtual image
US20080260184A1 (en) Virtual Recording Studio
CN101326582A (en) Recording device, reproducing device, recording and reproducing device, recording method, reproducing method, recording and reproducing method, and recording medium
CN114900733B (en) A video generation method, related device and storage medium
KR101873086B1 (en) Information system, information reproduction device, information generation method, and recording medium
CN108305308A (en) It performs under the line of virtual image system and method
TWI548277B (en) Method and assembly for improved audio signal presentation of sounds during a video recording
WO2021124680A1 (en) Information processing device and information processing method
CN110012264A (en) A kind of video handles synthesis system and method in real time
JP2008178090A (en) Video processing apparatus
CN109002275B (en) AR background audio processing method and device, AR equipment and readable storage medium
CN113596353B (en) Somatosensory interaction data processing method and device and somatosensory interaction equipment
JPH09247532A (en) Image synthesis method and its device
JP2008131379A (en) Distribution system and terminal device
WO2021014716A1 (en) Image processing device, image processing method, and program
JP5803956B2 (en) Karaoke system and karaoke device
JP5780258B2 (en) Portable terminal device, portable terminal program, server, and image browsing system
CN1719872A (en) Movie show entertainment system based on whole body fusion
JP2017092832A (en) Reproduction method and reproducer
JP2009100134A (en) Information processor and program
JP2009094701A (en) Information processing device and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
AD01 Patent right deemed abandoned
AD01 Patent right deemed abandoned

Effective date of abandoning: 20220909