CN108881803A - Audio-video inter-linked controlling method, system and audio-video linked system - Google Patents
Audio-video inter-linked controlling method, system and audio-video linked system Download PDFInfo
- Publication number
- CN108881803A CN108881803A CN201810822690.7A CN201810822690A CN108881803A CN 108881803 A CN108881803 A CN 108881803A CN 201810822690 A CN201810822690 A CN 201810822690A CN 108881803 A CN108881803 A CN 108881803A
- Authority
- CN
- China
- Prior art keywords
- microphone
- speech
- audio
- delay
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 52
- 238000004458 analytical method Methods 0.000 claims abstract description 11
- 230000003111 delayed effect Effects 0.000 claims description 11
- 230000009471 action Effects 0.000 claims description 4
- 238000005516 engineering process Methods 0.000 abstract description 3
- 239000011159 matrix material Substances 0.000 description 9
- 210000004209 hair Anatomy 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 230000000739 chaotic effect Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 238000004590 computer program Methods 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 241001310793 Podium Species 0.000 description 2
- 230000004913 activation Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 208000030979 Language Development disease Diseases 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000002035 prolonged effect Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000001755 vocal effect Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The present invention provides audio-video inter-linked controlling method, system and audio-video linked systems, are related to audio-video control technology field, including：It is arranged according to the triggering state of microphone and calls delay, is carried out picture position adjustment according to calling delay and controlling picture pick-up device by control instruction, determine a variety of audio-video linkage schemes；It records and the audio-frequency information of switch machine information and input of the Macro or mass analysis per microphone all the way, is made a speech and/or switching rule, and matched linkage scheme is generated according to speech and/or switching rule, or select matched linkage scheme in multiple audio-video linkage schemes.The present invention instructs control picture pick-up device to carry out the switching of picture position by detecting the triggering state of microphone by various control, can reduce the cost of audio-video linkage scheme, improve the accuracy of picture pick-up device call by location；Meanwhile automatically configuring by linkage scheme, person works' amount can be mitigated, improve user experience, expand use scope.
Description
Technical field
The present invention relates to audio-video control technology fields, link more particularly, to audio-video inter-linked controlling method, system and phonotape and videotape
System.
Background technique
Video conference can will be in each side of attending a meeting in strange land as a kind of efficient telecommunication tools coupled by network
It concentrates in together, realizes audio/video communication, data interaction, teleengineering support and assistance etc. is multimode exchanges.Video is solved at present
When meeting meeting-place is made a speech, the working method of adjust automatically camera preset position has：The intelligent instructor in broadcasting of polycom (Polycom) and
Microphone activates speaking podium two ways hand in hand.But intelligent instructor in broadcasting's equipment of polycom, a set of cost is 70,000 or more and only
It can be used in the video conferencing system of polycom brand, the mode of microphone activation 40,000 or more and can only also limit to hand in hand
In the second road camera of video conferencing system, and there are many agreement limitations.
Some large-scale meeting-place, a flower huge sum of money go by the way of microphone host hand in hand to realize audio-video linkage.Existing phonotape and videotape
Linked system is triggered to host for microphone, again from host to the process of camera transmission instruction, is all the side using " inverted order "
Formula；I.e.：The presetting bit that first microphone has been switched on, has just called camera to correspond to microphone by host in whole system, it is multiple when having
Microphone be already powered in the case where, which microphone is most post-opening, just calls the presetting bit of this microphone.If last booting
When cylinder shutdown, system just calls the presetting bit of secondary that last microphone, if this microphone just had been switched off, if look for backward
It is next, after all microphone shutdown, just return to the initial bit of camera.Moreover, microphone hand in hand, calling is all words
Cylinder host itself storage presetting bit, these presetting bits must with connected according to microphone host camera, system install
It is just kept when debugging, when presetting bit has variation in meeting or microphone position has variation, resetting must just be gone to lead by professional
The presetting bit data of machine, cumbersome, inefficiency.
Microphone presetting bit is called in a manner of inverted order, the user for needing to attend a meeting very cooperates the switch of microphone, than
It such as needs to have made a speech to open microphone again, once having said, just loses no time to close microphone, otherwise, camera is probably just always according to this
Spokesman；And the meeting of type is discussed if it is multi-party meter, it is necessary to strictly accomplish that " who, which will talk, just opens microphone, one has said and must close words
Cylinder ", this camera call the sequence of presetting bit just can be relatively more reasonable；And in some meeting, some leader finishes speaking, talks about
Cylinder does not close (or do not close microphone leave the table), and the calling of camera presetting bit will be very chaotic in entire meeting, and camera is just always
Initial bit will not be returned.Just always according to the position of this microphone not closed in very possible entire meeting.Before meeting if there is
Position is moved, microphone is transposed, that must just log in the modification presetting bit parameter that microphone host desynchronizes, and operate microphone host,
Needing certain professional technique ability just can be with being otherwise easy error leads to equipment damage.
As it can be seen that existing phonotape and videotape linkage implementation, that there are equipment costs is high, personnel are cumbersome, camera position tune
With chaotic problem.
Summary of the invention
In view of this, passing through the purpose of the present invention is to provide audio-video inter-linked controlling method, system and audio-video linked system
The triggering state of microphone is detected, and controls the switching of picture pick-up device picture position by control instruction, audio-video linkage can be reduced
The cost of scheme improves the accuracy of picture pick-up device call by location；Meanwhile automatically configuring by linkage scheme, it can mitigate
Person works' amount, improves user experience, expands use scope.
In a first aspect, the embodiment of the invention provides a kind of audio-video inter-linked controlling methods, wherein the method includes：
Setting steps：It is arranged according to the triggering state of microphone and calls delay, be delayed according to the calling and is referred to by control
It enables control picture pick-up device carry out picture position adjustment, determines a variety of audio-video linkage schemes；
Matching step：The audio-frequency information for recording simultaneously switch machine information and input of the Macro or mass analysis per microphone all the way, is sent out
Speech and/or switching rule, and matched linkage scheme is generated according to the speech and/or switching rule, or multiple described
Matched linkage scheme is selected in audio-video linkage scheme.
With reference to first aspect, the embodiment of the invention provides the first possible embodiments of first aspect, wherein institute
Stating calling delay includes booting delay, and the setting steps include：
When the triggering state of the microphone is booting, the booting delay is set, and when meeting booting delay,
The picture pick-up device, which is controlled, by the control instruction calls presetting bit corresponding to booting microphone.
With reference to first aspect, the embodiment of the invention provides second of possible embodiments of first aspect, wherein institute
Stating calling delay includes booting waiting delay, the first delay of speech, and the setting steps include：
When microphone is switched on and picture pick-up device is in presetting bit, the booting waiting delay is set, and detects and open described
Whether the audio input of booting microphone and other microphone is had in machine waiting delay；
It recalls to if it is not, controlling the picture pick-up device by the control instruction to zero presetting bit；
If so, then judging whether the time of audio input meets the first delay of the preset speech；
If it is satisfied, then being called by the control instruction control picture pick-up device corresponding preset to speech microphone
Position.
With reference to first aspect, the embodiment of the invention provides the third possible embodiments of first aspect, wherein institute
Stating setting steps includes：
When the triggering state of the microphone is persistently to make a speech, exclusive state is set by speech microphone.
With reference to first aspect, the embodiment of the invention provides the 4th kind of possible embodiments of first aspect, wherein institute
Stating calling delay includes that speech terminates delay, zero waiting delay, speech time delay, and the setting steps include：
At the end of the triggering state of the microphone is booting and makes a speech, the speech, which is arranged, terminates delay, and will be current
Microphone is set as exclusive state；
After the speech terminates delay time-out, the zero waiting delay is set, and current microphone is set as to rob
Floor status；
Judge whether there is booting microphone or the audio input of other microphones in the zero waiting delay；
It recalls to if it is not, controlling the picture pick-up device by the control instruction to zero presetting bit；
If so, then judging whether the time of audio input meets the preset speech time delay or the booting is prolonged
When；
If it is satisfied, then being called by the control instruction control picture pick-up device corresponding preset to speech microphone
Position.
With reference to first aspect, the embodiment of the invention provides the 5th kind of possible embodiments of first aspect, wherein institute
The method of stating further includes：
VIP microphone is set, in the case where having boot action or audio input in detecting the VIP microphone, by described
Control instruction controls the picture pick-up device and calls presetting bit corresponding to the VIP microphone.
With reference to first aspect, the embodiment of the invention provides the 6th kind of possible embodiments of first aspect, wherein states
Switching on and shutting down information includes：
Record is per the switching on and shutting down time of microphone, the switching on and shutting down frequency all the way, when speech corresponding with microphone booting is spaced, makes a speech
Between, speech number, obtain the switch machine information.
With reference to first aspect, the embodiment of the invention provides the 7th kind of possible embodiments of first aspect, wherein
In the matching step, the audio-frequency information includes：
The voice of microphone acquisition is subjected to Application on Voiceprint Recognition and content recognition, obtains the audio-frequency information.
Second aspect, the embodiment of the present invention also provide a kind of audio-video coordinated control system, wherein the system comprises：
Setting unit calls delay for being arranged according to the triggering state of microphone, is delayed according to the calling and passes through control
System instruction control picture pick-up device carries out picture position adjustment, determines a variety of audio-video linkage schemes；
Matching unit is obtained for recording the audio-frequency information of simultaneously switch machine information and input of the Macro or mass analysis per microphone all the way
Matched linkage scheme is generated to speech and/or switching rule, and according to the speech and/or switching rule, or multiple
Matched linkage scheme is selected in the phonotape and videotape linkage scheme.
The third aspect, the embodiment of the present invention also provide a kind of audio-video linked system, wherein including：By serial ports/485 mouthful/
Audio-video linkage controller that wireless network is attached, video conference terminal or it is other can controlled plant；
The phonotape and videotape linkage controller, for executing the as above any one audio-video inter-linked controlling method, and according to determination
Audio-video linkage scheme interacted with the video conference terminal.
The embodiment of the present invention brings following beneficial effect：
Phonotape and videotape inter-linked controlling method, system and audio-video linked system provided by the invention, including：According to the triggering shape of microphone
Delay is called in state setting, carries out picture position adjustment according to calling delay and controlling picture pick-up device by control instruction, determination is more
The audio-video linkage scheme of kind；The audio-frequency information for recording simultaneously switch machine information and input of the Macro or mass analysis per microphone all the way, is made a speech
And/or switching rule, and matched linkage scheme is generated according to speech and/or switching rule, or in multiple audio-video linkage sides
Matched linkage scheme is selected in case.The present invention is set by detecting the triggering state of microphone by control instruction control camera shooting
The switching that standby (or matrix etc. other can controlled plant) carries out picture position, can reduce the cost of audio-video linkage scheme, improve
The accuracy of picture pick-up device call by location；Meanwhile automatically configuring by linkage scheme, person works' amount can be mitigated, improved
User experience expands use scope.
Other features and advantages of the present invention will illustrate in the following description, also, partly become from specification
It obtains it is clear that understand through the implementation of the invention.The objectives and other advantages of the invention are in specification, claims
And specifically noted structure is achieved and obtained in attached drawing.
To enable the above objects, features and advantages of the present invention to be clearer and more comprehensible, preferred embodiment is cited below particularly, and cooperate
Appended attached drawing, is described in detail below.
Detailed description of the invention
It, below will be to specific in order to illustrate more clearly of the specific embodiment of the invention or technical solution in the prior art
Embodiment or attached drawing needed to be used in the description of the prior art be briefly described, it should be apparent that, it is described below
Attached drawing is some embodiments of the present invention, for those of ordinary skill in the art, before not making the creative labor
It puts, is also possible to obtain other drawings based on these drawings.
Fig. 1 is the audio-video inter-linked controlling method flow chart that the embodiment of the present invention one provides；
Fig. 2 is that the logical relation of phonotape and videotape linkage provided by Embodiment 2 of the present invention is intended to；
Fig. 3 is the audio-video coordinated control system schematic diagram that the embodiment of the present invention three provides；
Fig. 4 is the audio-video linked system schematic diagram that the embodiment of the present invention four provides.
Icon：
110- setting unit；120- matching unit；210- phonotape and videotape linkage controller；220- microphone；230- can controlled plant；
240- instruction sending device；250- sound equipment.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with attached drawing to the present invention
Technical solution be clearly and completely described, it is clear that described embodiments are some of the embodiments of the present invention, rather than
Whole embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art are not making creative work premise
Under every other embodiment obtained, shall fall within the protection scope of the present invention.
When solving video conference place speech at present, the working method of adjust automatically camera preset position has：polycom
The intelligent instructor in broadcasting of (Polycom) and hand in hand microphone activate speaking podium two ways.But intelligent instructor in broadcasting's equipment of polycom, it is a set of
Cost 70,000 or more and the video conferencing system of polycom brand can only be used in, the mode of microphone activation hand in hand
40,000 or more and it can only be confined to the second road camera of video conferencing system, and there are many agreement limitations.
Some large-scale meeting-place, a flower huge sum of money go by the way of microphone host hand in hand to realize audio-video linkage.Existing phonotape and videotape
Linked system is triggered to host for microphone, again from host to the process of camera transmission instruction, is all the side using " inverted order "
Formula.Microphone presetting bit is called in a manner of inverted order, the user for needing to attend a meeting very cooperates the switch of microphone, for example needs
It has made a speech and has opened microphone again, once having said, just lost no time to close microphone, otherwise, camera is probably just always according to the spokesman；
And the meeting of type is discussed if it is multi-party meter, it is necessary to strictly accomplish " who to talk just open microphone, one said must close microphone ", this
Camera calls the sequence of presetting bit just can be relatively more reasonable；And in some meeting, some leader finishes speaking, microphone does not have pass,
The calling of camera presetting bit will be very chaotic in entire meeting, and camera will not just return to always initial bit.It is very possible whole
Just always according to the position of this microphone not closed in a meeting.Moreover, microphone hand in hand, calling is all microphone host itself
Storage presetting bit, these presetting bits must with connected according to microphone host camera, just deposit in system installation and debugging
Alright, when presetting bit has variation in meeting or microphone position has variation, the presetting bit of resetting host must be just gone by professional
Data, cumbersome, inefficiency.
As it can be seen that existing phonotape and videotape linkage implementation, that there are equipment costs is high, personnel are cumbersome, camera position tune
With chaotic problem, the problems such as presetting bit is inconvenient is modified.
Based on this, phonotape and videotape inter-linked controlling method, system and audio-video linked system provided in an embodiment of the present invention pass through detection
The triggering state of microphone, and by the switching of control instruction control picture pick-up device picture position, audio-video linkage scheme can be reduced
Cost, improve picture pick-up device call by location accuracy；Meanwhile automatically configuring by linkage scheme, personnel can be mitigated
Workload improves user experience, expands use scope.
For convenient for understanding the present embodiment, first to audio-video inter-linked controlling method disclosed in the embodiment of the present invention into
Row is discussed in detail.
Embodiment one：
Fig. 1 is the audio-video inter-linked controlling method flow chart that the embodiment of the present invention one provides.
Referring to Fig.1, audio-video inter-linked controlling method mainly includes：
Setting steps S110：It is arranged according to the triggering state of microphone and calls delay, be delayed according to calling and is referred to by control
It enables control picture pick-up device carry out picture position adjustment, determines a variety of audio-video linkage schemes；
Specifically, the delays of a variety of calling are arranged according to triggering states such as the switching on and shutting down of microphone, speeches, in conjunction with it is infrared,
The various controls such as RS232, RS485, datnet instruction control picture pick-up device (or matrix etc. other can controlled plant) carries out picture
Position adjustment, and then determine a variety of audio-video linkage schemes.In addition, if picture pick-up device, which is plugged into, matrix or other controlled plants
, then, matrix or other controlled plants will also synchronize according to control instruction and switch over adjustment.
Matching step S120：The audio-frequency information for recording simultaneously switch machine information and input of the Macro or mass analysis per microphone all the way, obtains
Matched linkage scheme is generated to speech and/or switching rule, and according to speech and/or switching rule, or in multiple phonotape and videotapes
Matched linkage scheme is selected in linkage scheme.
Embodiment two：
Fig. 2 is setting steps schematic diagram provided by Embodiment 2 of the present invention.
Referring to Fig. 2, in audio-video inter-linked controlling method setting steps S110 in specific implementation, confirmable phonotape and videotape linkage
Scheme has following a variety of.
The first linkage scheme：When the triggering state of microphone is booting, setting booting delay (such as 0-2 seconds), and when full
When foot booting delay, picture pick-up device is controlled by control instruction and calls presetting bit corresponding to booting microphone.
Specifically, user's microphone booting after be arranged booting delay, be in order to cooperate the identification of people's sound/bat microphone sound, with
And the certain people of cooperation have the habit for first opening microphone, arranging the text of a statement or speech again, finally just making a speech；Picture pick-up device delay calls its preset
Position, the picture that can be dragged one's heels according to this spokesman always to avoid picture pick-up device reduce invalid shooting.
Second of linkage scheme：When microphone is switched on and picture pick-up device is in presetting bit, setting booting waiting delay (such as 0-
5 seconds), and the audio input for whether having other microphones in the booting microphone and video conference in booting waiting delay detected.
If that is, spokesman talks without microphone during this period without audio input, then taken the photograph by control instruction control
As equipment is recalled to zero presetting bit.The program can prevent some users from having opened microphone but without being eager to talk or is basic
It is not desired to talk, and causes picture pick-up device always according to his feature.
In addition, being at this time " floor status can be robbed ", during the waiting delay that is switched on, if other microphone has audio signal defeated
Enter, then controls picture pick-up device transfer shooting picture, the third as following linkage scheme：
If there is audio input, then judge whether the time of audio input meets the first delay of preset speech (such as at least
It is 1 second)；And in the case where satisfaction, it is believed that speech effectively, controls picture pick-up device by control instruction and calls to speech microphone pair
The presetting bit answered.Second and third kind linkage scheme main function be：One, identify whether this speech is effective；Two, there is " hosting
In the meeting of people ", when voice " the announcing the items on a programme " that host only has several seconds, the setting that this speech head can be delayed is longer, skips
The speech of " announcing the items on a programme " formula of host.
4th kind of linkage scheme：When the triggering state of microphone is persistently to make a speech, exclusive state is set by speech microphone；
At this point, picture pick-up device will be fixed at the presetting bit of the microphone, it is in exclusive state.
But in the case where being provided with VIP (Very Important Person advanced level user) microphone, VIP microphone
When having boot action or having audio input, other speech microphones are regardless of whether in exclusive state all by failure, picture pick-up device
It will call to the presetting bit of VIP microphone, that is to say, that VIP microphone all has highest priority at any time.
5th kind of linkage scheme：When the triggering state of microphone is booting and speech is over, speech is over can
To be that speech pause, termination etc. are any in real time without the state of speech, setting speech terminates to be delayed (such as 1-2 seconds), and will be current
Microphone is set as exclusive state；Speech terminates delay for waiting the user to continue to make a speech, other microphones can not rob speech.The party
Case can to avoid some human hairs say during the dead time is longer, drink water halfway when, cause to image because microphone does not have audio input
Equipment recalls to clean state.
6th kind of linkage scheme：After speech terminates delay time-out, setting zero waiting delay, and current microphone is arranged
For floor status can be robbed；Judge whether there is the booting microphone or the audio input of other microphones in zero waiting delay；And
Without in the case where, picture pick-up device is controlled by control instruction and is recalled to zero presetting bit；And in other instances, pass through
Control instruction control picture pick-up device calls presetting bit corresponding to speech microphone, and speech microphone here includes being in floor status
Any microphone, including above-mentioned booting microphone and other microphones.
5th, six kind of linkage scheme is combined, can both meet some spokesmans during the speech the dead time it is longer and
The case where keeping camera position, and it is avoided that some spokesmans speech terminates but there is not when the microphone of pass, other spokesmans have hair
Say camera without the embarrassment to turn round.In the meeting for having multidigit spokesman's discussion type, play a significant role：Multiple words
Simultaneously in the on state, as long as there is microphone making a speech, picture pick-up device will turn the presetting bit of this speech microphone to cylinder quickly, i.e.,
Accomplish " having its sound, just according to its people "；And when this person stops speech, another one spokesman connects, only needed to wait for a upper microphone
" speech terminate delay " after, picture pick-up device will turn upper new speech microphone, and so on, in entire conference process, camera shooting
The microphone that equipment can and then make a speech, ceaselessly rotates.If " speech terminates delay " the setting time is shorter, multiple-microphone is preset
Position conversion will more flexible, speed faster.The association schemes solve existing microphone hand in hand, with the microphone being finally switched on
It is preset for camera, if to realize the conversion of multiple-microphone presetting bit, the problem of can only ceaselessly switching microphone.
7th kind of linkage scheme, can also be into one in the case where there is the audio input of other microphones based on previous scheme
The setting speech time delay of step；I.e.：In the case where there is the audio input of other microphones, judge whether the time of audio input is full
The preset speech time delay of foot or the booting of microphone delay；And in the case where satisfaction, picture pick-up device is controlled by control instruction
Call presetting bit corresponding to speech microphone.Speech time delay is generally often identical with the first delay of speech, and first delay of making a speech is
First time speech after microphone booting starts the delay made a speech after mainly robbing " booting waiting delay "；And time delay of making a speech,
Refer to and rob speech when other microphones, which are in, terminates zero waiting delay, the function of the two is similar, is for pair
It makes an extemporaneous speech in short period (1 second), judgement is wanted to call picture pick-up device, calls chaotic situation to occur to reduce, improves
Call accuracy validity.
Further, audio-video inter-linked controlling method can also include：
VIP microphone is set, in the case where having boot action or audio input in detecting VIP microphone, passes through control instruction
Control picture pick-up device calls presetting bit corresponding to VIP microphone.VIP microphone has highest preferential compared to other microphones
Grade, it is preferential to call picture pick-up device that shooting picture is switched to the preset of VIP microphone when VIP microphone is switched on or has audio input
Position.After VIP microphone works, end delay, zero waiting delay after speech etc. are all excellent with other non-VIP microphones
First grade is identical.
A variety of audio-video linkage schemes of above-mentioned offer can in any combination, to adapt to various conference models.It is various
Phonotape and videotape linkage logical relation, can refer to Fig. 2 under conference model.For example, pure training or report meeting：Only one whole hair of meeting
Say people, in this case, as soon as spokesman's microphone is opened, picture pick-up device is adjusted to the corresponding presetting bit of spokesman's microphone, until
Speech terminates.Midway is if there is interruption, and no matter whether spokesman closes microphone, after " terminating zero waiting delay ", camera shooting
Equipment will recall to zero-bit automatically；And spokesman is when making a speech again, after having crossed " secondary speech delay ", picture pick-up device will be transferred to speech
In the presetting bit of person.Whole process, spokesman or distal end participant can mitigate without being concerned about or operating finding a view for camera
Person works' amount, improves user experience.
Also for example, the meeting of discussion type：One meeting-place has multiple spokesman to participate in discussion, and each microphone can be kept on all
, each microphone may all have audio signal to input at any time.At this point, " speech terminates delay " and " terminating zero waiting delay "
Combine, as long as previous position spokesman has said, terminate in " speech terminate delay " one, have new spokesman rob words, camera shooting sets
It is standby to turn round quickly；If never other spokesmans rob words (and microphone do not close), camera has been crossed " terminates
It can self-zeroing position after zero waiting delay ".And at this point, if being provided with VIP microphone, as long as the booting of VIP microphone or having audio
Input, regardless of the state of other microphones or the state of picture pick-up device, picture pick-up device all can directly be transferred to VIP microphone here
Come；To embody the priority of VIP microphone.
In addition, the above logical relation of various triggerings or the length of time of delay, it can be that is, electric by upper computer software
Brain end is adjusted and/or customized.
Further, in audio-video inter-linked controlling method the switch machine information of matching step S120 in specific obtain, including：
Record is per the switching on and shutting down time of microphone, the switching on and shutting down frequency all the way, speech corresponding with microphone booting interval, time limit of speech, speech
Number obtains switch machine information.
Specifically, corresponding with microphone booting speech interval refers to, from microphone open to have audio input interval time,
From speech is stopped to the interval time for closing microphone；Time limit of speech refers to, continues time limit of speech；Speech number refers to, multiple
It opens in microphone, corresponding speech number and number of not making a speech, also with good grounds spokesman's volume is estimated that this speech
Mouth is accustomed to a distance from microphone when human hair is sayed.Above-mentioned switch machine information can react the speech habit of a people, to switching on and shutting down
Information carries out Macro or mass analysis, can predict and act in next step.
And in audio-video inter-linked controlling method matching step S120 audio-frequency information in specific obtain, including：By microphone
The voice of acquisition carries out Application on Voiceprint Recognition and content recognition, obtains audio-frequency information.
Specifically, the voice of acquisition is divided into multiple keywords, keyword is word or segment words, then keyword is defeated
Enter into preset speech database and carry out the comparison and retrieval of vocal print, content, and then obtains the audio that spokesman's identity determines
Information.
In addition, during acquiring audio-frequency information, by mike gain is tuned up or is turned down to wave volume size into
Row is adjusted, to collect apparent effective audio-frequency information.
Embodiment three：
Fig. 3 is the audio-video coordinated control system schematic diagram that the embodiment of the present invention three provides.
A kind of audio-video coordinated control system is present embodiments provided, is linked for realizing phonotape and videotape provided by above-described embodiment
Control method.Referring to Fig. 3, audio-video coordinated control system mainly includes：
Setting unit 110 calls delay for being arranged according to the triggering state of microphone, is delayed according to calling and passes through control
Instruction control picture pick-up device carries out picture position adjustment, determines a variety of audio-video linkage schemes；
Matching unit 120, for recording the audio-frequency information of simultaneously switch machine information and input of the Macro or mass analysis per microphone all the way,
It is made a speech and/or switching rule, and matched linkage scheme is generated according to speech and/or switching rule, or in multiple sounds
As selecting matched linkage scheme in linkage scheme.
Example IV：
Fig. 4 is the audio-video linked system schematic diagram that the embodiment of the present invention four provides.
In order to realize provided by above-described embodiment with audio-video inter-linked controlling method, need to transfer video conference terminal camera shooting
The function of equipment, plurality of devices corresponding with video conference terminal interconnect.
Audio-video inter-linked controlling method and audio-video coordinated control system provided by based on the above embodiment, the present embodiment provides
Audio-video linked system.Referring to Fig. 4, audio-video linked system mainly includes：It is attached by serial ports/485 mouthful/wireless network etc.
Audio-video linkage controller 210, video conference terminal；Audio-video linkage controller 210, for executing above-mentioned audio-video linkage control
Method, and interacted according to determining audio-video linkage scheme with video conference terminal.
Video conference terminal include the microphone 220 being connected with audio-video linkage controller 210, can controlled plant 230 (such as
Minutes equipment, picture pick-up device or matrix device), instruction sending device 240 (such as infrared launcher), sound equipment 250 etc.
Deng.
Microphone 220 be it is multiple, for inputting the various audio-frequency informations at meeting scene；
Audio-video linkage controller 210, for being carried out at analysis according to the triggering state of microphone 220, the audio-frequency information of acquisition
Reason determines phonotape and videotape linkage scheme, and audio-video linkage scheme is sent to instruction sending device 240；
Instruction sending device 240 is the signals transmitting and receiving apparatus such as RS232/485/Zigbb, with matrix, central control system
Etc. it is other can controlled plant 230 interconnect；For according to audio-video linkage scheme and using the modes such as infrared, wired or wireless
To can controlled plant 230 send control instruction；
Can controlled plant 230, for according to control instruction carry out picture position adjustment.
Specifically, can controlled plant 230, can be audio and video matrix, camera is preset in the environment of more picture pick-up devices
Position and the input/output state of matrix synchronize operation；It is also possible to the acceptable audio-video linkage controller output such as middle control host
Control signal and the equipment that executes instruction.
Sound equipment 250, for exporting the speech in meeting.
Further, phonotape and videotape linked system provided by the present embodiment can more cascade or be together in series, form one
Bigger system, the input of realization more multiple-microphone and more input/output ports.
The embodiment of the present invention brings following beneficial effect：
Phonotape and videotape inter-linked controlling method, system and audio-video linked system provided by the invention, including：According to the triggering shape of microphone
Delay is called in state setting, carries out picture position adjustment according to calling delay and controlling picture pick-up device by control instruction, determination is more
The audio-video linkage scheme of kind；The audio-frequency information for recording simultaneously switch machine information and input of the Macro or mass analysis per microphone all the way, is made a speech
And/or switching rule, and matched linkage scheme is generated according to speech and/or switching rule, or in multiple audio-video linkage sides
Matched linkage scheme is selected in case.The present invention is set by detecting the triggering state of microphone by control instruction control camera shooting
The switching that standby (or matrix etc. other can controlled plant) carries out picture position, can reduce the cost of audio-video linkage scheme, improve
The accuracy of picture pick-up device call by location；Meanwhile automatically configuring by linkage scheme, person works' amount can be mitigated, improved
User experience expands use scope.
The technical effect and preceding method embodiment phase of system provided by the embodiment of the present invention, realization principle and generation
Together, to briefly describe, system embodiment part does not refer to place, can refer to corresponding contents in preceding method embodiment.
The embodiment of the present invention also provides a kind of electronic equipment, including memory, processor, and being stored in memory can locate
The computer program run on reason device, processor realize audio-video linkage control provided by the above embodiment when executing computer program
The step of method.
The embodiment of the present invention also provides a kind of computer readable storage medium, and meter is stored on computer readable storage medium
Calculation machine program, the step of audio-video inter-linked controlling method of above-described embodiment is executed when computer program is run by processor.
In addition, in the description of the embodiment of the present invention unless specifically defined or limited otherwise, term " installation ", " phase
Even ", " connection " shall be understood in a broad sense, for example, it may be being fixedly connected, may be a detachable connection, or be integrally connected；It can
To be mechanical connection, it is also possible to be electrically connected；It can be directly connected, can also can be indirectly connected through an intermediary
Connection inside two elements.For the ordinary skill in the art, above-mentioned term can be understood at this with concrete condition
Concrete meaning in invention.
In the description of the present invention, it should be noted that term " center ", "upper", "lower", "left", "right", "vertical",
The orientation or positional relationship of the instructions such as "horizontal", "inner", "outside" be based on the orientation or positional relationship shown in the drawings, merely to
Convenient for description the present invention and simplify description, rather than the device or element of indication or suggestion meaning must have a particular orientation,
It is constructed and operated in a specific orientation, therefore is not considered as limiting the invention.Likewise, mentioned in the present invention " open
In the terms such as machine delay ", " speech terminates delay ", corresponding " booting ", " delay " are also only for description purpose, such as
" booting ", can be the booting of microphone, voice-activated, or other means to the signal of system trigger, " delay " only describes one
A concept of time can be referred to as " waiting ", " interruption " or " putting off " etc., it is relatively important to should not be understood as indication or suggestion
Property；In addition, term " first ", " second ", " third " are used for description purposes only, it is relatively important indication or suggestion can not to be interpreted as
Property.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description,
The specific work process of device and unit, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
In several embodiments provided herein, it should be understood that disclosed systems, devices and methods, it can be with
It realizes by another way.The apparatus embodiments described above are merely exemplary, for example, the division of unit, only
For a kind of logical function partition, there may be another division manner in actual implementation, in another example, multiple units or components can be tied
Another system is closed or is desirably integrated into, or some features can be ignored or not executed.Another point, it is shown or discussed
Mutual coupling, direct-coupling or communication connection can be the INDIRECT COUPLING by some communication interfaces, device or unit
Or communication connection, it can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple
In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme
's.
It, can also be in addition, the functional units in various embodiments of the present invention may be integrated into one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.
It, can be with if the function is realized in the form of SFU software functional unit and when sold or used as an independent product
It is stored in the executable non-volatile computer-readable storage medium of a processor.Based on this understanding, of the invention
Technical solution substantially the part of the part that contributes to existing technology or the technical solution can be with software in other words
The form of product embodies, which is stored in a storage medium, including some instructions use so that
A set of embedded system or a computer equipment (can be personal computer, server or the network equipment etc.) execute this hair
The all or part of the steps of bright each embodiment the method.And storage medium above-mentioned includes：USB flash disk, read-only is deposited mobile hard disk
Reservoir (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or
The various media that can store program code such as CD.
Finally it should be noted that：Embodiment described above, only a specific embodiment of the invention, to illustrate the present invention
Technical solution, rather than its limitations, scope of protection of the present invention is not limited thereto, although with reference to the foregoing embodiments to this hair
It is bright to be described in detail, those skilled in the art should understand that：Anyone skilled in the art
In the technical scope disclosed by the present invention, it can still modify to technical solution documented by previous embodiment or can be light
It is readily conceivable that variation or equivalent replacement of some of the technical features；And these modifications, variation or replacement, do not make
The essence of corresponding technical solution is detached from the spirit and scope of technical solution of the embodiment of the present invention, should all cover in protection of the invention
Within the scope of.Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (10)
1. a kind of phonotape and videotape inter-linked controlling method, which is characterized in that the method includes：
Setting steps：It is arranged according to the triggering state of microphone and calls delay, be delayed according to the calling and passes through control instruction control
Picture pick-up device processed carries out picture position adjustment, determines a variety of audio-video linkage schemes；
Matching step：Record and the audio-frequency information of switch machine information and input of the Macro or mass analysis per microphone all the way, obtain speech and/
Or switching rule, and matched linkage scheme is generated according to the speech and/or switching rule, or in multiple phonotape and videotape connection
Matched linkage scheme is selected in dynamic scheme.
2. the setting walks the method according to claim 1, wherein calling delay includes booting delay
Suddenly include：
When the triggering state of the microphone is booting, the booting delay is set, and when meeting booting delay, is passed through
The control instruction controls the picture pick-up device and calls presetting bit corresponding to booting microphone.
3. according to the method described in claim 2, it is characterized in that, calling delay includes booting waiting delay, speech head
Delay, the setting steps include：
When microphone is switched on and picture pick-up device is in presetting bit, the booting waiting delay is set, and is detected in described booting etc.
Wait whether there is the audio input of booting microphone and other microphones in being delayed；
It recalls to if it is not, controlling the picture pick-up device by the control instruction to zero presetting bit；
If so, then judging whether the time of audio input meets the first delay of the preset speech；
If it is satisfied, then controlling the picture pick-up device by the control instruction calls presetting bit corresponding to speech microphone.
4. according to the method described in claim 3, it is characterized in that, the setting steps include：
When the triggering state of the microphone is persistently to make a speech, exclusive state is set by speech microphone.
5. according to the method described in claim 4, it is characterized in that, calling delay includes that speech terminates delay, zero etc.
Wait time delay that is delayed, makes a speech, the setting steps include：
At the end of the triggering state of the microphone is booting and makes a speech, the speech, which is arranged, to be terminated to be delayed, and by current microphone
It is set as exclusive state；
After the speech terminates delay time-out, the zero waiting delay is set, and sets current microphone to rob speech
State；
Judge whether there is booting microphone or the audio input of other microphones in the zero waiting delay；
It recalls to if it is not, controlling the picture pick-up device by the control instruction to zero presetting bit；
If so, then judging whether the time of audio input meets the preset speech time delay or booting delay；
If it is satisfied, then controlling the picture pick-up device by the control instruction calls presetting bit corresponding to speech microphone.
6. the method according to claim 1, wherein the method also includes：
VIP microphone is set, in the case where having boot action or audio input in detecting the VIP microphone, passes through the control
Instruction controls the picture pick-up device and calls presetting bit corresponding to the VIP microphone.
7. the method according to claim 1, wherein in the matching step, the switching on and shutting down information includes：
Record per the switching on and shutting down time of microphone, the switching on and shutting down frequency all the way, speech corresponding with microphone booting interval, time limit of speech,
Speech number, obtains the switch machine information.
8. the method according to claim 1, wherein in the matching step, the audio-frequency information includes：
The voice of microphone acquisition is subjected to Application on Voiceprint Recognition and content recognition, obtains the audio-frequency information.
9. a kind of phonotape and videotape coordinated control system, which is characterized in that the system comprises：
Setting unit calls delay for being arranged according to the triggering state of microphone, is delayed according to the calling and is referred to by control
It enables control picture pick-up device carry out picture position adjustment, determines a variety of audio-video linkage schemes；
Matching unit is sent out for recording the audio-frequency information of simultaneously switch machine information and input of the Macro or mass analysis per microphone all the way
Speech and/or switching rule, and matched linkage scheme is generated according to the speech and/or switching rule, or multiple described
Matched linkage scheme is selected in audio-video linkage scheme.
10. a kind of phonotape and videotape linked system, which is characterized in that including：The phonotape and videotape being attached by serial ports/485 mouthful/wireless network
Linkage controller, video conference terminal；
The phonotape and videotape linkage controller, for executing the audio-video inter-linked controlling method as described in any one of claim 1~8, and root
It is interacted according to determining audio-video linkage scheme with the video conference terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810822690.7A CN108881803A (en) | 2018-07-24 | 2018-07-24 | Audio-video inter-linked controlling method, system and audio-video linked system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810822690.7A CN108881803A (en) | 2018-07-24 | 2018-07-24 | Audio-video inter-linked controlling method, system and audio-video linked system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108881803A true CN108881803A (en) | 2018-11-23 |
Family
ID=64305153
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810822690.7A Pending CN108881803A (en) | 2018-07-24 | 2018-07-24 | Audio-video inter-linked controlling method, system and audio-video linked system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108881803A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112866624A (en) * | 2021-04-26 | 2021-05-28 | 浙江华创视讯科技有限公司 | Video conference type determining method and device, electronic equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102256098A (en) * | 2010-05-18 | 2011-11-23 | 宝利通公司 | Videoconferencing endpoint having multiple voice-tracking cameras |
| US20160134838A1 (en) * | 2014-11-06 | 2016-05-12 | Cisco Technology, Inc. | Automatic Switching Between Dynamic and Preset Camera Views in a Video Conference Endpoint |
| CN107027004A (en) * | 2017-05-26 | 2017-08-08 | 上海启诺信息科技有限公司 | Phonotape and videotape linkage microphone host |
| CN107580192A (en) * | 2017-09-15 | 2018-01-12 | 上海启诺信息科技有限公司 | Audio-video linkage control device and audio-video linked system |
| CN108063910A (en) * | 2013-08-01 | 2018-05-22 | 波利康公司 | For the camera base and its method in video conferencing system |
-
2018
- 2018-07-24 CN CN201810822690.7A patent/CN108881803A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102256098A (en) * | 2010-05-18 | 2011-11-23 | 宝利通公司 | Videoconferencing endpoint having multiple voice-tracking cameras |
| CN108063910A (en) * | 2013-08-01 | 2018-05-22 | 波利康公司 | For the camera base and its method in video conferencing system |
| US20160134838A1 (en) * | 2014-11-06 | 2016-05-12 | Cisco Technology, Inc. | Automatic Switching Between Dynamic and Preset Camera Views in a Video Conference Endpoint |
| CN107027004A (en) * | 2017-05-26 | 2017-08-08 | 上海启诺信息科技有限公司 | Phonotape and videotape linkage microphone host |
| CN107580192A (en) * | 2017-09-15 | 2018-01-12 | 上海启诺信息科技有限公司 | Audio-video linkage control device and audio-video linked system |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112866624A (en) * | 2021-04-26 | 2021-05-28 | 浙江华创视讯科技有限公司 | Video conference type determining method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11445145B2 (en) | Method and device for controlling camera shooting, smart device and computer storage medium | |
| CN109068087B (en) | Intelligent Conference Projection System | |
| TWI703473B (en) | Programmable intelligent agent for human-chatbot communication | |
| CN109509471A (en) | A method of the dialogue of intelligent sound robot is interrupted based on vad algorithm | |
| CN109637548A (en) | Voice interactive method and device based on Application on Voiceprint Recognition | |
| CN108154579A (en) | A kind of intelligent access control system and exchange method that can be interacted with visitor | |
| US20120293599A1 (en) | Meeting room participant recogniser | |
| US9641801B2 (en) | Method, apparatus, and system for presenting communication information in video communication | |
| EP4054111B1 (en) | Method for switching between man-machine dialogue modes | |
| EP3703362B1 (en) | Electronic doorbell system with camera selection | |
| CN110010125A (en) | Control method and device of intelligent robot, terminal equipment and medium | |
| CN107295149A (en) | A kind for the treatment of method and apparatus of strange phone | |
| WO2016192622A1 (en) | Control method for smart terminal/mobile phone | |
| CN103873661B (en) | State switching method and electronic equipment | |
| CN108881803A (en) | Audio-video inter-linked controlling method, system and audio-video linked system | |
| US20150256794A1 (en) | Information processing apparatus, information processing method and information processing program | |
| CN111916077B (en) | Voice control method and equipment | |
| CN109889927A (en) | Intercom method, apparatus and indoor unit in intercom system | |
| CN112837689B (en) | Conference system, data communication system, and voice information processing method | |
| CN109119075A (en) | Speech recognition scene awakening method and device | |
| CN109117737A (en) | Control method, device and the storage medium of hand washing machine | |
| CN119360317A (en) | Interaction method based on artificial intelligence device, server and artificial intelligence device | |
| WO2025061021A1 (en) | Video conference polling operation method and apparatus, and electronic device and storage medium | |
| CN206480064U (en) | A kind of Yunmen access control system | |
| CN106657630A (en) | Method and system for capturing screen by utilizing blink |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181123 |
|
| RJ01 | Rejection of invention patent application after publication |