CN102118523A - Mixing control method for centralized teleconference - Google Patents
Mixing control method for centralized teleconference Download PDFInfo
- Publication number
- CN102118523A CN102118523A CN2009102445526A CN200910244552A CN102118523A CN 102118523 A CN102118523 A CN 102118523A CN 2009102445526 A CN2009102445526 A CN 2009102445526A CN 200910244552 A CN200910244552 A CN 200910244552A CN 102118523 A CN102118523 A CN 102118523A
- Authority
- CN
- China
- Prior art keywords
- audio mixing
- conference terminal
- mixing
- module
- request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000002156 mixing Methods 0.000 title claims abstract description 137
- 238000000034 method Methods 0.000 title claims abstract description 26
- 230000011664 signaling Effects 0.000 claims description 16
- 206010048669 Terminal state Diseases 0.000 claims description 6
- 230000005540 biological transmission Effects 0.000 claims description 4
- 239000013643 reference control Substances 0.000 abstract 1
- 238000006243 chemical reaction Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012913 prioritisation Methods 0.000 description 1
Images
Landscapes
- Telephonic Communication Services (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a mixing control method for a centralized teleconference. The method is implemented based on a reference control server and a mixing server, wherein the mixing server consists of a mixing control module and a media mixing module. The method comprises the following steps of: causing conference terminals initially participating in the teleconference to enter a muted state; when the conference terminal is required to speak, making a request for entering a speaking state to the mixing control module, and bidirectionally transmitting a media stream to the media mixing module after the request is allowed; and when the conference terminal is not required to speak, making the request for entering the muted state to the mixing control module, and stopping transmitting the media stream to the media mixing module and only receiving a one-way media stream from the media mixing module after the request is allowed. In the mixing control method provided by the invention, a partial muting way is adopted so as to relieve the pressure of network uploading on a bandwidth and simultaneously reduce the media processing pressure of the mixing server.
Description
Technical field
The present invention relates to a kind of mixing control method that is used for centralized conference call, belong to the videoconference technical field.
Background technology
Centralized conference call has the advantages that signaling centralized control, medium focus on for meeting models such as multi-cast conferencing, full distributed meeting, also be most widely used a kind of videoconference model therefore.The advantage of centralized conference call is that all meeting control and medium are handled and all concentrated on conference control server and the audio mixing server, and less demanding to conference terminal.Common conference terminal can identify oneself with in the videoconference, does not need extra session control function and sound mixing function.The easier like this environment of building videoconference, but simultaneously also to the disposal ability of conference control server and audio mixing server and the communication bandwidth requirement to some extent of server end.
In general, adopt the TeleConference Bridge of centralized conference call model to have the following technical problem of needing solution badly:
(1) the audio mixing workload is big
For each conference terminal, the medium that the audio mixing server all needs other conference terminal is sended over carry out audio mixing, send to this conference terminal again, so the audio mixing workload is quite big.
(2) the encoding and decoding speech workload is big
For a plurality of conference terminals, conference control server need use different encoding and decoding speechs, and corresponding conversion work amount is big.
(3) bandwidth occupancy is big
Because it is each conference terminal all needs to send corresponding Media Stream, therefore also bigger to taking of bandwidth.
In number of patent application is 200510034524.3 Chinese invention patent application, a kind of telephone conference voice mixing method has been proposed, may further comprise the steps: A. sets a set time section, calculate the time domain energy of each participant side in the set time section, it is the most generous and inferior generous that judgement draws interior sound of each time period; B. in current slot, the most generous and inferior generous audio mixing that carries out of sound according to a last time period obtains the first audio mixing data, and according to the most generous and inferior generous audio mixing that carries out of the sound of current slot, obtains the second audio mixing data; C. the set time section is divided into two intervals, peace skating area, audio mixing district; In the audio mixing district of current slot, the audio mixing result is the first audio mixing data or the second audio mixing data; And in the level and smooth district of current slot, the first audio mixing data are dull in time to descend, and the second audio mixing data are dull in time to be increased, and the audio mixing result is formed by stacking by the first and second audio mixing data.Adopt this method, different audio mixing data of adjacent time period can smooth excessiveness, has improved the audio mixing effect.
But above-mentioned telephone conference voice mixing method also fails to solve the big technical problem of audio mixing workload that centralized conference call system faces.
Summary of the invention
Technical problem to be solved by this invention is to provide a kind of mixing control method that is used for centralized conference call.This method can realize the optimization of fairly large centralized conference call on medium are handled and transmitted.
For realizing above-mentioned goal of the invention, the present invention adopts following technical scheme:
A kind of mixing control method that is used for centralized conference call, realize that based on conference control server and audio mixing server described audio mixing server is made up of audio mixing control module and medium audio mixing module, it is characterized in that:
At first make the conference terminal of initial adding videoconference all be in mute state;
When described conference terminal need be made a speech, enter floor status to the request of described audio mixing control module, after request was passed through, it was the signaling of floor status that described audio mixing control module sends switching conference terminal state to described conference terminal; Described conference terminal becomes floor status after receiving signaling, and to the two-way transmission Media Stream of described medium audio mixing module, described medium audio mixing module is carried out the audio mixing processing to the Media Stream of described conference terminal, and sends to other conference terminals of participating in videoconference;
When described conference terminal does not need to make a speech, enter mute state to the request of described audio mixing control module, after request was passed through, it was the signaling of mute state that described audio mixing control module sends switching conference terminal state to described conference terminal; Described conference terminal becomes mute state after receiving signaling, stops to send Media Stream to described medium audio mixing module, receives only the one-way media stream from described medium audio mixing module.
Mixing control method provided by the present invention has following characteristics:
(1) utilizes the quiet mode of part, alleviated network and uploaded pressure bandwidth;
(2) all provide meeting control and medium processing capacity, do not need conference terminal to do any modification by conference control server and audio mixing server;
(3) the audio mixing scheme of process optimization has reduced the medium processing pressure of audio mixing server.
Description of drawings
The present invention is further illustrated below in conjunction with the drawings and specific embodiments.
Fig. 1 is in this mixing control method, the logical flow chart of conference terminal request speech;
Fig. 2 is in this mixing control method, the logical flow chart that the conference terminal request is quiet.
Embodiment
In centralized conference call, the main effect of audio mixing server is to set up unidirectional or two-way media channel with all conference terminals, receives the Media Stream of conference terminal, and Media Stream is carried out audio mixing, and the Media Stream behind the audio mixing is issued corresponding conference terminal again.In mixing control method provided by the present invention, the audio mixing server also should have certain controlled function, promptly can receive and send media control request and control signaling, is used for revising media channel direction and audio mixing state.
For this reason, the audio mixing server among the present invention mainly is made up of two modules: one is the audio mixing control module, and one is medium audio mixing module.
The audio mixing control module is mainly used in and receives speech/mute request, speech/mute request is accepted or refuses to handle, and send control speech/quiet signaling to conference terminal.The audio mixing control module can require medium audio mixing module to revise the audio mixing state after accepting request.
Medium audio mixing module is mainly used in the Media Stream that receives conference terminal, and Media Stream is carried out audio mixing, simultaneously the Media Stream behind the audio mixing is sent to corresponding other conference terminal.Receive the modification order of audio mixing control module when medium audio mixing module after, can carry out corresponding modification to the audio mixing state.As allow the A speech, and will join the Media Stream of A in the audio mixing Media Stream and go, or make A quiet, at this moment A just can not send Media Stream, can not join the Media Stream of A during audio mixing yet.
Above-mentioned medium audio mixing module can be realized by dsp chip, mainly is by dsp chip the media conversion of collecting to be become pcm encoder, and superpose (being the audio mixing operation), again the medium behind the audio mixing is carried out corresponding speech coding conversion.The audio mixing control module can be the firmware or the application program on the microprocessor of operating in of writing specially, is mainly used in the respective logic flow process that realizes audio mixing control.This audio mixing control module can be arranged in the dsp chip, directly controls medium audio mixing module; Perhaps based on distributed communication mechanism control medium audio mixing module.
The participant has two states in videoconference: floor status and mute state.Wherein floor status be we can say also and can be listened, and has from the audio mixing server to the meeting terminal this moment and the stream of the two-way media from conference terminal to the audio mixing server; And mute state is to listen ineffablely, has only the one-way media stream from the audio mixing server to the meeting terminal.Above-mentioned floor status and mute state are not unalterable, can videoconference carry out switch in the process.For example conference terminal can directly switch the floor status of oneself to conference control server and audio mixing server requests.
Role in the videoconference has two kinds: meeting presider and general participant.Have and have only a meeting presider in the videoconference, remaining all is general participant.When holding videoconference, whether general participant can make a speech and be determined by the meeting presider.In view of in a videoconference, general one-man of same time is in speech, and all the other participants are the audience at this moment, is significant so generally have only the Media Stream of or two or three conference terminals in some time periods.Based on above-mentioned analysis, if audio mixing server these useful Media Streams of an audio mixing and do not remove the Media Stream of those a large amount of otiose conference terminals of audio mixing when carrying out audio mixing, will reduce a large amount of audio mixing work undoubtedly, alleviate the pressure that medium are handled, also avoid of the influence of those Media Streams useless simultaneously the holophrase sound quality.
On specific implementation, at first make the conference terminal of initial adding videoconference all be in mute state.The switching of conference terminal between mute state and floor status can directly be controlled by the meeting presider.
As shown in Figure 1, conference terminal A can enter floor status to the request of audio mixing control module.After speaking request was passed through by the meeting presider, it was the signaling of floor status that the audio mixing control module sends switching conference terminal state to this conference terminal A, and conference terminal A becomes floor status after receiving signaling.The conference terminal A that is in floor status is to the two-way transmission Media Stream of medium audio mixing module, and medium audio mixing module is carried out the audio mixing processing to the Media Stream of this conference terminal A, and sends to other conference terminals of participating in videoconference.
As shown in Figure 2, the conference terminal A that is in floor status also can switch to mute state to the request of audio mixing control module when not needing to make a speech.After the mute request of conference terminal A was passed through by the meeting presider, it was the signaling of mute state that the audio mixing control module can send switching conference terminal state to conference terminal A, and conference terminal A becomes mute state after receiving signaling.After conference terminal switches to mute state, stop to send Media Stream, receive only one-way media stream from medium audio mixing module to medium audio mixing module.Compare with the prioritization scheme that relies on silence detection to realize, above-mentioned scheme has further been alleviated descending Network Transmission pressure, simultaneously also having avoided certain conference terminal to sound because of accidental cause is set to the audio mixing conference terminal, influences the voice quality of whole videoconference.
In order to improve the efficient of videoconference, the meeting presider should suitably control same time spokesman's quantity (suggestion maintains 2～3 people), can control the work of treatment amount of audio mixing server like this, the alleviation network is uploaded the pressure to bandwidth, improves the quality that audio mixing is handled simultaneously.
Compare with common videoconference, if the videoconference of 4 people's scales, the one-man makes a speech.Utilize this mixing control method without any need for audio mixing operation, this moment, up Media Stream had only 1 the tunnel, downlink media stream has 4 the tunnel.And common videoconference needs 4 audio mixings to other three people, and the up-downgoing Media Stream is respectively 4 the tunnel.If N (N is a natural number) people's meeting, the one-man is in speech.Utilize this mixing control method still without any need for audio mixing, up Media Stream also has only 1 the tunnel, and downlink media stream has the N road.And common videoconference just needs the audio mixing to N-1 people N time, and the up-downgoing Media Stream also is respectively the N road.If two people's speeches utilize this mixing control method to need once to two people's audio mixing, up Media Stream has two-way, and downlink media stream has the N road.This shows that under the situation many more the participant, that the speech number is few more, the implementation result of this mixing control method is good more.
Above the mixing control method that is used for centralized conference call of the present invention is had been described in detail.For one of ordinary skill in the art, any conspicuous change of under the prerequisite that does not deviate from connotation of the present invention it being done all will constitute to infringement of patent right of the present invention, with corresponding legal responsibilities.
Claims (2)
1. mixing control method that is used for centralized conference call, realize that based on conference control server and audio mixing server described audio mixing server is made up of audio mixing control module and medium audio mixing module, it is characterized in that:
At first make the conference terminal of initial adding videoconference all be in mute state;
When described conference terminal need be made a speech, enter floor status to the request of described audio mixing control module, after request was passed through, it was the signaling of floor status that described audio mixing control module sends switching conference terminal state to described conference terminal; Described conference terminal becomes floor status after receiving signaling, and to the two-way transmission Media Stream of described medium audio mixing module, described medium audio mixing module is carried out the audio mixing processing to the Media Stream of described conference terminal, and sends to other conference terminals of participating in videoconference;
When described conference terminal does not need to make a speech, enter mute state to the request of described audio mixing control module, after request was passed through, it was the signaling of mute state that described audio mixing control module sends switching conference terminal state to described conference terminal; Described conference terminal becomes mute state after receiving signaling, stops to send Media Stream to described medium audio mixing module, receives only the one-way media stream from described medium audio mixing module.
2. the mixing control method that is used for centralized conference call as claimed in claim 1 is characterized in that:
Described audio mixing control module is used for receiving speech/mute request, described speech/mute request is accepted or refuses to handle, and send control speech/quiet signaling to described conference terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2009102445526A CN102118523A (en) | 2009-12-30 | 2009-12-30 | Mixing control method for centralized teleconference |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2009102445526A CN102118523A (en) | 2009-12-30 | 2009-12-30 | Mixing control method for centralized teleconference |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102118523A true CN102118523A (en) | 2011-07-06 |
Family
ID=44217107
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2009102445526A Pending CN102118523A (en) | 2009-12-30 | 2009-12-30 | Mixing control method for centralized teleconference |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102118523A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103152185A (en) * | 2013-02-27 | 2013-06-12 | 深圳大学 | Establishment method and system for conference site of voice conference |
| CN105357208A (en) * | 2015-11-20 | 2016-02-24 | 深圳联友科技有限公司 | Multi-party network audio session method and system |
| CN105704338A (en) * | 2016-03-21 | 2016-06-22 | 腾讯科技（深圳）有限公司 | Audio mixing method, audio mixing equipment and system |
| WO2017121299A1 (en) * | 2016-01-13 | 2017-07-20 | 华为技术有限公司 | Method and apparatus for adjusting media stream transmission |
| CN108347418A (en) * | 2017-01-24 | 2018-07-31 | 展讯通信（上海）有限公司 | Control method, device and the mostly logical terminal of conference telephone |
| CN108540500A (en) * | 2018-07-11 | 2018-09-14 | Oppo（重庆）智能科技有限公司 | Data transmission method, device, equipment and the storage medium of more people's calls |
| CN108632048A (en) * | 2017-03-22 | 2018-10-09 | 展讯通信（上海）有限公司 | Conference telephone control method, device and mostly logical terminal |
| CN110266995A (en) * | 2019-06-12 | 2019-09-20 | 中兴通讯股份有限公司 | A kind of method, MCU and the storage medium of orderly control conference terminal speech |
| CN112565668A (en) * | 2020-12-28 | 2021-03-26 | 创想空间信息技术(苏州)有限公司 | Method, system and readable storage medium for sharing sound in network conference |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5483588A (en) * | 1994-12-23 | 1996-01-09 | Latitute Communications | Voice processing interface for a teleconference system |
| US5657096A (en) * | 1995-05-03 | 1997-08-12 | Lukacs; Michael Edward | Real time video conferencing system and method with multilayer keying of multiple video images |
| US5999208A (en) * | 1998-07-15 | 1999-12-07 | Lucent Technologies Inc. | System for implementing multiple simultaneous meetings in a virtual reality mixed media meeting room |
| CN1941891A (en) * | 2006-09-29 | 2007-04-04 | 华为技术有限公司 | Audio mixed processing method and processor |
| WO2009020082A1 (en) * | 2007-08-09 | 2009-02-12 | Kabushiki Kaisha Audio-Technica | Audio conference system |
| CN101389059A (en) * | 2007-09-11 | 2009-03-18 | 华为技术有限公司 | Method, system and device for realizing session mode switching |
| CN101523764A (en) * | 2006-10-18 | 2009-09-02 | Lg电子株式会社 | Method for controlling floor in push to talk service |
-
2009
- 2009-12-30 CN CN2009102445526A patent/CN102118523A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5483588A (en) * | 1994-12-23 | 1996-01-09 | Latitute Communications | Voice processing interface for a teleconference system |
| US5657096A (en) * | 1995-05-03 | 1997-08-12 | Lukacs; Michael Edward | Real time video conferencing system and method with multilayer keying of multiple video images |
| US5999208A (en) * | 1998-07-15 | 1999-12-07 | Lucent Technologies Inc. | System for implementing multiple simultaneous meetings in a virtual reality mixed media meeting room |
| CN1941891A (en) * | 2006-09-29 | 2007-04-04 | 华为技术有限公司 | Audio mixed processing method and processor |
| CN101523764A (en) * | 2006-10-18 | 2009-09-02 | Lg电子株式会社 | Method for controlling floor in push to talk service |
| WO2009020082A1 (en) * | 2007-08-09 | 2009-02-12 | Kabushiki Kaisha Audio-Technica | Audio conference system |
| CN101389059A (en) * | 2007-09-11 | 2009-03-18 | 华为技术有限公司 | Method, system and device for realizing session mode switching |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103152185A (en) * | 2013-02-27 | 2013-06-12 | 深圳大学 | Establishment method and system for conference site of voice conference |
| CN105357208A (en) * | 2015-11-20 | 2016-02-24 | 深圳联友科技有限公司 | Multi-party network audio session method and system |
| WO2017121299A1 (en) * | 2016-01-13 | 2017-07-20 | 华为技术有限公司 | Method and apparatus for adjusting media stream transmission |
| CN105704338A (en) * | 2016-03-21 | 2016-06-22 | 腾讯科技（深圳）有限公司 | Audio mixing method, audio mixing equipment and system |
| CN105704338B (en) * | 2016-03-21 | 2019-02-05 | 腾讯科技（深圳）有限公司 | A kind of sound mixing method, audio mixing equipment and system |
| CN108347418A (en) * | 2017-01-24 | 2018-07-31 | 展讯通信（上海）有限公司 | Control method, device and the mostly logical terminal of conference telephone |
| CN108632048A (en) * | 2017-03-22 | 2018-10-09 | 展讯通信（上海）有限公司 | Conference telephone control method, device and mostly logical terminal |
| CN108632048B (en) * | 2017-03-22 | 2020-12-22 | 展讯通信（上海）有限公司 | Conference call control method and device and multi-pass terminal |
| CN108540500A (en) * | 2018-07-11 | 2018-09-14 | Oppo（重庆）智能科技有限公司 | Data transmission method, device, equipment and the storage medium of more people's calls |
| CN108540500B (en) * | 2018-07-11 | 2021-06-11 | Oppo（重庆）智能科技有限公司 | Data transmission method, device, equipment and storage medium for multi-person conversation |
| CN110266995A (en) * | 2019-06-12 | 2019-09-20 | 中兴通讯股份有限公司 | A kind of method, MCU and the storage medium of orderly control conference terminal speech |
| CN112565668A (en) * | 2020-12-28 | 2021-03-26 | 创想空间信息技术(苏州)有限公司 | Method, system and readable storage medium for sharing sound in network conference |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102118523A (en) | Mixing control method for centralized teleconference | |
| US8170191B2 (en) | Method and system for handling audio signals of conference | |
| US6792092B1 (en) | Method and system for independent participant control of audio during multiparty communication sessions | |
| CN1611059B (en) | Method and system for controlling audio content during multiparty communication sessions | |
| EP2367343B1 (en) | Audio mixing | |
| RU2293368C2 (en) | Method (versions) and system (versions) for controlling conferencs and control unit for multimedia/speech system | |
| EP1360798B1 (en) | Control unit for multipoint multimedia/audio conference | |
| JP5534813B2 (en) | System, method, and multipoint control apparatus for realizing multilingual conference | |
| US7180997B2 (en) | Method and system for improving the intelligibility of a moderator during a multiparty communication session | |
| DE60127929T2 (en) | METHOD AND DEVICE FOR A TALK GROUP CALL IN A WIRELESS NEWS TRANSMISSION SYSTEM | |
| CN101179693B (en) | Mixed audio processing method of session television system | |
| US7580375B1 (en) | Scalable moderated audio conferencing for multicast and unicast endpoints and gateways | |
| US7929011B2 (en) | Method and system for handling video signals of conference | |
| US8340269B2 (en) | Method, device, and system for processing multi-channel audio signals | |
| CN112104836A (en) | Audio mixing method, system, storage medium and equipment for audio server | |
| CN101877706A (en) | Multi-terminal multimedia conference control system and implementation method | |
| CN101146208A (en) | Terminal with built-in multiple-point control unit and its communication method | |
| US20070133438A1 (en) | Method and system for reserving resources in a conferencing system | |
| CN101502043B (en) | Method for implementing voice conference and voice conference system | |
| CN101488870B (en) | Method, system and equipment for implementing sound mixing | |
| CN101018419A (en) | Scheduling method and system of the multi-party call service | |
| CN101610324A (en) | The method of prompting call progress state, conference control equipment and conference system | |
| CN104660423A (en) | Group call combined conference realization method, device and system | |
| CN120639750A (en) | IP conference realization method in weak network environment | |
| CN100525487C (en) | Method and system for determining multiway telecommunication service medium transmitting right |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20110706 |