[go: up one dir, main page]

CN120803392B - A system and method for supporting rapid expansion of multi-channel audio modules - Google Patents

A system and method for supporting rapid expansion of multi-channel audio modules

Info

Publication number
CN120803392B
CN120803392B CN202511258988.6A CN202511258988A CN120803392B CN 120803392 B CN120803392 B CN 120803392B CN 202511258988 A CN202511258988 A CN 202511258988A CN 120803392 B CN120803392 B CN 120803392B
Authority
CN
China
Prior art keywords
audio
module
audio data
data
buffer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202511258988.6A
Other languages
Chinese (zh)
Other versions
CN120803392A (en
Inventor
王志伟
童涌
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing Mythware Information Technology Co ltd
Original Assignee
Nanjing Mythware Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing Mythware Information Technology Co ltd filed Critical Nanjing Mythware Information Technology Co ltd
Priority to CN202511258988.6A priority Critical patent/CN120803392B/en
Publication of CN120803392A publication Critical patent/CN120803392A/en
Application granted granted Critical
Publication of CN120803392B publication Critical patent/CN120803392B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/162—Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

The invention discloses a system and a method for supporting rapid expansion of a plurality of paths of audio modules, which belong to the technical field of multi-path audio processing, wherein a Render thread module is connected with an audio distribution module B and is used for requesting audio data from the audio distribution module B, at the moment, a sound mixing module A mixes the audio data acquired from an audio buffer zone of each single path of audio stream unit into one path of audio data and sends the one path of audio data to the audio distribution module B, the audio distribution module B sends the audio data after sound mixing to the sound mixing module B, meanwhile, a microphone audio data in the audio buffer zone B is pulled and sent to the sound mixing module B, and the sound mixing module B mixes the audio data after sound mixing and the microphone audio data and then carries out sampling rate adjustment and volume adjustment and finally distributes the audio data through the audio distribution module C. The method can rapidly add audio sources, switch any one or more audio sources in multiple channels, and rapidly analyze the designated one or more audio sources.

Description

System and method for supporting rapid expansion of multi-channel audio module
Technical Field
The invention relates to the technical field of multipath audio processing, in particular to a system and a method for supporting rapid expansion of multipath audio modules.
Background
The traditional audio processing scheme comprises a hardware scheme and a software scheme, wherein the hardware scheme depends on physical wiring and special hardware, after wiring is completed, hardware connection is required to be readjusted for increasing and decreasing audio sources and switching channels, the configuration is tedious and inflexible, the software scheme is cumbersome to process audio streams of complex scenes, the flexibility is insufficient, any one or more audio sources in multiple channels cannot be added and switched, and the designated one or more audio sources can be analyzed quickly. Therefore, it is difficult to meet the demands for flexibility, scalability, and the like of audio processing in the current complex scene.
Based on this, the present invention designs a system and method for supporting the rapid expansion of multiple audio modules to solve the above-mentioned problems.
Disclosure of Invention
In view of the above drawbacks of the prior art, the present invention provides a system and method for supporting a fast expansion of multiple audio modules.
In order to achieve the above purpose, the invention is realized by the following technical scheme:
a system for supporting rapid expansion of multiple audio modules, comprising:
Several groups of single-channel audio stream units for respectively and independently processing the audio data inputted by each channel;
The audio mixing module A is used for mixing the audio data acquired from the audio buffer areas of the single-channel audio stream units into one-channel audio data, and the audio mixing module A is connected with the audio distribution module B which is connected with the audio distribution module B;
the audio distribution module B is used for sending the audio data after the audio mixing to the playing channel B, the audio debugging module and the audio mixing module B;
The microphone is used as audio data acquisition hardware and is used for collecting microphone audio data;
The volume control module C is used for adjusting the volume of the microphone audio data and is connected with the audio buffer zone B;
The audio buffer area B is used for temporarily storing microphone audio data and is connected with the sound mixing module B;
The audio mixing module B is used for mixing the audio data obtained from the audio distribution module B after audio mixing and the microphone audio data obtained from the audio buffer area B into one path of audio data;
The sampling rate conversion module B is used for adjusting the sampling rate of the audio data after the audio mixing and converting the audio data with various sampling rates into audio data which can be normally played by the equipment;
the volume control module B is used for adjusting the volume of the audio data after the audio mixing;
the audio distribution module C is used for transmitting the audio data after the audio mixing to each required channel through the audio coding module or not;
the Render thread module is connected with the audio distribution module B and is used for requesting audio data from the audio distribution module B, at the moment, the audio mixing module A mixes the audio data acquired from the audio buffer areas of the single-channel audio stream units into one-channel audio data and sends the audio data to the audio distribution module B, and the audio distribution module B sends the audio data after audio mixing to the audio mixing module B;
The Capture thread module is used for collecting audio data in real time through a microphone, transmitting the audio data to the audio buffer zone B after being regulated by the volume control module C, and pulling the microphone audio data in the audio buffer zone B to be transmitted to the sound mixing module B when the Render thread module is started;
A standard audio interface.
Further, the single-channel audio stream unit comprises an audio decoding module, a sampling rate conversion module A, a volume control module A, an audio distribution module A and an audio buffer area A which are connected in sequence, or comprises a sampling rate conversion module C, a volume control module D and an audio distribution module D which are connected in sequence, and an audio buffer area C1 which are connected with the audio distribution module D.
Further, the audio decoding module is used for decoding the audio data which is transmitted in the network and is coded into AAC or OPUS format into original audio data;
The sampling rate conversion module A is used for adjusting the sampling rate of the audio data;
the volume control module A is used for adjusting the volume of the audio data;
an audio distribution module A for transmitting audio data to the audio buffer A;
The audio buffer A is used for temporarily storing audio data and is connected with the audio mixing module.
Further, the audio decoding module adopts an AAC decoding module or an OPUS decoding module.
Further, the sampling rate conversion module C is configured to adjust a sampling rate of the audio data;
The volume control module D is used for adjusting the volume of the audio data;
the audio distribution module D is configured to send audio data to the audio buffer C and the audio buffer C1, so that a downstream module (such as the audio mixing module a) can "take the audio data as needed" from the buffer;
A playback channel a, which is a channel proxy of the output hardware of the audio data, for delivering the audio data of the audio buffer C1 to the selected output hardware, such as a speaker;
the audio buffer area C is used for temporarily storing audio data and is respectively connected with the audio mixing module.
Further, the audio distribution module B is connected with the playing channel B and the audio debugging module;
a playback channel B, which is a channel proxy for the output hardware of the audio data, for delivering the audio data to the selected output hardware, such as a speaker;
And the audio debugging module is used for debugging the audio.
Furthermore, the audio coding module is used for coding the audio data after the audio mixing into the audio data in the AAC or OPUS format and sending the audio data to the network.
Furthermore, the audio coding module adopts an AAC coding module or an OPUS coding module.
Further, the standard audio interface includes a sink interface for pushing out audio data and a source interface for acquiring superior audio data.
In order to better achieve the object of the present invention, the present invention also provides a method for supporting rapid expansion of multiple audio modules, comprising the steps of:
Step one, a Render thread module starts, requests audio data from an audio distribution module B, at the moment, a sound mixing module A mixes audio data acquired from an audio buffer zone of each single-channel audio stream unit into one-channel audio data and sends the one-channel audio data to the audio distribution module B, the audio distribution module B sends the audio data after sound mixing to the sound mixing module B, meanwhile, a microphone audio data in the audio buffer zone B is pulled and sent to the sound mixing module B, the sound mixing module B mixes the audio data after sound mixing and the microphone audio data and sends the mixed audio data to a sampling rate conversion module B, the sampling rate conversion module B adjusts the sampling rate of the audio data after sound mixing, converts the audio data with various sampling rates into audio data which can be normally played by equipment, and then adjusts the volume through a volume control module B, and finally sends the audio data after sound mixing into various channels through an audio coding module or a non-coding mode through the audio distribution module C;
Step two, when one or more audio streams are newly added, connecting the newly added single-channel audio stream processing unit with the audio mixing module A;
step three, when the audio stream of the designated path is played, adding a pipeline to the audio distribution module D, pointing to the playing channel A, and simultaneously releasing the binding between the playing channel A and other audio distribution modules;
Step four, when an audio stream of a certain path is eliminated, the connection between the single-path audio stream processing unit and the audio mixing module A is released;
and fifthly, when a certain path of audio stream is debugged, the audio debugging module is added to be connected with the path of audio distribution module, and when a certain path or a mixing module is required to be debugged, the audio debugging module is added to be connected with the audio distribution module B.
Compared with the prior art, the invention has the beneficial effects that 1, any path of audio stream can be rapidly integrated into an audio processing system;
2. audio stream data for any one node within the pipeline, including a single audio stream, a mixed audio stream, etc., may be obtained from the audio processing system;
3. any one or more audio sources in the multi-channel can be switched, and the designated one or more audio sources can be rapidly subjected to debugging analysis.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below. It is evident that the drawings in the following description are only some embodiments of the present invention and that other drawings may be obtained from these drawings without inventive effort for a person of ordinary skill in the art.
Fig. 1 is a flowchart of a method for supporting a multi-channel audio module capable of being quickly expanded.
Fig. 2 is a schematic diagram of a method for obtaining an audio stream of any node in a pipeline and a normal audio stream of the pipeline.
FIG. 3 is a schematic diagram of a method for rapidly analyzing a specified audio or audio channels by switching any audio source of multiple channels.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention more clear, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. It will be apparent that the described embodiments are some, but not all, embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Referring to fig. 1-3 of the drawings, a system for supporting rapid expansion of multiple audio modules includes:
Several groups of single-channel audio stream units for respectively and independently processing the audio data inputted by each channel;
The single-channel audio stream unit comprises an audio decoding module, a sampling rate conversion module A, a volume control module A, an audio distribution module A and an audio buffer area A which are connected in sequence;
an audio decoding module for decoding audio data transmitted in the network encoded in AAC or OPUS format into original audio data (PCM format);
The audio decoding module can adopt an AAC decoding module or an OPUS decoding module and the like;
the sampling rate conversion module A is used for adjusting the sampling rate of the audio data and converting the audio data with various sampling rates into audio data which can be normally played by the equipment;
the volume control module A is used for adjusting the volume of the audio data;
The audio distribution module A is used for sending the audio data to the audio buffer A so that a downstream module (such as a sound mixing module A and the like) can take the audio data from the buffer as required;
The audio buffer area A is used for temporarily storing audio data and waiting for the starting of the Render thread module;
or the single-channel audio stream unit comprises a sampling rate conversion module C, a volume control module D and an audio distribution module D which are sequentially connected, and an audio buffer zone C1 which are both connected with the audio distribution module D;
The sampling rate conversion module C is used for adjusting the sampling rate of the audio data and converting the audio data with various sampling rates into audio data which can be normally played by the equipment;
The volume control module D is used for adjusting the volume of the audio data;
the audio distribution module D is configured to send audio data to the audio buffer C and the audio buffer C1, so that a downstream module (such as the audio mixing module a) can "take the audio data as needed" from the buffer;
A playback channel a, which is a channel proxy of the output hardware of the audio data, for delivering the audio data of the audio buffer C1 to the selected output hardware, such as a speaker;
The audio buffer area C is used for temporarily storing audio data and waiting for the starting of the Render thread module;
the audio mixing module A is used for mixing the audio data acquired from the audio buffer area (the audio buffer area A or the audio buffer area C) of each single-channel audio stream unit into one-channel audio data;
the audio mixing module A is connected with the audio distribution module B, and the audio distribution module B is connected with the playing channel B, the audio debugging module and the audio mixing module B;
the audio distribution module B is used for sending the audio data after the audio mixing to the playing channel B, the audio debugging module and the audio mixing module B;
a playback channel B, which is a channel proxy for the output hardware of the audio data, for delivering the audio data to the selected output hardware, such as a speaker;
the audio debugging module is used for debugging the audio, such as quality check, parameter adjustment and the like, so as to ensure audio equalization and no noise;
The microphone is used as audio data acquisition hardware and is used for collecting microphone audio data;
The volume control module C is used for adjusting the volume of the microphone audio data and is connected with the audio buffer zone B;
the audio buffer zone B is used for temporarily storing microphone audio data and waiting for the starting of the Capture thread module;
The audio mixing module B is used for mixing the audio data obtained from the audio distribution module B after audio mixing and the microphone audio data obtained from the audio buffer area B into one path of audio data;
The sampling rate conversion module B is used for adjusting the sampling rate of the audio data after the audio mixing and converting the audio data with various sampling rates into audio data which can be normally played by the equipment;
the volume control module B is used for adjusting the volume of the audio data after the audio mixing;
the audio distribution module C is used for transmitting the audio data after the audio mixing to each required channel through the audio coding module or not;
the audio coding module is used for coding the audio data (PCM format) after the audio mixing into audio data in AAC or OPUS formats and sending the audio data to a network;
the audio coding module may employ an AAC coding module or an OPUS coding module, or the like.
The Capture thread module is used for collecting audio data in real time through a microphone, transmitting the audio data to the audio buffer zone B after being regulated by the volume control module C, and pulling the microphone audio data in the audio buffer zone B to be transmitted to the sound mixing module B when the Render thread module is started;
The audio distribution module B is connected with the audio distribution module B and used for pulling out audio data from the audio distribution module B, at the moment, the audio mixing module A mixes the audio data obtained from the audio buffer areas (the audio buffer areas A and C) of the single-channel audio stream units into one channel of audio data and sends the audio data to the audio distribution module B, the audio distribution module B sends the audio data after mixing to the audio mixing module B, meanwhile, the microphone audio data in the audio buffer area B is pulled out and sent to the audio mixing module B, and the audio mixing module B mixes the audio data after mixing with the microphone audio data and then carries out sampling rate adjustment and volume adjustment and finally distributes the audio data to all needed channels through the audio distribution module C.
Standard audio interfaces, including sink (transmitting end) interfaces for pushing out audio data and source (receiving end) interfaces (source interfaces) for obtaining superior audio data;
And defining unified audio input/output interfaces, wherein the sink interface provides putFrame methods for pushing out the audio data, and the source interface provides getFrame methods for acquiring the upper-level audio data. As shown in FIG. 1, a partial module only supports sink or source, and a partial template supports conversion of sink and source.
When one or more audio streams need to be added to the current system, AAC, OPUS or original audio data (PCM format) can be flowed in only by connecting the newly added single-channel audio stream processing unit with the audio mixing module A;
When the audio stream with a specified path is required to be played, a pipeline is added to the audio distribution module D according to the indication of the single-path audio processing unit 3, the pipeline points to the playing channel A, and the binding between the playing channel A and other audio distribution modules is released;
when a certain path of audio stream needs to be removed, the path of audio stream can be removed from the audio mixing module A only by removing the connection between the single path of audio stream processing unit and the audio mixing module A;
when a certain path of audio stream is required to be debugged, the audio debugging module is added to be connected with the path of audio distribution module (the audio distribution module A or the audio distribution module D), and when a certain path or the audio mixing module is required to be debugged, the audio debugging module is added to be connected with the audio distribution module B.
The invention can realize the following technical effects:
(1) Any one path of audio stream can be rapidly integrated into an audio processing system;
(2) Audio stream data for any one node within the pipeline, including a single audio stream, a mixed audio stream, etc., may be obtained from the audio processing system;
Referring to fig. 2, in case one, the audio stream in the pipe normally flows (the audio stream data in the pipe is not acquired), and the stream of the volume control module D is directly supplied to the audio buffer C. And secondly, when the audio stream of any node in the pipeline is required to be acquired, an audio distribution module D is added, the stream of the audio control module is intercepted, one path of the stream is distributed to an audio buffer zone C1, and then response processing is carried out.
(3) Any one or more audio sources in the multi-channel can be switched, and the designated one or more audio sources can be rapidly subjected to debugging analysis.
Referring to fig. 3, when any one audio source of multiple channels needs to be switched, only a corresponding audio buffer is required to be added or removed by calling AddMixerItem (adding a mixer item) or RemoveMixerItem (removing a mixer item) in the mixing module a according to the situation in the figure. The method needs to rapidly analyze one or more designated audios, and can be inserted into an audio distribution module B after a mixing module A according to a second situation, so that one audio source can be intercepted and distributed into an audio debugging module.
Referring to fig. 1 of the drawings, a method for supporting rapid expansion of multiple audio modules includes the following steps:
Step one, a Render thread module starts to ask for audio data from an audio distribution module B, at the moment, a sound mixing module A mixes audio data acquired from an audio buffer area (an audio buffer area A or an audio buffer area C) of each single-channel audio stream unit into one channel of audio data and sends the one channel of audio data to the audio distribution module B, the audio distribution module B sends the audio data after sound mixing to the sound mixing module B, and meanwhile, a microphone audio data in the audio buffer area B is pulled to send to the sound mixing module B;
Step two, when one or more audio streams need to be newly added to the current system, connecting the newly added single-channel audio stream processing unit with a mixing module A (automatically completing or manually triggering a service scene to complete), and then streaming AAC, OPUS or original audio data (in a PCM format) into the system;
Step three, when the audio stream of the designated path needs to be played, adding a pipeline in the audio distribution module D according to the indication of the single-path audio processing unit 3, pointing to the playing channel A, and simultaneously releasing the binding of the playing channel A and other audio distribution modules (service driving, such as audio and video streams of a group of groups of users, only playing the audio stream of the group of users at the moment, pointing the source to the playing channel A, and releasing the audio stream of the playing channel B, so that only the playing channel A has sound output);
Step four, when a certain path of audio stream needs to be removed, the connection between the single path of audio stream processing unit and the audio mixing module A is released, so that the path of audio stream can be removed in the audio mixing module A (when a certain path of audio source is disconnected, the connection is automatically released, and the binding and unbinding can be triggered by manually operating the source);
And fifthly, when a certain path of audio stream is required to be debugged, an audio debugging module is added to be connected with the path of audio distribution module (the audio distribution module A or the audio distribution module D), and when a certain path or a mixing module is required to be debugged, the audio debugging module is added to be connected with the audio distribution module B (when a developer debugs the path of audio stream on a debugging page, a clicking debugging function automatically triggers the connection of the audio distribution module and the path of audio source, and a path of audio source is distributed to a debugging file).
The invention can realize the following technical effects:
(1) Any one path of audio stream can be rapidly integrated into an audio processing system;
(2) Audio stream data for any one node within the pipeline, including a single audio stream, a mixed audio stream, etc., may be obtained from the audio processing system;
(3) Any one or more audio sources in the multi-channel can be switched, and the designated one or more audio sources can be rapidly subjected to debugging analysis.
The foregoing embodiments are merely for illustrating the technical solution of the present invention, but not for limiting the same, and although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those skilled in the art that modifications may be made to the technical solution described in the foregoing embodiments or equivalents may be substituted for parts of the technical features thereof, and such modifications or substitutions may be made without departing from the spirit and scope of the technical solution of the embodiments of the present invention.

Claims (10)

1.一种支持多路音频模块可快速扩展的系统，其特征在于，包括：1. A system that supports rapid expansion of multiple audio modules, characterized in that it comprises: 若干组单路音频流单元，用于分别独立处理各路输入的音频数据；Several sets of single-channel audio stream units are used to independently process the audio data of each input channel; 混音模块A，用于将从各单路音频流单元的音频缓冲区获取的音频数据混音成一路音频数据；混音模块A与音频分发模块B连接，音频分发模块B与混音模块B连接；Mixing module A is used to mix the audio data obtained from the audio buffers of each single audio stream unit into one audio stream; mixing module A is connected to audio distribution module B, and audio distribution module B is connected to mixing module B. 音频分发模块B，用于将混音后的音频数据发送至播放通道B、音频调试模块和混音模块B；Audio distribution module B is used to send the mixed audio data to playback channel B, audio debugging module and mixing module B; 麦克风，作为音频数据的采集硬件，收集麦克风音频数据；麦克风与音量控制模块C连接；The microphone, as the audio data acquisition hardware, collects microphone audio data; the microphone is connected to the volume control module C. 音量控制模块C，用于调整麦克风音频数据的音量；音量控制模块C与音频缓冲区B连接；Volume control module C is used to adjust the volume of microphone audio data; volume control module C is connected to audio buffer B. 音频缓冲区B，用于临时存储麦克风音频数据；音频缓冲区B与混音模块B连接；Audio buffer B is used to temporarily store microphone audio data; audio buffer B is connected to mixing module B. 混音模块B，用于将从音频分发模块B获取的混音后的音频数据、从音频缓冲区B获取的麦克风音频数据混音成一路音频数据；Mixing module B is used to mix the mixed audio data obtained from audio distribution module B and the microphone audio data obtained from audio buffer B into one audio data stream. 采样率转换模块B，用于调整混音后的音频数据的采样率，将各种采样率的音频数据转换为设备正常播放的音频数据；Sampling rate conversion module B is used to adjust the sampling rate of the mixed audio data and convert audio data of various sampling rates into audio data that can be played normally by the device. 音量控制模块B，用于调整混音后的音频数据的音量；Volume control module B is used to adjust the volume of the mixed audio data; 音频分发模块C，用于将混音后的音频数据经音频编码模块编码或不经编码发送到各个需要的通道中；The audio distribution module C is used to send the mixed audio data, either encoded by the audio encoding module or unencoded, to the required channels. Render线程模块，与音频分发模块B连接，用于向音频分发模块B索要音频数据，此时混音模块A将从各单路音频流单元的音频缓冲区获取的音频数据混音成一路音频数据并发送至音频分发模块B，音频分发模块B将混音后的音频数据发送给混音模块B；The Render thread module is connected to the audio distribution module B and is used to request audio data from the audio distribution module B. At this time, the mixing module A mixes the audio data obtained from the audio buffer of each single audio stream unit into one audio data and sends it to the audio distribution module B. The audio distribution module B sends the mixed audio data to the mixing module B. Capture线程模块，用于通过麦克风实时采集音频数据，并在经音量控制模块C调整后将音频数据传输至音频缓冲区B；以及在Render线程模块启动时，拉取音频缓冲区B中的麦克风音频数据发送给混音模块B；The Capture thread module is used to collect audio data in real time through the microphone, and after adjustment by the volume control module C, transmit the audio data to the audio buffer B; and when the Render thread module starts, it pulls the microphone audio data in the audio buffer B and sends it to the mixing module B. 标准音频接口。Standard audio interface. 2.根据权利要求1所述的支持多路音频模块可快速扩展的系统，其特征在于，所述单路音频流单元包括依次连接的音频解码模块、采样率转换模块A、音量控制模块A、音频分发模块A和音频缓冲区A；或者所述单路音频流单元包括依次连接的采样率转换模块C、音量控制模块D和音频分发模块D，以及与音频分发模块D均连接的音频缓冲区C和音频缓冲区C1。2. The system supporting rapid expansion of multiple audio modules according to claim 1, characterized in that the single audio stream unit includes an audio decoding module, a sampling rate conversion module A, a volume control module A, an audio distribution module A, and an audio buffer A connected in sequence; or the single audio stream unit includes a sampling rate conversion module C, a volume control module D, and an audio distribution module D connected in sequence, as well as an audio buffer C and an audio buffer C1 connected to the audio distribution module D. 3.根据权利要求2所述的支持多路音频模块可快速扩展的系统，其特征在于，音频解码模块，用于将网络中传输的编码为AAC或OPUS格式的音频数据解码成原始音频数据；3. The system supporting rapid expansion of multiple audio modules according to claim 2, characterized in that the audio decoding module is used to decode audio data encoded in AAC or OPUS format transmitted in the network into raw audio data; 采样率转换模块A，用于调整音频数据的采样率；Sampling rate conversion module A is used to adjust the sampling rate of audio data; 音量控制模块A，用于调整音频数据的音量；Volume control module A is used to adjust the volume of audio data; 音频分发模块A，用于将音频数据发送到音频缓冲区A；Audio distribution module A is used to send audio data to audio buffer A; 音频缓冲区A，用于临时存储音频数据；音频缓冲区A与混音模块连接。Audio buffer A is used to temporarily store audio data; audio buffer A is connected to the mixing module. 4.根据权利要求2或3所述的支持多路音频模块可快速扩展的系统，其特征在于，音频解码模块采用AAC解码模块或OPUS解码模块。4. The system supporting rapid expansion of multiple audio modules according to claim 2 or 3, characterized in that the audio decoding module adopts an AAC decoding module or an OPUS decoding module. 5.根据权利要求3所述的支持多路音频模块可快速扩展的系统，其特征在于，采样率转换模块C，用于调整音频数据的采样率；5. The system supporting rapid expansion of multiple audio modules according to claim 3, characterized in that the sampling rate conversion module C is used to adjust the sampling rate of the audio data; 音量控制模块D，用于调整音频数据的音量；Volume control module D is used to adjust the volume of audio data; 音频分发模块D，用于将音频数据发送到音频缓冲区C和音频缓冲区C1；Audio distribution module D is used to send audio data to audio buffer C and audio buffer C1; 播放通道A，作为音频数据的输出硬件的通道代理，用于将音频缓冲区C1的音频数据送给选择的输出硬件；Playback channel A, acting as a channel proxy for the audio data output hardware, is used to send the audio data in audio buffer C1 to the selected output hardware. 音频缓冲区C，用于临时存储音频数据；音频缓冲区C分别与混音模块连接。Audio buffer C is used to temporarily store audio data; audio buffer C is connected to the mixing module. 6.根据权利要求5所述的支持多路音频模块可快速扩展的系统，其特征在于，音频分发模块B与播放通道B、音频调试模块连接；6. The system supporting rapid expansion of multiple audio modules according to claim 5, characterized in that the audio distribution module B is connected to the playback channel B and the audio debugging module; 播放通道B，作为音频数据的输出硬件的通道代理，用于将音频数据送给选择的输出硬件；Playback channel B acts as a channel proxy for the audio data output hardware, used to send audio data to the selected output hardware; 音频调试模块，用于对音频进行调试。The audio debugging module is used to debug audio. 7.根据权利要求1所述的支持多路音频模块可快速扩展的系统，其特征在于，音频编码模块，用于将混音后的音频数据编码成AAC或OPUS格式的音频数据并发送到网络中。7. The system supporting rapid expansion of multiple audio modules according to claim 1, characterized in that the audio encoding module is used to encode the mixed audio data into AAC or OPUS format audio data and send it to the network. 8.根据权利要求7所述的支持多路音频模块可快速扩展的系统，其特征在于，音频编码模块采用AAC编码模块或OPUS编码模块。8. The system supporting rapid expansion of multiple audio modules according to claim 7, wherein the audio encoding module adopts an AAC encoding module or an OPUS encoding module. 9.根据权利要求6所述的支持多路音频模块可快速扩展的系统，其特征在于，标准音频接口包括将音频数据推送出去的sink接口和获取上级音频数据的source接口。9. The system supporting rapid expansion of multiple audio modules according to claim 6, characterized in that the standard audio interface includes a sink interface for pushing out audio data and a source interface for obtaining audio data from the upper level. 10.一种支持多路音频模块可快速扩展的方法，其特征在于，包括以下步骤：10. A method for supporting rapid expansion of multi-channel audio modules, characterized by comprising the following steps: 步骤一、Render线程模块启动，向音频分发模块B索要音频数据，此时混音模块A将从各单路音频流单元的音频缓冲区获取的音频数据混音成一路音频数据并发送至音频分发模块B，音频分发模块B将混音后的音频数据发送给混音模块B；同时，拉取音频缓冲区B中的麦克风音频数据发送给混音模块B；混音模块B将混音后的音频数据、麦克风音频数据混合后发送至采样率转换模块B，采样率转换模块B调整混音后的音频数据的采样率，将各种采样率的音频数据转换为设备正常播放的音频数据；再经过音量控制模块B调整音量；最后经音频分发模块C将混音后的音频数据经音频编码模块编码或不经编码发送到各个需要的通道中；Step 1: The Render thread module starts and requests audio data from the audio distribution module B. At this time, the mixing module A mixes the audio data obtained from the audio buffers of each single audio stream unit into one audio stream and sends it to the audio distribution module B. The audio distribution module B sends the mixed audio data to the mixing module B. Simultaneously, it pulls microphone audio data from the audio buffer B and sends it to the mixing module B. The mixing module B mixes the mixed audio data and the microphone audio data and sends it to the sampling rate conversion module B. The sampling rate conversion module B adjusts the sampling rate of the mixed audio data, converting audio data of various sampling rates into audio data that the device can play normally. Then, the volume control module B adjusts the volume. Finally, the audio distribution module C encodes the mixed audio data or sends it to each required channel, either directly or without encoding. 步骤二、当新增一路或多路音频流时，将新增的单路音频流处理单元与混音模块A连接；Step 2: When adding one or more audio streams, connect the newly added single-channel audio stream processing unit to mixing module A; 步骤三、当播放指定路的音频流时，在音频分发模块D添加一个管道，并指向播放通道A，同时解除播放通道A和其他音频分发模块的绑定；Step 3: When playing the audio stream of the specified channel, add a pipe to the audio distribution module D and point it to the playback channel A, while unbinding the playback channel A from other audio distribution modules. 步骤四、当排除某一路的音频流时，解除该单路音频流处理单元与混音模块A的连接；Step 4: When excluding a certain audio stream, disconnect the single audio stream processing unit from the mixing module A; 步骤五、当对某路音频流进行调试时，增加音频调试模块与该路音频分发模块连接，当需要对某路或混音模块进行调试时，增加音频调试模块与音频分发模块B连接。Step 5: When debugging a certain audio stream, add an audio debugging module and connect it to the audio distribution module for that stream. When debugging a certain stream or mixing module, add an audio debugging module and connect it to audio distribution module B.
CN202511258988.6A 2025-09-04 2025-09-04 A system and method for supporting rapid expansion of multi-channel audio modules Active CN120803392B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202511258988.6A CN120803392B (en) 2025-09-04 2025-09-04 A system and method for supporting rapid expansion of multi-channel audio modules

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202511258988.6A CN120803392B (en) 2025-09-04 2025-09-04 A system and method for supporting rapid expansion of multi-channel audio modules

Publications (2)

Publication Number Publication Date
CN120803392A CN120803392A (en) 2025-10-17
CN120803392B true CN120803392B (en) 2025-11-18

Family

ID=97312626

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202511258988.6A Active CN120803392B (en) 2025-09-04 2025-09-04 A system and method for supporting rapid expansion of multi-channel audio modules

Country Status (1)

Country Link
CN (1) CN120803392B (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101695023A (en) * 2009-10-19 2010-04-14 南京莱斯信息技术股份有限公司 Parallel expanded type multi-path audio exchange mixing system
CN101960865A (en) * 2008-03-03 2011-01-26 诺基亚公司 Apparatus for capturing and rendering a plurality of audio channels

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105611402A (en) * 2015-12-21 2016-05-25 中国电子科技集团公司第三十研究所 Channel expansion method supporting multipath PCM (Pulse Code Modulation) audio playing
CN108235052A (en) * 2018-01-09 2018-06-29 安徽小马创意科技股份有限公司 Multi-audio-frequency channel hardware audio mixing, acquisition and the method for broadcasting may be selected based on IOS
KR102738908B1 (en) * 2020-08-04 2024-12-06 삼성전자주식회사 Electronic device and method for outputting audio data thereof
CN114937456A (en) * 2022-04-24 2022-08-23 海宁奕斯伟集成电路设计有限公司 External playing device, method, program and system
CN120075455A (en) * 2025-02-28 2025-05-30 南京极域信息科技有限公司 Video coding and decoding and rendering method for middleware to cooperate with local resources

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101960865A (en) * 2008-03-03 2011-01-26 诺基亚公司 Apparatus for capturing and rendering a plurality of audio channels
CN101695023A (en) * 2009-10-19 2010-04-14 南京莱斯信息技术股份有限公司 Parallel expanded type multi-path audio exchange mixing system

Also Published As

Publication number Publication date
CN120803392A (en) 2025-10-17

Similar Documents

Publication Publication Date Title
EP2334068A1 (en) Video and audio processing method, multi-point control unit and video conference system
US12167220B2 (en) Audio representation and associated rendering
JP6010176B2 (en) Audio signal decoding method and apparatus
CN108235052A (en) Multi-audio-frequency channel hardware audio mixing, acquisition and the method for broadcasting may be selected based on IOS
WO2014161402A2 (en) Distributed video conference method, system, terminal, and audio-video integrated device
CN114979545A (en) Multi-terminal calling method, storage medium and electronic device
JP3719398B2 (en) Data transmission method and apparatus and data transmission / reception system
WO2021143043A1 (en) Multi-person instant messaging method, system, apparatus and electronic device
WO2015007137A1 (en) Videoconference terminal, secondary-stream data accessing method, and computer storage medium
CN106851131B (en) Interactive connection processing method, server, system and mobile terminal
CN120803392B (en) A system and method for supporting rapid expansion of multi-channel audio modules
CN112153321A (en) A conference recording method, device and conference recording system
CN107124635B (en) Video online method, video management system and live broadcast system
CN113301359A (en) Audio and video processing method and device and electronic equipment
WO2016101623A1 (en) Remote interaction method and device in multipoint audio and video communication
CN119363925B (en) A conference communication transmission method integrating audio and video
CN112019488A (en) A method, apparatus, device and storage medium for speech processing
CN101179695A (en) Method for realizing conference recording and broadcasting, video conference system and terminal
JP5086366B2 (en) Conference terminal device, relay device, and conference system
TWI896604B (en) Audio mixing method for network streaming and signal transmission method for network video streaming
CN118677990A (en) Audio transmission method, device, equipment, storage medium, program product
WO2021255327A1 (en) Managing network jitter for multiple audio streams
CN110753232A (en) Audio processing method, system and storage medium for online interactive scene
WO2022037444A1 (en) Encoding and decoding methods and apparatuses, medium, and electronic device
CN116132413B (en) WebRTC-based real-time voice transparent transmission improvement method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant