CN109003620A - A kind of echo removing method, device, electronic equipment and storage medium - Google Patents
A kind of echo removing method, device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN109003620A CN109003620A CN201810508076.3A CN201810508076A CN109003620A CN 109003620 A CN109003620 A CN 109003620A CN 201810508076 A CN201810508076 A CN 201810508076A CN 109003620 A CN109003620 A CN 109003620A
- Authority
- CN
- China
- Prior art keywords
- audio
- echo
- local terminal
- electronic equipment
- opposite end
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0316—Speech enhancement, e.g. noise reduction or echo cancellation by changing the amplitude
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0316—Speech enhancement, e.g. noise reduction or echo cancellation by changing the amplitude
- G10L21/0324—Details of processing therefor
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L2021/02082—Noise filtering the noise being echo, reverberation of the speech
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Quality & Reliability (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Telephone Function (AREA)
- Cable Transmission Systems, Equalization Of Radio And Reduction Of Echo (AREA)
Abstract
The embodiment of the invention provides a kind of echo removing method, device, electronic equipment and storage mediums, in this method, receive the opposite end audio of at least one opposite end electronic equipment transmission, obtain the input audio that the microphone of local terminal electronic equipment receives, wherein, input audio includes the echo and local terminal audio that opposite end audio generates, by the echo and the merging of local terminal audio in input audio, audio after being merged, from the audio after merging, removal echo is eliminated the audio after echo, will eliminate the audio after echo and is sent at least one remote electronics.In the present invention, in such a way that echo and local terminal audio are merged, audio after being merged all the way, and echo cancellation is carried out to the audio after merging all the way, be eliminated the audio after echo, then will eliminate the audio after echo and is sent at least one remote electronics, so that remote electronics no longer receive echo, the interference for reducing echo, improves communication efficiency.
Description
Technical field
The present invention relates to technical field of voice recognition, more particularly to a kind of echo removing method, device, electronic equipment and
Storage medium.
Background technique
Currently, user can be communicated by electronic equipment, and such as: two or more main broadcasters can be by each
From electronic equipment carry out even wheat.
During user is communicated by electronic equipment, there are such a case: the microphone of each user
Input audio in can be mixed with the user loudspeaker broadcasting audio generate echo, that is, loudspeaker sound pass through
Space reflection produces echo, and generated echo is input in Mike again goes.The presence of echo makes user logical
During letter, the sound of other users can not only be heard, moreover it is possible to hear the sound of oneself, echo is larger to the interference of communication, leads
Cause communication efficiency poor.
Summary of the invention
The embodiment of the present invention is designed to provide a kind of echo removing method, device, electronic equipment and storage medium, with
Lower interference of the echo to communication, improves communication efficiency.Specific technical solution is as follows:
A kind of echo removing method is applied to local terminal electronic equipment, the local terminal electronic equipment and at least one opposite end electricity
Sub- equipment communication connection, which comprises
Receive the opposite end audio that at least one described opposite end electronic equipment is sent；
Obtain the input audio that the microphone of the local terminal electronic equipment receives, wherein the input audio includes institute
State the echo and local terminal audio of the generation of opposite end audio；
Audio by the echo and local terminal audio merging in the input audio, after being merged；
From the audio after the merging, removes the echo and be eliminated the audio after echo；
Audio after the elimination echo is sent at least one described remote electronics.
Optionally, the echo by the input audio and the local terminal audio merge, after being merged
The step of audio, comprising:
The echo and the local terminal audio are subjected to linear superposition；
Using the audio after linear superposition as the audio after merging.
Optionally, the echo by the input audio and the local terminal audio merge, after being merged
The step of audio, comprising:
The echo and the local terminal audio are subjected to linear superposition, audio after being superimposed；
Decayed using default decay factor to audio after the superposition, the audio after being merged.
Optionally, it in the audio from after the merging, removes the echo and is eliminated the step of the audio after echo
Suddenly, comprising:
Based on the opposite end audio and default echo path function, determine that the opposite end audio is corresponding with reference to echo；
Audio from the audio after the merging, after removing the echo that is eliminated with reference to echo.
A kind of echo eliminating device is applied to local terminal electronic equipment, the local terminal electronic equipment and at least one opposite end electricity
Sub- equipment communication connection, described device include:
Receiving module, the opposite end audio sent for receiving at least one described opposite end electronic equipment；
Obtain module, the input audio that the microphone for obtaining the local terminal electronic equipment receives, wherein described defeated
Entering audio includes the echo and local terminal audio that the opposite end audio generates；
Merging module, for by the input audio the echo and the local terminal audio merge, after obtaining merging
Audio；
Module is removed, is eliminated the audio after echo for from the audio after the merging, removing the echo；
Sending module, for the audio after the elimination echo to be sent at least one described remote electronics.
Optionally, the merging module, comprising:
Linear superposition unit, for the echo and the local terminal audio to be carried out linear superposition；
Determination unit, for using the audio after linear superposition as the audio after merging.
Optionally, the merging module, comprising:
Audio determination unit after superposition is superimposed for the echo and the local terminal audio to be carried out linear superposition
Audio afterwards；
Attenuation units, for being decayed using default decay factor to audio after the superposition, the sound after being merged
Frequently.
Optionally, the removal module, comprising:
With reference to echo determination unit, for being based on the opposite end audio and default echo path function, it is described right to determine
Hold audio is corresponding to refer to echo；
Removal unit, for the sound from the audio after the merging, after removing the echo that is eliminated with reference to echo
Frequently.
A kind of electronic equipment, including processor and memory,
Memory, for storing computer program；
Processor when for executing the program stored on memory, realizes any of the above-described method and step.
A kind of computer readable storage medium is stored with computer program in the computer readable storage medium, described
Any of the above-described method and step is realized when computer program is executed by processor.
In the embodiment of the present invention, the opposite end audio of at least one opposite end electronic equipment transmission is received, local terminal electronics is obtained and sets
The input audio that standby microphone receives, wherein input audio includes the echo and local terminal audio that opposite end audio generates, will be defeated
The echo and local terminal audio entered in audio merges, the audio after being merged, and from the audio after merging, removal echo is disappeared
Except the audio after echo, the audio after elimination echo is sent at least one remote electronics.In the present invention, by that will return
The mode that sound and local terminal audio merge, the audio after being merged all the way, and echo cancellation is carried out to the audio after merging all the way,
Be eliminated the audio after echo, then will eliminate the audio after echo and is sent at least one remote electronics, so that far
End electronic equipment no longer receives echo, reduces the interference of echo, improves communication efficiency.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with
It obtains other drawings based on these drawings.
Fig. 1 is the application scenarios structural schematic diagram of echo removing method provided in an embodiment of the present invention；
Fig. 2 is a kind of flow diagram of echo removing method provided in an embodiment of the present invention；
Fig. 3 is that the echo and local terminal audio provided in an embodiment of the present invention by input audio merges, after being merged
The first flow diagram of audio；
Fig. 4 is that the echo and local terminal audio provided in an embodiment of the present invention by input audio merges, after being merged
Second of flow diagram of audio；
Fig. 5 is in the audio provided in an embodiment of the present invention from after merging, and removal echo is eliminated the audio after echo
Flow diagram；
Fig. 6 is a kind of structural schematic diagram of echo eliminating device provided in an embodiment of the present invention；
Fig. 7 is the structural schematic diagram of a kind of electronic equipment provided in an embodiment of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall within the protection scope of the present invention.
In order to solve prior art problem, the embodiment of the invention provides a kind of echo removing method, device, electronic equipments
And storage medium.
A kind of echo removing method is provided for the embodiments of the invention first to be introduced.
The application scenarios for being provided for the embodiments of the invention a kind of echo removing method below are introduced:
As shown in Figure 1, application scenarios include at least two electronic equipments, any one electronics at least two electronic equipments
Equipment can be used as local terminal electronic equipment, and other electronic equipments at least two electronic equipments in addition to local terminal electronic equipment are equal
For opposite end electronic equipment, local terminal electronic equipment and at least one opposite end electronic equipment are communicated to connect.
Each electronic equipment is provided with microphone and loudspeaker, and the microphone of local terminal electronic equipment receives local terminal audio, and
Local terminal audio is transmitted to opposite end electronic equipment, the loudspeaker of opposite end electronic equipment plays the local terminal audio received；Opposite end electronics
The microphone of equipment receives opposite end audio, and transmits opposite end audio to local terminal electronic equipment, and the loudspeaker of local terminal electronic equipment is broadcast
Put the opposite end audio received.
Wherein, the audio that local terminal audio can receive for the microphone of local terminal electronic equipment, opposite end audio are opposite end electronics
The audio that equipment can receive.
Such as: assuming that main broadcaster 1 is located at local terminal, main broadcaster 2 is located at opposite end, then electronic equipment used in main broadcaster 1 is local terminal electricity
Sub- equipment, electronic equipment used in main broadcaster 2 are opposite end electronic equipment, it is assumed that main broadcaster 1 and main broadcaster 2 connect wheat, at this time the sound of main broadcaster 1
Sound is local terminal audio, and the sound of main broadcaster 2 is opposite end audio；
The microphone of local terminal electronic equipment receives the sound of main broadcaster 1, and transmits the sound of main broadcaster 1 to opposite end electronic equipment,
The loudspeaker of opposite end electronic equipment plays the sound of the main broadcaster 1 received, at this point, main broadcaster 2 can hear the sound of main broadcaster 1；It is right
It holds the microphone of electronic equipment to receive the sound of main broadcaster 2, and transmits the sound of main broadcaster 2 to local terminal electronic equipment, local terminal electronics is set
Standby loudspeaker plays the sound of the main broadcaster 2 received, at this point, main broadcaster 1 can hear the sound of main broadcaster 2.
A kind of echo removing method provided in an embodiment of the present invention is applied to local terminal electronic equipment, which can
To include but is not limited to following equipment: desktop computer, laptop, mobile phone.
As shown in Fig. 2, a kind of echo removing method provided in an embodiment of the present invention, is applied to local terminal electronic equipment, local terminal
Electronic equipment and at least one opposite end electronic equipment communicate to connect, and this method may include:
S101: the opposite end audio of at least one opposite end electronic equipment transmission is received.
Since local terminal electronic equipment and at least one opposite end electronic equipment communicate to connect, so, in opposite end, electronic equipment has
Sound export when, so that it may receive opposite end electronic equipment transmission opposite end audio, and due to local terminal electronic equipment communication link
The opposite end electronic equipment connect not necessarily while having sound output, and therefore, local terminal electronic equipment receives at least one opposite end electronics and sets
The opposite end audio that preparation is sent.
S102: the input audio that the microphone of local terminal electronic equipment receives is obtained, wherein input audio includes opposite end sound
The echo and local terminal audio that frequency generates.
The sound that loudspeaker plays, that is, loudspeaker plays audio and produces echo by space reflection, the echo of generation with raise
Sound device broadcasting audio is highly relevant, and it is identical that the semanteme and loudspeaker of echo, which play the semanteme of audio, that is to say, that echo is listened
Get up as playing audio with loudspeaker, but it is not exactly the same that substantially echo and loudspeaker, which play audio,.
When the microphone of local terminal electronic equipment receives audio, can not only receive local terminal audio can also receive local terminal electricity
The loudspeaker of sub- equipment plays the echo that audio generates and therefore in order to eliminate echo, needs to obtain the Mike of local terminal electronic equipment
The input audio that wind receives, wherein input audio includes the echo and local terminal audio that opposite end audio generates.
S103: the audio by the echo and the merging of local terminal audio in input audio, after being merged.
Since echo cancellation technology is only capable of carrying out echo cancellation to audio all the way, in order to be returned to input audio
Sound is eliminated, and the audio by the echo and the merging of local terminal audio in input audio, after being merged is needed.
Above-mentioned echo and local terminal audio by input audio merges, and there are many modes of the audio after being merged, packet
It includes but is not limited to following several:
First way:
Referring to Fig. 3, step S103 may include:
S1031: echo and local terminal audio are subjected to linear superposition.
Sound is a kind of pressure wave for having object vibration to generate pressure to the air of surrounding and propagating, and is converted into electric signal
Afterwards, through oversampling, quantization, be still a kind of waveform signal of continuously smooth.The frequency and sound of voice signal after quantization
Frequency it is corresponding, amplitude is corresponding with the volume of sound.
After sound is quantified as voice signal, so that it may carry out linear superposition to voice signal.Voice letter after quantization
Number linear superposition be equal to air in sound wave linear superposition.
Since echo and local terminal audio are the voice signal after quantization, in order to which echo and local terminal audio are closed
And echo and local terminal audio can be subjected to linear superposition.
S1032: using the audio after linear superposition as the audio after merging.
It, can be using the audio after linear superposition as the sound after merging after echo and local terminal audio are carried out linear superposition
Frequently.
As a result, by way of linear superposition, audio all the way is merged into echo and local terminal audio.
The second way:
Referring to fig. 4, step S103 may include:
S1033: echo and local terminal audio are subjected to linear superposition, audio after being superimposed.
Sound is a kind of pressure wave for having object vibration to generate pressure to the air of surrounding and propagating, and is converted into electric signal
Afterwards, through oversampling, quantization, be still a kind of waveform signal of continuously smooth.The frequency and sound of voice signal after quantization
Frequency it is corresponding, amplitude is corresponding with the volume of sound.
After sound is quantified as voice signal, so that it may carry out linear superposition to voice signal.Voice letter after quantization
Number linear superposition be equal to air in sound wave linear superposition.
Since echo and local terminal audio are the voice signal after quantization, in order to which echo and local terminal audio are closed
And echo and local terminal audio can be subjected to linear superposition, audio after being superimposed.
S1034: decaying to audio after superposition using default decay factor, the audio after being merged.
Since the amplitude of audio after superposition is possible to very big, preset sound critical value is had exceeded, so that audio is made an uproar after superposition
Sound is larger, cause superposition after audio it is second-rate, therefore, in order to avoid reduce noise influence, need to denoise.
Illustratively, audio after superposition is denoised using adaptive weighted Mixed Audio Algorithm, the audio after being merged,
It is specifically as follows: is decayed using default decay factor to audio after superposition, the amplitude of audio after superposition is reduced, after making superposition
Audio is without departing from preset sound critical value.The noise of audio is smaller after superposition after decaying, and audio after the superposition after decaying is made
For the audio after merging.
As a result, by way of linear superposition and decaying, audio all the way is merged into echo and local terminal audio, so that closing
The noise of audio after and is less, improves the quality of audio after merging.
S104: from the audio after merging, removal echo is eliminated the audio after echo.
Audio all the way is being merged into echo and local terminal audio, that is, after the audio after merging, can to audio after merging into
Row echo cancellation.
Referring to Fig. 5, step S104 may include:
S1041: being based on opposite end audio and default echo path function, determines that opposite end audio is corresponding with reference to echo.
For being mixed with the voice flow of two sound, to separate them, then remove one of them, difficulty what it
Greatly.Just as one bottle of blue ink and one bottle of red ink are poured on together, it is the same for then needing red ink to extract.
It is and highly relevant with opposite end audio since echo is generated based on opposite end audio, therefore, opposite end sound can be based on
Frequency meter calculates the echo that opposite end audio generates, and is not local terminal electricity due to being the echo for the opposite end audio generation being calculated herein
The echo that the opposite end audio that the microphone of sub- equipment receives generates, therefore, the echo that the opposite end audio being calculated is generated
It is corresponding with reference to echo to be named as opposite end audio.
It illustratively, can be by the corresponding function for being expressed as opposite end audio with reference to echo of opposite end audio:
Echo=F (fe)
Wherein, echo is that opposite end audio is corresponding with reference to echo, and it is to indicate sound in wall that F, which is default echo path function,
The function of the physical process of the surfaces such as wall, ceiling multiple reflections, fe are opposite end audio.
There are many methods of determination of default echo path function, can be determined by sef-adapting filter principle, can also be with
It is determined by way of any determining echo path function in the prior art, details are not described herein.
Based on opposite end audio and above-mentioned formula, it is corresponding with reference to echo that opposite end audio can be obtained.
S1042: from the audio after merging, the audio after being eliminated echo with reference to echo is removed.
After obtaining the corresponding reference echo of opposite end audio, it can remove and be obtained with reference to echo from the audio after merging
Audio after eliminating echo.
Echo is referred to by determining as a result, then from the audio after merging, removal refers to the mode of echo, carries out
Echo cancellation.
S105: the audio after elimination echo is sent at least one remote electronics.
After the audio after the echo that is eliminated, the audio after elimination echo can be sent at least one remote electronic
Equipment.
Due to only including local terminal audio in the audio after elimination echo, at least one remote electronics is receiving
After audio after to elimination echo, the audio eliminated after echo received is played by loudspeaker, that is, pass through loudspeaker
Local terminal audio is played, no longer there is the echo of opposite end audio generation.
In the embodiment of the present invention, the opposite end audio of at least one opposite end electronic equipment transmission is received, local terminal electronics is obtained and sets
The input audio that standby microphone receives, wherein input audio includes the echo and local terminal audio that opposite end audio generates, will be defeated
The echo and local terminal audio entered in audio merges, the audio after being merged, and from the audio after merging, removal echo is disappeared
Except the audio after echo, the audio after elimination echo is sent at least one remote electronics.In the present invention, by that will return
The mode that sound and local terminal audio merge, the audio after being merged all the way, and echo cancellation is carried out to the audio after merging all the way,
Be eliminated the audio after echo, then will eliminate the audio after echo and is sent at least one remote electronics, so that far
End electronic equipment no longer receives echo, reduces the interference of echo, improves communication efficiency.
Corresponding with above method embodiment, the embodiment of the present invention also provides a kind of echo eliminating device, as shown in fig. 6,
Applied to local terminal electronic equipment, the local terminal electronic equipment and at least one opposite end electronic equipment are communicated to connect, and described device can
To include:
Receiving module 601, the opposite end audio sent for receiving at least one described opposite end electronic equipment；
Obtain module 602, the input audio that the microphone for obtaining the local terminal electronic equipment receives, wherein institute
Stating input audio includes the echo and local terminal audio that the opposite end audio generates；
Merging module 603, for being merged the echo and local terminal audio merging in the input audio
Audio afterwards；
Module 604 is removed, is eliminated the sound after echo for from the audio after the merging, removing the echo
Frequently；
Sending module 605, for the audio after the elimination echo to be sent at least one described remote electronics.
In the embodiment of the present invention, the opposite end audio of at least one opposite end electronic equipment transmission is received, local terminal electronics is obtained and sets
The input audio that standby microphone receives, wherein input audio includes the echo and local terminal audio that opposite end audio generates, will be defeated
The echo and local terminal audio entered in audio merges, the audio after being merged, and from the audio after merging, removal echo is disappeared
Except the audio after echo, the audio after elimination echo is sent at least one remote electronics.In the present invention, by that will return
The mode that sound and local terminal audio merge, the audio after being merged all the way, and echo cancellation is carried out to the audio after merging all the way,
Be eliminated the audio after echo, then will eliminate the audio after echo and is sent at least one remote electronics, so that far
End electronic equipment no longer receives echo, reduces the interference of echo, improves communication efficiency.
In a kind of implementation of the invention, the merging module 603 may include:
Linear superposition unit, for the echo and the local terminal audio to be carried out linear superposition；
Determination unit, for using the audio after linear superposition as the audio after merging.
In a kind of implementation of the invention, the merging module 603 may include:
Audio determination unit after superposition is superimposed for the echo and the local terminal audio to be carried out linear superposition
Audio afterwards；
Attenuation units, for being decayed using default decay factor to audio after the superposition, the sound after being merged
Frequently.
In a kind of implementation of the invention, the removal module 604 may include:
With reference to echo determination unit, for being based on the opposite end audio and default echo path function, it is described right to determine
Hold audio is corresponding to refer to echo；
Removal unit, for the sound from the audio after the merging, after removing the echo that is eliminated with reference to echo
Frequently.
The embodiment of the invention also provides a kind of electronic equipment, as shown in fig. 7, comprises processor 701 and memory 702,
Memory 702, for storing computer program；
Processor 701 when for executing the computer program stored on memory 702, being realized and being applied to local terminal electronics
The echo removing method of equipment, the local terminal electronic equipment and at least one opposite end electronic equipment communicate to connect, and this method can be with
Include the following steps:
Receive the opposite end audio that at least one described opposite end electronic equipment is sent；
Obtain the input audio that the microphone of the local terminal electronic equipment receives, wherein the input audio includes institute
State the echo and local terminal audio of the generation of opposite end audio；
Audio by the echo and local terminal audio merging in the input audio, after being merged；
From the audio after the merging, removes the echo and be eliminated the audio after echo；
Audio after the elimination echo is sent at least one described remote electronics.
In the embodiment of the present invention, electronic equipment receives the opposite end audio of at least one opposite end electronic equipment transmission, obtains this
The input audio that the microphone of end electronic equipment receives, wherein input audio includes the echo and local terminal that opposite end audio generates
Audio, by the echo and the merging of local terminal audio in input audio, the audio after being merged is removed from the audio after merging
Echo is eliminated the audio after echo, will eliminate the audio after echo and is sent at least one remote electronics.The present invention
In, in such a way that echo and local terminal audio are merged, audio after being merged all the way, and to the audio after merging all the way into
Then audio after elimination echo is sent at least one remote electronic by row echo cancellation, the audio after the echo that is eliminated
Equipment reduces the interference of echo, improves communication efficiency so that remote electronics no longer receive echo.
At this point, a kind of electronic equipment provided in an embodiment of the present invention is exactly local terminal electronic equipment.
In a kind of implementation of the invention, the echo and the local terminal audio by the input audio
Merge, the step of audio after being merged, may include:
The echo and the local terminal audio are subjected to linear superposition；
Using the audio after linear superposition as the audio after merging.
In a kind of implementation of the invention, the echo and the local terminal audio by the input audio
Merge, the step of audio after being merged, may include:
The echo and the local terminal audio are subjected to linear superposition, audio after being superimposed；
Decayed using default decay factor to audio after the superposition, the audio after being merged.
In a kind of implementation of the invention, in the audio from after the merging, removes the echo and disappeared
The step of except audio after echo, may include:
Based on the opposite end audio and default echo path function, determine that the opposite end audio is corresponding with reference to echo；
Audio from the audio after the merging, after removing the echo that is eliminated with reference to echo.
The memory that above-mentioned electronic equipment is mentioned may include random access memory (Random Access Memory,
It RAM), also may include nonvolatile memory (Non-Volatile Memory, NVM), for example, at least a disk storage
Device.Optionally, memory can also be that at least one is located remotely from the storage device of aforementioned processor.
Above-mentioned processor can be general processor, including central processing unit (Central Processing Unit,
CPU), network processing unit (Network Processor, NP) etc.；It can also be digital signal processor (Digital Signal
Processing, DSP), it is specific integrated circuit (Application Specific Integrated Circuit, ASIC), existing
It is field programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic device, discrete
Door or transistor logic, discrete hardware components.
The embodiment of the present invention also provides a kind of computer readable storage medium, storage in the computer readable storage medium
There is computer program, the echo cancellation side for being applied to local terminal electronic equipment is realized when the computer program is executed by processor
Method, the local terminal electronic equipment and at least one opposite end electronic equipment communicate to connect, and this method may include steps of:
Receive the opposite end audio that at least one described opposite end electronic equipment is sent；
Obtain the input audio that the microphone of the local terminal electronic equipment receives, wherein the input audio includes institute
State the echo and local terminal audio of the generation of opposite end audio；
Audio by the echo and local terminal audio merging in the input audio, after being merged；
From the audio after the merging, removes the echo and be eliminated the audio after echo；
Audio after the elimination echo is sent at least one described remote electronics.
The transmission of at least one opposite end electronic equipment is received in the embodiment of the present invention, when computer program is executed by processor
Opposite end audio obtains the input audio that the microphone of local terminal electronic equipment receives, wherein input audio includes that opposite end audio produces
Raw echo and local terminal audio, by input audio echo and local terminal audio merge, audio after being merged, after merging
Audio in, removal echo is eliminated the audio after echo, will eliminate the audio after echo and is sent at least one distal end electricity
Sub- equipment.In the present invention, in such a way that echo and local terminal audio are merged, audio after being merged all the way, and to all the way
Audio after merging carries out echo cancellation, the audio after the echo that is eliminated, then will eliminate the audio after echo be sent to
Few remote electronics reduce the interference of echo so that remote electronics no longer receive echo, improve communication
Effect.
In a kind of implementation of the invention, the echo and the local terminal audio by the input audio
Merge, the step of audio after being merged, may include:
The echo and the local terminal audio are subjected to linear superposition；
Using the audio after linear superposition as the audio after merging.
In a kind of implementation of the invention, the echo and the local terminal audio by the input audio
Merge, the step of audio after being merged, may include:
The echo and the local terminal audio are subjected to linear superposition, audio after being superimposed；
Decayed using default decay factor to audio after the superposition, the audio after being merged.
In a kind of implementation of the invention, in the audio from after the merging, removes the echo and disappeared
The step of except audio after echo, may include:
Based on the opposite end audio and default echo path function, determine that the opposite end audio is corresponding with reference to echo；
Audio from the audio after the merging, after removing the echo that is eliminated with reference to echo.
It should be noted that, in this document, relational terms such as first and second and the like are used merely to a reality
Body or operation are distinguished with another entity or operation, are deposited without necessarily requiring or implying between these entities or operation
In any actual relationship or order or sequence.Moreover, the terms "include", "comprise" or its any other variant are intended to
Non-exclusive inclusion, so that the process, method, article or equipment including a series of elements is not only wanted including those
Element, but also including other elements that are not explicitly listed, or further include for this process, method, article or equipment
Intrinsic element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that
There is also other identical elements in process, method, article or equipment including the element.
Each embodiment in this specification is all made of relevant mode and describes, same and similar portion between each embodiment
Dividing may refer to each other, and each embodiment focuses on the differences from other embodiments.Especially for system reality
For applying example, since it is substantially similar to the method embodiment, so being described relatively simple, related place is referring to embodiment of the method
Part explanation.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the scope of the present invention.It is all
Any modification, equivalent replacement, improvement and so within the spirit and principles in the present invention, are all contained in protection scope of the present invention
It is interior.
Claims (10)
1. a kind of echo removing method, which is characterized in that be applied to local terminal electronic equipment, the local terminal electronic equipment and at least one
A opposite end electronic equipment communication connection, which comprises
Receive the opposite end audio that at least one described opposite end electronic equipment is sent；
Obtain the input audio that the microphone of the local terminal electronic equipment receives, wherein the input audio includes described right
The echo and local terminal audio for holding audio to generate；
Audio by the echo and local terminal audio merging in the input audio, after being merged；
From the audio after the merging, removes the echo and be eliminated the audio after echo；
Audio after the elimination echo is sent at least one described remote electronics.
2. the method according to claim 1, wherein the echo by the input audio and described
The step of local terminal audio merges, audio after being merged, comprising:
The echo and the local terminal audio are subjected to linear superposition；
Using the audio after linear superposition as the audio after merging.
3. the method according to claim 1, wherein the echo by the input audio and described
The step of local terminal audio merges, audio after being merged, comprising:
The echo and the local terminal audio are subjected to linear superposition, audio after being superimposed；
Decayed using default decay factor to audio after the superposition, the audio after being merged.
4. the method according to claim 1, wherein removal is described to return in the audio from after the merging
Sound be eliminated the audio after echo the step of, comprising:
Based on the opposite end audio and default echo path function, determine that the opposite end audio is corresponding with reference to echo；
Audio from the audio after the merging, after removing the echo that is eliminated with reference to echo.
5. a kind of echo eliminating device, which is characterized in that be applied to local terminal electronic equipment, the local terminal electronic equipment and at least one
A opposite end electronic equipment communication connection, described device include:
Receiving module, the opposite end audio sent for receiving at least one described opposite end electronic equipment；
Obtain module, the input audio that the microphone for obtaining the local terminal electronic equipment receives, wherein the input sound
Frequency includes the echo and local terminal audio that the opposite end audio generates；
Merging module, for the sound by the echo and local terminal audio merging in the input audio, after being merged
Frequently；
Module is removed, is eliminated the audio after echo for from the audio after the merging, removing the echo；
Sending module, for the audio after the elimination echo to be sent at least one described remote electronics.
6. device according to claim 5, which is characterized in that the merging module, comprising:
Linear superposition unit, for the echo and the local terminal audio to be carried out linear superposition；
Determination unit, for using the audio after linear superposition as the audio after merging.
7. device according to claim 5, which is characterized in that the merging module, comprising:
Audio determination unit after superposition, for the echo and the local terminal audio to be carried out linear superposition, sound after being superimposed
Frequently；
Attenuation units, for being decayed using default decay factor to audio after the superposition, the audio after being merged.
8. device according to claim 5, which is characterized in that the removal module, comprising:
The opposite end sound is determined for being based on the opposite end audio and default echo path function with reference to echo determination unit
Frequently corresponding to refer to echo；
Removal unit, for the audio from the audio after the merging, after removing the echo that is eliminated with reference to echo.
9. a kind of electronic equipment, which is characterized in that including processor and memory,
Memory, for storing computer program；
Processor when for executing the program stored on memory, realizes any method and step of claim 1-4.
10. a kind of computer readable storage medium, which is characterized in that be stored with computer in the computer readable storage medium
Program realizes claim 1-4 any method and step when the computer program is executed by processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810508076.3A CN109003620A (en) | 2018-05-24 | 2018-05-24 | A kind of echo removing method, device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810508076.3A CN109003620A (en) | 2018-05-24 | 2018-05-24 | A kind of echo removing method, device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109003620A true CN109003620A (en) | 2018-12-14 |
Family
ID=64573888
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810508076.3A Pending CN109003620A (en) | 2018-05-24 | 2018-05-24 | A kind of echo removing method, device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109003620A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110138650A (en) * | 2019-05-14 | 2019-08-16 | 北京达佳互联信息技术有限公司 | Sound quality optimization method, device and the equipment of instant messaging |
| CN111863011A (en) * | 2020-07-30 | 2020-10-30 | 北京达佳互联信息技术有限公司 | Audio processing method and electronic equipment |
| CN115472175A (en) * | 2022-08-31 | 2022-12-13 | 海尔优家智能科技（北京）有限公司 | Echo cancellation method and device for audio resource, storage medium and electronic device |
Citations (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1946029A (en) * | 2006-10-30 | 2007-04-11 | 北京中星微电子有限公司 | Method and its system for treating audio signal |
| CN101043560A (en) * | 2006-03-22 | 2007-09-26 | 北京大学深圳研究生院 | Echo eliminator and echo cancellation method |
| CN101583996A (en) * | 2006-12-30 | 2009-11-18 | 摩托罗拉公司 | Method and noise suppression circuit incorporating multiple noise suppression techniques |
| CN101661751A (en) * | 2008-08-29 | 2010-03-03 | 华为技术有限公司 | Method and device for evaluating acoustic echo cancellation algorithm |
| CN101989430A (en) * | 2009-07-30 | 2011-03-23 | 比亚迪股份有限公司 | Audio mixing processing system and audio mixing processing method |
| KR101133308B1 (en) * | 2011-02-14 | 2012-04-04 | 신두식 | Microphone with a function of removing an echo |
| CN103152500A (en) * | 2013-02-21 | 2013-06-12 | 中国对外翻译出版有限公司 | Method for eliminating echo from multi-party call |
| CN103458137A (en) * | 2012-05-07 | 2013-12-18 | 马维尔国际贸易有限公司 | Systems and methods for voice enhancement in audio conference |
| CN103617797A (en) * | 2013-12-09 | 2014-03-05 | 腾讯科技（深圳）有限公司 | Voice processing method and device |
| CN104969537A (en) * | 2012-12-21 | 2015-10-07 | 微软技术许可有限责任公司 | Echo suppression |
| CN105516859A (en) * | 2015-11-27 | 2016-04-20 | 深圳Tcl数字技术有限公司 | Method and system for eliminating echo |
| CN106534762A (en) * | 2016-11-16 | 2017-03-22 | 深圳市捷视飞通科技股份有限公司 | Low-time-delay distributed audio processing method and system |
| CN106576205A (en) * | 2014-08-13 | 2017-04-19 | 三菱电机株式会社 | echo canceller |
| CN106910510A (en) * | 2017-02-16 | 2017-06-30 | 智车优行科技（北京）有限公司 | Vehicle-mounted power amplifying device, vehicle and its audio play handling method |
| CN107105111A (en) * | 2017-03-15 | 2017-08-29 | 西南交通大学 | One kind combination proportional affine projection echo cancel method of step-length |
| CN107211063A (en) * | 2015-02-03 | 2017-09-26 | 微软技术许可有限责任公司 | Non-linear echo paths are detected |
| CN107886965A (en) * | 2017-11-28 | 2018-04-06 | 游密科技(深圳)有限公司 | The echo cancel method of game background sound |
| CN108022598A (en) * | 2017-12-30 | 2018-05-11 | 东莞市艺展电子有限公司 | A clean sound front-end speech processing system |
-
2018
- 2018-05-24 CN CN201810508076.3A patent/CN109003620A/en active Pending
Patent Citations (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101043560A (en) * | 2006-03-22 | 2007-09-26 | 北京大学深圳研究生院 | Echo eliminator and echo cancellation method |
| CN1946029A (en) * | 2006-10-30 | 2007-04-11 | 北京中星微电子有限公司 | Method and its system for treating audio signal |
| CN101583996A (en) * | 2006-12-30 | 2009-11-18 | 摩托罗拉公司 | Method and noise suppression circuit incorporating multiple noise suppression techniques |
| CN101661751A (en) * | 2008-08-29 | 2010-03-03 | 华为技术有限公司 | Method and device for evaluating acoustic echo cancellation algorithm |
| CN101989430A (en) * | 2009-07-30 | 2011-03-23 | 比亚迪股份有限公司 | Audio mixing processing system and audio mixing processing method |
| KR101133308B1 (en) * | 2011-02-14 | 2012-04-04 | 신두식 | Microphone with a function of removing an echo |
| CN103458137A (en) * | 2012-05-07 | 2013-12-18 | 马维尔国际贸易有限公司 | Systems and methods for voice enhancement in audio conference |
| CN104969537A (en) * | 2012-12-21 | 2015-10-07 | 微软技术许可有限责任公司 | Echo suppression |
| CN103152500A (en) * | 2013-02-21 | 2013-06-12 | 中国对外翻译出版有限公司 | Method for eliminating echo from multi-party call |
| CN103617797A (en) * | 2013-12-09 | 2014-03-05 | 腾讯科技（深圳）有限公司 | Voice processing method and device |
| CN106576205A (en) * | 2014-08-13 | 2017-04-19 | 三菱电机株式会社 | echo canceller |
| CN107211063A (en) * | 2015-02-03 | 2017-09-26 | 微软技术许可有限责任公司 | Non-linear echo paths are detected |
| CN105516859A (en) * | 2015-11-27 | 2016-04-20 | 深圳Tcl数字技术有限公司 | Method and system for eliminating echo |
| CN106534762A (en) * | 2016-11-16 | 2017-03-22 | 深圳市捷视飞通科技股份有限公司 | Low-time-delay distributed audio processing method and system |
| CN106910510A (en) * | 2017-02-16 | 2017-06-30 | 智车优行科技（北京）有限公司 | Vehicle-mounted power amplifying device, vehicle and its audio play handling method |
| CN107105111A (en) * | 2017-03-15 | 2017-08-29 | 西南交通大学 | One kind combination proportional affine projection echo cancel method of step-length |
| CN107886965A (en) * | 2017-11-28 | 2018-04-06 | 游密科技(深圳)有限公司 | The echo cancel method of game background sound |
| CN108022598A (en) * | 2017-12-30 | 2018-05-11 | 东莞市艺展电子有限公司 | A clean sound front-end speech processing system |
Non-Patent Citations (2)
| Title |
|---|
| 张微: "VOIP电话会议系统中混音模块关键技术的研究与实现", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
| 杨义先等: "《2006北京地区高校研究生学术交流会 通信与信息技术会议论文集下》", 31 December 2006 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110138650A (en) * | 2019-05-14 | 2019-08-16 | 北京达佳互联信息技术有限公司 | Sound quality optimization method, device and the equipment of instant messaging |
| CN111863011A (en) * | 2020-07-30 | 2020-10-30 | 北京达佳互联信息技术有限公司 | Audio processing method and electronic equipment |
| CN111863011B (en) * | 2020-07-30 | 2024-03-12 | 北京达佳互联信息技术有限公司 | Audio processing method and electronic equipment |
| CN115472175A (en) * | 2022-08-31 | 2022-12-13 | 海尔优家智能科技（北京）有限公司 | Echo cancellation method and device for audio resource, storage medium and electronic device |
| CN115472175B (en) * | 2022-08-31 | 2025-02-11 | 海尔优家智能科技（北京）有限公司 | Audio resource echo cancellation method and device, storage medium and electronic device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101826892B (en) | Echo canceller | |
| US10121490B2 (en) | Acoustic signal processing system capable of detecting double-talk and method | |
| CN111402910B (en) | Method and equipment for eliminating echo | |
| US8908882B2 (en) | Reparation of corrupted audio signals | |
| US20140064508A1 (en) | System for adaptive audio signal shaping for improved playback in a noisy environment | |
| CN110769352B (en) | Signal processing method and device and computer storage medium | |
| CN103873975A (en) | Bluetooth headset noise reduction method, device and system | |
| US8498429B2 (en) | Acoustic correction apparatus, audio output apparatus, and acoustic correction method | |
| CN110956976B (en) | Echo cancellation method, device and equipment and readable storage medium | |
| CN108206023A (en) | Sound processing apparatus and sound processing method | |
| CN109493883A (en) | A kind of audio time-delay calculation method and apparatus of smart machine and its smart machine | |
| CN112466319A (en) | Audio processing method and device, computer equipment and storage medium | |
| CN109003620A (en) | A kind of echo removing method, device, electronic equipment and storage medium | |
| EP2806424A1 (en) | Improved noise reduction | |
| CN104581519A (en) | Noise reduction earphone and noise reduction method thereof | |
| CN104581526A (en) | Sensor | |
| CN109727605B (en) | Method and system for processing sound signal | |
| CN111356058A (en) | An echo cancellation method, device and smart speaker | |
| CN109067998A (en) | Sound adjusting method, terminal device and the device with store function | |
| CN108234793B (en) | Communication method, communication device, electronic equipment and storage medium | |
| JP2006139307A (en) | Apparatus and method having voice effect processing and noise control | |
| CN106297816B (en) | Echo cancellation nonlinear processing method and device and electronic equipment | |
| CN112997249B (en) | Voice processing method, device, storage medium and electronic equipment | |
| CN102044252B (en) | Device and method for eliminating noise | |
| CN107197403A (en) | A kind of terminal audio frequency parameter management method, apparatus and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20210205 Address after: 101300 309, 3rd floor, 60 Fuqian 1st Street, Tianzhu District, Shunyi District, Beijing Applicant after: Beijing longzhixin Technology Co.,Ltd. Address before: 100041 room a-1123, 2nd floor, building 3, yard 30, Shixing street, Shijingshan District, Beijing Applicant before: BEIJING PANDA MUTUAL ENTERTAINMENT TECHNOLOGY Co.,Ltd. |
|
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20181214 |