CN110536193B - Audio signal processing method and device - Google Patents

Abstract

The embodiment of the invention discloses a method and a device for processing an audio signal, relates to the technical field of electronics, and solves the problem that the environmental noise in the audio signal acquired by electronic equipment accounts for a relatively large proportion under the condition that a sound receiving hole connected with a main microphone is blocked and a sound receiving hole connected with an auxiliary microphone is not blocked. The electronic equipment determines that the first audio acquisition module is abnormal according to the first audio signal acquired by the first audio acquisition module, and calculates an adjustment proportion according to the amplitude value of the first audio signal and a first preset threshold, wherein the first preset threshold is the amplitude threshold of the current audio signal acquired by the first audio acquisition module; adjusting the audio signal acquired by the second audio acquisition module by adopting the adjustment proportion to obtain a second audio signal; and determining the difference value of the first audio signal and the second audio signal as the audio signal acquired by the electronic equipment.

Description

A kind of audio signal processing method and device

technical field

The present application relates to the field of electronic technology, and in particular, to a method and device for processing audio signals.

Background technique

Current electronic devices (such as mobile phones) commonly use two microphones (such as a primary MIC and a secondary MIC) to collect audio signals. Among the audio signals collected by the main MIC, the user's voice signal accounts for a relatively large proportion, and the environmental noise accounts for a relatively small proportion. In the audio signal collected by the secondary MIC, the user's voice signal accounts for a small proportion, and the environmental noise accounts for a relatively large proportion. Usually, the electronic device takes the difference between the audio signal collected by the main MIC and the audio signal collected by the secondary MIC as the audio signal finally obtained by the electronic device, which effectively shields the environmental noise.

In order to facilitate the collection of audio signals, a sound-receiving hole connected to the MIC is provided on the shell of the electronic device. When the user holds the electronic device or there are objects around the electronic device, it may happen that the sound receiving hole connected to the main MIC is blocked, but the sound receiving hole connected to the secondary MIC is not blocked. In this case, ambient noise accounts for a large proportion of the audio signal finally obtained by the electronic device, which affects the user experience.

SUMMARY OF THE INVENTION

The present application provides an audio signal processing method and device, which can solve the environmental noise in the audio signal finally obtained by the electronic device under the condition that the sound receiving hole connected to the main MIC is blocked and the sound receiving hole connected to the secondary MIC is not blocked. It accounts for a large proportion and affects the user experience.

To achieve the above object, the application adopts the following technical solutions:

In a first aspect, an audio signal processing method is provided, and the processing method is applied to an electronic device including a first audio collection module and a second audio collection module. Specifically, after determining that the first audio collection module is abnormal according to the first audio signal collected by the first audio collection module, the electronic device determines that the first audio collection module is abnormal according to the amplitude value of the first audio signal and the first preset threshold (the first audio collection module The amplitude threshold of the currently collected audio signal), calculate the adjustment ratio, and use the adjustment ratio to adjust the audio signal collected by the second audio acquisition module to obtain the second audio signal; after that, the electronic device determines the difference between the first audio signal and the second audio signal. The difference is the audio signal obtained by the electronic device.

In the scenario where the first audio collection module is abnormal, the electronic device adaptively adjusts the audio signal collected by the second audio collection module to obtain the second audio signal, so that the first audio signal collected by the first audio collection module is the same as the first audio signal collected by the first audio collection module. The difference between the two audio signals is kept within a preset range, which effectively shields the ambient noise and improves the user experience.

Optionally, in a possible implementation manner of the present application, the above-mentioned method of "the electronic device calculates the adjustment ratio according to the amplitude value of the first audio signal and the first preset threshold" is: the electronic device converts the first audio signal The ratio of the amplitude value of , and the first preset threshold is determined as the adjustment ratio.

Optionally, in another possible implementation manner of the present application, the above-mentioned method of "the electronic device adjusts the ratio of the audio signal collected by the second audio acquisition module to obtain the second audio signal" is: the electronic device determines the adjustment The product of the ratio and the audio signal collected by the second audio collection module is the second audio signal.

Optionally, in another possible implementation manner of the present application, the above-mentioned method of "determining that the first audio collection module is abnormal according to the first audio signal collected by the first audio collection module" is as follows: the electronic device determines that the first audio signal is abnormal. Whether the amplitude value of the audio signal is less than the first preset threshold, if the amplitude value of the first audio signal is less than the first preset threshold, it is determined that the first audio acquisition module is abnormal; or, the electronic device determines whether the energy distribution of the first audio signal is not The preset conditions are met, and if the energy distribution of the first audio signal does not meet the preset conditions, it is determined that the first audio acquisition module is abnormal; or, the electronic device determines whether the amplitude value of the first audio signal is less than the first preset threshold, and the Whether the energy distribution of an audio signal satisfies a preset condition, if the amplitude value of the first audio signal is less than the first preset threshold, and the energy distribution of the first audio signal does not meet the preset condition, it is determined that the first audio collection module is abnormal.

Optionally, in another possible implementation manner of the present application, the electronic device further adjusts the first preset threshold by using the adjustment ratio to obtain the adjusted first preset threshold, and adjusts the second preset threshold by using the adjustment ratio. (the amplitude threshold of the audio signal currently collected by the second audio collection module), and obtain the adjusted second preset threshold. The adjusted first preset threshold is used by the electronic device to determine whether the audio signal collected by the first audio collection module is abnormal in the subsequent process. The adjusted second preset threshold is used by the electronic device to determine whether the audio signal collected by the second audio collection module is abnormal in the subsequent process.

In a second aspect, an audio signal processing device is provided, the processing device is located in an electronic device including a first audio acquisition module and a second audio acquisition module, and the processing device can implement the first aspect and any possible implementation manner thereof function in . These functions can be implemented by hardware or by executing corresponding software by hardware. The hardware or software includes one or more modules corresponding to the above functions.

In a possible manner of the present application, the audio signal processing apparatus may include a determination unit, a calculation unit, and an adjustment unit, and the determination unit, the calculation unit, and the adjustment unit may perform the above-mentioned first aspect and any one of its possible Corresponding functions in the audio signal processing method of the implementation. For example, the determining unit is configured to determine that the first audio collection module is abnormal according to the first audio signal collected by the first audio collection module. The calculation unit is configured to calculate the adjustment ratio according to the amplitude value of the first audio signal and the first preset threshold when the determination unit determines that the first audio collection module is abnormal, where the first preset threshold is the current value of the first audio collection module Amplitude threshold for acquiring audio signals. The adjustment unit is configured to adjust the audio signal collected by the second audio collection module by adjusting the ratio to obtain the second audio signal. The determining unit is further configured to determine that the difference between the first audio signal and the second audio signal is the audio signal obtained by the processing device.

In a third aspect, an apparatus is provided, comprising a processor and a memory; the memory is coupled to the processor; the memory is used to store computer program code, the computer program code including instructions, when the processor executes the When the instruction is executed, the device executes the corresponding function in the audio signal processing method of the first aspect and any possible implementation manner thereof.

In a fourth aspect, a computer-readable storage medium is also provided, in which computer instructions are stored; when the computer instructions are executed on the audio signal processing device, the audio signal processing device executes the above-mentioned first The audio signal processing method described in the aspect and its various possible implementation manners.

In a fifth aspect, a computer program product is also provided, the computer program product comprising computer instructions, when the computer instructions are executed on the audio signal processing device, the audio signal processing device is made to perform the above-mentioned first aspect and its various possibilities. The audio signal processing method described in the implementation manner.

It should be noted that all or part of the above computer instructions may be stored on a computer storage medium, wherein the first computer storage medium may be packaged with the processor or separately packaged with the processor, which is not limited in this application.

For the description of the second aspect, the third aspect, the fourth aspect, the fifth aspect and their various implementations in this application, reference may be made to the detailed descriptions in the first aspect and their various implementations; For the beneficial effects of the third aspect, the fourth aspect, the fifth aspect, and various implementations thereof, reference may be made to the analysis of the beneficial effects in the first aspect and its various implementations, which will not be repeated here.

In this application, the names of the above audio signal processing apparatuses do not limit the devices or functional modules themselves, and in actual implementation, these devices or functional modules may appear in other names. As long as the functions of each device or functional module are similar to those of the present application, they fall within the scope of the claims of the present application and their equivalents.

These and other aspects of the present application will be more clearly understood from the following description.

Description of drawings

1 is a schematic diagram of a hardware structure example of a device provided by an embodiment of the present application;

2A is a schematic diagram 1 of the distribution of the primary microphone and the secondary microphone in the embodiment of the present application;

FIG. 2B is a schematic diagram 2 of the distribution of the main microphone and the secondary microphone in the embodiment of the present application;

3 is a schematic flowchart 1 of an audio signal processing method provided by an embodiment of the present application;

4 is a second schematic flowchart of a method for processing an audio signal according to an embodiment of the present application;

5 is a schematic structural diagram of an apparatus for processing audio signals in an embodiment of the present application;

FIG. 6 is a schematic structural diagram of a computer program product in an embodiment of the present application.

Detailed ways

An embodiment of the present application provides an audio signal processing method, which can be applied to an electronic device including at least two audio collection modules (eg, microphones). Specifically, it can be applied to the process of collecting the user's voice data by the electronic device after the voice communication is established.

Taking an electronic device including a first audio acquisition module and a second audio acquisition module as an example, when it is determined that the first audio acquisition module is abnormal, in order to reduce the proportion of environmental noise in the audio signal acquired by the electronic device, the electronic device adapts to Adjust the audio signal collected by the second audio collection module, so that the difference between the audio signal collected by the first audio collection module and the audio signal adjusted by the second audio collection module remains within the preset range, effectively shielding It reduces the ambient noise and improves the user experience.

For example, the electronic device in this embodiment of the present application may be a mobile phone (mobile phone 100 shown in FIG. 1 ), a tablet computer, a personal computer (PC), a personal digital assistant (PDA), a netbook, Terminal equipment such as wearable electronic devices. The embodiments of the present application do not specifically limit the specific form of the electronic device.

For example, the above electronic device may be used to establish a voice call with other electronic devices, and execute the method provided by the embodiment of the present application to obtain an audio signal representing the user's voice data. Alternatively, the above-mentioned electronic device is installed with a client for voice calls, and the client may execute the method provided by the embodiment of the present application after establishing a communication link with other clients to obtain a voice data representing the user. audio signal.

As shown in FIG. 1 , taking the mobile phone 100 as the above electronic device as an example, the mobile phone 100 may specifically include: a processor 101 , a radio frequency (RF) circuit 102 , a memory 103 , a touch screen 104 , a Bluetooth device 105 , one or more Sensor 106 , WiFi device 107 , positioning device 108 , audio circuit 109 , peripheral interface 110 , power supply device 111 and other components. These components may communicate via one or more communication buses or signal lines (not shown in FIG. 1 ). Those skilled in the art can understand that the hardware structure shown in FIG. 1 does not constitute a limitation on the mobile phone, and the mobile phone 100 may include more or less components than the one shown, or combine some components, or arrange different components.

Each component of the mobile phone 100 is described in detail below with reference to FIG. 1 :

The processor 101 is the control center of the mobile phone 100, uses various interfaces and lines to connect various parts of the mobile phone 100, and executes the functions of the mobile phone 100 by running or executing the application programs stored in the memory 103 and calling the data stored in the memory 103. Various functions and processing data. In some embodiments, the processor 101 may include one or more processing units. In some embodiments of the embodiments of the present application, the above-mentioned processor 101 may further include a fingerprint verification chip, which is used to verify the collected fingerprints.

The radio frequency circuit 102 can be used for receiving and transmitting wireless signals during the process of sending and receiving information or talking. In particular, the radio frequency circuit 102 can process the downlink data of the base station to the processor 101 after receiving it; in addition, send the uplink data to the base station. Typically, radio frequency circuits include, but are not limited to, antennas, at least one amplifier, transceivers, couplers, low noise amplifiers, duplexers, and the like. In addition, the radio frequency circuit 102 may also communicate with other devices through wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to Global System for Mobile Communications, General Packet Radio Service, Code Division Multiple Access, Wideband Code Division Multiple Access, Long Term Evolution, email, short message service, and the like.

操作系统，

操作系统等。上述存储器103可以是独立的，通过上述通信总线与处理器101相连接；存储器103也可以和处理器101集成在一起。The memory 103 is used to store application programs and data, and the processor 101 executes various functions of the mobile phone 100 and data processing by running the application programs and data stored in the memory 103 . The memory 103 mainly includes a stored program area and a stored data area, wherein the stored program area can store an operating system and an application program (such as a sound playback function, an image playback function, etc.) required for at least one function; 100 created data (such as audio data, phone book, etc.). In addition, the memory 103 may include high-speed random access memory (RAM), and may also include non-volatile memory, such as magnetic disk storage devices, flash memory devices, or other volatile solid-state storage devices, and the like. The memory 103 may store various operating systems, for example,

operating system,

operating system, etc. The above-mentioned memory 103 may be independent and connected to the processor 101 through the above-mentioned communication bus; the memory 103 may also be integrated with the processor 101 .

The touch screen 104 may specifically include a touch panel 104-1 and a display 104-2.

The touchpad 104-1 can collect touch events on or near the user of the mobile phone 100 (for example, the user uses a finger, a stylus, or any other suitable object on the touchpad 104-1 or on the touchpad 104). -1 operation near), and send the collected touch information to other devices (for example, the processor 101). Among them, the user's touch event near the touchpad 104-1 may be called a hovering touch; the hovering touch may refer to the fact that the user does not need to directly touch the touchpad in order to select, move or drag an object (such as an icon, etc.). , but only if the user is near the device in order to perform the desired function. In addition, various types of resistive, capacitive, infrared, and surface acoustic waves can be used to implement the touch panel 104-1.

A display (also referred to as a display screen) 104 - 2 may be used to display information entered by or provided to the user as well as various menus of the cell phone 100 . The display 104-2 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The touchpad 104-1 can be overlaid on the display 104-2. When the touchpad 104-1 detects a touch event on or near it, it is transmitted to the processor 101 to determine the type of the touch event, and then the processor 101 may provide corresponding visual output on display 104-2 according to the type of touch event. Although in FIG. 1, the touchpad 104-1 and the display screen 104-2 are used as two independent components to realize the input and output functions of the mobile phone 100, in some embodiments, the touchpad 104-1 1 is integrated with the display screen 104-2 to realize the input and output functions of the mobile phone 100. It can be understood that the touch screen 104 is formed by stacking multiple layers of materials. Only the touch panel (layer) and the display screen (layer) are shown in the embodiments of the present application, and other layers are not described in the embodiments of the present application. . In addition, the touch panel 104-1 can be arranged on the front of the mobile phone 100 in the form of a full panel, and the display screen 104-2 can also be arranged on the front of the mobile phone 100 in the form of a full panel, so that the front of the mobile phone can be frameless Structure.

In addition, the mobile phone 100 may also have a fingerprint recognition function. For example, the fingerprint acquisition device 112 may be configured on the back of the mobile phone 100 (eg, below the rear camera), or the fingerprint acquisition device 112 may be configured on the front of the mobile phone 100 (eg, below the touch screen 104 ). For another example, the fingerprint collection device 112 can be configured in the touch screen 104 to realize the fingerprint identification function, that is, the fingerprint collection device 112 can be integrated with the touch screen 104 to realize the fingerprint identification function of the mobile phone 100 . In this case, the fingerprint collection device 112 is configured in the touch screen 104, which may be a part of the touch screen 104, or may be configured in the touch screen 104 in other ways. The main component of the fingerprint collection device 112 in the embodiment of the present application is a fingerprint sensor, and the fingerprint sensor can adopt any type of sensing technology, including but not limited to optical, capacitive, piezoelectric or ultrasonic sensing technology.

The mobile phone 100 may also include a Bluetooth device 105 for realizing data exchange between the mobile phone 100 and other short-range devices (eg, mobile phones, smart watches, etc.). The Bluetooth device in this embodiment of the present application may be an integrated circuit or a Bluetooth chip or the like.

Cell phone 100 may also include at least one sensor 106, such as light sensors, motion sensors, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display of the touch screen 104 according to the brightness of the ambient light, and the proximity sensor may turn off the power of the display when the mobile phone 100 is moved to the ear . As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (usually three axes), and can detect the magnitude and direction of gravity when it is stationary. games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor, etc. that can be configured on the mobile phone 100, we will not Repeat.

A wireless fidelity (WiFi) device 107 is used to provide the mobile phone 100 with network access that complies with Wi-Fi related standard protocols, and the mobile phone 100 can access the Wi-Fi access point through the WiFi device 107, thereby helping the user Send and receive e-mail, browse the web and access streaming media, etc., it provides users with wireless broadband Internet access. In some other embodiments, the WiFi device 107 can also serve as a Wi-Fi wireless access point, and can provide Wi-Fi network access for other devices.

The positioning device 108 is used to provide the mobile phone 100 with a geographic location. It can be understood that, the positioning device 108 may specifically be a receiver of a global positioning system (global positioning system, GPS), a Beidou satellite navigation system, a Russian GLONASS or other positioning systems. After receiving the geographic location sent by the positioning system, the positioning device 108 sends the information to the processor 101 for processing, or sends the information to the memory 103 for storage. In other embodiments, the positioning device 108 may also be a receiver of an assisted global positioning system (AGPS), and the AGPS system acts as an auxiliary server to assist the positioning device 108 to complete ranging and positioning services. In this case, the assisted positioning server communicates with the positioning device 108 (ie, the GPS receiver) of the device, such as the mobile phone 100, through a wireless communication network to provide positioning assistance. In some other embodiments, the positioning device 108 may also be a positioning technology based on a Wi-Fi access point. Since each Wi-Fi access point has a globally unique media access control (MAC) address, the device can scan and collect surrounding Wi-Fi access points when Wi-Fi is turned on. broadcast signal, so the MAC address broadcast by the Wi-Fi access point can be obtained; the device sends these data (such as MAC address) that can identify the Wi-Fi access point to the location server through the wireless communication network, and the location server retrieves The geographic location of each Wi-Fi access point is calculated, and combined with the strength of the Wi-Fi broadcast signal, the geographic location of the device is calculated and sent to the positioning device 108 of the device.

The audio circuit 109 , the speaker 113 , and the microphone 114 may provide an audio interface between the user and the cell phone 100 . The audio circuit 109 can transmit the received audio data converted electrical signal to the speaker 113, and the speaker 113 converts it into a sound signal for output; on the other hand, the microphone 114 converts the collected sound signal into an electrical signal, which is converted by the audio circuit 109 After receiving, it is converted into audio data, and then the audio data is output to the radio frequency circuit 102 for sending to another mobile phone, for example, or the audio data is output to the memory 103 for further processing.

Cell phone 100 may include two or more microphones 114 . Take the mobile phone 100 including a primary microphone and a secondary microphone as an example. The two microphones can be deployed below the touch screen 104, as shown in FIG. 2A; the main microphone can also be deployed below the touch screen 104, and the secondary microphone is deployed on the back of the mobile phone 100, as shown in FIG. 2B, of course, the main microphone and The deployment position of the secondary microphone in the mobile phone 100 may also be other, which will not be listed one by one here.

The peripheral interface 110 is used to provide various interfaces for external input/output devices (eg, keyboard, mouse, external display, external memory, user identification module card, etc.). For example, the mouse is connected to the mouse through a universal serial bus (USB) interface, and the subscriber identification module (SIM) card provided by the telecom operator is connected through the metal contacts on the card slot of the subscriber identification module. . The peripheral interface 110 may be used to couple the aforementioned external input/output peripherals to the processor 101 and the memory 103 .

In this embodiment of the present invention, the mobile phone 100 can communicate with other devices in the device group through the peripheral interface 110 , for example, the display data sent by other devices can be received and displayed through the peripheral interface 110 . No restrictions apply.

The mobile phone 100 may also include a power supply device 111 (such as a battery and a power management chip) for supplying power to various components. The battery may be logically connected to the processor 101 through the power management chip, so as to manage charging, discharging, and power consumption management through the power supply device 111. and other functions.

Although not shown in FIG. 1 , the mobile phone 100 may further include a camera (a front camera and/or a rear camera), a flash, a pico-projection device, a near field communication (NFC) device, etc., which will not be repeated here.

Wherein, the execution subject of the audio signal processing method provided by the embodiment of the present application may be an audio signal processing device, and the processing device may be used in an electronic device (such as the mobile phone 100 shown in FIG. 1 ), or a central part of the electronic device. A processor (central processing unit, CPU), or a module in the electronic device for processing audio signals, or a client in the electronic device for processing audio signals.

The embodiments of the present application describe the method for processing audio signals provided by the present application by taking an electronic device including a first audio module and a second audio module for processing an audio signal as an example.

The following describes an audio signal processing method provided by an embodiment of the present application in detail through specific embodiments.

As shown in FIG. 3 , the audio signal processing method provided by the embodiment of the present application includes:

S301. The electronic device acquires the audio signal 1 collected by the first audio collection module and the audio signal 2 collected by the second audio collection module.

S302, the electronic device determines, according to the audio signal 1, that the first audio collection module is abnormal.

Optionally, the electronic device may determine that the first audio collection module is abnormal according to the amplitude value and/or energy distribution of the audio signal 1 .

Wherein, the electronic device can use the following method to determine: the electronic device samples the audio signal 1 in the unit period, obtains the sampled value of the audio signal 1, and calculates the absolute value of the amplitude of the sampled value of the audio signal 1, and calculates a plurality of sampled values. The average value of the absolute value of the amplitude of the audio signal 1 is obtained, and the average value of the amplitude of the sampled values of the audio signal 1 is obtained, and the average value is the amplitude value of the audio signal 1 .

If the sound-receiving hole connected to the first audio collection module is blocked, the amplitude of the audio signal 1 collected by the first audio collection module will be greatly reduced, which may be smaller than the first preset threshold, and the first preset threshold is the first The audio collection module collects the threshold value of the audio signal. Based on this, the electronic device can perform time domain analysis on the audio signal 1 to determine whether the amplitude of the audio signal 1 is smaller than the first preset threshold.

When it is determined that the amplitude of the audio signal 1 is less than the first preset threshold, the electronic device determines whether the duration when the amplitude of the audio signal 1 collected by the first audio acquisition module is less than the first preset threshold is greater than the preset duration, and the preset duration It can be dynamically set according to the design needs.

The electronic device collects the audio signal of the user's voice call through the first audio collection module, calculates the amplitude value of the audio signal during the user's voice call, and determines by comparing the amplitude value of the audio signal during the user's voice call with the size of the first preset threshold. Whether the amplitude value of the audio signal during the user's voice call is smaller than the first preset threshold, that is, determining whether the amplitude value of the audio signal 1 collected by the first audio collection module is smaller than the first preset threshold.

In the embodiment of the present application, the threshold for collecting audio signals by the first audio collection module is referred to as the first preset threshold, and the threshold for collecting audio signals by the second audio collection module is referred to as the second preset threshold.

In practical applications, the preset threshold (the first preset threshold or the second preset threshold) in the embodiment of the present application can be obtained according to experiments, that is, the sound-receiving hole is blocked, the audio signal is collected when the sound-receiving hole is blocked, and the sound-receiving hole is blocked. The amplitude of the audio signal collected when blocked is the preset threshold.

The determination of the first preset threshold is described here. Optionally, after the sound-receiving hole connected to the first audio collection module may be blocked, the first audio collection module may be used to collect audio signals for multiple times, and the average value of the amplitudes of the multiple collected audio signals may be obtained, and the obtained average value may be as the first preset threshold. As an embodiment, when the first preset threshold is obtained by collecting audio signals multiple times, the first preset threshold can be obtained by collecting audio signals with different sound wave characteristics (eg, male voice, female voice, elderly, children, etc.). As an embodiment, the sound-receiving holes connected to the first audio collection module can be blocked in different blocking ways (eg, different blocking angles, using different objects to block the sound-receiving holes, etc.) The amplitude of the audio signal collected in the mode is calculated, and the average value of the amplitude of the acquired audio signal is calculated to obtain the first preset threshold.

For the method for determining the second preset threshold, reference may be made to the method for determining the first preset threshold, which will not be repeated here.

In addition, because the low-frequency signal energy is relatively strong, the high-frequency signal energy is relatively weak; when the sound-receiving hole is blocked, most of the low-frequency signals can be collected by the audio acquisition module through the sound-receiving hole through the gap or shell resonance; but most high-frequency signals can be collected by the audio acquisition module. The signal cannot be collected by the audio collection module through the sound-receiving hole; therefore, when the sound-receiving hole is blocked, the audio signal collected by the audio collection module is mainly low-frequency signal.

Based on this, the electronic device can perform Fourier FFT transformation on the audio signal 1 to obtain the energy distribution of the audio signal 1, and by judging whether the collected energy distribution of the audio signal 1 satisfies the preset condition, that is, the frequency is higher than the preset frequency. The summation of the energy values of the audio signal 1 of the frequency point is used as the high frequency energy value, and the summation of the energy values of the audio signal 1 of the frequency lower than the preset frequency point is used as the low frequency energy value; Whether the ratio of the energy values is smaller than the preset value, if the ratio of the high frequency energy value to the low frequency energy value is smaller than the preset value, it is determined that the energy distribution of the audio signal 1 does not meet the preset condition.

If the amplitude of the audio signal 1 is smaller than the first preset threshold and/or the energy distribution of the audio signal 1 does not meet the preset conditions, the electronic device determines that the first audio collection module is abnormal, that is, the sound receiving hole connected to the first audio collection module is determined by the electronic device. It is blocked or the voice input of the first audio collection module in the electronic device is abnormal.

S303, the electronic device calculates the ratio of the amplitude value of the audio signal 1 to the first preset threshold to obtain the adjustment ratio.

The adjustment ratio is: the amplitude value of the audio signal 1/the first preset threshold.

S304 , the electronic device adjusts the audio signal 2 by adjusting the ratio to obtain the audio signal 3 .

S305, the electronic device determines that the difference between the audio signal 1 and the audio signal 3 is the audio signal finally obtained by the electronic device.

The amplitude value of the audio signal 1 is less than the first preset threshold. In order to shield the ambient noise, the electronic device adaptively adjusts the audio signal 2 to the audio signal 3, so that the difference between the audio signal 1 and the audio signal 3 remains within the preset range. Inside.

In addition, after adjusting the audio signal 2, the electronic device also needs to adjust the first preset threshold and the second preset threshold, so that the electronic device can determine whether the audio collection module is abnormal in the subsequent audio collection process.

As shown in FIG. 4 , the processing method provided by the embodiment of the present application further includes S401.

S401. The electronic device adjusts the first preset threshold using an adjustment ratio to obtain an adjusted first preset threshold, and adjusts the second preset threshold using an adjustment ratio to obtain an adjusted second preset threshold.

To sum up, when the first audio acquisition module is abnormal, the electronic device adaptively adjusts the audio signal collected by the second audio acquisition module, so that the finally obtained audio signal is clearer and the ambient noise is small, which improves the user experience.

The solutions provided by the embodiments of the present application have been introduced above mainly from the perspective of methods. In order to realize the above-mentioned functions, it includes corresponding hardware structures and/or software modules for executing each function. Those skilled in the art should easily realize that the present application can be implemented in hardware or a combination of hardware and computer software with the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein. Whether a function is performed by hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of this application.

In this embodiment of the present application, the electronic device may be divided into functional modules according to the foregoing method examples. For example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module. The above-mentioned integrated modules can be implemented in the form of hardware, and can also be implemented in the form of software function modules. It should be noted that, the division of modules in the embodiments of the present application is schematic, and is only a logical function division, and there may be other division manners in actual implementation.

As shown in FIG. 5 , it is a schematic structural diagram of an audio signal processing apparatus provided by an embodiment of the present application. The audio signal processing apparatus is used for the audio signal collected by the audio collection module, for example, used to execute the method shown in FIG. 3 and/or FIG. 4 . The audio signal processing apparatus may include a determination unit 50 , a calculation unit 51 and an adjustment unit 52 .

The determination unit 50 is configured to determine, according to the first audio signal collected by the first audio collection module, that the first audio collection module is abnormal. The calculation unit 51 is configured to calculate the adjustment ratio according to the amplitude value of the first audio signal and the first preset threshold when the determination unit 50 determines that the first audio acquisition module is abnormal, and the first preset threshold is the first audio acquisition The amplitude threshold of the audio signal currently collected by the module. The adjustment unit 52 is configured to adjust the audio signal collected by the second audio collection module by adjusting the ratio to obtain the second audio signal. The determining unit 50 is further configured to determine that the difference between the first audio signal and the second audio signal is the audio signal obtained by the processing device.

For example, in conjunction with FIG. 3 and FIG. 4 , the determining unit 50 may be used to perform S302 and S305 , the computing unit 51 may be used to perform S303 , and the adjusting unit 52 may be used to perform S304 and S401 .

Optionally, the calculating unit 51 is specifically configured to: determine the ratio of the amplitude value of the first audio signal to the first preset threshold as the adjustment ratio.

Optionally, the adjustment unit 52 is specifically configured to: determine that the product of the adjustment ratio and the audio signal collected by the second audio collection module is the second audio signal.

Optionally, the determining unit 50 is specifically configured to: determine whether the amplitude value of the first audio signal is less than the first preset threshold; if the amplitude value of the first audio signal is less than the first preset threshold, then determine that the first audio collection module is abnormal. Or, determine whether the energy distribution of the first audio signal satisfies the preset condition; if the energy distribution of the first audio signal does not meet the preset condition, then determine that the first audio acquisition module is abnormal; or, determine the amplitude value of the first audio signal Whether it is less than the first preset threshold, and whether the energy distribution of the first audio signal satisfies the preset conditions; if the amplitude value of the first audio signal is less than the first preset threshold, and the energy distribution of the first audio signal does not meet the preset conditions , it is determined that the first audio collection module is abnormal.

Optionally, the adjustment unit 52 is further configured to: use an adjustment ratio to adjust the first preset threshold to obtain an adjusted first preset threshold; use an adjustment ratio to adjust the second preset threshold to obtain an adjusted The second preset threshold is the amplitude threshold of the audio signal currently collected by the second audio collection module.

Of course, the audio signal processing apparatus provided in the embodiment of the present application includes but is not limited to the above-mentioned modules. For example, the audio signal processing apparatus may further include a storage unit 53 .

The storage unit 53 may be used to store program codes and the like of the processing device of the audio signal.

As an example, referring to FIG. 1 , the functions implemented by the determining unit 50 , the calculating unit 51 and the adjusting unit 52 in the audio signal processing apparatus are the same as those of the processor 101 in FIG. 1 , and the functions implemented by the storage unit 53 are the same as those implemented in FIG. 1 . The function of the memory 103 in is the same.

For the explanation of the relevant content in this embodiment, reference may be made to the foregoing method embodiment, which will not be repeated here.

Another embodiment of the present application further provides a computer-readable storage medium, where instructions are stored in the computer-readable storage medium, and when the instructions are executed on an audio signal processing apparatus, the audio signal processing apparatus executes the foregoing method embodiments The individual steps in the method flow shown.

Another embodiment of the present application further provides an electronic device, which includes the above-mentioned apparatus for processing audio signals.

In some embodiments, the disclosed methods may be implemented as computer program instructions encoded in a machine-readable format on a computer-readable storage medium or on other non-transitory media or articles of manufacture.

FIG. 6 schematically shows a conceptual partial view of a computer program product provided by an embodiment of the present application, where the computer program product includes a computer program for executing a computer process on a computing device.

In one embodiment, the computer program product is provided using signal bearing medium 60 . The signal bearing medium 60 may include one or more program instructions, which, when executed by one or more processors, may provide the functions or portions of the functions described above with respect to FIG. 3 or FIG. 4 . Thus, for example, with reference to the embodiment shown in FIG. 3 , one or more of the features of S301 - S305 may be undertaken by one or more instructions associated with the signal bearing medium 60 . In addition, the program instructions in FIG. 6 also describe example instructions.

In some examples, the signal bearing medium 60 may include a computer readable medium 61 such as, but not limited to, a hard drive, a compact disc (CD), a digital video disc (DVD), a digital tape, a memory, a read only memory (read only memory) -onlymemory, ROM) or random access memory (random access memory, RAM) and so on.

In some implementations, the signal bearing medium 60 may include a computer recordable medium 62 such as, but not limited to, memory, read/write (R/W) CD, R/W DVD, and the like.

In some embodiments, signal bearing medium 60 may include communication medium 63 such as, but not limited to, digital and/or analog communication media (eg, fiber optic cables, waveguides, wired communication links, wireless communication links, etc.).

Signal bearing medium 60 may be conveyed by a wireless form of communication medium 63 (eg, a wireless communication medium conforming to the IEEE 802.11 standard or other transmission protocol). The one or more program instructions may be, for example, computer-executable instructions or logic-implemented instructions.

In some examples, a processing apparatus such as the audio signal described with respect to FIG. 3 or FIG. 4 may be configured to, in response to passing through one or more of computer readable medium 61 , computer recordable medium 62 , and/or communication medium 63 , A program instruction that provides various operations, functions, or actions.

It should be understood that the arrangements described herein are for illustrative purposes only. Thus, those skilled in the art will understand that other arrangements and other elements (eg, machines, interfaces, functions, sequences, and groups of functions, etc.) can be used instead and that some elements may be omitted altogether depending on the desired results . Additionally, many of the described elements are functional entities that may be implemented as discrete or distributed components, or in conjunction with other components in any suitable combination and position.

In the above-mentioned embodiments, it may be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using a software program, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer-executed instructions are loaded and executed on the computer, the flow or function according to the embodiments of the present application is generated in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable device. Computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, computer, server, or data center over a wire (e.g. coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (eg infrared, wireless, microwave, etc.) means to another website site, computer, server or data center. Computer-readable storage media can be any available media that can be accessed by a computer or data storage devices including one or more servers, data centers, etc., that can be integrated with the media. Useful media may be magnetic media (eg, floppy disks, hard disks, magnetic tapes), optical media (eg, DVDs), or semiconductor media (eg, solid state disks (SSDs)), and the like.

The above descriptions are merely specific embodiments of the present application. Those skilled in the art can think of changes or substitutions based on the specific embodiments provided by the present application, which should all fall within the protection scope of the present application.

Claims (10)

1. a processing method of audio signal, applied to the electronic equipment comprising the first audio frequency acquisition module and the second audio frequency acquisition module, is characterized in that, comprises: According to the first audio signal collected by the first audio collection module, it is determined that the first audio collection module is abnormal; determining the ratio of the amplitude value of the first audio signal to the first preset threshold value as the adjustment ratio, and the first preset threshold value is the amplitude threshold value of the audio signal currently collected by the first audio collection module; Using the adjusting ratio to adjust the audio signal collected by the second audio collection module to obtain a second audio signal; It is determined that the difference between the first audio signal and the second audio signal is the audio signal obtained by the electronic device. 2. The processing method according to claim 1, wherein the adjusting the audio signal collected by the second audio acquisition module using the adjustment ratio to obtain the second audio signal, comprising: It is determined that the product of the adjustment ratio and the audio signal collected by the second audio collection module is the second audio signal. 3. The processing method according to claim 2, wherein, determining that the first audio collection module is abnormal according to the first audio signal collected by the first audio collection module, comprising: Determine whether the amplitude value of the first audio signal is less than the first preset threshold; if the amplitude value of the first audio signal is less than the first preset threshold, determine that the first audio collection module is abnormal; or, Determine whether the energy distribution of the first audio signal satisfies a preset condition; if the energy distribution of the first audio signal does not meet the preset condition, determine that the first audio collection module is abnormal; or, Determine whether the amplitude value of the first audio signal is smaller than the first preset threshold, and whether the energy distribution of the first audio signal satisfies the preset condition; if the amplitude value of the first audio signal is smaller than the first audio signal A preset threshold, and the energy distribution of the first audio signal does not meet the preset condition, it is determined that the first audio collection module is abnormal. 4. The processing method according to any one of claims 1-3, wherein the processing method further comprises: Using the adjustment ratio to adjust the first preset threshold to obtain the adjusted first preset threshold; Using the adjustment ratio to adjust the second preset threshold, the adjusted second preset threshold is obtained, and the second preset threshold is the amplitude threshold of the audio signal currently collected by the second audio collection module. 5. A processing device of an audio signal, characterized in that it is located in an electronic device comprising a first audio acquisition module and a second audio acquisition module, and the processing device comprises: a determining unit, configured to determine that the first audio collection module is abnormal according to the first audio signal collected by the first audio collection module; A calculation unit, configured to determine the ratio of the amplitude value of the first audio signal to the first preset threshold as the adjustment ratio when the determining unit determines that the first audio collection module is abnormal, and the first audio signal is A preset threshold is the amplitude threshold of the audio signal currently collected by the first audio collection module; an adjustment unit, configured to adjust the audio signal collected by the second audio collection module by using the adjustment ratio to obtain the second audio signal; The determining unit is further configured to determine that the difference between the first audio signal and the second audio signal is the audio signal obtained by the processing device. 6. The processing device according to claim 5, wherein the adjustment unit is specifically used for: It is determined that the product of the adjustment ratio and the audio signal collected by the second audio collection module is the second audio signal. 7. The processing device according to claim 6, wherein the determining unit is specifically configured to: Determine whether the amplitude value of the first audio signal is less than the first preset threshold; if the amplitude value of the first audio signal is less than the first preset threshold, determine that the first audio collection module is abnormal; or, Determine whether the energy distribution of the first audio signal satisfies a preset condition; if the energy distribution of the first audio signal does not meet the preset condition, determine that the first audio collection module is abnormal; or, Determine whether the amplitude value of the first audio signal is smaller than the first preset threshold, and whether the energy distribution of the first audio signal satisfies the preset condition; if the amplitude value of the first audio signal is smaller than the first audio signal A preset threshold, and the energy distribution of the first audio signal does not meet the preset condition, it is determined that the first audio collection module is abnormal. 8. The processing device according to any one of claims 5-7, wherein the adjustment unit is further configured to: Using the adjustment ratio, the first preset threshold is adjusted to obtain the adjusted first preset threshold; Using the adjustment ratio, the second preset threshold is adjusted to obtain the adjusted second preset threshold, where the second preset threshold is the amplitude threshold of the audio signal currently collected by the second audio collection module. 9. A computer-readable storage medium, comprising instructions, characterized in that, when the instructions are executed on an audio signal processing device, the audio signal processing device is made to execute any one of claims 1-4 The audio signal processing method. 10. A device, comprising: a processor and a memory; The memory is coupled to the processor; the memory is used to store computer program code, the computer program code including instructions, when the processor executes the instructions, the device performs as in claims 1-4 Any one of the audio signal processing methods.

Images