CN111863004A - Sound signal processing method, system, electronic device and storage medium - Google Patents

Abstract

The invention discloses a method and a system for processing a sound signal, electronic equipment and a storage medium. The processing method comprises the following steps: monitoring an external sound signal; judging whether the external sound signal meets a trigger condition; if so, raising the frequency of the sound signal to be played; and playing the sound signal to be played after the frequency is raised. The invention can monitor the external sound signal in real time in the playing process of the sound signal, and when the external sound signal meets the triggering condition, for example, when the playing environment turns from quiet to noisy, the frequency of the sound signal to be played is automatically raised, and then the sound signal to be played is played, so that a user can more clearly listen to the content of the played sound signal, and the definition of the played content is automatically enhanced.

Description

Sound signal processing method, system, electronic device and storage medium

technical field

The present invention relates to the technical field of sound signal processing, and in particular, to a sound signal processing method, system, electronic device and storage medium.

Background technique

Currently, during the playback of sound signals (for example, during a voice call, for example, during music playback, etc.), when the playback environment changes from quiet to noisy, in order to listen to the playback content more clearly, the usual practice includes increasing the playback volume. volume, wearing headphones, moving to a quiet environment, etc. without automatically enhancing the clarity of the playback content.

SUMMARY OF THE INVENTION

The technical problem to be solved by the present invention is to provide a sound signal processing method, system, electronic device and storage medium in order to overcome the defect in the prior art that the playback content cannot be automatically enhanced when the playback environment changes from quiet to noisy.

The present invention solves the above-mentioned technical problems through the following technical solutions:

A method for processing a sound signal, comprising:

monitor external sound signals;

Judging whether the external sound signal satisfies the triggering condition;

If so, increase the frequency of the sound signal to be played;

The to-be-played sound signal after the frequency is raised is played.

Preferably, the external sound signal includes an external noise signal, and the step of judging whether the external sound signal satisfies the trigger condition includes:

identifying an external noise signal in the external sound signal;

Determine whether the volume of the external noise is greater than a first threshold according to the external noise signal;

If yes, then determine that the external sound signal satisfies the trigger condition;

And/or, the external sound signal includes an external voice signal, and the step of judging whether the external sound signal satisfies the trigger condition includes:

Identifying an external voice signal in the external sound signal;

According to the external voice signal, determine whether the difference between the volume of the external voice at the current sampling moment and the volume at the previous sampling moment is greater than a second threshold;

If so, it is determined that the external sound signal satisfies the trigger condition.

Preferably, the external sound signal includes an external voice signal, and the step of judging whether the external sound signal satisfies the trigger condition includes:

Identifying an external voice signal in the external sound signal;

converting the external speech signal into text;

determine whether the text includes a trigger keyword;

If so, it is determined that the external sound signal satisfies the trigger condition.

Preferably, the step of monitoring the external sound signal specifically includes monitoring the external sound signal during the voice call;

The to-be-played sound signal includes a voice call signal.

A sound signal processing system, comprising:

Monitoring module for monitoring external sound signals;

a judgment module for judging whether the external sound signal satisfies a trigger condition;

If so, call a lift module, and the lift module is used to lift the frequency of the sound signal to be played;

The playing module is used for playing the sound signal to be played after the frequency is raised.

Preferably, the external sound signal includes an external noise signal, and the judgment module includes:

a first identification unit, used to identify the external noise signal in the external sound signal;

a first judging unit, configured to judge whether the volume of the external noise is greater than a first threshold according to the external noise signal;

If so, call a determination unit, and the determination unit is used to determine that the external sound signal satisfies the trigger condition;

And/or, the external sound signal includes an external voice signal, and the judgment module includes:

a second identification unit, configured to identify an external voice signal in the external sound signal;

A second judging unit for judging whether the difference between the volume of the external voice at the current sampling moment and the volume at the last sampling moment is greater than a second threshold according to the external voice signal;

If so, the determining unit is invoked, and the determining unit is configured to determine that the external sound signal satisfies the triggering condition.

Preferably, the external sound signal includes an external voice signal, and the judgment module includes:

a second identification unit, configured to identify an external voice signal in the external sound signal;

a conversion unit for converting the external voice signal into text;

a third judging unit for judging whether the text includes a trigger keyword;

If so, the determining unit is invoked, and the determining unit is configured to determine that the external sound signal satisfies the triggering condition.

Preferably, the monitoring module is specifically used to monitor external sound signals during a voice call;

The to-be-played sound signal includes a voice call signal;

The playback module includes an earpiece and/or a speaker.

An electronic device includes a memory, a processor, and a computer program stored in the memory and running on the processor. The processor implements any of the above sound signal processing methods when the processor executes the computer program.

A computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, implements the steps of any of the above sound signal processing methods.

The positive improvement effect of the present invention is: the present invention can monitor the external sound signal in real time during the playback of the sound signal, and when the external sound signal meets the trigger condition, for example, when the playback environment changes from quiet to noisy, the sound to be played is automatically raised first The frequency of the signal is played, and the sound signal to be played is played again, so that the user can listen to the content of the played sound signal more clearly, and the clarity of the played content is automatically enhanced.

Description of drawings

FIG. 1 is a flowchart of a method for processing a sound signal according to Embodiment 1 of the present invention.

FIG. 2 is a specific flowchart of a method for processing a sound signal according to Embodiment 1 of the present invention.

FIG. 3 is a schematic diagram of frequency boosting in the sound signal processing method according to Embodiment 1 of the present invention.

FIG. 4 is a schematic block diagram of a sound signal processing system according to Embodiment 2 of the present invention.

FIG. 5 is a schematic structural diagram of an electronic device according to Embodiment 3 of the present invention.

Detailed ways

The present invention is further described below by way of examples, but the present invention is not limited to the scope of the described examples.

Example 1

This embodiment provides a method for processing a sound signal. Referring to FIG. 1 , the processing method in this embodiment includes:

S101. Monitor external sound signals;

S102, judging whether the external sound signal satisfies the triggering condition;

If yes, execute step S103;

S103, raising the frequency of the sound signal to be played;

S104, playing the sound signal to be played after the frequency is raised.

The processing method of this embodiment may be applicable to a voice call process, wherein the sound signal to be played may include a voice call signal, and step S101 may specifically include monitoring an external sound signal during the voice call process. It should be understood that the processing method in this embodiment can also be applied to the playing process of sound media such as music.

Specifically, in this embodiment, the external sound signal may include an external noise signal and an external voice signal. For example, when the sound signal to be played includes a voice call signal, the external noise signal may include a voice call monitored by the microphone of the voice call device. The sound signal of the environment where the device is located, and the external voice signal may include the sound signal input by the user of the voice communication device through the microphone of the voice communication device.

In this embodiment, the trigger condition for triggering the processing of the sound signal to be played may be customized according to the actual application. For example, the trigger condition may include: the volume of the external noise is greater than the preset threshold, the volume of the external voice suddenly increases, the external The content of the voice indicates that the user of the voice communication device cannot hear the playing content, etc., wherein, different trigger conditions may be triggered in parallel, or may be triggered sequentially in a preset order, which is not limited in this embodiment.

Specifically, referring to FIG. 2 , step S102 in this embodiment may include:

S1021, identifying the external noise signal in the external sound signal;

S1022. Determine whether the volume of the external noise is greater than a first threshold according to the external noise signal;

If yes, execute step S1023;

S1023. Determine that the external sound signal satisfies the triggering condition.

Wherein, the first threshold can be customized according to the actual application, for example, the first threshold can be 50db.

Step S102 may also include:

S1024. Identify the external voice signal in the external voice signal;

S1025, according to the external voice signal, determine whether the difference between the volume of the external voice at the current sampling moment and the volume at the last sampling moment is greater than the second threshold;

If yes, step S1023 is executed.

Wherein, the second threshold can be customized according to the actual application, for example, the second threshold can be 6db.

After step S1024, it may further include:

S1026, convert the external voice signal into text;

S1027, determine whether the text includes a trigger keyword;

If yes, step S1023 is executed.

Among them, the trigger keyword can be customized according to the actual application, for example, "can't hear clearly", "what", "hello", "speak louder" and so on.

In this embodiment, if it is determined in step S102 that the external sound signal does not meet the triggering condition, the processing of increasing the frequency of the sound signal to be played is not performed.

In this embodiment, referring to FIG. 3 , after the frequency raising process, the frequency of the sound signal to be played is raised, but the volume does not change, that is, the sound signal is shifted in the direction of increasing frequency. After the sound signal to be played is processed to increase the frequency, since the human ear is more sensitive to the sound with higher frequency, the human ear can hear the content of the played sound signal more clearly, which enhances the clarity of the played content.

Specifically, when the processing method of this embodiment is applied to the process of voice call, although the increase of frequency will lead to the weakening of sound penetration, the distance between the user of the voice call device and the voice call device is relatively long during the voice call. so that the distance factor of sound propagation can be ignored. During the voice call, when it is judged that the trigger condition is met, that is, it is judged that the user of the voice call device may not be able to hear what the other party is saying, the voice call device will process the real-time frequency increase of the sound signal to be played, so that the voice call device The user of the voice communication device can hear the sound signal processed by the real-time frequency uplift, so that the user of the voice communication device can hear the content of the other party clearly.

Therefore, before the voice call signal input by the user (user A) of the voice call device is transmitted to the other party (user B) by means of dual microphone noise reduction and voice noise/echo cancellation algorithm, the voice call signal is processed. processing to solve the echo and noise generated during the voice call, so that the voice call content of the user (user A) of the voice call device can be clearly transmitted to the other party (user B), and the voice call device When the user (user A) may not be able to hear what the other party (user B) is saying, the frequency of the voice call signal input by the other party (user B) is increased in real time, so that the user (user A) of the voice call device can The content of the other party (user B) can be heard clearly, which further improves and improves the quality of the voice call during the voice call.

Example 2

This embodiment provides a sound signal processing system. Referring to FIG. 4 , the processing system in this embodiment includes:

a monitoring module 201 for monitoring external sound signals;

The judgment module 202 is used for judging whether the external sound signal satisfies the triggering condition;

If so, call the lifting module 203;

The elevating module 203 elevates the frequency of the sound signal to be played;

The playing module 204 plays the sound signal to be played after the frequency is raised.

The processing system of this embodiment may be applied to a voice call device, wherein the sound signal to be played may include a voice call signal, and the monitoring module 201 may include a microphone of the voice call device, and may be specifically used to monitor external sound signals during a voice call . It should be understood that the processing system in this embodiment may also be applied to a playback device for sound media such as music.

Specifically, in this embodiment, the external sound signal may include an external noise signal and an external voice signal. For example, when the sound signal to be played includes a voice call signal, the external noise signal may include a voice call monitored by the microphone of the voice call device. The sound signal of the environment where the device is located, the external voice signal may include the sound signal input by the user of the voice call device through the microphone of the voice call device, and the playback module 204 may include at least one of the earpiece and the speaker of the voice call device.

In this embodiment, the trigger condition for triggering the processing of the sound signal to be played may be customized according to the actual application. For example, the trigger condition may include: the volume of the external noise is greater than the preset threshold, the volume of the external voice suddenly increases, the external The content of the voice indicates that the user of the voice communication device cannot hear the playing content, etc., wherein, different trigger conditions may be triggered in parallel, or may be triggered sequentially in a preset order, which is not limited in this embodiment.

Specifically, referring to FIG. 4 , the judgment module 202 in this embodiment may include:

a first identification unit 2021, used to identify the external noise signal in the external sound signal;

a first judgment unit 2022, configured to judge whether the volume of the external noise is greater than the first threshold according to the external noise signal;

If so, call the determining unit 2023;

The determining unit 2023 is configured to determine that the external sound signal satisfies the triggering condition.

Wherein, the first threshold can be customized according to the actual application, for example, the first threshold can be 50db.

The judging module 202 may also include:

The second identification unit 2024 is used to identify the external voice signal in the external sound signal;

The second judgment unit 2025 is used to judge whether the difference between the volume of the external voice at the current sampling moment and the volume of the previous sampling moment is greater than the second threshold according to the external voice signal;

If so, the determining unit 2023 is called.

Wherein, the second threshold can be customized according to the actual application, for example, the second threshold can be 6db.

The judging module 202 may also include:

conversion unit 2026, for converting the external voice signal into text;

The third judging unit 2027 is used for judging whether the text includes a trigger keyword;

If so, the determining unit 2023 is called.

Among them, the trigger keyword can be customized according to the actual application, for example, "can't hear clearly", "what", "hello", "speak louder" and so on.

In this embodiment, if the determination module 202 determines that the external sound signal does not meet the triggering condition, the raising module 203 is not called to perform frequency raising processing on the sound signal to be played.

In this embodiment, referring to FIG. 3 , after the frequency raising process, the frequency of the sound signal to be played is raised, but the volume does not change, that is, the sound signal is shifted in the direction of increasing frequency. After the sound signal to be played is processed to increase the frequency, since the human ear is more sensitive to the sound with higher frequency, the human ear can hear the content of the played sound signal more clearly, which enhances the clarity of the played content.

Specifically, when the processing system of this embodiment is applied to a voice communication device, although the increase of the frequency will lead to the weakening of the sound penetration, the distance between the user of the voice communication device and the voice communication device is relatively large during the voice communication. so that the distance factor of sound propagation can be ignored. During the voice call, when it is judged that the trigger condition is met, that is, it is judged that the user of the voice call device may not be able to hear what the other party is saying, the voice call device will process the real-time frequency increase of the sound signal to be played, so that the voice call device The user of the voice communication device can hear the sound signal processed by the real-time frequency uplift, so that the user of the voice communication device can hear the content of the other party clearly.

Therefore, before the voice call signal input by the user (user A) of the voice call device is transmitted to the other party (user B) by means of dual microphone noise reduction and voice noise/echo cancellation algorithm, the voice call signal is processed. processing to solve the echo and noise generated during the voice call, so that the voice call content of the user (user A) of the voice call device can be clearly transmitted to the other party (user B), and the voice call device When the user (user A) may not be able to hear the content of the other party (user B) clearly, the frequency of the voice call signal input by the other party (user B) is increased in real time, so that the user (user A) of the voice call device can The content of the other party (user B) can be heard clearly, which further improves and improves the quality of the voice call during the voice call.

Example 3

This embodiment provides an electronic device, which can be expressed in the form of a computing device (for example, a server device), and includes a memory, a processor, and a computer program stored in the memory and running on the processor, wherein the processor The sound signal processing method provided in Embodiment 1 can be implemented when the computer program is executed.

FIG. 5 shows a schematic diagram of the hardware structure of this embodiment. As shown in FIG. 5 , the electronic device 9 specifically includes:

At least one processor 91, at least one memory 92, and a bus 93 for connecting different system components (including processor 91 and memory 92), wherein:

The bus 93 includes a data bus, an address bus and a control bus.

Memory 92 includes volatile memory, such as random access memory (RAM) 921 and/or cache memory 922 , and may further include read only memory (ROM) 923 .

The memory 92 also includes a program/utility 925 having a set (at least one) of program modules 924 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, examples of which are Each or some combination of these may include an implementation of a network environment.

The processor 91 executes various functional applications and data processing by running the computer program stored in the memory 92, such as the sound signal processing method provided in Embodiment 1 of the present invention.

The electronic device 9 may further communicate with one or more external devices 94 (eg, keyboards, pointing devices, etc.). Such communication may take place through input/output (I/O) interface 95 . Also, the electronic device 9 may communicate with one or more networks (eg, a local area network (LAN), a wide area network (WAN), and/or a public network such as the Internet) through a network adapter 96 . The network adapter 96 communicates with other modules of the electronic device 9 via the bus 93 . It should be understood that, although not shown in the figures, other hardware and/or software modules may be used in conjunction with the electronic device 9, including but not limited to: microcode, device drivers, redundant processors, external disk drive arrays, RAID (disk array) systems, tape drives, and data backup storage systems.

It should be noted that although several units/modules or sub-units/modules of the electronic device are mentioned in the above detailed description, this division is merely exemplary and not mandatory. Indeed, according to embodiments of the present application, the features and functions of two or more units/modules described above may be embodied in one unit/module. Conversely, the features and functions of one unit/module described above may be further subdivided to be embodied by multiple units/modules.

Example 4

This embodiment provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, implements the steps of the sound signal processing method provided in Embodiment 1.

Wherein, the readable storage medium may include, but is not limited to, a portable disk, a hard disk, a random access memory, a read-only memory, an erasable programmable read-only memory, an optical storage device, a magnetic storage device, or any of the above suitable combination.

In a possible implementation manner, the present invention can also be implemented in the form of a program product, which includes program codes, when the program product runs on a terminal device, the program code is used to cause the terminal device to execute the implementation Steps of the sound signal processing method described in Embodiment 1.

Wherein, the program code for executing the present invention can be written in any combination of one or more programming languages, and the program code can be completely executed on the user equipment, partially executed on the user equipment, as an independent The software package executes on the user's device, partly on the user's device, partly on the remote device, or entirely on the remote device.

Although the specific embodiments of the present invention are described above, those skilled in the art should understand that this is only an illustration, and the protection scope of the present invention is defined by the appended claims. Those skilled in the art can make various changes or modifications to these embodiments without departing from the principle and essence of the present invention, but these changes and modifications all fall within the protection scope of the present invention.

Claims (10)

1. A method for processing a sound signal, comprising:

monitoring an external sound signal;

judging whether the external sound signal meets a trigger condition;

if so, raising the frequency of the sound signal to be played;

and playing the sound signal to be played after the frequency is raised.

2. The method for processing the sound signal according to claim 1, wherein the external sound signal includes an external noise signal, and the step of determining whether the external sound signal satisfies a trigger condition includes:

identifying an external noise signal in the external sound signal;

judging whether the volume of the external noise is greater than a first threshold value according to the external noise signal;

if yes, determining that the external sound signal meets a trigger condition;

and/or, the external sound signal includes an external voice signal, and the step of judging whether the external sound signal satisfies the trigger condition includes:

recognizing an external voice signal in the external sound signal;

judging whether the difference between the volume of the external voice at the current sampling moment and the volume of the external voice at the previous sampling moment is larger than a second threshold value or not according to the external voice signal;

and if so, determining that the external sound signal meets the trigger condition.

3. The method for processing the sound signal according to claim 1, wherein the external sound signal includes an external voice signal, and the step of determining whether the external sound signal satisfies a trigger condition includes:

recognizing an external voice signal in the external sound signal;

converting the external voice signal into text;

judging whether the characters comprise trigger keywords or not;

and if so, determining that the external sound signal meets the trigger condition.

4. The method for processing the audio signal according to claim 1, wherein the step of monitoring the external audio signal includes monitoring the external audio signal during a voice call;

the sound signal to be played comprises a voice call signal.

5. A system for processing a sound signal, comprising:

the monitoring module is used for monitoring external sound signals;

the judging module is used for judging whether the external sound signal meets a triggering condition;

if so, calling a lifting module, wherein the lifting module is used for lifting the frequency of the sound signal to be played;

and the playing module is used for playing the sound signal to be played after the frequency is raised.

6. The sound signal processing system according to claim 5, wherein the external sound signal includes an external noise signal, and the determining module includes:

a first recognition unit for recognizing an external noise signal in the external sound signal;

a first judgment unit for judging whether the volume of the external noise is larger than a first threshold value according to the external noise signal;

if yes, calling a determining unit, wherein the determining unit is used for determining that the external sound signal meets a trigger condition;

and/or, the external sound signal includes an external voice signal, and the judging module includes:

a second recognition unit for recognizing an external voice signal among the external sound signals;

the second judgment unit is used for judging whether the difference between the volume of the external voice at the current sampling moment and the volume of the external voice at the previous sampling moment is larger than a second threshold value or not according to the external voice signal;

and if so, calling a determining unit, wherein the determining unit is used for determining that the external sound signal meets the triggering condition.

7. The sound signal processing system according to claim 5, wherein the external sound signal includes an external voice signal, and the determining module includes:

a second recognition unit for recognizing an external voice signal among the external sound signals;

a conversion unit for converting the external voice signal into a text;

a third judging unit, configured to judge whether the text includes a trigger keyword;

and if so, calling a determining unit, wherein the determining unit is used for determining that the external sound signal meets the triggering condition.

8. The system for processing the sound signal according to claim 5, wherein the monitoring module is specifically configured to monitor an external sound signal during a voice call;

the sound signal to be played comprises a voice call signal;

the playing module comprises an earphone and/or a loudspeaker.

9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the method of processing a sound signal according to any one of claims 1 to 4 when executing the computer program.

10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of processing a sound signal according to any one of claims 1 to 4.

Images