CN112840678B - Stereo playing method, device, storage medium and electronic equipment - Google Patents

Abstract

The present application discloses a stereo playback method, comprising: extracting a stereo signal with orientation information in an audio signal, decoding the stereo signal to obtain a multi-channel signal, and transcoding the multi-channel signal into two-sound The two-channel signals are respectively subjected to crosstalk cancellation and output to the two speakers for playback. The present application also provides a stereo playback device, a storage medium and an electronic device.

Description

Stereo playback method, device, storage medium and electronic device

technical field

The present application belongs to the technical field of acoustics, and in particular, relates to a stereo playback method, device, storage medium and electronic device.

Background technique

With the continuous development of electronic devices, the multimedia playback function on mobile phones has become one of the functions that users use on a daily basis, and users have higher and higher requirements for the audio playback effect of mobile phones. Currently, one of the ways to improve the audio playback effect is to achieve stereo sound Play, to achieve the effect of stereo playback requires a large space and equipment, which is not conducive to the realization of stereo playback on portable electronic devices such as mobile phones. One solution is to set two speakers on the mobile phone as external devices, which can achieve the effect of stereo playback while increasing the volume.

SUMMARY OF THE INVENTION

Embodiments of the present application provide a stereo playback method, device, storage medium, and electronic device, which can achieve the effect of stereo playback.

In a first aspect, an embodiment of the present application provides a stereo playback method, which is applied to an electronic device, where the electronic device includes dual speakers, and the method includes:

Extract the stereo signal with orientation information in the audio signal;

decoding the stereo signal to obtain a multi-channel signal;

transcoding the multi-channel signal into a two-channel signal;

Crosstalk cancellation is performed on the two-channel signals respectively, and the two-channel signals are output to the two speakers for playback.

In a second aspect, an embodiment of the present application provides a stereo playback device, which is applied to an electronic device, where the electronic device includes dual speakers, and the device includes:

The extraction module is used to extract the stereo signal with orientation information in the audio signal;

a decoding module for decoding the stereo signal to obtain a multi-channel signal;

a transcoding module for transcoding the multi-channel signal into a two-channel signal;

A crosstalk cancellation module, configured to perform crosstalk cancellation on the two-channel signals respectively.

In a third aspect, an embodiment of the present application provides a storage medium on which a computer program is stored, wherein, when the computer program is executed on a computer, the computer is caused to execute the stereo playback provided in the first aspect of this embodiment. method.

In a fourth aspect, an embodiment of the present application provides an electronic device for stereo playback, including dual speakers, a processor, and a memory, wherein the processor is configured to execute: by invoking a computer program in the memory:

Extract the stereo signal with orientation information in the audio signal;

decoding the stereo signal to obtain a multi-channel signal;

transcoding the multi-channel signal into a two-channel signal;

Crosstalk cancellation is performed on the two-channel signals respectively, and the two-channel signals are output to the two speakers for playback.

Because the embodiment of the present application can transcode multi-channel signals into two-channel signals, and finally perform crosstalk cancellation on the two-channel signals with stereo signals, it is possible to achieve a stereo playback effect when two speakers play audio.

Description of drawings

The technical solutions of the present application and the beneficial effects thereof will be apparent through the detailed description of the specific embodiments of the present application in conjunction with the accompanying drawings.

FIG. 1 is a first flow chart of a stereo playback method provided by an embodiment of the present application.

FIG. 2 is a second flowchart of a stereo playback method provided by an embodiment of the present application.

FIG. 3 is a schematic diagram of a first scenario of stereo playback provided by an embodiment of the present application.

FIG. 4 is a schematic diagram of a second scenario of stereo playback provided by an embodiment of the present application.

FIG. 5 is a first structural schematic diagram of a stereo playback device provided by an embodiment of the present application.

FIG. 6 is a schematic diagram of a second structure of a stereo playback device provided by an embodiment of the present application.

FIG. 7 is a schematic structural diagram of an electronic device for stereo playback provided by an embodiment of the present application.

Detailed ways

Please refer to the drawings, wherein the same component symbols represent the same components, and the principles of the present application are exemplified by being implemented in a suitable computing environment. The following description is based on illustrated specific embodiments of the present application and should not be construed as limiting other specific embodiments of the present application not detailed herein.

In the following description, specific embodiments of the present application will be described with reference to steps and symbols executed by one or more computers, unless otherwise stated. Accordingly, the steps and operations will be referred to several times as being performed by a computer, which reference herein includes operations by a computer processing unit of electronic signals representing data in a structured format. This operation transforms the data or maintains it in a location in the computer's memory system, which can be reconfigured or otherwise change the operation of the computer in a manner well known to testers in the art. The data structures maintained by the data are physical locations of the memory that have specific characteristics defined by the data format. However, the principle of the present application is described by the above text, which is not meant to be a limitation, and testers in the art will understand that various steps and operations described below can also be implemented in hardware.

The terms "first," "second," and "third," etc. in this application are used to distinguish different objects, rather than to describe a specific order. Furthermore, the terms "comprising" and "having", and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device comprising a series of steps or modules is not limited to the listed steps or modules, but some embodiments also include unlisted steps or modules, or some embodiments Other steps or modules inherent to these processes, methods, products or devices are also included.

With the continuous development of electronic devices, such as smart phones and other electronic devices, some electronic devices are equipped with dual speakers. When users play audio, they can not only increase the volume, but also achieve the effect of stereo playback. Due to the relatively long distance between the dual speakers Recently, when the mobile phone is placed horizontally to play audio, when the ear receives the sound from the speaker on the same side, it also receives the sound from the other speaker, which is the phenomenon of crosstalk. The solutions provided in the embodiments of the present application can solve the problem of crosstalk phenomenon when audio is played by dual speakers, and achieve a stereo playback effect when audio is played by dual speakers.

In one embodiment, a stereo playback method, applied to an electronic device with dual speakers, includes:

Extract the stereo signal with orientation information in the audio signal;

decoding the stereo signal to obtain a multi-channel signal;

transcoding the multi-channel signal into a two-channel signal;

Crosstalk cancellation is performed on the two-channel signals respectively, and the two-channel signals are output to the two speakers for playback.

In one embodiment, extracting a stereo signal with orientation information in the audio signal includes:

determine whether the audio signal includes a stereo signal;

If not, encoding the audio signal to obtain the stereo signal with orientation information.

In one embodiment, transcoding the multi-channel signal into a two-channel signal includes:

Build a virtual speaker array based on the head-related transfer function;

Binaural transcoding is performed on the virtual speaker array signal.

In one embodiment, constructing a virtual speaker array based on a head-related transfer function includes:

Build the position of multiple virtual speakers in space;

The audio signals of the plurality of virtual speakers are respectively calculated based on a first formula, wherein the first formula is:

为第i个虚拟扬声器位置在垂直平面YZ上的方位角，d为一个比例系数，W为声道信号。Among them, Pi is the audio signal of the _{ith virtual speaker, θ i is} the azimuth angle of the position of the ith virtual speaker on the horizontal plane XY,

is the azimuth angle of the i-th virtual speaker position on the vertical plane YZ, d is a scale factor, and W is the channel signal.

In one embodiment, performing binaural transcoding on the virtual speaker array signal includes:

Perform binaural transcoding on the virtual speaker array signal based on the second formula, and a stereo signal of the binaural signal can be obtained, wherein the second formula is:

Where L is the left channel signal, R is the right channel signal, H is the head-related transfer function, and P is the audio signal of the virtual speaker.

In an embodiment, the performing crosstalk cancellation on the two-channel signal includes:

The left channel signal of the two-channel signal is passed through a high-pass filter, and the right channel signal is passed through a low-pass filter, so as to eliminate the crosstalk of the middle and low frequency signals.

In an embodiment, the performing crosstalk cancellation on the medium and low frequency signals includes:

Crosstalk cancellation is performed on the claimed medium and low frequency signal based on a third formula, wherein the third formula is:

where C is the cancellation matrix, G is the gain constant, L _LP is the left channel signal passed through the low pass filter, L _HP is the left channel signal passed through the high pass filter, and R _LP is the right channel signal passed through the low pass filter signal, R _HP is the right channel signal passed through the high-pass filter, L _out is the output left channel signal, and R _out is the output right channel signal.

Please refer to FIG. 1. FIG. 1 is a schematic flowchart of a stereo playback method provided by an embodiment of the present application. The stereo playback method can be applied to electronic equipment with dual speakers. The flow of the stereo playback method may include:

In 101, a stereo signal with orientation information in the audio signal is extracted.

When the electronic device plays audio, it will download the audio file from the network or open it locally. At this time, the audio signal will be input. The audio file has many formats. Some formats of audio files contain stereo information. After the audio signal is input, the audio signal is extracted to obtain a stereo signal with orientation information.

At 102, the stereo signal is decoded to obtain a multi-channel signal.

In one embodiment, the stereo playback effect may be the playback effect of multi-channel surround sound, since there are many different formats of multi-channel surround sound, for example, Dolby AC-3 (Dolby Audio Code 3) standard, DTS (Digital Theater Sound) standard. When playing audio, audio files of different audio coding formats have different input audio signals. The stereo signal contained in the audio signal is decoded, and the multi-channel signal is obtained according to the decoded information.

In 103, the multi-channel signal is transcoded to obtain a two-channel signal.

Before transcoding, the stereo signal is decoded to obtain a virtual speaker signal, and then a virtual speaker array is constructed according to the virtual speaker signal. The position of the virtual speaker array can be constructed based on the head-related transfer function. At any place in the space, the virtual speaker array signal containing different channel information is finally transcoded in two channels, and finally a two-channel signal with a stereo signal is obtained.

In 104, crosstalk cancellation is performed on the two-channel signals respectively, and the two-channel signals are output to the two speakers for playback.

The two-channel signal after transcoding the multi-channel signal needs to perform crosstalk elimination. In an embodiment, the purpose of crosstalk elimination is achieved by filtering the two-channel signal in different frequency bands. The shielding effect of the head, when playing audio, the crosstalk of high-frequency signals is not obvious, you can pass the left channel signal in the two-channel signal through a high-pass filter, and the right channel signal through a low-pass filter. , mainly to eliminate the crosstalk of the medium and low frequency signals in the two-channel signal, and finally output the two-channel signal after the crosstalk elimination to the dual speakers, and the dual speakers perform audio playback, so that the electronic equipment can achieve the effect of stereo playback.

It can be seen from the above that in this embodiment, the stereo signal is extracted from the audio signal, and then the stereo signal is decoded, the decoded multi-channel signal is transcoded into a two-channel signal, and the finally output two-channel signal is crosstalk eliminated. , output the dual-channel signal to dual speakers, and can achieve better stereo playback effect when playing audio on dual speakers.

Please refer to FIG. 2. FIG. 2 is a schematic flowchart of a second stereo playback method provided by an embodiment of the present application. The stereo playback method can be applied to electronic equipment with dual speakers. The flow of the stereo playback method may include:

In 201, an input audio signal is acquired.

There are many ways to obtain the input audio signal. For example, the user can use the mobile phone to download the audio file online on the network, and then when the audio file is played, the input audio signal is obtained. audio signal. Since there are many formats of audio files, for example, audio files have formats such as MP3, WMA, APE, AAC, etc., the audio signals input during audio playback are also different.

In 202, it is judged whether the input audio signal contains a stereo signal, if not, step 203 is executed.

It can be understood that different audio signals contain different information. Some input audio signals contain stereo signals. Common stereo signals include B-Format, N3D, SN3D and other formats. Stereo signals contain orientation information, but some audio The signal does not contain a stereo signal.

The stereo signal contains orientation information. For example, in a virtual three-dimensional space, the orientation information of the stereo signal can be multiple positions. It is understandable that in this three-dimensional virtual space, when the virtual speaker plays audio, it is in a three-dimensional virtual The human ear in the space can pick up the sound from the virtual speakers in various locations.

When processing the next steps, it is necessary to first determine whether the input audio signal contains a stereo signal. If the input audio signal contains a stereo signal, execute step 204, and if the input audio signal does not have a stereo signal, execute step 203.

In 203, the input audio signal is encoded.

When it is determined that the input audio signal does not contain a stereo signal, the audio signal needs to be encoded. In an embodiment, when the audio signal does not contain a stereo signal, it can be understood that the audio signal only contains a mono audio signal. In this case, the spatial parameters can be set, and the stereo parameters and mono The audio signals are combined and encoded into an audio signal with a stereo signal.

As shown in FIG. 3, FIG. 3 is a schematic diagram of a stereo playback scenario provided in this embodiment. For example, an input audio signal may be encoded into an audio signal having a stereo signal, wherein the stereo signal may be B-Format, N3D, SN3D and other formats, specifically, the stereo signal in the first-order B-Format format can be encoded, and the specific encoding process is as follows:

为虚拟扬声器位置在垂直平面YZ上的方位角。则公式中，θ_i为虚拟扬声器位置在水平面XY上的方位角，

为虚拟扬声器位置在垂直平面YZ上的方位角，其中，s_i为第i个音频信号，i＝(1,2…k)为音频信号的个数，W声道信号表示全方向的声信号，X声道信号，Y声道信号和Z声道信号分别表示空间三个互相垂直取向的声信号。In Figure 3, θ is the azimuth angle of the virtual speaker position on the horizontal plane XY,

is the azimuth of the virtual speaker position on the vertical plane YZ. In the formula, θ _i is the azimuth angle of the virtual speaker position on the horizontal plane XY,

is the azimuth angle of the virtual speaker position on the vertical plane YZ, where s _i is the ith audio signal, i=(1,2...k) is the number of audio signals, and the W channel signal represents the omnidirectional acoustic signal , the X channel signal, the Y channel signal and the Z channel signal respectively represent three acoustic signals oriented vertically to each other in space.

Through the formula, the input audio signal can finally be encoded into an audio signal having a stereo signal. In this embodiment, the encoded stereo signal can be a first-order B-Format stereo signal.

At 204, a virtual speaker array is constructed and the stereo signal with orientation information is decoded.

It can be understood that the virtual speaker array includes multiple virtual speakers. In the virtual three-dimensional virtual space, these virtual speakers are placed in different positions to decode the stereo signal with orientation information, so that the signal of the virtual speaker array has The orientation information is finally constructed into a virtual speaker array in a three-dimensional virtual space.

In one embodiment, a stereo signal in formats such as B-Format and N3D can be decoded into a plurality of virtual speaker signals for playback. At this time, a person is in the virtual three-dimensional space played by the virtual speakers and receives the sound from each virtual speaker. Realize stereo playback.

为虚拟扬声器位置在垂直平面YZ上的方位角，图中10、20、30、40、50、60、70、80为处在虚拟三维空间中不同位置的虚拟扬声器，虚拟扬声器的位置可以基于头相关传输函数创建，也可以通过其它方式创建。对B-Format格式的立体声信号解码成8个虚拟扬声器信号进行重放，此时，8个虚拟扬声器的空间位置分别为(45°，30°)、(-45°，30°)、(135°，30°)、(-135°，30°)、(45°，-30°)、(-45°，-30°)、(135°，-30°)、(-135°，-30°)。具体地，根据公式进行重放，公式如下：For example, please refer to FIG. 3. FIG. 3 is a schematic diagram of a stereo playback scene provided by this embodiment. The virtual three-dimensional space is in the shape of a cube, and may also be a space in other shapes. In this embodiment, the virtual three-dimensional space of a cube is used as an example. When the person is in the center of the virtual three-dimensional space, the mobile phone is placed directly in front of the person's head, L1 and R1 are the left and right speakers of the mobile phone, respectively, θ is the azimuth of the virtual speaker position on the horizontal plane XY,

is the azimuth angle of the virtual speaker position on the vertical plane YZ, 10, 20, 30, 40, 50, 60, 70, 80 in the figure are virtual speakers at different positions in the virtual three-dimensional space, and the position of the virtual speaker can be based on the head The associated transfer function is created, and can also be created in other ways. The stereo signal in B-Format format is decoded into 8 virtual speaker signals for playback. At this time, the spatial positions of the 8 virtual speakers are (45°, 30°), (-45°, 30°), (135°). °, 30°), (-135°, 30°), (45°, -30°), (-45°, -30°), (135°, -30°), (-135°, -30 °). Specifically, playback is performed according to the formula, which is as follows:

为虚拟扬声器位置在垂直平面YZ上的方位角，W声道信号表示全方向的声信号，d为一个比例系数，取值范围0～2，在本实施例中，推荐值取1。最终得到的虚拟扬声器阵列信号可以表示为：Among them, P _i is the playback signal of the ith virtual speaker, i=(1,2...8), θ _i is the azimuth angle of the virtual speaker position on the horizontal plane XY,

is the azimuth angle of the virtual speaker position on the vertical plane YZ, the W channel signal represents the omnidirectional sound signal, d is a proportional coefficient, and the value ranges from 0 to 2. In this embodiment, the recommended value is 1. The resulting virtual speaker array signal can be expressed as:

In 205, the decoded multi-channel signal is transcoded into a two-channel signal.

In one embodiment, the virtual speaker array position may be constructed based on the head-related transfer function HRTF, and the multi-channel virtual speaker array signal is binaurally transcoded to obtain a binaural output stereo signal. According to the virtual speaker array signal obtained in the previous step, each virtual speaker corresponds to the head-related transfer function HRTF of the corresponding spatial angle, and in the time domain is the head-related impulse response HRIR, then the stereo signal of the two-channel is:

Among them, L and R represent the left channel signal and the right channel signal respectively, H is the head-related transfer function, and P is the playback signal of the virtual speaker.

At 206, crosstalk cancellation is performed on the binaural signal.

When two speakers play audio, if the distance between the two speakers is very close, crosstalk will occur. At this time, it is necessary to perform crosstalk cancellation processing on the input two-channel signal, so that there is no crosstalk when the two speakers play audio.

Please refer to FIG. 4 . FIG. 4 is a schematic diagram of a stereo playback scenario provided by this embodiment. In FIG. 4 , H _LL , H _RR , H _RL and H _LR are the head-related transfer function HRTF, and 1 is the left speaker of the mobile phone , 2 is the right speaker of the mobile phone, 3 is the left ear of the human being, and 4 is the right ear of the human being. When the dual speakers of the mobile phone play audio, both the left and right speakers can emit sound, and the human ear will receive the sound from the two speakers. , in the absence of audio signal processing, due to the close distance between the two speakers, when the phone is placed horizontally to play audio, when the ear receives the sound from the speaker on the same side, it will also receive the sound from the other speaker. , this is the crosstalk phenomenon. After the input audio signal is processed to eliminate the crosstalk, and then use the dual speakers of the mobile phone to play the audio, there will be no crosstalk phenomenon. Adjusted for actual production use.

In an embodiment, the sound that the human ear hears from the dual speakers of the mobile phone can be expressed as:

Among them, H _LL , H _RR , H _RL and H _LR are head related transfer functions HRTF. In order to eliminate the crosstalk phenomenon, so that the sound from the left channel and the sound from the right channel will not appear crosstalk in the human ear, it is necessary to create a cancellation matrix C, so that

In reality, due to the shielding effect of the human head, the crosstalk of high-frequency signals is not obvious. Crosstalk cancellation for medium and low frequency signals:

where G is the gain constant, L _LP is the left channel signal passed through the low pass filter, L _HP is the left channel signal passed through the high pass filter, R _LP is the right channel signal passed through the low pass filter, and R _HP is The right channel signal passed through the high-pass filter, L _out is the output left channel signal, R _out is the output right channel signal, and the crossover point f ₀ of the filter used can take a value in the range of 3500-5500 Hz. This implementation In the example, the value is 4000Hz.

According to the above process, the input two-channel signal is processed to achieve the effect of eliminating the crosstalk of the two-channel signal.

In 207, the audio signal is input to dual speaker playback.

After completing the step of eliminating the crosstalk, the dual-channel signal is input to the dual speakers, and when the dual speakers play audio, the crosstalk phenomenon is eliminated, and the effect of stereo playback is realized.

As can be seen from the above, the embodiment of the present application judges whether the input audio signal has a stereo signal by judging the input audio signal, and if there is a stereo signal, a virtual speaker array is constructed to decode the stereo signal with orientation information. If the input audio signal does not have a stereo signal, encode the audio signal to make it have a stereo signal, then construct a virtual speaker array, decode the stereo signal with orientation information, and then transcode the decoded multi-channel signal Convert the two-channel signal into a two-channel signal, eliminate the crosstalk of the transcoded two-channel signal, and input the audio signal to the dual speakers for playback to achieve the effect of stereo playback.

In one embodiment, the stereo playback device includes:

The extraction module is used to extract the stereo signal with orientation information in the audio signal;

a decoding module for decoding the stereo signal to obtain a multi-channel signal;

a transcoding module for transcoding the multi-channel signal into a two-channel signal;

A crosstalk cancellation module, configured to perform crosstalk cancellation on the two-channel signals respectively.

In one embodiment, the extraction module includes:

A judging submodule for judging whether the audio signal includes a stereo signal;

an encoding sub-module, configured to encode the audio signal when the determination sub-module determines that it is no, so as to obtain the stereo signal with orientation information.

In one embodiment, the transcoding module includes:

an array construction submodule for constructing a virtual speaker array based on the head-related transfer function;

The transcoding submodule is specifically configured to perform binaural transcoding on the virtual speaker array signal.

In one embodiment, the array construction sub-module is specifically used to construct the positions of multiple virtual speakers in space;

The audio signals of the plurality of virtual speakers are respectively calculated based on a first formula, wherein the first formula is:

为第i个虚拟扬声器位置在垂直平面YZ上的方位角，d为一个比例系数，W为声道信号。Among them, Pi is the audio signal of the _{ith virtual speaker, θ i is} the azimuth angle of the position of the ith virtual speaker on the horizontal plane XY,

is the azimuth angle of the i-th virtual speaker position on the vertical plane YZ, d is a scale factor, and W is the channel signal.

In one embodiment, the crosstalk cancellation module includes:

The filtering sub-module is used to pass the left channel signal of the two-channel signal through a high-pass filter, and the right channel signal through a low-pass filter, so as to eliminate the crosstalk of the middle and low frequency signals.

Please refer to FIG. 5. FIG. 5 is a stereo playback device provided by an embodiment of the present application. The stereo playback device 500 is applied to an electronic device containing dual speakers. The stereo playback device 500 includes an extraction module 501, a decoding module 502, a transcoding module 503, and a crosstalk module. Elimination module 504 .

Among them, the extraction module 501 is used for extracting the stereo signal with orientation information in the audio signal.

Specifically, when a user uses an electronic device to play audio, the audio file will be opened through network download or local storage, and an audio signal will be input at this time. The audio file has many formats, for example, the audio file has MP3, WMA , APE, AAC and other formats, some audio files contain stereo information. After the electronic device receives the input audio signal, the extraction module 501 will extract the audio signal to obtain a stereo signal with orientation information.

The decoding module 502 is configured to decode the stereo signal to obtain a multi-channel signal.

The decoding module 502 decodes the stereo signals in B-Format, N3D, SN3D and other formats to obtain multi-channel signals. It can be understood that in the virtual three-dimensional space, the multi-channel signals may be sent by virtual speakers at different positions.

The transcoding module 503 is configured to transcode the multi-channel signal into a dual-channel signal.

In one embodiment, the virtual speaker array position may be constructed based on the head-related transfer function HRTF, and the multi-channel virtual speaker array signal is binaurally transcoded to obtain a binaural output stereo signal.

It should be noted that after the multi-channel signal is transcoded, the obtained two-channel signal has a stereo signal, and the multi-channel signal can be understood as an audio signal sent by multiple virtual speakers.

The crosstalk cancellation module 504 is configured to perform crosstalk cancellation on the two-channel signals respectively and output the signals to the two speakers for playback.

The two-channel signal after transcoding the multi-channel signal needs to perform crosstalk elimination. In an embodiment, the purpose of crosstalk elimination is achieved by filtering the two-channel signal in different frequency bands. The shielding effect of the head, when playing audio, the crosstalk of high-frequency signals is not obvious, you can pass the left channel signal in the two-channel signal through a high-pass filter, and the right channel signal through a low-pass filter. , mainly to eliminate the crosstalk of the medium and low frequency signals in the two-channel signal, and finally output the two-channel signal after the crosstalk elimination to the dual speakers, and the dual speakers perform audio playback, so that the electronic equipment can achieve the effect of stereo playback.

Please also refer to FIG. 6 . FIG. 6 is another schematic structural diagram of a stereo playback device provided by an embodiment of the present application. The stereo playback device 500 is applied to an electronic device with dual speakers. In some embodiments, the extraction module 501 may include a judgment sub-module 5011 and an encoding sub-module 5012 .

The judging module 5011 is used for judging whether the audio signal contains a stereo signal.

In the input audio signal, some audio signals do not contain a stereo signal with orientation information, and a judgment needs to be made on the input audio signal. If the input audio signal does not have a stereo signal, the encoding sub-module 5012 needs to continue. Go to the next step.

The encoding sub-module 5012 is configured to encode the audio signal that does not contain the stereo signal to obtain the stereo signal with orientation information.

When it is determined that the input audio signal does not contain a stereo signal, the audio signal needs to be encoded. In an embodiment, when the audio signal does not contain a stereo signal, it can be understood that the audio signal only contains a mono audio signal. In this case, the spatial parameters can be set, and the stereo parameters and mono The audio signals are combined and encoded into an audio signal with a stereo signal.

In some embodiments, the transcoding module 503 includes an array construction sub-module 5031 and a transcoding sub-module 5032.

The array construction sub-module 5031 is used to construct a virtual speaker array based on the head-related transfer function.

It can be understood that the virtual speaker array includes multiple virtual speakers. In the virtual three-dimensional virtual space, these virtual speakers are placed in different positions to decode the stereo signal with orientation information, so that the signal of the virtual speaker array has The orientation information is finally constructed into a virtual speaker array in a three-dimensional virtual space.

The transcoding sub-module 5032 is specifically configured to perform binaural transcoding on the virtual speaker array signal.

In one embodiment, a stereo signal in formats such as B-Format and N3D can be decoded into a plurality of virtual speaker signals for playback. At this time, a person is in the virtual three-dimensional space played by the virtual speakers and receives the sound from each virtual speaker. Realize stereo playback.

In some embodiments, the crosstalk cancellation module 504 includes a filtering module 5041 for passing the left channel signal of the binaural signal through a high-pass filter, and the right channel signal through a low-pass filter.

Specifically, the two-channel signal generated after transcoding needs to be filtered, and the output two-channel signal will not have crosstalk when it is played by two speakers, because, in reality, due to the human head Shielding effect, the crosstalk phenomenon of high-frequency signals is not obvious. In this embodiment, the left channel signal and the right channel signal of the two-channel stereo signal are passed through the high-pass filter and the low-pass filter respectively, and the crosstalk is mainly eliminated for the middle and low frequency signals. .

It should be noted that, in the present application, when it is determined that the input audio signal does not have a stereo signal, the audio signal can be encoded into an audio signal containing stereo signals in multiple formats, and the multi-channel signal can be transcoded into a two-channel audio signal. When the signal is transcoded, it can be transcoded according to a preset transcoding method. For example, by using the spatial information contained in the multi-channel signal itself, in the final crosstalk elimination step, in the embodiment of the present application, the medium and low frequency signals are filtered. To achieve the purpose of eliminating crosstalk, specifically, the real-time adjustment of the two-channel signal can be performed according to the placement method of the mobile phone, which is not limited to the present application.

As can be seen from the above, the embodiment of the present application judges whether the input audio signal has a stereo signal by judging the input audio signal, and if there is a stereo signal, a virtual speaker array is constructed to decode the stereo signal with orientation information. If the input audio signal does not have a stereo signal, encode the audio signal to make it have a stereo signal, then construct a virtual speaker array, decode the stereo signal with orientation information, and then transcode the decoded multi-channel signal Convert the two-channel signal into a two-channel signal, eliminate the crosstalk of the transcoded two-channel signal, and input the audio signal to the dual speakers for playback to achieve the effect of stereo playback.

In the embodiment of the present application, the stereo playback device and the stereo playback method in the above embodiments belong to the same concept, and any method provided in the embodiment of the stereo playback method can be executed on the stereo device. For the specific implementation process, please refer to the stereo playback method. embodiment, which will not be repeated here.

As used herein, the term "module" can be thought of as a software object that executes on the computing system. The various components, modules, engines, and services described herein can be viewed as objects of implementation on the computing system. The apparatus and method described herein can be implemented in software, and certainly can also be implemented in hardware, which are all within the protection scope of the present application.

Embodiments of the present application further provide a storage medium, on which a computer program is stored, and when the computer program runs on a computer, the computer can execute the above-mentioned method for playing in stereo.

The embodiments of the present application also provide an electronic device, such as a tablet computer, a mobile phone and other electronic devices. The processor in the electronic device loads the instructions corresponding to the processes of one or more application programs into the memory according to the following steps, and the processor runs the application programs stored in the memory, thereby realizing various functions:

Extract the stereo signal with orientation information in the audio signal;

decoding the stereo signal to obtain a multi-channel signal;

transcoding the multi-channel signal into a two-channel signal;

Crosstalk cancellation is performed on the two-channel signals respectively, and the two-channel signals are output to the two speakers for playback.

In one embodiment, when extracting a stereo signal with orientation information in an audio signal, the processor is configured to perform the following steps:

determine whether the audio signal includes a stereo signal;

If not, encoding the audio signal to obtain the stereo signal with orientation information.

In one embodiment, when transcoding the multi-channel signal into a two-channel signal, the processor is configured to perform the following steps:

Build a virtual speaker array based on the head-related transfer function;

Binaural transcoding is performed on the virtual speaker array signal.

In one embodiment, when constructing the virtual speaker array based on the head-related transfer function, the processor is configured to perform the following steps:

Build the position of multiple virtual speakers in space;

The audio signals of the plurality of virtual speakers are respectively calculated based on a first formula, wherein the first formula is:

为第i个虚拟扬声器位置在垂直平面YZ上的方位角，d为一个比例系数，W为声道信号。Among them, Pi is the audio signal of the _{ith virtual speaker, θ i is} the azimuth angle of the position of the ith virtual speaker on the horizontal plane XY,

is the azimuth angle of the i-th virtual speaker position on the vertical plane YZ, d is a scale factor, and W is the channel signal.

In one embodiment, when performing binaural transcoding on the virtual speaker array signal, the processor is configured to perform the following steps:

Perform binaural transcoding on the virtual speaker array signal based on the second formula, and a stereo signal of the binaural signal can be obtained, wherein the second formula is:

Where L is the left channel signal, R is the right channel signal, H is the head-related transfer function, and P is the audio signal of the virtual speaker.

In one embodiment, the processor is configured to perform the following steps when performing crosstalk cancellation on the medium and low frequency signals:

Crosstalk cancellation is performed on the claimed medium and low frequency signal based on a third formula, wherein the third formula is:

where C is the cancellation matrix, G is the gain constant, L _LP is the left channel signal passed through the low pass filter, L _HP is the left channel signal passed through the high pass filter, and R _LP is the right channel signal passed through the low pass filter signal, R _HP is the right channel signal passed through the high-pass filter, L _out is the output left channel signal, and R _out is the output right channel signal.

Reference herein to an "embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the present application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor a separate or alternative embodiment that is mutually exclusive of other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

Please refer to FIG. 7 . FIG. 7 is a schematic structural diagram of an electronic device for stereo playback provided by an embodiment of the present invention. The electronic device 700 includes: a processor 701 , a display 702 , a memory 703 , a radio frequency circuit 704 , an audio module 705 and a power supply 706 .

The processor 701 is the control center of the electronic device 700, using various interfaces and lines to connect various parts of the entire electronic device, by running or loading the computer program stored in the memory 702, and calling the data stored in the memory 702, Various functions of the electronic device 700 are performed and data is processed, thereby overall monitoring of the electronic device 700 is performed.

The memory 702 can be used to store software programs and modules, and the processor 701 executes various functional applications and data processing by running the computer programs and modules stored in the memory 702 . The memory 702 may mainly include a stored program area and a stored data area, wherein the stored program area may store an operating system, a computer program (such as a sound playback function, an image playback function, etc.) required for at least one function, and the like; Data created by the use of electronic equipment, etc. Additionally, memory 702 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, memory 702 may also include a memory controller to provide processor 701 access to memory 702 .

In the embodiment of the present application, the processor 701 in the electronic device 700 loads the instructions corresponding to the processes of one or more computer programs into the memory 702 according to the following steps, and is executed by the processor 701 and stored in the memory 702 The computer program in , so as to realize various functions, as follows:

Obtain the input audio signal, extract the stereo signal with orientation information in the input audio signal, if the input audio signal does not have a stereo signal, encode the input audio signal to make it have a stereo signal, and then, encode the input audio signal with a stereo signal. The audio signal is decoded to obtain a multi-channel signal, the head-related transfer function is used to create a virtual speaker array, the multi-channel signal is transcoded into a two-channel signal with a stereo signal, and crosstalk is eliminated for the two-channel signal. Finally, the two-channel signal after the crosstalk cancellation is output to the dual speakers for playback, so as to realize the stereo playback effect when the electronic device plays the audio.

The display 703 may be used to display information input by or provided to the user and various graphical user interfaces, which may be composed of graphics, text, icons, video, and any combination thereof. The display 703 may include a display panel, and in some embodiments, the display panel may be configured in the form of a Liquid Crystal Display (LCD), or an Organic Light-Emitting Diode (OLED).

The radio frequency circuit 704 can be used to send and receive radio frequency signals, so as to establish wireless communication with the network device or other electronic devices through wireless communication, and to send and receive signals with the network device or other electronic devices.

The audio module 705 includes dual speakers and audio circuits. The audio circuit can convert the received audio data into an electrical signal and transmit it to the dual speakers, which are converted into sound signals for output; on the other hand, the microphone converts the collected sound signals into electrical signals, which are received and converted by the audio circuit. In the form of audio data, the audio data is output to the processor 701 for processing, and then sent to, for example, another terminal via the radio frequency circuit 704, or the audio data is output to the memory 702 for further processing. Audio circuitry may also include earplug jacks to provide peripheral headsets to communicate with the terminal.

Power supply 706 may be used to power various components of electronic device 700 . In some embodiments, the power supply 706 may be logically connected to the processor 701 through a power management system, so as to implement functions such as managing charging, discharging, and power consumption through the power management system.

Although not shown in FIG. 7 , the electronic device 700 may further include a camera, a Bluetooth module, etc., which will not be described in detail here.

In this embodiment of the present application, the storage medium may be a magnetic disk, an optical disk, a read only memory (Read Only Memory, ROM), or a random access memory (Random Access Memory, RAM), or the like.

In the above-mentioned embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

It should be noted that, for the stereo playback method of the embodiment of the present application, ordinary testers in the art can understand that all or part of the process of realizing the user gender prediction method of the embodiment of the present application can be completed by controlling the relevant hardware through a computer program. , the computer program can be stored in a computer-readable storage medium, such as in a memory of an electronic device, and executed by at least one processor in the electronic device, and the execution process can include, for example, the implementation of a method for predicting gender of a user example process. The storage medium can be a magnetic disk, an optical disk, a read-only memory, a random access memory, or the like.

For the stereo playback device of the embodiment of the present application, each functional module may be integrated in one processing chip, or each module may exist physically alone, or two or more modules may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware, and can also be implemented in the form of software function modules. If the integrated modules are implemented in the form of software functional modules and sold or used as independent products, they can also be stored in a computer-readable storage medium, such as a read-only memory, a magnetic disk or an optical disk.

A stereo playback method, device, storage medium, and electronic device provided by the embodiments of the present application have been described in detail above. The principles and implementations of the present application are described with specific examples. The descriptions of the above embodiments are only It is used to help understand the method and the core idea of the present application; meanwhile, for those skilled in the art, according to the idea of the present application, there will be changes in the specific embodiments and application scope. In summary, this specification The content should not be construed as a limitation on this application.

Claims (9)

1. A stereo playing method is applied to an electronic device, the electronic device comprises two loudspeakers, and the method comprises the following steps:

extracting a stereo signal with azimuth information in the audio signal;

decoding the stereo signal to obtain a multi-channel signal;

constructing the positions of a plurality of virtual loudspeakers in the space according to the multi-channel signals;

respectively calculating audio signals of a plurality of virtual speakers based on a first formula to obtain a virtual speaker array signal, wherein the first formula is as follows:

wherein,

is a first

The audio signal of the individual virtual loudspeakers is,

Is as follows

The azimuth of the virtual loudspeaker position in the horizontal plane XY,

is as follows

The azimuth angle of the virtual loudspeaker position on a vertical plane YZ, d is a proportionality coefficient, and W is a sound channel signal;

performing binaural transcoding on the virtual speaker array signal to obtain a binaural signal;

respectively carrying out crosstalk elimination on the two-channel signals and outputting the two-channel signals to the dual loudspeakers for playing, wherein the crosstalk elimination on the two-channel signals comprises the following steps:

enabling a left channel signal of the two-channel signal to pass through a high-pass filter, enabling a right channel signal to pass through a low-pass filter, and eliminating crosstalk of the middle-low frequency signal based on a third formula, wherein the third formula is as follows:

where C is the cancellation matrix, G is the gain constant,

is the left channel signal that is passed through the low pass filter,

is the left channel signal that is passed through a high pass filter,

is the right channel signal that is passed through the low pass filter,

for the right channel signal to pass through the high pass filter,

in order to output the left channel signal of the left channel,

is the output right channel signal.

2. The stereo playback method as defined in claim 1, wherein extracting the stereo signal having the azimuth information from the audio signal comprises:

Judging whether the audio signal contains a stereo signal;

if not, the audio signal is encoded to obtain the stereo signal with the azimuth information.

3. The stereo playback method as defined in claim 1, wherein the binaural transcoding of the virtual speaker array signal comprises:

and performing binaural transcoding on the virtual speaker array signal based on a second formula to obtain a stereo signal of the binaural signal, where the second formula is:

where L is the left channel signal, R is the right channel signal, H is the head related transfer function, and P is the audio signal of the virtual speaker.

4. A stereo playing device applied to an electronic device comprising two loudspeakers, comprises:

the device comprises an extraction module, a decoding module, a transcoding module and a crosstalk elimination module;

the extraction module is used for extracting a stereo signal with azimuth information in the audio signal;

the decoding module is used for decoding the stereo signal to obtain a multi-channel signal;

the transcoding module comprises an array construction sub-module and a transcoding sub-module;

the array construction submodule is specifically used for constructing the positions of a plurality of virtual loudspeakers in the space according to the multi-channel signals;

Respectively calculating audio signals of a plurality of virtual speakers based on a first formula to obtain a virtual speaker array signal, wherein the first formula is as follows:

wherein,

is as follows

The audio signals of the individual virtual loudspeakers,

is as follows

The azimuth of the virtual loudspeaker position in the horizontal plane XY,

is a first

The azimuth angle of the virtual loudspeaker position on a vertical plane YZ, d is a proportionality coefficient, and W is a sound channel signal;

the transcoding sub-module is used for performing double-channel transcoding on the virtual loudspeaker array signal to obtain a double-channel signal;

the crosstalk elimination module is configured to perform crosstalk elimination on the binaural signals respectively and output the binaural signals to the dual speakers for playing, where performing crosstalk elimination on the binaural signals includes:

enabling a left channel signal of the two-channel signal to pass through a high-pass filter, enabling a right channel signal to pass through a low-pass filter, and eliminating crosstalk of the middle-low frequency signal based on a third formula, wherein the third formula is as follows:

where C is the cancellation matrix, G is the gain constant,

is the left channel signal that is passed through the low pass filter,

is the left channel signal that is passed through a high pass filter,

is the right channel signal that is passed through the low pass filter,

For the right channel signal to pass through the high pass filter,

in order to output the left channel signal,

is the output right channel signal.

5. The stereo playback device according to claim 4, wherein the extraction module includes:

the judgment submodule is used for judging whether the audio signal contains a stereo signal;

and the coding submodule is used for coding the audio signal to obtain the stereo signal with the azimuth information when the judgment submodule judges that the audio signal is not the stereo signal with the azimuth information.

6. A storage medium having stored thereon a computer program, wherein the computer program, when executed on a computer, causes the computer to perform the method of any of claims 1 to 3.

7. An electronic device for stereophonic sound reproduction comprising dual speakers, a processor and a memory, wherein said processor is adapted to execute, by invoking a computer program in said memory:

extracting a stereo signal with azimuth information in the audio signal;

decoding the stereo signal to obtain a multi-channel signal;

constructing the positions of a plurality of virtual loudspeakers in the space according to the multi-channel signals;

respectively calculating audio signals of a plurality of virtual speakers based on a first formula to obtain a virtual speaker array signal, wherein the first formula is as follows:

Wherein,

is as follows

The audio signals of the individual virtual loudspeakers,

is as follows

The azimuth of the virtual loudspeaker position in the horizontal plane XY,

is as follows

The azimuth angle of the virtual loudspeaker position on a vertical plane YZ, d is a proportionality coefficient, and W is a sound channel signal;

performing binaural transcoding on the virtual speaker array signal to obtain a binaural signal;

respectively carrying out crosstalk elimination on the two-channel signals and outputting the two-channel signals to the dual loudspeakers for playing, wherein the crosstalk elimination on the two-channel signals comprises the following steps:

enabling a left channel signal of the two-channel signal to pass through a high-pass filter, enabling a right channel signal to pass through a low-pass filter, and eliminating crosstalk of the middle-low frequency signal based on a third formula, wherein the third formula is as follows:

where C is the cancellation matrix, G is the gain constant,

is the left channel signal that is passed through the low pass filter,

is the left channel signal that is passed through a high pass filter,

is the right channel signal that is passed through the low pass filter,

for the right channel signal to pass through the high pass filter,

is an outputOf the left channel signal of (a) a left channel signal,

is the output right channel signal.

8. The electronic device for stereophonic sound reproduction according to claim 7, wherein, when extracting a stereophonic sound signal having orientation information from the audio signal, the processor is configured to perform:

Judging whether the audio signal contains a stereo signal;

if not, the audio signal is coded to obtain the stereo signal with the azimuth information.

9. The electronic device of claim 8, wherein the processor is configured to perform, when binaural transcoding is performed on the virtual speaker array signal:

performing crosstalk cancellation on the low and medium frequency signals based on a second formula, wherein the second formula is as follows:

where L is the left channel signal, R is the right channel signal, H is the head related transfer function, and P is the audio signal of the virtual speaker.

Images