CN106303836A - Method and device for adjusting stereo playing - Google Patents

Abstract

The invention discloses a method for adjusting stereo playback. The method includes: obtaining the positioning information of multiple smart speakers in a user environment detected by a microphone array; obtaining the audio features of the multiple smart speakers extracted by the microphone array; according to The positioning information and/or the audio features generate a speaker control instruction; and send the generated speaker control instruction to associated smart speakers, so as to adjust the stereo playback effect of the multiple smart speakers. The present invention realizes the adjustment of the playback effect of the speaker according to the relative positions of the smart speaker and the user, so that the stereo playback sound is more realistic and the user experience is improved.

Description

A method and device for adjusting stereo playback

technical field

The invention relates to the field of smart devices, in particular to a method and device for adjusting stereo playback.

Background technique

In order to pursue better audio-visual enjoyment, many smart devices currently have stereo playback effects, especially by connecting to external smart speakers. However, when the positions of multiple external smart speakers are not fixed, because the device itself will not Adjusting the position of the speaker and the position of the user cannot achieve realistic audio-visual enjoyment.

Contents of the invention

In view of this, the object of the present invention is to propose a method and device for adjusting stereo playback, which can optimize the stereo playback effect according to the position of the smart speaker and the user's position.

To achieve the above object, the present invention adopts the following technical solutions:

In a first aspect, an embodiment of the present invention provides a method for adjusting stereo playback, including:

Obtain the positioning information of multiple smart speakers in the user environment detected by the microphone array;

Acquiring audio features of the plurality of smart speakers extracted by the microphone array;

generating a speaker control instruction according to the positioning information and/or the audio feature;

Send the generated speaker control instructions to the associated smart speakers, so as to adjust the stereo playback effect of the multiple smart speakers.

In a second aspect, an embodiment of the present invention provides a device for adjusting stereo playback, including:

The positioning information acquisition module is used to obtain the positioning information of multiple smart speakers in the user environment detected by the microphone array;

An audio feature acquisition module, configured to acquire the audio features of the plurality of smart speakers extracted by the microphone array;

an instruction generating module, configured to generate a speaker control instruction according to the positioning information and/or the audio feature;

The instruction sending module is configured to send the generated speaker control instructions to associated smart speakers, so as to adjust the stereo playback effect of the multiple smart speakers.

The beneficial effects of the present invention are: a method and device for adjusting stereo playback provided by the present invention realizes the positioning of the smart speaker and the extraction of audio features through the microphone array, adjusts the playback effect of the speaker, and makes the stereo playback sound more Realistic, enhance user experience.

Description of drawings

Exemplary embodiments of the present invention will be described in detail below with reference to the accompanying drawings, so that those of ordinary skill in the art will be more aware of the above-mentioned and other features and advantages of the present invention. In the accompanying drawings:

FIG. 1 is a schematic flowchart of a method for adjusting stereo playback provided by Embodiment 1 of the present invention;

FIG. 2 is a schematic flowchart of a method for adjusting stereo playback provided by Embodiment 2 of the present invention;

FIG. 3 is a structural block diagram of a device for adjusting stereo playback provided by Embodiment 3 of the present invention;

Fig. 4 is a structural block diagram of a device for adjusting stereo playback provided by Embodiment 4 of the present invention.

detailed description

The technical solutions of the present invention will be further described below in conjunction with the accompanying drawings and through specific implementation methods. It should be understood that the specific embodiments described here are only used to explain the present invention, but not to limit the present invention. In addition, it should be noted that, for the convenience of description, only some structures related to the present invention are shown in the drawings but not all structures.

Embodiment one

FIG. 1 is a schematic flowchart of a method for adjusting stereo playback provided by Embodiment 1 of the present invention. The method is suitable for stereo playback, and the method can be executed by a device for adjusting stereo playback. The device for adjusting stereo playback can be realized by software and/or hardware. As shown in Figure 1, the method includes:

Step 110 , acquiring location information of multiple smart speakers in the user environment detected by the microphone array.

In this embodiment, the microphone array is set on the smart terminal, and the microphone array is composed of multiple microphones. The smart terminal can be an electronic device such as a smart phone, a tablet computer, a smart bracelet, and a smart watch, and the user carries or wears the smart terminal, so that the location of the user is consistent with that of the smart terminal.

The microphone array respectively locates multiple smart speakers in the user's surrounding environment according to the user's position, and obtains the relative distance between each smart speaker and the user, and the smart terminal obtains the positioning information transmitted by the microphone array.

Step 120, acquiring the audio features of multiple smart speakers extracted by the microphone array.

The microphone array analyzes the audio characteristics of the smart speakers by receiving the audio information of each smart speaker, and obtains the performance parameters of the smart speakers according to the audio characteristics, and the smart terminal obtains the audio characteristics of the smart speakers transmitted by the microphone array. Among them, the audio characteristics may include: pitch, loudness and timbre, etc.; the performance parameters may include: frequency range and frequency response, distortion and signal-to-noise ratio, etc.

Step 130: Generate a speaker control instruction according to the positioning information and/or audio characteristics.

Specifically, the smart terminal generates a speaker control instruction according to the relative position of the speaker and the user, or generates a speaker control instruction according to the audio characteristics of the speaker, or generates a speaker control instruction according to the relative position of the user and the audio characteristics of the corresponding speaker. And the speaker control commands generated by different methods are different.

Step 140: Send the generated speaker control instruction to the associated smart speakers, so as to adjust the stereo playback effect of multiple smart speakers.

Specifically, the smart terminal sends the generated speaker control instructions to the corresponding smart speakers, and the smart speakers adjust their own playback effects according to the received speaker control instructions, thereby adjusting the stereo playback effects of all smart speakers and realizing stereo playback of the smart speakers. adjust.

A method for adjusting stereo playback provided by Embodiment 1 of the present invention uses a microphone array to locate a smart speaker according to the location of the user to obtain location information of the smart speaker; at the same time, uses a microphone array to extract audio features of the smart speaker to obtain smart The performance parameters of the speaker; the processor in the smart terminal generates a corresponding speaker control command according to the positioning information and/or audio characteristics of the smart speaker, sends the generated speaker control command to the corresponding smart speaker, and adjusts the playback of the smart speaker, Realize the adjustment of stereo playback, make stereo playback sound more realistic, and improve user experience.

Embodiment two

Fig. 2 is a schematic flowchart of a method for adjusting stereo playback provided by Embodiment 2 of the present invention. This embodiment is optimized on the basis of the above embodiments. In this embodiment, the positioning information of multiple smart speakers in the user environment detected by the microphone array is optimized as follows: determine whether the user is in a state of motion; if the user is in a state of motion, The positioning information of multiple smart speakers in the user environment detected by the microphone array is obtained; after obtaining the audio features of the multiple smart speakers extracted by the microphone array, the audio data to be played is processed according to the audio features, and the processed audio data Send to multiple smart speakers for playback.

Correspondingly, the method in this embodiment specifically includes:

Step 210, determine whether the user is in a motion state; if the user is in a motion state, obtain the positioning information of multiple smart speakers in the user's environment detected by the microphone array.

In this embodiment, the processor in the smart terminal judges the user's motion state by receiving the three-axis acceleration and three-axis angular velocity detected by the motion sensor and combining the GPS positioning information; by judging whether the user is in a motion state, it is judged whether the microphone array is It is necessary to detect the position information of the smart speaker, which can effectively save the operating cost of the microphone. When the user is not in the state of exercise, the microphone array may not detect; when the user is out of the state of exercise, it starts to detect the position information of the smart speaker.

Step 220, acquiring the audio features of multiple smart speakers extracted by the microphone array.

Step 230: Process the audio data to be played according to the audio characteristics, and send the processed audio data to multiple smart speakers for playback.

Specifically, the smart terminal judges the performance parameters of each smart speaker according to the audio characteristics played by the smart speaker, and performs corresponding processing on the audio data that each smart speaker needs to play in combination with the sound effects that need to be played at present, so that the played audio can achieve ideal playback. Effect.

Step 240: Generate a speaker control instruction according to the positioning information and/or audio characteristics.

Step 250 , sending the generated speaker control instruction to associated smart speakers, so as to adjust the stereo playback effect of multiple smart speakers.

It should be noted that, in this embodiment, the operation sequence of step 230 , step 240 and step 250 is not specifically limited, and only step 250 is performed after step 240 .

Further, generating the speaker control instruction according to the positioning information may include: determining the playing time difference of the multiple smart speakers according to the positioning information of the multiple smart speakers; and generating the playing start instruction according to the determined playing time difference.

Further, generating the speaker control instruction according to the audio characteristics may include: according to the audio characteristics of the plurality of smart speakers, comparing the sound wave amplitude, the actual audio signal waveform and the actual frequency of the frequency responses of the plurality of smart speakers in each frequency band with the standard The frequency response of the sound is compared with the standard sound wave amplitude, standard audio signal waveform and standard frequency in each frequency band; according to the comparison results, the performance and playback effect of multiple smart speakers are determined; according to the performance and playback effects of multiple smart speakers, generate Audio control commands for multiple smart speakers.

In a specific implementation manner, the method for adjusting stereo playback in this application can be applied to a scene where a user listens to music or watches a video at home. When the user is listening to music or watching videos at home, the smart terminal worn by the user is constantly detecting whether the user is in a state of motion. When the user is detected to be in a state of motion, the user's position may change, and the position of the smart speaker relative to the user may change , the microphone array starts to detect the position information of the smart speakers, and detects the audio characteristics of the smart speakers. Compare the standard sound wave amplitude, standard audio signal waveform and standard frequency in each frequency band with the frequency response of the standard sound; determine the performance and playback effect of multiple smart speakers based on the comparison results; determine the performance and playback effect of multiple smart speakers to generate sound effect control instructions for multiple smart speakers. At the same time, according to the respective performance parameters of each smart speaker or the needs of users, the audio played by each smart speaker is processed accordingly to enhance the audio playback effect, such as: according to the location information of each smart speaker and the performance of the smart speaker parameter, which determines the audio content played by each speaker. When playing rock music, the high and low frequencies are greatly improved, and the bass effect is enhanced for the speakers that play the bass. At the same time, according to the distortion and signal-to-noise ratio of each smart speaker, the distortion and signal-to-noise ratio of the speakers are reduced. Meet the requirements of bass speaker playback; enhance the treble effect of the speaker playing low and high pitch, and at the same time, according to the distortion and signal-to-noise ratio of each smart speaker, reduce the speaker distortion and signal-to-noise ratio to achieve the high-pitched speaker playback Require. When playing cross talk sketches and other programs, the frequency range of the sound from the human voice is relatively narrow, and the main focus is on improving the mid-range part, and performing mid-range playback effect processing on the audio of the mid-range playback speaker. When playing movies and videos, according to the playing sound effect, it is necessary to delay the playing sound to achieve an ideal listening effect, complete stereo adjustment, achieve a realistic playing effect, and improve user experience.

Embodiment three

Fig. 3 is a structural block diagram of a device for adjusting stereo playback provided by Embodiment 3 of the present invention. As shown in Figure 3, the device includes: a positioning information acquisition module 310, an audio feature acquisition module 320, an instruction generation module 330 and an instruction sending module 340, wherein:

The positioning information acquisition module 310 is used to acquire the positioning information of multiple smart speakers in the user environment detected by the microphone array;

The audio feature acquisition module 320 is used to acquire the audio features of a plurality of smart speakers extracted by the microphone array;

An instruction generation module 330, configured to generate a speaker control instruction according to the positioning information and/or audio characteristics;

The instruction sending module 340 is configured to send the generated speaker control instructions to associated smart speakers, so as to adjust the stereo playback effect of multiple smart speakers.

This embodiment provides a device for adjusting stereo playback. The positioning information acquisition module 310 acquires the position information of multiple smart speakers in the user environment detected by the microphone array, and sends the position information of the smart speakers to the command generation module 330; audio features The acquisition module 320 obtains the audio feature of the smart speaker extracted by the microphone array, and sends the audio feature of the smart speaker to the instruction generation module 330; the instruction generation module 330 generates a speaker control command according to the position information of the smart speaker, or, according to the audio feature of the smart speaker Generate a speaker control instruction, or generate a speaker control instruction based on the location information of the smart speaker and the audio characteristics of the corresponding smart speaker; the instruction sending module 340 sends the speaker control instruction generated by the instruction generation module 330 to the corresponding smart speaker, and the smart speaker receives The speaker control command adjusts its own playback effect, thereby adjusting the stereo playback effect of all smart speakers, making the stereo playback sound more realistic and improving user experience.

The device for adjusting stereo playback provided by this embodiment belongs to the same inventive concept as the method for adjusting stereo playback provided by any embodiment of the present invention, and can execute the method for adjusting stereo playback provided by any embodiment of the present invention, and has corresponding functions and beneficial effects. For technical details not exhaustively described in this embodiment, refer to the method for adjusting stereo playback provided by any embodiment of the present invention.

Embodiment Four

Fig. 4 is a structural block diagram of a device for adjusting stereo playback provided by Embodiment 4 of the present invention. As shown in Figure 4, the device includes: a positioning information acquisition module 310, an audio feature acquisition module 320, an instruction generation module 330 and an instruction sending module 340, and also includes:

The audio data processing module 350 is configured to process the audio data to be played according to the audio features after acquiring the audio features of multiple smart speakers extracted by the microphone array, and send the processed audio data to multiple smart speakers for playback.

Further, the instruction generation module 330 is further configured to: determine the smart speakers to be turned off from the plurality of smart speakers according to the location information of the plurality of smart speakers; and generate a speaker turn-off instruction according to the determined smart speakers to be turned off.

Further, the instruction generation module 330 is further configured to: determine the playing time difference of the multiple smart speakers according to the positioning information of the multiple smart speakers; and generate the playback start instruction according to the determined playing time difference.

Further, the instruction generation module 330 is also used for: according to the audio characteristics of multiple smart speakers, compare the frequency response of multiple smart speakers with the sound wave amplitude, the actual audio signal waveform and the actual frequency in each frequency band respectively with the frequency response of the standard tone Compare the standard sound wave amplitude, standard audio signal waveform and standard frequency in each frequency band; determine the performance and playback effect of multiple smart speakers based on the comparison results; generate multiple smart speakers based on the performance and playback effects of multiple smart speakers sound control commands.

Further, the positioning information acquisition module 310 is also used to: determine whether the user is in a motion state; if the user is in a motion state, obtain the positioning information of multiple smart speakers in the user's environment detected by the microphone array.

In this embodiment, a device for adjusting stereo playback is provided. The positioning information acquisition module 310 acquires the position information of the smart speaker detected by the microphone array, and sends the position information to the instruction generation module 330. The position information of the speaker is combined with the sound effect to determine the opening and closing of the smart speaker, and generate the control command of the smart speaker. The audio data processing module 350 determines the performance parameters of the smart speaker according to the audio characteristics provided by the microphone array, and adjusts the audio information played by the corresponding smart speaker; Processing, and then sent to the smart speaker for playback. For example, in the process of processing audio information, according to the playback characteristics of the smart speaker, the intensity of the bass information is enhanced for the audio information played by the bass speaker, and the intensity of the treble information is enhanced for the audio information played by the tweeter; according to the distortion of the speaker itself and noise ratio, the audio information is processed to reduce the distortion and noise ratio; according to the positioning information of multiple smart speakers, determine the playback time difference of multiple smart speakers; , to achieve realistic playback effects and so on. The playback time difference is mainly based on the sound image positioning principle of the time difference. The stereo sound heard by the human ear is caused by the time difference between the sound arriving at the two ears. The distance from the two ears can be judged according to the time difference. Keep within a certain value range, and the user should be within the range of the smart speaker playback system; the time difference reflects the relative time difference caused by the sound arriving at both ears, and the intensity difference reflects the attenuation difference caused by the distance caused by the sound propagating in the air , the intensity difference of playing the audio signal is based on the sound image localization principle of the intensity difference. The intensity of the sound reaching the human ear is different, and it can be judged that the distance between the sound source and the human ear is different. In the process of sound propagation, the head or air forms a Obstacles weaken the intensity of the sound, so the intensity of the sound reaching people's two ears is different, and the purpose of stereo adjustment can also be achieved by adjusting the intensity difference of the playback audio signal. The device can be installed in the smart terminal to complete the control of the smart speaker and achieve the purpose of adjusting the stereo. In particular, the playback module can also be an external device other than a smart terminal, such as a TV and a computer that can play music and video. The smart terminal sends the performance parameters of the smart speaker to the playback device through communication methods such as Bluetooth. The audio is processed and sent to the smart speaker for playback, thereby adjusting the stereo playback effect and improving the user experience.

Note that the above are only preferred embodiments of the present invention and applied technical principles. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the protection scope of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments, and can also include more other equivalent embodiments without departing from the concept of the present invention, and the present invention The scope is determined by the scope of the appended claims.

Claims (10)

1. the method regulating played in stereo, it is characterised in that including:

Obtain the location information of multiple intelligent sound boxes in the user environment of microphone array detection；

Obtain the audio frequency characteristics of the plurality of intelligent sound box that described microphone array extracts；

According to described location information and/or described audio frequency characteristics, generate audio amplifier control instruction；

The audio amplifier control instruction of generation is sent to the intelligent sound box of association, broadcasts regulating the stereo of the plurality of intelligent sound box Put effect.

Method the most according to claim 1, it is characterised in that according to described location information, generates audio amplifier control instruction, bag Include:

According to the location information of the plurality of intelligent sound box, determine the broadcasting time difference of the plurality of intelligent sound box；

According to the broadcasting time difference determined, generate and commence play out instruction.

Method the most according to claim 1, it is characterised in that according to described audio frequency characteristics, generates audio amplifier control instruction, bag Include:

According to the audio frequency characteristics of the plurality of intelligent sound box, by the frequency response of the plurality of intelligent sound box sound in each frequency range Wave amplitude, actual audio signal waveform and actual frequency respectively with the frequency response of standard pronunciation standing acoustic waves width in each frequency range Degree, standard audio signal waveform and standard frequency compare；

According to comparative result, determine performance and the result of broadcast of the plurality of intelligent sound box；

According to performance and the result of broadcast of the plurality of intelligent sound box, generate the sound effect control instruction of the plurality of intelligent sound box.

Method the most according to claim 1, it is characterised in that many in the user environment of described acquisition microphone array detection The location information of individual intelligent sound box, including:

Judge whether user is kept in motion；

If described user is kept in motion, then obtain the location of multiple intelligent sound boxes in the user environment of microphone array detection Information.

Method the most according to claim 1, it is characterised in that obtain the plurality of intelligence that described microphone array extracts After the audio frequency characteristics of audio amplifier, including:

According to described audio frequency characteristics, process voice data to be played, and the voice data after processing sends to the most the plurality of Intelligent sound box plays out.

6. the device regulating played in stereo, it is characterised in that including:

Location data obtaining module, the location letter of multiple intelligent sound boxes in the user environment obtaining microphone array detection Breath；

Audio frequency characteristics acquisition module, for obtaining the audio frequency characteristics of the plurality of intelligent sound box that described microphone array extracts；

Directive generation module, for according to described location information and/or described audio frequency characteristics, generates audio amplifier control instruction；

Instruction sending module, for the audio amplifier control instruction of generation being sent to the intelligent sound box of association, the plurality of to regulate The played in stereo effect of intelligent sound box.

Device the most according to claim 6, it is characterised in that described directive generation module specifically for:

According to the location information of the plurality of intelligent sound box, determine the broadcasting time difference of the plurality of intelligent sound box；

According to the broadcasting time difference determined, generate and commence play out instruction.

Device the most according to claim 6, it is characterised in that described directive generation module specifically for:

According to the audio frequency characteristics of the plurality of intelligent sound box, by the frequency response of the plurality of intelligent sound box sound in each frequency range Wave amplitude, actual audio signal waveform and actual frequency respectively with the frequency response of standard pronunciation standing acoustic waves width in each frequency range Degree, standard audio signal waveform and standard frequency compare；

According to comparative result, determine performance and the result of broadcast of the plurality of intelligent sound box；

According to performance and the result of broadcast of the plurality of intelligent sound box, generate the sound effect control instruction of the plurality of intelligent sound box.

Device the most according to claim 6, it is characterised in that described location data obtaining module specifically for:

Judge whether user is kept in motion；

If described user is kept in motion, then obtain the location of multiple intelligent sound boxes in the user environment of microphone array detection Information.

Device the most according to claim 6, it is characterised in that including:

Voice data processing module, at the audio frequency characteristics obtaining the plurality of intelligent sound box that described microphone array extracts Afterwards, according to described audio frequency characteristics, process voice data to be played, and the voice data after processing sends to the most the plurality of Intelligent sound box plays out.