CN103578512B - Record method and the device thereof of quick playback - Google Patents

Abstract

The present invention provides a method and device for fast playback of recordings. The method includes: acquiring multiple channels of sound data; processing each channel of sound data in the acquired multiple channels of voice data; playing the processed voice data in one The playback is performed in a path, wherein the playback path is at the audio driver layer of the mobile terminal. Through this method, various sounds can be quickly played back, and the purpose of hearing aid can be achieved through sound processing.

Description

Method and device for recording fast playback

technical field

The present invention relates to a recording playback method, and more specifically, relates to a method and device for fast playback of recordings using software.

Background technique

With the development of mobile terminal technology, devices with hearing aid functions such as mobile phone hearing aids have appeared for people with hearing impairments. However, existing mobile terminals such as mobile phone hearing aids are generally based on hardware design to enable the mobile phone to have a hearing aid function. This type of method not only makes the circuit design of the mobile phone more complicated, but also increases the cost of the mobile phone. There are also methods based on software, but the recording playback delay of such mobile terminals is often relatively long. For example, the delay of Apple mobile phones is generally 70ms, and the delay of android mobile phones is greater than 200ms. If users want to listen to music, radio, etc. while using the hearing aid function, they must purchase specially designed and expensive hearing aids.

Therefore, there is a need for a recording playback method that saves costs and reduces delays.

Contents of the invention

The purpose of the present invention is to solve the above technical problems. Therefore, one aspect of the present invention provides a method and device for fast playback of recordings.

In order to achieve the above purpose, a method for fast playback of recordings is provided, which may include the following steps: acquiring multiple channels of sound data; processing each channel of sound data in the acquired multiple channels of voice data; processing the processed voice data in a Playing in the playing path, wherein, the playing path is in the audio driver layer of the mobile terminal.

Preferably, the above steps may further include: receiving control information, wherein multiple channels of sound data are selected according to the control information.

Preferably, the processing may include at least one of mixing multiple channels of sound data, performing volume adjustment on each channel of sound data, and echo cancellation.

Preferably, the multi-channel sound data may include one or more of natural sound, data transmitted by a microphone, data transmitted by a user, telephone sound, and broadcast sound.

In order to achieve the above object, a device for fast playback of recordings is proposed, which may include: an acquisition module, which acquires multiple channels of sound data; a processing module, which processes each channel of voice data in the acquired multiple channels of voice data; a playback module, which The processed sound data is played in a playback path, wherein the playback path is at the audio driver layer of the mobile terminal.

Preferably, the above device may further include a receiving module, configured to receive control information, wherein multiple channels of sound data are selected according to the control information.

Preferably, the processing of each channel of sound data by the processing module may include at least one of mixing multiple channels of sound data, performing volume adjustment and echo cancellation on each channel of sound data.

Preferably, the multi-channel sound data may include one or more of natural sound, data transmitted by a microphone, data transmitted by a user, telephone sound, and broadcast sound.

The above method and device for quick playback of recording, through the expansion of the existing audio driver, add a playback path in the recording channel, and playback the recording after processing, which effectively saves costs, solves the problem of long delay, and realizes hearing aids. Features.

Description of drawings

The above-mentioned and other objects and features of the present invention will become more clear through the following description of exemplary embodiments of the present invention in conjunction with the accompanying drawings, wherein:

Fig. 1 is the flow chart of the recording fast playback method according to the first exemplary embodiment of the present invention;

Fig. 2 is the flow chart of the recording fast playback method according to the second exemplary embodiment of the present invention;

Fig. 3 is a block diagram of a recording fast playback device according to a third exemplary embodiment of the present invention;

FIG. 4 is a block diagram of a recording fast playback device according to a fourth exemplary embodiment of the present invention;

Fig. 5 is a block diagram of a linux-based recording fast playback device according to a fifth exemplary embodiment of the present invention.

detailed description

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

Generally speaking, the method for recording fast playback according to the present invention may include the following steps: acquiring multiple channels of sound data; processing each channel of sound data in the acquired multiple channels of voice data; Play in , wherein the playback path is at the audio driver layer of the mobile terminal.

The method for fast recording playback of the present invention will be described in detail below in combination with specific embodiments of the present invention.

Fig. 1 is a flow chart showing a method for fast playback of recordings according to a first exemplary embodiment of the present invention.

In step S101, multiple channels of audio data are acquired.

Specifically, the multiple channels of sound data may include one or more of natural sounds, data transmitted by a microphone, data transmitted by a user (such as music), telephone tones, broadcast tones, and the like.

In step S102, each channel of audio data in the acquired multi-channel audio data is processed.

Specifically, in order to achieve various purposes, for example, in order to allow the received recording data to be played together with other data and to amplify the sound data to achieve the purpose of assisting the sound, the sound data can be processed in this way, for example, according to The user's settings amplify the sound data; judge whether echo processing is needed according to whether there are headphones; and selectively perform sound mixing processing according to the playback rules set by the user.

In implementation, a corresponding user interface may be provided for the user, so that the user may input various settings in the user interface, such as volume adjustment, playing rules, and the like.

In step S103, the processed sound data is played in a playback path, wherein the playback path is in the audio driver layer of the mobile terminal.

Specifically, the implementation process of the audio driver layer is as follows. For example, when listening to music, the audio driver will allocate the buffer (BUFFER) required for playback, configure the audio playback path in the codec (CODEC), and set the audio Parameters such as sample rate, gain of audio amplifier. When ready, the user layer passes the audio data to the kernel, and the kernel passes it to the audio CODEC through direct memory access (DMA).

In the present invention, a playback path is added to the recording path, and the mixed data is played in the playback path. Taking playing natural sound and music at the same time as an example, before DMA transmits music data to CODEC, music and natural sound are mixed, and then the mixed data is played.

Fig. 2 is a flow chart illustrating a method for fast playback of recordings according to a second exemplary embodiment of the present invention.

In step S201, control information is received, wherein multiple channels of sound data are selected according to the control information. For example, an interface function for acquiring audio data from various channels may be added in the audio driver layer. Therefore, the user can input commands for obtaining various channels of audio data in the user interface, and these commands will be transmitted to the audio driver layer, so as to obtain various channels of audio data through the audio driver layer.

In step S202, the selected multi-channel audio data is acquired.

In step S203, each channel of audio data in the acquired multi-channel audio data is processed.

In step S204, the processed sound data is played in a playback path, wherein the playback path is in the audio driver layer of the mobile terminal.

Taking the existing android platform as an example, the delay of recording playback is at least 200ms. After adopting the method of the present invention, the delay is reduced to 40ms, and the played sound has a strong sense of space, which increases the user's acoustic experience. In addition, by adopting the method of the present invention, users can not only enjoy music, answer calls, listen to radio, etc., but also hear the surrounding natural sounds clearly at the same time. Headphones to listen to music without hearing other people's voices. Users can also adjust the volume of each sound data according to their personal preferences. For example, when listening to music, increase the magnification of the music and lower the volume of the sound recorded by the microphone. This not only achieves the purpose of listening to music but also Can hear other people's speech clearly.

FIG. 3 is a block diagram showing a recording fast playback device according to a third exemplary embodiment of the present invention.

As shown in FIG. 3 , the device for quick playback of recordings includes: an acquisition module 301 , a processing module 302 and a playback module 303 .

The acquiring module 301 is used for acquiring multiple channels of sound data.

The processing module 302 is used for processing each channel of sound data in the acquired multi-channel sound data. Specifically, the topology of the processing module is multi-input and single-output. The input source can be the data transmitted by the microphone, the data transmitted by the user space, the telephone sound, and the broadcast sound. The processing module performs processing such as echo cancellation, noise reduction, volume amplification and reduction, and sound mixing on the sound data as required.

The playing module 303 is used to play the processed sound data in a playing path, wherein the playing path is in the audio driver layer of the mobile terminal.

Fig. 4 is a block diagram of a recording fast playback device according to a fourth exemplary embodiment of the present invention.

As shown in FIG. 4 , the recording fast playback device in the exemplary embodiment of the present invention includes: a receiving module 401 , an acquiring module 402 , a processing module 403 and a playing module 404 .

The receiving module 401 is configured to receive control information, wherein multiple channels of sound data are selected according to the control information. For example, the user can set the rules for mixing, such as only supporting two channels of sound recording and music for mixing mobile phones or supporting the mixing of various sounds, and at the same time can adjust the volume of each channel.

The obtaining module 402 is used for obtaining the selected multi-channel sound data.

The processing module 403 is configured to process each channel of the acquired multiple channels of audio data.

The playing module 404 is configured to play the processed sound data in a playing path, wherein the playing path is in the audio driver layer of the mobile terminal.

Fig. 5 is a block diagram of a linux-based recording fast playback device according to a fifth exemplary embodiment of the present invention.

As shown in Figure 5, the recording fast playback device based on linux includes: user space sound data receiving module 501, user space UI module 502, control module 503, kernel sound data receiving module 504, audio processing module 505 and output module 506.

The user space sound data receiving module 501 is configured to receive sound data transmitted from the user space.

The user space UI module 502 is used to realize the UI function of the user space, so as to input relevant user commands into the kernel space to execute control.

The control module 503 is used for receiving control information of user space.

The kernel sound data receiving module 504 is used to obtain sound data in the kernel space, such as broadcast sound, telephone sound, sound data transmitted by a microphone, and the like.

The audio processing module 505 is used to process the received sound data of various channels, such as echo processing, sound mixing processing and so on.

The output module 506 is used to output the processed sound data, and may include earpieces, speakers, and the like.

As shown in FIG. 5 , the user space sound data receiving module 501 and the user space UI module 502 are located in the user space, and the control module 503 , the kernel sound data receiving module 504 , the audio processing module 505 and the output module 506 are located in the kernel space.

It should be understood that the recording fast playback device and its embodiments according to the exemplary embodiments of the present invention can execute the recording fast playback method described above with reference to FIG. 1 and FIG. 2 , which will not be repeated here to avoid repetition.

The above method and device for fast playback of recordings add a playback path to the audio driver to first perform processing such as amplification and sound mixing on the recordings, and then quickly play them out. This method does not need to change the circuit design of the mobile terminal, not only reduces the cost, but also solves the problem of long delay, and realizes the function of hearing aid, so that the mobile terminal using the method and device of the exemplary embodiment of the present invention can Suitable for people with hearing impairment.

The present invention has been described above in conjunction with specific embodiments, but the implementation of the present invention is not limited thereto. Within the spirit and scope of the present invention, those skilled in the art can make various modifications and variations, and these modifications and variations will fall within the protection scope defined by the claims.

Claims (6)

1. a method for the quick playback of recording, comprises the following steps:

Obtain multiple sound data, wherein, described multiple sound data comprise that naturetone, user transmitThe data that at least one in data, phone sound, broadcast sound and microphone transmit;

The multiple sound data Zhong Ge road voice data obtaining is processed;

Voice data after treatment is play in a broadcast path, wherein, described broadcast pathIn the audio driven layer of mobile terminal,

Wherein, in audio driven layer, increase the interface function for obtaining described multiple sound data, obtainThe step of getting multiple sound data comprises: obtaining of inputting in user interface by reception user is described manyThe order of road voice data, obtains described multiple sound number in response to described order by audio driven layerAccording to.

2. the method for claim 1, also comprises: receiving control information, wherein, according to describedMultiple sound data are selected in control information.

3. the method for claim 1, wherein described processing comprises multiple sound data is carried outAudio mixing, Dui Ge road voice data carry out at least one in volume adjusting and echo cancellation.

4. a device for the quick playback of recording, comprising:

Acquisition module, obtains multiple sound data, wherein, described multiple sound data comprise naturetone,One or more in data that the data, user that microphone transmits are transmitted, phone sound, broadcast sound;

Processing module, processes the multiple sound data Zhong Ge road voice data obtaining;

Playing module is play voice data after treatment in a broadcast path, wherein, and instituteState the audio driven layer of broadcast path in mobile terminal,

Wherein, in audio driven layer, increase the interface function for obtaining described multiple sound data, obtainThe order of obtaining described multiple sound data that delivery piece is inputted in user interface by receiving user, comesObtain described multiple sound data in response to described order by audio driven layer.

5. device as claimed in claim 4, also comprises receiver module, for receiving control information;

Wherein, select multiple sound data according to described control information.

6. device as claimed in claim 4, wherein, what processing module Dui Ge road voice data carried out locatesReason comprise by multiple sound data carry out audio mixing, Dui Ge road voice data carries out volume adjusting and echo cancellationIn at least one.