CN110033781A - Audio-frequency processing method, device and non-transitory computer readable media - Google Patents

Abstract

A kind of audio-frequency processing method.This audio-frequency processing method comprises the steps of: that by processor segmentation audio file be multiple audio sections；And multiple audio sections are compressed to generate multiple compressed section of audio by processor, include: the first audio section in the multiple audio sections of down-sampled is to generate the first compressed section of audio of multiple compressed section of audio, wherein the first object bandwidth of the first audio section is less than a bandwidth threshold value；And the second audio section in multiple audio sections is sampled to generate the second compressed section of audio of multiple compressed section of audio, and delay time is added in the second compressed section of audio, wherein the second target bandwidth of the second audio section is not less than bandwidth threshold value.Originally it is implemented on when bandwidth changes and more effectively compresses voice data stream, and prevent audio from discontinuously generating sonic boom.

Description

Audio processing method, apparatus and non-transitory computer readable medium

technical field

The present disclosure relates to an audio processing method, apparatus, and non-transitory computer-readable medium, and in particular, to an audio processing method, apparatus, and non-transitory computer-readable medium for compressing audio files.

Background technique

Traditionally, if an audio file is to be sent to an audio playback device via a wireless transmission protocol that only supports low bandwidth, such as Bluetooth, a distorted/lossy compression method such as MP3 format needs to be used to greatly reduce the amount of data. The compression ratio can easily cause audio distortion, resulting in noise or popping.

In addition, general compression technology usually involves a large number of operations such as converting audio files between time and frequency domains, so continuous audio data streams can be divided into fixed-size audio segments (frames) for calculation and compression. The terminal then decompresses the audio segments one by one and restores them to an audio data stream. Usually larger audio regions will have better compression efficiency, but too large audio regions will increase the delay of the sound and require larger memory. However, small playback devices such as bluetooth earphones, bluetooth speakers, etc. usually only have microprocessors with low processing power and small storage space, so these small playback devices will consume a long processing time when decompressing audio files. , and cannot be played in real time.

SUMMARY OF THE INVENTION

An embodiment of the present disclosure provides an audio processing method. The audio processing method includes the steps of: dividing an audio file into a plurality of audio sections by a processor; and compressing the plurality of audio sections by the processor to generate a plurality of compressed audio sections, including: down-sampling the plurality of audio sections the first audio segment to generate a first compressed audio segment of the plurality of compressed audio segments, wherein the first target bandwidth of the first audio segment is less than a bandwidth threshold; and sampling the first audio segment of the plurality of audio segments Two audio segments are used to generate a second compressed audio segment of the plurality of compressed audio segments, and a delay time is added to the second compressed audio segment, wherein the second target bandwidth of the second audio segment is not less than a bandwidth threshold.

In some embodiments, wherein compressing the audio segments by the processor to generate the compressed audio segments further comprises: separately calculating a first compressing one of the audio segments with a first algorithm compression rate and a second compression rate for compressing the one of the audio segments with a second algorithm; and compressing with the first algorithm in response to the first compression rate being higher than the second compression rate the one of the audio segments.

In some embodiments, the one of the audio segments includes a header, and the header includes a tag indicating the first algorithm.

In some embodiments, wherein compressing the audio segments by the processor to generate the compressed audio segments further includes dividing each of the compressed audio segments into a plurality of audio regions.

In some embodiments, the method further includes: transmitting the compressed audio segments to an audio playback device, so as to decompress the compressed audio segments according to the compressed audio regions by the audio playback device.

In some embodiments, the delay time is equal to the delay time of a low-pass filter of the processor.

In some embodiments, the method further includes setting the first target bandwidth according to a first command; and setting the second target bandwidth according to a second command.

Another embodiment of the present disclosure is to provide an apparatus including a memory and a processor. The memory is used to store audio files. The processor is used for dividing the audio file into a plurality of audio sections, and down-sampling a first audio section of the plurality of audio sections to generate a first compressed audio section, wherein the processor samples a second audio section of the plurality of audio sections The audio segment is used to generate a second compressed audio segment, and a delay time is added to the second compressed audio segment. The first target bandwidth of the first audio section is smaller than the bandwidth threshold, and the second target bandwidth of the second audio section is not smaller than the bandwidth threshold.

In some embodiments, the processor is further configured to divide each of the compressed audio segments into a plurality of audio regions.

Another embodiment of the present disclosure is to provide a non-transitory computer-readable medium storing plural instructions, and when the plural instructions are executed by a processor, the following steps are performed: dividing an audio file into a plurality of audio segments; downsampling a first audio segment of the plurality of audio segments to generate a first compressed audio segment, wherein a first target bandwidth of the first audio segment is less than a bandwidth threshold; and sampling a second audio of the plurality of audio segments segment to generate a second compressed audio segment, and adding a delay time to the second compressed audio segment, wherein the second target bandwidth of the second audio segment is not less than a bandwidth threshold.

Therefore, according to technical implementations of the present disclosure, the embodiments of the present disclosure provide an audio processing method, apparatus, and non-transitory computer-readable medium, and particularly relate to an audio processing method, apparatus, and non-transitory audio processing method for compressing audio files. The computer-readable medium can compress the audio data stream more efficiently when the bandwidth changes by dynamically down-sampling and up-sampling, and prevent the audio from being discontinuous and popping. In addition, the embodiments of the present disclosure simultaneously execute two or more different compression algorithms during compression, so as to achieve better compression efficiency. Furthermore, in the embodiments of the present disclosure, an audio segment is divided into a plurality of audio chunks during compression, and during decompression, the receiving end only needs a small space to decompress the audio data.

Description of drawings

In order to make the above-mentioned and other objects, features, advantages and embodiments of the present invention more clearly understood, the description of the accompanying drawings is as follows:

FIG. 1 is a schematic diagram of an apparatus according to some embodiments of the present disclosure;

2 is a waveform diagram of an audio segment according to some embodiments of the present disclosure;

3 is a waveform diagram of an audio segment according to some embodiments of the present disclosure;

FIG. 4 is a schematic diagram of an audio segment according to some embodiments of the present disclosure; and

FIG. 5 is a flowchart of an audio processing method according to some embodiments of the present disclosure.

Description of reference numbers:

100: Device

110: memory

130: Processor

200: Waveform

300: Waveform

400: Audio section

900: Audio playback device

500: Audio processing method

S510, S530, S550: Steps

Detailed ways

The following disclosure provides many different embodiments or illustrations for implementing different features of the invention. The elements and configurations in the specific examples are used in the following discussion to simplify the present disclosure. Any examples discussed are for illustrative purposes only and do not in any way limit the scope and meaning of the invention or its examples. Furthermore, the present disclosure may repeat references to numerical symbols and/or letters in different instances, such repetitions are for simplicity and clarification, and do not themselves specify the relationship between the different embodiments and/or configurations discussed below.

Terms used throughout the specification and claims generally have their ordinary meanings used in the art, in this disclosure, and in a particular context, unless otherwise noted. Certain terms used to describe the present disclosure are discussed below or elsewhere in this specification to provide those skilled in the art with additional guidance in the description of the present disclosure.

As used herein, "coupled" or "connected" may refer to two or more elements in direct physical or electrical contact with each other, or in indirect physical or electrical contact with each other, and "coupled" or "connected" "Connected" may also refer to the mutual operation or action of two or more elements.

It will be understood that the terms first, second, and third, etc., are used herein to describe various elements, components, regions, layers and/or regions. However, these elements, components, regions, layers and/or regions should not be limited by these terms. These terms are only used to identify a single element, component, region, layer and/or region. Thus, a first element, component, region, layer and/or region hereinafter could be termed a second element, component, region, layer and/or region without departing from the spirit of the invention. As used herein, the term "and/or" includes any combination of one or more of the associated listed items. References in this disclosure to "and/or" mean any, all, or any combination of at least one of the listed elements.

See Figure 1. FIG. 1 is a schematic diagram of an apparatus 100 according to some embodiments of the present disclosure. The device 100 is used for communicating with the audio playback device 900 . In some embodiments, after the device 100 processes the audio file, it transmits the processed audio data to the audio playback device 900 through wireless communication transmission. The audio playback device 900 decompresses the processed audio data to play the audio quickly and in real time.

In connection, the device 100 includes a memory 110 and a processor 130 . The processor 130 is coupled to the memory 110 . Operationally, the processor divides the audio file into a plurality of audio segments, and performs individual processing for each audio segment. Audio files can be split according to any rules, such as time length, number of samples and/or file size, etc. Wherein, the audio processing method 100 processes each audio segment according to the time sequence of the audio content, and the content of each audio segment has the same or different time length, number of sampling points and/or file size, the present disclosure Documents are not restricted.

The processor 130 compresses the plurality of audio segments. Since the bandwidth of audio data transmission is variable, multiple audio sections of the same audio file may respectively contain different target bandwidths. For example, the user can adjust the audio data transmission bandwidth during audio playback, and the target bandwidth of each audio segment is changed according to the audio data transmission bandwidth set by the user.

The first audio segment of the plurality of audio segments in the audio file will be compressed first. After the first audio segment is compressed, the second audio segment is compressed, and after the second audio segment is processed, the next audio segment continues to be processed until the entire audio file is processed.

In some embodiments, before the processor 130 compresses the first audio segment, if the user sets the audio data transmission bandwidth to be 400Kbps, the processor 130 receives an instruction including information that the audio data transmission bandwidth is 400Kbps, And according to this command, the target bandwidth of the first audio segment is set to 400Kbps. If the user sets the audio data transmission bandwidth to be 1 Mbps before the processor 130 compresses the second audio segment, the processor 130 receives an instruction including the information that the audio data transmission bandwidth is 1 Mbps, and sets according to the instruction The target bandwidth of the first audio segment is 1 Mbps.

The processor 130 compresses the audio segments according to the target bandwidth of each audio segment. If the target bandwidth of the audio segment is less than the bandwidth threshold, down-sample the audio segment to generate a compressed audio segment. If the target bandwidth of the audio segment is not less than the bandwidth threshold, the audio segment is sampled to generate a compressed audio segment, and a delay time is added to the compressed audio segment.

See Figure 2 and Figure 3. FIG. 2 is a waveform diagram 200 of an audio segment shown in accordance with some embodiments of the present disclosure. FIG. 3 is a waveform diagram 300 of an audio segment shown in accordance with some embodiments of the present disclosure. As shown in FIG. 2, the processor 130 samples the audio segment to obtain a plurality of sampling points. Assuming that in the case of normal sampling, the processor 130 samples at a frequency of 96KHz. When the target bandwidth of the audio section is less than the bandwidth threshold, the processor 130 downsamples the audio section. That is, the processor 130 samples at a lower frequency, such as 48KHz, 32KHz, etc., to generate compressed audio segments. On the other hand, when the target bandwidth of the audio segment is not less than the bandwidth threshold, the processor 130 samples the audio segment at a sampling frequency of normal sampling to generate a compressed audio segment, and adds a delay time to the compressed audio segment . For example, as shown in FIG. 3, a delay time td is added to the compressed audio segment.

As can be seen from the above, in the present disclosure, when the target bandwidth is relatively low, a better compression ratio can be achieved by down-sampling the audio segment. In addition, since the sound will be delayed when downsampling, the sound will not be delayed when not downsampling. Therefore, without downsampling, that is, when the target bandwidth is not less than the bandwidth threshold, a delay time is added to the compressed audio segment, so that when the target bandwidth changes dynamically, the playback audio will not be interrupted due to audio discontinuity. A popping sound is produced.

In some embodiments, when the processor 130 downsamples the audio segment, the audio segment is passed through a low-pass filter (not shown) of the processor 130 . In some embodiments, the low pass filter may be a Sinc filter. After the audio segment is processed by the low-pass filter of the processor 130, the compressed audio segment generated by the processor 130 will be affected by the low-pass filter to generate a delay time. In some embodiments, the delay time may be one of 16 samples to 256 samples. For example, if the sampling frequency is 96KHz, the delay time is a time length between 16/96000 seconds and 256/96000 seconds. For the down-sampled audio segment, the processor 130 adds a delay time equal to the delay time of the low-pass filter into the compressed audio segment, so that the audio is played continuously. The above-mentioned delay time is only an example, and the present disclosure is not limited thereto.

In some embodiments, the processor 130 is further configured to divide the compressed audio segment into a plurality of audio regions. See Figure 4. FIG. 4 is a schematic diagram of an audio section 400 shown in accordance with some embodiments of the present disclosure. As shown in FIG. 4, each audio section includes a header, and the processor 130 divides the audio data of the compressed audio section 400 into a plurality of audio regions C1 to C8. When the device 100 transmits the compressed audio segment 400 to the audio playback device 900 , the audio playback device 900 decompresses the audio region as a unit. That is, the processor 130 decompresses the data of the audio region C1 first, then decompresses the data of the audio region C2, and so on. In this way, the amount of computation performed by the audio playback device 900 during decompression can be reduced, and the audio playback device 900 can perform decompression with a smaller memory space.

For example, it is assumed that a compressed audio segment 400 includes data of 1024 sample points, and the audio playback device 900 needs a memory space of 6Kbyte for decompression processing. On the other hand, if the audio playback device 900 performs decompression according to the unit of audio region, assuming that the compressed audio segment 400 is divided into 8 audio regions, and each audio region contains only 128 sample point data, the audio playback device 900 only needs 750 bytes of data. memory space for decompression processing.

As can be seen from the above, by dividing the compressed audio segment into a plurality of audio segments, the audio playback device 900 can use a smaller memory space for decompression processing, and can reduce the amount of computation.

In some embodiments, before the processor 130 compresses an audio segment, the processor 130 respectively calculates a first compression ratio for compressing the audio segment with the first algorithm and compresses the audio region with the second algorithm. a second compression rate for the segment, and the processor 130 compresses the audio segment with a first algorithm in response to the first compression rate being higher than the second compression rate. For example, before the processor 130 compresses the first audio segment, the processor 130 first calculates the first compression rate for compressing the first audio segment using the RICE Coding algorithm, and then calculates the first compression ratio using the LZ algorithm. A second compression rate at which the first audio segment is compressed. If the first compression ratio is higher than the second compression ratio, the processor 130 compresses the first audio segment by using the Glenbow coding algorithm to generate the first compressed audio segment. And if the first compression rate is not higher than the second compression rate, the processor 130 compresses the first audio segment with the LZ algorithm to generate the first compressed audio segment. In addition, different audio segments of the same audio file can be compressed with different algorithms. The compression algorithms listed above are only examples, and the present disclosure is not limited thereto.

In some embodiments, the header of the audio segment includes a tag indicating the algorithm used to compress the audio segment. For example, if the first audio segment is compressed with the Glomb encoding algorithm, the header of the first audio segment will include a message to indicate that the first audio segment is encoded with the Glenbow encoding algorithm Compressed tags. Conversely, if the second audio segment is compressed by the LZ algorithm, the header of the second audio segment will include a tag indicating that the second audio segment is compressed by the LZ algorithm.

As can be seen from the above, in the embodiments of the present disclosure, for different audio segments in the same audio file, a better algorithm can be selected to compress different audio segments. Therefore, better compression efficiency can be achieved in the embodiments of the present disclosure.

See Figure 5. FIG. 5 is a flowchart of an audio processing method 500 according to some embodiments of the present disclosure. As shown in FIG. 5 , the audio processing method 500 includes steps S510 to S550.

In step S510, the audio file is divided into a plurality of audio segments. In some embodiments, step S510 may be performed by the processor 130 in FIG. 1 . For example, the processor 130 divides the audio file into a plurality of audio segments and processes each audio segment individually.

For example, the first audio segment of the plurality of audio segments in the audio file will first go through steps S530 to S550. After the first audio segment has been compressed, the second audio segment proceeds to step S530 to step S550, and after the second audio segment is processed, continue to process the next audio segment until the entire audio file is Processing is complete. The first and second mentioned above are only used to illustrate the sequence.

In step S530, a plurality of audio segments are compressed to generate a plurality of compressed audio segments. In some embodiments, step S530 may be performed by the processor 130 in FIG. 1 . Specifically, when step S530 is executed, if the target bandwidth of the audio segment is smaller than the bandwidth threshold, the audio segment is down-sampled to generate a compressed audio segment. If the target bandwidth of the audio segment is not less than the bandwidth threshold, the audio segment is sampled to generate a compressed audio segment, and a delay time is added to the compressed audio segment.

In some embodiments, step S530 further includes calculating a first compression rate for compressing the audio segment with the first algorithm and a second compression rate for compressing the audio segment with a second algorithm, and the processor 130 responds to The audio segment is compressed by the first algorithm at a first compression rate higher than the second compression rate. In addition, the header of the compressed audio segment includes a tag indicating the compression algorithm used when compressing the audio segment, so that the audio playback device 190, when performing decompression, recognizes that the processor 130 is compressing the audio segment algorithm used.

In step S550, a plurality of compressed audio segments are transmitted to the audio playback device. In some embodiments, step S550 may be performed by the processor 130 in FIG. 1 to transmit a plurality of compressed audio segments to the audio playback device 190 in FIG. 1 . After the audio playback device 190 receives the compressed audio segment, the audio playback device 190 decompresses the compressed audio segment to play the audio file in real time.

In some embodiments, step S530 further includes dividing each of the plurality of compressed audio segments into a plurality of audio regions, so that the audio playback device 190 can perform decompression processing in units of audio regions in step S550.

In some embodiments, the above-described audio processing method 500 may be implemented by a non-transitory computer-readable medium. The non-transitory computer-readable medium stores plural program code instructions. When the plural program code instructions are executed by the processor, steps S510 to S550 in the audio processing method 500 or an integration method of these steps can be executed. The non-transitory computer-readable medium can be a computer, a cell phone, or a standalone audio encoder, and the processor can be a processor or a system-on-chip, or the like.

In some embodiments of the present disclosure, the processor 130 may be a server, a circuit, a central processing unit (CPU), a circuit, a central processing unit (CPU), a function of storing, computing, reading data, receiving signals or information, and transmitting signals or information. Microprocessor (MCU) or other equivalent device.

In some embodiments of the present disclosure, the memory 110 may be a circuit with a data storage function or other device or circuit with an equivalent function. In some embodiments of the present disclosure, the device 100 may be a device with higher computing processing capability such as a computer, and the audio playback device 900 may be a device with lower computing processing capability such as a Bluetooth device. The above computing processing capability refers to computing parameters such as the processor's clock rate, processor performance, floating-point computing capability, bit bandwidth, and memory capacity. For example, devices with higher computing processing capabilities may include audio systems, smartphones, Tablet computers, portable music players, etc., devices with lower computing processing capabilities may include Bluetooth headsets, Bluetooth speakers, and the like.

It can be known from the above-mentioned embodiments of the present disclosure that the embodiments of the present disclosure provide an audio processing method, apparatus and non-transitory computer-readable medium, and particularly relate to an audio processing method, apparatus and non-transitory audio file for compressing audio files. The computer-readable medium compresses the audio data stream more efficiently when the bandwidth changes by dynamically down-sampling and up-sampling, and prevents the audio from being discontinuous and popping. In addition, the embodiments of the present disclosure can simultaneously execute two or more different compression algorithms when compressing the audio segment, so as to achieve better compression efficiency. Furthermore, in the embodiments of the present disclosure, an audio segment is divided into a plurality of audio regions during compression, and during decompression, the receiving end (such as an audio playback device) only needs a small space and a low computing processing capability. The audio data can be decompressed.

Additionally, the above illustrations contain exemplary steps in a sequence, but the steps need not be performed in the order shown. It is within the scope of this disclosure to perform the steps in a different order. These steps may be added, replaced, changed order and/or omitted as appropriate within the spirit and scope of the embodiments of the present disclosure.

Although the present disclosure has been disclosed above in terms of embodiments, it is not intended to limit the present disclosure. Any person skilled in the art can make various changes and modifications without departing from the spirit and scope of the present disclosure. The scope of protection shall be determined by the claims.

Claims (10)

1. a kind of audio-frequency processing method, characterized by comprising:

Dividing an audio file by a processor is a plurality of audio sections；And

Those audio sections are compressed to generate plurality of compressed audio section by the processor, include:

One first audio section in those audio sections of down-sampled compresses sound with generate those compressed section of audio one first Frequency section, wherein a first object bandwidth of the first audio section is less than a bandwidth threshold value；And

One second audio section in those audio sections is sampled to generate the one second of those compressed section of audio compression audio Section, and a delay time, wherein one second target bandwidth of the second audio section is added in second compressed section of audio Not less than the bandwidth threshold value.

2. audio-frequency processing method as described in claim 1, which is characterized in that wherein compress those audio sections by the processor Include to generate those compressed section of audio also:

It calculates separately and one first compression ratio of one of those audio sections person is compressed with one first algorithm and with one second Algorithm compresses one second compression ratio of the person in those audio sections；And

In response to being higher than first compression ratio of second compression ratio, being somebody's turn to do in those audio sections is compressed with first algorithm Person.

3. audio-frequency processing method as claimed in claim 2, which is characterized in that wherein the person in those audio sections includes one Header, and the header includes the label for being used to indicate first algorithm.

4. audio-frequency processing method as described in claim 1, which is characterized in that wherein compress those audio sections by the processor Include to generate those compressed section of audio also:

Dividing each in those compressed section of audio is a plurality of audio regions.

5. audio-frequency processing method as claimed in claim 4, which is characterized in that also include:

Those compressed section of audio are sent to an audio playing apparatus, to compress sound according to those by the audio playing apparatus Frequency domain decompresses those compressed section of audio.

6. audio-frequency processing method as described in claim 1, which is characterized in that wherein the delay time is equal to the processor The delay time of one low-pass filter.

7. audio-frequency processing method as described in claim 1, which is characterized in that also include:

According to one first instruction, the first object bandwidth is set；And

According to one second instruction, the second target bandwidth is set.

8. a kind of device, characterized by comprising:

One memory, to store an audio file；And

One processor is a plurality of audio sections to divide the audio file, and 1 in down-sampled those audio sections the One audio section is to generate one first compressed section of audio, and wherein the processor samples one second audio in those audio sections A delay time is added in second compressed section of audio to generate one second compressed section of audio in section,

Wherein a first object bandwidth of the first audio section is less than a bandwidth threshold value, wherein the 1 of the second audio section Two target bandwidths are not less than the bandwidth threshold value.

9. device as claimed in claim 8, which is characterized in that wherein the processor is more to divide those compressed section of audio Middle each is a plurality of audio regions.

10. a kind of non-transitory computer readable media, which is characterized in that plural instruction is stored with, when the plural number instructs at by one When managing device execution, execute:

Dividing an audio file is a plurality of audio sections；

One first audio section in those audio sections of down-sampled is to generate one first compressed section of audio, wherein first sound One first object bandwidth of frequency section is less than a bandwidth threshold value；And

One second audio section in those audio sections is sampled to generate one second compressed section of audio, and in second compression A delay time is added in audio section, and wherein one second target bandwidth of the second audio section is not less than the bandwidth threshold value.