CN101634588B - A method and device for drawing audio waveforms - Google Patents

Abstract

The invention relates to the field of audio data processing, and in particular to a method and a device for drawing audio waveforms, which are used for solving the problem that the method for drawing the waveforms in the prior art processes audio files with large capacity at low speed so that the operation time is prolonged and the work efficiency is reduced. The method comprises the following steps: determining the number of particulate pixels displaying audio data; dividing the audio data corresponding to an audio waveform display area into a plurality of audio subdata segments according to the capacity of the audio data and the number of the particulate pixels displaying the audio data; respectively storing the divided different audio subdata segments into corresponding display cache units according to the playing time of the audio data; and drawing the audio subdata segments in the corresponding display cache units into the audio waveforms according to the playing time of the audio data. The method can speed up the audio data processing and improve the work efficiency.

Description

A method and device for drawing audio waveforms

technical field

The invention relates to the field of audio data processing, in particular to a method and device for drawing audio waveforms.

Background technique

Audio editing plays an important role in radio stations, TV stations and other digital constructions, and is an important part of the media management system. For example, in radio stations and TV stations, editors must perform quick editing operations before storing the collected original materials into the library, so as to extract the content that users are interested in. If the system can accurately and quickly display the waveform of the corresponding audio data when editing the original media material, it can quickly locate the characteristic area of the audio data (such as the silent area, etc.), thereby speeding up the time of editing operations and improving the efficiency of work. efficiency.

There are currently two commonly used waveform drawing methods:

The first, unbuffered method.

This method reads the data corresponding to the display area in the disk, and draws the read data into a waveform for display. When the user operates on the data in the display area (or adjusts the display area), it needs to continue to read the data in the disk. The manipulated data is plotted as a waveform for display.

Because this method puts all the operations on the audio data on the disk, it will cause the user to repeatedly read the data on the disk when performing operations. Since the speed of reading the disk is relatively slow, it seriously affects the The time to draw the waveform.

The second is the full buffer method.

This method first stores all audio data in the memory, reads the data corresponding to the display area in the memory, draws the read data into a waveform for display, and when the user operates on the data in the display area (or adjusts the display area), It is necessary to continue to read the data in the memory, and draw the operated data into a waveform for display.

Since this method stores all audio data in the memory, it speeds up the drawing of the waveform compared to the first method, but because the memory capacity is much smaller than the disk capacity, for large-capacity audio data, it is impossible to store the entire audio data. Stored in memory, so the second method cannot be applied to large-capacity audio data.

To sum up, the current waveform drawing method is slow in processing large-capacity audio files, which increases the operation time and reduces work efficiency.

Contents of the invention

Embodiments of the present invention provide a method and device for drawing audio waveforms, which are used to solve the problem of waveform drawing methods in the prior art. The speed of processing large-capacity audio files is slow, thereby increasing the operation time and reducing the workload. The question of efficiency.

A method for drawing an audio waveform provided by an embodiment of the present invention includes:

Determining the number of grainy pixels for displaying audio data, the grainy pixels being used to display an audio waveform of the audio data;

According to the audio data capacity and the quantity of the granular pixel of described display audio data, the audio data corresponding to the audio waveform display area is divided into a plurality of audio sub-data segments;

Store the divided different audio sub-data segments into corresponding display buffer units according to the audio data playback time;

According to the playing time of the audio data, the corresponding audio sub-data segment in the display buffer unit is drawn into an audio waveform.

An audio waveform drawing device provided in an embodiment of the present invention includes:

Determining module, is used for determining the quantity of the granular pixel of display audio data, and described granular pixel is used for the audio wave form of display audio data;

The first division module is used to divide the audio data corresponding to the audio waveform display area into a plurality of audio sub-data segments according to the audio data capacity and the number of granular pixels of the displayed audio data;

The first processing module is used to store the divided different audio sub-data segments into corresponding display buffer units according to the playing time of the audio data;

The drawing module is used to draw the corresponding audio sub-data segment in the display buffer unit into an audio waveform according to the playing time of the audio data.

The embodiment of the present invention determines the number of granular pixels for displaying audio data, and the granular pixels are used to display the audio waveform of the audio data; according to the audio data capacity and the number of granular pixels for displaying the audio data, the audio waveform is displayed The audio data corresponding to the region is divided into a plurality of audio sub-data segments; the divided different audio sub-data segments are stored in corresponding display buffer units according to the audio data playback time; according to the audio data playback time, the corresponding The audio sub-data segment in the display buffer unit is drawn into an audio waveform. Since the audio data in the audio waveform display area can be stored in the memory regardless of the file size, the speed of processing audio data is accelerated and the work efficiency is improved.

Description of drawings

FIG. 1 is a schematic structural diagram of an audio waveform drawing device according to an embodiment of the present invention;

2 is a schematic diagram of a method for drawing an audio waveform according to an embodiment of the present invention;

FIG. 3A is a schematic diagram of a cache module according to an embodiment of the present invention;

FIG. 3B is a schematic diagram of the change of the buffer module after the first audio waveform display area moves according to the embodiment of the present invention;

FIG. 3C is a schematic diagram of the change of the buffer module after the second audio waveform display area moves according to the embodiment of the present invention;

Fig. 4 is a schematic flow chart of the method after the audio waveform display area is moved according to the embodiment of the present invention;

Fig. 5 is a schematic flow chart showing the method after particle size adjustment according to an embodiment of the present invention.

Detailed ways

The embodiment of the present invention divides the audio data corresponding to the audio waveform display area into a plurality of audio sub-data segments according to the audio data capacity and the number of granular pixels displaying the audio data, and stores the audio sub-data segments in the display buffer unit, The audio data in the audio waveform display area can be stored in the memory regardless of the file size, thereby speeding up the processing of audio data and improving work efficiency.

Wherein, the quantity of the granular pixel of display audio data is the quantity of the granular pixel of this audio data waveform display in the audio waveform display area; Further,

The number of grainy pixels in the audio waveform display area is the number of grainy pixels capable of displaying audio data waveforms in the audio waveform display area.

The number of grainy pixels displaying audio data and the number of grainy pixels in the audio waveform display area may be the same or different.

Specifically, it also shows that all the granular pixels in the audio waveform display area display the waveform of the audio data, for example: the time of the audio waveform display area is equal to or less than the time of the video file.

It does not mean that some granular pixels in the audio waveform display area display the waveform of the audio data, for example: the time of the audio waveform display area is longer than the time of the video file.

In the specific implementation process, the time of the audio waveform display area can be adjusted (that is, the display granularity is adjusted), so that the time length of each granular pixel in the audio waveform display area will change, so that the granular pixels displaying audio data can be changed quantity.

The embodiments of the present invention will be further described in detail below in conjunction with the accompanying drawings.

As shown in FIG. 1 , the audio waveform drawing device according to the embodiment of the present invention includes: a determination module 100 , a first division module 101 , a first processing module 102 and a drawing module 103 .

A determining module 100, configured to determine the number of grainy pixels for displaying audio data.

Wherein, the number of grainy pixels displaying audio data can be determined according to the following formula:

${\mathrm{<span\; class="notranslate">\; N</span>}}_{\mathrm{<span\; class="notranslate">\; pix</span>}}<span\; class="notranslate">\; =</span>\mathrm{<span\; class="notranslate">\; min</span>}<span\; class="notranslate">\; (</span>\mathrm{<span\; class="notranslate">\; N</span>}<span\; class="notranslate">\; ,</span>\mathrm{<span\; class="notranslate">\; N</span>}<span\; class="notranslate">\; \&times;</span>\frac{{\mathrm{<span\; class="notranslate">\; T</span>}}_{\mathrm{<span\; class="notranslate">\; 1</span>}}}{{\mathrm{<span\; class="notranslate">\; T</span>}}_{\mathrm{<span\; class="notranslate">\; 2</span>}}}<span\; class="notranslate">\; )</span>$

_Npix is the number of granular pixels that display audio data, N is the number of granular pixels in the audio waveform display area, T ₁ is the time length of audio data, and T ₂ is the time length of granular pixels.

The first dividing module 101 is used for dividing the audio data corresponding to the audio waveform display area into a plurality of audio sub-data segments according to the audio data capacity and the number of granular pixels for displaying the audio data determined by the determining module 100 .

Wherein, when the quantity of the granular pixel of display audio data is not less than the quantity of the granular pixel of audio waveform display area, the audio data corresponding to the audio waveform display area is divided into a plurality of audio frequency sub-data segments according to the following formula:

When the number of granular pixels of the audio data displayed is less than the number of granular pixels of the audio waveform display area, the audio data corresponding to the audio waveform display area is divided into multiple audio sub-data segments according to the following formula:

Specifically, the starting audio data position is calculated according to the following formula:

offset＝T _start ×BytesPerSecond

Among them, T _start is the start time (seconds) of the display, and BytesPerSecond is the number of bytes per second of the file.

Since the start position of the audio waveform display area may not be the start position of the audio data, it is necessary to determine the specific position of the audio data to start displaying.

Then divide the audio sub-data segment according to the Step (audio sub-data segment capacity) from the determined position until the audio data corresponding to the audio waveform display area is divided.

In this way, one granular pixel in the audio waveform display area displays the divided audio sub-data waveform.

The first processing module 102 is configured to store different audio sub-data divided by the first dividing module 101 into corresponding display buffer units according to the playing time of the audio data.

Wherein, the number of display buffer units is equal to the number of granular pixels in the audio waveform display area, which can ensure that each audio sub-data corresponds to a display buffer unit.

According to the playing time of the audio data, they are respectively stored in the corresponding display buffer unit, which can be set according to the needs, for example, the first audio sub-data segment is stored in the first display buffer unit, and the second audio sub-data segment is stored in the The second shows the cache unit, and so on.

In the specific implementation process, if the capacity of an audio sub-data segment is greater than one display buffer unit, that is, each display buffer unit cannot store all the data of the audio sub-data segment, then the first processing module 102 selects from each audio sub-data segment The data equal to the capacity of each display buffer unit is extracted, and stored in the corresponding buffer unit according to the playing time of the audio data.

If the capacity of the display cache unit is not preset, the capacity of the display cache unit needs to be determined according to the following formula:

Total capacity of cache units = (number of cache units displayed + number of cache units to be displayed) × capacity of cache units

The first processing module 102 can be extracted sequentially or randomly.

For example: the capacity of each display buffer unit is 10k, and each audio sub-data segment is 1M, then 10k data can be extracted from the beginning position of the audio sub-data segment, or can be extracted from a certain position in the middle of the audio sub-data segment 10k data, and 10k data can also be extracted from the audio sub-data segment at random.

The drawing module 103 is configured to draw the corresponding audio sub-data segment in the display buffer unit into an audio waveform according to the playing time of the audio data.

The drawing module 103 may use an averaging strategy to draw the audio data waveform, that is, calculate the average value of the audio sub-data segments in each display buffer unit, and draw the waveform according to the average value.

It should be noted that this embodiment is not limited to the averaging strategy, and any strategy for drawing audio data waveforms is applicable to this embodiment.

Wherein, the audio waveform drawing apparatus in the embodiment of the present invention may further include: a second dividing module 104 and a second processing module 105 .

The second dividing module 104 is used for when there is corresponding audio data in the region to be displayed of the audio waveform, according to the audio data capacity and the quantity of the grainy pixels of the display audio data determined by the determination module 100, the audio frequency corresponding to the region to be displayed of the audio waveform The data is divided into a plurality of audio sub-data segments.

Wherein, the audio waveform display area can be behind and/or before the audio waveform display area, and the size of the audio waveform display area can be set according to needs. For example, if the memory is relatively large, the audio waveform display area can be set relatively large , and the corresponding number of cache units to be displayed will increase.

The method of dividing by the second dividing module 104 is similar to that of the first dividing module 101 , and will not be repeated here.

The second processing module 105 is configured to store the different audio sub-data segments divided by the second dividing module 104 into corresponding cache units to be displayed according to the playing time of the audio data.

The processing manner of the second processing module 105 is similar to the processing manner of the first processing module 102, and will not be repeated here.

Since the user needs to drag the audio waveform display area back and forth when processing audio, and the dragged float is not very large, it is possible that the audio data corresponding to the audio waveform display area after the user moves will be stored in the cache unit, such as The audio data corresponding to the moved audio waveform display area is all in the buffer unit, that is, a part is in the display buffer unit, a part is in the buffer unit to be displayed, and possibly all is in the buffer unit to be displayed; or the moved A part of the audio data corresponding to the audio waveform display area is in the buffer unit.

This can ensure that after the display window is moved, there is no need to read from the disk or only a part of the data is read from the disk, which further reduces the interaction with the disk and speeds up the drawing of the waveform. Some of the audio data of the display buffer unit is before the audio data of the buffer unit is displayed, so that when the user moves the audio waveform display area forward, the interaction with the disk can be reduced and the audio waveform can be displayed in real time.

Wherein, for the situation that all the audio data corresponding to the moved audio waveform display area are in the buffer unit, the audio waveform rendering device in the embodiment of the present invention may further include: a first conversion module 106 .

The first conversion module 106 is used to store all the audio data corresponding to the audio waveform display area after the movement in the buffer unit, use the buffer unit of the audio waveform display area after the movement as the display buffer unit, and use other buffer units as the buffer unit to be displayed. The buffer unit is displayed, and the drawing module 103 is notified to draw the audio waveform.

In this way, the drawing module 103 will draw the waveform of the audio data corresponding to the moved audio waveform display area.

Wherein, for the case where part of the audio data corresponding to the moved audio waveform display area is in the cache unit, the audio waveform drawing device in the embodiment of the present invention may further include: a third division module 107, a deletion module 108, and a third processing module 109 and the second conversion module 110 .

The third division module 107 is used to store the audio data part corresponding to the audio waveform display area after the movement in the buffer unit, according to the audio data capacity and the quantity of the granular pixels of the display audio data determined by the determination module 100, to move The audio data corresponding to the audio waveform display area that is not stored in the buffer unit is divided into multiple audio sub-data segments.

Since part of the audio data corresponding to the moved audio waveform display area is not cached in the buffer unit, the third division module 107 needs to divide this part of data.

The method of dividing by the third dividing module 107 is similar to the way of dividing by the first dividing module 101 , and will not be repeated here.

The deletion module 108 is configured to delete from the cache unit, the audio waveform that does not need to be displayed in the moved audio waveform display area, and the corresponding audio sub-data segment.

Among them, after the audio waveform display area is moved, the buffer unit of the audio waveform display area must change, and some may be the display buffer unit before the movement, and the other part is the buffer unit to be displayed before the movement; or all of them are buffer units to be displayed unit. In either case, there will be some buffer units that do not store the audio data corresponding to the moved audio waveform display area, which requires deleting the audio data in this part of the buffer unit before storing the divided audio data into these buffer units .

The third processing module 109 is configured to store the different audio sub-data segments divided by the third dividing module 107 into corresponding buffer units for deleting audio sub-data segments according to the audio data playback time.

The processing manner of the third processing module 109 is similar to the processing manner of the first processing module 102 , and will not be repeated here.

The second conversion module 110 is configured to use the buffer unit in the moved audio waveform display area as a display buffer unit, use other buffer units as buffer units to be displayed, and notify the drawing module 103 to draw the audio waveform.

In this way, the drawing module 103 will draw the waveform of the audio data corresponding to the moved audio waveform display area.

Wherein, the audio waveform drawing apparatus in the embodiment of the present invention may further include: a notification module 111 .

The notification module 111 is configured to notify the determination module 100 to determine the number of granular pixels for displaying audio data according to the changed display granularity after the display granularity of the audio waveform display area changes.

As the display granularity changes, the number of granular pixels displaying audio data also changes accordingly, so the number of granular pixels displaying audio data needs to be re-determined.

As shown in Figure 2, the method for drawing the audio waveform in the embodiment of the present invention includes the following steps:

Step 200, determine the number of grainy pixels for displaying audio data.

Wherein, the number of grainy pixels displaying audio data can be determined according to the following formula:

${\mathrm{<span\; class="notranslate">\; N</span>}}_{\mathrm{<span\; class="notranslate">\; pix</span>}}<span\; class="notranslate">\; =</span>\mathrm{<span\; class="notranslate">\; min</span>}<span\; class="notranslate">\; (</span>\mathrm{<span\; class="notranslate">\; N</span>}<span\; class="notranslate">\; ,</span>\mathrm{<span\; class="notranslate">\; N</span>}<span\; class="notranslate">\; \&times;</span>\frac{{\mathrm{<span\; class="notranslate">\; T</span>}}_{\mathrm{<span\; class="notranslate">\; 1</span>}}}{{\mathrm{<span\; class="notranslate">\; T</span>}}_{\mathrm{<span\; class="notranslate">\; 2</span>}}}<span\; class="notranslate">\; )</span>$

_Npix is the number of granular pixels that display audio data, N is the number of granular pixels in the audio waveform display area, T ₁ is the time length of audio data, and T ₂ is the time length of granular pixels.

Step 201: Divide the audio data corresponding to the audio waveform display area into a plurality of audio sub-data segments according to the audio data capacity and the number of granular pixels for displaying the audio data determined in step 200.

Wherein, when the quantity of the granular pixel of displaying audio data is not less than the quantity of the granular pixel of audio waveform display area, the audio data corresponding to the audio waveform display area is divided into a plurality of audio frequency sub-data segments according to the following formula:

When the number of granular pixels of the audio data displayed is less than the number of granular pixels of the audio waveform display area, the audio data corresponding to the audio waveform display area is divided into multiple audio sub-data segments according to the following formula:

Specifically, the starting audio data position is calculated according to the following formula:

offset＝T _start ×BytesPerSecond

Among them, T _start is the start time (seconds) of the display, and BytesPerSecond is the number of bytes per second of the file.

Since the start position of the audio waveform display area may not be the start position of the audio data, it is necessary to determine the specific position of the audio data to start displaying.

Then divide the audio sub-data segment according to the Step (audio sub-data segment capacity) from the determined position until the audio data corresponding to the audio waveform display area is divided.

In this way, one granular pixel in the audio waveform display area displays the divided audio sub-data waveform.

Step 202: Store the divided audio data sub-segments in corresponding display buffer units according to audio data playback time.

Wherein, the number of display buffer units is equal to the number of granular pixels in the audio waveform display area, which can ensure that each audio sub-data corresponds to a display buffer unit.

According to the playing time of the audio data, they are stored in the corresponding display buffer units, which can be set according to the needs. For example, the first audio sub-data segment is stored in the first display buffer unit, and the second audio sub-data segment is stored in the first display buffer unit. In the second display cache unit, and so on.

In the specific implementation process, if the capacity of an audio sub-data segment is greater than one display buffer unit, that is, each display buffer unit cannot store all the data of the audio sub-data segment, then extract a value equal to each audio sub-data segment from each audio sub-data segment Display the data of the capacity of the buffer unit, and store it in the corresponding display buffer unit according to the playing time of the audio data.

If the capacity of the display cache unit is not preset, the capacity of the display cache unit needs to be determined according to the following formula:

Total capacity of cache units = (number of cache units displayed + number of cache units to be displayed) × capacity of cache units

In step 202, extraction may be performed sequentially or randomly.

For example: the capacity of each display buffer unit is 10k, and each audio sub-data segment is 1M, then 10k data can be extracted from the beginning position of the audio sub-data segment, or can be extracted from a certain position in the middle of the audio sub-data segment 10k data, and 10k data can also be extracted from the audio sub-data segment at random.

Step 203, according to the playing time of the audio data, draw the corresponding audio sub-data segment in the display buffer unit into an audio waveform.

In step 203, the audio data waveform can be drawn using an averaging strategy, that is, the average value of the audio sub-data segments in each display buffer unit is calculated, and the waveform is drawn according to the average value.

It should be noted that this embodiment is not limited to the averaging strategy, and any strategy for drawing audio data waveforms is applicable to this embodiment.

Wherein, when there is corresponding audio data in the area to be displayed of the audio waveform, after step 200, it may further include:

Step S1, according to the audio data capacity and the number of grainy pixels for displaying audio data determined in step 200, divide the audio data corresponding to the area to be displayed of the audio waveform into a plurality of audio sub-data segments.

Wherein, the audio waveform display area can be behind and/or before the audio waveform display area, and the size of the audio waveform display area can be set according to needs. For example, if the memory is relatively large, the audio waveform display area can be set relatively large , and the corresponding number of cache units to be displayed will increase.

The division method in step S1 is similar to the division method in step 201 and will not be repeated here.

Step S2. Store the divided audio sub-data segments in corresponding cache units to be displayed according to the audio data playback time.

The processing method of step S1 is similar to the processing method of step 201 and will not be repeated here.

Since the user needs to drag the audio waveform display area back and forth when processing audio, and the dragged float is not very large, it is possible that the audio data corresponding to the audio waveform display area after the user moves will be stored in the cache unit, such as The audio data corresponding to the moved audio waveform display area is all in the buffer unit, that is, a part is in the display buffer unit, a part is in the buffer unit to be displayed, and possibly all is in the buffer unit to be displayed; or the moved A part of the audio data corresponding to the audio waveform display area is in the buffer unit.

This can ensure that after the display window is moved, there is no need to read from the disk or only a part of the data is read from the disk, which further reduces the interaction with the disk and speeds up the drawing of the waveform. Some of the audio data of the display buffer unit is before the audio data of the buffer unit is displayed, so that when the user moves the audio waveform display area forward, the interaction with the disk can be reduced and the audio waveform can be displayed in real time.

Wherein, for the case where all the audio data corresponding to the moved audio waveform display area is in the buffer unit, the method for drawing the audio waveform in the embodiment of the present invention may further include:

Step a204, using the moved buffer unit in the audio waveform display area as a display buffer unit, and using other buffer units as to-be-displayed buffer units.

Step a205 , according to the playing time of the audio data, draw the corresponding audio sub-data segment in the display buffer unit into an audio waveform.

In this way, the waveform of the audio data corresponding to the moved audio waveform display area can be drawn.

Wherein, for the case where part of the audio data corresponding to the moved audio waveform display area is in the cache unit, the method for drawing the audio waveform in the embodiment of the present invention may further include:

Step b204, according to the audio data capacity and the number of granular pixels for displaying audio data determined in step 200, divide the audio data not stored in the buffer unit corresponding to the audio waveform display area into a plurality of audio sub-data segments.

Since part of the audio data corresponding to the moved audio waveform display area is not cached in the buffer unit, this part of data needs to be divided.

The manner of division in step b204 is similar to the manner of division in step 201 and will not be repeated here.

Step b205 , deleting from the cache unit the corresponding audio sub-data segment of the audio waveform that does not need to be displayed in the moved audio waveform display area.

Among them, after the audio waveform display area is moved, the buffer unit of the audio waveform display area must change, and some may be the display buffer unit before the movement, and the other part is the buffer unit to be displayed before the movement; or all of them are buffer units to be displayed unit. In either case, there will be some buffer units that do not store the audio data corresponding to the moved audio waveform display area, which requires deleting the audio data in this part of the buffer unit before storing the divided audio data into these buffer units .

Step b206. Store the divided audio sub-data segments in corresponding buffer units for deleting audio sub-data segments according to the audio data playback time.

Step b207, using the buffer unit in the moved audio waveform display area as a display buffer unit, and using other buffer units as buffer units to be displayed.

Step b208 , according to the playing time of the audio data, draw the corresponding audio sub-data segment in the display buffer unit into an audio waveform.

In this way, the waveform of the audio data corresponding to the moved audio waveform display area can be drawn.

Wherein, if the display granularity of the audio waveform display area changes, step 200 is re-executed.

As the display granularity changes, the number of granular pixels displaying audio data also changes accordingly, so the number of granular pixels displaying audio data needs to be re-determined.

As shown in Figure 3A, in the schematic diagram of the cache module of the embodiment of the present invention, it is assumed that the audio waveform display area needs three display buffer units (numbered as 1, 2, 3), and there are two audio waveform pre-display buffer units (numbered 4, 5). It should be noted that the number of cache units in actual operation is very large, and this is just an example for illustration.

Wherein, each buffer unit has the same capacity and structure, and the audio data stored in the entire buffer unit is continuous in time.

Wherein, the guard pointer marks the starting position of drawing the waveform, so that starting from the position of the guard pointer, the audio data of the next three buffer units (that is, the 1st, 2nd and 3rd buffer units) are drawn into waveforms.

Assuming that the user drags the audio waveform display area backward by 1 pixel on the basis of Figure 3A, as shown in Figure 3B, the buffer units of the entire audio waveform display area have changed (i.e. become the 2nd, 3rd and 4th cache unit), at this moment, the station guard pointer moves to the right to the first buffer unit, since the audio data corresponding to the audio waveform display area after the movement is all stored in the cache unit (ie, the 2nd, 3 and 4 cache units), so from the station guard Starting from the pointer position, draw the audio data of the next three buffer units (that is, the 2nd, 3rd and 4th buffer units) into waveforms, and at this time, the 1st and 5th buffer units are the buffer units to be displayed.

Assuming that the user drags the audio waveform display area backward by 3 pixels on the basis of Figure 3A, as shown in Figure 3C, the buffer units of the entire audio waveform display area have changed (i.e. become the 4th, 5th and 1st Cache unit, because of the limitation of the number of cache units, so the cache unit should be recycled), at this time, the guard pointer moves to the right to the fourth cache unit.

Since the audio data corresponding to the moved audio waveform display area is partially stored in the cache unit (that is, the 4th and 5th cache units), an audio subdata after the audio subdata segment cached by the 5th cache unit is read from the disk segment, and store the audio sub-data segment in the first cache unit, disconnect the two-way pointers of the first and second cache units, and connect the two-way pointers of the first and fifth cache units at the same time, when the first cache unit arrives tail.

At this time, starting from the position of the stand guard pointer, the audio data of the next three buffer units (that is, the 4th, 5th and 1st buffer units) are drawn into waveforms. At this time, the 2nd and 3rd buffer units are the buffer units to be displayed.

It should be noted that the method for moving the audio waveform display area to the left is similar to the method for moving to the right described above, and will not be repeated here.

As shown in Figure 4, the method after the audio waveform display area of the embodiment of the present invention moves includes the following steps:

Step 400, the user moves the audio waveform display area, that is, moves the audio waveform display area to the left or right or positions the audio waveform display area at random.

Step 401 , check whether all the audio data corresponding to the audio waveform display area is stored in the buffer unit, if yes, execute step 407 ; otherwise, execute step 402 .

Step 402 , check whether the audio data corresponding to the audio waveform display area is partially stored in the buffer unit, if yes, perform step 403 ; otherwise, perform step 405 .

Step 403: Store audio sub-data segments not in the audio waveform display area into corresponding buffer units.

Step 404 , use the buffer unit in the moved audio waveform display area as a display buffer unit, use other buffer units as buffer units to be displayed, and execute step 407 .

Step 405: Divide the audio data corresponding to the audio waveform display area and the audio waveform display area into multiple audio sub-data segments according to the audio data capacity and the number of granular pixels displaying the audio data.

Step 406, store the different audio sub-data segments corresponding to the divided audio waveform display area into corresponding display buffer units according to the audio data playback time; store the different audio sub-data corresponding to the divided audio waveform display area The segments are stored in the corresponding cache units to be displayed according to the playing time of the audio data.

Step 407, move the guard pointer to the first display buffer unit in the audio waveform display area.

Step 408: Draw an audio waveform according to the audio sub-data segment in the display buffer unit of the audio waveform display area.

As shown in Figure 5, the embodiment of the present invention shows that the method after particle size adjustment includes the following steps:

Step 500, the user adjusts the display granularity.

Step 501: Determine the number of granular pixels for displaying audio data according to the adjusted display granularity. Among them, according to $N_{\mathrm{pix}}=\min (N,N\&times;\frac{T_1}{T_2})$ Determines the number of grainy pixels to display audio data.

Step 502: Determine the capacity of the display buffer unit according to the determined number of grainy pixels for displaying the audio data.

Among them, the capacity of the display cache unit is determined according to the following formula:

Total capacity of cache units=(number of cache units to be displayed+number of cache units to be displayed)×capacity of cache units.

Step 503: Divide the audio data corresponding to the audio waveform display area and the audio waveform display area into a plurality of audio sub-data segments according to the audio data capacity and the adjusted number of granular pixels for displaying the audio data.

Step 504, store the different audio sub-data segments corresponding to the divided audio waveform display area in the corresponding display buffer unit according to the audio data playback time; store the different audio sub-data segments corresponding to the divided audio waveform display area The data segments are respectively stored in corresponding cache units to be displayed according to the playing time of the audio data.

Step 505, draw the audio sub-data segment in each display buffer unit into an audio waveform.

The present invention is not limited to the sequence of steps provided in the above method embodiments, and those skilled in the art can easily think of other sequence of steps through the solutions provided in the embodiments of the present invention, so as to achieve the same purpose as the present invention.

As can be seen from the foregoing embodiments: the embodiment of the present invention determines the number of granular pixels for displaying audio data, and the granular pixels are used to display audio waveforms of audio data; According to the number of pixels, the audio data corresponding to the audio waveform display area is divided into a plurality of audio sub-data segments; the divided different audio sub-data segments are stored in corresponding display buffer units according to the audio data playback time; Described audio data playing time, the audio sub-data segment in the corresponding display cache unit is drawn into audio waveforms, because regardless of the file size, the audio data in the audio waveform display area can be stored in the memory, thereby speeding up the processing of audio The speed of the data improves the work efficiency, and if all or part of the data in the audio waveform display area moved by the user is in the display buffer unit and the buffer unit to be displayed, there is no need to read from the disk or only read a part from the disk Data, thereby reducing the amount of data interacting with the disk and the time required for user operations, and realizing the real-time display of the audio waveform processed by the user.

Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalent technologies, the present invention also intends to include these modifications and variations.

Claims (15)

1. A method for audio waveform drawing, characterized in that the method comprises: Determining the number of grainy pixels for displaying audio data, the grainy pixels being used to display an audio waveform of the audio data; According to the audio data capacity and the quantity of the granular pixel of described display audio data, the audio data corresponding to the audio waveform display area is divided into a plurality of audio sub-data segments; Store the divided different audio sub-data segments into corresponding display buffer units according to the audio data playback time; According to the playing time of the audio data, the corresponding audio sub-data segment in the display buffer unit is drawn into an audio waveform. 2. The method of claim 1, further comprising: When there is corresponding audio data in the area to be displayed of the audio waveform, according to the audio data capacity and the number of granular pixels of the displayed audio data, the audio data corresponding to the area to be displayed by the audio waveform is divided into a plurality of audio sub-data segments; The different audio sub-data segments that are divided when there is corresponding audio data in the area to be displayed of the audio waveform are respectively stored in the corresponding buffer units to be displayed according to the playing time of the audio data. 3. The method according to claim 1 or 2, wherein, if the capacity of each buffer unit is less than the capacity of each audio sub-data segment, then extract a buffer equal to each buffer unit from each audio sub-data segment capacity data, and store them in corresponding cache units according to the playing time of the audio data. 4. The method of claim 2, further comprising: When the audio data corresponding to the moved audio waveform display area is all stored in the buffer unit, the buffer unit of the moved audio waveform display area is used as a display buffer unit, and other buffer units are used as buffer units to be displayed; According to the playing time of the audio data, the corresponding audio sub-data segment in the display buffer unit is drawn into an audio waveform. 5. method as claimed in claim 2 or 4, is characterized in that, this method also comprises: When the audio data corresponding to the moved audio waveform display area is partially stored in the buffer unit, according to the audio data capacity and the number of grainy pixels of the audio data displayed, the corresponding part of the audio waveform display area is not stored in the buffer unit The audio data of is divided into multiple audio sub-data segments; Deleted from the cache unit, the audio waveform that does not need to be displayed in the moved audio waveform display area, and the corresponding audio sub-data segment; Different audio sub-data segments obtained after dividing the audio data corresponding to the audio waveform display area not stored in the buffer unit are stored in the corresponding buffer unit for deleting the audio sub-data segment according to the audio data playback time; Use the buffer unit in the moved audio waveform display area as the display buffer unit, and use other buffer units as the buffer unit to be displayed; According to the playing time of the audio data, the corresponding audio sub-data segment in the display buffer unit is drawn into an audio waveform. 6. The method of claim 1, further comprising: After the display granularity of the audio waveform display area changes, determine the number of granular pixels for displaying audio data according to the changed display granularity; According to the audio data capacity and the quantity of the granular pixel of described display audio data, the audio data corresponding to the audio waveform display area is divided into a plurality of audio sub-data segments; The different audio sub-data segments divided after the display granularity of the audio waveform display area changes are respectively stored in the corresponding display buffer unit according to the audio data playback time; According to the playing time of the audio data, the corresponding audio sub-data segment in the display buffer unit is drawn into an audio waveform. 7. the method as claimed in claim 1 or 6 is characterized in that, when the quantity of the granular pixel of displaying audio data is not less than the quantity of the granular pixel of audio waveform display area, according to following formula audio waveform is divided into The audio data corresponding to the display area is divided into multiple audio sub-data segments:

When the number of granular pixels of the audio data displayed is less than the number of granular pixels of the audio waveform display area, the audio data corresponding to the audio waveform display area is divided into multiple audio sub-data segments according to the following formula: 8. An audio waveform drawing device, characterized in that the device comprises: Determining module, is used for determining the quantity of the granular pixel of display audio data, and described granular pixel is used for the audio wave form of display audio data; The first division module is used to divide the audio data corresponding to the audio waveform display area into a plurality of audio sub-data segments according to the audio data capacity and the number of granular pixels of the displayed audio data; The first processing module is used to store the divided different audio sub-data segments into corresponding display buffer units according to the audio data playback time; The drawing module is used to draw the corresponding audio sub-data segment in the display buffer unit into an audio waveform according to the playing time of the audio data. 9. The device of claim 8, further comprising: The second division module is used to divide the audio data corresponding to the audio waveform area to be displayed into multiple parts according to the audio data capacity and the number of granular pixels of the audio data displayed when there is corresponding audio data in the audio waveform area to be displayed. audio sub-data segments; The second processing module is configured to store the different audio sub-data segments divided by the second dividing module into corresponding cache units to be displayed according to the playing time of the audio data. 10. The device according to claim 8, wherein the first processing module is further configured to: When the capacity of each display buffer unit is smaller than the capacity of each audio sub-data segment, data equal to the capacity of each display buffer unit is extracted from each audio sub-data segment, and stored in the corresponding display according to the audio data playback time in the cache unit. 11. The device according to claim 9, wherein the second processing module is further used for: When the capacity of each cache unit to be displayed is smaller than the capacity of each audio sub-data segment, data equal to the capacity of each buffer unit to be displayed is extracted from each audio sub-data segment, and stored in the corresponding audio data playback time in the cache unit to be displayed. 12. The device of claim 9, further comprising: The first conversion module is used to store all the audio data corresponding to the moved audio waveform display area in the buffer unit, use the buffer unit of the moved audio waveform display area as a display buffer unit, and use other buffer units as to-be-displayed The buffer unit notifies the drawing module to draw the audio waveform. 13. The device according to claim 9 or 12, further comprising: The third division module is used to store the audio data part corresponding to the audio waveform display area after the movement in the buffer unit, according to the audio data capacity and the number of granular pixels of the audio data displayed, the audio waveform after the movement The audio data not stored in the cache unit corresponding to the display area is divided into multiple audio sub-data segments; The deletion module is used to delete from the cache unit, the audio waveform that does not need to be displayed in the moved audio waveform display area, and the corresponding audio sub-data segment; The third processing module is used to divide the audio data corresponding to the audio waveform display area into different audio sub-data segments that are not stored in the buffer unit, and store them in corresponding deleted audio sub-data segments according to the audio data playback time. in the cache unit; The second conversion module is configured to use the buffer unit in the moved audio waveform display area as a display buffer unit, use other buffer units as buffer units to be displayed, and notify the drawing module to draw the audio waveform. 14. The device of claim 8, further comprising: The notification module is configured to notify the determining module to determine the number of granular pixels for displaying audio data according to the changed display granularity after the display granularity of the audio waveform display area changes. 15. The device according to claim 8, wherein, when the number of granular pixels of the audio data displayed is not less than the number of granular pixels of the audio waveform display area, the audio frequency corresponding to the audio waveform display area is calculated according to the following formula The data is divided into multiple audio sub-data segments:

When the number of granular pixels of the audio data displayed is less than the number of granular pixels of the audio waveform display area, the audio data corresponding to the audio waveform display area is divided into multiple audio sub-data segments according to the following formula:

Images