CN108111900A - A kind of broadcasting speed control method and device - Google Patents

Abstract

Embodiments of the present invention provide a playback speed control method and device. In the method, the data buffer area receives the first video data acquired from the cloud storage system, acquires the first video data, and according to the playback time point and the playback correspondence, Obtain the playback speed information corresponding to the first video data, determine the decoding speed information that matches the playback speed information, and use the decoding speed information to decode and play the first video data; The speed information and quantity information determine the stream fetching speed that matches the playback speed information, and obtain the second video data from the cloud storage system according to the stream fetching speed, and the data buffer area receives the second video data again, because the decoding speed information and The streaming speed matches the playback speed information, which avoids abnormal playback during fast playback or slow playback.

Description

A playback speed control method and device

technical field

The invention relates to the field of multimedia technologies, in particular to a method and device for controlling playback speed.

Background technique

At present, the normal playback process of video data stored in the cloud storage system is generally: obtain the data to be played from the cloud storage system through a target thread, and push the acquired data to be played to the buffer of the playback library through this thread , the playback library decodes the data to be played and plays it.

When the user of the cloud storage system fast-plays the video data of a certain period of time, that is, when the playback speed of the video data to be played in a certain period of time is set to be faster, at this time, the target thread obtains the video data to be played from the cloud storage system. The speed of data fetching is correspondingly accelerated, so that the speed of pushing the acquired data to be played to the buffer of the playback library becomes faster, so that there are too many data to be played in the buffer of the playback library. At this time, the decoding speed is slow Due to the streaming speed, frame skipping occurs when the playback library plays the data to be played. For example, if the streaming speed is 10 frames/s and the decoding speed is 8 frames/s, the playback library will lose 2 frames during decoding. Therefore, the playing picture is incoherent;

When the user of the cloud storage system slows down the video data of a certain period of time, that is, when the playback speed of the video data to be played in a certain period of time is set to be slow, at this time, the target thread obtains the video data to be played from the cloud storage system. The data fetching speed is correspondingly slowed down, so that the push speed of the acquired data to be played to the buffer of the playback library is slowed down, so that there is less data to be played in the buffer of the playback library. At this time, the playback library The decoding speed is faster than the streaming speed, so that a black screen appears when the playback library plays the data to be played. For example, the streaming speed is 8 frames/s, the decoding speed is 10 frames/s, and there are 8 frames of video data in the buffer. When the playback library finishes decoding the 8 frames of video data, the target thread has not yet pushed the next 8 frames of video data into the buffer, thus making the playback screen black.

To sum up, in the prior art, when the playback speed changes, that is, when fast playback or slow playback is performed, abnormal playback phenomena such as incoherent images or black screens will occur, making the playback effect poor.

Contents of the invention

The purpose of the embodiments of the present invention is to provide a playback speed control method and device, so as to avoid abnormal playback during fast playback or slow playback. The specific technical scheme is as follows:

A method for controlling playback speed, applied to a stream-controlled playback system, wherein a data buffer area is set in the stream-controlled playback system, and the method includes:

The data buffer area receives the first video data obtained from the cloud storage system, wherein the first video data carries a playback time point and a playback correspondence, and the playback correspondence is a playback time period and playback speed information corresponding relationship;

Acquiring the first video data in the data buffer area, obtaining the playback speed information corresponding to the first video data according to the playback time point and the playback correspondence, and determining the decoding speed information matching the playback speed information, Decoding and playing the first video data by using the decoding speed information;

Acquiring the quantity information of the video data in the data buffer area, and determining a streaming speed matching the playing speed information according to the playing speed information and the acquired quantity information;

Acquiring the second video data from the cloud storage system according to the determined streaming speed, and then receiving the second video data in the data cache area.

Optionally, the step of obtaining the playback speed information corresponding to the first video data according to the playback time point and the playback correspondence includes:

Calling the callback function of the playback library to calculate the target playback time period where the received playback time point is located, and determine the playback speed information corresponding to the first video data according to the target playback time period and the playback correspondence.

Optionally, the decoding speed information that matches the obtained playback speed information is calculated through a playback library callback function.

Optionally, the operation of acquiring the first video data in the data buffer area is performed by a streaming thread.

Optionally, the operation of decoding and playing the first video data by using the decoding speed information is performed by a playback library.

Optionally, the operation of determining the streaming speed matching the playing speed information is performed by a streaming control thread.

A playback speed control device, applied to a stream control playback system, wherein a data buffer area is provided in the stream control playback system, and the device includes:

The receiving module is used for the data buffer area to receive the first video data obtained from the cloud storage system, wherein the first video data carries a playback time point and a playback correspondence, and the playback correspondence is the playback time Correspondence between segments and playback speed information;

The playback module is configured to obtain the first video data in the data buffer area, obtain the playback speed information corresponding to the first video data according to the playback time point and the playback correspondence, and determine to match the playback speed information Decoding speed information, using the decoding speed information to decode and play the first video data;

A streaming speed determination module, configured to acquire the quantity information of the video data in the data buffer area, and determine a streaming speed matching the playback speed information according to the playback speed information and the acquired quantity information;

An acquisition module, configured to acquire the second video data from the cloud storage system according to the determined streaming speed, and then receive the second video data in the data cache area.

Optionally, the playback module is specifically used for:

Calling the callback function of the playback library to calculate the target playback time period where the received playback time point is located, and determine the playback speed information corresponding to the first video data according to the target playback time period and the playback correspondence.

Optionally, the decoding speed information that matches the obtained playback speed information is calculated through a playback library callback function.

In the embodiment of the present invention, the data buffer area receives the first video data obtained from the cloud storage system, acquires the first video data in the data buffer area, determines the decoding speed information matching the playback speed information of the first video data, and utilizes The decoding speed information decodes and plays the first video data, and at the same time, obtains the quantity information of the video data in the data buffer area, determines the stream fetching speed matched with the playing speed information according to the playing speed information and the obtained quantity information, and The second video data is acquired from the cloud storage system according to the determined streaming speed. Since the decoding speed information and the streaming speed both match the playback speed information, abnormal playback during fast playback or slow playback is avoided.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without creative work.

FIG. 1 is a schematic flow chart of a playback speed control method provided by an embodiment of the present invention;

FIG. 2 is a schematic structural diagram of a stream control playback system provided by an embodiment of the present invention;

Fig. 3 is a schematic structural diagram of a playback speed control device provided by an embodiment of the present invention.

Detailed ways

The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

In order to solve the problems in the prior art, the embodiments of the present invention provide a playback speed control method and device.

A playback speed control method provided by an embodiment of the present invention is firstly introduced below.

It should be noted that the playback speed control method provided by the embodiment of the present invention is applied to a stream control playback system, which is connected to a cloud storage system through communication, and controls the playback speed of video data in the cloud storage system.

As shown in Figure 1, a playback speed control method provided by an embodiment of the present invention, a data buffer area is provided in the stream control playback system, and the method may include:

S101: The data cache area receives first video data acquired from a cloud storage system.

The stream control playback system obtains video data from the cloud storage system through the SDK (Software Development Kit, software development kit) interface, and sends the obtained first video data to the data buffer area, wherein the cloud storage system is a large-scale A distributed storage system is used to store video data. In addition, in one embodiment of the present invention, the above-mentioned operation of sending the first video data obtained from the cloud storage system to the data cache area is performed by the stream fetching thread of.

Because the users of the cloud storage system will have the requirement of fast forwarding, slow forwarding or fast forwarding for a certain period of time and slow forwarding for another period of time of video data, for example: the user has a certain video data that has been viewed. When playing back, the time period of interest will be set to slow down, and the time period other than the time period of interest will be fast forwarded. Therefore, the acquired first video data carries the playback time point and the corresponding relationship of playback. The time point is the current time point of the first video data, and the playing correspondence is the correspondence between the playing time period and the playing speed information.

For example: the playback time of a certain video data is 9:00-11:00, the user sets 9:00-10:00 to fast playback and the playback speed is 10 frames/s, and 10:00-11:00 to slow playback and playback speed is 5 frames/s, then the playback corresponding relationship carried in the acquired first video data is as shown in Table 1:

Table 1

play time period playback speed information 9:00-10:00 10 frames/s 10:00-11:00 5 frames/s

S102: Obtain the first video data in the data buffer area, obtain the playback speed information corresponding to the first video data according to the playback time point and the playback correspondence, determine the decoding speed information that matches the playback speed information, and use the decoding speed information to analyze the first video data. A video data is decoded and played.

Acquire the first video data from the data buffer area, thereby obtaining the playback time point carried in the first video data. In one embodiment of the present invention, the above-mentioned operation of obtaining the first video data in the data buffer area is performed by Executed by the streaming thread.

In one embodiment of the present invention, the playback speed information corresponding to the first video data is obtained according to the playback time point and the playback correspondence, which may be:

The playback library callback function is called to calculate the target playback time period where the received playback time point is located, and the playback speed information corresponding to the first video data is determined according to the target playback time period and the playback correspondence.

In order to determine the playback speed information corresponding to the first video data, it is necessary to know which playback speed information corresponds to the playback time of the first video data. Therefore, the received playback speed information can be calculated by calling the playback library callback function. The target playback time period where the time point is located, and then determine the playback speed information corresponding to the first video data according to the target playback time period and the playback correspondence.

For example: the received playback time point is 9:10, the playback time of a certain video data is 9:00-11:00, the user sets 9:00-10:00 fast forward and the playback speed is 10 frames/s, 10:00-11:00 is slowed down and the playback speed is 5 frames/s. The playback correspondence carried in the acquired first video data is shown in Table 1:

Table 1

play time period playback speed information 9:00-10:00 10 frames/s 10:00-11:00 5 frames/s

Call the callback function of the playback library to calculate the target playback time period of the received playback time point 9:10 as 9:00-10:00, and determine the playback corresponding to the first video data according to the target playback time period and playback correspondence in Table 1 The speed information is 10 frames/s.

After determining the playback speed information corresponding to the first video data, in order to play the first video data according to the playback speed information, call the playback library callback function to calculate the decoding speed information that matches the playback speed information, and use the decoding speed information Decode and play the first video data, thereby achieving the purpose of playing the first video data according to the playback speed information set by the user. In addition, the above-mentioned operation of decoding and playing the first video data by using the decoding speed information is performed by The playback library in the streaming playback system is executed, wherein the playback library is a playback library that can perform processing operations and playback operations, and the playback library can also be used to store videos to be played.

S103: Obtain quantity information of the video data in the data buffer area, and determine a stream fetching speed matching the playback speed information according to the playback speed information and the acquired quantity information.

If the video data fetching speed is too fast from the cloud storage system, too much video data in the data buffer area will make the video data acquisition speed too fast from the data buffer area. At this time, when the video data is played, the There will be frame skipping; if the speed of getting video data from the cloud storage system is too slow, and the video data in the data buffer is too small, the speed of getting video data from the data buffer will be too slow. , a black screen will appear when playing video data.

Therefore, in order to avoid frame skipping or black screen in the process of playing video data, there needs to be an appropriate amount of video data in the data buffer area to balance the streaming speed and playback speed. Therefore, the video in the data buffer area is obtained data quantity information, and determine the streaming speed that matches the playback speed information according to the playback speed information and the acquired quantity information, in one embodiment of the present invention, the above-mentioned determination and playing The flow rate matched by the speed information can include:

extracting the playback speed of the first video data from the playback speed information;

Obtain the quantity of video data in the data buffer area from the obtained quantity information;

According to the playing speed and the quantity, determine the streaming speed for matching the quantity of the video data in the data buffer with the playing speed.

By determining the size of the playback speed and the amount of video data acquired, determine the streaming speed that can match the video data in the data buffer with the playback speed. In addition, the above determination of the streaming speed that matches the playback speed information Speed operations are performed by the flow control thread.

S104: Obtain the second video data from the cloud storage system according to the determined streaming speed, and then receive the second video data in the data buffer area.

After determining the stream fetching speed, acquire the second video data from the cloud storage system according to the stream fetching speed, and send the acquired second video data to the data cache area, and the data cache area receives the second video data again, thus, In the process of playing the video data, both the fetching speed and the decoding speed information match the playing speed information.

It can be seen that after the user fast forwards, slows down or fast forwards a certain time period of video data and slows down another time period, the embodiment of the present invention can obtain the video data with the playback speed set by the user. , automatically determine the decoding speed information and streaming speed that match the playback speed information, and automatically complete the playback speed control without human intervention.

In the embodiment of the present invention, the data buffer area receives the first video data obtained from the cloud storage system, acquires the first video data in the data buffer area, determines the decoding speed information matching the playback speed information of the first video data, and utilizes The decoding speed information decodes and plays the first video data, and at the same time, obtains the quantity information of the video data in the data buffer area, determines the stream fetching speed matched with the playing speed information according to the playing speed information and the obtained quantity information, and Acquire the second video data from the cloud storage system according to the determined streaming speed. Since the decoding speed information and the streaming speed both match the playback speed information, playback exceptions during fast playback or slow playback can be avoided, and it can be realized Automatically control playback speed without human intervention.

In addition, for the convenience of understanding, the present application will be described in detail in combination with the embodiment shown in FIG. 2 . In this embodiment, a data cache area, a stream fetching thread, a streaming thread, a stream control thread and a playback library are set in the stream control playback system, and the stream control playback system is connected to the cloud storage system through the cloud storage SDK interface;

Assuming that the playback time of a certain video data is 9:00-11:00, the user sets 9:00-10:00 to fast forward and the playback speed is H, and 10:00-11:00 to slow down and the playback speed is I, H Greater than 1, it is assumed that the playback time point of the video data A obtained by the streaming thread is 9:20;

The process of playing speed control through the flow control playback system shown in Figure 2 is:

1. The streaming thread sends the video data A obtained from the cloud storage system through the cloud storage SDK interface to the data cache area;

2. The data buffer area receives the video data A, wherein the video data A carries the playback time point 9:20 and the playback correspondence, and the playback correspondence is the correspondence between the playback time period and the playback speed information as shown in Table 2:

Table 2

play time period playback speed information 9:00-10:00 h 10:00-11:00 I

3. The streaming thread obtains the video data A in the data buffer, and sends the obtained video data A to the playback library;

4. The playback library calls the callback function of the playback library to calculate the target playback time period of the received playback time point 9:10 as 9:00-10:00, and determine the video data A according to the target playback time period and playback correspondence in Table 1 The corresponding playback speed information is H, and the determined playback speed information H is sent to the flow control thread, and the decoding speed information B matching the obtained playback speed information H is determined, and the received decoding speed information B is determined according to the determined decoding speed information B The received video data A is decoded and played;

5. The flow control thread obtains the quantity information C of the video data in the data buffer area, and determines the stream fetching speed D matching the playback speed information H according to the received playback speed information H and the acquired quantity information C, and fetches the stream The speed D is sent to the stream fetching thread;

6. The streaming thread acquires the video data M from the cloud storage system according to the received streaming speed D, and returns to step 2.

In the embodiment of the present invention, stream fetching and stream pushing are performed through different threads, that is, the stream fetching thread fetches the stream, sends the video data of the stream fetching to the data buffer area, and the stream pushing thread pushes the stream to the playback library, therefore, The stream fetching thread and the stream pushing thread can work at the same time. Compared with the existing technology where a target thread fetches stream and pushes stream, the push stream needs to wait for the stream fetching to be completed before execution, which realizes asynchronous processing and improves processing efficiency .

At the same time, in the embodiment of the present invention, the playback speed of the video data is controlled by increasing the data buffer area and the cooperation of the stream fetching thread, the streaming thread, the stream control thread and the playback library, so that the decoding speed information and the stream fetching speed are equal. Matching the playback speed information avoids abnormal playback during fast playback or slow playback, and can automatically control the playback speed without human intervention.

With respect to the method embodiment described above, as shown in Figure 3, the embodiment of the present invention also provides a playback speed control device, which is applied to a stream control playback system, wherein a data buffer area is provided in the stream control playback system, and the device include:

The receiving module 201 is used for the data buffer area to receive the first video data obtained from the cloud storage system, wherein the first video data carries a playback time point and a playback correspondence, and the playback correspondence is a playback The corresponding relationship between the time period and the playback speed information;

The playback module 202 is configured to obtain the first video data in the data buffer area, obtain the playback speed information corresponding to the first video data according to the playback time point and the playback correspondence, and determine the playback speed information corresponding to the playback speed information. Matching decoding speed information, using the decoding speed information to decode and play the first video data;

The streaming speed determination module 203 is configured to acquire the quantity information of the video data in the data buffer area, and determine the streaming speed matching the playback speed information according to the playback speed information and the acquired quantity information;

The acquiring module 204 is configured to acquire the second video data from the cloud storage system according to the determined streaming speed, and the data cache area receives the second video data.

In the embodiment of the present invention, the data buffer area receives the first video data obtained from the cloud storage system, acquires the first video data in the data buffer area, determines the decoding speed information matching the playback speed information of the first video data, and utilizes The decoding speed information decodes and plays the first video data, and at the same time, obtains the quantity information of the video data in the data buffer area, determines the stream fetching speed matched with the playing speed information according to the playing speed information and the obtained quantity information, and Acquire the second video data from the cloud storage system according to the determined streaming speed. Since the decoding speed information and the streaming speed both match the playback speed information, playback exceptions during fast playback or slow playback can be avoided, and it can be realized Automatically control playback speed without human intervention.

In an implementation manner, the playing module 202 may be specifically used for:

Calling the callback function of the playback library to calculate the target playback time period where the received playback time point is located, and determine the playback speed information corresponding to the first video data according to the target playback time period and the playback correspondence.

In an implementation manner, the decoding speed information that matches the obtained playback speed information is calculated through a playback library callback function.

In an implementation manner, the operation of obtaining the first video data in the data buffer area is performed by a streaming thread.

In an implementation manner, the operation of decoding and playing the first video data by using the decoding speed information is performed by a playback library.

In an implementation manner, the operation of determining the stream fetching speed matching the playback speed information is performed by a stream control thread.

It should be noted that in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that there is a relationship between these entities or operations. There is no such actual relationship or order between them. Furthermore, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus comprising a set of elements includes not only those elements, but also includes elements not expressly listed. other elements of or also include elements inherent in such a process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article or apparatus comprising said element.

Each embodiment in this specification is described in a related manner, the same and similar parts of each embodiment can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and for relevant parts, refer to part of the description of the method embodiment.

The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the protection scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principles of the present invention are included in the protection scope of the present invention.

Claims (9)

1. a kind of broadcasting speed control method, applied to flow control play system, which is characterized in that set in the flow control play system Data buffer area is equipped with, the described method includes：

The data buffer area receives the first video data obtained from cloud storage system, wherein, first video data In carry play time and play correspondence, the correspondence that plays is reproduction time section and broadcasting speed information Correspondence；

The first video data in the data buffer area is obtained, according to the play time and correspondence is played, obtains The corresponding broadcasting speed information of first video data, determines the decoding speed information with the broadcasting speed information matches, First video data is decoded and played using the decoding speed information；

Obtain the quantity information of the video data in the data buffer area, and according to the broadcasting speed information and acquired Quantity information determines to take flow velocity degree with the broadcasting speed information matches；

According to identified flow velocity degree is taken to obtain the second video data from the cloud storage system, the data buffer area connects again Receive second video data.

2. according to the method described in claim 1, it is characterized in that, described close according to the play time and broadcasting are corresponding System, the step of obtaining first video data corresponding broadcasting speed information, include：

Broadcasting storehouse call back function is called to calculate the target reproduction time section where received play time, according to described Target reproduction time section and broadcasting correspondence, determine the corresponding broadcasting speed information of first video data.

It is 3. according to the method described in claim 1, it is characterized in that, described with the decoding of broadcasting speed information matches that is being obtained Velocity information is calculated by playing storehouse call back function.

4. according to the method described in claim 1, it is characterized in that, first video counts obtained in the data buffer area According to operation performed by plug-flow thread.

5. according to the method described in claim 1, it is characterized in that, described regarded using the decoding speed information to described first Frequency according to the operation for being decoded and playing is performed by playing storehouse.

6. according to the method described in claim 1, it is characterized in that, described determine to take stream with the broadcasting speed information matches The operation of speed is performed by flow control thread.

7. a kind of broadcasting speed control device, applied to flow control play system, which is characterized in that set in the flow control play system Data buffer area is equipped with, described device includes：

Receiving module receives the first video data obtained from cloud storage system for the data buffer area, wherein, it is described Play time is carried in first video data and plays correspondence, the broadcasting correspondence is reproduction time section and broadcasts Put the correspondence of velocity information；

Playing module, for obtaining the first video data in the data buffer area, according to the play time and broadcasting Correspondence obtains the corresponding broadcasting speed information of first video data, determines and the broadcasting speed information matches Decoding speed information is decoded and played to first video data using the decoding speed information；

Stream speed determination module is taken, for obtaining the quantity information of the video data in the data buffer area, and according to described Broadcasting speed information and acquired quantity information determine to take flow velocity degree with the broadcasting speed information matches；

Acquisition module, it is described for according to identified flow velocity degree being taken to obtain the second video data from the cloud storage system Data buffer area receives second video data again.

8. device according to claim 7, which is characterized in that the playing module is specifically used for：

Broadcasting storehouse call back function is called to calculate the target reproduction time section where received play time, according to described Target reproduction time section and broadcasting correspondence, determine the corresponding broadcasting speed information of first video data.

9. device according to claim 7, which is characterized in that the decoding of broadcasting speed information matches with being obtained Velocity information is calculated by playing storehouse call back function.