CN104066007A - Cloud service device, video playback multi-screen preview method and system - Google Patents

Abstract

A cloud service device includes a data flow center, an index service unit, a digital signal processing unit and a data transceiving unit. The data stream center stores the video preview screen, and the index service unit is used to calculate the offset between the video preview time point and the multi-screen preview time point after receiving the multi-screen preview request information, and find the offset in the data stream center The corresponding multiple preview images; the digital signal processing unit is used to compress multiple preview images into a single file; the data transceiver unit is used to receive a single file and send it to the multimedia device, so that the multimedia device can decompress the single file into multiple previews screen for multi-screen preview. In addition, a method and a cloud service system for cloud service equipment to provide multi-screen preview during video playback are also provided. The above-mentioned cloud service device, method and system can realize multi-screen preview during video playback, greatly improving user experience and satisfying visual requirements.

Description

Cloud service device, method and system for multi-screen preview during video playback

technical field

The present invention relates to network communication, in particular to a cloud service device, a method and a system for providing multi-screen preview during video playback.

Background technique

With the development of computer technology, online video playback has gradually become the mainstream. When users watch video playback, they can preview the video. However, the existing technology can only realize the function of single-screen preview, but cannot realize multi-screen preview during video playback. function, the user experience is not good.

Contents of the invention

In view of this, it is necessary to provide a cloud service device that can provide multi-screen preview during video playback.

In addition, it is also necessary to provide a method for the cloud service device to provide multi-screen preview during video playback, which can provide multi-screen preview during video playback.

In addition, it is also necessary to provide a cloud service system that can provide multi-screen preview during video playback.

The cloud service device provided by the embodiment of the present invention includes a data stream center, an index service unit, a digital signal processing unit, and a data transceiving unit. The data stream center stores video preview images, and the index service unit is used to calculate according to the time interval between the first multi-screen preview frames and the number of first multiple-screen preview frames after receiving the first multi-screen preview request information. Multiple preview screen time points with the video preview time point as the center point are respectively multiple offsets relative to the video preview time point, and in the data stream center according to the position and multiple offsets of the preview screen corresponding to the video preview time point Quantitatively find out the positions of multiple preview pictures corresponding to multiple preview picture time points, and obtain multiple preview pictures from the data stream center according to the positions of multiple preview pictures; the digital signal processing unit is used to combine multiple preview pictures compressed into a single file; the data transceiver unit is used to receive the single file and send it to the multimedia device, so that the multimedia device decompresses the single file into multiple preview screens for multi-screen preview.

Preferably, if the time interval between the first multiple preview frames is represented by Δt, and the number of the first multiple preview frames is represented by n, then the two preview frames closest to the video preview time point in the multiple preview frame time points and the video preview time The offset between the preview images corresponding to the point is △t, and the offset between the two preview images farthest from the video preview time point among the multiple preview image time points and the preview image corresponding to the video preview time point is (n-1)*Δt/2.

Preferably, the index service unit is further configured to receive the second multi-screen preview request and calculate the expansion start time point and multiple expansion time points according to the expansion start time point, the expansion end time point, and the second multi-screen preview number in the second multi-screen preview request. Multiple offsets between screen preview time points. Wherein, the plurality of expanded image preview time points are time points between the expansion start time point and the expansion end time point.

Preferably, if t1 is used to represent the start time point of expansion, t2 is used to represent the end time point of expansion, and n1 is used to represent the second most preview screen number, the two adjacent expanded screen previews between the start time point of expansion and the end time point of expansion The offset between time points is equal to (t2-t1)/(n1-1).

The method for the cloud service device provided by the embodiment of the present invention to provide multi-screen preview during video playback includes: after receiving the first multi-screen preview request information, according to the time interval between the first multiple preview screens and the first multi-screen preview request information in the first multi-screen preview request information. The number of multiple preview screens calculates the multiple offsets of multiple preview screen time points with the video preview time point as the center point relative to the video preview time point; according to the position and multiple offsets of the preview screen corresponding to the video preview time point Find out the positions of multiple preview screens corresponding to multiple preview screen time points; obtain multiple preview screens from the data flow center according to the positions of multiple preview screens; compress multiple preview screens into a single file; send a single file to The multimedia device is used for the multimedia device to decompress a single file into multiple preview screens for multi-screen preview.

Preferably, if the time interval between the first multiple preview frames is represented by Δt, and the number of the first multiple preview frames is represented by n, the two preview time points closest to the video preview time point among the multiple preview frame time points correspond to The offset between the preview screen and the video preview screen is △t, the offset between the preview screen and the video preview screen corresponding to the two preview time points farthest from the video preview time point among multiple preview screen time points The amount is (n-1)*Δt/2.

Preferably, the second multi-screen preview request is received and the time between the expansion start time point and the multiple expanded screen preview time points is calculated according to the expansion start time point, the expansion end time point, and the second multi-screen preview number in the second multi-screen preview request. multiple offsets. Wherein, the plurality of expanded image preview time points are time points between the expansion start time point and the expansion end time point.

Preferably, if t1 is used to represent the start time point of expansion, t2 is used to represent the end time point of expansion, and n1 is used to represent the second most preview screen number, the two adjacent expanded screen previews between the start time point of expansion and the end time point of expansion The offset between time points is equal to (t2-t1)/(n1-1).

The cloud service system provided by the embodiment of the present invention includes not only the above-mentioned cloud service equipment, but also multimedia equipment. The multimedia device is used to send the first multi-screen preview request information to the cloud service device, receive a single file stored in multiple screens sent by the cloud service device, decompress the single file into multiple video screens, and display the multiple video screens on the multimedia device player to realize multi-video screen preview.

Preferably, the multimedia device is also used to send the second multi-screen preview request information to the cloud service device, receive a single file stored in multiple screens transmitted by the cloud service device, decompress the single file into multiple video screens, and display the multiple video screens on the Multimedia device player to realize multi-video screen preview.

The multi-picture preview method provided by the embodiment of the present invention can simultaneously preview multiple preview pictures around the video preview time point, which satisfies the user's demand for simultaneous preview of multiple pictures, and greatly improves the experience of users watching online videos.

Description of drawings

FIG. 1 is a diagram of an application environment and functional modules of an embodiment of a cloud service device of the present invention.

FIG. 2 is a calculation diagram of an embodiment of the calculation of multiple offsets of multiple preview picture time points with the video preview time point as the center point relative to the video preview time point respectively by the cloud service device of the present invention.

FIG. 3 is a calculation diagram of an embodiment of calculating multiple offsets between the unfolding start time point and multiple expanded screen preview time points by the cloud service device of the present invention.

FIG. 4 is a flow chart of an embodiment of a method for a cloud service device to provide multi-screen preview during video playback according to the present invention.

FIG. 5 is a flow chart of an embodiment of a method for multi-screen preview during video playback by the cloud service system of the present invention.

Explanation of main component symbols

Cloud service device 10

multimedia equipment 20

Data Flow Center 100

Indexing service unit 102

Digital Signal Processing Unit 104

Data transceiver unit 106

player 200

Detailed ways

Referring to FIG. 1 , it shows an application environment and functional module diagram of an embodiment of the cloud service device 10 . In this embodiment, when the user needs to perform a multi-screen preview, the multimedia device 20 is used to send a multi-screen preview request to the cloud service device 10, and the cloud service device 10 processes the multi-screen preview request after receiving the multi-screen preview request. Afterwards, the multiple frames required by the user to be previewed can be provided. At this time, the player 200 in the multimedia device 20 can play the multiple frames required to be previewed.

When the user needs to perform a multi-screen preview while watching an online video, only the multimedia device 20 needs to send the first multi-screen preview request information to the cloud service device 10, such as the user can move the mouse to a certain point on the playback progress bar to trigger The multimedia device 20 sends the multi-screen preview request information at this point to the cloud service device 10 . In this embodiment, the first multi-screen preview request information includes some parameters required for previewing multiple screens, such as video preview time point, time interval between first multiple preview frames, and number of first multiple preview frames. Generally, the video preview time point refers to the time point on the corresponding playback progress bar moved by the mouse outside the video screen that the user is watching. The time interval between each frame is set, such as 5 seconds, and the number of multiple preview frames is also the number of preview frames desired to be set by the user, such as 7 frames.

In this embodiment, the cloud service device 10 includes a data stream center 100 , an index service unit 102 , a digital signal processing unit 104 and a data transceiving unit 106 . Among them, the data stream center 100 stores the video data stream that the user is watching, which includes many video frames for the user to preview, and each frame has a corresponding playback time point, indicating the time difference between the current frame and the video start time.

The index service unit 102 receives the first multi-screen preview request information from the multimedia device 20, and then calculates the time interval between the first multiple preview frames and the number of the first multiple preview frames in the received information, with the video preview time point as the center point. Multiple preview image time points are respectively relative to multiple offsets of the video preview time point, and in the data flow center 100, according to the position of the preview image corresponding to the video preview time point and the multiple offsets, find out the relationship between the multiple preview images. The locations of the multiple preview images corresponding to the time point, and then obtain the multiple preview images from the data flow center 100 according to the locations of the multiple preview images.

Please refer to FIG. 2 , the following example explains in detail how the index service unit 102 calculates multiple preview screen time points with the video preview time point as the center point respectively relative to the video preview time point according to the received first multi-screen preview request information. Offset.

For example, the video preview time point received by the index service unit 102 is 10 minutes and 30 seconds, and the time interval Δt between multiple frames set by the user interface is 5 seconds, and the number n of previewed frames is 7, so , with the video preview time point as the center point, every 5 seconds is a picture that needs to be previewed, then the index service unit 102 can first calculate the two preview pictures and video The offset between the preview images is △t (that is, 5 seconds) and when the offset between the two preview images farthest from the video preview time point among the multiple preview image time points and the video preview image is ( n-1)*△t/2 (introduce n=7, which is 3△t, which is 15 seconds), and since the time interval between multiple pictures is △t, it can be deduced that at the time point away from the video preview The two preview screens between the nearest and the farthest are 2△t, so the time points of these preview screens can be calculated as 10 minutes and 15 seconds, 10 minutes and 20 seconds, 10 minutes and 25 seconds, 10 minutes and 30 seconds, and 10 minutes and 35 seconds seconds, 10 minutes and 40 seconds and 10 minutes and 45 seconds. After the preview time points of these multiple frames are calculated, the index service unit 102 can find the preview frames corresponding to these multiple preview time points in the data stream center 100 according to these data.

As a further improvement of the present invention, when the user needs to perform a more subtle preview between any two pictures in the preview pictures that have been found, at this time, the user can start by moving the mouse to expand between any two pictures that he wants to preview Moving the preview screen corresponding to the time point to the preview screen corresponding to the unfolding end time point can trigger the multimedia device 20 to send the second multi-screen preview request to the cloud service device 10 . In other implementation manners, the user may also trigger the multimedia device 20 to send the second multi-screen preview request to the cloud service device 10 through other methods, so as to perform a more subtle preview.

In this embodiment, the index service unit 102 in the cloud service device 10 can calculate the start time of expansion according to the received second multi-screen preview request, the expansion start time point, the expansion end time point, and the number of second multi-screen preview screens. Multiple offsets between the time point and the multiple expanded sheet preview time points. Among them, the start time point of expansion refers to the time point corresponding to any two pictures on the left (that is, front) on the video playback progress bar, and the end time point of expansion is the time point corresponding to any two pictures on the right side of the video playback progress bar ( That is, at the time point corresponding to the latter), the second maximum number of preview frames is also the number of frames that the user has already set in the multimedia device 20 according to his own needs and wants to preview further, for example, 6 frames.

Please refer to FIG. 3 , which shows a calculation diagram of an implementation manner of calculating multiple offsets by the cloud service device 10 of the present invention. In this embodiment, the offset refers to the time difference between the expansion start time point and multiple expanded screen preview time points. In this embodiment, the expansion start time point is indicated by t1, the expansion end time point is indicated by t2, and the second number of multiple preview screens is indicated by n1. In this way, it can be deduced that the offset between the two adjacent expanded picture preview time points between the expansion start time point and the expansion end time point is equal to (t2-t1)/(n1-1), that is, the adjacent The time interval between two expanded screen preview time points is equal to (t2-t1)/(n1-1), so that the expansion start time point is taken as the starting point, followed by the time interval (t2-t1)/(n1-1) The time points corresponding to all the preview images between the expansion start time point and the expansion end time point can be released.

For example, assuming that the expansion start time point t1 is 10 minutes and 20 seconds, the expansion end time point t2 is 10 minutes and 25 seconds, and the user's second most preview screen number n1 is 6, in this way, according to the above-mentioned preview closest to the expansion start time point t1 The calculation formula (t2-t1)/(n1-1) of the offset between the screen time point and the unfolding start time point t1 can be calculated as 1 second, and so on, to calculate the corresponding time points of all preview screens They are 10 minutes and 20 seconds, 10 minutes and 21 seconds, 10 minutes and 22 seconds, 10 minutes and 23 seconds, 10 minutes and 24 seconds and 10 minutes and 25 seconds. After finding these time points, the index service unit 102 can find out the preview images corresponding to these time points in the data stream center 100 according to these time points.

Referring to FIG. 4 , it shows a flowchart of an embodiment of a method for the cloud service device 10 of the present invention to provide multi-screen preview during video playback. This method is used in the cloud service device 10 in FIG. 1 and is implemented by the functional modules in FIG. 1 .

Generally, when the user is watching an online video, if he needs to preview the exciting content behind, he can move the time point on the playback progress bar to be previewed by the mouse, and the multimedia device 20 will be triggered to send the desired preview image. The multi-screen preview request is sent to the cloud service device 10, and when the cloud service device 10 receives these multi-screen preview requests, how is it processed? The following is an introduction to how the cloud service device 10 provides multiple preview images that the user needs to preview after receiving the multi-screen preview request.

In step S400, after receiving the first multi-screen preview request information, the index service unit 102 calculates the video preview time point as the center according to the time interval between the first multi-screen preview frames and the first multi-screen preview frame number in the first multi-screen preview request information. The multiple preview image time points of the point are respectively multiple offsets relative to the video preview time point.

In step S402, the indexing service unit 102 finds the positions of multiple preview frames corresponding to multiple preview frame time points according to the positions of the preview frames corresponding to the video preview time points and multiple offsets.

In step S404, the index service unit 102 obtains a plurality of preview images from the data flow center 100 according to the positions of the plurality of preview images.

After the index service unit 102 finds a plurality of preview images in the data stream center 100, in step S406, the digital signal processing unit 104 compresses the plurality of preview images into a single file to reduce file size, reduce packet loss, and improve overall effectiveness.

In step S408, the data transceiving unit 106 transmits the single file to the multimedia device 20 for the multimedia device 20 to decompress the single file into multiple preview frames for multi-screen preview.

Referring to FIG. 5 , it is a flow chart of an embodiment of a method for multi-screen preview in the cloud service system of the present invention during video playback. This method is used in the cloud service device 10 and the multimedia device 20 in FIG. 1 , and is jointly completed by the cloud service device 10 and the multimedia device 20 .

In step S500 , the multimedia device 20 obtains the video preview time point according to the position of the mouse on the playback progress bar, and sends a multi-video screen preview request to the cloud service device 10 . Wherein, the multi-screen preview request information includes the video preview time point, the time interval between multiple preview frames, and the number of multiple preview frames.

Generally, the video preview time point refers to the time point on the corresponding playback progress bar moved by the mouse outside the video screen that the user is watching. The time interval between each picture is set, such as 5 seconds, the number of multiple preview pictures is also the number of preview pictures that the user wants to see, and the total playing time of the video is the duration of the video watched by the user.

In step S502, after receiving the multi-screen preview request, the cloud service device 10 calculates and finds a plurality of preview frames corresponding to the multi-screen preview request.

In step S504, the cloud service device 10 compresses the multiple preview images into a single file.

In step S506, the multimedia device 20 receives the single file transmitted by the cloud service device 10 and decompresses the single file into multiple video images.

In step S508, the multimedia device 20 displays the multiple video frames on the player of the multimedia device to realize the preview of the multiple video frames.

It can be seen from the above examples that the multi-picture preview method provided by the embodiment of the present invention can simultaneously preview multiple preview pictures around the video playback time point, which satisfies the user's demand for simultaneously previewing multiple pictures, and makes users who watch online videos The experience has been greatly improved.

The above is a detailed introduction to the cloud service device provided by the present invention and its method for providing multi-screen preview during video playback and the cloud service system. In this paper, specific embodiments are applied to explain the principle and implementation of the present invention. The above implementation The description of the example is only used to help understand the inventive method and its core idea of the present invention; at the same time, for those of ordinary skill in the art, according to the idea of the present invention, the specific implementation and application range will be changed. In summary As mentioned above, the summary of the present invention should not be construed as limiting the present invention.

Claims (10)

1. a high in the clouds service equipment, comprises Data flow centre, and described Data flow centre stores video preview picture, it is characterized in that, described high in the clouds service equipment also comprises:

Index service unit, for receive after the preview request of picture more than first information according to the preview request of picture more than first information more than first between preview screen the time interval calculate with the number of preview screen more than first a plurality of side-play amounts that a plurality of preview screen time points of putting are distinguished relative described video preview time point centered by video preview time point, and according to the position of preview screen corresponding to described video preview time point and described a plurality of side-play amount, find out the position with the corresponding a plurality of preview screen of described a plurality of preview screen time point in described Data flow centre, and from Data flow centre, obtain a plurality of preview screen according to the position of a plurality of preview screen,

Digital signal processing unit, for being compressed into single archives by described a plurality of preview screen; And

Data transmit-receive unit, for receiving described single archives and being sent to multimedia equipment, becomes described a plurality of preview screen to carry out the preview of many pictures for the single archives of described multimedia equipment decompress(ion).

2. high in the clouds as claimed in claim 1 service equipment, it is characterized in that, if represent described time interval between preview screen more than first with △ t, with n, represent the described number of preview screen more than first, in described a plurality of preview screen time point, from the side-play amount between two nearest preview screen of described video preview time point preview screen corresponding with described video preview time point, be △ t, in described a plurality of preview screen time point, from the side-play amount between described video preview time point two preview screen farthest preview screen corresponding with described video preview time point, be (n-1) * △ t/2.

3. high in the clouds as claimed in claim 1 service equipment, it is characterized in that, described index service unit is also for receiving the preview request of picture more than second and launching time started point, launch a plurality of side-play amounts between end time point and the described expansion of the number of preview screen more than second calculating time started point and a plurality of expansion picture preview time point according to the described preview request of picture more than second, wherein, described a plurality of expansion picture preview time point is the time point between described expansion time started point and described expansion end time point.

4. high in the clouds as claimed in claim 3 service equipment, it is characterized in that, if represent described expansion time started point with t1, with t2, represent described expansion end time point, with n1, represent the described number of preview screen more than second, between described expansion time started point and described expansion end time point, the side-play amounts between adjacent two expansion picture preview time points equal (t2-t1)/(n1-1).

5. when high in the clouds service equipment provides video playback, a method for many pictures preview, is characterized in that, comprising:

After reception picture more than first preview request information, according to a plurality of preview screen time points that more than first, between preview screen, the time interval puts centered by video preview time point with the calculating of the number of preview screen more than first in the preview request of picture more than first information, distinguish a plurality of side-play amounts of relative described video preview time point;

According to the position of preview screen corresponding to described video preview time point and described a plurality of side-play amount, find out the position with the corresponding a plurality of preview screen of described a plurality of preview screen time point;

According to the position of a plurality of preview screen, from Data flow centre, obtain a plurality of preview screen;

Described a plurality of preview screen are compressed into single archives; And

Transmit described single archives to multimedia equipment, for the single archives of described multimedia equipment decompress(ion), become described a plurality of preview screen to carry out the preview of many pictures.

6. the method for many pictures preview when high in the clouds as claimed in claim 5 service equipment provides video playback, it is characterized in that, a plurality of preview screen time points of putting centered by video preview time point described in calculating the respectively method of a plurality of side-play amounts of relatively described video preview time point comprise:

If represent described time interval between preview screen more than first with △ t, with n, represent the described number of preview screen more than first, in described a plurality of preview screen time point, from two nearest corresponding preview screen of preview time point of described video preview time point and the side-play amount between described video preview picture, being △ t, is (n-1) * △ t/2 from described video preview time point two corresponding preview screen of preview time point and the side-play amount between described video preview picture farthest in described a plurality of preview screen time points.

7. when high in the clouds as claimed in claim 5 service equipment provides video playback, the method for many pictures preview, is characterized in that, described method also comprises:

Receive the preview request of picture more than second and calculate a plurality of side-play amounts between described expansion time started point and a plurality of expansion picture preview time point according to launching time started point, expansion end time point and the number of preview screen more than second in the described preview request of picture more than second, wherein, described a plurality of expansion picture preview time point is the time point between described expansion time started point and described expansion end time point.

8. when high in the clouds as claimed in claim 7 service equipment provides video playback, the method for many pictures preview, is characterized in that, the method for calculating a plurality of side-play amounts between described expansion time started point and other a plurality of picture preview time points comprises:

If represent described expansion time started point with t1, with t2, represent described expansion end time point, with n1, represent the described number of preview screen more than second, between described expansion time started point and described expansion end time point, the side-play amounts between adjacent two expansion picture preview time points equal (t2-t1)/(n1-1).

9. a cloud service system, is characterized in that, comprising:

High in the clouds service equipment as described in claim 1-4 any one; And

Multimedia equipment, be used for sending the described preview request of picture more than first information to described high in the clouds service equipment, receive the single archives that store described many pictures that described high in the clouds service equipment transmits, described in decompress(ion), single archives become multiple video pictures, and described multiple video pictures is presented in described multimedia equipment player, to realize multiple video pictures preview.

10. cloud service system as claimed in claim 9, it is characterized in that, described multimedia equipment is also for sending the preview request of picture more than second information to described high in the clouds service equipment, receive the single archives that store described many pictures that described high in the clouds service equipment transmits, described in decompress(ion), single archives become multiple video pictures, and described multiple video pictures is presented in described multimedia equipment player, to realize multiple video pictures preview.