CN106331747A - Method and device for video optimization - Google Patents

Abstract

The embodiment of the present invention discloses a video optimization method and device. The method in the embodiment of the present invention includes: receiving a video play request from a terminal, and the video play request includes the address of the video file; according to the address of the video file, sending to the The content providing device sends the video play request; receives the video play response sent by the content providing device, and the video play response includes the video file; obtains the feature value of the video file according to a predefined rule; determines the The characteristic value of the video file is in the abnormal information table, and the video file is sent to the terminal, wherein the abnormal information table records the characteristic value of the video file that cannot be optimized for video. The present invention can improve user experience.

Description

Method and device for video optimization

technical field

The invention relates to the field of video processing, in particular to a video optimization method and device.

Background technique

In video services, a Service Provider (SP) is usually a provider of video content. Terminal users can obtain the video content provided by the service provider through the network. Due to the different processing capabilities of the terminals, the network bandwidth conditions where the terminals are located Different, the requirements of end users, and the requirements for the quality of video content provided by SP are also different. At present, in order to adapt to different network bandwidths, different terminal processing capabilities and different user needs, so as to obtain better user experience, a video optimization (Video Optimization, VO) technology has been developed. Convert the bit rate or encoding format of the original video file to meet various needs, reduce video traffic, and obtain the best bit rate and frame rate. At present, it is mainly used in the scene of watching videos on mobile networks.

At present, there is no uniform standard for video formats on the mobile Internet. In terms of packaging formats, there are Motion Picture Experts Group-4 part 14 (MP4), TS, and WebM (proposed by Google, which is a Open, free media file format), flash video (FlashVideo, FLV) and other formats, in terms of video encoding format, there are H.264, VP8 (an open video compression standard), VP9 (upgraded version of VP8) Wait. And even if it is also encapsulated in MP4 format, because the specific implementations of different SPs are different, it is difficult to ensure that all videos on the Internet can be properly transcoded and optimized for VO transcoding optimization.

At present, in the existing technology, when a video VO cannot be pre-judged whether it can be processed normally and an abnormality occurs in the processing process, it will cause the video to be unable to be viewed normally by the end user, which may eventually lead to user complaints. , which degrades the end-user experience.

Contents of the invention

Embodiments of the present invention provide a video optimization method and device to improve terminal user experience.

The first aspect of the embodiment of the present invention provides a video optimization method, including:

Receiving a video playback request from the terminal, the video playback request includes the address of the video file;

sending the video playback request to the content providing device according to the address of the video file;

receiving a video playback response sent by the content providing device, where the video playback response includes a video file;

Acquiring feature values of the video file according to predefined rules;

It is determined that the characteristic value of the video file is in the abnormal information table, and the video file is sent to the terminal, wherein the abnormal information table records the characteristic value of the video file that cannot be optimized for video.

With reference to the first aspect of the embodiments of the present invention, in the first possible implementation manner of the first aspect of the embodiments of the present invention, acquiring the feature values of the video file according to predefined rules specifically includes: according to the The address key field of the video file obtains the characteristic value, or obtains the special value according to the content of the video file.

With reference to the first aspect of the embodiments of the present invention, the second possible implementation manner of the first aspect of the embodiments of the present invention further includes:

Determine that the feature value of the video file is not in the exception information table;

Perform video optimization processing on the video file according to the video optimization strategy;

After the video optimization processing is successful, the optimized video file is sent to the terminal.

With reference to the second possible implementation manner of the first aspect of the embodiments of the present invention, the third possible implementation manner of the first aspect of the embodiments of the present invention further includes:

An exception occurs when performing video optimization processing on a video file, adding the feature value of the video file to the exception information table, and stopping sending the video file to the terminal.

With reference to the second possible implementation manner of the first aspect of the embodiments of the present invention, the fourth possible implementation manner of the first aspect of the embodiments of the present invention further includes:

According to the video optimization strategy, performing video optimization processing on the video file, specifically includes:

Perform video optimization processing on the video file according to the current network bandwidth of the terminal or the resolution of the terminal screen.

The second aspect of the embodiment of the present invention provides a video optimization device, including:

The request receiving module is used to receive the video playback request of the terminal, and the video playback request includes the address of the video file;

A request sending module, configured to send the video playback request to the content providing device according to the address of the video file;

A response receiving module, configured to receive a video playback response sent by the content providing device, where the video playback response includes a video file;

A feature value acquisition module, configured to acquire feature values of the video file according to predefined rules;

The abnormal confirmation module is used to determine that the feature value of the video file is in the abnormal information table, and send the video file to the terminal, wherein the abnormal information table records the feature value of the video file that cannot be optimized for video.

With reference to the second aspect of the embodiments of the present invention, in a first possible implementation manner of the second aspect of the embodiments of the present invention,

The characteristic value obtaining module is specifically configured to obtain a characteristic value according to the address key field of the video file, or obtain a special value according to the content of the video file.

With reference to the second aspect of the embodiments of the present invention, in a second possible implementation manner of the second aspect of the embodiments of the present invention, it further includes:

A conventional confirmation module, configured to determine that the feature value of the video file is not in the exception information table;

An optimization module, configured to perform video optimization processing on the video file according to a video optimization strategy;

The video sending module is configured to send the optimized video file to the terminal after the video optimization processing is successful.

In combination with the second possible implementation manner of the second aspect of the embodiments of the present invention, the third possible implementation manner of the second aspect of the embodiments of the present invention further includes:

The exception processing module is configured to generate an exception when performing video optimization processing on the video file, add the feature value of the video file to the exception information table, and stop sending the video file to the terminal.

With reference to the second possible implementation manner of the second aspect of the embodiment of the present invention, in the fourth possible implementation manner of the second aspect of the embodiment of the present invention,

The optimization module is specifically configured to perform video optimization processing on the video file according to the network bandwidth of the current terminal or the resolution of the terminal screen.

It can be seen from the above technical solutions that the embodiments of the present invention have the following advantages:

In the embodiment of the present invention, an exception information table is set in the video optimization device through online video optimization fault self-learning. This exception information table records the feature values of video files that cannot be optimized for video. Obtain the unique feature value of the video file from the video file obtained in the device, and then confirm whether the feature value is recorded in the exception information table. If the feature value already exists in the exception information table, it is considered that the video file cannot be processed. Video optimization, so the video optimization device directly releases the video file without affecting the viewing experience of the end user. Improved user experience.

Description of drawings

Fig. 1 is a schematic diagram of the environment in which the video optimization method of the present invention operates;

Fig. 2 is a schematic flow chart of a video optimization method in an embodiment of the present invention;

FIG. 3 is a schematic flowchart of another video optimization method in an embodiment of the present invention;

FIG. 4 is a schematic structural diagram of a video optimization device in an embodiment of the present invention;

Fig. 5 is a schematic structural diagram of another video optimization device in an embodiment of the present invention.

detailed description

In order to enable those skilled in the art to better understand the solutions of the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only It is an embodiment of a part of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present invention.

The terms "comprising" and "having" in the description and claims of the present invention and the above drawings, as well as any variations thereof, are intended to cover non-exclusive inclusion, for example, processes, methods, A system, product or device is not necessarily limited to those steps or elements explicitly listed, but may include other steps or elements not explicitly listed or inherent to the process, method, product or device.

As shown in Figure 1, the running environment of a video optimization method provided by the present invention includes:

Mobile terminal 11, base station 12, gateway GPRS support node (gateway GPRS supportnode, GGSN) 13, video optimization equipment 14, Internet 15 and a plurality of SP16, wherein, mobile terminal 11 accesses in the Internet 15 through the wireless network of base station 12, And connect to a plurality of SP16 through Internet 15, and obtain the video content that needs from a plurality of SP16, also connect GGSN13 and video optimization equipment 15 between base station 12 and Internet 15, video optimization equipment 15 is aimed at mobile terminal 11 all visits According to certain video optimization strategies, the online video optimization operation is started according to certain video optimization strategies for HTTP streams accessing video content. The optimization operation includes converting video codec format, bit rate, frame rate, etc., and optimizing the optimized The video content is sent to the mobile terminal 11 through the GGSN13 and the base station 12 . The specific video optimization strategy may be the network condition of the mobile terminal, the terminal capability and the user's choice, etc. Figure 1 shows a mobile terminal, but in fact, it is also possible if it is a fixed terminal, such as a computer.

The following introduces the embodiments of the video optimization method of the present invention, specifically including:

Step 201: receiving a video play request from the terminal, the video play request includes the address of the video file;

Step 202: Send the video playback request to the content providing device according to the address of the video file;

Step 203: Receive a video play response sent by the content providing device, where the video play response includes a video file;

Step 204: Obtain the feature value of the video file according to a predefined rule;

Step 205: Determine that the feature value of the video file is in the exception information table, and send the video file to the terminal, wherein the exception information table records the feature value of the video file that cannot be optimized for video.

Further, acquiring the feature value of the video file according to a predefined rule specifically includes: acquiring the feature value according to the address key field of the video file, or acquiring the special value according to the content of the video file.

The above method further includes: determining that the feature value of the video file is not in the exception information table, and performing video optimization processing on the video file according to the video optimization strategy; after the video optimization processing is successful, sending the optimized video file to the terminal.

The above method further includes: generating an exception when performing video optimization processing on the video file, adding the feature value of the video file to the exception information table, and stopping sending the video file to the terminal.

The above method further includes: performing video optimization processing on the video file according to the video optimization policy, specifically including: performing video optimization processing on the video file according to the current terminal network bandwidth or the resolution of the terminal screen.

In the embodiment of the present invention, an exception information table is set in the video optimization device through online video optimization fault self-learning. This exception information table records the feature values of video files that cannot be optimized for video. Obtain the unique feature value of the video file from the video file obtained in the device, and then confirm whether the feature value is recorded in the exception information table. If the feature value already exists in the exception information table, it is considered that the video file cannot be processed. Video optimization, so the video optimization device directly releases the video file without affecting the viewing experience of the end user. Improved user experience.

The following introduces the embodiments of the video optimization method in the embodiments of the present invention, and the embodiments of the user video optimization method of the present invention are applied in the operating environment of video optimization.

Step 301: The mobile terminal sends a video play request to the content providing device of the SP, and the video play request includes a uniform resource locator (Uniform ResourceLocator, URL) of a specified video content, and the video play request passes through multiple networks in the wireless network. Meta is sent to the video optimization device.

Step 302: the video optimization device receives the above video play request, and sends the video play request to the content providing device of the corresponding SP.

Step 303: The content providing device of the SP receives the above-mentioned video playback request, obtains the video file corresponding to the URL, and sends a video playback response containing the video file to the mobile terminal. The video playback response can specifically be a response message, in the message The body (body) carries the video file, and the response message is sent to the video optimization device via the Internet.

Step 304: the video optimization device receives the response message returned by the content providing device from the SP, and the response message includes the video file.

Step 305: The video optimization device obtains the unique feature value of the video file according to the predefined rules, and the feature value can uniquely identify the video file.

Specifically, there are the following two predefined rules for feature value acquisition:

1. Obtain the feature value according to the URL key field of the video file, but this method will be limited by the SP. When the URL definition rules of the SP change, the feature value acquisition method needs to be updated synchronously.

例如：对于某一SP的某个视频资源的URL为： http://119.147.97.13/youku/6775432A73E3681FB986A3596C/03002001005232C 2FF32D405CF07DDC3F94277-252A-DD76-DD74-80.mp4 ，其中03002001005232C2FF32D405CF07DDC3F94277-252A-DD76-DD74-80 It is a fixed part, which can uniquely identify the video file on the SP. However, this method is limited by the SP, and when the rules defined by the SP for the URL change, the feature value extraction method needs to be updated synchronously. When applying this rule, the video optimization device needs to obtain the setting rules of each SP for the video URL from each SP, and obtain the part that can fixedly represent the video file, so that the video optimization device can use the same SP next time. The feature values of each video file are obtained.

2. Extract the feature value according to the content of the video file. For example, the video optimization device uses message digest algorithm version 5 (message digest algorithm 5, MD5) to calculate the first 32K bytes of the video file, and the obtained data value is the The feature value of the video file. This method is not limited to SP, but it will consume a certain amount of additional computing resources.

Step 306: The video optimization device determines whether the feature value of the video file generated above is in the exception information table. If the feature value of the video file generated above is in the exception information table, it indicates that the video file cannot be successfully optimized for online transcoding. Video optimization The device releases the video file and does not perform video optimization on the video file, that is, directly transmits the video file to the mobile terminal. If the feature value of the video file generated above is not in the exception information table, it indicates that the video file may be optimized for online transcoding at present, and step 307 is continued.

An exception information table is stored in the video optimization device, and the exception information table includes the feature values of video files that have been optimized by each video optimization device and the optimization processing is unsuccessful, so that if a certain video file is determined for the first time When the video optimization process cannot be performed, then when the video file is requested to play again, the video optimization device can determine that the video file cannot be optimized online according to the feature value of the video file in the exception information table, and then directly The video file is released, which improves the efficiency of video optimization, saves the resources of the video optimization device and reduces the waiting time for the mobile terminal to receive the video file.

The exception information table can also record which SP the video file corresponding to the feature value comes from, so that after a certain period of time, the video optimization device can perform statistics on the SPs in the exception information table, and for one or more SPs with the most in the statistical results , that is, there may be problems with the video files of one or more SPs themselves, and maintenance personnel or video optimization equipment can respond to the corresponding SPs.

Step 307: The video optimization device performs online video optimization processing on the video file according to the optimization strategy. If the online video optimization is successful, the optimized video file is sent to the mobile terminal. If there is an exception in the online video optimization, that is, the online video optimization fails. If it succeeds, the feature value of the video file will be added to the exception information table, so that the subsequent video optimization device will not optimize the video file, and this video viewing will be interrupted, that is to say, the video optimization device will stop sending data to the terminal. Send the above video file.

The optimization strategies here can be in the following categories: transcoding and adapting the resolution of the video file according to the user’s terminal screen resolution, or dynamically adjusting the code rate of the video file according to the user’s current effective access bandwidth, etc. . When the optimization strategy is specifically to optimize according to the resolution of the user's terminal screen, the video playback request in step 301 also includes the resolution of the user's terminal screen, and the video optimization device determines the resolution of the terminal screen according to the video playback request. Optimize video files. When the optimization strategy is specifically to dynamically adjust the code rate of the video file by transcoding the current effective access bandwidth, the video optimization device also needs to obtain the size of the current effective access bandwidth of the terminal. After entering the size of the bandwidth, the video optimization device performs video optimization according to the obtained value.

Video optimization specifically includes: adjusting video encoding format, resolution, frame rate or bit rate.

In the embodiment of the present invention, through online video optimization fault self-learning, the videos that have failed to be transcoded and optimized are released, without affecting the viewing experience of the end user. When the VO device of some video files cannot be successfully optimized for online transcoding, it will only affect the first viewing of the video, and subsequent viewing will not be affected.

The following describes the embodiment of the video optimization device in the embodiment of the present invention, please refer to Figure 4, including:

Request receiving module 41, is used for receiving the video play request of terminal, and this video play request has included the address of video file;

A request sending module 42, configured to send the video playback request to the content providing device according to the address of the video file;

A response receiving module 43, configured to receive a video play response sent by the content providing device, the video play response includes a video file;

Feature value obtaining module 44, is used for according to predefined rule, obtains the feature value of described video file;

The abnormal confirmation module 45 is configured to determine that the characteristic value of the video file is in the abnormal information table, and send the video file to the terminal, wherein the abnormal information table records the characteristic value of the video file that cannot be optimized for video.

Further, the above-mentioned characteristic value obtaining module 44 is specifically configured to obtain a characteristic value according to the address key field of the video file, or obtain a special value according to the content of the video file.

Further, as shown in Figure 5, the video optimization device also includes:

The conventional confirmation module 46 is used to determine that the feature value of the video file is not in the abnormal information table;

An optimization module 47, configured to perform video optimization processing on the video file according to the video optimization strategy;

The video sending module 48 is configured to send the optimized video file to the terminal after the video optimization processing is successful.

Further, as shown in FIG. 5 , the video optimization device further includes: an exception processing module 49, configured to generate an exception when performing video optimization processing on a video file, and add the feature value of the video file to the exception information table, And stop sending the video file to the terminal.

Further, as shown in FIG. 5 , the optimization module 47 is specifically configured to base on the network bandwidth of the current terminal or the resolution of the terminal screen.

The following describes the embodiment of the electronic device in the embodiment of the present invention, and the present invention is an embodiment of the electronic device in the embodiment including:

one or more processors;

memory;

and one or more programs;

Wherein, the memory stores an exception information table and the one or more programs; the one or more programs are stored in the memory and configured to be executed by the one or more processors, the The one or more programs include instructions for:

Receiving a video playback request from the terminal, the video playback request includes the address of the video file;

sending the video playback request to the content providing device according to the address of the video file;

receiving a video playback response sent by the content providing device, where the video playback response includes a video file;

Acquiring feature values of the video file according to predefined rules;

It is determined that the characteristic value of the video file is in the abnormal information table, and the video file is sent to the terminal, wherein the abnormal information table records the characteristic value of the video file that cannot be optimized for video.

For other steps or further refinement steps completed by the instruction, refer to the steps in the method for calculating the user social feature above, which will not be repeated here.

An embodiment of the present invention also provides a computer storage medium, wherein the computer storage medium can store a program, and the program includes at least some or all of the steps of the method for calculating the user's social feature described in the above method embodiments when executed.

In the foregoing embodiments, the descriptions of each embodiment have their own emphases, and for parts not described in detail in a certain embodiment, reference may be made to relevant descriptions of other embodiments.

Those skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the above-described system, device and unit can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed system, device and method can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or May be integrated into another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.

If the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such an understanding, the essence of the technical solution of the present invention or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , including several instructions to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk, and other media that can store program codes.

As mentioned above, the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still understand the foregoing The technical solutions recorded in each embodiment are modified, or some of the technical features are replaced equivalently; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims (10)

1. A method for video optimization, comprising: Receiving a video playback request from the terminal, the video playback request includes the address of the video file; sending the video playback request to the content providing device according to the address of the video file; receiving a video playback response sent by the content providing device, where the video playback response includes a video file; Acquiring feature values of the video file according to predefined rules; It is determined that the characteristic value of the video file is in the abnormal information table, and the video file is sent to the terminal, wherein the abnormal information table records the characteristic value of the video file that cannot be optimized for video. 2. The method for video optimization according to claim 1, wherein said obtaining the feature value of said video file according to a predefined rule specifically comprises: The characteristic value is obtained according to the address key field of the video file, or the special value is obtained according to the content of the video file. 3. The method for video optimization according to claim 1, further comprising: Determine that the feature value of the video file is not in the exception information table; Perform video optimization processing on the video file according to the video optimization strategy; After the video optimization processing is successful, the optimized video file is sent to the terminal. 4. the method for video optimization as claimed in claim 3, is characterized in that, also comprises: when carrying out video optimization process to video file, produce exception, add the feature value of described video file to described exception information table, and stop adding to The terminal sends the video file. 5. The method for video optimization according to claim 3, wherein said video optimization process is performed on said video file according to the video optimization strategy, specifically comprising: Perform video optimization processing on the video file according to the current network bandwidth of the terminal or the resolution of the terminal screen. 6. A video optimization device, characterized in that, comprising: The request receiving module is used to receive the video playback request of the terminal, and the video playback request includes the address of the video file; A request sending module, configured to send the video playback request to the content providing device according to the address of the video file; A response receiving module, configured to receive a video playback response sent by the content providing device, where the video playback response includes a video file; A feature value acquisition module, configured to acquire feature values of the video file according to predefined rules; The abnormal confirmation module is configured to determine that the characteristic value of the video file is in the abnormal information table, and send the video file to the terminal, wherein the abnormal information table records the characteristic value of the video file that cannot be optimized for video. 7. The video optimization device according to claim 6, wherein the characteristic value obtaining module is specifically configured to obtain the characteristic value according to the address key field of the video file, or obtain the special value according to the content of the video file. 8. The video optimization device according to claim 6, further comprising: A conventional confirmation module, configured to determine that the feature value of the video file is not in the exception information table; An optimization module, configured to perform video optimization processing on the video file according to a video optimization strategy; The video sending module is configured to send the optimized video file to the terminal after the video optimization processing is successful. 9. The video optimization device according to claim 8, further comprising: an exception processing module, configured to generate an exception when performing video optimization processing on a video file, and add the feature value of the video file to the exception information table, and stop sending the video file to the terminal. 10. The video optimization device according to claim 8, wherein the optimization module is specifically configured to perform video optimization processing on the video file according to the network bandwidth of the current terminal or the resolution of the terminal screen.