CN111567044A - Video processing method and device, coding equipment and decoding equipment - Google Patents

Abstract

A video processing method, a device, an encoding device and a decoding device, wherein the method can comprise the following steps: determining the video type of the obtained video to be processed; if the video type of the video to be processed is a preset video type, modifying each pixel precision value in the initial pixel precision set to obtain a target pixel precision set; and coding the video to be processed based on the target pixel precision set to obtain a coded video. The embodiment of the invention can improve the coding performance of the terminal equipment.

Description

A video processing method, device, encoding device and decoding device

technical field

The present invention relates to the field of communication technologies, and in particular, to a video processing method, an apparatus, an encoding device and a decoding device.

Background technique

With the continuous development of the information age, in daily life, more and more users will record or store certain content by shooting videos with cameras or video cameras. Or when transmitting a video, the video content needs to be encoded, and then the encoded video is stored or transmitted. When the video needs to be displayed, the encoded video is decoded and displayed by a decoding method corresponding to the encoding process.

In the process of encoding video, one of the key technologies is inter-frame prediction. The main idea of inter-frame prediction is to obtain the predicted frame from the motion vector of the current frame in the video and the reference frame. In this process, the selection of the pixel precision of the motion vector is directly related to the quality of the inter-frame prediction, which in turn affects the video coding quality. Therefore, in the field of digital video coding technology, how to choose the pixel precision in the coding process has become a hot issue in current research.

SUMMARY OF THE INVENTION

Embodiments of the present invention provide a video processing method, apparatus, encoding device, and decoding device, which can improve the encoding performance of the terminal device.

In a first aspect, an embodiment of the present invention provides a video processing method, including:

Determine the video type of the obtained video to be processed;

If the video type of the video to be processed is a preset video type, then modifying each pixel precision value in the initial pixel precision set to obtain a target pixel precision set;

The to-be-processed video is encoded based on the target pixel precision set to obtain an encoded video.

In a second aspect, an embodiment of the present invention provides another video processing method, including:

receive encoded video;

When the encoded video includes identification information, determine that the video type corresponding to the encoded video is a preset video type;

decoding the encoded video based on the target pixel precision set;

The target pixel precision set is obtained by modifying each pixel precision value in the initial pixel precision set.

In a third aspect, an embodiment of the present invention provides a video processing apparatus, including a determination unit and a processing unit:

A determination unit for determining the video type of the acquired video to be processed;

a processing unit, configured to modify each pixel precision value in the initial pixel precision set to obtain a target pixel precision set if the determining unit determines that the video type of the video to be processed is a preset video type;

The processing unit is further configured to perform encoding processing on the to-be-processed video based on the target pixel precision set to obtain an encoded video.

In a fourth aspect, an embodiment of the present invention further provides another video processing apparatus, including a receiving unit and a processing unit:

a receiving unit for receiving the encoded video;

a processing unit, configured to determine that the video type corresponding to the encoded video is a preset video type when the encoded video includes identification information;

The processing unit is further configured to perform decoding processing on the encoded video based on the target pixel precision set;

The target pixel precision set is obtained by modifying each pixel precision value in the initial pixel precision set.

In a fifth aspect, an embodiment of the present invention provides an encoding device, characterized in that it includes a memory and a processor, the memory is connected to the processor, and the memory is used to store a computer program, and the computer program includes Program instructions, the processor is configured to invoke the program instructions to execute the video processing method of the first aspect.

In a sixth aspect, an embodiment of the present invention provides a decoding device, characterized in that it includes a memory and a processor, the memory is connected to the processor, and the memory is used to store a computer program, and the computer program includes Program instructions, the processor is configured to invoke the program instructions to execute the video processing method of the second aspect.

In a seventh aspect, an embodiment of the present invention further provides a computer storage medium, where first computer program instructions are stored in the computer storage medium, and when the first computer program instructions are executed by a processor, are used to execute the first aspect The video processing method of the second aspect is further stored in the computer storage medium, and the second computer program instructions are used to execute the video processing method of the second aspect when executed by the processor.

In this embodiment of the present invention, the terminal device judges the acquired video type of the video to be processed, and if the video type of the video to be processed is a preset video type, increases each pixel precision value in the initial pixel precision set to obtain a target pixel precision set, and further, perform encoding processing on the video to be processed based on the target pixel precision set to obtain an encoded video. In the above process of encoding the video to be processed, the target pixel precision set used in the encoding process is determined according to the video type of the video to be processed, so as to achieve targeted selection of the target pixel precision set for the to-be-processed videos of different video types, thereby. Improves the quality of encoded video.

Description of drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the accompanying drawings required in the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some of the present invention. In the embodiments, for those of ordinary skill in the art, other drawings can also be obtained according to these drawings without any creative effort.

1 is a scene diagram of a drone aerial photography provided by an embodiment of the present invention;

FIG. 2a is a schematic diagram of motion estimation according to an embodiment of the present invention;

2b is a schematic diagram of determining a motion vector according to an embodiment of the present invention;

3a is a schematic diagram of another motion estimation provided by an embodiment of the present invention;

3b is a schematic diagram of still another motion estimation provided by an embodiment of the present invention;

4 is a schematic flowchart of a video processing method according to an embodiment of the present invention;

5 is a schematic diagram of an encoding system according to an embodiment of the present invention;

FIG. 6 is an interaction diagram provided by an embodiment of the present invention;

7 is a schematic structural diagram of an encoding device according to an embodiment of the present invention;

FIG. 8 is a schematic structural diagram of a decoding device according to an embodiment of the present invention.

Detailed ways

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

Aiming at the problem of pixel precision selection in video coding, the embodiment of the present invention proposes a video processing method. The method can set a set of pixel precisions for coding processing in a targeted manner according to the video type of the video to be processed, which can improve video coding. performance. Specifically, the video processing method provided by the embodiment of the present invention may include: determining the acquired video type of the video to be processed; if the video type of the to-be-processed video is a preset video type, The precision value is modified to obtain a target pixel precision set; the to-be-processed video is encoded based on the target pixel precision set to obtain an encoded video. In the above process of encoding the video to be processed, according to the video type of the video to be processed, the initial pixel precision set is modified accordingly, so as to obtain a pixel precision set suitable for the video to be processed, and a targeted The target pixel precision set is selected for the to-be-processed videos of different video types, so that the quality of the encoded video can be improved.

The video processing method provided by the embodiment of the present invention can be applied to various application scenarios of video encoding and transmission. The video processing method is specifically described below by taking the application scenario of drone aerial photography as an example. Referring to FIG. 1 , which is a scene diagram of a drone aerial photography provided by an embodiment of the present invention, it is assumed that FIG. 1 includes a drone 101 , a camera area 102 , and a display device 103 . A camera device 1011 is mounted on the drone 101, and the camera device can be used to shoot videos and images, and the drone 101 can also be equipped with a pan-tilt 1012, and the camera device 1011 can be used to capture video through the cloud. The station 1012 is mounted on the drone 101 . The imaging area 102 includes vehicles, trees and rivers, and the imaging device 1011 photographs the imaging area 102 to obtain a video to be processed.

The initial pixel precision set may be set by default in the drone 101. Each pixel precision in the initial pixel precision set may not be applicable to all video types. Therefore, after obtaining the video to be processed, the drone 101 does not directly use it. The initial pixel precision set performs encoding processing on the to-be-processed video, but determines the video type of the to-be-processed video, and further determines whether the video type to which the to-be-processed video belongs is suitable for encoding using the initial pixel precision set. If it is determined that the video type to which the to-be-processed video belongs can be encoded using the initial pixel precision set, the to-be-processed video is encoded based on the initial pixel precision set; if it is determined that the video to which the to-be-processed video belongs If the type is not suitable for using the initial pixel precision set, then modify each pixel precision value included in the initial pixel precision set, so that each modified pixel precision value is suitable for the video type to which the video to be processed belongs. The precision values make up the target pixel precision set. Next, the UAV 101 encodes the video to be processed based on the target pixel precision set.

Optionally, the UAV 101 sends the encoded video obtained by encoding the video to be processed to the decoding end. The decoding end described here may be configured in the UAV 101, or may be independent of the UAV. Decoding device, the decoding end uses a corresponding decoding strategy to decode the encoded video, and finally sends the decoded video to the display device 103. The display device 101 can be an encoding device with a display screen. After receiving the decoded video sent by the decoding end When the video is decoded, the decoded video can be displayed on the display screen so that the user can watch the video.

In one embodiment, video refers to various technologies for capturing, recording, processing, storing, transmitting and reproducing a series of static images in the form of electrical signals, and in the original video obtained by shooting devices such as cameras or camcorders It contains a lot of redundant information, so the amount of uncompressed video data is very large, it is difficult to store, and it is also inconvenient to transmit in the network. For example, the data volume of one second of digital TV video is about 1113KB. If it is assumed that the transmission bandwidth is 1M and the bit rate is 9123840, it takes 9 seconds to transmit one second of digital TV video, that is, the user wants to watch one second The clock's digital TV video needs to wait until 9 seconds, which greatly reduces the user experience. For another example, the data volume of an uncompressed 10-second video is about 2.4G. Suppose a mobile phone with a memory of 16G, after removing the part occupied by the system, the remaining storage space is at most 12G, which can only store at most 50 seconds. video.

Therefore, in order to solve the problems of difficult video storage and transmission, it is necessary to compress the original video. The so-called compressing the original video is to remove a large amount of redundant information contained in the original video, such as temporal redundancy, visual redundancy, and spatial redundancy. The process of encoding video. In this embodiment of the present invention, the video to be processed is the original video, and one of the key technologies in the video coding process is inter-frame prediction, which utilizes the temporal correlation between adjacent video frames. , using the previously encoded reconstructed frame as a reference frame, and predicting the current frame by means of motion estimation and motion compensation, so as to remove the temporal redundancy information of the video. To put it simply, the theoretical basis of inter-frame prediction is that there is a certain correlation between the scenes in the adjacent frames of the moving image. It is not necessary to transmit all the information of each frame during encoding, but only the difference between frames. That's it.

Video can be regarded as being composed of multiple frames of images, and encoding the video refers to encoding each frame of image included in the video. In one embodiment, when encoding any frame image in the video, the frame image is firstly divided into multiple coding regions, and each coding region is further divided into multiple coding units, and each coding unit includes multiple coding units. coding blocks, and performing inter-frame prediction on each coding block in turn. The following takes the target coding block in a certain coding unit of the current frame as an example to introduce the process of inter-frame prediction: find the reference frame corresponding to the current frame in the time domain, and the reference frame is an encoded frame near the current frame in the time domain Any frame in the frame; search for similar blocks similar to the target coding block in the reference frame, and determine the relative position between the target coding block and the similar block (as shown in Figure 2a and Figure 2b), the relative position is called Motion vector (Motion Vector, MV) (for the convenience of description, the process of determining the motion vector is called motion estimation hereinafter); according to the motion vector, as well as the related information of the motion vector and the reference frame, the prediction block corresponding to the target coding block is obtained. A prediction block corresponding to each coding block of the current frame can be obtained through a similar process, so that the predicted frame of the current frame can be obtained.

In one embodiment, the above-mentioned related information of the motion vector includes the pixel precision used in the motion estimation process (which can also be understood as the pixel precision of the motion vector), the motion vector difference (Motion vector difference, MVD), and the like. The MVD refers to the difference between the motion vector obtained through the motion estimation process and the predicted motion vector (motion vector prediction, MVP), where the MVP uses multiple MVs between multiple adjacent coded blocks and the current coded block calculated. The larger the pixel precision value, the lower the accuracy of the pixel precision, the lower the motion estimation accuracy, the smaller the pixel precision value, the higher the pixel precision accuracy, the higher the motion estimation accuracy. For example, referring to FIG. 3a and FIG. 3b are schematic diagrams of two kinds of motion estimation provided by the embodiments of the present invention. In the above two figures, black dots represent whole pixels, white dots represent 1/2 pixels, and it is assumed that 301 represents the current A target coded block in the frame, 302 represents a similar block in the reference frame. Assuming that the pixel precision used in FIG. 3a is integer pixel precision, arrow 303 represents the motion vector corresponding to the target coding block, that is, the position difference of the target coding block in the previous frame image and the current frame image. Assuming that the pixel precision used in Figure 3b is 1/2 pixel precision, 304 represents the motion vector corresponding to the target coding block. From the comparison of Figure 3a and Figure 3b, it can be seen that the motion vector represented by 304 is more accurate than the motion vector represented by 303.

Considering that the human visual system is not sensitive to some details, some motion details in a video may be encoded with low pixel precision, and some motion details need to be encoded with high pixel precision. Based on this situation , in order to improve the quality of inter-frame prediction, the coding device can use the Adaptive Motion Vector Resolution (AMVR) technology to determine the pixel accuracy of the motion vector used in the inter-frame prediction process. It can be seen from the above description that the AMVR technology essentially determines is the pixel precision of the MVD. In one embodiment, the main principle of the AMVR technology is: the encoding device may set a pixel precision set, and the pixel precision set may include at least two pixel precisions, and the encoding process is performed on a certain coding unit of a certain video. , the corresponding pixel precision can be adaptively selected from the pixel precision set as the pixel precision of the MVD according to the characteristics of the coding unit.

It should be understood that the encoding device sets a pixel precision set, and when encoding the video, selects the appropriate pixel precision for each coding unit from the pixel precision set to encode, so as to ensure that while removing visual redundancy in the video, It also reduces the amount of data processed by the encoding device and saves some terminal power consumption. For example, the pixel precision set may be (integer pixel precision, 1/2 pixel precision, 1/4 pixel precision), or the pixel precision set may also be (integer pixel precision, 4 pixel precision, and 1/4 pixel precision).

In one embodiment, the characteristics of video content under different video types are different, and the characteristics of the video content are different, resulting in different sets of pixel precisions used in video coding using the AMVR technology. Usually, video types can include natural video and screen content video. Natural video refers to the video obtained by shooting certain scenes through a camera device without other processing; screen content video generally refers to the video displayed on the screen of the encoding device. Content, mainly video of computer screen, TV screen, mobile phone screen and so on. This type of video includes not only some natural images, but also some text, graphics, animations, games and other visual contents generated by computers, which belong to a kind of video formed by a mixture of natural and artificial images. Compared with natural videos, screen content videos often have steep edges, high-purity colors, strong contrast, etc., and also tend to have more regular and simpler motion information.

Due to the difference between the natural video and the screen content video, several pixel precisions in this pixel precision set may not be suitable for encoding the screen content video or the natural video. Therefore, this application sets the above pixel precision for the encoding device Sets (for example, integer pixel precision, 1/2 pixel precision, and 1/4 pixel precision as described above) are called the initial pixel precision set. When encoding the screen content video, each pixel precision value in the initial pixel precision set will be used. Modifications are made to obtain a target pixel-accuracy set suitable for on-screen content video. Similarly, the initial pixel precision set set by the encoding device may be suitable for screen content video. If the video to be processed is a natural video, it is also necessary to modify each pixel precision in the initial pixel precision set to obtain the target suitable for natural video. Pixel precision collection.

Referring to FIG. 4 , it is a video processing method provided by an embodiment of the present invention. The video processing method can be used in any encoding device capable of implementing an encoding function, and the video processing method can be specifically executed by a processor of the encoding device. The video processing method may include the following steps:

Step S401, the encoding device determines the video type of the acquired video to be processed.

In one embodiment, the to-be-processed video acquired by the encoding device may be obtained by photographing a camera object by a camera configured on the encoding device, or the to-be-processed video may also be a camera taken by an independent camera device. The object is captured and sent to the encoding device.

In one embodiment, the video formats obtained by photographing the camera objects by different camera devices may also be different, so a video may include multiple video formats, such as avi, mp4, mts, and mp3. Optionally, the video format of the to-be-processed video acquired by the encoding device may be any one of the foregoing video formats.

As a feasible implementation manner, videos can be classified into natural videos and screen content videos according to the way in which the video content is generated. Natural images, for example, small videos shot by everyday mobile phones; screen content videos generally refer to the content displayed on the screen of an encoding device, and the encoding devices described here may mainly include encoding devices such as computers, televisions, and mobile phones. Specifically, the screen content video includes not only some natural images, but also some computer-generated visual content such as texts, graphics, animations, or games, and the screen content video is a kind of mixed natural video and artificial images. video. For example, a movie, or a playback animation added by the computer to a presentation, etc. In this embodiment of the present invention, the video type of the video to be processed acquired by the encoding device may be any one of natural video or screen content video.

It should be understood that the above-mentioned classification of videos is only a feasible video classification method enumerated in the embodiment of the present invention, and video types can also be classified according to other classification criteria. For example, videos can be classified into long videos and short video.

2a, 2b and FIG. 3a, the description of the embodiment in FIG. 3b shows that when the encoding device encodes videos of different video types, if the corresponding pixel precision sets are set for different video types in a targeted manner, it can be While improving the quality of the encoded video, the power consumption of some terminals is saved. Therefore, in this embodiment of the present invention, after determining the video type of the video to be processed, an appropriate pixel precision set is selected for the to-be-processed video, and then encoding processing is performed on the to-be-processed video based on the selected pixel precision set. In one embodiment, the encoding device may select an appropriate pixel precision set for the video to be processed through step S402.

It should be understood that the to-be-processed video is composed of multiple frames of images, and when the to-be-processed video is encoded, each frame of the multiple frames of images is processed. Therefore, the following determination Obtaining the video type of the video to be processed is essentially determining the video type of the current frame of the video to be processed.

In one embodiment, the implementation of step S401 may include: determining a hash value corresponding to the video to be processed; if the hash value is not greater than a threshold, determining that the video type of the video to be processed is a pre-processed video. Set a video type; if the hash value is greater than the threshold, it is determined that the video type of the video to be processed is not the preset video type. That is, the encoding device may determine the video type to which the video to be processed belongs according to the hash value corresponding to the video to be processed. Wherein, the threshold is a preset value for determining the video type, and the value can be set by the encoding device. In this embodiment of the present invention, the preset video type may be set by an encoding device, and the preset video type may include any one or more of screen content video or natural video. In other embodiments, the preset video type may include It is assumed that the video type may also include either a long video or a short video.

Suppose that after the encoding device obtains the video to be processed, before starting to encode the target frame of the video to be processed, it first needs to calculate the hash value of the target frame. If the hash value of the target frame is less than or equal to the threshold, then determine the target frame is a preset video type; if the hash value of the target frame is greater than the threshold, it is determined that the target frame is not a preset video type. Further, according to the judgment result, a set of pixel precisions required for encoding processing is selected.

In another embodiment, the implementation of step S401 may further include: invoking a video type identification model to identify the to-be-processed video to obtain an identification result; if the video type indicated by the identification result is a preset video type, it is determined that the video type of the video to be processed is a preset video type. That is to say, a video type recognition model can be stored in the encoding device. The video type recognition mode is obtained by training video samples containing different video types. The encoding device calls the model to recognize the video to be processed, and obtains the recognition result. The identification result may include a probability that the video to be processed belongs to a certain video type, and a video type with a higher probability is determined as the video type of the video to be processed. For example, assuming that the encoding device invokes the video type identification model to identify the video to be processed, the obtained identification result may be 30% of the natural video and 70% of the screen content video. According to the identification result, it is determined that the to-be-processed video is the screen content video .

Step S402: If the video type of the video to be processed is a preset video type, increase each pixel precision value in the initial pixel precision set to obtain a target pixel precision set.

In one embodiment, the initial pixel precision set may be the default pixel precision set of the encoding device, or may be the pixel precision set used by the encoding device when the encoding process of the previous frame is performed. Assuming that the initial pixel precision set is the default pixel precision set of the encoding device, the encoding device may set the initial pixel precision set by: determining the initial pixel precision set according to the pixel precision set used in historical video encoding processing, for example, encoding The device obtains the pixel precision set used in the last 5 video processing, among which the pixel precision set used in 4 video encoding processing is the same (1/2 pixel precision, 1/4 pixel precision, integer pixel precision), then Determines (1/2 pixel precision, 1/4 pixel precision, integer pixel precision) as the default initial pixel precision. In other embodiments, the initial pixel precision may also be set by the encoding device according to the acquired setting operation. Before the encoding device performs the encoding process, the user may set the initial pixel precision set during encoding through the user interface of the encoding device , or the user can also perform some other encoding-related configuration operations through the user interface.

In one embodiment, in the embodiment of the present invention, if it is determined in step S401 that the video type of the video to be processed is a preset video type, the initial pixel precision set currently set in the encoding device is obtained, if the initial pixel precision Each pixel precision included in the precision set meets the pixel precision requirement when encoding the video of the preset video type, then the initial pixel precision set may be used directly to encode the image to be processed; if the initial pixel precision Each pixel precision included in the set has one or more pixel precisions, and does not meet the pixel precision requirements when encoding the video of the preset video type, then the corresponding pixel precision value is modified, and finally the modified The initial pixel precision set is used as the target pixel precision set for encoding the video to be processed. Wherein, the modification to the pixel precision value may include increase or decrease.

In an embodiment, the implementation manner of modifying each pixel precision value in the initial pixel precision set to obtain the target pixel precision set may be: according to the preset video type, determining a pixel precision value adjustment rule; according to the pixel precision The value adjustment rule modifies each pixel precision value included in the initial pixel precision set to obtain the target pixel precision set. Wherein, in the embodiment of the present invention, the implementation manner of determining the pixel precision value adjustment rule according to the preset video type may be to determine the pixel precision value adjustment rule according to the motion rule of the preset video type and the video content of the video to be processed. For example, the pixel precision value adjustment rule is: the difference between the modified pixel precision value and the corresponding pixel precision value before the modification is less than or equal to 7 pixels. For another example, the adjustment rule may also be set as: the difference between the modified pixel precision and the corresponding pixel precision value before the modification is less than or equal to 1/2 pixel precision, and so on. It should be understood that the above is only a method for modifying the pixel precision value enumerated in the embodiment of the present invention, and the specific modification method is not specifically limited in the embodiment of the present invention.

In one embodiment, even for the same piece of video, the required pixel precision sets are different when using different coding modes to encode it. In this embodiment of the present invention, it is assumed that the encoding mode includes a first type encoding mode and a second type encoding mode, and the first type encoding mode may refer to any one of an inter-frame inter encoding mode and an affine encoding mode, so The second type of coding mode refers to the other of the inter coding mode and the affine coding mode. Corresponding to the two encoding modes, the initial set of pixel precisions may include a first set of initial pixel precisions and a second set of initial pixel precisions. The initial pixel precision set corresponding to the first type of coding mode may be the first initial pixel precision set, and the corresponding initial pixel precision set in the second type of coding mode may be the second initial pixel precision set. In other embodiments, the initial pixel precision set corresponding to the first type of coding mode may also be the second initial pixel precision set, and the initial pixel precision set corresponding to the second type of coding mode may also be the first initial pixel precision set.

In one embodiment, the main difference between the inter coding mode and the affine coding mode is that the inter coding mode only pays attention to the motion information of translational motion in the video, while the affine coding mode pays attention to more motion information, such as zoom, rotation, perspective Irregular movements such as sports. It can be seen from the foregoing description that when using the inter coding mode for inter prediction, the processing object of the inter prediction is a certain coding block in a frame of image, and the processing object of the affine coding mode is no longer the entire coding block. Divide the entire coding block into multiple coding sub-blocks, and take each coding sub-block as the processing object. In this way, each coding sub-block in affine coding mode corresponds to a motion vector, and the motion vectors corresponding to multiple coding sub-blocks form a motion vector field in affine coding mode. Motion compensation in affine coding mode refers to the use of motion Vector fields and reference frames result in predicted frames. In one embodiment, the motion vector of each coding sub-block included in each coding block in the affine coding mode can be obtained by calculating the parameters of the control points on the coding block. Normally, in affine coding mode, the number of control points on each coding block can be two or three. As for how to obtain the motion vector of each coded word block corresponding to each coded block in the affine coding mode by calculating the parameters of the control point, a related method in the prior art can be used, and details are not repeated here.

In one embodiment, as can be seen from the above description, after it is determined that the video type of the video to be processed is a preset video type, before determining the corresponding target pixel precision set for the video to be processed, it is first necessary to determine whether the video to be processed is The encoding mode used when the video is encoded, and then further selects the initial pixel precision set to be adjusted according to the encoding mode, and finally increases and adjusts each pixel precision in the initial pixel precision set to be adjusted to obtain the target pixel precision set.

Specifically, the initial pixel precision set includes a first initial pixel precision set and a second initial pixel precision set, the target pixel precision set includes a first target pixel precision set and a second target pixel precision set, and the initial pixel precision set The precision value of each pixel in the precision set is increased to obtain a target pixel precision set, which includes: obtaining an encoding mode used when encoding the video to be processed; if the encoding mode is the first type of encoding mode, Each pixel precision value in the first initial pixel precision set is modified to obtain a first target pixel precision set; if the encoding mode is the second type of encoding mode, each pixel precision value in the second initial pixel precision set is modified. Modify to obtain the second target pixel precision set.

In one embodiment, the encoding mode used in the encoding process of the video to be processed may be selected by the encoding device according to the motion information included in the video to be processed. If the video to be processed includes rotation, translation, zoom and other motion information, the first type of encoding mode can be selected to encode the video to be processed; if the encoding device determines that the video to be processed only includes translation motion information , the second type of encoding mode can be selected to encode the to-be-processed video. In other embodiments, the encoding mode used when encoding the video to be processed may also be determined by the encoding device according to the setting operation input by the user on the user interface.

For example, assuming that the encoding device is set in the first encoding mode, the first initial pixel precision set is (1/2 pixel precision, integer pixel precision, 1/4 pixel precision); in the second encoding mode, the second The initial pixel precision set is (1/4 pixel precision, 1/8 pixel precision, 1/16 pixel precision). Assuming that the encoding device obtains a piece of video to be processed, and judges that the video type of the video to be processed is a preset video type, further, the encoding device determines the encoding mode required for encoding the video to be processed, if it is determined The encoding mode is the first type encoding mode, then modify each pixel precision value in the first initial pixel precision set (integer pixel precision, 1/2 pixel precision, 1/4 pixel precision) to obtain the first target pixel precision set, which can be expressed as (integer pixel precision, 4 pixel precision and 8 pixel precision); if it is determined that the encoding mode is the second type of encoding mode, the second initial pixel precision set (1/4 pixel precision, 1/8 Each pixel precision value in the pixel precision, 1/16 pixel precision) is modified to obtain a second target pixel precision set, which can be expressed as (1/2 pixel precision, integer pixel precision, 2 pixel precision).

Step S403: Encode the to-be-processed video based on the target pixel precision set to obtain an encoded video.

In one embodiment, after the target pixel precision set corresponding to the video to be processed is determined in step S402, inter-frame prediction is performed on the to-be-processed video based on the target pixel precision set, and then the inter-predicted to-be-processed video is subjected to inter-frame prediction. Process the video to perform other encoding processes, such as transformation, quantization, entropy encoding, etc., to obtain an encoded video. The performing inter-frame prediction on the video to be processed based on the target pixel precision set is substantially performing inter-frame prediction on each frame of the video to be processed.

In one embodiment, after encoding the processed video to obtain the encoded video, the encoded video may be transmitted to the decoding end in the form of a code stream, and the decoding end performs decoding processing on the encoded video, and the decoding end may decode the encoded video. The obtained video is transmitted to the display device and displayed by the display device. After encoding, decoding and displaying the above-mentioned video to be processed, some redundant information included in the video to be processed is eliminated, which greatly reduces the data volume of the video to be processed, improves the video transmission efficiency, and also improves the user experience. viewing experience. For example, assuming that a one-second digital TV video is transmitted through a 1M transmission bandwidth, without encoding processing, it needs to be transmitted for 9 seconds, that is, the user needs to wait for 9 seconds to watch a one-second video. Digital TV video; after being processed by the video processing method of the embodiment of the present invention, it may only need to be transmitted for 1 second.

In one embodiment, after encoding and processing each frame of the target video to be processed based on the target pixel accuracy, adding identification information capable of identifying the video type to which the frame of image belongs to each frame of the image, and encoding the to-be-processed image After the above-mentioned processing is performed on each frame image in the video, an encoded video is obtained, and the encoded video includes identification information, and the encoded video and identification information are sent to the decoding end, so that the decoding end decodes according to the encoding situation of each frame of image. . Specifically, performing encoding processing on the to-be-processed video based on the target pixel precision set to obtain an encoded video includes: adding identification information to the encoded video; sending the encoded video to which the identification information is added to decoding end, the identification information is used to instruct the decoding end to decode the encoded video based on the identification information.

In one embodiment, after determining the target pixel precision set corresponding to the video to be processed, the encoding device may set an index identifier for each pixel precision included in the target pixel precision set. You can know the pixel precision used to encode a frame of images. Wherein, the index identifier of each pixel precision setting included in the target pixel precision set may be: assuming that the target pixel precision set is (integer pixel precision, 4 pixel precision, 8 pixel precision), the index identifier is: 0 means integer pixel precision, 00 It means 4 pixel precision, 01 means 8 pixel precision.

After encoding the to-be-processed video to obtain the encoded video, the encoding device may send the index identifier together with the encoded video to the decoder, where the index identifier is used to instruct the decoding end to decode the encoded video based on the index identifier. Specifically, performing encoding processing on the to-be-processed video based on the target pixel precision set to obtain an encoded video includes: setting an index identifier for each pixel precision included in the target pixel precision set; The target pixel precision in the target pixel precision set used during encoding processing, and the index mark corresponding to the target pixel precision; add the index mark to the encoded video, and add the coding with the index mark The video is sent to the decoding end, and the index identifier is used to instruct the decoding end to decode the encoded video based on the index identifier.

In this embodiment of the present invention, the encoding device determines the acquired video type of the video to be processed, and if the video type of the to-be-processed video is a preset video type, increases each pixel precision value in the initial pixel precision set to obtain a target pixel precision set, and further, perform encoding processing on the video to be processed based on the target pixel precision set to obtain an encoded video. In the above process of encoding the video to be processed, the target pixel precision set used in the encoding process is determined according to the video type of the video to be processed, so as to achieve targeted selection of the target pixel precision set for the to-be-processed videos of different video types, thereby. Improves the quality of encoded video.

Referring to FIG. 5, an encoding system provided by an embodiment of the present invention may include an encoding end 501 and a decoding end 502, and the encoding end 501 and the decoding end 502 may be configured in the same terminal device, Alternatively, the encoding end 501 and the decoding end 502 may also be two independent devices. In the encoding system shown in FIG. 5 , the encoding end 501 is configured to perform compression encoding on the video to be processed by using a suitable set of pixel precisions to reduce redundant information included in the video to be processed, and the encoding end 501 will The encoded video obtained after the encoding process is sent to the decoding end, and the decoding end 502 uses the pixel precision set corresponding to the encoding end and other encoding information to decode the encoded video.

Referring to FIG. 6 , which is an interaction diagram provided by an embodiment of the present invention, the following describes the interaction flow of the encoding end 501 and the decoding end 502 in FIG. 5 when encoding and decoding the video with reference to FIG. 6 . In one embodiment, after acquiring the video to be processed in step S601, the encoding end 501 determines the video type of the video to be processed. The target pixel precision set required for encoding the to-be-processed video is selected according to the video type of the to-be-processed video. Specifically, if the encoding end 501 determines in step S602 that the video type of the video to be processed is the preset video type, then each pixel precision in the initial pixel precision set stored in the encoding end 501 is modified to obtain the target pixel precision set, Further, in step S603, the video to be processed is encoded based on the target pixel precision set; if the encoding terminal 501 determines that the video type of the video to be processed is not a preset video type, the initial pixel stored in the decoding terminal 501 is used to perform the encoding process. The set performs encoding processing on the video to be processed.

Optionally, the preset video type described in step S602 may include any one or more of screen content video and natural video, or the preset video type may also include any one of long video and short video, Alternatively, the preset video type may also be other video types, and the embodiment of the present invention does not limit the preset video type. In one embodiment, for the method for the encoding end 501 to determine the video type of the video to be processed, reference may be made to the description of the related content in the embodiment of FIG. 4 , which will not be repeated here.

The encoding mode used by the encoding end 501 to encode the video to be processed may be a first type encoding mode and a second type encoding mode, where the first type encoding mode may include any one of an inter encoding mode and an affine encoding mode, and the second type encoding mode The encoding mode may include one of an inter encoding mode and an affine encoding mode. In different encoding modes, the initial pixel precision sets corresponding to the encoding end 501 are also different. Specifically, the initial pixel precision set corresponding to the first type of coding mode may be the first initial pixel precision set, and the initial pixel precision set corresponding to the second type of coding mode may be the second initial pixel precision set. After the encoding end 501 determines that the video type of the video to be processed is the preset video type, and before determining the target pixel precision set, the encoding end 501 also needs to determine the encoding mode: if the encoding mode is the first type encoding mode, the encoding The end 501 adjusts each pixel precision value in the first initial pixel precision set to obtain a first target pixel precision set; if the encoding mode is the second type of encoding mode, the encoding end 501 adjusts each pixel in the second initial pixel precision set. The precision value is adjusted to obtain the second target pixel precision set.

In the encoding system shown in FIG. 5 , the encoding end 501 performs encoding processing on the video to be processed based on the target pixel precision set in step S603, and after obtaining the encoded video, it can also add identification information to the encoded video in step S604, and add the identification information to the encoded video. The encoded video of the information is sent to the decoding end 502 . The identification information refers to information used to identify that the video type corresponding to the encoded video is a preset video type. In other words, if the decoding end 502 detects that the encoded video includes this identification information, it can determine the corresponding video type of the encoded video. The video type is the preset video type.

The decoding end 502 receives the encoded video sent by the encoding end 501 in step S605, and can extract the information included in the encoded video. If it is determined in step S606 that the encoded video includes identification information, then determine the received encoded video. The corresponding video type is a preset video type; further, the decoding end 502 can obtain the target pixel precision set set by the encoding end 501 for the preset video type, and decode the encoded video based on the target pixel precision set by step S607 deal with.

In one embodiment, after the encoding end 501 obtains the encoded video by performing step S603, in addition to adding identification information to the encoded video, an index identification may also be added to the encoded video, and the index identification is used to identify the video to be processed by the encoding end 501 The target pixel precision used in the encoding process, the target pixel precision belongs to any one of the target pixel precision set. It can be understood that the video to be processed is composed of multiple frames of images, so the video encoding processing of the video to be processed is also processed in units of frames. The encoded video of the frame image encoding result is sent to the decoding end. Therefore, the target pixel precision used in the encoding process of the video to be processed is essentially for each frame of the video to be processed.

The encoding end 501 sends the encoded video with the index mark added to the decoding end 502, and the decoding end 502 determines the target pixel precision identified by the index mark from the target pixel precision set; further, based on the target pixel precision The encoded video is decoded. After decoding the encoded video based on the target precision, the decoding end 502 obtains a video with a smaller amount of data that can be displayed or stored.

In the encoding system provided by the embodiment of the present invention, the encoding end 501 sets a corresponding target pixel precision set to encode the to-be-processed video according to the video type of the video to be processed, which improves the quality of video encoding. The identification information included in the sent encoded video can accurately select the target pixel precision set, and decode the encoded video, which can ensure that the video content is not damaged and improve the decoding quality.

Referring to FIG. 7 , which is a schematic structural diagram of an encoding device provided by an embodiment of the present invention, the encoding device described in FIG. 7 may include: a memory 701 and a processor 702 , wherein the memory 701 and the processor 702 are connected through a bus 703 , and the memory Program code is stored in 701 , and memory 702 calls the program code in memory 701 .

The memory 701 may include a volatile memory (volatile memory), such as random-access memory (RAM); the memory 701 may also include a non-volatile memory (non-volatile memory), such as a flash memory ( flash memory), solid-state drive (solid-state drive, SSD), etc.; the memory 701 may also include a combination of the above-mentioned types of memory.

The processor 702 may be a central processing unit (Central Processing Unit, CPU). The processor 702 may further include a hardware chip. The above-mentioned hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or the like. The PLD may be a field-programmable gate array (FPGA), a generic array logic (GAL), or the like. The processor 702 may also be a combination of the above structures.

In this embodiment of the present invention, the memory 701 is used to store a computer program, and the computer program includes program instructions, and the processor 702 is used to execute the program instructions stored in the memory 701 to implement the above-mentioned embodiment shown in FIG. 4 . corresponding method steps.

In one embodiment, the processor 702 is configured to execute when invoking the program instructions: determine the acquired video type of the video to be processed; if the video type of the video to be processed is a preset video type, then initialize the Each pixel precision value in the pixel precision set is modified to obtain a target pixel precision set; the to-be-processed video is encoded based on the target pixel precision set to obtain an encoded video.

In one embodiment, when determining the acquired video type of the video to be processed, the processor 702 performs the following operations: determining a hash value corresponding to the video to be processed; if the hash value is not greater than a threshold, Then, it is determined that the video type of the video to be processed is a preset video type; if the hash value is greater than the threshold, it is determined that the video type of the to-be-processed video is not the preset video type.

In one embodiment, when determining the acquired video type of the video to be processed, the processor 702 performs the following operations: calling a video type identification model to identify the to-be-processed video to obtain an identification result; if the identification If the video type indicated by the result is the preset video type, it is determined that the video type of the to-be-processed video is the preset video type.

In one embodiment, the initial pixel precision set includes a first initial pixel precision set and a second initial pixel precision set, the target pixel precision set includes a first target pixel precision set and a second target pixel precision set, the When the processor modifies each pixel precision value in the initial pixel precision set to obtain the target pixel precision set, the processor performs the following operations: obtaining the encoding mode used when encoding the video to be processed; if the encoding mode is the first one type of coding mode, modify each pixel precision value in the first initial pixel precision set to obtain a first target pixel precision set; if the coding mode is the second type of coding mode, the second initial Each pixel precision value in the pixel precision set is modified to obtain a second target pixel precision set.

In one embodiment, the first type of coding mode may include any one of an inter-frame inter coding mode and an affine coding mode, and the second type of coding mode may include an inter-frame inter coding mode and the affine coding mode Another type of encoding mode.

In one embodiment, when the processor 702 encodes the video to be processed based on the target pixel precision set to obtain an encoded video, the processor 702 performs the following operations: adding identification information to the encoded video; adding the added The encoded video of the identification information is sent to the decoding end, and the identification information is used to instruct the decoding end to decode the encoded video based on the identification information.

In one embodiment, the processor 702 performs the following operations when encoding the video to be processed based on the target pixel precision set to obtain an encoded video: setting the pixel precision for each pixel precision included in the target pixel precision set index identification; determine the target pixel accuracy in the target pixel accuracy set used when encoding the video to be processed, and the index identification corresponding to the target pixel accuracy; add the index identification to the encoded video, and send the encoded video to which the index identifier is added to the decoding end, where the index identifier is used to instruct the decoding end to decode the encoded video based on the index identifier.

Referring to FIG. 8 , which is a schematic structural diagram of a decoding device provided by an embodiment of the present invention, the decoding device described in FIG. 8 may include: a memory 801 and a processor 802 , wherein the memory 801 and the processor 802 are connected through a bus 803 , and the memory Program code is stored in 801 , and memory 802 calls the program code in memory 801 .

The memory 801 may include volatile memory (volatile memory), such as random-access memory (random-access memory, RAM); the memory 801 may also include non-volatile memory (non-volatile memory), such as flash memory ( flash memory), solid-state drive (solid-state drive, SSD), etc.; the memory 801 may also include a combination of the above-mentioned types of memory.

The processor 802 may be a central processing unit (Central Processing Unit, CPU). The processor 802 may further include a hardware chip. The above-mentioned hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or the like. The PLD may be a field-programmable gate array (FPGA), a generic array logic (GAL), or the like. The processor 802 may also be a combination of the above structures.

In this embodiment of the present invention, the memory 801 is used to store a computer program, and the computer program includes program instructions, and the processor 802 is used to execute the program instructions stored in the memory 801 .

In one embodiment, the processor 802 is configured to execute when invoking the program instructions: receive an encoded video; when the encoded video includes identification information, determine that a video type corresponding to the encoded video is a preset video type performing decoding processing on the encoded video based on a target pixel precision set; the target pixel precision set is obtained by modifying each pixel precision value in the initial pixel precision set.

In one embodiment, the encoded video further includes an index identifier, and when performing decoding processing on the encoded video based on the target pixel precision set, the processor 802 performs the following operations: from the target pixel precision set, determining the target pixel precision identified by the index identifier; and performing decoding processing on the encoded video based on the target pixel precision.

Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented by instructing relevant hardware through a computer program, and the program can be stored in a computer-readable storage medium. During execution, the processes of the embodiments of the above-mentioned methods may be included. The storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM), or a random access memory (Random Access Memory, RAM) or the like.

The above disclosure is only a part of the embodiments of the present invention, and of course, it cannot limit the scope of the rights of the present invention, so the equivalent changes made according to the claims of the present invention are still within the scope of the present invention.

Claims (21)

1. A video processing method, comprising:

determining the video type of the obtained video to be processed;

if the video type of the video to be processed is a preset video type, modifying each pixel precision value in the initial pixel precision set to obtain a target pixel precision set;

and coding the video to be processed based on the target pixel precision set to obtain a coded video.

2. The method of claim 1, wherein the determining the video type of the acquired video to be processed comprises:

determining a hash value corresponding to the video to be processed;

if the hash value is not greater than the threshold value, determining that the video type of the video to be processed is a preset video type;

and if the hash value is larger than the threshold value, determining that the video type of the video to be processed is not the preset video type.

3. The method of claim 1, wherein the determining the video type of the acquired video to be processed comprises:

calling a video type identification model to identify the video to be processed to obtain an identification result;

and if the video type indicated by the identification result is a preset video type, determining that the video type of the video to be processed is the preset video type.

4. The method of claim 1, wherein the initial set of pixel precisions comprises a first initial set of pixel precisions and a second initial set of pixel precisions, the target set of pixel precisions comprises a first target set of pixel precisions and a second target set of pixel precisions,

the modifying each pixel precision value in the initial pixel precision set to obtain a target pixel precision set includes:

acquiring a coding mode used when the video to be processed is coded;

if the coding mode is a first type of coding mode, modifying each pixel precision value in the first initial pixel precision set to obtain a first target pixel precision set;

and if the coding mode is a second type of coding mode, modifying each pixel precision value in the second initial pixel precision set to obtain a second target pixel precision set.

5. The method of claim 4, wherein the first type of coding mode comprises any one of an inter-frame coding mode and an affine coding mode, and wherein the second type of coding mode comprises the other one of the inter-frame coding mode and the affine coding mode.

6. The method of claim 1, wherein the encoding the video to be processed based on the target set of pixel precisions to obtain an encoded video, comprises:

adding identification information to the encoded video;

and sending the coded video added with the identification information to a decoding end, wherein the identification information is used for indicating the decoding end to decode the coded video based on the identification information.

7. The method of claim 1, wherein the encoding the video to be processed based on the target set of pixel precisions to obtain an encoded video, comprises:

setting index identification for each pixel precision included in the target pixel precision set;

determining target pixel precision in the target pixel precision set used when the video to be processed is coded and an index identification corresponding to the target pixel precision;

and adding the index identifier to the coded video, and sending the coded video added with the index identifier to a decoding end, wherein the index identifier is used for indicating the decoding end to decode the coded video based on the index identifier.

8. A video processing method, comprising:

receiving an encoded video;

when the coded video comprises the identification information, determining that the video type corresponding to the coded video is a preset video type;

decoding the encoded video based on a target pixel precision set;

the target pixel precision set is obtained by modifying each pixel precision value in the initial pixel precision set.

9. The method of claim 8, wherein the encoded video further comprises an index identifier, and wherein the decoding the encoded video based on the target set of pixel precisions comprises:

determining, from the set of target pixel accuracies, a target pixel accuracy identified by the index identification;

and decoding the coded video based on the target pixel precision.

10. A video processing apparatus, comprising:

the determining unit is used for determining the video type of the acquired video to be processed;

the processing unit is used for modifying each pixel precision value in the initial pixel precision set to obtain a target pixel precision set if the determining unit determines that the video type of the video to be processed is a preset video type;

and the processing unit is further configured to perform encoding processing on the video to be processed based on the target pixel precision set to obtain an encoded video.

11. A video processing apparatus, comprising:

a receiving unit for receiving encoded video;

the processing unit is used for determining the video type corresponding to the coded video as a preset video type when the coded video comprises the identification information;

the processing unit is further configured to perform decoding processing on the encoded video based on a target pixel precision set;

the target pixel precision set is obtained by modifying each pixel precision value in the initial pixel precision set.

12. An encoding device, comprising a memory and a processor:

the memory for storing program code;

the processor, invoking the program code, when executed, is configured to perform the following:

determining the video type of the obtained video to be processed;

if the video type of the video to be processed is a preset video type, modifying each pixel precision value in the initial pixel precision set to obtain a target pixel precision set;

and coding the video to be processed based on the target pixel precision set to obtain a coded video.

13. The encoding device of claim 12, wherein the processor, when determining the video type of the acquired video to be processed, performs the following:

determining a hash value corresponding to the video to be processed;

if the hash value is not greater than the threshold value, determining that the video type of the video to be processed is a preset video type;

and if the hash value is larger than the threshold value, determining that the video type of the video to be processed is not the preset video type.

14. The encoding device of claim 12, wherein the processor, when determining the video type of the acquired video to be processed, performs the following:

calling a video type identification model to identify the video to be processed to obtain an identification result;

and if the video type indicated by the identification result is a preset video type, determining that the video type of the video to be processed is the preset video type.

15. The encoding device of claim 12, wherein the initial set of pixel precisions comprises a first initial set of pixel precisions and a second initial set of pixel precisions, the target set of pixel precisions comprises a first target set of pixel precisions and a second target set of pixel precisions,

when the processor modifies each pixel precision value in the initial pixel precision set to obtain a target pixel precision set, the following operations are executed:

acquiring a coding mode used when the video to be processed is coded;

if the coding mode is a first type of coding mode, modifying each pixel precision value in the first initial pixel precision set to obtain a first target pixel precision set;

and if the coding mode is a second type of coding mode, modifying each pixel precision value in the second initial pixel precision set to obtain a second target pixel precision set.

16. The encoding device according to claim 15, wherein the first type of encoding mode includes any one of an inter-frame encoding mode and an affine encoding mode, and the second type of encoding mode includes the other one of the inter-frame encoding mode and the affine encoding mode.

17. The encoding device according to claim 12, wherein the processor, when performing encoding processing on the video to be processed based on the target pixel precision set to obtain an encoded video, performs the following operations:

adding identification information to the encoded video;

and sending the coded video added with the identification information to a decoding end, wherein the identification information is used for indicating the decoding end to decode the coded video based on the identification information.

18. The encoding device according to claim 12, wherein the processor, when performing encoding processing on the video to be processed based on the target pixel precision set to obtain an encoded video, performs the following operations:

setting index identification for each pixel precision included in the target pixel precision set;

determining target pixel precision in the target pixel precision set used when the video to be processed is coded and an index identification corresponding to the target pixel precision;

and adding the index identifier to the coded video, and sending the coded video added with the index identifier to a decoding end, wherein the index identifier is used for indicating the decoding end to decode the coded video based on the index identifier.

19. A decoding device, comprising a memory and a processor:

the memory for storing program code;

the processor, invoking the program code, when executed, is configured to perform the following:

receiving an encoded video;

when the coded video comprises the identification information, determining that the video type corresponding to the coded video is a preset video type;

decoding the encoded video based on a target pixel precision set;

the target pixel precision set is obtained by modifying each pixel precision value in the initial pixel precision set.

20. The decoding device according to claim 19, wherein the encoded video further includes an index identifier, and the processor performs the following operations when performing a decoding process on the encoded video based on the target set of pixel precisions:

determining, from the set of target pixel accuracies, a target pixel accuracy identified by the index identification;

and decoding the coded video based on the target pixel precision.

21. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a first computer program comprising first program instructions that, when executed by a processor, cause the processor to perform the video processing method of any of claims 1-7; alternatively, the computer readable storage medium stores a second computer program comprising second program instructions which, when executed by a processor, cause the processor to carry out the video processing method according to claim 8 or 9.

Images