CN111406404A - Compression method, decompression method, system and storage medium for obtaining video file - Google Patents

Abstract

The application relates to the technical field of image processing, in particular to a compression method, a decompression method, a system and a storage medium for obtaining a video file, which comprises the following steps: acquiring a plurality of image data to be compressed according to a time sequence; respectively mapping color values of all pixels in each image data to all pixel positions in a plurality of image blocks based on color attributes of all pixels in the image data; and compressing image blocks which correspond to each image data in the plurality of image data and have the same color attribute to obtain a video file. The scheme provided by the application can effectively reduce the code stream and ensure high fidelity image quality at the same time. Since the compression method in the present application can effectively reduce the data amount, the encoding of 8K video can be performed by a 4K encoder in the prior art. The uplink stable peak value between the current 5G is 90Mbps, so that the 5G real-time transmission of 8K videos can be realized, and meanwhile, high-fidelity image quality is achieved.

Description

Compression method, decompression method, system and storage medium for obtaining video file

technical field

The present application relates to the technical field of image processing, and in particular, to a compression method, decompression method, system and storage medium for obtaining video files.

Background technique

As people's playing quality of multimedia playing data is getting higher and higher, the data volume of multimedia playing data is also increasing. For multimedia playback data with a large amount of data, after the traditional method is used to compress and encode it, the amount of data still cannot be controlled within the range that can be stably transmitted. In order to ensure that the multimedia playback data can be transmitted stably, the multimedia playback data can usually only be further compressed, but this method will cause serious loss of color information and cannot meet the requirements of high image quality. Therefore, people expect to have a better compression method, so as to achieve a high-fidelity effect for multimedia playback data with a large amount of data while ensuring transmission stability.

SUMMARY OF THE INVENTION

In view of the above-mentioned shortcomings of the prior art, the purpose of the present application is to provide a compression method, decompression method, system and storage medium for obtaining a video file, which are used to solve the problem of difficult transmission of ultra-high-definition video data in the prior art.

In order to achieve the above purpose and other related purposes, a first aspect of the present application provides a compression method for obtaining a video file, comprising the following steps: obtaining multiple pieces of image data to be compressed in chronological order; the image data is used to display UHD4K and the video images of the above pixels; based on the color attributes of each pixel in the image data, map the color value of each pixel in each image data to each pixel position in multiple image blocks; The image blocks corresponding to each image data and having the same color attribute are compressed to obtain a video file.

In some implementations of the first aspect of the present application, in the case where each pixel in the image data represents a single color attribute, the color attribute of each pixel in the image data The step of mapping the color values of the pixels to the respective pixel positions in the plurality of image blocks includes: traversing the image data according to the color format set based on the Bayer format in the image data; wherein, during the traversing, based on the The color attribute of each pixel in the color format is extracted, the color value of each pixel is extracted from the image data, and mapped to the pixel position in the corresponding image block.

In some implementations of the first aspect of the present application, in the case where each pixel in the image data represents RGB color attributes; the color attribute of each pixel in the image data is based on the The step of respectively mapping the color values of the pixels to the respective pixel positions in the plurality of image blocks includes: traversing the image data according to the color format set based on the pixel row format in the image data; wherein, during the traversing, based on For the color attributes of each pixel in the color format, the color principal component or color fitting component of each pixel is extracted from the image data, and mapped to the pixel position in the corresponding image block.

In some implementations of the first aspect of the present application, the step of compressing image blocks corresponding to each of the multiple pieces of image data and having the same color attribute includes: according to the color format The color attributes of the plurality of pieces of image data are sequentially input into a first encoder for compression processing.

In some implementations of the first aspect of the present application, the step of compressing image blocks corresponding to each of the multiple pieces of image data and having the same color attribute includes: under synchronization control, using The multiple second encoders respectively compress multiple image blocks with the same color attribute.

In some implementations of the first aspect of the present application, a video file obtained by performing compression processing with a plurality of second encoders includes synchronization information set for decompressing the video file to restore multiple pieces of image data.

A second aspect of the present application further provides a method for decompressing a video file, including: acquiring a video file; decompressing the video file according to a compression method used corresponding to the video file to obtain a plurality of image blocks ; wherein, according to the color attribute of each image block, the obtained multiple image blocks correspond to each image data in the multiple image data to be generated; The color value of the pixel position is mapped into the pixel of the image data; based on the color value of each pixel in the image data, a video image for displaying UHD 4K and above pixels is generated.

In some embodiments of the second aspect of the present application, the step of decompressing the video file according to the compression method to obtain multiple image blocks includes: under synchronization control, using multiple second decoders The video file is decompressed according to the color attribute respectively; wherein, each second decoder outputs a plurality of image blocks with the same color attribute; wherein, each image block corresponds to a piece of image data to be generated.

In some implementations of the second aspect of the present application, each second decoder determines the correspondence between the decompressed image blocks and a piece of image data to be generated according to synchronization information in the video file relation.

In some implementations of the second aspect of the present application, the step of performing decompression processing on the video file according to the compression method to obtain multiple image blocks includes: using a first decoder to perform decompression on the received video file. The decompression process obtains multiple groups of image blocks divided according to different color attributes in the color format; wherein, each image block in each group of image blocks corresponds to a piece of image data to be generated.

In some embodiments of the second aspect of the present application, the step of mapping the color value of each pixel position in each corresponding image block to the pixel of the image data according to the color attribute includes: according to the color format, Traverse the pixel positions in the image blocks of each color attribute, and during the traversal, map the color values of the corresponding pixel positions in each image block to the pixel positions in the corresponding image data to generate image data; wherein, the image data The color value at each pixel location in , represents a single color attribute.

In some implementations of the second aspect of the present application, the step of generating a video image for displaying UHD 4K and above pixels based on the color value of each pixel obtained by mapping in the image data further includes: according to the Color format, performing interpolation processing on each pixel position in the obtained image data to obtain a video image containing RGB color attributes in each pixel.

A third aspect of the present application further provides a compression device, including: a communication interface for communicating with an external decompression device; a memory for storing at least one program and image data to be compressed; a processor for coordinating A communication interface and a memory are used to execute the program, and during execution, the image data is compressed according to the compression method for obtaining a video file described in any one of the first aspects of the present application, so as to obtain a video file.

A fourth aspect of the present application further provides a decompression device, including: a communication interface for communicating with an external compression device; a memory for storing at least one program and a video file to be decompressed; a processor for A communication interface and a memory are coordinated to execute the program, and during execution, the video file is decompressed according to the video file decompression method according to any one of the second aspect of the present application, so as to play the video file.

A fifth aspect of the present application further provides a video transmission system, comprising: the compression device according to the third aspect of the present application; and the decompression device according to the fourth aspect of the present application.

A sixth aspect of the present application further provides a computer-readable storage medium, comprising: storing at least one program; when the at least one program is invoked, the at least one program executes the method of obtaining a video file according to any one of the first aspect of the present application compression method; or, when the at least one program is invoked, executes the video file decompression method according to any one of the second aspect of the present application.

As mentioned above, the compression method, decompression method, system and storage medium for obtaining video files of the present application have the following beneficial effects: the compression method, decompression method, system and storage medium for obtaining video files provided by the present application can effectively Reduce the bitrate while maintaining high-fidelity image quality. In the present application, the amount of data added by a plurality of image blocks is far lower than the amount of data after compression processing using the traditional method. Among them, compared with the YUV222 format, it has only half the data volume; compared with the YUV444 format, it has only 1/3 of the data volume, but the amount of information carried by the compression method of the present application is equivalent to that of the YUV444 format. . Taking 8K video as an example, the image block of each color attribute is equivalent to the 4K video YUV400 format with only luminance information, and compared with the YUV422 format, the data volume is only half of that. Since the compression method in this application can effectively reduce the amount of data, the 8K video can be encoded by the 4K encoder in the prior art. Similarly, with the compression method of the present application, the 4K video can also be encoded by the 2K video encoder, or the 16K video can be processed by the 8K video encoder. Moreover, the compression method of the present application can directly utilize RGB video images or Bayer format images for compression without converting to YUV format. In addition, the bit rate generated by the compression method of the present application can be controlled at about half of that of YUV422, that is, 24 to 80 Mbps, and the current stable peak value of 5G uplink is 90 Mbps, so 5G real-time transmission of 8K video can be realized. High fidelity picture quality.

Description of drawings

Fig. 1 shows the flow chart of the compression method in this application in one embodiment;

FIG. 2 shows a schematic diagram of image data in the present application in an embodiment;

3 shows a schematic diagram of an embodiment of a mapping method for respectively mapping the color value of each pixel in each image data to each pixel position in a plurality of image blocks in the present application;

4 shows a schematic diagram of an embodiment in which each pixel in the image data in the present application represents an RGB color attribute;

5 is a schematic diagram of another embodiment of the mapping method for mapping the color value of each pixel in each image data to each pixel position in a plurality of image blocks in the present application;

FIG. 6 shows a schematic diagram of an embodiment of using a first encoder to perform compression processing in the present application;

FIG. 7 is a schematic diagram showing another embodiment of the compression process using a first encoder in the present application;

FIG. 8 is a schematic diagram showing another embodiment in which each pixel in the image data in the present application represents an RGB color attribute;

FIG. 9 shows a schematic diagram of another embodiment when the compression device in the present application does not know the principal component in each pixel in advance;

FIG. 10 shows an implementation of a mapping method for mapping the color value of each pixel in each image data to each pixel position in a plurality of image blocks when the compression device in the present application does not know the principal component in each pixel in advance. example diagram;

FIG. 11 shows a schematic diagram of still another embodiment when the compression device in the present application does not know the principal component in each pixel in advance;

FIG. 12 shows another mapping method for mapping the color value of each pixel in each image data to each pixel position in a plurality of image blocks when the compression device in the present application does not know the principal component in each pixel in advance. Schematic diagram of the embodiment;

FIG. 13 shows a schematic diagram of another embodiment when the compression device in the present application does not know the principal component in each pixel in advance;

FIG. 14 shows yet another mapping method for mapping the color value of each pixel in each image data to each pixel position in a plurality of image blocks when the compression device in the present application does not know the principal component in each pixel in advance. Schematic diagram of the embodiment.

Figure 15 shows a flow chart of the decompression method in one embodiment;

FIG. 16 shows a schematic diagram of an embodiment of decompression processing using a first decoder in the present application;

FIG. 17 shows a schematic diagram of another embodiment of the decompression process using a first decoder in the present application;

18 shows a schematic diagram of an embodiment in which the decompression device in the present application maps the color value of each pixel position in each corresponding image block to the pixel of the image data;

Figure 19 shows a schematic diagram of an embodiment of the compression device in the present application;

FIG. 20 shows a schematic diagram of an embodiment of the decompression device in the present application;

FIG. 21 is a schematic structural diagram of the video transmission system in the present application in an embodiment.

Detailed ways

The embodiments of the present application are described below by specific specific examples, and those skilled in the art can easily understand other advantages and effects of the present application from the contents disclosed in this specification.

Although in some instances the terms first, second, etc. are used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, a first decoder could be referred to as a second decoder, and similarly, a second decoder could be referred to as a first decoder, without departing from the scope of the various described embodiments. Both the first decoder and the decoder are describing a threshold, but unless the context clearly indicates otherwise, they are not the same decoder.

Also, as used herein, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context dictates otherwise. It should be further understood that the terms "comprising", "comprising" indicate the presence of stated features, steps, operations, elements, components, items, kinds, and/or groups, but do not exclude one or more other features, steps, operations, The existence, appearance or addition of elements, assemblies, items, categories, and/or groups. The terms "or" and "and/or" as used herein are to be construed to be inclusive or to mean any one or any combination. Thus, "A, B or C" or "A, B and/or C" means "any of the following: A; B; C; A and B; A and C; B and C; A, B and C" . Exceptions to this definition arise only when combinations of elements, functions, steps, or operations are inherently mutually exclusive in some way.

As users' requirements for playback quality of multimedia playback data continue to increase, for example, in scenarios such as program live broadcasts, video conferences, or security monitoring, technicians need to transmit multimedia playback data with better stability and higher fidelity. However, as people's playing quality of multimedia playing data is getting higher and higher, the data volume of multimedia playing data is also increasing. For a large amount of multimedia playback data, the code stream after being compressed and encoded by the traditional method is also large, and it is usually necessary to convert the RGB image into YUV format and then perform compression encoding. Taking 30 frames of 8K as an example, if the YUV444 format is used as an example, the data volume reaches 7680×4320×24bit×30fps≈3GByte/s. If the YUV422 format is used, although half of the color components are lost, the data volume still reaches 2Gbyte/ s. Under this amount of data, if the method in the prior art is used for compression encoding, the code stream is 48-160 Mbps. Even if the latest 5G technology is used, the peak average value of the uplink speed of 5G CPE is 80-90 Mbps, which is still unable to meet the stability requirements. transmission requirements. On the other hand, in some embodiments, the compression of multimedia playback data mostly adopts the YUV422 or YUV420 format, and the color information is seriously lost, which cannot meet the requirement of high image quality. People expect to have a better compression method, which can achieve high-fidelity effects for multimedia playback data with a large amount of data even at low bit rates.

To this end, the present application provides a compression method for obtaining a video file, so as to solve the above problem and make the playback of high-definition video smoother and with higher fidelity. The compression method is mainly completed by an image compression device, wherein the compression device may be a terminal device or a server. Here, the terminal device includes, but is not limited to, a camera device, an electronic terminal device for personal use, and the like.

It should be understood that the camera device includes a camera device, a storage device, a processing device, and may also include an interface device and the like. The camera is used to acquire image data, wherein the image data is composed of multiplexed image data set based on colors. The imaging device at least includes a lens composed of a lens group, a photosensitive device, and the like, wherein the photosensitive device includes, for example, a CCD device, a CMOS device, and the like. The storage device may include high speed random access memory, and may also include nonvolatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other nonvolatile solid state storage devices. The storage device also includes a memory controller that controls access to the memory by other components of the device, such as the CPU and peripheral interfaces. The storage device is used to store at least one program and image data to be encoded. The programs stored in the storage device include an operating system, a communication module (or instruction set), a graphics module (or instruction set), a text input module (or instruction set), and an application (or instruction set). The program in the storage device further includes an instruction set for performing an encoding operation on the image data in sequence based on the technical solution provided by the compression method. The processing device includes but is not limited to: CPU, GPU, FPGA (Field-Programmable Gate Array), ISP (Image Signal Processing chip), or other devices including at least one dedicated to processing stored in the storage device. Program processing chips (such as AI-specific chips), etc. The processing device invokes and executes at least one program stored in the storage device to perform compression processing on the stored image data according to the compression method. The interface device includes but is not limited to: a data line interface and a network interface; wherein, an example of the data line interface includes at least one of the following: a serial interface such as USB, a bus interface, a parallel interface, and the like. Examples of network interfaces include at least one of the following: a short-range wireless network interface such as a Bluetooth protocol-based network interface and a WiFi network interface, such as a wireless network interface based on a 3G, 4G, or 5G protocol for a mobile network, such as a wired network interface that includes a network card Wait. In some scenarios, the camera device is installed on the pan/tilt above the road to monitor vehicle violations, such as speeding, running a red light, and the like. In other scenarios, the camera device is configured on the minimally invasive medical equipment, and the camera device is arranged at the front end of the flexible tube through an optical fiber or other special data lines. In other scenarios, the camera device is configured on the high-speed moving track of the stadium to capture high-definition pictures of the competitive game.

It should be understood that the electronic terminal equipment for personal use includes desktop computers, notebook computers, tablet computers, and splicing equipment specially used for producing TV programs, movies, TV series, and the like. The electronic terminal equipment includes a storage device and a processing device. Wherein, the storage device and the processing device may be the same as or similar to the corresponding devices in the aforementioned camera equipment, and will not be described in detail here. The electronic terminal equipment may also include a camera device for capturing image data. Here, in some examples, the hardware and software modules of the camera device may be the same as or similar to the corresponding devices in the aforementioned camera equipment, and will not be repeated here. In still other examples, the electronic terminal device may further include an image acquisition interface for acquiring image data. The image acquisition interface may be a network interface, a data line interface, or a program interface. Wherein, the network interface and the data line interface may be the same as or similar to the corresponding devices in the aforementioned camera equipment, and will not be described in detail here. For example, through the network interface, the processing device of the electronic terminal device downloads image data from the Internet. In another example, through the program interface, the processing device of the electronic terminal device acquires the image data displayed on the display screen by the drawing software. Wherein, the drawing software is, for example, PS software, or screenshot software. For another example, through the data line interface, the processing device of the electronic terminal device obtains one frame of image data in the high-definition video without editing processing from the storage device.

The server includes, but is not limited to, a single server, a server cluster, a distributed server, a server based on cloud technology, and the like. Wherein, the server includes a storage device, a processing device, an image acquisition interface, and the like. The storage device and the processing device may be configured in the same entity server device, or configured in multiple entity server devices according to the division of labor of each entity server device. The image acquisition interface may be a network interface or a data line interface. The storage device, processing device, image acquisition interface, etc. included in the server can be the same as the corresponding devices mentioned in the aforementioned terminal equipment; each corresponding device. For example, the storage device may also include a solid state drive or the like. For example, the processing device may also include a CPU dedicated to a server or the like. The image acquisition interface in the server acquires image data and encoding instructions from the Internet, and the processing device executes the compression method described in this application on the acquired image data based on the encoding instructions.

The video file may be stored in a storage medium, or the video file may be transmitted to a compression device using a communication transmission mode of 60 Mbps and above. Wherein, the transmission method includes but is not limited to: wireless transmission method based on 5G communication protocol, or optical fiber transmission.

Based on the requirement of compressing and encoding image data generated by any of the above scenarios, the present application provides a compression method for obtaining a video file. Please refer to FIG. 1 , which is a flowchart of the compression method in an embodiment.

In step S110, multiple pieces of image data to be compressed are acquired in time sequence; the image data is used to display video images of UHD 4K and above pixels.

The image data includes, but is not limited to, ultra-high-definition images (such as 4K images or 8K images), and images that have been compressed and decompressed. For example, the image data is a high-definition image from an original video captured by a high-definition camera. For another example, the image data is a high-definition image transmitted through a dedicated data channel. For another example, the image data is an image that comes from the Internet and needs to be re-encoded. The format of the image data may be a Bayer format, or an RGB image generated by Debayer, or a format such as YUV. For example, the image data is in Bayer format directly generated by a sensor of a high-definition camera. For another example, the Bayer format generated by the sensor of the high-definition camera passes through the Debayer, that is, the other two color components are fitted to the color components of each pixel in the Bayer format, thereby generating an RGB image, and using the RGB image as the image to be processed. data.

It should be understood that Debayer is mosaic processing, which is a digital image processing algorithm whose purpose is to reconstruct a full-color image from the incomplete color samples output by a photosensitive element covered with a color filter array (CFA). . This method is also called color filter array interpolation (CFAinterpolation) or color reconstruction method (Colorreconstruction).

It should be understood that a video file is composed of several frames of image data. Therefore, the compression device acquires several frames of image data to be processed in time sequence, so as to sequentially process several frames of image data in time sequence.

It should be understood that UHD is Ultra High Definition, that is, ultra high definition. UHD 4k and above refers to video images with a resolution of 4K pixels and above, such as 8k pixels, 16k pixels, etc. For ease of understanding, 8K pixels are used as an example for description in this embodiment, but the principle of this solution can also be used to compress 4K pixels, 16K pixels or even higher-definition video images.

Here, the image data for displaying a video image of UHD 4K and above pixels may be the aforementioned image data in Bayer format or image data in RGB format. The image data in RGB format includes image data in RGB format itself and image data in other formats (eg, YUV format, etc.) that can be converted into RGB format.

Please continue to refer to FIG. 1, in step S120, the compression device maps the color value of each pixel in each image data to each pixel position in multiple image blocks based on the color attribute of each pixel in the image data. .

It should be understood that a pixel is the basic unit of image display. Each pixel has different color properties depending on the format of the image data in which it resides. For example, for image data in Bayer format, the color attribute of the pixel is a single color component; for image data in RGB and other formats, the color attribute of the pixel includes three colors: red (R), green (G), and blue (B). weight. Since the human eye is more sensitive to green than other colors, the number of G components is usually twice the number of other color components. Therefore, in some embodiments, the G component is represented by a Gr component or a Gb component. Wherein, each pixel has a color value corresponding to its color attribute. For example, when the image data is in Bayer format, please refer to FIG. 2 , which is a schematic diagram of an embodiment of the image data in this application. As shown in the figure, each square represents a pixel, and each pixel There is only a single color component of R or G or B, wherein the G component is represented by the Gr component and the Gb component, and the color value of each pixel in the image data is the luminance value of the single color component, that is, the color value of each pixel; when When the image data is in RGB format, the color value of each pixel in the image data includes the luminance value of each color component in the pixel.

For ease of understanding, a single image data is used as an example for illustration. It should be understood that the processing method for multiple pieces of image data is to process multiple pieces of image data respectively according to the processing method for single piece of image data, and respectively provide the processed results to step S130.

In this embodiment, the compressing device divides the image data into a plurality of image blocks based on the color attribute, in order to ensure the correlation between each pixel in the image data and each pixel in the image block, so as to be able to decode the image data. Restoring the image data, the compression device maps the color value of each pixel in each image data to each pixel position in the plurality of image blocks, respectively.

In an exemplary embodiment, in the case that each pixel in the image data represents a single color attribute, the step S120 includes: according to the color format set based on the Bayer format in the image data, traverse the The image data; wherein, during the traversal, based on the color attribute of each pixel in the color format, the color value of each pixel is extracted from the image data, and mapped to the pixel position in the corresponding image block.

Continuing to refer to Figure 2, each pixel in the image data represents a single color attribute. In this embodiment, 4 (2×2) pixels are determined as the color format 101, because when scanning Bayer data, usually the odd-numbered lines output G, R, G, R..., and the even-numbered lines output B, G, B, G . . . and thus pixel data with 4 different color attributes in one color format 101 . Taking the relative positions of pixel data of different color attributes in the pixel unit as a pixel row format, traverse the image data, thereby extracting each pixel data and forming a plurality of image blocks.

In some embodiments, please refer to FIG. 3 , which shows a schematic diagram of an embodiment of a mapping method for mapping the color value of each pixel in each image data to each pixel position in a plurality of image blocks in the present application. As shown in the figure, in this embodiment, the odd-numbered rows in the image data are Gr, R, Gr, R..., and the even-numbered rows are B, Gb, B, Gb.... Here, the odd-numbered rows Gr, R, B, and Gb of even-numbered lines are determined as one color format 101 . For ease of understanding, the coordinates of all pixels in the color format 101 where the pixels in the first row and first column are defined are the origin (0, 0), that is, the color format 101 includes Gr(0, 0), R(0 , 0), B(0, 0) and Gb(0, 0). As shown in FIG. 3 , with the color format 101 as a reference, the coordinates of each pixel in the color format shifted to the right by one unit in the horizontal direction of the color format 101 are determined as (0, 1), and The coordinates of each pixel in the color format shifted to the right by 2 units in the horizontal direction of the color format 101 are determined to be (0, 2), and the color format 101 will be shifted to the right by 3 units in the horizontal direction of the color format 101. The coordinates of each pixel in the color format of the unit are determined to be (0, 3)...; Similarly, taking the color format 101 as a reference, the vertical direction of the color format 101 will be shifted downward by 1 unit The coordinates of each pixel in the color format are determined to be (1, 0), and the coordinates of each pixel in the color format shifted downward by 2 units in the vertical direction of the color format 101 are determined to be (2, 0). The coordinates of each pixel in the color format shifted downward by 3 units in the vertical direction of the color format 101 are determined to be (3, 0) . . . By traversing the entire image data according to this rule, each pixel in the image data has its position information, so that the image data can be restored by using the position information during decoding.

After determining the position information of each pixel, the compression device extracts the color value of each pixel from the image data based on the color attribute of each pixel. Here, the compression device divides all pixel data in the image data into a plurality of image blocks based on color attributes, and each image block contains only one color attribute. Please continue to refer to FIG. 3. Since the color attributes in this embodiment include four attributes of R, Gr, Gb, and B, in this embodiment, all pixel data in the image data are divided into R, Gr, Gb, and B based on color attributes. Four image blocks of Gr, Gb, and B. For example, Gr(0, 0) is divided into image blocks of Gr color attribute, Gr(0, 1) is divided into image blocks of Gr color attribute and offset to the right in the horizontal direction of Gr(0, 0) Move 1 unit, Gr(0, 2) is divided into the image block of Gr color attribute and offset 2 units to the right in the horizontal direction of Gr(0, 0), Gr(0, 3) is divided into In the image block of Gr color attribute and offset 3 units to the right in the horizontal direction of Gr(0, 0); Gr(1, 0) is divided into the image block of Gr color attribute and in Gr(0, 0 ) is shifted down by 1 unit in the vertical direction, Gr(2, 0) is divided into image blocks of the Gr color attribute and is shifted down by 2 units in the vertical direction of Gr(0, 0), Gr(0, 0) (3, 0) is divided into image blocks of Gr color attributes and is shifted downward by 3 units in the vertical direction of Gr(0, 0) ... Similarly, each pixel of R, Gb, B color attributes is also one Each image block is correspondingly divided into each image block, and each pixel position in each image block has a corresponding relationship with its pixel position in the image data, which will not be repeated here.

In another exemplary embodiment, please refer to FIG. 4 , which shows a schematic diagram of an embodiment in which each pixel in the image data in the present application represents an RGB color attribute. As shown in the figure, the image data obtained by the compression device is an RGB image. For example, the image data is debayer based on the Bayer format, that is, two other color components are fitted on the color components of each pixel shown in FIG. 2 . color components, thereby generating an RGB image. Here, when each pixel in the image data represents an RGB color attribute, the step S120 includes: traversing the image data according to the color format set based on the pixel row format in the image data; Wherein, during the traversal, based on the color attribute of each pixel in the color format, the color principal component or color fitting component of each pixel is extracted from the image data, and mapped to the pixel position in the corresponding image block.

It should be understood that since the data output by the sensor of the image capturing device is usually in Bayer format, each pixel has only a single component. However, the encoder cannot directly encode the Bayer format, and the display device cannot directly display images in the Bayer format. Therefore, it is usually necessary to debayer the Bayer format to form an RGB format. However, the amount of data processed by the Debayer is very large, three times that of the Bayer format, which causes the code stream to be too large and affects the transmission efficiency. Therefore, in some embodiments, the RGB format is also converted into a YUV format, that is, into a luminance and chrominance format, and then the chrominance is subtracted, thereby reducing the amount of data. Among them, YUV422 will reduce the data volume by 1/3, YUV420 will reduce the data volume by 1/2, but its data volume is still 2 times and 1.5 times that of the Bayer format, respectively. At the same time, converting the format to YUV422 or YUV420 will also bring about serious loss of color information, which cannot meet the needs of high image quality.

Please continue to refer to FIG. 4 , in this embodiment, each pixel in the image data has three color components, wherein the bold part in each pixel represents the main component in the pixel, and each pixel has three color components. The non-bold parts in , represent the other two components fitted based on the principal components in the pixel. 4 (2×2) pixels are determined as a color format 101, because in a color format 101, each pixel has three color components, in order to save and reduce the code stream after compression encoding, here only in each Extract a color component from a pixel.

In some embodiments, the compression device knows the main component in each pixel in advance, and then directly determines the main component in each pixel as the color component to be extracted. In other embodiments, the compression device cannot know the main component of each pixel in advance, and may determine a certain component in each pixel as the color component to be extracted according to a preset rule. Here, the preset rules are exemplified but not limited to: the rules for extracting G and R from odd-numbered rows, and the rules for extracting B and G from even-numbered rows; or the rules for extracting G and B from odd-numbered rows, and the rules for extracting R and G from even-numbered rows; Or according to the rules of extracting R and G from odd-numbered rows, and extracting G and B from even-numbered rows; or according to the rules of extracting B and G from odd-numbered rows, and extracting G and R from even-numbered rows. Wherein, when the G component is represented as a Gr component and a Gb component, the preset rules can also be exemplified but not limited to: the rules for extracting Gr and R from odd-numbered rows, and B and Gb from even-numbered rows; or extracting from odd-numbered rows. Gb, B, the rules for extracting R and Gr from even-numbered rows; or the rules for extracting R and Gr from odd-numbered rows, and the rules for extracting Gb and B from even-numbered rows; or the rules for extracting B and Gb from odd-numbered rows, and the rules for extracting Gr and R from even-numbered rows, etc. It should be understood that, due to the limited degree of recognition of the image by the human eye, the influence of any of the above extraction methods on the final imaging effect can be ignored.

Please continue to refer to FIG. 4 , in this embodiment, the compression device obtains the principal component in each pixel in advance. Here, the compression device determines the main component in each pixel as the color component to be extracted, then the color format 101 is determined as odd-numbered lines Gr, R, and even-numbered lines B, Gb.

Please refer to FIG. 5 , which is a schematic diagram of another embodiment of the mapping method for mapping the color value of each pixel in each image data to each pixel position in a plurality of image blocks in the present application. As shown in the figure, for ease of understanding, the coordinates of all pixels in the color format 101 where the pixels in the first row and first column of the image data are defined are the origin (0, 0), that is, the color format 101 includes R Gr B(0, 0), R G B(0, 0), R G B(0, 0), and R G B(0, 0). As shown in FIG. 5 , with the color format 101 as a reference, the coordinates of each pixel in the color format shifted to the right by one unit in the horizontal direction of the color format 101 are determined as (0, 1), and The coordinates of each pixel in the color format shifted to the right by 2 units in the horizontal direction of the color format 101 are determined to be (0, 2), and the color format 101 will be shifted to the right by 3 units in the horizontal direction of the color format 101. The coordinates of each pixel in the color format of the unit are determined to be (0, 3)...; Similarly, taking the color format 101 as a reference, the vertical direction of the color format 101 will be shifted downward by 1 unit The coordinates of each pixel in the color format are determined to be (1, 0), and the coordinates of each pixel in the color format shifted downward by 2 units in the vertical direction of the color format 101 are determined to be (2, 0). The coordinates of each pixel in the color format shifted downward by 3 units in the vertical direction of the color format 101 are determined to be (3, 0) . . . By traversing the entire image data according to this rule, each pixel in the image data has its position information, so that the image data can be restored by using the position information during decoding.

After determining the position information of each pixel, the compression device extracts the color value of each pixel from the image data based on the color attribute of each pixel. Since the compression device knows the principal component in each pixel in advance, the compression device only needs to extract the principal component in each pixel. Here, the compression device divides all principal components in the image data into a plurality of image blocks based on color attributes, and each image block contains only one color attribute. Please continue to refer to FIG. 5. Since the color attributes in this embodiment include four attributes of R, Gr, Gb, and B, in this embodiment, all pixel data in the image data are divided into R, Gr, Gb, and B based on color attributes. Four image blocks of Gr, Gb, and B. For example, Gr(0, 0) is divided into image blocks of Gr color attribute, Gr(0, 1) is divided into image blocks of Gr color attribute and offset to the right in the horizontal direction of Gr(0, 0) Move 1 unit, Gr(0, 2) is divided into the image block of Gr color attribute and offset 2 units to the right in the horizontal direction of Gr(0, 0), Gr(0, 3) is divided into In the image block of Gr color attribute and offset 3 units to the right in the horizontal direction of Gr(0, 0); Gr(1, 0) is divided into the image block of Gr color attribute and in Gr(0, 0 ) is shifted down by 1 unit in the vertical direction, Gr(2, 0) is divided into image blocks of the Gr color attribute and is shifted down by 2 units in the vertical direction of Gr(0, 0), Gr(0, 0) (3, 0) is divided into image blocks of Gr color attributes and is shifted downward by 3 units in the vertical direction of Gr(0, 0) ... Similarly, each pixel of R, Gb, B color attributes is also one Each image block is correspondingly divided into each image block, and each pixel position in each image block has a corresponding relationship with its pixel position in the image data, which will not be repeated here.

In other embodiments, the compression device does not have prior knowledge of the principal components in each pixel. Here, according to the rules of extracting Gr and R from odd-numbered rows, and extracting B and Gb from even-numbered rows; extracting Gb and B from odd-numbered rows, and extracting R and Gr from even-numbered rows; extracting R and Gr from odd-numbered rows and extracting even-numbered rows The rules for Gb and B; the rules for extracting B and Gb from odd-numbered lines and the rules for extracting Gr and R from even-numbered lines are given as examples.

Please refer to FIG. 8 , which is a schematic diagram of another embodiment in which each pixel in the image data in the present application represents an RGB color attribute. In this embodiment, the compression device does not know in advance the principal components in each pixel. Here, the color components to be extracted are determined by the rules of extracting Gr and R from odd lines and B and Gb from even lines, and the color format is determined as Gr and R for odd lines and B and Gb for even lines. Since the compression method of the embodiment shown in FIG. 5 is the same when the color format is odd-numbered lines Gr and R, and even-numbered lines B and Gb, it will not be repeated.

Please refer to FIG. 9 , which is a schematic diagram of another embodiment when the compression device in the present application does not know the principal component in each pixel in advance. In this embodiment, the color components to be extracted are determined according to the rules of extracting Gb and B for odd rows and R and Gr for even rows, and the color format 101 is determined as odd rows Gb and B and even rows R and Gr.

Please refer to FIG. 10 , which shows the mapping of mapping the color value of each pixel in each image data to each pixel position in a plurality of image blocks when the compression device in the present application does not know the principal component in each pixel in advance. A schematic diagram of an embodiment of the method. As shown in the figure, for ease of understanding, the coordinates of all pixels in the color format 101 where the pixels in the first row and first column of the image data are defined are the origin (0, 0), that is, the color format 101 includes R Gb B(0, 0), R GB(0, 0), R G B(0, 0), and R Gr B(0, 0). As shown in FIG. 10 , based on the color format 101, the coordinates of each pixel in the color format shifted to the right by one unit in the horizontal direction of the color format 101 are determined as (0, 1), and The coordinates of each pixel in the color format shifted to the right by 2 units in the horizontal direction of the color format 101 are determined to be (0, 2), and the color format 101 will be shifted to the right by 3 units in the horizontal direction of the color format 101. The coordinates of each pixel in the color format of the unit are determined to be (0, 3)...; Similarly, taking the color format 101 as a reference, the vertical direction of the color format 101 will be shifted downward by 1 unit The coordinates of each pixel in the color format are determined to be (1, 0), and the coordinates of each pixel in the color format shifted downward by 2 units in the vertical direction of the color format 101 are determined to be (2, 0). The coordinates of each pixel in the color format shifted downward by 3 units in the vertical direction of the color format 101 are determined to be (3, 0) . . . By traversing the entire image data according to this rule, each pixel in the image data has its position information, so that the image data can be restored by using the position information during decoding.

After determining the position information of each pixel, the compression device extracts the color value of each pixel from the image data based on the color attribute of each pixel and divides it into a plurality of image blocks, and each image block contains only one type of color properties. Please continue to refer to FIG. 10. Since the color attributes in this embodiment include four attributes of R, Gr, Gb, and B, in this embodiment, all pixel data in the image data are divided into R, Gr, Gb, and B based on color attributes. Four image blocks of Gr, Gb, and B. For example, Gb(0,0) is divided into image blocks of Gb color attribute, Gb(0,1) is divided into image blocks of Gb color attribute and is offset to the right in the horizontal direction of Gb(0,0) Shifted by 1 unit, Gb(0, 2) is divided into the image block of Gb color attribute and shifted to the right by 2 units in the horizontal direction of Gb(0, 0), Gb(0, 3) is divided into In the image block of Gb color attribute and offset 3 units to the right in the horizontal direction of Gb(0,0); Gb(1,0) is divided into the image block of Gb color attribute and in Gb(0,0 ) is shifted down by 1 unit in the vertical direction, Gb(2, 0) is divided into the image block of the Gb color attribute and is shifted down by 2 units in the vertical direction of Gb(0, 0), Gb (3, 0) is divided into image blocks of Gb color attribute and is shifted downward by 3 units in the vertical direction of Gb (0, 0) ... Similarly, each pixel of B, R, Gr color attributes is also one Each image block is correspondingly divided into each image block, and each pixel position in each image block has a corresponding relationship with its pixel position in the image data, which will not be repeated here.

Please refer to FIG. 11 , which is a schematic diagram of yet another embodiment when the compression device in the present application does not know the principal component in each pixel in advance. In this embodiment, the color components to be extracted are determined according to the rules of extracting R and Gr for odd lines and Gb and B for even lines, and the color format 101 is determined as R and Gr for odd lines and Gb and B for even lines.

Please refer to FIG. 12 , which shows the mapping of mapping the color value of each pixel in each image data to each pixel position in a plurality of image blocks when the compression device in the present application does not know the principal component in each pixel in advance. A schematic diagram of another embodiment of the method. As shown in the figure, for ease of understanding, the coordinates of all pixels in the color format 101 where the pixels in the first row and first column of the image data are defined are the origin (0, 0), that is, the color format 101 includes RGB(0,0), RGrB(0,0), RGBB(0,0), and RGB(0,0). As shown in FIG. 10 , based on the color format 101, the coordinates of each pixel in the color format shifted to the right by one unit in the horizontal direction of the color format 101 are determined as (0, 1), and The coordinates of each pixel in the color format shifted to the right by 2 units in the horizontal direction of the color format 101 are determined to be (0, 2), and the color format 101 will be shifted to the right by 3 units in the horizontal direction of the color format 101. The coordinates of each pixel in the color format of the unit are determined to be (0, 3)...; Similarly, taking the color format 101 as a reference, the vertical direction of the color format 101 will be shifted downward by 1 unit The coordinates of each pixel in the color format are determined to be (1, 0), and the coordinates of each pixel in the color format shifted downward by 2 units in the vertical direction of the color format 101 are determined to be (2, 0). The coordinates of each pixel in the color format shifted downward by 3 units in the vertical direction of the color format 101 are determined to be (3, 0) . . . By traversing the entire image data according to this rule, each pixel in the image data has its position information, so that the image data can be restored by using the position information during decoding.

After determining the position information of each pixel, the compression device extracts the color value of each pixel from the image data based on the color attribute of each pixel and divides it into a plurality of image blocks, and each image block contains only one type of color properties. Please continue to refer to FIG. 10. Since the color attributes in this embodiment include four attributes of R, Gr, Gb, and B, in this embodiment, all pixel data in the image data are divided into R, Gr, Gb, and B based on color attributes. Four image blocks of Gr, Gb, and B. For example, R(0,0) is assigned to the image block of R color attribute, R(0,1) is assigned to the image block of R color attribute and is offset to the right in the horizontal direction of R(0,0) Move 1 unit, R(0, 2) is divided into the image block of R color attribute and offset 2 units to the right in the horizontal direction of R(0, 0), R(0, 3) is divided into In the image block of R color attribute and offset 3 units to the right in the horizontal direction of R(0,0); R(1,0) is divided into the image block of R color attribute and in R(0,0 ) is shifted down by 1 unit in the vertical direction, R(2, 0) is divided into the image block of the R color attribute and is shifted down by 2 units in the vertical direction of R(0, 0), R (3, 0) is divided into image blocks of R color attribute and is shifted downward by 3 units in the vertical direction of R(0, 0) ... Similarly, each pixel of Gr, Gb, B color attributes is also one Each image block is correspondingly divided into each image block, and each pixel position in each image block has a corresponding relationship with its pixel position in the image data, which will not be repeated here.

Please refer to FIG. 13 , which is a schematic diagram of another embodiment when the compression device in the present application does not know the principal component of each pixel in advance. In this embodiment, the color components to be extracted are determined according to the rules of extracting B and Gb from odd-numbered rows and Gr and R from even-numbered rows.

Please refer to FIG. 14 , which shows the mapping of mapping the color value of each pixel in each image data to each pixel position in a plurality of image blocks when the compression device in this application does not know the principal component in each pixel in advance. A schematic diagram of yet another embodiment of the method. As shown in the figure, for ease of understanding, the coordinates of all pixels in the color format 101 where the pixels in the first row and first column of the image data are defined are the origin (0, 0), that is, the color format 101 includes R G B(0,0), RGb B(0,0), R Gr B(0,0) and R G B(0,0). As shown in FIG. 14 , based on the color format 101, the coordinates of each pixel in the color format shifted to the right by one unit in the horizontal direction of the color format 101 are determined as (0, 1), and The coordinates of each pixel in the color format shifted to the right by 2 units in the horizontal direction of the color format 101 are determined to be (0, 2), and the color format 101 will be shifted to the right by 3 units in the horizontal direction of the color format 101. The coordinates of each pixel in the color format of the unit are determined to be (0, 3)...; Similarly, taking the color format 101 as a reference, the vertical direction of the color format 101 will be shifted downward by 1 unit The coordinates of each pixel in the color format are determined to be (1, 0), and the coordinates of each pixel in the color format shifted downward by 2 units in the vertical direction of the color format 101 are determined to be (2, 0). The coordinates of each pixel in the color format shifted downward by 3 units in the vertical direction of the color format 101 are determined to be (3, 0) . . . By traversing the entire image data according to this rule, each pixel in the image data has its position information, so that the image data can be restored by using the position information during decoding.

After determining the position information of each pixel, the compression device extracts the color value of each pixel from the image data based on the color attribute of each pixel and divides it into a plurality of image blocks, and each image block contains only one type of color properties. Please continue to refer to FIG. 10. Since the color attributes in this embodiment include four attributes of R, Gr, Gb, and B, in this embodiment, all pixel data in the image data are divided into R, Gr, Gb, and B based on color attributes. Four image blocks of Gr, Gb, and B. For example, B(0, 0) is divided into image blocks of B color attribute, B(0, 1) is divided into image blocks of B color attribute and is offset to the right in the horizontal direction of B(0, 0) Move 1 unit, B(0, 2) is divided into the image block of B color attribute and offset 2 units to the right in the horizontal direction of B(0, 0), B(0, 3) is divided into In the image block of B color attribute and offset 3 units to the right in the horizontal direction of B(0,0); B(1,0) is divided into the image block of B color attribute and in B(0,0 ) is shifted down by 1 unit in the vertical direction, B(2, 0) is divided into the image block of the B color attribute and is shifted down by 2 units in the vertical direction of B(0, 0), B (3, 0) is divided into image blocks of B color attribute and is shifted downward by 3 units in the vertical direction of B(0, 0) ... Similarly, each pixel of Gb, Gr, R color attributes is also one Each image block is correspondingly divided into each image block, and each pixel position in each image block has a corresponding relationship with its pixel position in the image data, which will not be repeated here.

It should be understood that the mapping relationship is determined in the form of coordinates for ease of understanding in the above embodiments, but in some implementation manners, each pixel is extracted from the image data based on the color attribute of each pixel in the color format. The method of mapping the color value to the pixel position in the corresponding image block is not limited to determining the mapping relationship by coordinates, but can also include any information such as serial numbers that can be identified by the compression device for determining the mapping relationship.

In step S130, the compressing device compresses image blocks corresponding to each of the multiple pieces of image data and having the same color attribute to obtain a video file. Here, the plurality of image blocks obtained in step S120 are input to the encoder for encoding. Wherein, the coding standard may be adopted, including but not limited to: H.265 or AVS2, that is, the second-generation digital audio and video coding and decoding technology standard, and the like.

In some embodiments, the encoder may be integrated in the compression device, for example, the processing apparatus of the compression device coordinates the encoder to perform step S130 after performing steps S110 and S120. Alternatively, the encoder may also be an independent terminal device or a server. The encoder includes a processing module capable of logic control and digital operation, and a storage module for storing intermediate data generated during the operation of the processing module. Wherein, the processing module includes, for example, any one or a combination of the following: FPGA, MCU, CPU, and the like. Examples of the storage module include any one or a combination of the following: volatile memory such as registers, stacks, and caches.

It should be understood that a video encoder is a program or device capable of compressing digital video. Usually, the data in Bayer format cannot be directly encoded by the encoder because each pixel has only a single color attribute and lacks the other two color attributes. It is necessary to debayer the data in Bayer format to generate RGB format, or convert it into YUV format before entering the encoder encoding. In this embodiment, since the pixels in each image block only include a single color attribute, the insufficient number of bits can be temporarily filled with 0 when entering the encoder, so that on the one hand, the image block can be compatible with existing The encoder in the technology, on the other hand, facilitates the calculation of the encoder and ensures the processing efficiency of the encoder.

In an exemplary embodiment, a plurality of image blocks may be processed by one encoder. Here, the step S130 includes: according to the color attributes in the color format, the corresponding image data of the multiple pieces of image data are processed. A plurality of image blocks are sequentially input to a first encoder for compression processing.

Please refer to FIG. 6 , which is a schematic diagram of an embodiment of using a first encoder to perform compression processing in the present application. As shown in the figure, the figure shows a plurality of image blocks generated by the image data of 4 different frames of ①, ②, ③, ④, wherein each image block in each serial number only includes a single color attribute. Here, a plurality of image blocks are input into a first encoder according to a preset order for compression encoding. Wherein, the preset order includes but is not limited to: based on the time when the image data corresponding to the image block is acquired, or based on the color attribute of the image block and the like.

In some embodiments, the preset order is determined based on the time when the image data corresponding to the image block is acquired. Please refer to FIG. 7 , which is a schematic diagram of another embodiment of the present application using a first encoder to perform compression processing. As shown in the figure, in this embodiment, the four image blocks with the serial number ① are first input to the first encoder 102 for compression processing, and then the four image blocks with the serial number ② are input into the first encoder 102 for processing In the compression process, the four image blocks with serial number ③ are then input to the first encoder 102 for compression processing, and finally the four image blocks with serial number ④ are input into the first encoder 102 for compression processing.

In some other embodiments, the preset order is determined based on the color attributes of the image blocks. Please continue to refer to FIG. 6 . First, the image blocks whose color attribute is Gr is input to the first encoder 102 for compression processing. Then input the image block whose color attribute is R to the first encoder 102 for compression processing, then input the image block whose color attribute is B to the first encoder 102 for compression processing, and finally input the image block whose color attribute is Gb to the first encoder 102 for compression processing. Since the color difference between adjacent frames is small, the method in this embodiment can greatly reduce the amount of computation and improve the compression efficiency.

In an exemplary embodiment, in order to improve the efficiency of compression processing, multiple image blocks may be processed by multiple encoders respectively. Here, the step S130 includes: under synchronization control, using multiple second image blocks The encoder compresses multiple image blocks with the same color attribute respectively.

In some embodiments, in order to distinguish image blocks generated from image data of different frames, the step S130 further includes: a video file obtained by performing compression processing with multiple second encoders includes a video file for decompressing the video file to Synchronization information set for restoring multiple image data. Here, the second encoder will generate synchronization information for each image block, and the synchronization information includes but is not limited to timestamps, serial numbers, etc. For example, images of the same frame have the same timestamp, and images of different frames The images have different time stamps, so that the image blocks with the same time stamp can be restored into one image data at the decoding end. For another example, images of the same frame have the same sequence number, and images of different frames have different sequence numbers, so that the image blocks with the same sequence number are restored into one image data at the decoding end. Wherein, since there is an error in the time mechanism of different second encoders, a synchronization server can be used to perform time synchronization on the multiple second encoders to coordinate the time mechanisms of the multiple second encoders to keep the same or control the error. within acceptable limits. Wherein, the server includes but is not limited to an NTP (Network Time Protocol) server and the like. In still other embodiments, based on a synchronization protocol, one of the plurality of second encoders can perform synchronization control on the other second encoders, so as to coordinate the other second encoders to be in the same time mechanism Or control the error within an acceptable range. Wherein, the synchronization protocol includes but is not limited to the 1588 protocol and the like.

In an exemplary embodiment, the image data is in Bayer format or other formats other than RGB format, such as YUV format and the like. Then, the image data needs to be converted into RGB or Bayer format, and then compressed according to the above-mentioned compression processing method, and the compression processing method will not be repeated here.

The image data compressed by the technical idea provided by the above-mentioned compression method can be stored on a storage medium, or data can be transmitted between devices or within a device by using a communication transmission method of 60 Mbps and above. For example, in a camcorder with integrated recording and playback, each hardware constituting the compression device compresses the captured image data into corresponding compressed image data under the instruction dispatch of the software, and saves it in the storage device. When the user operates the camcorder to play the compressed image data, each hardware constituting the decompression device decompresses the compressed image data and plays (or displays) the compressed image data under the instruction dispatch of the software. For another example, the imaging device that can execute the compression method compresses the captured image data into corresponding compressed image data (such as a compressed file or a code stream), and utilizes a wireless transmission method, optical fiber transmission based on the 5G communication protocol. The compressed image data is transmitted to a server by means of other transmission methods, and a decompression device arranged in the server decompresses the compressed image data and plays (or displays) the compressed image data.

The compression method of the present application can ensure the stability of transmission while ensuring the clarity of the ultra-high-definition video. The amount of data compressed and encoded by the compression method of the present application can be transmitted by the current 4K encoder to realize the transmission of 8K images. The problem of difficult transmission of ultra-high-definition video in the prior art is solved.

Embodiments of the second aspect of the present application further provide a video file decompression method, the decompression method is mainly completed by an image decompression device, wherein the decompression device may be a terminal device, or server. Here, the terminal device may be a terminal device, a server, or the like.

Wherein, the terminal equipment includes but is not limited to playback equipment, electronic terminal equipment for personal use, and the like. The playback device includes a storage device, a processing device, and may also include an interface device and the like. Among other things, the storage device may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. The storage device also includes a memory controller that controls access to the memory by other components of the device, such as the CPU and peripheral interfaces. The storage device is used to store at least one program and image data to be decompressed. The programs stored in the storage device include an operating system, a communication module (or instruction set), a graphics module (or instruction set), a text input module (or instruction set), and an application (or instruction set). The program in the storage device further includes an instruction set for performing a decompression operation on the image data in time series based on the technical solution provided by the decompression method. The processing device includes, but is not limited to: CPU, GPU, FPGA (Field-Programmable Gate Array), ISP (Image Signal Processing image processing chip), or other devices that include at least A program's processing chip (such as an AI-specific chip), etc. The processing device invokes and executes at least one program stored in the storage device to perform decompression processing on the stored image data according to the decompression method. Among them, using a processing device that can process matrix data in parallel, such as an FPGA, is more suitable for efficient and real-time decompression processing of the acquired image data. The interface device includes, but is not limited to, a data line interface and a network interface; examples of the data line interface include: display interfaces such as VGA interface and HDMI interface, serial interfaces such as USB, and parallel interfaces such as data bus. Examples of network interfaces include at least one of the following: a short-range wireless network interface such as a Bluetooth protocol-based network interface and a WiFi network interface, such as a wireless network interface based on a 3G, 4G, or 5G protocol for a mobile network, such as a wired network interface that includes a network card Wait. The playback device further includes a display device for displaying the decompressed image data. The display device at least includes a display screen, a display screen controller, etc., wherein the display screen includes a liquid crystal display screen, a curved display screen, a touch screen and the like. Examples of the display screen controller include a processor dedicated to the display device, a processor integrated with the processor in the processing device, and the like. In some scenarios, the playback device sets a traffic command center for decompressing and displaying the compressed image data transmitted from the camera device. In other scenarios, the playback device is configured on a computer device that is communicatively connected to the minimally invasive medical device, which is connected to the minimally invasive medical device through an optical fiber or other special data line, and connects the current minimally invasive medical device with the information provided by the minimally invasive medical device. The compressed image data is decompressed and played. In other scenarios, the playback device is configured in the computer room of the TV forwarding center, and is used for decompressing and playing the compressed image data transmitted from the camera device set on the field for video editing. In other scenarios, the playback device is a set-top box, which is used to decompress the code stream in the corresponding TV channel in the TV signal and output it to the TV set for display.

The electronic terminal equipment for personal use includes desktop computers, notebook computers, tablet computers, and splicing equipment specially used for producing TV programs, movies, TV dramas, and the like. The electronic terminal equipment includes a storage device and a processing device. Wherein, the storage device and the processing device may be the same as or similar to the corresponding devices in the aforementioned camera equipment, and will not be described in detail here. The electronic terminal device may further include display means for displaying the decompressed image data. Here, in some examples, the hardware and software modules of the electronic terminal may be the same as or similar to the corresponding devices in the aforementioned playback device, which will not be repeated here. In still other examples, the electronic terminal device may further include an image acquisition interface for acquiring compressed image data derived from compression. The image acquisition interface may be a network interface, a data line interface, or a program interface. Wherein, the network interface and the data line interface may be the same as or similar to the corresponding devices in the aforementioned playback device, and will not be described in detail here. For example, through the network interface, the processing device of the electronic terminal device downloads the compressed image data from the Internet. For another example, through the data line interface, the processing device of the electronic terminal device obtains the editing file from the storage device.

The server includes, but is not limited to, a single server, a server cluster, a distributed server, a server based on cloud technology, and the like. Wherein, the server includes a storage device, a processing device, an image acquisition interface, and the like. The storage device and the processing device may be configured in the same entity server device, or configured in multiple entity server devices according to the division of labor of each entity server device. The image acquisition interface may be a network interface or a data line interface. The storage device, processing device, image acquisition interface, etc. included in the server can be the same as the corresponding devices mentioned in the aforementioned terminal equipment; each corresponding device. For example, the storage device may also include a solid state drive or the like. For example, the processing device may also include a CPU dedicated to a server or the like. The image acquisition interface in the server acquires compressed image data and playback instructions from the Internet, and the processing device executes the decompression method described in the present application on the acquired compressed image data based on the playback instructions.

Based on the demand for decompressing image data generated by any of the above scenarios, the present application provides a decompression method for obtaining a video file. Please refer to FIG. 15 , which shows the flow of the decompression method in one embodiment. picture.

In step S210, a video file is acquired. Wherein, the video file is obtained by compressing graphic data according to the compression method in the present application.

In some embodiments, the video file may come from a storage medium, or the video file may be transmitted to a decompression device using a communication transmission mode of 60 Mbps and above. Wherein, the transmission method includes but is not limited to: wireless transmission method based on 5G communication protocol, or optical fiber transmission.

In step S220, the video file is decompressed according to the compression method used for the corresponding video file to obtain a plurality of image blocks; wherein, according to the color attribute of each image block, the obtained plurality of image blocks and Each of the multiple pieces of image data to be generated corresponds to each piece of image data.

Here, the video file obtained in step S210 is input to the decoder for decoding. Wherein, the decoding standard may include, but is not limited to, H.265 or AVS2, that is, the second-generation digital audio and video codec technology standard, and the like.

In some embodiments, the decoder may be integrated in the decompression device, for example, the processing apparatus of the decompression device coordinates the decoder to perform step S220 after performing step S210. Alternatively, the decoder may also be an independent terminal device or a server. The decoder includes a processing module capable of logic control and digital operations, and a storage module for storing intermediate data generated during the operation of the processing module. Wherein, the processing module includes, for example, any one or a combination of the following: FPGA, MCU, CPU, and the like. Examples of the storage module include any one or a combination of the following: volatile memory such as registers, stacks, and caches.

In an exemplary embodiment, multiple image blocks may be processed separately by one decoder. Here, the step S220 includes: using the first decoder to decompress the received video file to obtain the basis Groups of image blocks divided by different color attributes in the color format. Wherein, each image block in each group of image blocks corresponds to a piece of image data to be generated.

Here, the first decoder performs decompression processing on the received video file according to the compression coding method of the image block by the encoder during compression coding. And after obtaining multiple groups of image blocks through decoding by the first decoder, the first decoder determines the correspondence between the multiple image blocks according to the obtained image block order and compression coding rules, so as to convert the multiple image blocks into multiple groups. Image blocks generate image data.

In some embodiments, please refer to FIG. 16 , which shows a schematic diagram of an embodiment of decompression processing using a first decoder in the present application. In this embodiment, during the compression encoding, the encoder performs compression encoding on a plurality of image blocks based on the time rule when the image data corresponding to the image blocks are acquired. Therefore, as shown in FIG. 16 , the first decoder sequentially obtains the image block with the Gr color attribute numbered ①, the image block with the R color attribute numbered ①, and the image block with the B color attribute numbered ① , the image block with the Gb color attribute numbered ①, the image block with the Gr color attribute numbered ②, the image block with the R color attribute numbered ②…. Here, the corresponding relationship between multiple image blocks is determined according to the rules when the encoder performs compression coding, such as the image block with the Gr color attribute numbered ①, the image block with the R color attribute numbered ①, and the image block with the R color attribute numbered ① The image block of B color attribute and the image block of Gb color attribute numbered ① are all from the same image data, the image block of Gr color attribute numbered ②, the image block of R color attribute numbered ②, the image block numbered ② The image block of the B color attribute and the image block of the Gb color attribute numbered ② all come from the same image data and are located after ① in order, etc.

In other embodiments, please refer to FIG. 17 , which is a schematic diagram of another embodiment of using a first decoder to perform decompression processing in the present application. In this embodiment, during the compression encoding, the encoder performs compression encoding on a plurality of image blocks based on the rules of the color attributes of the image blocks. Therefore, as shown in FIG. 17 , the first decoder sequentially obtains the image block with the Gr color attribute numbered ①, the image block with the Gr color attribute numbered ②, and the image block with the Gr color attribute numbered ③ , the image block with the Gr color attribute numbered ④, the image block with the R color attribute numbered ①, the image block with the R color attribute numbered ②…. Here, the corresponding relationship between multiple image blocks is determined according to the rules when the encoder performs compression coding, such as the image block with the Gr color attribute numbered ①, the image block with the R color attribute numbered ①, and the image block with the R color attribute numbered ① The image block of B color attribute and the image block of Gb color attribute numbered ① are all from the same image data, the image block of Gr color attribute numbered ②, the image block of R color attribute numbered ②, the image block numbered ② The image block of the B color attribute and the image block of the Gb color attribute numbered ② all come from the same image data and are located after ① in order, etc.

In another exemplary embodiment, in order to improve the efficiency of decompression processing, multiple image blocks may be processed by multiple decoders respectively. Here, the step S220 includes: under synchronization control, using multiple decoders Each second decoder decompresses the video file according to the color attribute; wherein, each second decoder outputs a plurality of image blocks with the same color attribute; wherein, each image block is associated with an image to be generated. corresponding to the image data. In some embodiments, in order to distinguish image blocks generated from image data of different frames, each second decoder determines the decompressed image blocks and an image to be generated according to synchronization information in the video file Correspondence between data.

Here, the second decoder generates synchronization information for each image block, and the synchronization information includes but is not limited to timestamps, serial numbers, etc. For example, images of the same frame have the same timestamp, and images of different frames have the same The images have different time stamps, so that the image blocks with the same time stamp can be restored into one image data at the decoding end. For another example, images of the same frame have the same sequence number, and images of different frames have different sequence numbers, so that the image blocks with the same sequence number are restored into one image data at the decoding end. Wherein, since there is an error in the time mechanism of different second decoders, a synchronization server can be used to synchronize the time of the plurality of second decoders to coordinate the time mechanisms of the plurality of second decoders to keep the same or to control the error. within acceptable limits. Wherein, the server includes but is not limited to an NTP (Network Time Protocol) server and the like. In still other embodiments, based on a synchronization protocol, one of the plurality of second decoders can perform synchronization control on the other second decoders, so as to coordinate the other second decoders to be in the same time mechanism Or control the error within an acceptable range. Wherein, the synchronization protocol includes but is not limited to the 1588 protocol and the like.

Please continue to refer to FIG. 15 , after obtaining multiple image blocks through the above-mentioned decompression method, the decompression device provides the obtained multiple image blocks to step S230 .

In step S230, according to the color attribute, the color value of each pixel position in each corresponding image block is mapped to the pixel of the image data.

It should be understood that a pixel is the basic unit of image display. Each pixel has different color properties depending on the format of the image data in which it resides. For example, for image data in Bayer format, the color attribute of the pixel is a single color component; for image data in RGB and other formats, the color attribute of the pixel includes three colors: red (R), green (G), and blue (B). weight. Since the human eye is more sensitive to green than other colors, the number of G components is usually twice the number of other color components. Therefore, in some embodiments, the G component is represented by a Gr component or a Gb component. Wherein, each pixel has a color value corresponding to its color attribute. For example, when the image data is in Bayer format, there is only a single color component of R or G or B in each pixel, wherein the G component is represented by a Gr component and a Gb component, and the color value of each pixel in the image data is this The luminance value of a single color component, that is, the color value of each pixel; when the image data is in RGB format, the color value of each pixel in the image data includes the luminance value of each color component in the pixel.

In an exemplary embodiment, please refer to FIG. 18 , which shows a schematic diagram of an embodiment in which the decompression device in the present application maps the color value of each pixel position in each corresponding image block to the pixel of the image data. Here, after the decompression device acquires multiple image blocks, according to the mapping relationship between the pixel positions in the image blocks and the pixel positions in the image data corresponding to the image block, the color value of each pixel in the image block is Map to pixel positions in the corresponding image data, thereby restoring multiple image blocks into image data. As shown in FIG. 18 , each pixel in a plurality of image blocks of the decompression device is mapped into image data according to its position information, wherein the pixels with the same position information and different color attributes are arranged according to their color format during compression. For example: Gr(0,0), R(0,0), B(0,0), Gb(0,0) are all mapped to the (0,0) position in the image data, at the same time, according to the compression When odd-numbered lines extract Gr, R, and even-numbered lines extract the format of B, Gb, and arrange Gr(0,0), R(0,0), B(0,0), Gb(0,0) according to the color format . Similarly, other pixels in the image block are also mapped to the image data according to the above method. Therefore, the step S230 further includes: according to the color format, traversing the pixel positions in the image blocks of each color attribute, and during the traversing, mapping the color values of the corresponding pixel positions in each image block to the corresponding pixel positions in the image data. pixel position to generate image data; wherein the color value of each pixel position in the image data represents a single color attribute. Here, the decompression device respectively processes the multiple image blocks according to the above method, and sends the generated multiple image data to step S240 in sequence.

It should be understood that the color format in this embodiment is determined according to the color format during compression, and the method for determining the color format has been described in the implementation of the first aspect of this application, so it will not be repeated here.

In step S240, based on the color value of each pixel in the image data, a video image for displaying UHD 4K and above pixels is generated.

It should be understood that UHD is Ultra High Definition, that is, ultra high definition. UHD 4k and above refers to video images with a resolution of 4K pixels and above, such as 8k pixels, 16k pixels, etc. For ease of understanding, 8K pixels are used as an example for description in this embodiment, but the principle of this solution can also be used to compress 4K pixels, 16K pixels or even higher-definition video images.

Here, the image data provided in step S230 is equivalent to the image data in Bayer format. In some embodiments, in order to facilitate display, the decompression device performs Debayer and other processing on the image data provided in step S230, thereby generating an RGB image for display. Therefore, the step S240 further includes: performing interpolation processing on each pixel position in the obtained image data according to the color format to obtain a video image containing RGB color attributes in each pixel. The RGB image includes image data in RGB format itself and image data in other formats (eg, YUV format, etc.) that can be converted into RGB format.

It should be understood that Debayer is mosaic processing, which is a digital image processing algorithm whose purpose is to reconstruct a full-color image from the incomplete color samples output by a photosensitive element covered with a color filter array (CFA). . This method is also called color filter array interpolation (CFAinterpolation) or color reconstruction method (Colorreconstruction).

Please refer to FIG. 19 , which is a schematic diagram of an embodiment of the compression device in this application. As shown in the figure, the compression device includes: a communication interface for communicating with an external decompression device; a memory for storing at least one A program and image data to be compressed; a processor for coordinating a communication interface and a memory to execute the program, during execution, according to the compression method for obtaining a video file as described in any of the embodiments of the first aspect of the present application, The image data is compressed to obtain a video file.

Among them, the memory includes a non-volatile memory, a storage server, and the like. Wherein, the non-volatile memory is, for example, a solid state disk or a U disk. The storage server is used for storing various obtained power consumption related information and power supply related information. The communication interface includes a network interface, a data line interface, and the like. The network interfaces include but are not limited to: Ethernet network interface devices, network interface devices based on mobile networks (3G, 4G, 5G, etc.), network interface devices based on short-range communication (WiFi, Bluetooth, etc.), and the like. The data line interface includes but is not limited to: USB interface, RS232, etc. The communication interface is connected with data of various sensing devices, third-party systems, the Internet, and the like. The processor is connected to the communication interface and the memory, and includes at least one of a CPU or a chip integrated with the CPU, a programmable logic device (FPGA) and a multi-core processor. The processor also includes memory, registers, etc., for temporary storage of data.

The communication interface is used for communication connection with an external decompression device. Here, the communication interface includes, for example, a network card, which is communicatively connected to the decompression device through the Internet or a built-in dedicated network. For example, the communication interface sends the video file compressed by the compression device to the decompression device.

The memory is used to store at least one program and image data to be compressed. Here, the memory includes, for example, a memory card provided in a compression device.

The processor is configured to invoke the at least one program to coordinate the communication interface and the memory to execute the compression method mentioned in any of the foregoing examples.

Please refer to FIG. 20 , which is a schematic diagram of an embodiment of the decompression device in this application. As shown in the figure, the decompression device includes: a communication interface for communicating with an external compression device; a memory for storing at least A program and a video file to be decompressed; a processor for coordinating a communication interface and a memory to execute the program, during execution according to the decompression of the video file as described in any of the embodiments of the second aspect of the present application The method decompresses the video file so as to play the video file.

Among them, the memory includes a non-volatile memory, a storage server, and the like. Wherein, the non-volatile memory is, for example, a solid state disk or a U disk. The storage server is used for storing various obtained power consumption related information and power supply related information. The communication interface includes a network interface, a data line interface, and the like. The network interfaces include but are not limited to: Ethernet network interface devices, network interface devices based on mobile networks (3G, 4G, 5G, etc.), network interface devices based on short-range communication (WiFi, Bluetooth, etc.), and the like. The data line interface includes but is not limited to: USB interface, RS232, etc. The communication interface is connected with data of various sensing devices, third-party systems, the Internet, and the like. The processor is connected to the communication interface and the memory, and includes at least one of a CPU or a chip integrated with the CPU, a programmable logic device (FPGA) and a multi-core processor. The processor also includes memory, registers, etc., for temporary storage of data.

The communication interface is used for communication connection with an external compression device. Here, the communication interface includes, for example, a network card, which is communicatively connected to the compression device through the Internet or a built-in dedicated network. For example, the communication interface receives a video file that has been compressed and processed by the compression device, and provides the video file to the processor.

The memory is used to store at least one program and a video file to be decompressed. Here, the memory includes, for example, a memory card provided in the decompression device.

The processor is configured to call the at least one program to coordinate the communication interface and the memory to execute the decompression method mentioned in any of the foregoing examples, so as to decompress the video file so as to play the video file.

Based on any of the compression and decompression methods provided above, the present application also provides a video transmission system, please refer to FIG. 21 , which is a schematic structural diagram of the video transmission system in an embodiment of the present application. The video transmission system includes any one of the aforementioned compression devices and decompression devices.

Here, the video transmission system includes a communication interface, a memory, and a processor. Wherein, the communication interface may include a network interface, a data line interface, or a program interface or the like. During the compression, the image data in the camera or the Internet is acquired through the communication interface of the compression device, and the processing device executes the compression operation by calling the program stored in the memory, so as to compress and encode the acquired image data into a video file , and stored in the storage device. When the video transmission system displays the video file based on user operation, the processing device executes the decompression operation by calling the program in the storage device, and displays the image data obtained after decompression on the display screen. Wherein, the compression and decompression operations in the video transmission system can be performed based on the corresponding methods provided in this application, which will not be repeated here.

It should be noted that, from the description of the above embodiments, those skilled in the art can clearly understand that part or all of the present application can be implemented by means of software combined with a necessary general hardware platform. If the functions are implemented in the form of software functional units and sold or used as independent products, they may also be stored in a computer-readable storage medium. Based on this understanding, the present application also provides a computer-readable storage medium, the storage medium stores at least one program, and the program implements any of the aforementioned compression methods or decompression methods when executed.

Based on this understanding, the technical solutions of the present application can be embodied in the form of software products in essence or in the parts that make contributions to the prior art, and the computer software products can include one or more machine-executable instructions stored thereon. A machine-readable medium, the instructions, when executed by one or more machines, such as a computer, computer network, or other electronic device, can cause the one or more machines to perform operations in accordance with embodiments of the present application. For example, each step in a compression method or a decompression method, etc. Machine-readable media may include, but are not limited to, floppy disks, optical disks, CD-ROM (compact disk-read only memory), magneto-optical disks, ROM (read only memory), RAM (random access memory), EPROM (erasable memory) except programmable read-only memory), EEPROM (electrically erasable programmable read-only memory), magnetic or optical cards, flash memory, or other types of media/machine-readable media suitable for storing machine-executable instructions.

Also, any connection is properly termed a computer-readable medium. For example, if the instructions are sent from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technologies such as infrared, radio, and microwave Coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of the medium. It should be understood, however, that computer-readable storage media and data storage media do not include connections, carrier waves, signals, or other transitory media, but are instead intended to be non-transitory, tangible storage media. Disk and disc, as used in the application, includes compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk, and blu-ray disc, where disks usually reproduce data magnetically, while discs use lasers to optically reproduce data replicate the data.

It should be understood that, in various embodiments of the present application, the size of the sequence numbers of the above-mentioned processes does not mean the sequence of execution, and the execution sequence of each process should be determined by its functions and internal logic, and should not be dealt with in the embodiments of the present application. implementation constitutes any limitation.

In the several embodiments provided in this application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

To sum up, the video file compression method provided by the present application can effectively reduce the bit stream and at the same time ensure high-fidelity image quality. In the present application, the amount of data added by a plurality of image blocks is far lower than the amount of data after compression processing using the traditional method. Among them, compared with the YUV222 format, it has only half the data volume; compared with the YUV444 format, it has only 1/3 of the data volume, but the amount of information carried by the compression method of the present application is equivalent to that of the YUV444 format. . Taking 8K video as an example, the image block of each color attribute is equivalent to the 4K video YUV400 format with only luminance information, and compared with the YUV422 format, the data volume is only half of that. Since the compression method in this application can effectively reduce the amount of data, the encoding of 8k video can be performed by the encoder in the prior art. Similarly, with the compression method of the present application, the 4K video can also be encoded by the 2K video encoder, or the 16K video can be processed by the 8K video encoder. In addition, the bit rate generated by the compression method of the present application can be controlled at about half of that of YUV422, that is, 24 to 80 Mbps, and the current stable peak value of 5G uplink is 90 Mbps, so 5G real-time transmission of 8K video can be realized. High fidelity picture quality.

The above-mentioned embodiments merely illustrate the principles and effects of the present application, but are not intended to limit the present application. Anyone skilled in the art can make modifications or changes to the above embodiments without departing from the spirit and scope of the present application. Therefore, all equivalent modifications or changes made by those with ordinary knowledge in the technical field without departing from the spirit and technical idea disclosed in this application should still be covered by the claims of this application.

Claims (16)

1. A compression method for obtaining a video file, comprising the steps of:

acquiring a plurality of image data to be compressed according to a time sequence; the image data is used to display video images of UHD4K and above pixels;

respectively mapping color values of all pixels in each image data to all pixel positions in a plurality of image blocks based on color attributes of all pixels in the image data;

and compressing image blocks which correspond to each image data in the plurality of image data and have the same color attribute to obtain a video file.

2. The method of claim 1, wherein in the case that each pixel in the image data represents a single color attribute, the step of mapping the color value of each pixel in each image data to the pixel position in each of the plurality of image blocks respectively based on the color attribute of each pixel in the image data comprises:

traversing the image data in a color format set based on a Bayer format in the image data;

during traversal, extracting a color value of each pixel from the image data based on the color attribute of each pixel in the color format, and mapping to a pixel position in a corresponding image block.

3. The compression method for obtaining a video file according to claim 1, wherein in the case where each pixel in the image data represents an RGB color attribute; the step of mapping the color value of each pixel in each image data to each pixel position in the plurality of image blocks based on the color attribute of each pixel in the image data includes:

traversing the image data in a color format set based on a pixel row format in the image data;

wherein, during traversal, based on the color attribute of each pixel in the color format, a color principal component or a color fitting component of each pixel is extracted from the image data and mapped to a pixel position in the corresponding image block.

4. The compression method for obtaining video files according to claim 2 or 3, wherein the step of compressing the image blocks corresponding to each of the plurality of image data and having the same color attribute comprises:

and sequentially inputting a plurality of image blocks corresponding to the plurality of image data into a first encoder for compression processing according to the color attributes in the color format.

5. The compression method for obtaining video files according to any one of claims 1 to 3, wherein the step of compressing the image blocks corresponding to each of the plurality of image data and having the same color attribute comprises:

and under synchronous control, a plurality of second encoders are used for respectively compressing a plurality of image blocks with the same color attribute.

6. The compression method for obtaining a video file according to claim 5, wherein the video file obtained by the compression processing using the plurality of second encoders includes synchronization information provided for decompressing the video file to recover a plurality of image data.

7. A method for decompressing a video file, comprising:

acquiring a video file;

decompressing the video file according to the compression mode used by the corresponding video file to obtain a plurality of image blocks; the obtained image blocks correspond to each image data in the image data to be generated according to the color attributes of the image blocks;

mapping the color value of each pixel position in each corresponding image block to the pixel of the image data according to the color attribute;

and generating a video image for displaying the UHD4K and above pixels based on the color value of each pixel in the image data.

8. The method for decompressing a video file according to claim 7, wherein the step of decompressing the video file according to the compression scheme to obtain the plurality of image blocks comprises:

under the synchronous control, a plurality of second decoders are used for respectively decompressing the video files according to the color attributes; wherein each second decoder outputs a plurality of image blocks having the same color attribute; wherein each image block corresponds to an image data to be generated.

9. The method of claim 8, wherein each second decoder determines a correspondence between the plurality of decompressed image blocks and image data to be generated according to synchronization information in the video file.

10. The method for decompressing a video file according to claim 7, wherein the step of decompressing the video file according to the compression scheme to obtain the plurality of image blocks comprises:

decompressing the received video file by using a first decoder to obtain a plurality of groups of image blocks divided according to different color attributes in a color format; each image block in each group of image blocks corresponds to image data to be generated.

11. The method for decompressing a video file according to claim 7, wherein the step of mapping the color value of each pixel position in each corresponding image block to a pixel of the image data according to the color attribute comprises:

traversing pixel positions in the image blocks with the color attributes according to the color formats, and mapping color values of corresponding pixel positions in the image blocks to the pixel positions in the corresponding image data during traversal to generate image data; wherein the color value of each pixel location in the image data represents a single color attribute.

12. The method for decompressing a video file according to claim 11, wherein the step of generating a video image for displaying pixels UHD4K and above based on the color values of the pixels mapped in the image data further comprises:

and according to the color format, performing interpolation processing on each pixel position in the obtained image data to obtain a video image containing RGB color attributes in each pixel.

13. A compression apparatus, comprising

A communication interface for communication connection with an external decompression device;

a memory for storing at least one program and image data to be compressed;

a processor for coordinating the communication interface and the memory to execute the program, during which the image data is compressed according to the method for obtaining a video file as claimed in any one of claims 1-6 to obtain a video file.

14. A decompression apparatus, comprising:

the communication interface is used for being in communication connection with external compression equipment;

a memory for storing at least one program and a video file to be decompressed;

a processor for coordinating the communication interface and the memory to execute the program, during which the video file is decompressed according to the method for decompressing a video file as claimed in any one of claims 7 to 12, so as to play the video file.

15. A video transmission system, comprising:

the compression device of claim 13; and

the decompression device of claim 14.

16. A computer-readable storage medium, comprising: at least one program is stored; -said at least one program, when invoked, executing a compression method for obtaining video files according to any one of claims 1 to 6; alternatively, said at least one program, when invoked, performs a method of decompressing a video file according to any of claims 7-12.

Images