Fast transmission processing method and device for big data video
Technical Field
The invention relates to the technical field of video transmission, in particular to a method and a device for processing fast transmission of big data video.
Background
Video technology has been applied to many fields, on the one hand, use traffic supervision, the real time monitoring of safety supervision, on the other hand, use trades such as propaganda, investigation, tourism, utilize the aircraft to carry on 360 degrees panorama shots of camera such as mountain and lake, the historical sites of the attraction, important geographic features etc., it is shooting with 360 degrees of square camera to shoot the best effect, video speed and focus after the shooting can change, satisfy people to the demand of definition and speed, but because the data bulk of video is very big, because bandwidth and other network reasons, the jamming phenomenon is serious when causing the video to play, can not reach real-time smooth broadcast video purpose, consequently, can not satisfy the demand that people took the video and watched while.
Disclosure of Invention
In order to solve the problems, the invention provides a method and a device for processing the fast transmission of the big data video, which greatly reduce the transmission flow of the video, improve the transmission speed and meet the real-time transmission requirement when people watch the big data video and the high quality video by carrying out gridding processing on different types of video frames, carrying out block division on grids according to the complexity of texture characteristics and carrying out merging and stream control on the blocks.
The specific technical scheme provided by the invention is as follows:
a fast transmission processing method of big data video comprises the following steps:
step 1: acquiring an ith frame image in a video, and simultaneously performing segmentation pretreatment and image pretreatment on the ith frame image, wherein the segmentation pretreatment is used for segmenting the image into a segmented image and area information, and the image pretreatment is used for performing texture analysis, edge extraction and analysis on the image to acquire image detail information;
step 2: dividing image blocks of the obtained image area quality matrix to obtain image blocks and corresponding quality data;
and step 3: traversing and analyzing the block quality data, reducing the block quality according to a principle, and generating a block quality matrix;
and 4, step 4: traversing the blocks and combining the blocks according to the principle to generate a pyramid block;
and 5: and regulating and controlling the form and transmission of the block code stream in real time according to the network live condition and the user requirements, so that the video is smoothly played.
Preferably, step 1 further comprises: and performing image segmentation by using deep learning, extracting texture features and edges of the image, and performing significance analysis on the image.
Preferably, step 2 further comprises:
dividing the image into a plurality of levels of unit blocks, wherein the size of the unit blocks is changed in proportion and is matched with a block preset according to the size of the image; and determining a quality characteristic value according to the complexity of the texture characteristic of the image, wherein the quality characteristic value changes in proportion and is matched with a quality step threshold preset according to the image.
Preferably, step 3 further comprises: the forming method of the multilevel unit block comprises the following steps:
and traversing and identifying the quality feature type of each scene, respectively forming the high-quality scenes with complex texture features into small unit blocks, forming the scenes with medium-complex and medium-quality texture features into medium unit blocks, and forming the low-quality scenes with simple texture features into large unit blocks.
Preferably, if a high-quality cell block is surrounded by low-quality cell blocks, the high-quality cell block is degraded to have the same level as the surrounding low-quality cell blocks, and a final block quality matrix is generated through traversal.
Preferably, step 4 further comprises: the method for respectively combining the unit blocks according to the quality comprises the following steps:
merging adjacent, equal and close unit blocks: respectively merging the unit blocks with low quality, the unit blocks with medium quality and the unit blocks with high quality to form corresponding blocks;
merging the degraded high-quality unit block with the surrounding low-quality unit blocks.
Preferably, traversing the blocks and forming the first-level block data on the pyramid according to the number of the low-quality blocks, the medium-quality blocks and the high-quality blocks to generate the pyramid blocks.
Preferably, step 5 further comprises:
regulating and controlling the form and transmission of block code streams in real time according to the network bandwidth, the real-time network condition and the definition requirement of a user target; and when the network can not meet the transmission requirement but meets the definition of the user target, degrading the high-quality block code stream and transmitting the high-quality block code stream by using the low-quality block code stream.
Preferably, the method for regulating and controlling the code stream in real time further comprises:
and further combining the high-quality blocks to form the high-quality large block, thereby reducing the flow control.
The invention also includes a fast transmission processing device of big data video, the device includes:
a processor:
the method comprises an identification unit: the recognition function is provided, and object recognition is carried out according to the texture features of the ith frame of image;
an image processing unit: carrying out image segmentation processing and image quality analysis processing on the ith frame of image;
a block processing unit: respectively combining adjacent unit blocks with equal quality and similar different quality grades to form corresponding blocks;
a code stream control unit: and regulating and controlling the transmission state of the code stream in real time.
The invention has the beneficial effects that: by providing the fast transmission processing method and the fast transmission processing device for the big data video, the video frames are subjected to gridding processing according to different object characteristics and scene characteristics, grids are divided into different quality blocks according to the complexity of texture characteristics, and then the blocks of different types are combined respectively to form a multi-stage block pyramid, so that the purpose of controlling the stream is achieved.
Drawings
FIG. 1 is a schematic view of a processing apparatus according to the present invention;
FIG. 2 is a flow chart of a processing side of the present invention.
Wherein: 1-an identification unit; 2-an image processing unit; 3-a block processing unit; 4-code stream control unit.
Detailed Description
As used in the specification and in the claims, certain terms are used to refer to particular components. As one skilled in the art will appreciate, manufacturers may refer to a component by different names. This specification and claims do not intend to distinguish between components that differ in name but not function. As used in the following description and in the claims, the terms "include," "include," and "comprise" are used in an open-ended fashion, and thus should be interpreted to mean "include, but not limited to,"; "multistage" should be interpreted as "more than or equal to three"; the description which follows is a preferred embodiment of the present application, but is made for the purpose of illustrating the general principles of the application and not for the purpose of limiting the scope of the application. The protection scope of the present application shall be subject to the definitions of the appended claims.
As shown in fig. 1-2, in one embodiment, there is provided a fast transmission processing apparatus for big data video, the apparatus comprising:
a processor:
comprising an identification unit 1: the recognition function is provided, and object recognition is carried out according to the texture features of the ith frame of image;
the image processing unit 2: carrying out image segmentation processing and image quality analysis processing on the ith frame of image;
the block processing unit 3: respectively combining adjacent unit blocks with equal quality and similar different quality grades to form corresponding blocks;
code stream control unit 4: and regulating and controlling the transmission state of the code stream in real time.
The invention provides a fast transmission processing method of big data video, which comprises the following steps:
step 1: the identification unit 1 acquires an ith frame image of a video, the image processing unit 2 simultaneously performs segmentation preprocessing and image preprocessing on the ith frame image, the segmentation preprocessing divides the image into a segmented image and area information, and the image preprocessing performs texture analysis, edge extraction and analysis on the image to acquire image detail information;
preferably, step 1 further comprises: the image processing unit 2 performs image segmentation using depth learning, extracts texture features and edges of the image, and performs saliency analysis on the image.
Step 2: the block processing unit 3 divides the image blocks of the acquired image area quality matrix according to the area quality and a blocking principle to obtain image blocks and corresponding quality data;
the block processing unit 3 divides the image into a plurality of levels of unit blocks, the size of the unit blocks is changed in proportion and is matched with a block preset according to the size of the image; and determining a quality characteristic value according to the complexity of the texture characteristic of the image, wherein the quality characteristic value changes in proportion and is matched with a quality step threshold preset according to the image.
It should be noted that, before processing an image, a block is preset according to the size of the image, the size of the block changes in proportion, and when the block processing unit 3 performs block multi-level division on the image, the division is performed according to the size of the preset block;
before processing an image, a quality threshold is preset according to the complexity of texture features of the image, the quality threshold is a step threshold and changes proportionally, and the block processing unit 3 determines the quality feature value of the image according to the preset step threshold.
And step 3: the block processing unit 3 traverses and analyzes the block quality data, reduces the block quality according to the principle, and repeatedly traverses until all the blocks are finished to generate a block quality matrix;
preferably, step 3 further comprises: the forming method of the multilevel unit block comprises the following steps:
the block processing unit 3 traverses and identifies the quality feature type of each scene, and respectively forms the high-quality scenes with complex texture features into small unit blocks, forms the medium unit blocks with the scenes with medium-complex and medium-quality texture features, and forms the low-quality scenes with simple texture features into large unit blocks.
Preferably, if all the surrounding high quality cell blocks are low quality cell blocks, the block processing unit 3 degrades the high quality cell blocks, and generates the final block quality matrix in the same level as the surrounding low quality cell blocks.
And 4, step 4: the block processing unit 3 traverses the blocks and merges the blocks according to the principle, and repeats traversal until all the blocks are finished to generate a pyramid block;
preferably, step 4 further comprises: the method for respectively combining the unit blocks according to the quality comprises the following steps:
the block processing unit 3 merges adjacent, equal and close unit blocks: respectively merging the unit blocks with low quality, the unit blocks with medium quality and the unit blocks with high quality to form corresponding blocks;
block processing unit 3 merges the high-quality unit blocks that have been degraded with the surrounding low-quality unit blocks.
Preferably, the block processing unit 3 traverses the blocks and forms the first-level block data on the pyramid according to the number of the low-quality blocks, the medium-quality blocks and the high-quality blocks, so as to generate the pyramid blocks.
And 5: the code stream control unit 4 regulates and controls the form and transmission of the block code stream in real time according to the network live condition and the user requirements, so that the video is smoothly played.
Preferably, step 5 further comprises:
the code stream control unit 4 regulates and controls the form and transmission of block code streams in real time according to the network bandwidth, the real-time network condition and the definition requirement of a user target; and when the network can not meet the transmission requirement but meets the definition of the user target, degrading the high-quality block code stream and transmitting the high-quality block code stream by using the low-quality block code stream.
Preferably, the method for regulating and controlling the code stream in real time further comprises:
the code stream control unit 4 further merges the plurality of high-quality blocks to form a high-quality large block, thereby reducing the flow control.
The foregoing describes several preferred embodiments of the present application, but, as noted above, it is to be understood that the application is not limited to the forms disclosed herein, but is not to be construed as excluding other embodiments and is capable of use in various other combinations, modifications, and environments and is capable of changes within the scope of the inventive concept as expressed herein, commensurate with the above teachings, or the skill or knowledge of the relevant art. And that modifications and variations may be effected by those skilled in the art without departing from the spirit and scope of the application, which is to be protected by the claims appended hereto.