CN111601151A - Method, device, medium and equipment for reviewing hundred million-level pixel video - Google Patents
Method, device, medium and equipment for reviewing hundred million-level pixel video Download PDFInfo
- Publication number
- CN111601151A CN111601151A CN202010284529.6A CN202010284529A CN111601151A CN 111601151 A CN111601151 A CN 111601151A CN 202010284529 A CN202010284529 A CN 202010284529A CN 111601151 A CN111601151 A CN 111601151A
- Authority
- CN
- China
- Prior art keywords
- video
- hundred million
- pictures
- paths
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 34
- 238000005520 cutting process Methods 0.000 claims abstract description 14
- 230000009191 jumping Effects 0.000 claims abstract description 5
- 238000012552 review Methods 0.000 claims description 25
- 238000004590 computer program Methods 0.000 claims description 14
- 239000002131 composite material Substances 0.000 claims description 11
- 238000003860 storage Methods 0.000 claims description 8
- 230000000875 corresponding effect Effects 0.000 description 29
- 238000010586 diagram Methods 0.000 description 20
- 238000012545 processing Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 239000002699 waste material Substances 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000007723 transport mechanism Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
- H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/432—Content retrieval operation from a local storage medium, e.g. hard-disk
- H04N21/4325—Content retrieval operation from a local storage medium, e.g. hard-disk by playing back content from the storage medium
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Databases & Information Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention provides a method, a device, a medium and equipment for reviewing hundred million-level pixel videos. The method comprises the following steps: receiving a playing request of a client, wherein the playing request comprises an initial timestamp, a target area and a target resolution; searching a target video file group corresponding to the playing request, opening multiple paths of video files in the target video file group, and jumping video pictures of the multiple paths of video files to the position of the initial timestamp; determining N paths of videos related to the target area based on the target area, and cutting pictures corresponding to the same time stamps in the N paths of videos; splicing the N paths of cut video pictures, and coding the N paths of cut video pictures into a synthetic picture with the target resolution; and starting from the starting time stamp, sending the synthesized picture corresponding to the subsequent time stamp to the client in a video stream mode. The problem of video playback of a hundred million-level pixel array camera is effectively solved.
Description
Technical Field
The invention relates to the field of video playing, in particular to a method, a device, a medium and equipment for reviewing hundred million-level pixel video.
Background
In the related art, the hundred million-level pixel video is shot by an array camera composed of a plurality of ultra-high-definition cameras, and the array camera comprises an array composed of a plurality of long-focus cameras and is responsible for shooting high-resolution detail video of a specific area. When the video is recorded, each camera in the array camera records a video respectively, and the videos recorded by a plurality of cameras in the same array camera are stored in a form of a video file group. When looking back, if all the video data is transmitted to the client, the amount of data is very large and the performance requirements on the client computer are very high. Taking an array camera composed of 3 rows, 5 columns and 15 ultra high definition cameras as an example, each camera has a standard 4K resolution, i.e., 3840 × 2160, and about 830 ten thousand pixels. The total pixels of 15 cameras are 1.24 hundred million pixels, which is equivalent to the data volume of 60 1080P resolution videos, and thus the video with huge data volume occupies a large bandwidth resource and cannot be played back on a single device.
Disclosure of Invention
To solve the above-described problems, the present invention provides a method, apparatus, medium, and device for mega pixel video review.
According to a first aspect of the embodiments of the present disclosure, there is provided a method for reviewing hundred million-level pixel video, applied to a server, the method including:
receiving a playing request of a client, wherein the playing request comprises an initial timestamp, a target area and a target resolution;
searching a target video file group corresponding to the playing request, opening multiple paths of video files in the target video file group, and jumping video pictures of the multiple paths of video files to the position of the initial timestamp;
determining N paths of videos related to the target area based on the target area, and cutting pictures corresponding to the same time stamps in the N paths of videos;
splicing the N paths of cut video pictures, and coding the N paths of cut video pictures into a synthetic picture with the target resolution;
starting from the starting timestamp, sending a composite picture corresponding to a subsequent timestamp to a client in a video stream mode; wherein N is an integer of 1 or more.
The hundred million-level pixel video review method further comprises the following steps: and splicing the video pictures of the multiple paths of video files according to a preset position relation before determining N paths of videos related to the target area based on the target area to form video pictures with hundred million-level pixels.
The determining, based on the target area, N paths of videos related to the target area, and the cropping the N paths of video pictures includes:
determining N paths of videos related to the target area in the video pictures of the hundred million-level pixels based on the target area;
and cutting the picture of each video according to the intersection range of the picture of each video and the target area.
The splicing the N paths of cut video pictures and coding the spliced N paths of cut video pictures into the synthetic picture with the target resolution comprises the following steps:
splicing the pictures of each cut video according to corresponding positions in the video pictures of the hundred million-level pixels, coding the spliced N video pictures into a synthesized picture, and adjusting the resolution of the synthesized picture to be the target resolution; or,
and based on the target resolution, cutting the pictures of each related video after adjusting the resolution, splicing according to the corresponding positions in the video pictures of the hundred million-level pixels, and coding the spliced N-path video pictures into a synthesized picture.
A hundred million-level pixel video review method is applied to a client and is characterized by comprising the following steps:
acquiring hundred million-level pixel video information;
generating a playing request based on the hundred million-level pixel video information, and sending the playing request to a server, wherein the playing request comprises an initial timestamp, a target area and a target resolution;
and receiving and playing the video stream returned by the server.
According to a second aspect of the embodiments of the present disclosure, there is provided a hundred million-level pixel video review device applied to a server, including:
the request receiving module is used for receiving a playing request of a client, wherein the playing request comprises an initial timestamp, a target area and a target resolution;
the decoding module is used for searching a target video file group corresponding to the playing request, opening multiple paths of video files in the target video file group, and skipping video pictures of the multiple paths of video files to the position of the starting timestamp;
the cutting module is used for determining N paths of videos related to the target area based on the target area and cutting pictures corresponding to the same time stamp in the N paths of videos; wherein N is an integer greater than or equal to 1;
the coding module is used for splicing the N paths of cut video pictures and coding the N paths of cut video pictures into a synthetic picture with the target resolution;
and the video stream sending module is used for sending the composite picture corresponding to the subsequent timestamp to the client in a video stream mode from the starting timestamp.
The hundred million-level pixel video review device further comprises:
and the hundred million-level pixel video splicing module is used for splicing the video pictures of the multi-channel video files according to a preset position relation to form the video pictures of hundred million-level pixels.
Hundred million grades of pixel video playback devices is applied to the client, includes:
the video information acquisition module is used for acquiring hundred million-level pixel video information;
the request sending module is used for generating a playing request based on the hundred million-level pixel video information and sending the playing request to a server, wherein the playing request comprises an initial timestamp, a target area and a target resolution;
and the playing module is used for receiving and playing the video stream returned by the server.
According to a third aspect of embodiments of the present disclosure, there is provided a computer readable storage medium having stored thereon a computer program which, when executed, implements the steps of a method for hundred million pixel video review.
According to a fourth aspect of embodiments of the present disclosure, there is provided a computer device comprising a processor, a memory, and a computer program stored on the memory, the processor implementing the steps of the method for video review of hundred million pixels when executing the computer program.
By the aid of the method for reviewing the hundred million-level pixel videos, playback of the hundred million-level or more pixel videos can be achieved, the played back video data only contain areas interested by customers and are the expected resolution, waste of bandwidth and processing capacity caused by redundant picture content data and unnecessary high resolution is avoided, and the problem of reviewing the recorded videos of the hundred million-level pixel array camera is effectively solved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the invention and together with the description, serve to explain the principles of the invention. In the drawings, like reference numerals are used to indicate like elements. The drawings in the following description are directed to some, but not all embodiments of the invention. For a person skilled in the art, other figures can be derived from these figures without inventive effort.
FIG. 1 is a flow diagram illustrating a method for hundred million pixel video review in accordance with an exemplary embodiment.
FIG. 2 is a schematic diagram illustrating a target area in positional relationship to a hundred million pixels video picture according to an example embodiment.
FIG. 3 is a flow diagram illustrating a method for hundred million pixel video review in accordance with an exemplary embodiment.
FIG. 4 is a block diagram illustrating a hundred million pixel video review device according to an example embodiment.
FIG. 5 is a block diagram illustrating a hundred million pixel video review device according to an example embodiment.
FIG. 6 is a block diagram illustrating a hundred million pixel video review device according to an example embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention. It should be noted that the embodiments and features of the embodiments in the present application may be arbitrarily combined with each other without conflict.
The hundred million-level pixel video is shot by an array camera composed of a plurality of ultra-high-definition cameras, the array camera is an array composed of a plurality of long-focus cameras, and each long-focus camera is responsible for shooting high-resolution detail video of a specific area. And after the video recorded by each camera in the array camera is correspondingly processed, splicing the video into a complete hundred million-level pixel video according to the position of the shot specific area. Therefore, mega pixel video includes multiple videos, and the multiple videos need to be stitched in a specific order to display a complete mega pixel video picture. Therefore, mega pixel video is also stored in the form of a video file set including multiple video files. The data volume of the multi-channel video file is huge, if a video recording with hundred million pixels is played back, the performance requirement on playback equipment is very high, and taking an array camera consisting of 3 rows, 5 columns and 15 ultra-high definition cameras as an example, each camera has a standard 4K resolution, namely 3840 x 2160 and about 830 thousand pixels. The total pixels of 15 cameras are 1.24 hundred million pixels, which is equivalent to the data size of 60 1080P resolution videos, and thus the huge data size cannot be quickly transmitted and cannot be played back on a single device.
To solve the above problem, a method for video review of hundred million pixels is provided.
FIG. 1 is a flow diagram illustrating a method for hundred million pixel video review in accordance with an exemplary embodiment. Referring to fig. 1, the method for looking back at hundred million-level pixel video is applied to a server, and comprises the following steps:
step S11, receiving a play request from the client, where the play request includes a start timestamp, a target area, and a target resolution.
Step S12, searching a target video file group corresponding to the playing request, opening the multi-channel video files in the target video file group, and jumping the video pictures of the multi-channel video files to the position of the initial timestamp.
And step S13, determining N paths of videos related to the target area based on the target area, and cutting pictures corresponding to the same time stamp in the N paths of videos.
And step S14, splicing the N paths of cut video pictures and coding the spliced video pictures into a synthetic picture with a target resolution.
Step S15, starting from the initial timestamp, sending the composite picture corresponding to the subsequent timestamp to the client in a video stream mode; wherein N is an integer of 1 or more.
In the embodiment of the present disclosure, in step S11, a play request of the client is received. The client selects a starting time stamp, a target area to be reviewed, and information such as resolution supported by playing equipment of the client is provided for the server according to specific requirements to be reviewed, so that the server processes the hundred million-level pixel video according to the specific requirements of the client.
In step S12, after determining the target video of hundred million pixels that the client needs to play back, searching a multi-channel video file set corresponding to the target video, opening the multi-channel video file, and jumping the video frame to the start timestamp position. All the video files in the video file group are decoded at the same time from the time stamp, so that the video of all the decoded video files is ensured to be synchronous in time, and the condition that the video pictures after splicing are inconsistent due to asynchronous time is avoided.
In step S13, based on the target area, N videos related to the target area are determined. And selecting an interested area in the playback video as a target area at the client according to the self requirement. The target area corresponds to a part of area in a hundred million-level pixel video picture, and may be a picture area corresponding to a certain video in a multi-path video file set, or a part of area in a picture corresponding to a certain video, or a plurality of partial areas simultaneously including multi-path video pictures. FIG. 2 is a schematic diagram illustrating a target area in positional relationship to a hundred million pixels video picture according to an example embodiment. Referring to fig. 2, fig. 2 shows a hundred million pixel video picture formed by splicing 12 video pictures, wherein numerals 1-12 represent 12 video pictures and 13 is a target area. As can be seen from the figure, the target area 13 has an intersecting and containing relationship with multiple video pictures in the hundred million-level pixel video pictures, and the target area 13 intersects with the pictures corresponding to the video 1, the video 2, the video 3, the video 5, the video 7, the video 9, the video 10 and the video 11 and contains the picture corresponding to the video 6. The video pictures intersected with the target area are cut and spliced with the complete video pictures included by the target area, so that the picture content corresponding to the target area can be provided for the client, and the video pictures which are positioned outside the target area and are not intersected with the target area do not need to be processed, such as pictures corresponding to the videos 4, 8 and 12. Therefore, videos corresponding to pictures intersecting and contained by the target area are taken as videos related to the target area, that is, videos 1, 2, 3, 5, 7, 9, 10, 11, and 6 in fig. 2 are related videos. And cutting the picture of each video according to the intersection range of the picture of each video and the target area. If the picture of a certain path of video is completely contained in the target area, the range where the picture of the path of video intersects with the target area can be considered as the whole picture of the path of video.
In one embodiment, to facilitate determining the N channels of related video, the video frames of the multiple channels of video files determined in step S12 are first stitched to form video frames with hundred million pixels according to a predetermined position relationship. According to the intersection or the inclusion relation between the target area and the video picture of the hundred million-level pixels, N paths of related videos can be conveniently determined. Of course, the determination may also be performed in other manners, for example, coordinate marking is performed on multiple paths of video pictures according to a predetermined position relationship, the target area is converted into a coordinate position, and N paths of related videos are determined through calculation. The specific manner of determining the N-way correlated video is not limited herein.
In one embodiment, the step S14 of splicing the N cropped video pictures, wherein the encoding into the composite picture of the target resolution includes:
and splicing the pictures of each cut video according to the corresponding positions in the video pictures of hundred million-level pixels, coding the spliced N video pictures into a synthesized picture, and adjusting the resolution of the synthesized picture to be the target resolution.
Or,
and based on the target resolution, cutting the pictures of each related video after adjusting the resolution, splicing according to the corresponding positions in the video pictures of hundred million-level pixels, and coding the spliced N-path video pictures into a composite picture. According to the target resolution of the synthesized picture, the resolution of the picture of the video related to each path is adjusted, and the picture is cut after being adjusted to the proper resolution, so that the data volume needing to be processed can be reduced.
In one embodiment, step S15 is to send the composite picture corresponding to the subsequent timestamp to the client in a video stream manner, starting from the starting timestamp. And the synthesized picture is the resolution specified by the client or the resolution corresponding to the playing capability of the client equipment, the synthesized picture is taken as a video frame, and the timestamp of the video frame is the timestamp corresponding to the hundred million-level pixel video records, so that each timestamp of the hundred million-level pixel video records corresponds to one video frame of the synthesized picture, and the playback of the hundred million-level pixel video records can be realized only by sending the synthesized picture of each frame to the client according to the sequence of the timestamps and playing the synthesized picture according to the sequence of the timestamps.
FIG. 3 is a flow diagram illustrating a method for hundred million pixel video review in accordance with an exemplary embodiment. Referring to fig. 3, the method for video review of hundred million-level pixels is applied to a client, and includes:
step S31, acquiring hundred million-level pixel video information;
step S32, generating a playing request based on the hundred million-level pixel video information, and sending the playing request to a server, wherein the playing request comprises an initial timestamp, a target area and a target resolution;
and step S33, receiving and playing the video stream returned by the server.
In the embodiment of the disclosure, the client firstly establishes network communication with the server, and can establish long connection by using a WebSocket protocol to acquire video information of existing videos of the server, such as video shooting time, video duration, video resolution and the like. After the client side obtains the video information, the client side confirms the starting time stamp needing to be reviewed, the starting time stamp needing to be reviewed is sent to the server side through the established communication channel, meanwhile, the resolution supported by the client side equipment or the resolution defined by the client side is used as a target resolution and is sent to the server side, and the server side generates a corresponding preview image according to the starting time stamp and the target resolution, so that the client side can select an interested target area. The target resolution refers to how much resolution the client wishes to view, for example 1080P resolution, or 4K resolution, etc. Or after the client and the server establish long connection, the server sends video information of the existing video to the client, generates a corresponding preview image according to the resolution supported by the client equipment, and the client selects a target area according to the preview image, determines an initial timestamp and a target resolution, forms a play request and sends the play request to the server. And receiving and playing the video stream returned by the server, thereby realizing the playback of the hundred million-level pixel video.
In the process of watching and playing back the video, a user can select the starting time stamp at any time, adjust the target area and the target resolution, and can play back the picture content which the user is interested in as long as a playing request is initiated to the server side again.
Through the above description, in the playback method of the hundred million level pixel video in the application, the video data received by the client only contains the interested area and is the expected resolution, so that the waste of bandwidth and processing capacity caused by redundant picture content data and unnecessary over-high resolution is avoided, and the problem of video playback of the hundred million level pixel array camera is effectively solved.
FIG. 4 is a block diagram illustrating a hundred million pixel video review device according to an example embodiment. Referring to fig. 4, the apparatus for revising megapixel video includes a request receiving module 401, a decoding module 402, a cropping module 403, an encoding module 404, and a video stream transmitting module 405.
The request receiving module 401 is configured to receive a play request of a client, where the play request includes a start timestamp, a target area, and a target resolution.
The decoding module 402 is configured to search a target video file group corresponding to the play request, open multiple video files in the target video file group, and skip video frames of the multiple video files to the start timestamp position.
The cropping module 403 is configured to determine, based on the target area, N paths of videos related to the target area, and crop a picture corresponding to the same timestamp in the N paths of videos; wherein N is an integer of 1 or more.
The encoding module 404 is configured to splice the N cropped video pictures into a composite picture at the target resolution.
The video stream transmitting module 405 is configured to transmit the composite picture corresponding to the subsequent timestamp to the client in a video stream manner from the starting timestamp.
FIG. 5 is a block diagram illustrating a hundred million pixel video review device according to an example embodiment. Referring to fig. 5, the mega-pixel video review apparatus further includes a mega-pixel video stitching module 501.
The hundred million level pixel video stitching module 501 is configured to stitch video frames of multiple paths of video files according to a predetermined position relationship to form a video frame of hundred million level pixels.
FIG. 6 is a block diagram illustrating a hundred million pixel video review device according to an example embodiment. Referring to fig. 6, the apparatus for reviewing hundred million pixel videos, applied to a client, includes a video information obtaining module 601, a request sending module 602, and a playing module 603.
The video information acquisition module 601 is configured to acquire giga-pixel video information.
The request sending module 602 is configured to generate a play request based on the hundred million-level pixel video information, and send the play request to the server, where the play request includes a start timestamp, a target area, and a target resolution.
The playing module 603 is configured to receive and play the video stream returned by the server.
The above-described aspects may be implemented individually or in various combinations, and such variations are within the scope of the present invention.
As will be appreciated by one skilled in the art, the embodiments herein may be provided as a method, apparatus (device), or computer program product. Accordingly, the present disclosure may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present disclosure may take the form of a computer program product embodied on one or more computer-usable storage media having computer-usable program code embodied in the medium. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data, including, but not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, Digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by the computer, and the like. In addition, communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media as known to those skilled in the art.
The present disclosure is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (devices) and computer program products according to embodiments herein. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein.
In this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that an article or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such article or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of additional like elements in the article or device comprising the element.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, it is intended that the present invention cover the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents.
Claims (10)
1. A method for reviewing hundred million pixel video is applied to a server side, and is characterized by comprising the following steps:
receiving a playing request of a client, wherein the playing request comprises an initial timestamp, a target area and a target resolution;
searching a target video file group corresponding to the playing request, opening multiple paths of video files in the target video file group, and jumping video pictures of the multiple paths of video files to the position of the initial timestamp;
determining N paths of videos related to the target area based on the target area, and cutting pictures corresponding to the same time stamps in the N paths of videos;
splicing the N paths of cut video pictures, and coding the N paths of cut video pictures into a synthetic picture with the target resolution;
starting from the starting timestamp, sending a composite picture corresponding to a subsequent timestamp to a client in a video stream mode; wherein N is an integer of 1 or more.
2. The method for video review of hundred million pixels according to claim 1, further comprising: and splicing the video pictures of the multiple paths of video files according to a preset position relation before determining N paths of videos related to the target area based on the target area to form video pictures with hundred million-level pixels.
3. The method for reviewing once in a million-level pixel video as claimed in claim 2, wherein the determining N-way video related to the target area based on the target area, and the cropping the N-way video comprises:
determining N paths of videos related to the target area in the video pictures of the hundred million-level pixels based on the target area;
and cutting the picture of each video according to the intersection range of the picture of each video and the target area.
4. The method for video review of hundred million pixels according to claim 2, wherein the stitching the cropped N video pictures to a composite picture of the target resolution comprises:
splicing the pictures of each cut video according to corresponding positions in the video pictures of the hundred million-level pixels, coding the spliced N video pictures into a synthesized picture, and adjusting the resolution of the synthesized picture to be the target resolution; or,
and based on the target resolution, cutting the pictures of each related video after adjusting the resolution, splicing according to the corresponding positions in the video pictures of the hundred million-level pixels, and coding the spliced N-path video pictures into a synthesized picture.
5. A method for reviewing hundred million pixel videos is applied to a client, and is characterized by comprising the following steps:
acquiring hundred million-level pixel video information;
generating a playing request based on the hundred million-level pixel video information, and sending the playing request to a server, wherein the playing request comprises an initial timestamp, a target area and a target resolution;
and receiving and playing the video stream returned by the server.
6. A hundred million level pixel video review device is applied to the server side, characterized by comprising:
the request receiving module is used for receiving a playing request of a client, wherein the playing request comprises an initial timestamp, a target area and a target resolution;
the decoding module is used for searching a target video file group corresponding to the playing request, opening multiple paths of video files in the target video file group, and skipping video pictures of the multiple paths of video files to the position of the starting timestamp;
the cutting module is used for determining N paths of videos related to the target area based on the target area and cutting pictures corresponding to the same time stamp in the N paths of videos; wherein N is an integer greater than or equal to 1;
the coding module is used for splicing the N paths of cut video pictures and coding the N paths of cut video pictures into a synthetic picture with the target resolution;
and the video stream sending module is used for sending the composite picture corresponding to the subsequent timestamp to the client in a video stream mode from the starting timestamp.
7. The hundred million pixel video review device of claim 6, further comprising:
and the hundred million-level pixel video splicing module is used for splicing the video pictures of the multi-channel video files according to a preset position relation to form the video pictures of hundred million-level pixels.
8. A hundred million-level pixel video review device applied to a client is characterized by comprising:
the video information acquisition module is used for acquiring hundred million-level pixel video information;
the request sending module is used for generating a playing request based on the hundred million-level pixel video information and sending the playing request to a server, wherein the playing request comprises an initial timestamp, a target area and a target resolution;
and the playing module is used for receiving and playing the video stream returned by the server.
9. A computer-readable storage medium, on which a computer program is stored, characterized in that the computer program, when executed, implements the steps of the method according to any one of claims 1-5.
10. A computer arrangement comprising a processor, a memory and a computer program stored on the memory, characterized in that the steps of the method according to any of claims 1-5 are implemented when the computer program is executed by the processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010284529.6A CN111601151A (en) | 2020-04-13 | 2020-04-13 | Method, device, medium and equipment for reviewing hundred million-level pixel video |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010284529.6A CN111601151A (en) | 2020-04-13 | 2020-04-13 | Method, device, medium and equipment for reviewing hundred million-level pixel video |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111601151A true CN111601151A (en) | 2020-08-28 |
Family
ID=72183531
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010284529.6A Pending CN111601151A (en) | 2020-04-13 | 2020-04-13 | Method, device, medium and equipment for reviewing hundred million-level pixel video |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111601151A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112511768A (en) * | 2020-11-27 | 2021-03-16 | 上海网达软件股份有限公司 | Multi-picture synthesis method, device, equipment and storage medium |
| CN113891112A (en) * | 2021-09-29 | 2022-01-04 | 北京拙河科技有限公司 | Live broadcast method, device, medium and equipment for billion pixel video |
| CN114125400A (en) * | 2021-12-17 | 2022-03-01 | 浙江大华技术股份有限公司 | Multi-channel video analysis method and device |
| CN114302086A (en) * | 2021-12-24 | 2022-04-08 | 威创集团股份有限公司 | Method, device and system for recording and playing back full-screen ultrahigh-resolution picture of display wall |
| CN115396564A (en) * | 2022-07-29 | 2022-11-25 | 珠海视熙科技有限公司 | Video processing method, device, video device and storage medium |
| WO2023103641A1 (en) * | 2021-12-10 | 2023-06-15 | 北京拙河科技有限公司 | Video data processing method and device supporting interactive viewing, and system |
| CN116828208A (en) * | 2023-07-17 | 2023-09-29 | 中国电信股份有限公司 | A video compression and enhancement method, device, electronic equipment and storage medium |
| CN119094681A (en) * | 2023-12-05 | 2024-12-06 | 苏州一际智能科技有限公司 | Method, device and system for reviewing billion-pixel fusion video |
| CN119169255A (en) * | 2023-11-14 | 2024-12-20 | 苏州一际智能科技有限公司 | Target tracking display method and device for billion-pixel computational imaging system |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050103849A1 (en) * | 2003-11-13 | 2005-05-19 | Xiaoxun Zhu | Automatic hand-supportable image-based bar code symbol reader having image-processing based bar code reading subsystem employing simple decode image processing operations applied in an outwardly-directed manner referenced from the center of a captured narrow-area digital image of an object bearing a 1D bar code symbol |
| CN101521745A (en) * | 2009-04-14 | 2009-09-02 | 王广生 | Multi-lens optical center superposing type omnibearing shooting device and panoramic shooting and retransmitting method |
| US20100266181A1 (en) * | 2008-04-30 | 2010-10-21 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Device and method for producing a ct reconstruction of an object comprising a high-resolution object region of interest |
| CN103155585A (en) * | 2010-07-12 | 2013-06-12 | 欧普斯梅迪库斯股份有限公司 | Systems and methods for networked in-context, high-resolution image viewing |
| CN105120366A (en) * | 2015-08-17 | 2015-12-02 | 宁波菊风系统软件有限公司 | A presentation method for an image local enlarging function in video call |
| CN105338323A (en) * | 2015-11-20 | 2016-02-17 | 浙江大华技术股份有限公司 | Video monitoring method and device |
| CN106233745A (en) * | 2013-07-29 | 2016-12-14 | 皇家Kpn公司 | Tile video flowing is provided to client |
| CN106604042A (en) * | 2016-12-22 | 2017-04-26 | Tcl集团股份有限公司 | Panorama webcasting system and panorama webcasting method based on cloud server |
| CN107040794A (en) * | 2017-04-26 | 2017-08-11 | 盯盯拍(深圳)技术股份有限公司 | Video broadcasting method, server, virtual reality device and panoramic virtual reality play system |
| CN107395984A (en) * | 2017-08-25 | 2017-11-24 | 北京佰才邦技术有限公司 | A kind of method and device of transmission of video |
| CN110301136A (en) * | 2017-02-17 | 2019-10-01 | Vid拓展公司 | The system and method for selective object of interest scaling are carried out in streamed video |
-
2020
- 2020-04-13 CN CN202010284529.6A patent/CN111601151A/en active Pending
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050103849A1 (en) * | 2003-11-13 | 2005-05-19 | Xiaoxun Zhu | Automatic hand-supportable image-based bar code symbol reader having image-processing based bar code reading subsystem employing simple decode image processing operations applied in an outwardly-directed manner referenced from the center of a captured narrow-area digital image of an object bearing a 1D bar code symbol |
| US20100266181A1 (en) * | 2008-04-30 | 2010-10-21 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Device and method for producing a ct reconstruction of an object comprising a high-resolution object region of interest |
| CN101521745A (en) * | 2009-04-14 | 2009-09-02 | 王广生 | Multi-lens optical center superposing type omnibearing shooting device and panoramic shooting and retransmitting method |
| CN103155585A (en) * | 2010-07-12 | 2013-06-12 | 欧普斯梅迪库斯股份有限公司 | Systems and methods for networked in-context, high-resolution image viewing |
| CN106233745A (en) * | 2013-07-29 | 2016-12-14 | 皇家Kpn公司 | Tile video flowing is provided to client |
| CN105120366A (en) * | 2015-08-17 | 2015-12-02 | 宁波菊风系统软件有限公司 | A presentation method for an image local enlarging function in video call |
| CN105338323A (en) * | 2015-11-20 | 2016-02-17 | 浙江大华技术股份有限公司 | Video monitoring method and device |
| CN106604042A (en) * | 2016-12-22 | 2017-04-26 | Tcl集团股份有限公司 | Panorama webcasting system and panorama webcasting method based on cloud server |
| CN110301136A (en) * | 2017-02-17 | 2019-10-01 | Vid拓展公司 | The system and method for selective object of interest scaling are carried out in streamed video |
| CN107040794A (en) * | 2017-04-26 | 2017-08-11 | 盯盯拍(深圳)技术股份有限公司 | Video broadcasting method, server, virtual reality device and panoramic virtual reality play system |
| CN107395984A (en) * | 2017-08-25 | 2017-11-24 | 北京佰才邦技术有限公司 | A kind of method and device of transmission of video |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112511768A (en) * | 2020-11-27 | 2021-03-16 | 上海网达软件股份有限公司 | Multi-picture synthesis method, device, equipment and storage medium |
| CN112511768B (en) * | 2020-11-27 | 2024-01-02 | 上海网达软件股份有限公司 | Multi-picture synthesis method, device, equipment and storage medium |
| CN113891112A (en) * | 2021-09-29 | 2022-01-04 | 北京拙河科技有限公司 | Live broadcast method, device, medium and equipment for billion pixel video |
| CN113891112B (en) * | 2021-09-29 | 2023-12-05 | 北京拙河科技有限公司 | Live broadcasting method, device, medium and equipment of billion pixel video |
| WO2023103641A1 (en) * | 2021-12-10 | 2023-06-15 | 北京拙河科技有限公司 | Video data processing method and device supporting interactive viewing, and system |
| CN114125400A (en) * | 2021-12-17 | 2022-03-01 | 浙江大华技术股份有限公司 | Multi-channel video analysis method and device |
| CN114302086A (en) * | 2021-12-24 | 2022-04-08 | 威创集团股份有限公司 | Method, device and system for recording and playing back full-screen ultrahigh-resolution picture of display wall |
| CN115396564A (en) * | 2022-07-29 | 2022-11-25 | 珠海视熙科技有限公司 | Video processing method, device, video device and storage medium |
| CN116828208A (en) * | 2023-07-17 | 2023-09-29 | 中国电信股份有限公司 | A video compression and enhancement method, device, electronic equipment and storage medium |
| CN119169255A (en) * | 2023-11-14 | 2024-12-20 | 苏州一际智能科技有限公司 | Target tracking display method and device for billion-pixel computational imaging system |
| CN119094681A (en) * | 2023-12-05 | 2024-12-06 | 苏州一际智能科技有限公司 | Method, device and system for reviewing billion-pixel fusion video |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111601151A (en) | Method, device, medium and equipment for reviewing hundred million-level pixel video | |
| RU2652099C2 (en) | Transmission device, transmission method, reception device and reception method | |
| CN111193937B (en) | Live video data processing method, device, equipment and medium | |
| US12058446B2 (en) | Method and system of image processing with composition and display of regions of interest | |
| US20150222815A1 (en) | Aligning videos representing different viewpoints | |
| US20140327830A1 (en) | Multiple-input configuration and playback video enhancement | |
| KR102025157B1 (en) | System and method for transmitting a plurality of video image | |
| CN111225228B (en) | Video live broadcast method, device, equipment and medium | |
| WO2019192416A1 (en) | Video processing method and device therefor, and storage medium and electronic product | |
| CN114189696A (en) | Video playing method and device | |
| CN107438196A (en) | Method and apparatus for playing recorded video | |
| US20200213631A1 (en) | Transmission system for multi-channel image, control method therefor, and multi-channel image playback method and apparatus | |
| US20200314509A1 (en) | Video Processing Method, Terminal and Server | |
| CN111614975B (en) | Hundred million-level pixel video playing method, device, medium and equipment | |
| KR20200027638A (en) | Apparatus and method for processing a plurality of moving picture | |
| CN114079813A (en) | Picture synchronization method, coding method, video playing device and video coding device | |
| CN107018442B (en) | A method and device for synchronous playback of video recordings | |
| CN115002335A (en) | Video processing method, apparatus, electronic device, and computer-readable storage medium | |
| CN112087642B (en) | Cloud guide playing method, cloud guide server and remote management terminal | |
| CN113891112B (en) | Live broadcasting method, device, medium and equipment of billion pixel video | |
| JP2002112158A (en) | Image transmission device, image display device, and image transmission method | |
| KR102777291B1 (en) | System operating method for transfering multiview video and system of thereof | |
| KR102599664B1 (en) | System operating method for transfering multiview video and system of thereof | |
| US12184983B2 (en) | Systems and methods for free-view video streaming | |
| DE112011103035T5 (en) | Real-time key frame synchronization |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20211101 Address after: 518000 409, Yuanhua complex building, 51 Liyuan Road, merchants street, Nanshan District, Shenzhen, Guangdong Applicant after: Shenzhen zhuohe Technology Co.,Ltd. Address before: 100083 no.2501-1, 25th floor, block D, Tsinghua Tongfang science and technology building, No.1 courtyard, Wangzhuang Road, Haidian District, Beijing Applicant before: Beijing Zhuohe Technology Co.,Ltd. |
|
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200828 |