CN108900898A - Video structural method, apparatus and system - Google Patents
Video structural method, apparatus and system Download PDFInfo
- Publication number
- CN108900898A CN108900898A CN201810957605.8A CN201810957605A CN108900898A CN 108900898 A CN108900898 A CN 108900898A CN 201810957605 A CN201810957605 A CN 201810957605A CN 108900898 A CN108900898 A CN 108900898A
- Authority
- CN
- China
- Prior art keywords
- data
- video
- code flow
- rtsp
- flow core
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 45
- 230000005540 biological transmission Effects 0.000 claims abstract description 41
- 238000005538 encapsulation Methods 0.000 claims abstract description 29
- 238000013075 data extraction Methods 0.000 claims description 8
- 238000004364 calculation method Methods 0.000 claims description 3
- 238000012549 training Methods 0.000 abstract description 9
- 230000006870 function Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000013528 artificial neural network Methods 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000000977 initiatory effect Effects 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003032 molecular docking Methods 0.000 description 1
- 238000012806 monitoring device Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000011017 operating method Methods 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
- H04N21/4341—Demultiplexing of audio and video streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/85406—Content authoring involving a specific file format, e.g. MP4 format
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The present invention provides a kind of video structural method, apparatus and systems, are applied to RTSP server, are related to the technical field of video structural, including：Extract the video code flow core data of encapsulation format video file；Based on RTSP, video code flow core data interface channel is established with central apparatus；Video code flow core data is sent to the RTSP client of central apparatus, video code flow core data is identified by algorithm and realizes video structural.The video data that this method passes through the more enough various encapsulation format of transmission of RTSP server, data are received using RTSP client simultaneously and are decoded and video structural, it alleviates and needs additional storage space and the limited technical problem of data source in existing method, it can satisfy multi-channel video while detecting the functional requirement of identification, training speed is improved, more optimized algorithm simulating environment is provided.
Description
Technical field
The present invention relates to video structural technical fields, more particularly, to a kind of video structural method, apparatus and system.
Background technique
Present monitoring device is ubiquitous, and for entire monitoring system to intelligent development, video camera collects magnanimity view
Unstructured video data is carried out structuring processing using artificial intelligence technology and computer vision technique by frequency evidence, for for
Big data platform and data digging system provide data basis, have become trend of the times.
Currently, most AI algorithm training is all based on a large amount of picture and video resource is trained, generally require
Locally increasing additional memory space.In addition, picture and naked code stream that training library is usually only acquired by the camera of oneself
Video recording, this allows trained range to become very limited.When needing to detect simultaneously on a hardware and identify the thing in multiple videos
When object, the method for traditional reading picture and naked streaming video file just becomes have very much limitation, it is difficult to it is same to meet multi-channel video
When detection identification functional requirement.
Summary of the invention
In view of this, the purpose of the present invention is to provide a kind of video structural method, apparatus and system, it is existing to alleviate
Additional storage space and the limited technical problem of data source, training for promotion speed are needed in method, and it is imitative to provide more optimized algorithm
True environment.
In a first aspect, the method is serviced applied to RTSP the embodiment of the invention provides a kind of video structural method
Device, including：
Extract the video code flow core data of encapsulation format video file；
Based on RTSP, video code flow core data interface channel is established with central apparatus；
The video code flow core data is sent to the RTSP client of the central apparatus, by the video code flow core
Calculation identifies realization video structural according to by algorithm.
With reference to first aspect, the embodiment of the invention provides the first possible embodiments of first aspect, wherein institute
The video code flow core data for extracting encapsulation format video file is stated, is specifically included：
Initial data is obtained from video file or phase generator terminal, encapsulation format data are obtained by solution agreement；
Format decapsulation is carried out to the encapsulation format data, obtains bit stream data, the bit stream data includes：Audio code
Flow data and video codeword data stream；
The bit stream data is decoded, video code flow core data is obtained, the video code flow core data includes：
Audio sampling data and video pixel data.
With reference to first aspect, the embodiment of the invention provides second of possible embodiments of first aspect, wherein institute
It states based on RTSP, establishes video code flow core data interface channel with central apparatus, including：
Pass through RTSP transmission of configuration information；
According to the configuration information, the video code flow core data interface channel based on RTP is established.
With reference to first aspect, the embodiment of the invention provides the third possible embodiments of first aspect, wherein institute
It states to the RTSP client of the central apparatus and sends the video code flow core data, including：
Respond one or more connection requests that the RTSP client is initiated；
According to the play command that the RTSP client is sent, the video code flow core number with the RTSP client is carried out
According to transmission.
With reference to first aspect, the embodiment of the invention provides the 4th kind of possible embodiments of first aspect, wherein institute
It states after the RTSP client of the central apparatus transmission video code flow core data, further includes：
It to the core data received while being decoded by multiple decoding channels.
Second aspect, the embodiment of the present invention also provide a kind of video structural device, including：Described device is applied to RTSP
Server, including：
Data extraction module, for extracting the video code flow core data of encapsulation format video file；
Data transmission module establishes video code flow core data interface channel with central apparatus for being based on RTSP；
Data reception module, for sending the video code flow core data to the RTSP client of the central apparatus,
Video structural is realized to identify the video code flow core data by algorithm.
In conjunction with second aspect, the embodiment of the invention provides the first possible embodiments of second aspect, wherein institute
Stating data extraction module includes：
Acquiring unit obtains encapsulation format number by solution agreement for obtaining initial data from video file or phase generator terminal
According to；
Decapsulation unit obtains bit stream data for carrying out format decapsulation to the encapsulation format data；
Decoding unit obtains video code flow core data for being decoded to the bit stream data.
In conjunction with second aspect, the embodiment of the invention provides second of possible embodiments of second aspect, wherein institute
Stating data transmission module includes：
RTSP control unit, for passing through RTSP transmission of configuration information；
RTP transmission unit is logical for according to the configuration information, establishing the video code flow core data connection based on RTP
Road.
In conjunction with second aspect, the embodiment of the invention provides the third possible embodiments of second aspect, wherein institute
Stating data reception module includes：
Connection unit, the one or more connection requests initiated for responding the RTSP client；
Order unit, the play command for being sent according to the RTSP client carry out and the RTSP client
The transmission of video code flow core data.
Structuring unit realizes video structural for identifying the video code flow core data by algorithm.
The third aspect, the embodiment of the present invention also provide a kind of video structural system, including：RTSP client and such as right
It is required that 6 to 9 described in any item video structural devices.
The embodiment of the present invention brings following beneficial effect：A kind of video structural method provided in an embodiment of the present invention,
Apparatus and system is applied to RTSP server.The video structural method includes：Extract the video codes of encapsulation format video file
Flow core data；Based on RTSP, video code flow core data interface channel is established with central apparatus；To the central apparatus
RTSP client sends the video code flow core data, and the video code flow core data is identified by algorithm and realizes view
Frequency structuring.This method can transmit the video data of various encapsulation format by RTSP server, while utilize RTSP client
End receives data and is decoded and video structural, alleviates and needs additional storage space and data source limited in existing method
The technical issues of, it can satisfy multi-channel video while detecting the functional requirement of identification, improve training speed, provide more optimized
Algorithm simulating environment.
Other features and advantages of the present invention will illustrate in the following description, also, partly become from specification
It obtains it is clear that understand through the implementation of the invention.The objectives and other advantages of the invention are in specification, claims
And specifically noted structure is achieved and obtained in attached drawing.
To enable the above objects, features and advantages of the present invention to be clearer and more comprehensible, preferred embodiment is cited below particularly, and cooperate
Appended attached drawing, is described in detail below.
Detailed description of the invention
It, below will be to specific in order to illustrate more clearly of the specific embodiment of the invention or technical solution in the prior art
Embodiment or attached drawing needed to be used in the description of the prior art be briefly described, it should be apparent that, it is described below
Attached drawing is some embodiments of the present invention, for those of ordinary skill in the art, before not making the creative labor
It puts, is also possible to obtain other drawings based on these drawings.
Fig. 1 is the flow chart of video structural method provided in an embodiment of the present invention；
Fig. 2 is the detail flowchart of step S11 provided in an embodiment of the present invention；
Fig. 3 is the detail flowchart of step S12 provided in an embodiment of the present invention；
Fig. 4 is the detail flowchart of step S13 provided in an embodiment of the present invention；
Fig. 5 is the schematic diagram of video structural device provided in an embodiment of the present invention.
Icon：21- data extraction module；22- data transmission module；23- data reception module；211- acquiring unit；
212- decapsulation unit；213- decoding unit；221-RTSP control unit；222-RTP transmission unit；231- connection unit；
232- order unit；233- hardware decoding unit；234- structuring unit.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with attached drawing to the present invention
Technical solution be clearly and completely described, it is clear that described embodiments are some of the embodiments of the present invention, rather than
Whole embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art are not making creative work premise
Under every other embodiment obtained, shall fall within the protection scope of the present invention.
Currently, existing video structural algorithm training is all based on a large amount of picture and video resource is trained, need
Locally increasing additional memory space；Trained data source is limited in scope；It is difficult to meet multi-channel video while detecting identification
Functional requirement.
Based on this, a kind of video structural method, apparatus and system provided in an embodiment of the present invention can alleviate existing side
Additional storage space and the limited technical problem of data source are needed in method, be can satisfy multi-channel video while being detected the function of identification
Demand, training for promotion speed provide more optimized algorithm simulating environment.
For convenient for understanding the present embodiment, first to a kind of video structural method disclosed in the embodiment of the present invention
It describes in detail.
Embodiment one：
The embodiment of the invention provides a kind of video structural methods, are applied to RTSP server, as shown in Figure 1, the party
Method includes the following steps：
S11：Extract the video code flow core data of encapsulation format video file.
The embodiment of the present invention is mainly demultiplexed using video code flow of the class libraries of ffmpeg to various encapsulation format files
With.Ffmpeg be it is a set of can be used to record, converted digital audio, video, and the open source computer journey of stream can be translated into
Sequence.
As shown in Fig. 2, step S11 specifically includes following three sub-steps：
S111：Initial data is obtained from video file or phase generator terminal, encapsulation format data are obtained by solution agreement.
The always initial data that the video file on automatic network or phase generator terminal obtain, by solving agreement, as http, rtmp,
The agreements such as file obtain the data of encapsulation format, the data include a variety of encapsulation format video file, as mp4, flv, mkv,
The formats such as mpegts, avi.Algorithm training is set to possess more extensive more flexible number come the video data on automatic network by obtaining
According to source, while also saving a large amount of memory space.
S112：Format decapsulation is carried out to encapsulation format data, obtains bit stream data.
Above-mentioned bit stream data includes：Audio code stream data and video codeword data stream.The coded format of the bit stream data includes：
One of h264, h265, mpeg2, acc or a variety of.
S113：Bit stream data is decoded, video code flow core data is obtained.
Above-mentioned video code flow core data includes：Audio sampling data and video pixel data.The video code flow core number
Include according to coded format：One of yuv420p, yuv422p, rgb24, pcm or a variety of.
Bit stream data is decoded, video code flow core data is obtained, is provided for the data transmission in next step S12
Data source.
S12：Based on RTSP, video code flow core data interface channel is established with central apparatus.
RTSP (Real-Time Stream Protocol), i.e. real time streaming transport protocol are the more matchmakers of text based
Body plays control protocol, belongs to application layer.As an application layer protocol, RTSP provides a frame for extension, makes
The controlled and program request for obtaining Streaming Media becomes possible, it is mainly used to the transmission that control has the data of real-time characteristic, but itself
It is not used to transmission stream medium data, and underlying transport protocols must be relied on, such as RTP/RTCP, provided service is completed to flow
The transmission of media data.RTP (Realtime Transport Protocol) real-time transport protocol：It is on Internet
One transport protocol of multimedia data stream.RTCP (Realtime Transport ControlProtocol) real-time Transmission control
Agreement processed：It is responsible for management transmission quality exchange of control information between current application process.
In the present embodiment, it is based on RTSP, establishes interface channel with central apparatus, video code flow core number is sent by network
According to.
As shown in figure 3, step S12 specifically includes following two sub-step：
S121：Pass through RTSP transmission of configuration information.
Configuration information includes：Specific control information, operating method, status code, and description interact behaviour between RTP
Make.By RTSP, one or more RTSP clients of server and central apparatus is made to establish connection, and handles playing request.
The connection of RTSP uses Transmission Control Protocol.TCP (Transmission Control Protocol) transmission control protocol：It is a kind of face
To connection, reliable, the transport layer communication protocol based on byte stream.
S122：According to configuration information, the video code flow core data interface channel based on RTP is established.
In the embodiment of the present invention, video codeword data stream is transmitted using RTP, establishes data connection channel, wherein transmission video
The RTP of data uses udp protocol.UDP (User Datagram Protocol) User Datagram Protocol：It is OSI (Open
System Interconnection), i.e. a kind of open system interconnection, connectionless transport layer protocol in reference model mentions
For the simple unreliable information transmission service towards affairs.
S13：Video code flow core data is sent to the RTSP client of central apparatus, video code flow core data is led to
It crosses algorithm identification and realizes video structural.
In the embodiment of the present invention, receiving end of the RTSP client as multi-channel video is mainly based upon live555 to video
The reception and processing of the video data of coded format obtain the video data in transmission data packet, and parse and obtain complete frame
Data.
Live555 is one and provides the cross-platform C++ open source projects of solution for Streaming Media, realizes to normal stream
The support of media transmission protocol such as RTP/RTCP, RTSP, SIP etc..To the stream of the audio, video data of a variety of audio/video coding formats
Change, reception and processing etc. are supported, including MPEG, DV, JPEG video and a variety of audio codings.
Step S13：Video code flow core data is sent to the RTSP client of central apparatus, by video code flow core number
Video structural is realized according to identifying by algorithm, as shown in figure 4, specifically including following four sub-step：
S131：Respond one or more connection requests that RTSP client is initiated.
RTSP server receives and responds one or more connection requests of RTSP client initiation, is step S132, to
RTSP client transmission video code flow core data is prepared.
S132：According to the play command that RTSP client is sent, the video code flow core data with RTSP client is carried out
Transmission.
RTSP server receives RTSP client and sends play command, and RTSP server controls the transmission of media stream, makes
Transmission stream medium data is transmitted with RTP.In the present embodiment, the friendship with RTSP server is mainly carried out using the RTSP client
Mutually, stream medium data is obtained, provides data source for the data decoding in next step S133.
S133：It to the core data received while being decoded by multiple decoding channels.
Start RTSP client in central apparatus, can receive video code flow core data packet, core is obtained by decoding
Calculation evidence is realized and is handled in video structural of the RTSP client to the video data come on automatic network.RTSP client decoding
Attribute can be set to：Corresponding decoded output is carried out to different video data, therefore, multiple decoding channels docking can be opened
It the multi-channel video code stream core data that receives while being decoded, realizes multiple-channel output, provided for video structural proof of algorithm
Multi-channel analog test scene.
Relative in conventional video structured data transfer method, RTSP transmission not only provides expanding for data transmission
Property, it also meets the multi-channel video in video structural while detecting the functional requirement of identification.
S134：Video code flow core data is identified by algorithm and realizes video structural.
Feature extraction is carried out to video code flow core data using the neural network algorithm of multiple convolutional layers, obtains feature
Figure.For each characteristic pattern, the object of each object in core data corresponding with characteristic pattern is determined using neural network algorithm
Classification, i.e. interesting target, such as：Bicycle, two-wheeled motor vehicle, motor tricycle, car, minibus, truck, large-scale visitor
Vehicle, pedestrian, face etc..Each object in characteristic pattern is encoded, video structural can be to object in time series chart
It is tracked as in, obtains the object category and coding of a series of time serieses.
By RTSP transmission method, the recognizer of the client of RTSP obtains decoded data source, can be by hard
The accelerating engine at part end promotes recognition speed by running algorithm training program.It realizes simultaneously and external data source is known
, do not limit to not only with itself camera, do not need additionally to open up memory space yet.
In a kind of video structural method provided in an embodiment of the present invention, this method is applied to RTSP server, including：It mentions
Take the video code flow core data of encapsulation format video file；Based on RTSP, video code flow core data is established with central apparatus
Interface channel；Video code flow core data is sent to the RTSP client of central apparatus, video code flow core data is passed through
Video structural is realized in algorithm identification.This method is by the more enough video datas for transmitting various encapsulation format of RTSP server, together
Shi Liyong RTSP client receives data and is decoded and video structural, alleviates and needs extra storage empty in existing method
Between and the limited technical problem of data source, can satisfy multi-channel video while detecting the functional requirement of identification, improve training speed
Degree, provides more optimized algorithm simulating environment.
Embodiment two：
The embodiment of the invention provides a kind of video structural devices, as shown in figure 5, the device includes：
Data extraction module 21, data transmission module 22, data reception module 23；Data extraction module 21 includes：It obtains
Unit 211, decapsulation unit 212, decoding unit 213；Data transmit mould 22：RTSP control unit 221, RTP transmission are single
Member 222；Data reception module 23 includes：Connection unit 231, order unit 232, hardware decoding unit 233, structuring unit
234。
Data extraction module 21, for extracting the video code flow core data of encapsulation format video file；Data transmit mould
Block 22 establishes video code flow core data interface channel with central apparatus for being based on RTSP；Data reception module 23, is used for
Video code flow core data is sent to the RTSP client of central apparatus, video code flow core data is identified in fact by algorithm
Existing video structural.
Acquiring unit 211 obtains encapsulation format by solution agreement for obtaining initial data from video file or phase generator terminal
Data；Decapsulation unit 212 obtains bit stream data for carrying out format decapsulation to encapsulation format data；Decoding unit 213,
For being decoded to bit stream data, video code flow core data is obtained.RTSP control unit 221, for being transmitted by RTSP
Configuration information；RTP transmission unit 222 is logical for according to configuration information, establishing the video code flow core data connection based on RTP
Road.Connection unit 231, for responding one or more connection requests of RTSP client initiation；Order unit 232 is used for root
According to the play command that RTSP client is sent, transmit with the video code flow core data of RTSP client；Hardware decoding is single
Member 233, for the core data received while being decoded by multiple decoding channels；Structuring unit 234, being used for will
Video code flow core data is identified by algorithm realizes video structural.
The technical effect and preceding method embodiment phase of device provided by the embodiment of the present invention, realization principle and generation
Together, to briefly describe, Installation practice part does not refer to place, can refer to corresponding contents in preceding method embodiment.
Video structural device provided in an embodiment of the present invention and video structural method provided by the above embodiment, have
Identical technical characteristic, therefore also can solve identical technical problem, reach identical technical effect.
Embodiment three：
The embodiment of the invention provides a kind of video structural system, which includes that RTSP client and embodiment two mention
The video structural device of confession.
The RTSP server in video structural device that embodiment two provides, can communicate with multiple RTSP clients.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description
It with the specific work process of device, can refer to corresponding processes in the foregoing method embodiment, details are not described herein.
The flow chart and block diagram in the drawings show the system of multiple embodiments according to the present invention, method and computer journeys
The architecture, function and operation in the cards of sequence product.In this regard, each box in flowchart or block diagram can generation
A part of one module, section or code of table, a part of the module, section or code include one or more use
The executable instruction of the logic function as defined in realizing.It should also be noted that in some implementations as replacements, being marked in box
The function of note can also occur in a different order than that indicated in the drawings.For example, two continuous boxes can actually base
Originally it is performed in parallel, they can also be executed in the opposite order sometimes, and this depends on the function involved.It is also noted that
It is the combination of each box in block diagram and or flow chart and the box in block diagram and or flow chart, can uses and execute rule
The dedicated hardware based system of fixed function or movement is realized, or can use the group of specialized hardware and computer instruction
It closes to realize.
In several embodiments provided herein, it should be understood that disclosed systems, devices and methods, it can be with
It realizes by another way.The apparatus embodiments described above are merely exemplary, for example, the division of the unit,
Only a kind of logical function partition, there may be another division manner in actual implementation, in another example, multiple units or components can
To combine or be desirably integrated into another system, or some features can be ignored or not executed.Another point, it is shown or beg for
The mutual coupling, direct-coupling or communication connection of opinion can be through some communication interfaces, device or unit it is indirect
Coupling or communication connection can be electrical property, mechanical or other forms.
It, can also be in addition, the functional units in various embodiments of the present invention may be integrated into one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.
It, can be with if the function is realized in the form of SFU software functional unit and when sold or used as an independent product
It is stored in the executable non-volatile computer-readable storage medium of a processor.Based on this understanding, of the invention
Technical solution substantially the part of the part that contributes to existing technology or the technical solution can be with software in other words
The form of product embodies, which is stored in a storage medium, including some instructions use so that
One computer equipment (can be personal computer, server or the network equipment etc.) executes each embodiment institute of the present invention
State all or part of the steps of method.And storage medium above-mentioned includes：USB flash disk, mobile hard disk, read-only memory (ROM, Read-
Only Memory), random access memory (RAM, Random AccessMemory), magnetic or disk etc. is various to deposit
Store up the medium of program code.
Finally it should be noted that：Embodiment described above, only a specific embodiment of the invention, to illustrate the present invention
Technical solution, rather than its limitations, scope of protection of the present invention is not limited thereto, although with reference to the foregoing embodiments to this hair
It is bright to be described in detail, those skilled in the art should understand that：Anyone skilled in the art
In the technical scope disclosed by the present invention, it can still modify to technical solution documented by previous embodiment or can be light
It is readily conceivable that variation or equivalent replacement of some of the technical features；And these modifications, variation or replacement, do not make
The essence of corresponding technical solution is detached from the spirit and scope of technical solution of the embodiment of the present invention, should all cover in protection of the invention
Within the scope of.Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (10)
1. a kind of video structural method, which is characterized in that the method is applied to RTSP server, including：
Extract the video code flow core data of encapsulation format video file；
Based on RTSP, video code flow core data interface channel is established with central apparatus；
The video code flow core data is sent to the RTSP client of the central apparatus, by the video code flow core number
Video structural is realized according to identifying by algorithm.
2. the method according to claim 1, wherein the video code flow core for extracting encapsulation format video file
Calculation evidence, specifically includes：
Initial data is obtained from video file or phase generator terminal, encapsulation format data are obtained by solution agreement；
Format decapsulation is carried out to the encapsulation format data, obtains bit stream data, the bit stream data includes：Audio code fluxion
According to and video codeword data stream；
The bit stream data is decoded, video code flow core data is obtained, the video code flow core data includes：Audio
Sampled data and video pixel data.
3. establishing video code flow with central apparatus the method according to claim 1, wherein described be based on RTSP
Core data interface channel, including：
Pass through RTSP transmission of configuration information；
According to the configuration information, the video code flow core data interface channel based on RTP is established.
4. the method according to claim 1, wherein described send institute to the RTSP client of the central apparatus
Video code flow core data is stated, including：
Respond one or more connection requests that the RTSP client is initiated；
According to the play command that the RTSP client is sent, pass with the video code flow core data of the RTSP client
It is defeated.
5. the method according to claim 1, wherein described send institute to the RTSP client of the central apparatus
After stating video code flow core data, further include：
It to the core data received while being decoded by multiple decoding channels.
6. a kind of video structural device, which is characterized in that described device is applied to RTSP server, including：
Data extraction module, for extracting the video code flow core data of encapsulation format video file；
Data transmission module establishes video code flow core data interface channel with central apparatus for being based on RTSP；
Data reception module will for sending the video code flow core data to the RTSP client of the central apparatus
The video code flow core data is identified by algorithm realizes video structural.
7. device according to claim 6, which is characterized in that the data extraction module includes：
Acquiring unit obtains encapsulation format data by solution agreement for obtaining initial data from video file or phase generator terminal；
Decapsulation unit obtains bit stream data for carrying out format decapsulation to the encapsulation format data；
Decoding unit obtains video code flow core data for being decoded to the bit stream data.
8. device according to claim 6, which is characterized in that the data transmission module includes：
RTSP control unit, for passing through RTSP transmission of configuration information；
RTP transmission unit, for establishing the video code flow core data interface channel based on RTP according to the configuration information.
9. device according to claim 6, which is characterized in that the data reception module includes：
Connection unit, the one or more connection requests initiated for responding the RTSP client；
Order unit, the play command for being sent according to the RTSP client carry out the video with the RTSP client
The transmission of code stream core data；
Structuring unit realizes video structural for identifying the video code flow core data by algorithm.
10. a kind of video structural system, which is characterized in that including RTSP client and as described in any one of claim 6 to 9
Video structural device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810957605.8A CN108900898A (en) | 2018-08-21 | 2018-08-21 | Video structural method, apparatus and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810957605.8A CN108900898A (en) | 2018-08-21 | 2018-08-21 | Video structural method, apparatus and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108900898A true CN108900898A (en) | 2018-11-27 |
Family
ID=64355052
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810957605.8A Pending CN108900898A (en) | 2018-08-21 | 2018-08-21 | Video structural method, apparatus and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108900898A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112040269A (en) * | 2020-09-08 | 2020-12-04 | 平安科技（深圳）有限公司 | Video data display method and device, terminal equipment and storage medium |
| CN112243147A (en) * | 2019-07-16 | 2021-01-19 | 青岛海信传媒网络技术有限公司 | Video image zooming method, video image zooming service device and display equipment |
| CN114037941A (en) * | 2021-11-22 | 2022-02-11 | 南京启数智能系统有限公司 | Method and device for algorithmic multi-data cross-validation completion for video target attributes |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101448152A (en) * | 2007-11-28 | 2009-06-03 | 深圳华为通信技术有限公司 | Multi-channel video processing method and system, terminal and media server |
| CN101895737A (en) * | 2010-07-13 | 2010-11-24 | 中兴通讯股份有限公司 | Multimedia decoding method and device, video monitoring method and system |
| CN104735426A (en) * | 2015-04-07 | 2015-06-24 | 中国工商银行股份有限公司 | Multi-input and multi-output video processing device and method |
| CN104751639A (en) * | 2015-03-17 | 2015-07-01 | 上海视聪网络信息技术有限公司 | Big-data-based video structured license plate recognition system and method |
| CN105007465A (en) * | 2015-07-21 | 2015-10-28 | 江苏物联网研究发展中心 | Cipher-text H264 video live-broadcasting and on-demand platform based on live555 frame and ffmpeg library |
| US20160381431A1 (en) * | 2015-06-24 | 2016-12-29 | Time Warner Cable Enterprises Llc | Multicast video program switching architecture |
| CN106982356A (en) * | 2017-04-08 | 2017-07-25 | 复旦大学 | A kind of distributed extensive video flow processing system |
| CN108009473A (en) * | 2017-10-31 | 2018-05-08 | 深圳大学 | Based on goal behavior attribute video structural processing method, system and storage device |
| CN108062349A (en) * | 2017-10-31 | 2018-05-22 | 深圳大学 | Video frequency monitoring method and system based on video structural data and deep learning |
-
2018
- 2018-08-21 CN CN201810957605.8A patent/CN108900898A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101448152A (en) * | 2007-11-28 | 2009-06-03 | 深圳华为通信技术有限公司 | Multi-channel video processing method and system, terminal and media server |
| CN101895737A (en) * | 2010-07-13 | 2010-11-24 | 中兴通讯股份有限公司 | Multimedia decoding method and device, video monitoring method and system |
| CN104751639A (en) * | 2015-03-17 | 2015-07-01 | 上海视聪网络信息技术有限公司 | Big-data-based video structured license plate recognition system and method |
| CN104735426A (en) * | 2015-04-07 | 2015-06-24 | 中国工商银行股份有限公司 | Multi-input and multi-output video processing device and method |
| US20160381431A1 (en) * | 2015-06-24 | 2016-12-29 | Time Warner Cable Enterprises Llc | Multicast video program switching architecture |
| CN105007465A (en) * | 2015-07-21 | 2015-10-28 | 江苏物联网研究发展中心 | Cipher-text H264 video live-broadcasting and on-demand platform based on live555 frame and ffmpeg library |
| CN106982356A (en) * | 2017-04-08 | 2017-07-25 | 复旦大学 | A kind of distributed extensive video flow processing system |
| CN108009473A (en) * | 2017-10-31 | 2018-05-08 | 深圳大学 | Based on goal behavior attribute video structural processing method, system and storage device |
| CN108062349A (en) * | 2017-10-31 | 2018-05-22 | 深圳大学 | Video frequency monitoring method and system based on video structural data and deep learning |
Non-Patent Citations (2)
| Title |
|---|
| 谢兴昶: "基于视频结构化描述技术的车辆大数据系统的设计与实现", 《中国优秀硕士学位论文全文数据库》 * |
| 陈海燕: "基于人脸识别技术的视频结构化智能分析平台", 《中国安防》 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112243147A (en) * | 2019-07-16 | 2021-01-19 | 青岛海信传媒网络技术有限公司 | Video image zooming method, video image zooming service device and display equipment |
| CN112243147B (en) * | 2019-07-16 | 2023-08-04 | Vidaa(荷兰)国际控股有限公司 | Video picture scaling method and display device |
| CN112040269A (en) * | 2020-09-08 | 2020-12-04 | 平安科技（深圳）有限公司 | Video data display method and device, terminal equipment and storage medium |
| WO2021147556A1 (en) * | 2020-09-08 | 2021-07-29 | 平安科技（深圳）有限公司 | Video data presentation method and apparatus, terminal device, and storage medium |
| CN114037941A (en) * | 2021-11-22 | 2022-02-11 | 南京启数智能系统有限公司 | Method and device for algorithmic multi-data cross-validation completion for video target attributes |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2017041366A1 (en) | Method and device for image recognition | |
| CN110198432A (en) | Processing method, device, computer-readable medium and the electronic equipment of video data | |
| MX2014012361A (en) | Methods and systems for real-time transmuxing of streaming media content. | |
| JP7410966B2 (en) | Multimedia data processing methods, devices, electronic devices and computer programs | |
| CN101212654A (en) | Network video monitoring system and data acquisition method | |
| CN108900898A (en) | Video structural method, apparatus and system | |
| CN113395284B (en) | Multi-scene voice service real-time matching method, system, equipment and storage medium | |
| CN116061973B (en) | Vehicle track prediction method, control device, readable storage medium, and vehicle | |
| US10360913B2 (en) | Speech recognition method, device and system based on artificial intelligence | |
| CN102137098A (en) | Method for on-line real-time recording and forwarding of audio/ video streams by mobile internet terminal | |
| CN112350986B (en) | Fragmentation shaping method and system for audio and video network transmission | |
| CN107733876A (en) | A kind of stream media caption display methods, mobile terminal and storage device | |
| CN107396134A (en) | Recorded broadcast equipment and remote teaching apparatus | |
| CN118317125A (en) | Real-time intelligent video analysis system, method and terminal based on edge computing | |
| EP2947629A1 (en) | Method for object-based coding of video information | |
| CN111541864B (en) | Digital retina software defined camera method and system | |
| CN117714741A (en) | Video file processing method, video management platform and storage medium | |
| CN113068059B (en) | Video live broadcasting method, device, equipment and storage medium | |
| US20250156369A1 (en) | Appliances and methods to provide robust computational services in addition to a/v encoding, for example at edge of mesh networks | |
| CN115209179A (en) | Video data processing method and device | |
| Ghini et al. | Industry 4.0 and video monitoring: a multidimensional approach based on MPEG-DASH | |
| CN109361671A (en) | A streaming media transmission architecture method based on SIP protocol | |
| CN114679630B (en) | Data transmission method, device and computer readable storage medium | |
| CN111787417B (en) | Audio and video transmission control method based on artificial intelligence AI and related equipment | |
| CN115080843A (en) | Monitoring scene video recommendation method, system, device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181127 |