CN110740296B

CN110740296B - Method and device for processing video stream monitored by video network

Info

Publication number: CN110740296B
Application number: CN201910945592.7A
Authority: CN
Inventors: 王志宾; 袁庆宁; 赵虎彪; 王艳辉
Original assignee: Visionvera Information Technology Co Ltd
Current assignee: Visionvera Information Technology Co Ltd
Priority date: 2019-09-30
Filing date: 2019-09-30
Publication date: 2022-02-08
Anticipated expiration: 2039-09-30
Also published as: CN110740296A

Abstract

The present invention provides a processing method and device for monitoring video streams via the Internet of Views. In the process of retrieving the monitoring video stream of the video network through the video network handheld, if the user feels that the resolution does not meet the user's requirements, he can input the conversion request of the resolution of the monitoring video stream on the video network handheld. The conversion request carries Definition parameter, the video network handheld sends the conversion request to the video network streaming media server, so that the video network streaming media server converts the first video network monitoring video stream that needs to be sent to the video network handheld channel with the help of the video network transcoder. It is the second video network monitoring video stream corresponding to the definition parameter, and the second video network monitoring video stream is sent to the video network handheld through the video network streaming media server, so that the video network handheld can call the video network that meets the user's needs. The video network monitoring video stream corresponding to the definition parameter.

Description

Method and device for processing video stream monitored by video network

Technical Field

The invention relates to the technical field of data processing, in particular to a method and a device for processing a video stream monitored by a video network.

Background

Nowadays, in order to provide safety prevention and guarantee for the work and life of people, a monitoring camera is often arranged at an important position, and a monitoring video stream at the important position is recorded through the monitoring camera.

And then, the staff can check the monitoring video stream recorded by the monitoring camera by using a computer, check whether suspicious personnel exist in the monitoring video stream, and the like.

The monitoring video stream recorded by the monitoring camera is usually of a specific definition, and the monitoring video stream of the specific definition can be checked by using a computer, but the specific definition sometimes does not meet the requirements of workers.

Disclosure of Invention

In order to solve the above problem, embodiments of the present invention show a method and an apparatus for processing a video stream monitored by a video network.

In a first aspect, an embodiment of the present invention shows a method for processing a video stream monitored by a video network, which is applied to video networking handheld communications, and the method includes:

in the process of calling video stream of the video network, acquiring a conversion request of video stream definition, wherein the conversion request carries definition parameters, and the conversion request is used for requesting to convert a first video stream of the video network to be transmitted to the video network palm into a second video stream of the video network corresponding to the definition parameters;

sending the conversion request to a video networking streaming media server; enabling the video networking streaming media server to send the first video networking monitoring video stream and the conversion request to a video networking transcoder, enabling the video networking transcoder to convert the first video networking monitoring video stream into a second video networking monitoring video stream corresponding to the definition parameter, and sending the second video networking monitoring video stream to the video networking streaming media server;

and receiving the second video network monitoring video stream returned by the video network streaming media server.

In an optional implementation, the method further includes:

and playing and/or storing the second video network monitoring video stream.

In an optional implementation, the method further includes:

receiving first prompt information sent by the video networking streaming media server, wherein the first prompt information is used for indicating that the video networking transcoder cannot execute definition conversion operation because the video networking transcoder is not online;

and displaying the first prompt message.

In an optional implementation, the method further includes:

receiving second prompt information sent by the video networking streaming media server, wherein the second prompt information is used for indicating that the definition conversion operation cannot be executed because the number of the video streams which are being converted by the video networking transcoder at the same time reaches a preset number;

and displaying the second prompt message.

In a second aspect, an embodiment of the present invention shows a method for processing a video stream in a video network, which is applied to a video streaming server, and the method includes:

receiving a conversion request of video stream definition sent by a video networking palm top switch, wherein the conversion request carries definition parameters, and the conversion request is used for requesting to convert a first video networking monitoring video stream needing to be sent to the video networking palm top switch into a second video networking monitoring video stream corresponding to the definition parameters;

sending the first video networking monitoring video stream and the conversion request to a video networking transcoder so that the video networking transcoder converts the first video networking monitoring video stream into a second video networking monitoring video stream corresponding to the definition parameter and sends the second video networking monitoring video stream to a video networking streaming media;

receiving the second video networking monitoring video stream sent by the video networking repeater;

and sending the second video networking monitoring video stream to the video networking palm.

In an optional implementation manner, the conversion request further carries a user identifier of a user;

the method further comprises the following steps:

and storing the corresponding relation between the user identification and the definition parameter.

In an optional implementation, the method further includes:

detecting whether the video networking transcoder is online;

the step of sending the first video network surveillance video stream and the conversion request to a video network transcoder is performed with the video network transcoder online.

And under the condition that the video networking transcoder is not on line, sending first prompt information to the video networking palm, wherein the first prompt information is used for indicating that the video networking transcoder cannot execute definition conversion operation because of not being on line.

In an optional implementation manner, before sending the first video network surveillance video stream and the conversion request to the video network transcoder, the method further includes:

detecting whether the number of video streams being simultaneously converted by the video networking transcoder reaches a preset number or not;

when the number of the video streams being simultaneously converted by the video network transcoder does not reach a preset number, the step of sending the first video network monitoring video stream and the conversion request to the video network transcoder is executed;

and under the condition that the number of the video streams which are being simultaneously converted by the video networking transcoder reaches a preset number, sending second prompt information to the video networking palm, wherein the second prompt information is used for indicating that the definition conversion operation cannot be executed because the number of the video streams which are being simultaneously converted by the video networking transcoder reaches the preset number.

In a third aspect, an embodiment of the present invention shows a processing apparatus for video stream monitoring in a video networking, where the processing apparatus is applied to a video networking pda, and the apparatus includes:

the system comprises an acquisition module, a conversion module and a processing module, wherein the acquisition module is used for acquiring a conversion request of video stream definition in the process of calling video stream monitoring of a video network, the conversion request carries definition parameters, and the conversion request is used for requesting to convert a first video network monitoring video stream which needs to be transmitted to a video network palm in the future into a second video network monitoring video stream corresponding to the definition parameters;

the first sending module is used for sending the conversion request to a video networking streaming media server; enabling the video networking streaming media server to send the first video networking monitoring video stream and the conversion request to a video networking transcoder, enabling the video networking transcoder to convert the first video networking monitoring video stream into a second video networking monitoring video stream corresponding to the definition parameter, and sending the second video networking monitoring video stream to the video networking streaming media server;

and the first receiving module is used for receiving the second video networking monitoring video stream returned by the video networking streaming media server.

In an optional implementation, the apparatus further comprises:

and the playing and storing module is used for playing and/or storing the second video network monitoring video stream.

In an optional implementation, the apparatus further comprises:

the second receiving module is used for receiving first prompt information sent by the video networking streaming media server, wherein the first prompt information is used for indicating that the video networking transcoder cannot execute definition conversion operation because of being not on line;

and the first display module is used for displaying the first prompt message.

In an optional implementation, the apparatus further comprises:

a third receiving module, configured to receive second prompt information sent by the video networking streaming media server, where the second prompt information is used to indicate that a resolution conversion operation cannot be performed because the number of video streams being simultaneously converted by the video networking transcoder reaches a preset number;

and the second display module is used for displaying the second prompt message.

In a fourth aspect, an embodiment of the present invention shows an apparatus for processing video streams in a video network, where the apparatus is applied to a video streaming server, and the apparatus includes:

the fourth receiving module is used for receiving a conversion request of video stream definition sent by the video networking palm top, wherein the conversion request carries definition parameters, and the conversion request is used for requesting to convert a first video networking monitoring video stream needing to be sent to the video networking palm top later into a second video networking monitoring video stream corresponding to the definition parameters;

the second sending module is used for sending the first video networking monitoring video stream and the conversion request to a video networking transcoder so that the video networking transcoder converts the first video networking monitoring video stream into a second video networking monitoring video stream corresponding to the definition parameter and sends the second video networking monitoring video stream to a video networking streaming media;

a fifth receiving module, configured to receive the second video networking monitoring video stream sent by the video networking repeater;

and the third sending module is used for sending the second video networking monitoring video stream to the video networking palm.

the device further comprises:

and the storage module is used for storing the corresponding relation between the user identification and the definition parameter.

In an optional implementation, the apparatus further comprises:

the second detection module is used for detecting whether the video networking transcoder is online or not;

the second sending module is further configured to send the first video stream and the conversion request to the video network transcoder under the condition that the video network transcoder is online.

And the fourth sending module is used for sending first prompt information to the video networking palm under the condition that the video networking transcoder is not on line, wherein the first prompt information is used for indicating that the video networking transcoder cannot execute the definition conversion operation because of not being on line.

In an optional implementation, the apparatus further comprises:

the second detection module is used for detecting whether the number of the video streams which are being simultaneously converted by the video networking transcoder reaches a preset number or not;

the second sending module is further configured to send the first video stream and the conversion request to the video network transcoder of the video network when the number of video streams being simultaneously converted by the video network transcoder does not reach a preset number;

and a fifth sending module, configured to send, to the video networking pad, second prompt information when the number of video streams being simultaneously converted by the video networking transcoder reaches a preset number, where the second prompt information is used to indicate that a resolution conversion operation cannot be performed because the number of video streams being simultaneously converted by the video networking transcoder reaches the preset number.

In a fifth aspect, the embodiment of the present invention shows an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the processor executes the computer program, the processor implements the processing method of the video stream for monitoring video stream through the video network according to the first aspect.

In a sixth aspect, the embodiment of the present invention shows a computer-readable storage medium, on which a computer program is stored, the computer program causing a processor to execute the processing method of the video stream monitoring through the internet of view according to the first aspect.

In a seventh aspect, an embodiment of the present invention shows an electronic device, where the electronic device includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor, when executing the computer program, implements the processing method for monitoring a video stream through a video network according to the second aspect.

In an eighth aspect, the embodiment of the present invention shows a computer-readable storage medium, on which a computer program is stored, the computer program causing a processor to execute the processing method for monitoring video streams in video networking according to the second aspect.

The embodiment of the invention has the following advantages:

in the invention, in the process of calling the video stream of the video network through the video network palm, if a user feels that the definition of the called video stream of the video network does not meet the requirement of the user, a conversion request of the definition of the monitoring video stream can be input on the video network palm, the conversion request carries definition parameters, and the conversion request is used for requesting to convert a first video stream of the video network which needs to be sent to the video network palm into a second video stream of the video network corresponding to the definition parameters; the video networking palm leads to the video networking streaming media server to send the conversion request, so that the video networking streaming media server converts a first video networking monitoring video stream which needs to be sent to the video networking palm through later into a second video networking monitoring video stream corresponding to the definition parameter by means of a video networking transcoder, and sends the second video networking monitoring video stream to the video networking palm through the video networking streaming media server, and therefore the video networking palm through can call the video networking monitoring video stream corresponding to the definition parameter meeting the user requirement.

For example, the second video network monitoring video stream can be smoothly played later, so that the phenomenon of pause is avoided.

Drawings

Fig. 1 is a block diagram of a processing system for monitoring video streams in a video network according to an embodiment of the present invention.

Fig. 2 is a flowchart illustrating steps of a method for processing a surveillance video stream in a video network according to an embodiment of the present invention.

Fig. 3 is a flowchart illustrating steps of a method for processing a surveillance video stream in a video network according to an embodiment of the present invention.

Fig. 4 is a flowchart illustrating steps of a method for processing a surveillance video stream in a video network according to an embodiment of the present invention.

Fig. 5 is a block diagram of a processing apparatus for monitoring video streams in a video network according to an embodiment of the present invention.

Fig. 6 is a block diagram of a processing apparatus for monitoring video streams in a video network according to an embodiment of the present invention.

Fig. 7 is a networking schematic diagram of a video network of the present invention.

Fig. 8 is a schematic diagram of a hardware structure of a node server according to the present invention.

Fig. 9 is a schematic diagram of a hardware structure of an access switch of the present invention.

Fig. 10 is a schematic diagram of a hardware structure of an ethernet protocol conversion gateway according to the present invention.

Detailed Description

In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.

Referring to fig. 1, a block diagram of a processing system for monitoring video streams in a video network according to an embodiment of the present invention is shown, the system including:

the system comprises an internet of vision palm communication 01, an internet of vision streaming media server 02, an internet of vision server 03, an internet of vision protocol transfer server 04 and an internet of vision transcoder 05.

The video networking palm communication 01 is in communication connection with the video networking streaming media server 02 based on an internet protocol, the video networking streaming media server 02 is in communication connection with the video networking server 03 based on a video networking protocol, and the video networking streaming media server 02 is in communication connection with the video networking transcoder 05 based on a video networking protocol.

The video networking server 03 and the video networking transfer assisting server 04 are in communication connection based on a video networking protocol, the transfer assisting server 04 is connected with a camera, and the camera can collect monitoring video streams.

Referring to fig. 2, a flowchart illustrating steps of a method for processing a video stream for monitoring a video network according to an embodiment of the present invention is shown, where the method may be applied to the system shown in fig. 1, and the method may specifically include the following steps:

in step S101, in the process of retrieving the video stream monitored by the video network, the video network palm obtains a request for converting the definition of the video stream, where the request carries a definition parameter, and the request is used to request to convert a first video stream monitored by the video network palm that needs to be sent later into a second video stream monitored by the video network corresponding to the definition parameter;

when the user needs to call the video stream of the video network monitor, the user can input the user identification and the user password on the video network palm, so that the video networking palm logs in the video networking streaming media server according to the user account and the user password, then the user can transmit a request for calling the video networking monitoring video stream to the video networking streaming media server through the video networking palm, so that the networking streaming media server can log in the video networking streaming media server according to the request for calling the monitoring video stream, the video networking monitoring video stream collected by the camera is called by the video networking server and the co-transformation server, and transmits the called video network monitoring video stream to the video network palm, then the video network palm receives the video network monitoring video stream, therefore, the video networking monitoring video stream can be called and played later, and the user can check the video networking monitoring video stream.

However, the definition of the video stream may not meet the requirement of the user, for example, the performance of hardware equipment that the video network monitor is connected to on the palm is low, and the definition of the video stream is high, and the high definition usually means that the resolution, the bit rate, and the frame rate are high and the level of the encoding mode is high, but the hardware equipment with the low performance cannot smoothly play the video stream with the high definition, which may cause a pause phenomenon, and cause the user to not smoothly view the video stream, and then may reduce the viewing experience of the user.

Therefore, in order to avoid the situation, the invention supports that a user actively controls the definition of the video networking monitoring video stream which needs to be transmitted to the video networking handheld communication after the video networking handheld communication control video networking streaming media server needs to be converted by the video networking transcoder, so that the video networking monitoring video stream received after the video networking handheld communication is the video networking monitoring video stream corresponding to the definition parameter needed by the user.

For example, the hardware device on the video network palm is low in performance, the video network monitoring video stream corresponding to low definition is played, the pause phenomenon is avoided, the user can smoothly check the video network monitoring video stream, and the user experience can be improved.

In the invention, in the process of calling the video stream of the video network, if a user feels that the definition of the called video stream of the video network does not meet the requirement, the definition of a first video stream of the video network which needs to be sent to the video network palm after conversion can be converted, for example, a conversion request of the definition of the monitoring video stream can be input on the video network palm, the conversion request carries definition parameters, and the conversion request is used for requesting to convert the first video stream of the video network which needs to be sent to the video network palm later into a second video stream of the video network corresponding to the definition parameters; the internet of things palm obtains the conversion request and then executes step S102.

In step S102, the video network palm leads to the video network streaming media server to send the conversion request;

in step S103, the video network streaming server receives the conversion request;

in step S104, the video networking streaming media server sends the first video networking monitoring video stream and the conversion request to the video networking transcoder, so that the video networking transcoder converts the first video networking monitoring video stream into a second video networking monitoring video stream corresponding to the definition parameter, and sends the second video networking monitoring video stream to the video networking streaming media;

in the present invention, a video network converter may be used to convert the sharpness of the first video network surveillance video stream.

After the video networking streaming media server receives the conversion request, it is determined that a first video networking monitoring video stream which needs to be sent to the video networking palm top gateway later is required to be converted into a second video networking monitoring video stream corresponding to the definition parameter, and therefore after the video networking streaming media server obtains the first video networking monitoring video stream which needs to be sent to the video networking palm top gateway through the video networking server and the auxiliary conversion server, the first video networking monitoring video stream and the conversion request can be sent to the video networking transcoder, the video networking transcoder converts the first video networking monitoring video stream into the second video networking monitoring video stream corresponding to the definition parameter, and the second video networking monitoring video stream is sent to the video networking streaming media server.

In step S105, the video network streaming media server receives a second video network monitoring video stream sent by the video network repeater;

in step S106, the video networking streaming server sends the second video networking monitoring video stream to the video networking palm.

In step S107, the video networking palm receives the second video networking monitoring video stream returned by the video networking streaming media server.

Therefore, the video networking palm communication can call the video networking monitoring video stream corresponding to the definition parameter meeting the user requirement.

The second video networking pda may then play and/or store the second video networking surveillance video stream. So that the user can view the second video-networking surveillance video stream and thereafter also view the second video-networking surveillance video stream.

In another embodiment of the present invention, the conversion request may also carry a user identifier of the user; in this way, the video network streaming media server can also store the corresponding relation between the user identification and the definition parameter.

Therefore, if a user needs to call other video networking monitoring video streams again later, the video networking streaming media server can obtain definition parameters meeting the requirements of the user based on the corresponding relation and the user identification of the user, then the other video networking monitoring video streams obtained by the video networking server and the cooperation server are processed by a video networking encoder to obtain the video networking monitoring video streams corresponding to the definition parameters, and the video networking monitoring video streams corresponding to the definition parameters are sent to the video networking palm switch, so that the user can call the video networking monitoring video streams corresponding to the definition parameters, a switching request carrying the definition parameters is not needed to be manually input to the video networking palm switch again, and therefore the user operation can be simplified under the condition that the user calls the corresponding video networking monitoring video streams of the definition parameters.

In another embodiment of the present invention, before step S104, the video network streaming server may detect whether the video network transcoder is online;

in the case that the video network transcoder is online, the video network transcoder can perform the sharpness conversion operation, and thus, the video network streaming server may perform step S104: the first video network surveillance video stream and the conversion request are sent to a video network transcoder. Or, in the case that the video networking transcoder is not online, the video networking transcoder cannot perform the sharpness conversion operation, and thus, the video networking streaming server may send, to the video networking palm, first prompt information for indicating that the sharpness conversion operation cannot be performed because the video networking transcoder is not online.

Then, the video network palm receives first prompt information sent by the video network streaming media server and displays the first prompt information. The user can know that the video networking transcoder is not on line through the first prompt message, so that the definition conversion operation cannot be executed, namely, the user can know the reason for the definition conversion operation, and the definition of the video networking monitoring video is converted in a mode of finding other conversion definitions as soon as possible, otherwise, if the user does not know the reason for the definition conversion failure, the user can wait for the reason, but in fact the definition cannot be successfully converted, and the user experience can be reduced.

In another embodiment of the present invention, before step S104, the video network streaming media server needs to detect whether the number of video streams being simultaneously converted by the video network transcoder reaches a preset number; under the condition that the number of the video streams being simultaneously converted by the video networking transcoder does not reach the preset number, it indicates that the video networking transcoder does not reach the highest load at this time, and the video networking transcoder can perform the sharpness conversion operation at this time, so the video networking streaming server can perform the step S104: sending the first video network monitoring video stream and the conversion request to a video network transcoder; or, under the condition that the number of the video streams being simultaneously converted by the video networking transcoder reaches the preset number, it is indicated that the video networking transcoder reaches the highest load at this time, the video networking transcoder cannot perform the definition conversion operation at this time, and it is necessary to wait for the video networking transcoder to finish the definition of at least one video stream being currently converted before converting the first video networking monitoring video stream into the second video networking monitoring video stream corresponding to the definition parameter.

And then the video network palm receives second prompt information sent by the video network streaming media server and displays the second prompt information. So that the user can know through the second prompt message that the quantity of the video stream that video networking transcoder is being converted simultaneously reaches the preset quantity, thereby definition conversion operation can't be carried out, namely, let the user can know the reason that definition conversion operation can't be carried out, so that let the user look for the definition of other conversion definition's modes as soon as possible and convert the definition of video networking surveillance video, or, wait for video networking transcoder to finish converting and can convert first video networking surveillance video stream into the second video networking surveillance video stream that this definition parameter corresponds after finishing the definition of at least one video stream that is currently converting, otherwise, if the user does not know the reason that can't convert the definition, and then can reduce user experience.

Referring to fig. 3, a flowchart illustrating steps of a method for processing a video stream monitored by a video network according to an embodiment of the present invention is shown, where the method may be applied to the video network pda 01 shown in fig. 1, and the method may specifically include the following steps:

in step S201, in a process of retrieving a video networking monitoring video stream, a conversion request of video stream definition is obtained, where the conversion request carries a definition parameter, and the conversion request is used to request to convert a first video networking monitoring video stream that needs to be transmitted to the video networking palm into a second video networking monitoring video stream corresponding to the definition parameter;

in step S202, sending the conversion request to a video networking streaming server; enabling the video networking streaming media server to send the first video networking monitoring video stream and the conversion request to a video networking transcoder, enabling the video networking transcoder to convert the first video networking monitoring video stream into a second video networking monitoring video stream corresponding to the definition parameter, and sending the second video networking monitoring video stream to the video networking streaming media server;

in step S203, the second video-networking monitoring video stream returned by the video-networking streaming media server is received.

In an optional implementation, the method further includes:

and playing and/or storing the second video network monitoring video stream.

In an optional implementation, the method further includes:

and displaying the first prompt message.

In an optional implementation, the method further includes:

and displaying the second prompt message.

Referring to fig. 4, a flowchart illustrating steps of a method for processing a video stream monitored by a video network according to an embodiment of the present invention is shown, where the method may be applied to the video streaming server 02 shown in fig. 1, and the method may specifically include the following steps:

in step S301, a request for converting the definition of a video stream sent by a video networking pda is received, where the request for converting carries a definition parameter, and the request for converting is used to request to convert a first video networking surveillance video stream that needs to be sent to the video networking pda later into a second video networking surveillance video stream corresponding to the definition parameter;

in step S302, the first video networking monitoring video stream and the conversion request are sent to a video networking transcoder, so that the video networking transcoder converts the first video networking monitoring video stream into a second video networking monitoring video stream corresponding to the definition parameter, and sends the second video networking monitoring video stream to a video networking streaming media;

in step S303, receiving the second video network monitoring video stream sent by the video network repeater;

in step S304, the second video-networking monitoring video stream is sent to the video-networking palm.

the method further comprises the following steps:

In an optional implementation, the method further includes:

detecting whether the video networking transcoder is online;

It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.

Referring to fig. 5, a block diagram of a processing apparatus for monitoring video streams in a video network according to an embodiment of the present invention is shown, and the apparatus is applied to video networking handheld communications, and specifically may include the following modules:

the acquiring module 11 is configured to acquire a request for converting definition of a video stream in a process of retrieving a video stream monitored by a video networking, where the request for converting carries a definition parameter, and the request for converting a first video stream monitored by the video networking is required to be transmitted to the video networking palm in the future into a second video stream monitored by the video networking corresponding to the definition parameter;

a first sending module 12, configured to send the conversion request to a video networking streaming server; enabling the video networking streaming media server to send the first video networking monitoring video stream and the conversion request to a video networking transcoder, enabling the video networking transcoder to convert the first video networking monitoring video stream into a second video networking monitoring video stream corresponding to the definition parameter, and sending the second video networking monitoring video stream to the video networking streaming media server;

the first receiving module 13 is configured to receive the second video-networking monitoring video stream returned by the video-networking streaming media server.

In an optional implementation, the apparatus further comprises:

and the first display module is used for displaying the first prompt message.

In an optional implementation, the apparatus further comprises:

and the second display module is used for displaying the second prompt message.

Referring to fig. 6, a block diagram of a processing apparatus for monitoring video streams in a video network according to an embodiment of the present invention is shown, and the apparatus is applied to a video streaming server, and specifically may include the following modules:

a fourth receiving module 21, configured to receive a request for converting definition of a video stream sent by a video networking pda, where the request for converting carries a definition parameter, and the request for converting is used to request to convert a first video networking monitoring video stream that needs to be sent to the video networking pda later into a second video networking monitoring video stream corresponding to the definition parameter;

a second sending module 22, configured to send the first video networking surveillance video stream and the conversion request to a video networking transcoder, so that the video networking transcoder converts the first video networking surveillance video stream into a second video networking surveillance video stream corresponding to the definition parameter, and sends the second video networking surveillance video stream to a video networking streaming media;

a fifth receiving module 23, configured to receive the second video networking monitoring video stream sent by the video networking repeater;

and a third sending module 24, configured to send the second video networking monitoring video stream to the video networking pad.

the device further comprises:

In an optional implementation, the apparatus further comprises:

For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.

The embodiment of the present invention also shows an electronic device, where the electronic device includes a memory, a processor, and a computer program stored in the memory and running on the processor, and when the processor executes the computer program, the method for processing a video stream monitored by a video network is implemented.

An embodiment of the present invention further illustrates a computer-readable storage medium, on which a computer program is stored, where the computer program enables a processor to execute the processing method for monitoring video streams in the video network.

The video networking is an important milestone for network development, is a real-time network, can realize high-definition video real-time transmission, and pushes a plurality of internet applications to high-definition video, and high-definition faces each other.

The video networking adopts a real-time high-definition video exchange technology, can integrate required services such as dozens of services of video, voice, pictures, characters, communication, data and the like on a system platform on a network platform, such as high-definition video conference, video monitoring, intelligent monitoring analysis, emergency command, digital broadcast television, delayed television, network teaching, live broadcast, VOD on demand, television mail, Personal Video Recorder (PVR), intranet (self-office) channels, intelligent video broadcast control, information distribution and the like, and realizes high-definition quality video broadcast through a television or a computer.

To better understand the embodiments of the present invention, the following description refers to the internet of view:

some of the technologies applied in the video networking are as follows:

network Technology (Network Technology)

Network technology innovation in video networking has improved the traditional Ethernet (Ethernet) to face the potentially huge first video traffic on the network. Unlike pure network Packet Switching (Packet Switching) or network Circuit Switching (Circuit Switching), the Packet Switching is adopted by the technology of the video networking to meet the Streaming requirement. The video networking technology has the advantages of flexibility, simplicity and low price of packet switching, and simultaneously has the quality and safety guarantee of circuit switching, thereby realizing the seamless connection of the whole network switching type virtual circuit and the data format.

Switching Technology (Switching Technology)

The video network adopts two advantages of asynchronism and packet switching of the Ethernet, eliminates the defects of the Ethernet on the premise of full compatibility, has end-to-end seamless connection of the whole network, is directly communicated with a user terminal, and directly bears an IP data packet. The user data does not require any format conversion across the entire network. The video networking is a higher-level form of the Ethernet, is a real-time exchange platform, can realize the real-time transmission of the whole-network large-scale high-definition video which cannot be realized by the existing Internet, and pushes a plurality of network video applications to high-definition and unification.

Server Technology (Server Technology)

The server technology on the video networking and unified video platform is different from the traditional server, the streaming media transmission of the video networking and unified video platform is established on the basis of connection orientation, the data processing capacity of the video networking and unified video platform is independent of flow and communication time, and a single network layer can contain signaling and data transmission. For voice and video services, the complexity of video networking and unified video platform streaming media processing is much simpler than that of data processing, and the efficiency is greatly improved by more than one hundred times compared with that of a traditional server.

Storage Technology (Storage Technology)

The super-high speed storage technology of the unified video platform adopts the most advanced real-time operating system in order to adapt to the media content with super-large capacity and super-large flow, the program information in the server instruction is mapped to the specific hard disk space, the media content is not passed through the server any more, and is directly sent to the user terminal instantly, and the general waiting time of the user is less than 0.2 second. The optimized sector distribution greatly reduces the mechanical motion of the magnetic head track seeking of the hard disk, the resource consumption only accounts for 20% of that of the IP internet of the same grade, but concurrent flow which is 3 times larger than that of the traditional hard disk array is generated, and the comprehensive efficiency is improved by more than 10 times.

Network Security Technology (Network Security Technology)

The structural design of the video network completely eliminates the network security problem troubling the internet structurally by the modes of independent service permission control each time, complete isolation of equipment and user data and the like, generally does not need antivirus programs and firewalls, avoids the attack of hackers and viruses, and provides a structural carefree security network for users.

Service Innovation Technology (Service Innovation Technology)

The unified video platform integrates services and transmission, and is not only automatically connected once whether a single user, a private network user or a network aggregate. The user terminal, the set-top box or the PC are directly connected to the unified video platform to obtain various multimedia video services in various forms. The unified video platform adopts a menu type configuration table mode to replace the traditional complex application programming, can realize complex application by using very few codes, and realizes infinite new service innovation.

Networking of the video network is as follows:

the video network is a centralized control network structure, and the network can be a tree network, a star network, a ring network and the like, but on the basis of the centralized control node, the whole network is controlled by the centralized control node in the network.

As shown in fig. 7, the video network is divided into an access network and a metropolitan network.

The devices of the access network part can be mainly classified into 3 types: node server, access switch, terminal (including various set-top boxes, coding boards, memories, etc.). The node server is connected to an access switch, which may be connected to a plurality of terminals and may be connected to an ethernet network.

The node server is a node which plays a centralized control function in the access network and can control the access switch and the terminal. The node server can be directly connected with the access switch or directly connected with the terminal.

Similarly, devices of the metropolitan network portion may also be classified into 3 types: a metropolitan area server, a node switch and a node server. The metro server is connected to a node switch, which may be connected to a plurality of node servers.

The node server is a node server of the access network part, namely the node server belongs to both the access network part and the metropolitan area network part.

The metropolitan area server is a node which plays a centralized control function in the metropolitan area network and can control a node switch and a node server. The metropolitan area server can be directly connected with the node switch or directly connected with the node server.

Therefore, the whole video network is a network structure with layered centralized control, and the network controlled by the node server and the metropolitan area server can be in various structures such as tree, star and ring.

The access network part can form a unified video platform (the part in the dotted circle), and a plurality of unified video platforms can form a video network; each unified video platform may be interconnected via metropolitan area and wide area video networking.

Video networking device classification

1.1 devices in the video network of the embodiment of the present invention can be mainly classified into 3 types: server, exchanger (including Ethernet protocol conversion gateway), terminal (including various set-top boxes, code board, memory, etc.). The video network as a whole can be divided into a metropolitan area network (or national network, global network, etc.) and an access network.

1.2 wherein the devices of the access network part can be mainly classified into 3 types: node server, access exchanger (including Ethernet protocol conversion gateway), terminal (including various set-top boxes, coding board, memory, etc.).

The specific hardware structure of each access network device is as follows:

a node server:

as shown in fig. 8, the system mainly includes a network interface module 201, a switching engine module 202, a CPU module 203, and a disk array module 204;

the network interface module 201, the CPU module 203, and the disk array module 204 all enter the switching engine module 202; the switching engine module 202 performs an operation of looking up the address table 205 on the incoming packet, thereby obtaining the direction information of the packet; and stores the packet in a queue of the corresponding packet buffer 206 based on the packet's steering information; if the queue of the packet buffer 206 is nearly full, it is discarded; the switching engine module 202 polls all packet buffer queues for forwarding if the following conditions are met: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero. The disk array module 204 mainly implements control over the hard disk, including initialization, read-write, and other operations on the hard disk; the CPU module 203 is mainly responsible for protocol processing with an access switch and a terminal (not shown in the figure), configuring an address table 205 (including a downlink protocol packet address table, an uplink protocol packet address table, and a data packet address table), and configuring the disk array module 204.

The access switch:

as shown in fig. 9, the network interface module (downlink network interface module 301, uplink network interface module 302), switching engine module 303 and CPU module 304 are mainly included;

wherein, the packet (uplink data) coming from the downlink network interface module 301 enters the packet detection module 305; the packet detection module 305 detects whether the Destination Address (DA), the Source Address (SA), the packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id) and enters the switching engine module 303, otherwise, discards the stream identifier; the packet (downstream data) coming from the upstream network interface module 302 enters the switching engine module 303; the incoming data packet of the CPU module 304 enters the switching engine module 303; the switching engine module 303 performs an operation of looking up the address table 306 on the incoming packet, thereby obtaining the direction information of the packet; if the packet entering the switching engine module 303 is from the downstream network interface to the upstream network interface, the packet is stored in the queue of the corresponding packet buffer 307 in association with the stream-id; if the queue of the packet buffer 307 is nearly full, it is discarded; if the packet entering the switching engine module 303 is not from the downlink network interface to the uplink network interface, the data packet is stored in the queue of the corresponding packet buffer 307 according to the guiding information of the packet; if the queue of the packet buffer 307 is nearly full, it is discarded.

The switching engine module 303 polls all packet buffer queues and may include two cases:

if the queue is from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queued packet counter is greater than zero; 3) obtaining a token generated by a code rate control module;

if the queue is not from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero.

The rate control module 308 is configured by the CPU module 304, and generates tokens for packet buffer queues from all downstream network interfaces to upstream network interfaces at programmable intervals to control the rate of upstream forwarding.

The CPU module 304 is mainly responsible for protocol processing with the node server, configuration of the address table 306, and configuration of the code rate control module 308.

Ethernet protocol conversion gateway：

As shown in fig. 10, the system mainly includes a network interface module (a downlink network interface module 401 and an uplink network interface module 402), a switching engine module 403, a CPU module 404, a packet detection module 405, a rate control module 408, an address table 406, a packet buffer 407, a MAC adding module 409, and a MAC deleting module 410.

Wherein, the data packet coming from the downlink network interface module 401 enters the packet detection module 405; the packet detection module 405 detects whether the ethernet MAC DA, the ethernet MAC SA, the ethernet length or frame type, the video network destination address DA, the video network source address SA, the video network packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id); then, the MAC deletion module 410 subtracts MAC DA, MAC SA, length or frame type (2byte) and enters the corresponding receiving buffer, otherwise, discards it;

the downlink network interface module 401 detects the sending buffer of the port, and if there is a packet, obtains the ethernet MAC DA of the corresponding terminal according to the destination address DA of the packet, adds the ethernet MAC DA of the terminal, the MAC SA of the ethernet protocol gateway, and the ethernet length or frame type, and sends the packet.

The other modules in the ethernet protocol gateway function similarly to the access switch.

A terminal:

the system mainly comprises a network interface module, a service processing module and a CPU module; for example, the set-top box mainly comprises a network interface module, a video and audio coding and decoding engine module and a CPU module; the coding board mainly comprises a network interface module, a video and audio coding engine module and a CPU module; the memory mainly comprises a network interface module, a CPU module and a disk array module.

1.3 devices of the metropolitan area network part can be mainly classified into 2 types: node server, node exchanger, metropolitan area server. The node switch mainly comprises a network interface module, a switching engine module and a CPU module; the metropolitan area server mainly comprises a network interface module, a switching engine module and a CPU module.

2. Video networking packet definition

2.1 Access network packet definition

The data packet of the access network mainly comprises the following parts: destination Address (DA), Source Address (SA), reserved bytes, payload (pdu), CRC.

As shown in the following table, the data packet of the access network mainly includes the following parts:

DA

SA

Reserved

Payload

CRC

wherein:

the Destination Address (DA) is composed of 8 bytes (byte), the first byte represents the type of the data packet (such as various protocol packets, multicast data packets, unicast data packets, etc.), there are 256 possibilities at most, the second byte to the sixth byte are metropolitan area network addresses, and the seventh byte and the eighth byte are access network addresses;

the Source Address (SA) is also composed of 8 bytes (byte), defined as the same as the Destination Address (DA);

the reserved byte consists of 2 bytes;

the payload part has different lengths according to different types of datagrams, and is 64 bytes if the datagram is various types of protocol packets, and is 32+1024 or 1056 bytes if the datagram is a unicast packet, of course, the length is not limited to the above 2 types;

the CRC consists of 4 bytes and is calculated in accordance with the standard ethernet CRC algorithm.

2.2 metropolitan area network packet definition

The topology of a metropolitan area network is a graph and there may be 2, or even more than 2, connections between two devices, i.e., there may be more than 2 connections between a node switch and a node server, a node switch and a node switch, and a node switch and a node server. However, the metro network address of the metro network device is unique, and in order to accurately describe the connection relationship between the metro network devices, parameters are introduced in the embodiment of the present invention: a label to uniquely describe a metropolitan area network device.

In this specification, the definition of the Label is similar to that of the Label of MPLS (Multi-Protocol Label Switch), and assuming that there are two connections between the device a and the device B, there are 2 labels for the packet from the device a to the device B, and 2 labels for the packet from the device B to the device a. The label is classified into an incoming label and an outgoing label, and assuming that the label (incoming label) of the packet entering the device a is 0x0000, the label (outgoing label) of the packet leaving the device a may become 0x 0001. The network access process of the metro network is a network access process under centralized control, that is, address allocation and label allocation of the metro network are both dominated by the metro server, and the node switch and the node server are both passively executed, which is different from label allocation of MPLS, and label allocation of MPLS is a result of mutual negotiation between the switch and the server.

As shown in the following table, the data packet of the metro network mainly includes the following parts:

DA

SA

Reserved

label (R)

Payload

CRC

Namely Destination Address (DA), Source Address (SA), Reserved byte (Reserved), tag, payload (pdu), CRC. The format of the tag may be defined by reference to the following: the tag is 32 bits with the upper 16 bits reserved and only the lower 16 bits used, and its position is between the reserved bytes and payload of the packet.

The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.

Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.

The foregoing describes in detail a method and apparatus for processing a video stream monitored by a video network, and a specific example is applied in the description to explain the principle and implementation of the present invention, and the description of the foregoing embodiment is only used to help understand the method and core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. a processing method of video network monitoring video stream, is characterized in that, is applied to video network palm-top communication, described method comprises:

In the process of retrieving the video stream monitored by the Internet of Things, a conversion request of the definition of the video stream is obtained, and the conversion request carries the definition parameter, and the conversion request is used to request the first video to be sent to the mobile phone of the Internet of Video Convert a video network monitoring video stream into a second video network monitoring video stream corresponding to the definition parameter;

Sending the conversion request to a video network streaming media server; so that the video network streaming media server sends the first video network monitoring video stream and the conversion request to a video network transcoder, and makes the video network transcoding The device converts the first Internet-of-view monitoring video stream into a second Internet-of-view monitoring video stream corresponding to the definition parameter, and sends the second Internet-of-view monitoring video stream to the Internet-of-view streaming media server; The streaming media server is communicatively connected to a video networking server, the video networking server is communicatively connected to a co-translation server, the co-transmission server is connected with a camera, and the co-transmission server is used to obtain the first video network monitoring from the camera video stream, and transmit the first video network monitoring video stream to the video network streaming media server through the video network server;

receiving the second Internet-of-view monitoring video stream returned by the Internet-of-view streaming media server;

Wherein, the conversion request carries a user ID, and the video streaming server is also used to store the corresponding relationship between the user ID and the definition parameter, so that when the user needs to retrieve a different video monitoring video stream of the video network At the time, the Internet-of-view streaming media server obtains the definition parameter that meets the user's requirement according to the corresponding relationship and the user identifier.

2. The method according to claim 1, wherein the method further comprises:

Playing and/or storing the second network-of-view surveillance video stream.

3. The method according to claim 1, wherein the method further comprises:

receiving first prompt information sent by the video network streaming media server, where the first prompt information is used to indicate that the definition conversion operation cannot be performed because the video network transcoder is not online;

The first prompt information is displayed.

4. The method according to claim 1, wherein the method further comprises:

Receive second prompt information sent by the video network streaming media server, where the second prompt information is used to indicate that the definition conversion cannot be performed because the number of video streams being converted by the video network transcoder at the same time reaches a preset number operate;

The second prompt information is displayed.

5. A processing method for monitoring video streams via the Internet of Views, characterized in that it is applied to a streaming media server of the Internet of Views, the streaming media servers of the Internet of Views are connected in communication with the Internet-of-views servers, and the Internet-of-views servers are connected in communication with the co-translation servers. A camera is connected to the co-translation server, and the co-translation server is used to obtain the first video network monitoring video stream from the camera, and transmit the first video network monitoring video stream to the video network through the video network server. Described video network streaming media server; Described method comprises:

Receive a video stream definition conversion request sent by the video network handheld, the conversion request carries the definition parameter, and the conversion request is used to request the first video network monitoring video stream that needs to be sent to the video network handheld. Converting to a second video network monitoring video stream corresponding to the definition parameter;

Send the first network-of-view monitoring video stream and the conversion request to the network-of-view transcoder, so that the network-of-view transcoder converts the first network-of-view monitoring video stream to the corresponding resolution parameter. the second video network monitoring video stream, and sending the second video network monitoring video stream to the video network streaming media;

receiving the second Internet-of-view monitoring video stream sent by the Internet-of-view repeater;

sending the second video network monitoring video stream to the video network handheld communication;

6. The method according to claim 5, wherein the conversion request also carries the user identification of the user;

The method also includes:

The correspondence between the user identification and the definition parameter is stored.

7. The method according to claim 5, wherein the method further comprises:

Detecting whether the video network transcoder is online;

Under the condition that the Internet-of-view transcoder is online, the step of sending the first Internet-of-view monitoring video stream and the conversion request to the Internet-of-view transcoder is performed;

In the case that the video network transcoder is not online, first prompt information is sent to the video network handheld communication, and the first prompt information is used to indicate that the video network transcoder cannot be executed clearly because it is not online. Degree conversion operation.

8. The method according to claim 5, characterized in that, before sending the first Internet-of-view monitoring video stream and the conversion request to the Internet-of-view transcoder, the method further comprises:

Detecting whether the number of video streams being simultaneously converted by the video network transcoder reaches a preset number;

In the case that the number of video streams being simultaneously converted by the network-of-view transcoder does not reach a preset number, execute the sending the first network-of-view monitoring video stream and the conversion request to the network-of-view transcoder A step of;

In the case that the number of video streams being simultaneously converted by the video network transcoder reaches a preset number, send second prompt information to the video network handheld, where the second prompt information is used to indicate that due to the video The networked transcoder is converting the preset number of streams simultaneously and cannot perform the resolution conversion.

9. A processing device for monitoring a video stream via the Internet of Views, characterized in that it is applied to the handheld communication of Internet of Views, and the device comprises:

The obtaining module is used to obtain a conversion request of the definition of the video stream in the process of retrieving the monitoring video stream of the video network, the conversion request carries a definition parameter, and the conversion request is used to request that the video stream needs to be sent to the video network later. Converting the first Internet-of-view monitoring video stream sent by the handheld communication into the second Internet-of-view monitoring video stream corresponding to the definition parameter;

A first sending module, configured to send the conversion request to the Internet-of-view streaming media server; so that the Internet-of-view streaming media server sends the first Internet-of-view monitoring video stream and the conversion request to the Internet-of-view transcoder , and make the video network transcoder convert the first video network monitoring video stream into the second video network monitoring video stream corresponding to the definition parameter, and send the second video network monitoring video stream to the video network streaming media server. video stream; the video network streaming media server is connected to the video network server in communication, the video network server is communicatively connected to the co-translation server, the co-translation server is connected with a camera, and the co-translation server is used to obtain from the camera the first video network monitoring video stream, and the first video network monitoring video stream is transmitted to the video network streaming media server through the video network server;

a first receiving module, configured to receive the second network-of-view monitoring video stream returned by the network-of-view streaming media server;

10. A processing device for monitoring a video stream via the Internet of Views, characterized in that it is applied to a streaming media server of the Internet of Views, the streaming media server of the Internet of Views is communicatively connected to the Internet-of-views server, and the Internet-of-views server is communicatively connected to a co-translation server. A camera is connected to the co-translation server, and the co-translation server is used to obtain the first video network monitoring video stream from the camera, and transmit the first video network monitoring video stream to the video network through the video network server. Described video network streaming media server; Described apparatus comprises:

The fourth receiving module is used to receive a video stream definition conversion request sent by the video network handheld communication, the conversion request carries the definition parameter, and the conversion request is used to request that the video stream needs to be sent to the video network handheld communication later. Converting the first network-of-view monitoring video stream into a second network-of-view monitoring video stream corresponding to the definition parameter;

A second sending module, configured to send the first network-of-view monitoring video stream and the conversion request to a network-of-view transcoder, so that the network-of-view transcoder converts the first network-of-view monitoring video stream for the second network-of-view monitoring video stream corresponding to the definition parameter, and sending the second network-of-view monitoring video stream to the network-of-view streaming media;

a fifth receiving module, configured to receive the second network-of-view monitoring video stream sent by the network-of-view repeater;

a third sending module, configured to send the second video network monitoring video stream to the video network handheld communication;