CN106303377A - Video monitoring processing method and processing device - Google Patents

Abstract

The present invention provides a video monitoring processing method and device, wherein the method includes: a client registers to a video conferencing system; the client receives a video sent by a video monitoring terminal, wherein the video monitoring terminal registers to the video conferencing system through a gateway . The invention solves the problem that the video conferencing system and the video monitoring system in the related art are not shared and integrated, and the client cannot monitor multiple channels at the same time, and then realizes video transcoding by using the codec capability of the MCU, and also saves the video monitoring Client, use the video conferencing client instead to realize the video monitoring function. At the same time, it can also use the MCU video synthesis capability, so that the client can monitor multiple terminals at the same time.

Description

Video surveillance processing method and device

technical field

The present invention relates to the communication field, in particular, to a video surveillance processing method and device.

Background technique

At present, the integration of video conferencing and video surveillance systems only connects video surveillance terminals to the video conferencing system, but the original video surveillance system is still independent of the video conferencing system, and the video surveillance system requires an independent video surveillance client and media processing services. The media processing capabilities of the two systems are not shared and integrated. The original video surveillance system has weak media processing capabilities. It only has media distribution and transcoding, but no video synthesis function. The client cannot monitor multiple channels at the same time.

In the related technologies, the video conferencing system and the video surveillance system are not shared and integrated, and the client cannot monitor multiple channels at the same time, and no effective solution has been proposed yet.

Contents of the invention

The present invention provides a video monitoring processing method and device to at least solve the problem in the related art that the video conferencing system and the video monitoring system are not shared and integrated, and the client cannot monitor multiple channels at the same time.

According to one aspect of the present invention, a video monitoring processing method is provided, including: a client registers to a video conferencing system; the client receives a video sent by a video monitoring terminal, wherein the video monitoring terminal registers to the The video conferencing system.

Further, after the client registers to the video conferencing system, the steps include: the client obtains information of the video surveillance terminal; and calls the video surveillance terminal according to the information.

Further, registering the client with the video conferencing system includes: registering the client with a gatekeeper (Gate Keeper, GK for short) of the video conferencing system.

Further, the registration of the video surveillance terminal to the video conferencing system through the gateway includes: the video surveillance terminal registers to the video surveillance management platform; address; the gateway generates a terminal number of the video conference system for the video monitoring terminal according to the address of the video monitoring terminal, and registers the video monitoring terminal with the video conference system.

Further, the gateway registering the video monitoring terminal with the video conferencing system includes: converting the video monitoring terminal into a virtual video conferencing terminal by the gateway; registering the video monitoring terminal with the video conferencing system The gatekeeper GK.

Further, calling the video surveillance terminal according to the information includes: the client creates and calls a conference on a multipoint control unit (MCU for short) of the video conferencing system; the client Set the rate of calling the video monitoring terminal; the client receives the video resource of the monitoring terminal, wherein the video resource of the monitoring terminal is the MCU transcoding the video of the video monitoring terminal to the client The video resources supported by the terminal.

Further, calling the video surveillance terminal according to the information includes: the gateway obtains the address of the video surveillance terminal; sends the video media resource of the video surveillance terminal to the video conference terminal of the video conference system or The multi-point control unit MCU of the video conferencing system.

Further, before the client receives the video sent by the video monitoring terminal, it includes: the multi-point control unit MCU of the video conference system calls the terminal; according to whether the terminal has decoding capability, it is judged that the terminal is a video conference terminal or a video conference terminal. A monitoring terminal, wherein, when the terminal has decoding capability, the terminal is a video conferencing terminal, and when the terminal has no decoding capability, the terminal is a video monitoring terminal.

According to another aspect of the present invention, there is also provided a video surveillance processing device, the device is applied to a client, and the device includes: a registration module, used to register to the video conference system; a receiving module, used to receive video surveillance The video sent by the terminal, wherein the video monitoring terminal registers with the video conferencing system through a gateway.

Further, the device further includes: an obtaining module, configured to obtain information of the video surveillance terminal; a calling module, configured to call the video surveillance terminal according to the information.

Through the present invention, the client is used to register to the video conferencing system; the client receives the video sent by the video monitoring terminal, wherein the video monitoring terminal registers to the video conferencing system through the gateway. It solves the problem that the video conferencing system and the video monitoring system are not shared and integrated in the related technology, and the client cannot monitor multiple channels at the same time, and then realizes video transcoding by using the encoding and decoding capabilities of the MCU, and also saves the video monitoring client. Use a video conferencing client instead to implement the video surveillance function. At the same time, it can also use the video synthesis capability of the MCU, so that the client can monitor multiple terminals at the same time.

Description of drawings

The accompanying drawings described here are used to provide a further understanding of the present invention and constitute a part of the application. The schematic embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute improper limitations to the present invention. In the attached picture:

Fig. 1 is the flowchart of the video surveillance processing method according to the embodiment of the present invention;

Fig. 2 is a structural block diagram of a video surveillance processing device according to an embodiment of the present invention;

Fig. 3 is a structural block diagram (1) of a video surveillance processing device according to an embodiment of the present invention;

Figure 4 is a structural diagram of a traditional video conferencing and video surveillance fusion system;

5 is a structural diagram of a video conferencing and video surveillance fusion system according to an embodiment of the present invention;

6 is a simplified structural diagram of a fusion system according to an embodiment of the present invention;

Fig. 7 is a flow chart of video surveillance performed by a software client according to an embodiment of the present invention;

FIG. 8 is a flowchart of a multipoint control unit calling a video conference/monitoring terminal according to an embodiment of the present invention;

9 is a schematic diagram of the transmission direction of the video stream when the software client performs video monitoring according to an embodiment of the present invention;

Fig. 10 is a schematic diagram of the transmission direction of the video stream when the software client performs a video conference with other video conference terminals (including a video monitoring terminal) according to an embodiment of the present invention.

detailed description

Hereinafter, the present invention will be described in detail with reference to the drawings and examples. It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other.

In this embodiment, a video surveillance processing method is provided. FIG. 1 is a flowchart of a video surveillance processing method according to an embodiment of the present invention. As shown in FIG. 1 , the process includes the following steps:

Step S102, the client registers to the video conferencing system;

Step S104, the client receives the video sent by the video surveillance terminal, wherein the video surveillance terminal registers with the video conferencing system through the gateway.

Through the above steps, both the client and the video monitoring terminal are registered with the video conference system, and the video monitoring terminal can be converted into a virtual video conference terminal, and then the client can display the video of the video monitoring terminal. Compared with the prior art, the video monitoring system is independent of the video conferencing system, which solves the problem that the video conferencing system and the video monitoring system are not shared and integrated, and the client cannot monitor multiple channels at the same time in the related art. The decoding capability realizes video transcoding, and also saves the video monitoring client, and uses the video conferencing client instead to realize the video monitoring function. At the same time, it can also use the video synthesis capability of the MCU, so that the client can monitor multiple terminals at the same time.

In the process of implementing video surveillance, the client needs to call the video surveillance terminal. In an optional implementation, the client first obtains the information of the video surveillance terminal, and calls the video surveillance terminal according to the above information.

The above step S102 involves the client registering with the video conference system. In an optional embodiment, the client registers with the gatekeeper GK of the video conference system. Thereby, the registration of the client to the video conferencing system is realized.

The above step S104 involves the video surveillance terminal registering to the video conference system through the gateway. In an optional embodiment, the video surveillance terminal is registered to the video surveillance management platform, and the gateway obtains the address of the video surveillance terminal by accessing the video surveillance management platform. , the gateway generates a terminal number of the video conference system for the video monitoring terminal according to the address of the video monitoring terminal, and registers the video monitoring terminal with the video conference system. Thus, the registration of the video monitoring terminal to the video conference system is realized.

The above-mentioned process of the gateway registering the video monitoring terminal to the video conference system, in an optional embodiment, the gateway converts the video monitoring terminal into a virtual video conference terminal, and registers the video monitoring terminal to the gatekeeper GK of the video conference system.

In an optional embodiment, after calling the video monitoring terminal according to the information, the client creates and calls a conference on the multipoint control unit MCU of the video conferencing system, the client sets the rate of calling the video monitoring terminal, and the client receives Monitoring the video resources of the terminal, where the video resource of the monitoring terminal is the MCU transcoding the video of the video monitoring terminal into a video resource supported by the client. Furthermore, it is realized that the client can receive the video resources of the monitoring terminal. In another optional embodiment, after calling the video monitoring terminal according to the information, the gateway obtains the address of the video monitoring terminal, and sends the video media resources of the video monitoring terminal to the video conference terminal of the video conference system or the Multipoint Control Unit MCU.

In an optional embodiment, before the client receives the video sent by the video monitoring terminal, the multipoint control unit MCU of the video conferencing system calls the terminal, and determines whether the terminal is a video conferencing terminal or a video monitoring terminal according to whether the terminal has decoding capability, Wherein, when the terminal has a decoding capability, the terminal is a video conferencing terminal, and when the terminal has no decoding capability, the terminal is a video monitoring terminal.

In this embodiment, a video surveillance processing device is also provided, which is used to implement the above embodiments and preferred implementation modes, and those that have been explained will not be repeated here. As used below, the term "module" may be a combination of software and/or hardware that realizes a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, implementations in hardware, or a combination of software and hardware are also possible and contemplated.

Fig. 2 is a structural block diagram of a video surveillance processing device according to an embodiment of the present invention, the device is applied to a client, and as shown in Fig. 2, the device includes: a registration module 22 for registering to the video conferencing system; a receiving module 24 , for receiving the video sent by the video monitoring terminal, where the video monitoring terminal registers with the video conferencing system through the gateway.

Fig. 3 is the structural block diagram (1) of the video surveillance processing device according to the embodiment of the present invention, as shown in Fig. 3, this device also includes except all modules shown in Fig. 2: obtaining module 32, is used to obtain this video The information of the monitoring terminal; the calling module 34 is used to call the video monitoring terminal according to the information.

It should be noted that each of the above-mentioned modules can be implemented by software or hardware. For the latter, it can be implemented in the following manner, but not limited to this: each of the above-mentioned modules is located in the same processor; or, each of the above-mentioned modules is located in the In the first processor, the second processor and the third processor . . .

Aiming at the above-mentioned problems existing in the related art, the following will be described in conjunction with specific optional embodiments, and the above-mentioned optional embodiments and their optional implementation manners are combined in the following optional embodiments.

The purpose of this optional embodiment is to use the more powerful video processing capabilities in the video conferencing system to complete the video processing in the traditional video surveillance system, such as video transcoding, by integrating the media processing modules in the video surveillance system and the video conferencing system , forwarding, and synthesis. Furthermore, the traditional video surveillance client is integrated with the video conferencing software terminal, so that one client can carry out video conferencing and multi-channel video surveillance.

The implementation steps of this optional embodiment are:

Step A. The video surveillance terminal is registered to the video surveillance management platform;

Step B. monitor the fusion gateway to access the video surveillance platform, and obtain the media resource URL address of the video surveillance terminal;

Step C. The monitoring fusion gateway generates a terminal number of a video conferencing system for each video monitoring terminal, and registers with the video conferencing system (such as GK in the H323 protocol);

Step D. The software client registers to the video conferencing system, and can obtain the information of the video monitoring terminal from the system, such as number and name;

Step E. The software client point-to-point calls the number of the video monitoring terminal;

Step F. The video conferencing system holds a meeting, and adds the software client and the video conferencing terminal to the meeting;

Step G. The software client displays the video of the video monitoring terminal, but the video monitoring terminal has no decoding capability, and the multipoint control unit does not send audio and video to the monitoring terminal;

In addition, in the terminal capability interaction part of the H323 protocol, the protocol is extended. In standard H323 protocol communication, media transmission must be bidirectional. In the converged system, a video monitoring terminal is added as a virtual video conferencing terminal, and the virtual terminal has no video decoding capability. Therefore, H323 capability interaction failure will occur in the standard protocol. By extending the H323 capabilities, terminals without decoding capabilities can still interact through capabilities, and the Internet will be successful. In this case, the video media is transmitted in one direction. However, the traditional integrated monitoring gateway will fake the decoding ability of the virtual terminal. When the video conferencing system sends media to it, it will not process it. This approach wastes network bandwidth and server computing resources.

In this fusion system, the video conferencing terminal and the conference management client are also combined. The integrated software client can create a conference room to organize meetings, and can also join the conference as a software video conferencing terminal, or interact with other hardware video conferencing terminals. Or software terminal for point-to-point video conferencing.

Fig. 4 is a structural diagram of a traditional video conferencing and video surveillance fusion system. As shown in Fig. 4, the video conferencing system and the video surveillance system have independent video transcoding units and clients.

Fig. 5 is a structural diagram of a video conferencing and video surveillance fusion system according to an embodiment of the present invention. The multipoint control unit in the video conferencing system is used to replace the video transcoding unit in the video surveillance system, and the video conferencing system client is used to replace the video surveillance system. client. Among them, the multi-point control unit integrates the conference management module and provides an interface for the software client to access to create and hold conferences.

FIG. 6 is a simplified structural diagram of a fusion system according to an embodiment of the present invention. As shown in FIG. 6 , the details of the video monitoring system are hidden, and the video monitoring terminal corresponds to a virtual video conference terminal in the video conference system.

The following describes the specific implementation of the fusion of video conferencing and video surveillance systems in conjunction with the accompanying drawings:

1. As shown in Figure 5, the left side of the figure is the composition of the video conference system, including MCU multi-point control unit, GK gatekeeper, video conference terminal and software client. Both the video conferencing terminal and the MCU are registered with the GK (the MCU can also have a built-in GK configured as a neighborhood GK with an external GK), and the MCU provides a conference management interface for the software client to connect. The software client is not only a video conferencing software terminal, but also serves as a conference management client. Therefore, the software client must be registered with the GK and connected to the conference management unit of the MCU.

The right side of Figure 5 is the video surveillance system. Compared with the traditional video surveillance system in Figure 4, it does not require a video transcoding unit or an independent client for video surveillance. Video transcoding is realized by the MCU codec function in the video conference video, and the same software client is used for video monitoring and video conference at the same time.

Figure 5 The surveillance fusion gateway is responsible for converting video surveillance terminals into virtual video conference terminals and registering them with GK. When the MCU or terminal calls the video conference terminal, the monitoring fusion gateway obtains the media URL address of the monitoring terminal from the video monitoring platform, and then obtains the audio and video media of the monitoring terminal and sends it to the video conference terminal or MCU.

2. Fig. 7 is the flow chart that the software client according to the embodiment of the present invention carries out video monitoring, as shown in Fig. 7, this flow process comprises the following steps:

Step S702, setting the audio and video capability (such as H264/4CIF) of the software client;

Step S704, the client registers to the GK and logs in to the conference management system of the MCU;

Step S706, the client obtains a list of video monitoring terminals from the GK;

Step S708, select the terminal that needs to be monitored to call, and set the call rate (such as 512kbps);

Step S710, the client calls the MCU conference management system interface to create and call a conference on the MCU, the conference includes the software client and the monitoring terminal, and the conference rate is the rate at which the client calls the monitoring terminal;

Step S712, the MCU calls the monitoring terminal and the software client, and transcodes the video of the monitoring terminal into a capability (such as H264/4CIF) supported by the software client and sends it to the software client;

In step S714, the client terminal receives the video media from the monitoring terminal, realizing video monitoring.

3. Fig. 8 is a flow chart of the multipoint control unit calling video conferencing/monitoring terminal according to the embodiment of the present invention, as shown in Fig. 8, has described MCU calling monitoring terminal/video conferencing terminal (comprising hardware terminal and software terminal, i.e. software client) process. Different from calling a video conferencing terminal, the virtual video conferencing terminal corresponding to the monitoring terminal has no video decoding capability, and the normal H323 capability negotiation cannot pass. The optional embodiment of the present invention expands the H323 capability, so that this situation can also pass the capability negotiation . As shown in Figure 8:

Step S802, the MCU starts a conference and calls the terminal;

Step S804, performing extended H323 capability negotiation with the terminal;

Step S806, judging whether the terminal has video decoding capability, if the terminal has decoding capability, it is a video conferencing terminal, and executes the next step, otherwise, jumps to step S816;

Step S808, in normal conference mode, sending video media to the terminal;

Step S810, judging whether there is only one video conferencing terminal in the conference, if yes, execute S812, otherwise, execute S814;

Step S812, the MCU performs flow control on the video conferencing terminal, so that the video rate sent by the terminal is 0;

Step S814, in normal conference mode, decoding the video stream received by the terminal;

Step S816, video monitoring mode, does not send video to the terminal, but only receives its audio and video stream.

Fig. 9 is a schematic diagram of the transmission direction of the video stream when the software client performs video surveillance according to an embodiment of the present invention. Sent to the video conferencing terminal, the video media is one-way transmission, which is the same as the traditional monitoring client monitoring, but the method of the present invention can realize multi-channel simultaneous monitoring;

6b) The MCU does not perform flow control on this video conferencing terminal, and sends the video media received from the terminal to other video conferencing terminals after processing according to the conference rate.

Fig. 10 is a schematic diagram of the transmission direction of the video stream when the software client performs a video conference with other video conference terminals (including a video monitoring terminal) according to an embodiment of the present invention. As shown in FIG. 10 , in this case, the video media of the video conferencing terminal is transmitted bidirectionally, and the video media of the monitoring terminal is transmitted unidirectionally.

6c) The terminal has no video decoding capability, and the MCU considers the terminal to be a monitoring terminal. The monitoring terminal can send audio and video media to the MCU, but the MCU does not send audio and video media to the monitoring terminal. In the traditional method, the MCU sends video media to the monitoring fusion gateway, and the fusion gateway does not process it. Compared with the traditional method, the method of the present invention reduces performance loss and saves network bandwidth.

In summary, through the fusion system of the present invention, the video transcoding unit in the video monitoring system is omitted, and the codec capability of the MCU is used to realize video transcoding, and the video monitoring client is also omitted, and the video conferencing client is used terminal instead of realizing the video surveillance function. At the same time, it can also use the video synthesis capability of the MCU, so that the client can monitor multiple terminals at the same time.

In another embodiment, software is also provided, and the software is used to implement the technical solutions described in the above embodiments and preferred implementation manners.

In another embodiment, there is also provided a storage medium, in which the software is stored, the storage medium includes but not limited to: optical discs, floppy disks, hard disks, rewritable memories, and the like.

Obviously, those skilled in the art should understand that each module or each step of the above-mentioned present invention can be realized by a general-purpose computing device, and they can be concentrated on a single computing device, or distributed in a network formed by multiple computing devices Alternatively, they may be implemented in program code executable by a computing device so that they may be stored in a storage device to be executed by a computing device, and in some cases, in an order different from that shown here The steps shown or described are carried out, or they are separately fabricated into individual integrated circuit modules, or multiple modules or steps among them are fabricated into a single integrated circuit module for implementation. As such, the present invention is not limited to any specific combination of hardware and software.

The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and changes. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included within the protection scope of the present invention.

Claims (10)

1. a video monitoring processing method, it is characterised in that including:

Client registers is to video conferencing system；

Described client receives the video that Video Monitoring Terminal sends, and wherein, described Video Monitoring Terminal passes through gateway It is registered to described video conferencing system.

Method the most according to claim 1, it is characterised in that described client registers to described video conferencing system it After include:

Described client obtains the information of described Video Monitoring Terminal；

According to Video Monitoring Terminal described in described information calls.

Method the most according to claim 1, it is characterised in that described client registers to described video conferencing system bag Include:

Described client registers is to the gatekeeper GK of described video conferencing system.

Method the most according to claim 1, it is characterised in that described Video Monitoring Terminal is the most described by gateway registration Video conferencing system includes:

Described Video Monitoring Terminal is registered to video monitoring management platform；

Described gateway obtains the address of described Video Monitoring Terminal by accessing described video monitoring management platform；

Described gateway is that described Video Monitoring Terminal generates described video council according to the address of described Video Monitoring Terminal The termination number of conference system, and described Video Monitoring Terminal is registered to described video conferencing system.

Method the most according to claim 4, it is characterised in that described Video Monitoring Terminal is registered to institute by described gateway State video conferencing system to include:

Described Video Monitoring Terminal is converted to virtual video conference terminal by described gateway；

Described Video Monitoring Terminal is registered to the gatekeeper GK of described video conferencing system.

Method the most according to claim 2, it is characterised in that according to Video Monitoring Terminal described in described information calls it After include:

Described client creates on the multipoint control unit MCU of described video conferencing system and calls a meeting；

Described client arranges the speed calling described Video Monitoring Terminal；

Described client receives the video resource of described monitor terminal, and wherein, the video resource of described monitor terminal is The video resource that the video code conversion of described Video Monitoring Terminal is supported by described MCU by described client.

Method the most according to claim 4, it is characterised in that according to Video Monitoring Terminal described in described information calls it After include:

Described gateway obtains the address of described Video Monitoring Terminal；

The video media asset of described Video Monitoring Terminal is sent to the video conference of described video conferencing system eventually End or the multipoint control unit MCU of described video conferencing system.

Method the most according to any one of claim 1 to 7, it is characterised in that described client receives described video Include before the video that monitor terminal sends:

The multipoint control unit MCU calling terminal of described video conferencing system；

Whether have decoding capability according to described terminal, it is judged that described terminal be video conference terminal or video monitoring eventually End, wherein, when described terminal has decoding capability, described terminal is video conference terminal, does not has in described terminal During decoding capability, described terminal is Video Monitoring Terminal.

9. a video monitoring processing means, described device is applied to client, it is characterised in that described device includes:

Registering modules, is used for being registered to video conferencing system；

Receiver module, for receiving the video that Video Monitoring Terminal sends, wherein, described Video Monitoring Terminal passes through Gateway registration is to described video conferencing system.

Device the most according to claim 9, it is characterised in that described device also includes:

Acquisition module, for obtaining the information of described Video Monitoring Terminal；

Calling module, for according to Video Monitoring Terminal described in described information calls.