CN105828046A - Data flow transmission method and device - Google Patents

Abstract

The present invention provides a data stream transmission method and device, the method comprising: when the video management server determines that the access device needs to copy the data stream for the target client, the access device receives the copied data stream from the video management server Redirection policy; if the access device receives a data flow that matches the copy redirection policy, the access device sends the data flow according to the destination address of the data flow, and uses the copy redirection The policy copies the new data flow for the destination client, and sends the new data flow to the destination client. Through the technical scheme of the present invention, the working pressure of the streaming media server can be reduced, the processing resources of the streaming media server can be saved, the network bandwidth can be saved, and the duplication and distribution of the data stream can be completed in time, and the data stream can be transmitted to the client in real time. Moreover, under the premise of ensuring network security, the transmission path of the data flow can be made more reasonable and the transmission path can be simplified as much as possible.

Description

A data stream transmission method and device

technical field

The present invention relates to the technical field of video surveillance, in particular to a data stream transmission method and device.

Background technique

Streaming media refers to a media form that transmits data streams (such as audio data, video data, and multimedia files, etc.) in a network in a streaming manner. Compared with the online broadcasting form of downloading and watching, the typical characteristics of streaming media are: users can watch while downloading, without having to wait for the entire file to be downloaded. Due to the superiority of streaming media technology, this streaming media technology is widely used in video on demand, video conferencing, distance education, telemedicine and online live broadcasting systems. Among them, the streaming media server is the core equipment of the streaming media application and the key platform for the operator to provide services to the users. The main functions of the streaming media server are: collecting, buffering, scheduling, and transmitting and playing data streams, such as streaming data with streaming protocols (such as RTP (RealtimeTransportProtocol, real-time transport protocol), RTSP (RealTimeStreamingProtocol, real-time streaming protocol), etc.) The stream is transmitted to the client for users to watch online.

The video surveillance system is an important part of the security system, and it is a comprehensive system with strong prevention capabilities. Video surveillance system is widely used in many occasions because of its intuition, accuracy, timeliness and rich information content. With the rapid development of computer, network, image processing and transmission technology, video surveillance technology has also made great progress. Currently, in a video surveillance system, for data streams collected by front-end devices (such as network cameras, analog cameras, encoders, etc.), there may be multiple clients that need to order the data streams. To this end, a streaming server needs to be deployed in the video surveillance system, and the streaming server copies multiple data streams and sends the copied data streams to multiple clients respectively.

As shown in Figure 1, it is a schematic diagram of a network where a streaming media server is deployed in a video surveillance system. The data stream transmission process is as follows: After the front-end device collects the data stream, it sends the data stream to the streaming media server. After receiving the data stream, the streaming media server copies three data streams, one data stream is sent to client 1, the other data stream is sent to client 2, and the other data stream is sent to client 3.

With the development of video surveillance systems, more and more front-end devices are deployed in video surveillance systems, and more and more clients request data streams. When the copy and distribution functions of all data streams are handled by streaming media servers, The working pressure of the streaming media server is too great, which takes up a lot of processing resources, and may not be able to complete the replication and distribution of the data stream in time, resulting in the inability to transmit the data stream to the client in real time. Moreover, the streaming media server needs to receive and send a large amount of data streams, which consumes too much network bandwidth.

Contents of the invention

The present invention provides a data stream transmission method, which is applied to a video monitoring system including a video management server and an access device, and the video monitoring system also includes a destination client connected to the access device, and the The source device connected to the access device, and the source device is the source device corresponding to the data flow requested by the destination client, the method includes:

When the video management server determines that the access device needs to copy the data stream for the destination client, the access device receives a copy redirection policy from the video management server;

If the access device receives a data flow that matches the copy redirection policy, the access device sends the data flow according to the destination address of the data flow, and uses the copy redirection policy for the The destination client copies the new data stream, and sends the new data stream to the destination client.

The video monitoring system also includes a streaming media server, the source device includes a front-end device, and the method further includes:

The process in which the video management server determines that the access device needs to copy the data stream for the destination client specifically includes: the video management server learns that the access device is connected to the front-end device, and communicates with the When the destination client is connected, if a message for requesting a data flow from the destination client is received, determine that the access device needs to copy the data flow for the destination client;

The process of the access device receiving the data flow matching the copy redirection policy specifically includes: the access device parses out the source IP address and the destination IP address from the received data flow, if the source IP The address is the IP address of the front-end device, and the destination IP address is the IP address of the streaming media server, then it is determined that the data flow matches the copy redirection strategy;

The process of the access device duplicating the new data flow for the destination client by using the copy redirection strategy specifically includes: the access device copies the data flow, and assigns the source IP address of the copied data flow to Modify it to the IP address of the streaming media server, and modify the destination IP address of the copied data stream to the IP address of the destination client.

The video monitoring system also includes a streaming media server, the source device includes a source client that has received the data stream from the streaming media server, and the method further includes:

The process in which the video management server determines that the access device needs to copy the data stream for the destination client specifically includes: the video management server learns that the access device is connected to the source client, and communicates with the source client. When the destination client is connected, if a message for requesting a data flow from the destination client is received, it is determined that the access device needs to copy the data flow for the destination client;

The process of the access device receiving the data flow matching the copy redirection policy specifically includes: the access device parses out the source IP address and the destination IP address from the received data flow, if the source IP The address is the IP address of the streaming media server, and the destination IP address is the IP address of the source client, then it is determined that the data flow matches the copy redirection strategy;

The process of the access device duplicating the new data flow for the destination client by using the copy redirection strategy specifically includes: the access device copies the data flow, and keeps the source IP address of the copied data flow is the IP address of the streaming media server, and the destination IP address of the copied data stream is changed to the IP address of the destination client.

The method further includes: when the access device receives a first registration message from a destination client, a source client, or a front-end device connected to the access device, sending the first registration message to The video management server parses out the device information of the destination client, the source client, or the front-end device from the first registration message, and sends a second registration message to the video management server, The second registration message carries the device information and the information of the access device, so that the video management server uses the second registration message to know that the access device is connected to the destination client , and connect to the front-end device; or, learn that the access device is connected to the destination client and connect to the source client.

The method further includes: after the video management server receives the first registration message from the destination client, the source client or the front-end device, if the video management server does not receive the first registration message from the rejecting the destination client, the source client or the front-end device from accessing the video surveillance system.

The present invention provides a data stream transmission device, which is applied to a video surveillance system including a video management server and an access device, and the data stream transmission device is applied to the access device, and in the video surveillance system It also includes a destination client connected to the access device, a source device connected to the access device, and the source device is the source device corresponding to the data flow requested by the destination client, and the data flow The transmission device specifically includes:

A receiving module, configured to receive a copy redirection policy from the video management server when the video management server determines that the access device needs to copy the data stream for the destination client;

A processing module, configured to send the data flow according to the destination address of the data flow when receiving the data flow matching the copy redirection strategy, and use the copy redirection strategy to copy the data flow for the destination client A new data stream is generated, and the new data stream is sent to the destination client.

The video surveillance system further includes a streaming media server, the source device includes a front-end device, and the processing module is specifically configured to, during the process of receiving the data stream matching the copy redirection policy, from the received data Source IP address and destination IP address are resolved in the flow, if the source IP address is the IP address of the front-end equipment, and the destination IP address is the IP address of the streaming media server, then it is determined that the data flow is matched to the duplicate Orientation strategy: In the process of using the replication redirection strategy to copy the new data flow for the purpose client, copy the data flow, and modify the source IP address of the copied data flow to the IP of the streaming media server address, modifying the destination IP address of the copied data stream to the IP address of the destination client; or,

The video surveillance system also includes a streaming media server, the source device includes a source client that has received the data stream from the streaming media server, and the processing module is specifically configured to In the process of directing the data flow of the strategy, the source IP address and the destination IP address are resolved from the received data flow, if the source IP address is the IP address of the streaming media server, and the destination IP address is the If the IP address of the source client is used, then it is determined that the data flow matches the copy redirection strategy; in the process of copying the new data flow for the destination client using the copy redirection strategy, copy the data flow, And keep the source IP address of the copied data stream as the IP address of the streaming media server, and modify the destination IP address of the copied data stream to the IP address of the destination client.

It also includes: a registration module, configured to send the first registration message to the video management server, and parse out the device information of the destination client, source client or the front-end device from the first registration message, and send a second registration message to the video management server, the The second registration message carries the device information and the information of the access device, so that the video management server uses the second registration message to know that the access device is connected to the destination client, and Connect to the front-end device; or learn that the access device is connected to the destination client and connect to the source client.

The present invention provides a data stream transmission device, which is applied in a video surveillance system including a video management server and an access device, and the data stream transmission device is applied on the video management server, and in the video surveillance system It also includes a destination client connected to the access device, a source device connected to the access device, and the source device is the source device corresponding to the data flow requested by the destination client, and the data flow The transmission device specifically includes:

A determining module, configured to determine that the access device needs to copy the data flow for the destination client;

A sending module, configured to send a copy redirection policy to the access device; so that when the access device receives a data flow matching the copy redirection policy, it sends the copy redirection policy according to the destination address of the data flow The data stream is copied, and a new data stream is copied for the destination client by using the copy redirection policy, and the new data stream is sent to the destination client.

The video surveillance system further includes a streaming media server, the source device includes a front-end device, and the determining module is specifically configured to, in the process of determining that the access device needs to copy the data stream for the destination client, in When it is known that the access device is connected to the front-end device and the destination client, if a message for requesting a data stream is received from the destination client, then it is determined that the access device needs to be connected to the destination client. The destination client replicates the data stream; or,

The video monitoring system also includes a streaming media server, the source device includes a source client that has received the data stream from the streaming media server, and the determining module is specifically configured to determine that the access device needs to During the process of duplicating data streams for the destination client, when it is known that the access device is connected to the source client and connected to the destination client, if a request from the destination client is received If the data flow message is not received, it is determined that the access device needs to copy the data flow for the destination client.

Based on the above technical solution, in the embodiment of the present invention, the replication and distribution of the data stream can be realized through the access device, instead of the streaming media server to realize the replication and distribution of all data streams, thereby reducing the working pressure of the streaming media server and saving the streaming media server Processing resources, saving network bandwidth, and can complete the replication and distribution of data streams in time, and transmit data streams to clients in real time. Moreover, under the premise of ensuring network security, the transmission path of the data flow can be made more reasonable and the transmission path can be simplified as much as possible.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the accompanying drawings that need to be used in the description of the embodiments of the present invention or the prior art. Obviously, the accompanying drawings in the following description These are only some embodiments described in the present invention, and those skilled in the art can also obtain other drawings according to these drawings.

Fig. 1 is a schematic diagram of a network in which a streaming media server is deployed in a video surveillance system;

Fig. 2 is a flowchart of a data stream transmission method in an embodiment of the present invention;

3-6 are schematic diagrams of application scenarios in an embodiment of the present invention;

Fig. 7 is a hardware structural diagram of an access device in an embodiment of the present invention;

FIG. 8 is a structural diagram of a data stream transmission device in an embodiment of the present invention;

Fig. 9 is a hardware structural diagram of a video management server in an embodiment of the present invention;

Fig. 10 is a structural diagram of a data stream transmission device in an embodiment of the present invention.

detailed description

The terminology used in the present invention is for the purpose of describing specific embodiments only, not limiting the present invention. As used herein and in the claims, the singular forms "a", "the", and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It should also be understood that the term "and/or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items.

It should be understood that although the terms first, second, third, etc. may be used in the present invention to describe various information, the information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, without departing from the scope of the present invention, first information may also be called second information, and similarly, second information may also be called first information. Depending on the context, furthermore, the use of the word "if" could be interpreted as "at" or "when" or "in response to a determination."

Aiming at the problems existing in the prior art, a method for transmitting data streams (such as audio data, video data and multimedia files, etc.) is proposed in the embodiment of the present invention. A secure access gateway, which can be a Layer 2 access switch), a destination client connected to the access device (such as a decoding client, a decoder, etc., which can be multiple), and a source connected to the access device In the video surveillance system of the equipment. Wherein, the source device may be the source device corresponding to the data flow requested by the destination client, the source device and the destination client are located under the same access device, and the source device is relative to the data flow requested by the destination client In other words, the source device has the data flow requested by the destination client. As shown in Figure 2, the transmission method of the data stream may include:

Step 201, when the video management server determines that the access device needs to copy data streams for the target client, the access device receives a copy redirection policy from the video management server.

Step 202, if the access device receives a data stream that matches the copy redirection policy, the access device sends the data stream according to the destination address of the data stream, and uses the copy redirection policy to copy new data for the destination client stream, and send the new data stream to the destination client.

In an example, the video monitoring system may further include a streaming media server, and the above-mentioned source device includes a front-end device connected to the access device. In this application scenario, the front-end device and the destination client are located under the same access device, and the data stream requested by the destination client is exactly the data stream that the front-end device collects and sends to the streaming media server. The front-end device has the destination client The requested data flow, therefore, the front-end device may be referred to as the source device corresponding to the data flow requested by the destination client.

Based on this, the video management server determines that the access device needs to copy the data stream for the destination client, which may specifically include but not limited to the following methods: when the video management server learns that the access device is connected to the front-end device and is connected to the destination client , if a message for requesting a data flow from the destination client is received, it is determined that the access device needs to copy the data flow for the destination client.

Further, the process of the access device receiving the data flow matching the replication redirection policy may specifically include but not limited to: the access device parses out the source IP address and the destination IP address from the received data flow, if the source IP If the address is the IP address of the front-end device, and the destination IP address is the IP address of the streaming media server, then it is determined that the data flow matches the replication redirection strategy.

Further, the process of the access device duplicating the new data flow for the destination client using the copy redirection strategy may specifically include but not limited to: the access device copies the data flow, and modifies the source IP address of the copied data flow to The IP address of the streaming media server, and modify the destination IP address of the copied data stream to the IP address of the destination client.

In another example, the video surveillance system may also include a streaming media server, and the above-mentioned source device includes a source client connected to the access device, and the source client means that the data from the streaming media server has been received stream client. In this application scenario, the source client and the destination client are located under the same access device, and the data stream requested by the destination client is exactly the data stream sent by the streaming media server to the source client, and the source client has the destination client The requested data flow, therefore, the source client may be referred to as the source device corresponding to the data flow requested by the destination client.

Based on this, the process for the video management server to determine that the access device needs to copy the data stream for the destination client may specifically include: when the video management server learns that the access device is connected to the source client and the destination client, if After receiving a message for requesting a data flow from the destination client, it is determined that the access device needs to copy the data flow for the destination client.

Further, the process of the access device receiving the data flow matching the replication redirection policy may specifically include but not limited to: the access device parses out the source IP address and the destination IP address from the received data flow, if the source IP The address is the IP address of the streaming media server, and the destination IP address is the IP address of the source client, then it is determined that the data flow matches the replication redirection strategy.

Further, the process of the access device duplicating the new data flow for the source client using the copy redirection strategy may specifically include but not limited to: the access device copies the data flow, and keeps the source IP address of the copied data flow as the stream media IP address of the server, and modify the destination IP address of the copied data stream to the IP address of the source client.

During the registration process of the destination client, source client or front-end device, in the embodiment of the present invention, the access device receives the first registration message, on the basis of sending the first registration message to the video management server, the device information of the destination client, source client or front-end device can also be parsed from the first registration message, and sent to the video management server sending a second registration message, the second registration message carries the device information and the information of the access device, so that the video management server uses the second registration message to know the access device and the target client and connected to the front-end device; or, it is learned that the access device is connected to the destination client and connected to the source client.

Further, after the video management server receives the first registration message from the destination client, the source client or the front-end device, if it does not receive the second registration message from the access device within a preset time, then Deny destination clients, source clients or front-end devices from accessing the video surveillance system to ensure system security.

Based on the above technical solution, in the embodiment of the present invention, the replication and distribution of the data stream can be realized through the access device, instead of the streaming media server to realize the replication and distribution of all data streams, thereby reducing the working pressure of the streaming media server and saving the streaming media server Processing resources, saving network bandwidth, and can complete the replication and distribution of data streams in time, and transmit data streams to clients in real time. Moreover, under the premise of ensuring network security, the transmission path of the data flow can be made more reasonable and the transmission path can be simplified as much as possible.

The foregoing technical solutions of the embodiments of the present invention will be described below in conjunction with specific application scenarios.

Application Scenario 1: As shown in Figure 3, the video surveillance system may include an access device 1, a front-end device connected to the access device 1 (i.e. source device), client 1 (i.e. destination client), and a video management server ,flow media services.

As shown in FIG. 3 , during the registration process of the front-end device, the front-end device sends a first registration message to the access device 1, and the access device 1 sends the first registration message to the video management server. After receiving the first registration message, the video management server completes the registration process of the front-end device, and the processing flow of the registration process will not be repeated here, so that the front-end device can be connected to the video surveillance system.

When the access device 1 receives the first registration message from the front-end device connected to the access device, on the basis of sending the first registration message to the video management server, it can also send the first registration message to the video management server. Perform detection and interception, and analyze the device information of the front-end device from the first registration message, such as the device identifier, device IP address, and device type of the front-end device. Afterwards, the access device 1 sends a second registration message to the video management server, and the second registration message carries the device information of the front-end device and the information of the access device 1, such as the identifier and IP address of the access device 1 , the device type, and the interface information of the front-end device connected to the access device 1 (for example, the front-end device is connected to the interface 1).

After receiving the second registration message, the video management server knows that the front-end device (parsed from the device information of the front-end device in the second registration message) and the access device 1 (from the access device 1 in the second registration message) parsed from the information) to connect and connect to interface 1 of access device 1.

As shown in FIG. 3, during the registration process of the client 1, the client 1 sends a first registration message to the access device 1, and the access device 1 sends the first registration message to the video management server. After receiving the first registration message, the video management server completes the registration process of the client 1, and the processing flow of the registration process will not be repeated here, so that the client 1 can be connected to the video surveillance system.

When the access device 1 receives the first registration message from the client 1 connected to the access device, on the basis of sending the first registration message to the video management server, it can also send the first registration message to the video management server. The message is detected and intercepted, and the device information of the client 1 is analyzed from the first registration message, such as the device identifier of the client 1, the device IP address, and the device type. Afterwards, the access device 1 sends a second registration message to the video management server, and the second registration message carries the device information of the client 1 and the information of the access device 1, such as the identifier of the access device 1, IP Address, device type, and interface information of the client 1 connected to the access device 1 (for example, the client 1 is connected to the interface 2).

After receiving the second registration message, the video management server learns that the client 1 (parsed from the device information of the client 1 in the second registration message) and the access device 1 (from the access of the second registration message) Analyzed from the information of device 1) to connect and connect to interface 2 of access device 1.

In the embodiment of the present invention, after the video management server receives the first registration message from the client 1 or the front-end device, if it does not receive the second registration message from the access device 1 within a preset time (such as 3 minutes), registration message, the video management server thinks that the client 1 or the front-end device is not connected to the legal access device (the legal access device will send the first Two registration messages, so that the video management server completes the registration process of the access device), and refuses the client 1 or the front-end device to access the video surveillance system (because the client 1 or the front-end device has been allowed to access the video surveillance system before) system, so the client 1 or the front-end device can be offline in the subsequent process), so as to ensure the security of the entire video surveillance system.

Based on the above process, the video management server can know that the front-end device is connected to the interface 1 of the access device 1 , and know that the client 1 is connected to the interface 2 of the access device 1 . Therefore, the video management server knows that the access device 1 is connected to the front-end device and is connected to the client 1, and if it receives a message from the client 1 for requesting a data stream (that is, the data stream sent by the front-end device), it determines to accept The ingress device needs to replicate the data stream for client 1. Afterwards, the video management server sends a copy redirection policy to the access device 1, which is used to make the access device 1 copy the data stream sent by the front-end device to the streaming media server, obtain a new data stream, and transfer the new data stream to the streaming media server. The data stream is sent to client 1.

Based on this, in the embodiment of the present invention, after the access device 1 receives the copy redirection policy from the video management server, if it receives a data stream that matches the copy redirection policy, the access device 1 will follow the copy redirection policy of the data stream. The destination address sends the data flow, and uses the copy redirection policy to copy a new data flow for the client 1, and sends the new data flow to the client 1.

In an example, the matching option of the copy redirection policy may be: the source IP address is the IP address of the front-end device, and the destination IP address is the IP address of the streaming media server. The action option can be: modify the source IP address to the IP address of the streaming media server, modify the destination IP address to the IP address of client 1, and send a new data flow.

For the data flow collected by the front-end device, when the client 1 sends a message requesting the data flow to the video management server, the transmission path of the data flow between the front-end device and the client 1 is:

As shown in FIG. 4 , it is the transmission path of the data stream between the front-end device and the client 1 in the prior art. The video management server notifies the front-end device to send the data stream to the streaming media server, and notifies the streaming media server to send the data stream to the client 1 . Based on this, after the front-end device collects the data stream, it sends the data stream to the streaming media server. The source IP address of the data stream is the IP address of the front-end device, and the destination IP address is the IP address of the streaming media server. After receiving the data stream, the streaming media server stores the data stream locally, makes a copy of the data stream, and sends the copied data stream to client 1. The source IP address of the data stream is the IP address of the streaming media server , and the destination IP address is the IP address of client 1. It can be seen from FIG. 4 that the data stream will be sent to the streaming media server first, and then the streaming media server will send the data stream to the client 1, and the transmission path of the data stream is repeated.

As shown in FIG. 5 , it is the transmission path of the data stream between the front-end device and the client 1 in the embodiment of the present invention. The video management server notifies the front-end device to send the data stream to the streaming server, but no longer notifies the streaming server to send the data stream to the client 1 . Based on this, after the front-end device collects the data stream, it sends the data stream to the streaming media server. The source IP address of the data stream is the IP address of the front-end device, and the destination IP address is the IP address of the streaming media server. After receiving the data stream, the access device 1 forwards the data stream to the streaming media server, and the streaming media server stores the data stream locally after receiving the data stream, but no longer sends the data to the client 1 flow.

On the basis of the access device 1 forwarding the data stream to the streaming media server, the access device 1 can also resolve the source IP address and the destination IP address from the data stream, because the source IP address of the data stream is the IP address, the destination IP address is the IP address of the streaming media server, so the data flow can match the above copy redirection strategy. Based on this, access device 1 copies the data stream, and modifies the source IP address of the copied data stream to the IP address of the streaming media server, and modifies the destination IP address of the copied data stream to the IP address of client 1 . Afterwards, the access device 1 sends the new data flow to the client 1, the source IP address of the new data flow is the IP address of the streaming media server, and the destination IP address is the IP address of the client 1.

It can be seen from FIG. 5 that the streaming media server no longer sends the data stream to the client 1, but the access device 1 directly sends the data stream to the client 1, and the transmission path of the data stream is not repeated.

In an example, the access device 1 may also modify the destination MAC (MediaAccessControl, media access control) address of the copied data stream to the MAC address of the client 1 .

In one example, the video management server can also notify client 1 that the source IP address of the data stream it accepts is the IP address of the streaming media server, so that client 1 accepts and processes that the source IP address is the IP address of the streaming media server The data flow of the client 1 will not be described in detail.

In one example, for the application scenario shown in Figure 3, assuming that only client 1 currently requests the data stream of the front-end device, and no other client requests the data stream of the front-end device, the video management server notifies the front-end device to directly transfer the data stream sent to client 1. Based on this, after the front-end device collects the data stream, it sends the data stream to the client 1, the source IP address of the data stream is the IP address of the front-end device, and the destination IP address is the IP address of the client 1. After receiving the data flow, the access device 1 can directly send the data flow to the client 1 based on the destination IP address of the data flow.

Application Scenario 2: As shown in FIG. 6 , based on the application scenario 1 shown in FIG. 3 , the video surveillance system may further include an access device 2 , a client 2 and a client 3 connected to the access device 2 . Assuming that client 2 requests the data stream first, and then client 3 requests the data stream, then the streaming media server sends the data stream to client 2. At this time, client 2 is the source client, and client 3 is the destination client. Assuming that client 3 requests the data stream first, and client 2 requests the data stream later, the streaming media server sends the data stream to client 3. At this time, client 3 is the source client, and client 2 is the destination client.

The process of client 1 requesting the data stream of the front-end device is the same as that of application scenario 1, and will not be repeated here. The following describes the process of client 2/client 3 requesting the data stream of the front-end device.

As shown in FIG. 6, during the registration process of the client 2 or the client 3, the client 2 or the client 3 may send a first registration message to the access device 2, and then the access device 2 sends the first registration message to the access device 2. A registration message is sent to the video management server. After the video management server receives the first registration message, it completes the registration process of the client 2 or the client 3, and the processing flow of the registration process will not be repeated here, so that the client 2 or the client 3 can access the into the video surveillance system.

When the access device 2 receives the first registration message from the client 2 or the client 3 connected to the access device 2, on the basis of sending the first registration message to the video management server, it can also send the first registration message to the video management server. The first registration message is detected and intercepted, and the device information of client 2 or client 3 is parsed from the first registration message, such as the device identification, device IP address, device type and other information of client 2 or client 3 . The access device 2 sends a second registration message to the video management server, and the second registration message carries the device information of the client 2 or the client 3 and the information of the access device 2, such as the identification of the access device 2, IP address, device type, and interface information of client 2 or client 3 connected to access device 2 (for example, client 2 is connected to interface 1, and client 3 is connected to interface 2).

After receiving the second registration message, the video management server knows that the client 2 or the client 3 (parsed from the device information of the client 2 or the client 3 in the second registration message) and the access device 2 (from the The information of the access device 2 in the second registration message is parsed out) to connect, and the client 2 is connected to the interface 1 of the access device 2, and the client 3 is connected to the interface 2 of the access device 2.

In the embodiment of the present invention, after the video management server receives the first registration message from the client 2 or the client 3, if it does not receive the first registration message from the access device 2 within a preset time (such as 3 minutes), Two registration messages, the video management server thinks that client 2 or client 3 is not connected to a legal access device (legal access device will send this access device during the registration process of client 2 or client 3) The second registration message of the device, so that the video management server completes the registration process of the access device), and refuses client 2 or client 3 to access the video surveillance system (because client 2 or client 3 has been allowed to Access to the video surveillance system, so the client 2 or client 3 can be offline in the subsequent process), to ensure the security of the entire video surveillance system.

Based on the above process, the video management server can know that the client 2 is connected to the interface 1 of the access device 2 , and know that the client 3 is connected to the interface 2 of the access device 2 . Therefore, the video management server can learn that the access device 2 is connected to at least two clients (i.e., client 2 and client 3). Assuming that client 2 first requests a data stream, and then client 3 requests a data stream, then client 2 is the source client, and client 3 is the destination client. Afterwards, if a message for requesting a data flow from the destination client is received, the video management server sends a copy redirection strategy to the access device 2, and the copy redirection strategy is used to make the access device 2 send to the streaming media server The data flow of the destination client is copied to obtain a new data flow, and the new data flow is sent to the source client.

Based on the above description, in the embodiment of the present invention, after the access device 2 receives the copy redirection policy from the video management server, if it receives a data stream that matches the copy redirection policy, the access device 2 follows the data stream send the data flow to the destination address (that is, send the data flow to the source client, such as client 2), and use the copy redirection strategy to copy the new data flow for the destination client (such as client 3), and send the data flow to The new data stream is sent to the destination client.

In an example, the matching option of the copy redirection strategy may be: the source IP address is the IP address of the streaming media server, and the destination IP address is the IP address of the source client (such as client 2). The action option can be: keep the source IP address unchanged, that is, keep the source IP address as the IP address of the streaming media server, modify the destination IP address to the IP address of the destination client (such as client 3), and pass the interface 2 (that is, The client 3 is connected to the interface on the access device 2) to send a new data flow.

For the data flow collected by the front-end equipment, after the front-end equipment sends the data flow to the streaming media server, after the client 2/client 3 sends a message requesting the data flow to the video management server, the data flow is in the stream The transmission path between the media server and client 2/client 3 is:

In the prior art, the video management server may notify the streaming media server to send data streams to client 2 and client 3 respectively. Based on this, the streaming media server can copy two data streams, one of which is sent to client 2, the source IP address of the data stream is the IP address of the streaming media server, and the destination IP address is the IP address of client 2 and another data flow is sent to the client 3, the source IP address of the data flow is the IP address of the streaming media server, and the destination IP address is the IP address of the client 3. It can be seen from this that the streaming media server needs to send two data streams.

In the embodiment of the present invention, the video management server may notify the streaming media server to send the data stream to the client 2 (source client), but no longer notify the streaming media server to send the data stream to the client 3 . Based on this, the streaming media server only copies a data stream, and the data stream is sent to the client 2. The source IP address of the data stream is the IP address of the streaming media server, and the destination IP address is the IP address of the client 2. The access device 2 forwards the data stream to the client 2 after receiving the data stream.

On the basis of the access device 2 forwarding the data stream to the client 2, the access device 2 can also resolve the source IP address and the destination IP address from the data stream, because the source IP address of the data stream is the stream media server The destination IP address is the IP address of client 2 (that is, the source client), so the data flow can match the above-mentioned replication redirection strategy. Based on this, the access device 2 copies the data flow, and keeps the source IP address of the copied data flow as the IP address of the streaming media server (that is, keeps the source IP address of the data flow unchanged), and keeps the copied data flow The destination IP address of is changed to the IP address of client 3 (ie, the destination client). Afterwards, the access device 2 sends the new data flow to the client 3, the source IP address of the new data flow is the IP address of the streaming media server, and the destination IP address is the IP address of the client 3.

It can be seen from this that the streaming media server only sends one copy of the data stream, reducing the transmission of the data stream.

In an example, the access device 2 may also modify the destination MAC address of the copied data flow to the MAC address of the client 3 . In addition, in an example, the video management server can also notify client 2 or client 3 that the source IP address of the data stream it accepts is the IP address of the streaming media server, so that client 2 or client 3 accepts and processes The source IP address is the data flow of the IP address of the streaming media server, and the processing process of the client 2 or the client 3 will not be described in detail.

It can be seen from the application scenario 1 and the application scenario 2 that in the embodiment of the present invention, the replication and distribution of the data stream can be realized through the access device, instead of the streaming media server to realize the replication and distribution of all data streams, thereby reducing the work of the streaming media server Pressure, save the processing resources of the streaming media server, save network bandwidth, and can complete the replication and distribution of the data stream in time, and transmit the data stream to the client in real time. Moreover, under the premise of ensuring network security, the transmission path of the data flow can be made more reasonable and the transmission path can be simplified as much as possible. Moreover, the processing performance of the entire video surveillance system is more efficient and the deployment is more convenient. Moreover, the access device can also perform authentication on the front-end device, so as to realize the function of duplicating the media stream on the basis of the authentication function. Based on this authentication function, when both the front-end device and the client are connected to the access device, the access device prohibits mutual access between the front-end device and the client by default. Only the front-end device and the client have passed the authentication. The terminal can exchange visits to ensure security.

Based on the same inventive concept as the above method, an embodiment of the present invention also provides a data stream transmission device, which is applied to a video surveillance system including a video management server and an access device, and the video surveillance system also includes a The destination client connected to the access device, the source device connected to the access device, and the source device is the source device corresponding to the data flow requested by the destination client, and the data flow transmission device is applied in the access device. Wherein, the device for transmitting the data stream may be implemented by software, or by hardware or a combination of software and hardware. Taking software implementation as an example, as a device in a logical sense, it is formed by reading the corresponding computer program instructions in the non-volatile memory through the processor of the access device where it is located. From the hardware level, as shown in Figure 7, it is a hardware structural diagram of the access device where the data stream transmission device proposed by the present invention is located. In addition to the processor and non-volatile memory shown in Figure 7, The access device may also include other hardware, such as a forwarding chip responsible for processing messages, a network interface, memory, etc.; in terms of hardware structure, the access device may also be a distributed device, which may include multiple interface cards, so that Extend message processing at the hardware level.

As shown in FIG. 8, it is a structural diagram of a data stream transmission device proposed in an embodiment of the present invention, and the data stream transmission device specifically includes:

The receiving module 11 is configured to receive a copy redirection policy from the video management server when the video management server determines that the access device needs to copy the data stream for the destination client;

The processing module 12 is configured to send the data flow according to the destination address of the data flow when receiving the data flow matching the copy redirection strategy, and use the copy redirection strategy to serve the destination client Duplicate the new data stream, and send the new data stream to the destination client.

The video monitoring system also includes a streaming media server, the source device includes a front-end device, and the processing module 12 is specifically configured to, during the process of receiving the data stream matching the copy redirection strategy, from the received Analyze the source IP address and the destination IP address in the data flow, if the source IP address is the IP address of the front-end equipment, and the destination IP address is the IP address of the streaming media server, then it is determined that the data flow is matched to the copied Redirection strategy: In the process of using the replication redirection strategy to replicate the new data stream for the purpose client, replicate the data stream, and modify the source IP address of the replicated data stream to that of the streaming media server IP address, modifying the destination IP address of the copied data stream to the IP address of the destination client; or,

The video monitoring system also includes a streaming media server, the source device includes a source client that has received the data stream from the streaming media server, and the processing module 12 is specifically configured to match the copied In the process of redirecting the data stream of the policy, the source IP address and the destination IP address are resolved from the received data stream, if the source IP address is the IP address of the streaming media server, and the destination IP address is The IP address of the source client, then determine that the data flow matches the copy redirection strategy; in the process of copying the new data flow for the destination client using the copy redirection strategy, copy the data flow , and keep the source IP address of the copied data stream as the IP address of the streaming media server, and modify the destination IP address of the copied data stream to the IP address of the destination client.

The transmission device of the data stream also includes (not shown in the figure):

A registration module, configured to send the first registration message to the video management server when receiving a first registration message from a destination client, a source client, or a front-end device connected to the access device , and parse out the device information of the destination client, the source client, or the front-end device from the first registration message, and send a second registration message to the video management server, the second registration The message carries the device information and the information of the access device, so that the video management server uses the second registration message to know that the access device is connected to the destination client, and communicates with the The front-end device is connected; or, it is learned that the access device is connected to the destination client and is connected to the source client.

Wherein, each module of the device of the present invention can be integrated into one body, or can be deployed separately. The above modules can be combined into one module, or can be further split into multiple sub-modules.

Based on the same inventive concept as the above method, an embodiment of the present invention also provides a data stream transmission device, which is applied to a video surveillance system including a video management server and an access device, and the video surveillance system also includes a The destination client connected to the access device, the source device connected to the access device, and the source device is the source device corresponding to the data flow requested by the destination client, and the transmission device of the data flow applies on the video management server. The device for transmitting the data stream may be implemented by software, or by hardware or a combination of software and hardware. Taking software implementation as an example, as a logical device, it is formed by reading the corresponding computer program instructions in the non-volatile memory through the processor of the video management server where it is located. From the perspective of hardware, as shown in FIG. 9, it is a hardware structural diagram of the video management server where the data stream transmission device proposed by the present invention is located. In addition to the processor and non-volatile memory shown in FIG. 9, The video management server may also include other hardware, such as a forwarding chip responsible for processing messages, a network interface, memory, etc.; in terms of hardware structure, the video management server may also be a distributed device, which may include multiple interface cards, so that Extend message processing at the hardware level.

As shown in FIG. 10, it is a structural diagram of a data stream transmission device proposed by an embodiment of the present invention, and the data stream transmission device specifically includes:

A determining module 21, configured to determine that the access device needs to copy the data flow for the destination client;

The sending module 22 is configured to send the copy redirection policy to the access device; so that when the access device receives a data flow matching the copy redirection policy, it sends the data flow according to the destination address of the data flow the data flow, and copy a new data flow for the destination client by using the copy redirection policy, and send the new data flow to the destination client.

The video surveillance system further includes a streaming media server, the source device includes a front-end device, and the determination module 21 is specifically configured to determine that the access device needs to copy a data stream for the destination client, When it is known that the access device is connected to the front-end device and the destination client, if a message for requesting a data flow from the destination client is received, it is determined that the access device needs to be The destination client replicates the data stream; or,

The video surveillance system also includes a streaming media server, the source device includes a source client that has received the data stream from the streaming media server, and the determining module 21 is specifically used to determine the access device In the process of duplicating data streams for the destination client, if it is known that the access device is connected to the source client and connected to the destination client, if receiving a request from the destination client for If the data flow request message is received, it is determined that the access device needs to copy the data flow for the destination client.

Wherein, each module of the device of the present invention can be integrated into one body, or can be deployed separately. The above modules can be combined into one module, or can be further split into multiple sub-modules.

Through the description of the above embodiments, those skilled in the art can clearly understand that the present invention can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is a better implementation Way. Based on this understanding, the essence of the technical solution of the present invention or the part that contributes to the prior art can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions to make a A computer device (which may be a personal computer, a server, or a network device, etc.) executes the methods described in various embodiments of the present invention. Those skilled in the art can understand that the drawing is only a schematic diagram of a preferred embodiment, and the modules or processes in the drawing are not necessarily necessary for implementing the present invention.

Those skilled in the art can understand that the modules in the device in the embodiment can be distributed in the device in the embodiment according to the description in the embodiment, or can be located in one or more devices different from the embodiment according to corresponding changes. The modules in the above embodiments can be combined into one module, and can also be further divided into multiple sub-modules. The serial numbers of the above embodiments of the present invention are for description only, and do not represent the advantages and disadvantages of the embodiments.

The above disclosures are only a few specific embodiments of the present invention, however, the present invention is not limited thereto, and any changes conceivable by those skilled in the art shall fall within the protection scope of the present invention.

Claims (10)

1. A transmission method of a data stream, applied in a video monitoring system comprising a video management server and an access device, characterized in that, the video monitoring system also includes a destination client connected to the access device, A source device connected to the access device, and the source device is the source device corresponding to the data stream requested by the destination client, the method includes: When the video management server determines that the access device needs to copy the data stream for the destination client, the access device receives a copy redirection policy from the video management server; If the access device receives a data flow that matches the copy redirection policy, the access device sends the data flow according to the destination address of the data flow, and uses the copy redirection policy for the The destination client copies the new data stream, and sends the new data stream to the destination client. 2. The method according to claim 1, wherein the video surveillance system also includes a streaming media server, the source device includes a front-end device, and the method further includes: The process in which the video management server determines that the access device needs to copy the data stream for the destination client specifically includes: the video management server learns that the access device is connected to the front-end device, and communicates with the When the destination client is connected, if a message for requesting a data flow from the destination client is received, determine that the access device needs to copy the data flow for the destination client; The process of the access device receiving the data flow matching the copy redirection policy specifically includes: the access device parses out the source IP address and the destination IP address from the received data flow, if the source IP The address is the IP address of the front-end device, and the destination IP address is the IP address of the streaming media server, then it is determined that the data flow matches the copy redirection policy; The process of the access device duplicating the new data flow for the destination client by using the copy redirection strategy specifically includes: the access device copies the data flow, and assigns the source IP address of the copied data flow to Modify it to the IP address of the streaming media server, and modify the destination IP address of the copied data stream to the IP address of the destination client. 3. The method according to claim 1, wherein the video surveillance system also includes a streaming media server, and the source device includes a source client that has received the data stream from the streaming media server, so Said method further comprises: The process in which the video management server determines that the access device needs to copy the data stream for the destination client specifically includes: the video management server learns that the access device is connected to the source client, and communicates with the source client. When the destination client is connected, if a message for requesting a data flow from the destination client is received, it is determined that the access device needs to copy the data flow for the destination client; The process of the access device receiving the data flow matching the copy redirection policy specifically includes: the access device parses out the source IP address and the destination IP address from the received data flow, if the source IP The address is the IP address of the streaming media server, and the destination IP address is the IP address of the source client, then it is determined that the data flow matches the copy redirection strategy; The process of the access device duplicating the new data flow for the destination client by using the copy redirection strategy specifically includes: the access device copies the data flow, and keeps the source IP address of the copied data flow is the IP address of the streaming media server, and the destination IP address of the copied data stream is changed to the IP address of the destination client. 4. The method according to claim 2 or 3, characterized in that the method further comprises: When the access device receives a first registration message from a destination client, a source client, or a front-end device connected to the access device, it sends the first registration message to the video management server, And parse out the device information of the destination client, the source client or the front-end device from the first registration message, and send a second registration message to the video management server, the second registration message The text carries the information of the device and the information of the access device, so that the video management server can use the second registration message to know that the access device is connected to the target client, and communicate with the front end The device is connected; or, it is learned that the access device is connected to the destination client and connected to the source client. 5. method according to claim 4, is characterized in that, described method also comprises: After the video management server receives the first registration message from the destination client, the source client or the front-end device, if it does not receive the first registration message from the access device within a preset time If a registration message is received, the destination client, the source client or the front-end device is denied access to the video monitoring system. 6. A data stream transmission device, which is applied to a video surveillance system including a video management server and an access device, and the data stream transmission device is applied to the access device, wherein the video The monitoring system further includes a destination client connected to the access device, and a source device connected to the access device, and the source device is the source device corresponding to the data flow requested by the destination client, the The data flow transmission device specifically includes: A receiving module, configured to receive a copy redirection policy from the video management server when the video management server determines that the access device needs to copy the data stream for the destination client; A processing module, configured to send the data flow according to the destination address of the data flow when receiving the data flow matching the copy redirection strategy, and use the copy redirection strategy to copy the data flow for the destination client A new data stream is generated, and the new data stream is sent to the destination client. 7. The device of claim 6, wherein: The video surveillance system further includes a streaming media server, the source device includes a front-end device, and the processing module is specifically configured to, during the process of receiving the data stream matching the copy redirection policy, from the received data Source IP address and destination IP address are resolved in the flow, if the source IP address is the IP address of the front-end equipment, and the destination IP address is the IP address of the streaming media server, then it is determined that the data flow is matched to the duplicate Orientation strategy: In the process of using the replication redirection strategy to copy the new data flow for the purpose client, copy the data flow, and modify the source IP address of the copied data flow to the IP of the streaming media server address, modifying the destination IP address of the copied data stream to the IP address of the destination client; or, The video surveillance system also includes a streaming media server, the source device includes a source client that has received the data stream from the streaming media server, and the processing module is specifically configured to In the process of directing the data flow of the strategy, the source IP address and the destination IP address are resolved from the received data flow, if the source IP address is the IP address of the streaming media server, and the destination IP address is the If the IP address of the source client is used, then it is determined that the data flow matches the copy redirection strategy; in the process of copying the new data flow for the destination client using the copy redirection strategy, copy the data flow, And keep the source IP address of the copied data stream as the IP address of the streaming media server, and modify the destination IP address of the copied data stream to the IP address of the destination client. 8. The device according to claim 7, further comprising: A registration module, configured to send the first registration message to the video management server when receiving a first registration message from a destination client, a source client, or a front-end device connected to the access device , and parse out the device information of the destination client, the source client, or the front-end device from the first registration message, and send a second registration message to the video management server, the second registration The message carries the device information and the information of the access device, so that the video management server uses the second registration message to know that the access device is connected to the destination client, and communicates with the The front-end device is connected; or, it is learned that the access device is connected to the destination client and is connected to the source client. 9. A data stream transmission device, applied in a video surveillance system including a video management server and an access device, and the data stream transmission device is applied on the video management server, wherein the video The monitoring system further includes a destination client connected to the access device, and a source device connected to the access device, and the source device is the source device corresponding to the data flow requested by the destination client, the The data flow transmission device specifically includes: A determining module, configured to determine that the access device needs to copy the data flow for the destination client; A sending module, configured to send a copy redirection policy to the access device; so that when the access device receives a data flow matching the copy redirection policy, it sends the copy redirection policy according to the destination address of the data flow The data stream is copied, and a new data stream is copied for the destination client by using the copy redirection policy, and the new data stream is sent to the destination client. 10. The apparatus of claim 9, wherein: The video surveillance system further includes a streaming media server, the source device includes a front-end device, and the determining module is specifically configured to, in the process of determining that the access device needs to copy the data stream for the destination client, in When it is known that the access device is connected to the front-end device and the destination client, if a message for requesting a data stream is received from the destination client, then it is determined that the access device needs to be connected to the destination client. The destination client replicates the data stream; or, The video monitoring system also includes a streaming media server, the source device includes a source client that has received the data stream from the streaming media server, and the determining module is specifically configured to determine that the access device needs to During the process of duplicating data streams for the destination client, when it is known that the access device is connected to the source client and connected to the destination client, if a request from the destination client is received If the data flow message is not received, it is determined that the access device needs to copy the data flow for the destination client.