CN118337961A - Visual intercom method, system and access control machine - Google Patents

Abstract

The application discloses a visual intercom system, which comprises an entrance guard machine, wireless receiving equipment and signaling service, wherein the entrance guard machine, the wireless receiving equipment and the signaling service are communicated based on WebRTC, and when the entrance guard machine or the wireless receiving equipment creates a WebRTC connection request, signaling interaction is carried out through the signaling service so as to realize audio and video WebRTC communication connection; the access control machine is used for collecting audio and video signals of a first user, sending the audio and video signals of the first user to the wireless receiving equipment and receiving the audio and video signals sent by the wireless receiving equipment; the wireless receiving equipment is used for receiving the audio and video signals sent by the access control machine and sending the audio and video signals of the second user to the access control machine.

Description

A visual intercom method, system and access control machine

Technical Field

The present invention relates to the technical field of video intercom, and in particular to a video intercom method, system and access control machine.

Background technique

Common video intercom technologies include network-based real-time audio and video communication technology and webcam technology. Network-based real-time audio and video communication technology mainly includes the use of RTSP, RTMP, SIP and other protocols, through which multiple people can achieve real-time online audio and video communication, but at the same time, applications or plug-ins need to be installed, the threshold for use is high, and the user experience is not good. Webcam technology is a technology that uses a camera to collect video signals and transmits them to the client through the network. This technology usually uses HTTP or RTSP protocol for video transmission, which can realize remote real-time monitoring and intercom. However, due to limitations of network bandwidth, delay and other factors, the video quality may be affected. Therefore, a video intercom method, system and access control machine that can solve the above technical problems are needed.

Summary of the invention

The main purpose of this application is to provide a video intercom method, system and access control machine based on WEBRTC technology, aiming to solve the problems mentioned in the background technology.

The present application provides a video intercom system, including an access control machine, a wireless receiving device and a signaling service. The access control machine, the wireless receiving device and the signaling service communicate with each other based on WebRTC. When the access control machine or the wireless receiving device creates a WebRTC connection request, signaling interaction is performed through the signaling service to realize audio and video WebRTC communication connection;

The access control machine is used to collect audio and video signals of the first user, send the audio and video signals of the first user to the wireless receiving device, and receive the audio and video signals sent by the wireless receiving device;

The wireless receiving device is used to receive the audio and video signals sent by the access control machine, and send the audio and video signals of the second user to the access control machine.

Furthermore, the access control machine includes a first communication request module, which is used to send a communication request to the wireless receiving device through the WEBRTC protocol. After the wireless receiving device receives the communication request and confirms it, it realizes signaling interaction between the access control machine browser and the wireless receiving device browser to establish an audio and video communication connection between the access control machine and the wireless receiving device.

Furthermore, it also includes a security encryption module, which is used to encrypt and protect the audio and video signals transmitted between the access control machine and the wireless receiving device to ensure the security and privacy of audio and video communications.

The present application also provides a video intercom method, which is applied to a video intercom system, wherein the video intercom system includes an access control machine, a wireless receiving device, and a signaling service, and is characterized in that the signaling interaction between the access control machine and the wireless receiving device is realized through signaling interaction to establish an audio and video WebRTC communication connection. The video intercom method includes the following steps:

Any one of the access control machine and the wireless receiving device collects audio and video signals;

Encode audio and video signals through codecs;

The encoded audio and video signals are transmitted through the WebRTC protocol and transmitted to the other end of the access control machine and the wireless receiving device through a network transmission device;

After receiving the audio and video signals, the other end of the access control machine and the wireless receiving device decodes the audio and video signals through a codec;

Play the information corresponding to the audio and video signals.

Furthermore, it also includes a security encryption method, which securely encrypts the audio and video signals transmitted between the access control machine and the wireless receiving device to ensure the security and privacy of the audio and video communications.

Furthermore, the “security encryption of the audio and video signals transmitted between the access control machine and the wireless receiving device” specifically includes:

By introducing SRTP encryption and/or DTLS transport layer encryption, the audio and video signals transmitted between the access control machine and the wireless receiving device are encrypted and protected.

The present application also provides a video intercom access control machine, including a video acquisition module, an audio and video encoding and decoding module, a network transmission module, an audio and video playback module and a control signaling module;

The audio and video acquisition module is used to collect audio and video signals;

The audio and video encoding and decoding module is used to encode the audio and video signals collected to be sent to the wireless receiving device and decode the audio and video signals received by the wireless receiving device;

The network transmission module is used to transmit the audio and video signals to the wireless receiving device through the WebRTC protocol;

The audio and video playback module is used to play the received audio and video signals after decoding;

The control signaling module is used to implement signaling interaction between the access control machine and the wireless receiving device browser to establish an audio and video communication connection with the wireless receiving device.

Furthermore, it also includes a security encryption module, which is used to encrypt and protect the audio and video data to be sent to the wireless receiving device.

Furthermore, SRTP encryption and/or DTLS transport layer encryption are introduced to encrypt and protect the audio and video data to be sent to the wireless receiving device.

Furthermore, the control signaling module implements signaling interaction between browsers by using an open source WebSocket library.

In the present invention, by utilizing WebRTC technology, the access control machine, the wireless receiving device and the signaling service communicate based on WebRTC. When the access control machine or the wireless receiving device creates a WebRTC connection request, the signaling service performs signaling interaction to realize the audio and video WebRTC communication connection. By utilizing the real-time communication API provided by the Web browser, real-time communication and video transmission between browsers are realized. Users do not need to download and install additional applications or plug-ins, and the threshold for use is low. In addition, due to the use of the WebRTC protocol to optimize audio and video encoding and decoding, high-quality, real-time audio and video communication is realized, greatly improving the real-time performance and communication quality. Moreover, the video intercom system and method provided by the present invention have the advantages of low threshold, good real-time performance, high security, and excellent user experience.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

FIG. 1 is a schematic diagram of a module of a video intercom system according to an embodiment of the present invention.

FIG. 2 is a schematic diagram of a communication process of a video intercom system according to an embodiment of the present invention.

FIG. 3 is a schematic diagram of a module of an access control machine according to an embodiment of the present invention.

The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings.

Detailed ways

In order to make the above-mentioned purposes, features and advantages of the present invention more obvious and easy to understand, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work belong to the scope of protection of the present invention.

Referring to FIGS. 1-3 , the present application provides a video intercom system, including an access control machine 100, a wireless receiving device 200 and a signaling service 300. The access control machine 100, the wireless receiving device 200 and the signaling service 300 communicate with each other based on WebRTC. When the access control machine 100 or the wireless receiving device 200 creates a WebRTC connection request, signaling interaction is performed through the signaling service 300 to realize audio and video WebRTC communication connection;

The access control machine 100 is used to collect the audio and video signals of the first user, send the audio and video signals of the first user to the wireless receiving device 200, and receive the audio and video signals sent by the wireless receiving device 200;

The wireless receiving device 200 is used to receive the audio and video signals sent by the access control machine 100 , and send the audio and video signals of the second user to the access control machine 100 .

In the present invention, by utilizing WebRTC technology, the access control machine 100, the wireless receiving device 200 and the signaling service 300 communicate based on WebRTC, utilizing existing network equipment and audio and video acquisition equipment, without the need to purchase expensive hardware, reducing the cost of the video intercom system, and realizing real-time communication and video transmission between browsers. It does not require users to download and install additional applications or plug-ins, and the threshold for use is low. In addition, due to the use of the WebRTC protocol to optimize audio and video encoding and decoding, high-quality, real-time audio and video communication is achieved, greatly improving real-time performance and communication quality. Moreover, the video intercom system and method provided by the present invention have the advantages of low threshold, good real-time performance, high security, and excellent user experience, and because the video intercom system in this application is implemented based on WebRTC technology, it can communicate with other WebRTC applications, which is convenient for expansion and upgrading.

In one embodiment of the present invention, the access control machine 100 includes a first communication request module, which is used to send a communication request to the wireless receiving device 200 through the WEBRTC protocol. After the wireless receiving device 200 receives the communication request and confirms it, it implements signaling interaction between the browser of the access control machine 100 and the browser of the wireless receiving device 200 to establish an audio and video communication connection between the access control machine 100 and the wireless receiving device 200.

In one embodiment of the present invention, the video intercom system also includes a security encryption module, which is used to encrypt and protect the audio and video signals transmitted between the access control machine 100 and the wireless receiving device 200 to ensure the security and privacy of audio and video communications; the video intercom system of the present invention uses a security encryption module to encrypt and protect audio and video data, ensure the security and privacy of audio and video communications, and improve the security of the video intercom system.

The present application also provides a video intercom method, which is applied to a video intercom system, wherein the video intercom system includes an access control machine 100, a wireless receiving device 200 and a signaling service 300, and is characterized in that the signaling interaction between the access control machine 100 and the wireless receiving device 200 is realized through signaling interaction to establish an audio and video WebRTC communication connection. The video intercom method includes the following steps:

Any end of the access control machine 100 and the wireless receiving device 200 collects audio and video signals;

Encode audio and video signals through codecs;

The encoded audio and video signals are transmitted through the WebRTC protocol and transmitted to the other end of the access control machine 100 and the wireless receiving device 200 through a network transmission device;

The access control machine 100 and the other end of the wireless receiving device 200 receive the audio and video signals and decode the audio and video signals through a codec;

Play the information corresponding to the audio and video signals.

In one embodiment of the present invention, a security encryption method is also included, which securely encrypts the audio and video signals transmitted between the access control machine 100 and the wireless receiving device 200 to ensure the security and privacy protection of the audio and video communication.

In one embodiment of the present invention, the “security encryption of the audio and video signals transmitted between the access control machine 100 and the wireless receiving device 200” specifically includes:

The audio and video signals transmitted between the access control machine 100 and the wireless receiving device 200 are encrypted and protected by introducing SRTP encryption and/or DTLS transport layer encryption.

The present application also provides a video intercom access control machine 100, comprising a video acquisition module 10, an audio and video encoding and decoding module 20, a network transmission module 30, an audio and video playback module 40 and a control signaling module 50;

The audio and video acquisition module 10 is used to collect audio and video signals. Specifically, in one embodiment, the audio and video acquisition module 10 of the video intercom system includes a microphone and a camera. The microphone is used to collect voice signals, and the camera is used to collect video signals. The camera uses the 2 million pixels of the face recognition machine itself.

The audio and video codec module 20 is used to encode the audio and video signals collected to be sent to the wireless receiving device 200 and decode the audio and video signals received by the wireless receiving device 200; specifically, in one embodiment of the present invention, WebRTC technology is adopted, and the open source library of amazon-kinesis-video-streams-webrtc-sdk is used to process the WebRTC protocol. The WebRTC protocol uses VP8 and H.264 codecs for audio and video encoding and decoding. Open source VP8 and H.264 codecs such as libvpx and x264 can be used. The codec can be implemented in hardware or software.

The network transmission module 30 is used to transmit the audio and video signals to the wireless receiving device 200 through the WebRTC protocol; specifically, in one embodiment of the present invention, WebSocket is used to communicate with the signaling server 300, and an open source WebSocket library such as libwebsockets is used. The audio and video data is transmitted through the WebRTC protocol, and the open source library of amazon-kinesis-video-streams-webrtc-sdk is used. The network transmission device can use common network interfaces, routers, switches and other devices.

The audio and video playback module 40 is used to play the received audio and video signals after decoding; specifically, in one embodiment of the present invention, the audio and video playback module of the video intercom system of the present invention includes a speaker and a display. The speaker is used to play the voice signal, and the display is used to display the video signal. The speaker and the display can use common USB peripherals and be connected to the computer or embedded system through a USB interface. In the Linux system, open source software such as FFmpeg can be used to decode and play the audio and video signals.

The control signaling module 50 is used to implement signaling interaction between the access control machine 100 and the browser of the wireless receiving device 200 to establish an audio and video communication connection with the wireless receiving device 200.

The present invention also includes a security encryption module 60, which is used to encrypt and protect the audio and video data to be sent to the wireless receiving device 200; the present invention uses an encryption algorithm to encrypt and protect the audio and video data to ensure the security and privacy of audio and video communications. An open source encryption algorithm library can be used, such as OpenSSL.

Specifically, the audio and video data sent to the wireless receiving device 200 is encrypted and protected by introducing SRTP encryption and/or DTLS transport layer encryption.

Specifically, in one embodiment of the present invention, the control signaling module of the video intercom system of the present invention is used to implement signaling interaction between browsers to establish an audio and video communication connection. The control signaling module can use an open source WebSocket library, such as libwebsockets.

The "this device" mentioned in the present invention refers to any GPS device carried and/or used by the user, and "other devices" refers to other devices except the GPS device carried and/or used by the user. This is only to distinguish between the subject and the object, and is not a limitation on the devices.

The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent processing scope of the present application.

Claims (10)

1. The visual intercom system is characterized by comprising an entrance guard machine, wireless receiving equipment and signaling service, wherein the entrance guard machine, the wireless receiving equipment and the signaling service are communicated based on WebRTC, and when the entrance guard machine or the wireless receiving equipment creates a WebRTC connection request, signaling interaction is carried out through the signaling service to realize audio and video WebRTC communication connection;

The access control machine is used for collecting audio and video signals of a first user, sending the audio and video signals of the first user to the wireless receiving equipment and receiving the audio and video signals sent by the wireless receiving equipment;

the wireless receiving equipment is used for receiving the audio and video signals sent by the access control machine and sending the audio and video signals of the second user to the access control machine.

2. The visual intercom system according to claim 1, wherein the entrance guard machine comprises a first communication request module, the first communication request module is configured to send a communication request to the wireless receiving device through the WEBRTC protocol, and after the wireless receiving device receives the communication request and confirms, signaling interaction between the entrance guard machine browser and the wireless receiving device browser is achieved, so as to establish an audio-video communication connection between the entrance guard machine and the wireless receiving device.

3. The visual intercom system of claim 1, further comprising a security encryption module for encrypting and protecting audio and video signals transmitted between said entrance guard and said wireless receiving device to ensure security and privacy protection of audio and video communications.

4. The visual intercom method is applied to a visual intercom system, and the visual intercom system comprises an access control machine, wireless receiving equipment and signaling service. The visual intercom method comprises the following steps:

any one end of the access control machine and the wireless receiving equipment collects audio and video signals;

Encoding the audio and video signals by a codec;

Transmitting the encoded audio and video signals through a WebRTC protocol, and transmitting the encoded audio and video signals to the other ends of the access control machine and the wireless receiving equipment through network transmission equipment;

The other ends of the access control machine and the wireless receiving equipment receive video signals and then decode the audio and video signals through a coder-decoder;

and playing information corresponding to the audio and video signals.

5. The visual intercom method according to claim 4, further comprising a secure encryption method for securing security and privacy protection of audio and video communications by securely encrypting audio and video signals transmitted between the entrance guard machine and the wireless receiving device.

6. The visual intercom method according to claim 5, wherein the step of securely encrypting the audio/video signal transmitted between the entrance guard machine and the wireless receiving device comprises:

And (3) encrypting and protecting the audio and video signals transmitted between the gate inhibition machine and the wireless receiving equipment by introducing SRTP encryption and/or DTLS transmission layer encryption.

7. The visual intercom access control machine is characterized by comprising a video acquisition module, an audio/video encoding/decoding module, a network transmission module, an audio/video playing module and a control signaling module;

the audio and video acquisition module is used for acquiring audio and video signals;

the audio/video encoding and decoding module is used for encoding the acquired audio/video signals to be sent to the wireless receiving equipment and decoding the received audio/video signals of the wireless receiving equipment;

The network transmission module is used for transmitting the audio and video signals to the wireless receiving equipment through the WebRTC protocol;

the audio/video playing module is used for playing the received audio/video signals after decoding;

and the control signaling module is used for realizing signaling interaction between the access control machine and the wireless receiving equipment browser so as to establish audio and video communication connection with the wireless receiving equipment.

8. The video intercom access control device of claim 7 further comprising a secure encryption module for encrypting and protecting audio and video data to be transmitted to the wireless receiving device.

9. The video-intercom access control device of claim 8 wherein the audio-video data to be transmitted to the wireless receiving device is cryptographically protected by introducing SRTP encryption and/or DTLS transport layer encryption.

10. The visual intercom access control system of claim 7 wherein said control signaling module enables signaling interaction between browsers by using an open source WebSocket library.