WO2018129758A1 - Monitor video distribution method and device thereof - Google Patents
Monitor video distribution method and device thereof Download PDFInfo
- Publication number
- WO2018129758A1 WO2018129758A1 PCT/CN2017/071379 CN2017071379W WO2018129758A1 WO 2018129758 A1 WO2018129758 A1 WO 2018129758A1 CN 2017071379 W CN2017071379 W CN 2017071379W WO 2018129758 A1 WO2018129758 A1 WO 2018129758A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- video
- monitoring
- media processing
- processing device
- monitoring server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1101—Session protocols
- H04L65/1104—Session initiation protocol [SIP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
- H04N21/26208—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/6437—Real-time Transport Protocol [RTP]
Definitions
- the present invention relates to the field of surveillance video processing, and in particular, to a method and apparatus for distributing surveillance video.
- the monitoring system consists of 5 parts: camera, transmission, control, display, and record registration.
- the camera transmits the video image to the media processing device through the coaxial video cable, and the media processing device distributes the video signal to the monitoring and recording devices such as the monitoring terminals, and simultaneously records the voice signal to be transmitted into the video recorder.
- the operator can issue commands to control the up, down, left, and right movements of the pan/tilt and adjust the zoom magnification of the lens, and can realize the multi-channel camera and the pan/tilt through the monitoring terminal. Switch between.
- the traditional video surveillance system calls video directly from the camera, and does not consider the limitations of the external environment. For example, without considering the pressure of bandwidth resources, under certain network transmission speeds, such as different monitoring terminals to the same surveillance video. When the call is made, the call bottleneck occurs and the number of calls is limited.
- the object of the present invention is to overcome the above problems existing in the prior art, and to provide a monitoring video distribution method and device thereof, which are used for optimizing bandwidth utilization under limited bandwidth and breaking the limitation of a limited number of video resources called by a camera resource. .
- a monitoring video distribution method and device thereof comprising a monitoring terminal, a monitoring server, a media processing device, a codec device, and a camera;
- the monitoring terminal is configured to provide an interactive interface for a video resource scheduling operation, and implement a video one-click call, a video call, and a video push function;
- the monitoring terminal includes a headquarters monitoring terminal and a branch monitoring terminal;
- the monitoring server is configured to perform integrated scheduling control, video media processing, user registration management, and call routing analysis functions;
- the media processing device is configured to implement video stream distribution and an end user registration proxy function
- the codec device is configured to provide an audio and video access function, and provide a codec function of the high definition video, and a video resolution conversion function;
- the camera is used to implement video image acquisition and transmission functions.
- the device accessed by the codec device includes a high definition or standard definition analog camera, a large screen, a projector, a computer image, and an analog matrix.
- monitoring terminal the media processing device, and the codec device follow the standard SIP protocol REGISTER message, and the monitoring terminal, the media processing device, and the codec device are registered to the monitoring server.
- the monitoring terminal, the monitoring server, the media processing device, the codec device, and the inter-camera communication adopt a signaling flow and a media stream; the signaling flow is used for transmitting and returning control instructions; and the media stream is used for Transfer monitoring video data information.
- the signaling flow is implemented by using a SIP message.
- the media stream is implemented by using an RTP message.
- a method for distributing surveillance video includes the following steps:
- the video stream communication between the monitoring terminal and the monitoring server, the monitoring server, and the media processing device is established.
- the headquarters monitoring terminal sends signaling to the monitoring server, and the monitoring server returns the SDP message of the monitoring server paired with the headquarters monitoring terminal;
- the monitoring server receives the headquarters monitoring.
- the terminal forwards to the matched media processing device, and the media processing device returns an SDP message of the media processing device paired with the monitoring server;
- the media processing device sends signaling to the matched codec device, and the codec device returns an SDP message of the codec device paired with the media processing device;
- the branch monitoring terminal sends signaling to the monitoring server
- the receiving branch monitoring terminal of the monitoring server sends signaling to the matched media processing device.
- the media processing device determines to adjust the repeatability of the access device, and the monitoring server returns an SDP message of the monitoring server paired with the branch monitoring terminal; the media processing device returns an SDP message of the media processing device paired with the monitoring server.
- the video resolution correction is further included; the video resolution correction is used to unify the resolution between the monitoring terminal, the monitoring server, and the codec device.
- the video resolution correction includes video scaling; the video scaling is used by the monitoring terminal, and the monitoring server has a resolution smaller than that of the encoding and decoding device, and the scaling is performed.
- Decode device video stream resolution is used by the monitoring terminal, and the monitoring server has a resolution smaller than that of the encoding and decoding device, and the scaling is performed.
- the video resolution correction further includes video padding; the video padding is used for Filling the video stream vacant area of the codec device when the resolution of the monitoring terminal and the monitoring server is greater than the resolution of the codec device
- the present invention provides a monitoring device for monitoring video, including a monitoring terminal, a monitoring server, a media processing device, a codec device, and a camera.
- the present invention also relates to a method for distributing a monitoring video; When the monitoring terminal monitors the video of the monitoring point, it does not establish the video stream to the codec device again. Instead, after directly performing video comparison processing from the media processing device, the video stream is distributed to the branch monitoring terminal to save video. Streaming data, while any subsequent monitoring terminal monitors the camera video of the monitoring point, distributes the data after comparison and processing by the media processing device, breaks the limitation of the number of video calls of the monitoring point, saves the signaling message establishment process and big data.
- the video stream transmission process the invention optimizes the media processing device to call the video stream processing mechanism of the camera resource under a limited bandwidth, thereby improving the bandwidth utilization.
- FIG. 1 is a schematic diagram of a monitoring device for distributing video according to the present invention
- FIG. 2 is a schematic diagram of a distribution process of monitoring video according to the present invention.
- a monitoring video distribution method including a monitoring terminal, a monitoring server, a media processing device, a codec device, and a camera;
- the monitoring terminal An interactive interface for providing a video resource scheduling operation, implementing a video one-click call, a video call, and a video push function;
- the monitoring terminal includes a headquarters monitoring terminal and a branch monitoring terminal; and the monitoring server is used to complete the comprehensive scheduling Control, video media processing, user registration management, and call routing analysis functions;
- the media processing device is configured to implement video stream distribution, and the terminal user registration proxy function;
- the codec device is configured to provide audio and video access functions, and Provide codec function of HD video and video resolution conversion function;
- the camera is used to realize video image acquisition and transmission.
- the device accessed by the codec device comprises a high definition or standard definition analog camera, a large screen, a projector, a computer image, and an analog matrix.
- the monitoring terminal, the media processing device, and the codec device follow a standard SIP protocol REGISTER message, and the monitoring terminal, the media processing device, and the codec device are registered with the monitoring server.
- the monitoring terminal, the monitoring server, the media processing device, the codec device, and the inter-camera communication adopt a signaling flow and a media stream; the signaling flow is used for transmitting and returning control instructions; and the media stream is used for Transfer monitoring video data information.
- the signaling flow is implemented by using a SIP message.
- the media stream is implemented by using an RTP message.
- a method for distributing surveillance video includes the following steps:
- the video stream communication between the monitoring terminal and the monitoring server, the monitoring server, and the media processing device is established.
- the headquarters monitoring terminal sends signaling to the monitoring server, and the monitoring server returns the SDP message of the monitoring server paired with the headquarters monitoring terminal;
- the monitoring server receives the headquarters monitoring.
- the terminal forwards to the matched media processing device, and the media processing device returns an SDP message of the media processing device paired with the monitoring server;
- the media processing device sends signaling to the matched codec device, and the codec device returns an SDP message of the codec device paired with the media processing device;
- the branch monitoring terminal sends signaling to the monitoring server
- the receiving branch monitoring terminal of the monitoring server sends signaling to the matched media processing device.
- the media processing device determines to adjust the repeatability of the access device, and the monitoring server returns an SDP message of the monitoring server paired with the branch monitoring terminal; the media processing device returns an SDP message of the media processing device paired with the monitoring server.
- the video resolution correction is further included; the video resolution correction is used to unify the resolution between the monitoring terminal, the monitoring server, and the codec device.
- the video resolution correction comprises video scaling; the video scaling is used by the monitoring terminal, and the monitoring server has a resolution smaller than the resolution of the codec device, and the scaling is performed.
- Decode device video stream resolution is used by the monitoring terminal, and the monitoring server has a resolution smaller than the resolution of the codec device, and the scaling is performed.
- the video resolution correction further includes video padding; the video padding is used for the monitoring terminal, and the monitoring server has a resolution greater than the resolution of the codec device. Filling the video stream free area of the codec device.
- the codec device A refers to the codec device in the monitoring point 1 in FIG. 1, and the P1 to P6: the headquarters monitoring terminal and the monitoring server, the monitoring server, and the media processing device follow the standard SIP protocol.
- the message flow is set up to complete the S1 and S2 video streams.
- P1 carries the SDP message of the monitoring terminal
- P4 returns the SDP message of the monitoring server paired with the headquarters monitoring terminal
- P2 carries the SDP message of the monitoring server receiving the video stream.
- the P3 returns the SDP message of the media processing device paired with the monitoring server, and the monitoring server also needs to perform the bridging process, and the video stream of the step S2 is automatically returned to the monitoring terminal through the S1 step.
- the INVITE message format is as follows:
- the c attribute and the m attribute in the message include IP and port number information; the a attribute includes an encoding format. It should be understood that the above format, as an example value, varies according to the actual environment, but all follow the definition of a standard SDP message.
- P7-P9 The video stream that completes the S3 step is established according to the standard SIP protocol message. At this time, the P7 carries the SDP message of the media processing device, and the P8 returns the SDP message of the codec device paired with the media processing device.
- the video media stream information received by the S3 point will be video-scaled according to the previous signaling negotiation message before returning to the video through the S2 and S1 points.
- the S3 video is subject to the HD video, when S3 If the returned video resolution is greater than the video resolution of S2 and S1, the video reduction processing is performed; when the video resolution returned by S3 is equal to the video resolution size of S2 and S1, it is directly forwarded; when the video resolution returned by S3 is smaller than For the video resolutions of S2 and S1, the video received at point S3 is filled with reference to the center point of the video image of S2, and the area with insufficient filling is supplemented with black, and then the filled video is returned to point S2.
- the video stream that completes the S4 step is established according to the standard SIP protocol message.
- the P10 carries the SDP message of the branch monitoring terminal, the P11 transparently transmits the SDP message, and the P12 returns the media processing paired with the branch monitoring terminal.
- the SDP message of the device, the P12 transparently transmits the SDP message; in the step of P11, the media processing device determines, according to the account of the camera to be viewed, that the camera resources processed and processed are the same, according to the video scaling processing mechanism mentioned above. After the video is processed and then sent to the branch monitoring terminal, if it is determined that there is already a video stream of the same resolution that is scaled and processed before the scaling process, the scaled video stream is directly copied and forwarded to S4 point.
- the video stream process established by S3 may be preceded by the video stream process established by S1 and S2, and only needs to be modified before the INVITE signaling sequence of the codec device A, so by adjusting the signaling in the process.
- the order to satisfy the processing of video distribution is also within the scope of this patent.
- the invention provides a device for monitoring video distribution, including a monitoring terminal, a monitoring server and a media.
- the present invention also relates to a method for distributing a monitoring video; the present invention does not establish a video stream to the codec device again when the video of the monitoring terminal monitors the monitoring point.
- the video stream is distributed to the segment monitoring terminal to save the video stream data, and at the same time, any subsequent monitoring terminal monitors the camera video of the monitoring point, which is processed from the media processing device.
- Distributing data breaking the limitation of the number of video calls of the monitoring point, saving the signaling message establishment process and the video streaming process of large data volume; the invention optimizes the video stream of the media processing device to the camera resource under limited bandwidth Call processing mechanisms to increase bandwidth utilization.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Databases & Information Systems (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Closed-Circuit Television Systems (AREA)
- Telephonic Communication Services (AREA)
Abstract
Description
本发明涉及监控视频处理领域,具体涉及一种监控视频的分发方法及其装置。The present invention relates to the field of surveillance video processing, and in particular, to a method and apparatus for distributing surveillance video.
监控系统是由摄像、传输、控制、显示、记录登记5大部分组成。摄像机通过同轴视频电缆将视频图像传输到媒体处理设备,媒体处理设备再将视频信号分配到各监控终端等监视器及录像设备,同时可将需要传输的语音信号同步录入到录像机内。通过监控终端,操作人员可发出指令,对云台的上、下、左、右的动作进行控制及对镜头进行调焦变倍的操作,并可通过监控终端实现在多路摄像机及云台之间的切换。The monitoring system consists of 5 parts: camera, transmission, control, display, and record registration. The camera transmits the video image to the media processing device through the coaxial video cable, and the media processing device distributes the video signal to the monitoring and recording devices such as the monitoring terminals, and simultaneously records the voice signal to be transmitted into the video recorder. Through the monitoring terminal, the operator can issue commands to control the up, down, left, and right movements of the pan/tilt and adjust the zoom magnification of the lens, and can realize the multi-channel camera and the pan/tilt through the monitoring terminal. Switch between.
传统的视频监控系统调用视频都是直接从摄像机处获取,并没有考虑外部环境的局限性影响,例如,没有考虑带宽资源的压力,在一定的网络传输速度下,如不同监控终端对同一监控视频进行调用时,即会出现调用瓶颈,调用次数受到限制。The traditional video surveillance system calls video directly from the camera, and does not consider the limitations of the external environment. For example, without considering the pressure of bandwidth resources, under certain network transmission speeds, such as different monitoring terminals to the same surveillance video. When the call is made, the call bottleneck occurs and the number of calls is limited.
发明内容Summary of the invention
本发明的目的在于克服现有技术存在的以上问题,提供一种监控视频的分发方法及其装置,用于在有限的带宽下,优化带宽利用率,突破摄像头资源调用视频的有限次数的局限性。The object of the present invention is to overcome the above problems existing in the prior art, and to provide a monitoring video distribution method and device thereof, which are used for optimizing bandwidth utilization under limited bandwidth and breaking the limitation of a limited number of video resources called by a camera resource. .
为实现上述技术目的,达到上述技术效果,本发明通过以下技术方案实现:In order to achieve the above technical effects and achieve the above technical effects, the present invention is achieved by the following technical solutions:
一种监控视频的分发方法及其装置,包括监控终端、监控服务器、媒体处理设备、编解码设备、摄像头;A monitoring video distribution method and device thereof, comprising a monitoring terminal, a monitoring server, a media processing device, a codec device, and a camera;
所述的监控终端用于提供视频资源调度操作的交互界面,实现视频一键呼叫、视频调看、视频推送功能;所述的监控终端包括总部监控终端、分部监控终端;The monitoring terminal is configured to provide an interactive interface for a video resource scheduling operation, and implement a video one-click call, a video call, and a video push function; the monitoring terminal includes a headquarters monitoring terminal and a branch monitoring terminal;
所述的监控服务器用于完成综合调度控制、视频媒体处理、用户注册管理以及呼叫路由分析功能;The monitoring server is configured to perform integrated scheduling control, video media processing, user registration management, and call routing analysis functions;
所述的媒体处理设备用于实现视频流分发、终端用户注册代理功能;The media processing device is configured to implement video stream distribution and an end user registration proxy function;
所述的编解码设备用于提供音视频接入功能,并提供高清视频的编解码功能,以及视频分辨率转换功能; The codec device is configured to provide an audio and video access function, and provide a codec function of the high definition video, and a video resolution conversion function;
所述的摄像头用于实现视频图像的采集以及传输功能。The camera is used to implement video image acquisition and transmission functions.
进一步的,所述的编解码设备接入的设备包括高清或标清模拟摄像头、大屏、投影仪、电脑图像、模拟矩阵。Further, the device accessed by the codec device includes a high definition or standard definition analog camera, a large screen, a projector, a computer image, and an analog matrix.
进一步的,所述的监控终端、媒体处理设备、编解码设备遵循标准的SIP协议的REGISTER消息,所述的监控终端、媒体处理设备、编解码设备到所述的监控服务器注册。Further, the monitoring terminal, the media processing device, and the codec device follow the standard SIP protocol REGISTER message, and the monitoring terminal, the media processing device, and the codec device are registered to the monitoring server.
进一步的,所述的监控终端、监控服务器、媒体处理设备、编解码设备、摄像头间通讯采用信令流、媒体流;所述的信令流用于传递与返回控制指令;所述的媒体流用于传输监控视频数据信息。Further, the monitoring terminal, the monitoring server, the media processing device, the codec device, and the inter-camera communication adopt a signaling flow and a media stream; the signaling flow is used for transmitting and returning control instructions; and the media stream is used for Transfer monitoring video data information.
进一步的,所述的信令流采用SIP消息实现。Further, the signaling flow is implemented by using a SIP message.
进一步的,所述的媒体流采用RTP消息实现。Further, the media stream is implemented by using an RTP message.
一种监控视频的分发方法,包括以下步骤:A method for distributing surveillance video includes the following steps:
建立总部监控终端与监控服务器、监控服务器与媒体处理设备的视频流通信,总部监控终端发出信令至监控服务器,监控服务器返回与总部监控终端配对的监控服务器的SDP消息;监控服务器的接收总部监控终端发出信令后转发至匹配的媒体处理设备,媒体处理设备返回与监控服务器配对的媒体处理设备的SDP消息;The video stream communication between the monitoring terminal and the monitoring server, the monitoring server, and the media processing device is established. The headquarters monitoring terminal sends signaling to the monitoring server, and the monitoring server returns the SDP message of the monitoring server paired with the headquarters monitoring terminal; the monitoring server receives the headquarters monitoring. After the terminal sends the signaling, the terminal forwards to the matched media processing device, and the media processing device returns an SDP message of the media processing device paired with the monitoring server;
建立媒体处理设备与编解码设备的视频流通信,媒体处理设备发送信令至匹配的编解码设备,编解码设备返回与媒体处理设备配对的编解码设备的SDP消息;Establishing a video stream communication between the media processing device and the codec device, the media processing device sends signaling to the matched codec device, and the codec device returns an SDP message of the codec device paired with the media processing device;
建立分部监控终端与监控服务器、监控服务器与媒体处理设备视频流通信,分部监控终端发出信令至监控服务器,监控服务器的接收分部监控终端发出信令后转发至匹配的媒体处理设备,媒体处理设备判断调看接入设备的重复性,监控服务器返回与分部监控终端配对的监控服务器的SDP消息;媒体处理设备返回与监控服务器配对的媒体处理设备的SDP消息。Establishing a branch monitoring terminal and monitoring server, monitoring server and media processing device video stream communication, the branch monitoring terminal sends signaling to the monitoring server, and the receiving branch monitoring terminal of the monitoring server sends signaling to the matched media processing device. The media processing device determines to adjust the repeatability of the access device, and the monitoring server returns an SDP message of the monitoring server paired with the branch monitoring terminal; the media processing device returns an SDP message of the media processing device paired with the monitoring server.
进一步的,还包括视频分辨率修正;所述的视频分辨率修正用于统一所述的监控终端、所述的监控服务器与所述编解码设备间的分辨率。Further, the video resolution correction is further included; the video resolution correction is used to unify the resolution between the monitoring terminal, the monitoring server, and the codec device.
进一步的,所述的视频分辨率修正包括视频缩放;所述的视频缩放用于所述的监控终端、所述的监控服务器的分辨率小于所述的编解码设备分辨率时缩放所述的编解码设备视频流分辨率。Further, the video resolution correction includes video scaling; the video scaling is used by the monitoring terminal, and the monitoring server has a resolution smaller than that of the encoding and decoding device, and the scaling is performed. Decode device video stream resolution.
进一步的,所述的视频分辨率修正还包括视频填充;所述的视频填充用于 所述的监控终端、所述的监控服务器的分辨率大于所述的编解码设备分辨率时填充所述的编解码设备视频流空余区域Further, the video resolution correction further includes video padding; the video padding is used for Filling the video stream vacant area of the codec device when the resolution of the monitoring terminal and the monitoring server is greater than the resolution of the codec device
本发明的有益效果:本发明提供一种监控视频的分发装置,包括监控终端、监控服务器、媒体处理设备、编解码设备、摄像头;本发明还涉及一种监控视频的分发方法;本发明实现分部监控终端调看监控点的视频时,并没有再次建立到编解码设备中的视频流,而是,直接从媒体处理设备作视频比较处理后,分发视频流到分部监控终端中,节省视频流数据,同时后续任何监控终端调看监控点的摄像头视频,都是从媒体处理设备比较处理后分发数据,打破了监控点的视频调用次数的局限性,节省的信令消息建立过程以及大数据量的视频流传输过程;本发明在有限的带宽下,优化媒体处理设备对摄像头资源的视频流调用处理机制,从而提高了带宽利用率。Advantageous Effects of the Invention The present invention provides a monitoring device for monitoring video, including a monitoring terminal, a monitoring server, a media processing device, a codec device, and a camera. The present invention also relates to a method for distributing a monitoring video; When the monitoring terminal monitors the video of the monitoring point, it does not establish the video stream to the codec device again. Instead, after directly performing video comparison processing from the media processing device, the video stream is distributed to the branch monitoring terminal to save video. Streaming data, while any subsequent monitoring terminal monitors the camera video of the monitoring point, distributes the data after comparison and processing by the media processing device, breaks the limitation of the number of video calls of the monitoring point, saves the signaling message establishment process and big data. The video stream transmission process; the invention optimizes the media processing device to call the video stream processing mechanism of the camera resource under a limited bandwidth, thereby improving the bandwidth utilization.
上述说明仅是本发明技术方案的概述,为了能够更清楚了解本发明的技术手段,并可依照说明书的内容予以实施,以下以本发明的较佳实施例并配合附图详细说明如后。本发明的具体实施方式由以下实施例及其附图详细给出。The above description is only an overview of the technical solutions of the present invention, and the technical means of the present invention can be more clearly understood and can be implemented in accordance with the contents of the specification. Hereinafter, the preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. Specific embodiments of the present invention are given in detail by the following examples and the accompanying drawings.
此处所说明的附图用来提供对本发明的进一步理解,构成本申请的一部分,本发明的示意性实施例及其说明用于解释本发明,并不构成对本发明的不当限定。在附图中:The drawings described herein are intended to provide a further understanding of the invention, and are intended to be a part of the invention. In the drawing:
图1是本发明的一种监控视频的分发装置示意图;1 is a schematic diagram of a monitoring device for distributing video according to the present invention;
图2是本发明的一种监控视频的分发流程示意图。2 is a schematic diagram of a distribution process of monitoring video according to the present invention.
下面将参考附图并结合实施例,来详细说明本发明。The invention will be described in detail below with reference to the drawings in conjunction with the embodiments.
参照图1-2所示,如图1所示,一种监控视频的分发方法及其装置及其系统,包括监控终端、监控服务器、媒体处理设备、编解码设备、摄像头;所述的监控终端用于提供视频资源调度操作的交互界面,实现视频一键呼叫、视频调看、视频推送功能;所述的监控终端包括总部监控终端、分部监控终端;所述的监控服务器用于完成综合调度控制、视频媒体处理、用户注册管理以及呼叫路由分析功能;所述的媒体处理设备用于实现视频流分发、终端用户注册代理功能;所述的编解码设备用于提供音视频接入功能,并提供高清视频的编解码功能,以及视频分辨率转换功能;所述的摄像头用于实现视频图像的采集以及传输功能。 As shown in FIG. 1 , a monitoring video distribution method, a device thereof, and a system thereof, including a monitoring terminal, a monitoring server, a media processing device, a codec device, and a camera; the monitoring terminal An interactive interface for providing a video resource scheduling operation, implementing a video one-click call, a video call, and a video push function; the monitoring terminal includes a headquarters monitoring terminal and a branch monitoring terminal; and the monitoring server is used to complete the comprehensive scheduling Control, video media processing, user registration management, and call routing analysis functions; the media processing device is configured to implement video stream distribution, and the terminal user registration proxy function; the codec device is configured to provide audio and video access functions, and Provide codec function of HD video and video resolution conversion function; the camera is used to realize video image acquisition and transmission.
优选地,所述的编解码设备接入的设备包括高清或标清模拟摄像头、大屏、投影仪、电脑图像、模拟矩阵。Preferably, the device accessed by the codec device comprises a high definition or standard definition analog camera, a large screen, a projector, a computer image, and an analog matrix.
优选地,所述的监控终端、媒体处理设备、编解码设备遵循标准的SIP协议的REGISTER消息,所述的监控终端、媒体处理设备、编解码设备到所述的监控服务器注册。Preferably, the monitoring terminal, the media processing device, and the codec device follow a standard SIP protocol REGISTER message, and the monitoring terminal, the media processing device, and the codec device are registered with the monitoring server.
优选地,所述的监控终端、监控服务器、媒体处理设备、编解码设备、摄像头间通讯采用信令流、媒体流;所述的信令流用于传递与返回控制指令;所述的媒体流用于传输监控视频数据信息。Preferably, the monitoring terminal, the monitoring server, the media processing device, the codec device, and the inter-camera communication adopt a signaling flow and a media stream; the signaling flow is used for transmitting and returning control instructions; and the media stream is used for Transfer monitoring video data information.
优选地,所述的信令流采用SIP消息实现。Preferably, the signaling flow is implemented by using a SIP message.
优选地,所述的媒体流采用RTP消息实现。Preferably, the media stream is implemented by using an RTP message.
一种监控视频的分发方法,如图2所示,包括以下步骤:A method for distributing surveillance video, as shown in FIG. 2, includes the following steps:
建立总部监控终端与监控服务器、监控服务器与媒体处理设备的视频流通信,总部监控终端发出信令至监控服务器,监控服务器返回与总部监控终端配对的监控服务器的SDP消息;监控服务器的接收总部监控终端发出信令后转发至匹配的媒体处理设备,媒体处理设备返回与监控服务器配对的媒体处理设备的SDP消息;The video stream communication between the monitoring terminal and the monitoring server, the monitoring server, and the media processing device is established. The headquarters monitoring terminal sends signaling to the monitoring server, and the monitoring server returns the SDP message of the monitoring server paired with the headquarters monitoring terminal; the monitoring server receives the headquarters monitoring. After the terminal sends the signaling, the terminal forwards to the matched media processing device, and the media processing device returns an SDP message of the media processing device paired with the monitoring server;
建立媒体处理设备与编解码设备的视频流通信,媒体处理设备发送信令至匹配的编解码设备,编解码设备返回与媒体处理设备配对的编解码设备的SDP消息;Establishing a video stream communication between the media processing device and the codec device, the media processing device sends signaling to the matched codec device, and the codec device returns an SDP message of the codec device paired with the media processing device;
建立分部监控终端与监控服务器、监控服务器与媒体处理设备视频流通信,分部监控终端发出信令至监控服务器,监控服务器的接收分部监控终端发出信令后转发至匹配的媒体处理设备,媒体处理设备判断调看接入设备的重复性,监控服务器返回与分部监控终端配对的监控服务器的SDP消息;媒体处理设备返回与监控服务器配对的媒体处理设备的SDP消息。Establishing a branch monitoring terminal and monitoring server, monitoring server and media processing device video stream communication, the branch monitoring terminal sends signaling to the monitoring server, and the receiving branch monitoring terminal of the monitoring server sends signaling to the matched media processing device. The media processing device determines to adjust the repeatability of the access device, and the monitoring server returns an SDP message of the monitoring server paired with the branch monitoring terminal; the media processing device returns an SDP message of the media processing device paired with the monitoring server.
优选地,还包括视频分辨率修正;所述的视频分辨率修正用于统一所述的监控终端、所述的监控服务器与所述编解码设备间的分辨率。Preferably, the video resolution correction is further included; the video resolution correction is used to unify the resolution between the monitoring terminal, the monitoring server, and the codec device.
优选地,所述的视频分辨率修正包括视频缩放;所述的视频缩放用于所述的监控终端、所述的监控服务器的分辨率小于所述的编解码设备分辨率时缩放所述的编解码设备视频流分辨率。Preferably, the video resolution correction comprises video scaling; the video scaling is used by the monitoring terminal, and the monitoring server has a resolution smaller than the resolution of the codec device, and the scaling is performed. Decode device video stream resolution.
优选地,所述的视频分辨率修正还包括视频填充;所述的视频填充用于所述的监控终端、所述的监控服务器的分辨率大于所述的编解码设备分辨率时填 充所述的编解码设备视频流空余区域。Preferably, the video resolution correction further includes video padding; the video padding is used for the monitoring terminal, and the monitoring server has a resolution greater than the resolution of the codec device. Filling the video stream free area of the codec device.
下面结合图1、图2详细介绍:The following is described in detail in conjunction with Figure 1 and Figure 2:
如图2所示,流程中,编解码设备A指的是图1中监控点1中的编解码设备,P1~P6:总部监控终端与监控服务器、监控服务器与媒体处理设备遵循标准的SIP协议消息流程,建立完成S1、S2步骤的视频流,此时,P1携带监控终端的SDP消息,P4返回与总部监控终端配对的监控服务器的SDP消息,P2携带监控服务器的接收视频流的SDP消息,P3返回与监控服务器配对的媒体处理设备的SDP消息,监控服务器还需要作桥接处理,将S2步骤的视频流自动通过S1步骤返回给监控终端。INVITE消息格式如下形式:As shown in FIG. 2, in the process, the codec device A refers to the codec device in the monitoring point 1 in FIG. 1, and the P1 to P6: the headquarters monitoring terminal and the monitoring server, the monitoring server, and the media processing device follow the standard SIP protocol. The message flow is set up to complete the S1 and S2 video streams. At this time, P1 carries the SDP message of the monitoring terminal, P4 returns the SDP message of the monitoring server paired with the headquarters monitoring terminal, and P2 carries the SDP message of the monitoring server receiving the video stream. The P3 returns the SDP message of the media processing device paired with the monitoring server, and the monitoring server also needs to perform the bridging process, and the video stream of the step S2 is automatically returned to the monitoring terminal through the S1 step. The INVITE message format is as follows:
INVITE sip:00243017@0024.avsp.com;user=phone SIP/2.0INVITE sip:00243017@0024.avsp.com;user=phone SIP/2.0
Via:SIP/2.0/UDP172.16.82.240:10000;rport;branch=z9hG4bKBY311ecc6e256344dab2a52450be03d076Via: SIP/2.0/UDP172.16.82.240:10000;rport;branch=z9hG4bKBY311ecc6e256344dab2a52450be03d076
Max-Forwards:70Max-Forwards: 70
From:From:
<sip:00244169@0024.avsp.com>;tag=f075152c29454f338ed57841df7a5764<sip:00244169@0024.avsp.com>;tag=f075152c29454f338ed57841df7a5764
To:<sip:00243017@0024.avsp.com>To:<sip:00243017@0024.avsp.com>
Contact:<sip:172.16.82.240:10000>Contact:<sip:172.16.82.240:10000>
Call-ID:aee1341c786f4dfe8648964af4f129f2Call-ID: aee1341c786f4dfe8648964af4f129f2
CSeq:18763INVITECSeq: 18763INVITE
Session-Expires:1000Session-Expires: 1000
Min-SE:90Min-SE: 90
Route:<sip:172.16.82.45:5060;lr>Route:<sip:172.16.82.45:5060;lr>
Content-Type:application/sdpContent-Type: application/sdp
Content-Length:307Content-Length: 307
v=0V=0
o=cs-ist 0 0IN IP4 172.16.82.240o=cs-ist 0 0IN IP4 172.16.82.240
s=0s=0
c=IN IP4 172.16.82.240c=IN IP4 172.16.82.240
t=0 0 t=0 0
m=video 62418RTP/AVP 97 120m=video 62418RTP/AVP 97 120
b=TIAS:4096000b=TIAS:4096000
a=recvonlya=recvonly
a=rtpmap:97H264/90000a=rtpmap:97H264/90000
a=fmtp:97profile-level-id=428016;max-mbps=36000;max-fs=1200a=fmtp:97profile-level-id=428016;max-mbps=36000;max-fs=1200
a=rtpmap:120VP8/90000a=rtpmap:120VP8/90000
a=fmtp:120profile-level-id=428016;max-mbps=36000;max-fs=1200a=fmtp:120profile-level-id=428016;max-mbps=36000;max-fs=1200
其中,本消息中的c属性与m属性包含IP与端口号信息;a属性包含编码格式。应当理解,上面的格式,为举例值,根据实际环境而改变,但都是遵循标准的SDP消息的定义。The c attribute and the m attribute in the message include IP and port number information; the a attribute includes an encoding format. It should be understood that the above format, as an example value, varies according to the actual environment, but all follow the definition of a standard SDP message.
P7~P9:根据标准的SIP协议消息,建立完成S3步骤的视频流,此时,P7携带媒体处理设备的SDP消息,P8返回与媒体处理设备配对的编解码设备的SDP消息。P7-P9: The video stream that completes the S3 step is established according to the standard SIP protocol message. At this time, the P7 carries the SDP message of the media processing device, and the P8 returns the SDP message of the codec device paired with the media processing device.
特别指出,S3点接收到的视频媒体流信息,通过S2、S1点返回视频前,会根据前面的信令协商消息,作视频缩放处理,具体的,S3的视频以高清视频为准,当S3返回的视频分辨率大于S2、S1的视频分辨率大小,则作视频缩小处理;当S3返回的视频分辨率等于S2、S1的视频分辨率大小,则直接转发;当S3返回的视频分辨率小于S2、S1的视频分辨率,则将S3点接收的视频以S2的视频图像的中心点为参照填充,填充不足的区域以黑色补充,之后将填充的视频返回给S2点。In particular, the video media stream information received by the S3 point will be video-scaled according to the previous signaling negotiation message before returning to the video through the S2 and S1 points. Specifically, the S3 video is subject to the HD video, when S3 If the returned video resolution is greater than the video resolution of S2 and S1, the video reduction processing is performed; when the video resolution returned by S3 is equal to the video resolution size of S2 and S1, it is directly forwarded; when the video resolution returned by S3 is smaller than For the video resolutions of S2 and S1, the video received at point S3 is filled with reference to the center point of the video image of S2, and the area with insufficient filling is supplemented with black, and then the filled video is returned to point S2.
P10~P15:根据标准的SIP协议消息,建立完成S4步骤的视频流,此时,P10携带分部监控终端的SDP消息,P11透传该SDP消息,P12返回与分部监控终端配对的媒体处理设备的SDP消息,P12透传该SDP消息;媒体处理设备在P11的步骤中,根据调看的摄像头的账号,判断处理调看的摄像头资源是同一个,则根据前文提到的视频缩放处理机制,将视频处理后再发送给分部监控终端,但在作缩放处理前,如果判断出,已经存在缩放处理的相同分辨率的视频流,则直接将缩放后的视频流作拷贝处理后转发给S4点。P10 to P15: The video stream that completes the S4 step is established according to the standard SIP protocol message. At this time, the P10 carries the SDP message of the branch monitoring terminal, the P11 transparently transmits the SDP message, and the P12 returns the media processing paired with the branch monitoring terminal. The SDP message of the device, the P12 transparently transmits the SDP message; in the step of P11, the media processing device determines, according to the account of the camera to be viewed, that the camera resources processed and processed are the same, according to the video scaling processing mechanism mentioned above. After the video is processed and then sent to the branch monitoring terminal, if it is determined that there is already a video stream of the same resolution that is scaled and processed before the scaling process, the scaled video stream is directly copied and forwarded to S4 point.
应当理解,在流程中,S3建立的视频流过程,可提前于S1、S2建立的视频流过程,只需要修改到编解码设备A的INVITE信令顺序前,所以,通过调整流程中的信令顺序满足视频分发的处理,也在本专利受保护的范围内。It should be understood that, in the process, the video stream process established by S3 may be preceded by the video stream process established by S1 and S2, and only needs to be modified before the INVITE signaling sequence of the codec device A, so by adjusting the signaling in the process. The order to satisfy the processing of video distribution is also within the scope of this patent.
本发明提供一种监控视频的分发装置,包括监控终端、监控服务器、媒体 处理设备、编解码设备、摄像头;本发明还涉及一种监控视频的分发方法;本发明实现分部监控终端调看监控点的视频时,并没有再次建立到编解码设备中的视频流,而是,直接从媒体处理设备作视频比较处理后,分发视频流到分部监控终端中,节省视频流数据,同时后续任何监控终端调看监控点的摄像头视频,都是从媒体处理设备比较处理后分发数据,打破了监控点的视频调用次数的局限性,节省的信令消息建立过程以及大数据量的视频流传输过程;本发明在有限的带宽下,优化媒体处理设备对摄像头资源的视频流调用处理机制,从而提高了带宽利用率。The invention provides a device for monitoring video distribution, including a monitoring terminal, a monitoring server and a media. The present invention also relates to a method for distributing a monitoring video; the present invention does not establish a video stream to the codec device again when the video of the monitoring terminal monitors the monitoring point. After the video processing process is directly performed from the media processing device, the video stream is distributed to the segment monitoring terminal to save the video stream data, and at the same time, any subsequent monitoring terminal monitors the camera video of the monitoring point, which is processed from the media processing device. Distributing data, breaking the limitation of the number of video calls of the monitoring point, saving the signaling message establishment process and the video streaming process of large data volume; the invention optimizes the video stream of the media processing device to the camera resource under limited bandwidth Call processing mechanisms to increase bandwidth utilization.
以上所述,仅为本发明的较佳实施例而已,并非对本发明作任何形式上的限制;凡本行业的普通技术人员均可按说明书附图所示和以上所述而顺畅地实施本发明;但是,凡熟悉本专业的技术人员在不脱离本发明技术方案范围内,利用以上所揭示的技术内容而做出的些许更动、修饰与演变的等同变化,均为本发明的等效实施例;同时,凡依据本发明的实质技术对以上实施例所作的任何等同变化的更动、修饰与演变等,均仍属于本发明的技术方案的保护范围之内。 The above is only the preferred embodiment of the present invention, and is not intended to limit the present invention in any way; and those skilled in the art can smoothly implement the present invention as shown in the drawings and described above. However, those skilled in the art can make equivalent changes to the changes, modifications and evolutions made by the above-discussed technical contents without departing from the technical scope of the present invention. At the same time, any changes, modifications and evolutions of any equivalent changes made to the above embodiments in accordance with the essential techniques of the present invention are still within the scope of the technical solutions of the present invention.
Claims (9)
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2017100254707 | 2017-01-13 | ||
| CN201710025470.7A CN106791695A (en) | 2017-01-13 | 2017-01-13 | The distribution method and its device of a kind of monitor video |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2018129758A1 true WO2018129758A1 (en) | 2018-07-19 |
Family
ID=58946736
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2017/071379 Ceased WO2018129758A1 (en) | 2017-01-13 | 2017-01-17 | Monitor video distribution method and device thereof |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN106791695A (en) |
| WO (1) | WO2018129758A1 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112188227A (en) * | 2020-09-30 | 2021-01-05 | 武汉中科通达高新技术股份有限公司 | Streaming media data distribution method and device |
| CN112258912A (en) * | 2020-10-10 | 2021-01-22 | 深圳市捷视飞通科技股份有限公司 | Network interactive teaching method, device, computer equipment and storage medium |
| CN114040166A (en) * | 2021-11-11 | 2022-02-11 | 浩云科技股份有限公司 | Distributed stream media grouping management system, method, equipment and medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101198029A (en) * | 2007-04-13 | 2008-06-11 | 东华大学 | System and Method for Remote Video Monitoring Based on Softswitch |
| CN103384247A (en) * | 2013-07-05 | 2013-11-06 | 福建星网锐捷通讯股份有限公司 | Video multicast achieving method based on session initiation protocol (SIP) monitoring system |
| US20140095576A1 (en) * | 2012-09-28 | 2014-04-03 | Avaya Inc. | System and method for classification of media in voip sessions with rtp source profiling/tagging |
| CN104349118A (en) * | 2014-11-26 | 2015-02-11 | 苏州科达科技股份有限公司 | Gateway for video conference system to schedule video monitoring system and processing method thereof |
| CN105554515A (en) * | 2015-12-30 | 2016-05-04 | 邦彦技术股份有限公司 | Multilevel media distribution method and system based on SIP (Session Initiation Protocol) |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2009278275A (en) * | 2008-05-13 | 2009-11-26 | Sony Corp | Video distribution device, video distribution method, video receiver and video reception method |
| CN101808233A (en) * | 2009-02-18 | 2010-08-18 | 杭州海康威视数字技术股份有限公司 | Universal system for realizing video monitoring of mobile phone and method thereof |
| CN101895569B (en) * | 2010-06-21 | 2015-01-28 | 中兴通讯股份有限公司 | Implementation method of video browsing, IMS video monitoring system and front monitoring front-end |
| CN101938494B (en) * | 2010-09-21 | 2012-12-26 | 武汉烽火众智数字技术有限责任公司 | Intelligent switching method for media connection modes in safe city video monitoring |
-
2017
- 2017-01-13 CN CN201710025470.7A patent/CN106791695A/en active Pending
- 2017-01-17 WO PCT/CN2017/071379 patent/WO2018129758A1/en not_active Ceased
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101198029A (en) * | 2007-04-13 | 2008-06-11 | 东华大学 | System and Method for Remote Video Monitoring Based on Softswitch |
| US20140095576A1 (en) * | 2012-09-28 | 2014-04-03 | Avaya Inc. | System and method for classification of media in voip sessions with rtp source profiling/tagging |
| CN103384247A (en) * | 2013-07-05 | 2013-11-06 | 福建星网锐捷通讯股份有限公司 | Video multicast achieving method based on session initiation protocol (SIP) monitoring system |
| CN104349118A (en) * | 2014-11-26 | 2015-02-11 | 苏州科达科技股份有限公司 | Gateway for video conference system to schedule video monitoring system and processing method thereof |
| CN105554515A (en) * | 2015-12-30 | 2016-05-04 | 邦彦技术股份有限公司 | Multilevel media distribution method and system based on SIP (Session Initiation Protocol) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112188227A (en) * | 2020-09-30 | 2021-01-05 | 武汉中科通达高新技术股份有限公司 | Streaming media data distribution method and device |
| CN112258912A (en) * | 2020-10-10 | 2021-01-22 | 深圳市捷视飞通科技股份有限公司 | Network interactive teaching method, device, computer equipment and storage medium |
| CN114040166A (en) * | 2021-11-11 | 2022-02-11 | 浩云科技股份有限公司 | Distributed stream media grouping management system, method, equipment and medium |
| CN114040166B (en) * | 2021-11-11 | 2023-07-04 | 浩云科技股份有限公司 | Distributed stream media grouping management system, method, equipment and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106791695A (en) | 2017-05-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11412021B2 (en) | Method and device for media streaming between server and client using RTP/RTSP standard protocol | |
| US10791261B2 (en) | Interactive video conferencing | |
| TWI635751B (en) | User equipment (UE) based on Multimedia Messaging Service (MTSI) of IMS that can be used for video attention area (ROI) signaling (2) | |
| CN108810636B (en) | Video playback method, virtual reality device, server, system and storage medium | |
| US10491861B2 (en) | Interactive video conferencing | |
| EP3092793B1 (en) | Interactive video conferencing | |
| CN101047853B (en) | Server apparatus and video transmission method | |
| US9094527B2 (en) | Seamlessly transferring a communication | |
| CN112866199B (en) | Method for viewing GB/T28181 protocol-supporting equipment in Chrome browser | |
| CN105704426A (en) | Method, device and system for video conferencing | |
| CN104219479A (en) | Video communication service processing method and system | |
| CN101754002B (en) | Video monitoring system and realization method for dual-stream monitoring front end thereof | |
| WO2018129758A1 (en) | Monitor video distribution method and device thereof | |
| CN103929623A (en) | A video data processing method in a video surveillance system | |
| EP2884743A1 (en) | Process for managing the exchanges of video streams between users of a video conference service | |
| CN101729318A (en) | Modulus mutual control gateway, monitoring system and monitoring method | |
| CN1787632B (en) | Method and system for sending video signals between different types of user agents | |
| WO2014082294A1 (en) | Media stream transmission method and relevant device and system | |
| CN113973230B (en) | Call processing method, device and system | |
| CN117439980B (en) | Video on demand method, device, equipment and storage medium based on intermediate number | |
| HK1235593A1 (en) | Interactive video conferencing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17890983 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 17890983 Country of ref document: EP Kind code of ref document: A1 |