[go: up one dir, main page]

WO2013117065A1 - Video processing method and system, ivw and ivu - Google Patents

Video processing method and system, ivw and ivu Download PDF

Info

Publication number
WO2013117065A1
WO2013117065A1 PCT/CN2012/076671 CN2012076671W WO2013117065A1 WO 2013117065 A1 WO2013117065 A1 WO 2013117065A1 CN 2012076671 W CN2012076671 W CN 2012076671W WO 2013117065 A1 WO2013117065 A1 WO 2013117065A1
Authority
WO
WIPO (PCT)
Prior art keywords
ivu
video
ivw
cms
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2012/076671
Other languages
French (fr)
Chinese (zh)
Inventor
邢晓江
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Publication of WO2013117065A1 publication Critical patent/WO2013117065A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • the present invention relates to video surveillance technology and intelligent video analysis technology in the information field, and in particular to a video processing method and system, IVW and IVU. Background technique
  • the video surveillance system is an important service for operators.
  • the video surveillance system is deployed in large quantities as the basis for services such as urban security, security protection, and remote monitoring.
  • Intelligent Video (IV) technology is derived from the research of Computer Vision (CV) and Artificial Intelligence (AI). Its development goal is to establish a mapping relationship between images and event descriptions. Identify and identify key target objects from a wide range of video images.
  • This research applied to the security video surveillance system will be able to use the powerful data processing capabilities of the computer to filter out useless or interference information in the image, automatically analyze and extract key useful information in the video source, so that the camera in the traditional monitoring system not only Being a human eye also makes the "smart video analysis" computer a human brain and has a more "smart” way of learning and thinking.
  • the main object of the present invention is to provide a video processing method and system, IVW and IVU, to implement superimposed video analysis and recognition technology based on an existing video monitoring system.
  • Video analytics identification services are now available in a flexible, configurable manner.
  • the invention provides a video processing system, comprising: an intelligent management platform IVM and an intelligent video processing unit IVU,
  • the IVW is used to save and manage the capability set of the IVU under the jurisdiction, and according to the request of the video monitoring system, select an IVU that meets the capability requirement from the IVU under the jurisdiction and call it;
  • the IVU is configured to accept management and scheduling of the IVW, analyze and identify an image or video stream input from the video surveillance system, and output a processing result to the IVW.
  • the IVW is further configured to provide an intelligent application policy configuration service, and save the configured intelligent application policy.
  • the IVW is further configured to receive a call from the video surveillance system to the IVW-supplied smart application policy, and feed back the address of the IVU of the execution policy to the video surveillance system according to the saved IVU capability set.
  • the IVU is further configured to: when an IVU as an execution policy is invoked by the IVW, acquire an image or a video stream from a destination indicated by the video monitoring system, analyze and identify an input image or a video stream, and The processing result is output to the IVW.
  • the invention also provides an intelligent management platform IVW, comprising:
  • the IVU management scheduling module is configured to save and manage the capability set of the intelligent video processing unit IVU, and select an IVU that meets the capability requirement from the IVU under the control according to the request of the video monitoring system;
  • the analysis result saving module is configured to receive an output result of the IVU analyzing and identifying the image or video stream input to the IVU from the video monitoring system, and save the result.
  • the IVW further includes: a policy management module, configured to provide a smart application policy configuration service, and save the configured smart application policy.
  • the policy management module is further configured to: accept a call of the video monitoring system to the IVW saved smart application policy, and notify the IVU management scheduling module;
  • the IVU management scheduling module is further configured to: feed back an address of the IVU of the execution policy to the video monitoring system according to the invoked smart application policy and the saved capability set of the IVU.
  • the invention also provides an intelligent video processing unit IVU, comprising:
  • the capability reporting module is configured to report the capability set of the IVU to the IVW, and accept management and scheduling of the IVW;
  • a processing module configured to analyze and identify an image or video stream input to the IVU from the video monitoring system, and output the processing result to the IVW.
  • the processing module is further configured to: when the IVU is invoked by the IVW as an execution policy, acquire an image or a video stream from a destination indicated by the video monitoring system, analyze the input image or the video stream, and The processing is identified, and the processing result is output to the IVW.
  • the invention also provides a video processing method, the method comprising:
  • the intelligent management platform IVW saves and manages the capability set of the intelligent video processing unit IVU under its jurisdiction, and selects and calls the IVU that satisfies the capability requirements from the IVUs under the jurisdiction of the video surveillance system;
  • the IVU accepts the management and scheduling of the IVW, analyzes and identifies the image or video stream input to the IVU from the video surveillance system, and outputs the processing result to the IVW.
  • the method further includes: the IVW providing an intelligent application policy configuration service, and saving the configured smart application policy.
  • the method further includes: the IVW accepting a call from the video surveillance system to the IVW-preserved intelligent application policy, and feeding back the address of the IVU of the execution policy to the video surveillance system according to the saved IVU capability set.
  • the method further includes: the IVU executing the policy acquiring an image or video stream from the destination indicated by the video surveillance system, analyzing and identifying the input image or video stream, and outputting the processing result to the IVW.
  • the intelligent application policy saved by the IVW is called by the video surveillance platform CMS inside the video surveillance system, and the IVW feeds back the address of the IVU of the execution policy to the CMS, and the destination indicated by the CMS is the front-end PU inside the video surveillance system;
  • the IVU obtains an image or video stream from the PU indicated by the CMS as:
  • the IVU requests an image or video stream of the PU from a CMS, and the CMS forwards the request to a corresponding PU;
  • the PU returns a response message to the CMS, the CMS selects a video distribution unit VTDU that forwards an image or video stream, and sends the response message to the IVU;
  • the CMS notifies the selected VTDU of the address of the PU transmitting the image or video stream and the address of the IVU receiving the image or video stream;
  • a session is established between the PU and the IVU through the VTDU, and the image or video stream of the PU is forwarded to the IVU via the VTDU.
  • the intelligent application policy saved by the IVW is called by the CMS inside the video surveillance system, and the address of the IVU of the IVW feedback execution policy is given to the CMS, and the destination indicated by the CMS is the PU inside the video monitoring system;
  • the IVU obtains an image or video stream from the PU indicated by the CMS as:
  • the IVU requests an image or video stream of the PU from a CMS, and the CMS forwards the request to a corresponding PU;
  • the PU returns a response message to the CMS, and the CMS sends the response message to the IVU;
  • a session is established between the PU and the IVU, and the IVU receives an image or video stream sent by the PU.
  • the video processing method and system, the IVW and the IVU provided by the invention provide a video analysis and identification service in a flexible and configurable manner on the basis of the existing video monitoring system; and can flexibly select different video front end PUs
  • the video content is analyzed and identified, and the video analysis and recognition capabilities and results are uniformly provided in a flexible and configurable manner based on the existing video surveillance system.
  • Video processing service is DRAWINGS
  • FIG. 1 is a schematic structural diagram of a video processing system according to an embodiment of the present invention.
  • FIG. 2 is a flowchart of registering an IVU with an IVM in an embodiment of the present invention
  • FIG. 3 is a flowchart of a smart application policy configuration according to an embodiment of the present invention.
  • FIG. 4 is a flowchart of a video processing method according to an embodiment of the present invention.
  • FIG. 5 is a flowchart of acquiring an video surveillance image by an IVU according to an embodiment of the present invention.
  • FIG. 6 is a schematic structural diagram of an IVW according to an embodiment of the present invention.
  • FIG. 7 is a schematic structural diagram of an IVU according to an embodiment of the present invention. detailed description
  • a video processing system mainly includes: an intelligent management platform (IVM) and an intelligent video processing unit (IVU).
  • IVW is mainly used to save and manage the capability set of the IVU under its jurisdiction.
  • the IVU that meets the capability requirements is selected and called from the IVUs under its jurisdiction.
  • the IVU is mainly used to accept the management and scheduling of the IVW, analyze and identify the image or video stream input from the video surveillance system, and output the processing result to the IVW.
  • the IVW is further configured to provide an intelligent application policy configuration service, and save the configured smart application policy. Accept the IVU capability query and/or intelligent application policy query request of the video surveillance system, and feedback the query result to the video surveillance system.
  • the IVW accepts the call of the video monitoring system to the intelligent application policy saved by the IVW, and feeds back the address of the IVU of the execution strategy to the video monitoring system according to the saved IVU capability set.
  • the IVU as the execution strategy is called by the IVW
  • the image or video stream is acquired from the destination indicated by the video surveillance system, and the input image or video stream is analyzed and identified, and the processing knot is output.
  • the results of the image or video stream analysis and recognition process can also be output to the video surveillance system.
  • the video surveillance system mainly includes: a video surveillance platform (CMS), a video distribution unit (VTDU), a front end (PU), a client (CU), and a network storage unit (NRU).
  • CMS video surveillance platform
  • VTDU video distribution unit
  • PU front end
  • CU client
  • NRU network storage unit
  • CMS is the central management server of video surveillance system, which implements functions such as client/user management, front-end/platform equipment management, call control, management and service parameter configuration, content distribution, billing, virtual domain management and business process control. It can interface with 97/CRM system and billing system.
  • the VTDU is connected to the CMS, which is a media forwarding/distribution unit of the video surveillance system. It implements functions such as audio/video reception, forwarding, distribution, and billing data collection, and optionally implements multicast functions. Multiple levels of cascading, distributed deployment.
  • NRU connection VTDU is a network video storage unit in the video surveillance system, which implements functions such as receiving/storing audio/video, recording storage management, storage medium management, and video playback service.
  • the NRU must be able to connect to various physical storage devices such as Storage Area Network (SAN), Network Attached Storage (NAS), and Direct Attached Storage (DAS). NRU enables distributed deployment. NRU accepts the management of CMS.
  • SAN Storage Area Network
  • NAS Network Attached Storage
  • DAS Direct Attached Storage
  • the PU connects the CMS and the VTDU. It is the information collection terminal of the video surveillance system. It implements the collection function of video information, audio information, data information and alarm information, and has the bidirectional transmission function of voice information and data information. Some PUs can realize the storage function of audio and video recording. PUs usually include the following devices: front-end devices (video servers or DVRs, etc.), cameras, pan/tilt devices, alarm input and output devices, and so on.
  • the CU connects to the VTDU, which is the client application end of the video surveillance system, and realizes the presentation of video information, audio information, data information and alarm information to the user.
  • the CU also have the functions of device management and user management for the video surveillance system.
  • the CU can implement the configuration of the IVM, and can obtain the result after the IVU processing. The functions of the IVM and IVU are further described below.
  • the IVM is connected to the IVU and CMS, which is a central service platform network element. It can be deployed in a unified manner with the CMS and can be deployed independently.
  • CMS which is a central service platform network element. It can be deployed in a unified manner with the CMS and can be deployed independently.
  • the IVM has a CMS-oriented intelligent application call and feedback interface, which can realize the management of the IVU capability and support the IVU capability. Inquire.
  • the ability management of the IVU mainly includes: Accepting the ability of the IVU to report, save, manage, and schedule the capability information of the IVU under its jurisdiction.
  • the IVM also supports user intelligent application policy configuration, saves user-configured smart application policies, and supports intelligent application policy query.
  • the composition of the IVW is as shown in FIG. 6, and mainly includes: an IVU management scheduling module 61 and an analysis result saving module 62.
  • the IVU management scheduling module 61 is configured to save and manage the capability set of the administered IVU, select an IVU that meets the capability requirement from the administered IVR according to the request of the video monitoring system, and invoke the analysis result saving module 62, and connect the IVU management.
  • the scheduling module 61 is configured to receive an output result of the IVU analyzing and identifying the image or video stream input from the video surveillance system to the IVU, and save the result.
  • the IVW may further include: a policy management module 63, and a connection IVU management scheduling module 61, configured to provide a smart application policy configuration service, and save the configured smart application policy.
  • the policy management module 63 accepts the call of the video monitoring system to the IVW saved smart application policy, and notifies the IVU management scheduling module 61; the IVU management scheduling module 61 feeds back the execution strategy according to the invoked smart application policy and the saved IVU capability set.
  • the address of the IVU is given to the video surveillance system.
  • the IVU connects to the IVM and the VTDU. It is a central service platform network element. It can be deployed in a distributed manner. It can be deployed in a unified manner with the CMS and can be deployed independently. It can realize the required information from the input video or picture and output the recognition result to the IVM; it can also directly transmit the original information of the passenger flow intelligent statistics to the IVM.
  • composition of the IVU is as shown in FIG. 7, and mainly includes: a capability reporting module 71 and a processing module 72.
  • the capability reporting module 71 is configured to report the capability of the IVU to the IVW.
  • the management and scheduling of the IVW is accepted;
  • the processing module 72 is configured to analyze and identify the image or video stream input from the video surveillance system to the IVU, and output the processing result to the IVW.
  • the processing module 72 is further configured to: when the IVU is called by the IVW as the execution policy, acquire an image or a video stream from the destination indicated by the video monitoring system, analyze and identify the input image or the video stream, and output the processing result. Give IVW.
  • the IVU can report its capability set to the IVW for storage after the registration to the IVW is successful; correspondingly, when the IVW receives the request from the video surveillance system, according to its own storage The set of capabilities of the IVU, selecting the corresponding IVU that performs video analysis and recognition processing.
  • the IVW can also store the smart application policy configured by the user, and provide the query and modification service of the smart application policy; when receiving the request of the video monitoring system, query the stored smart application policy, and obtain the smart application policy according to the query, and itself
  • the intelligent application policy saved by the IVW is called by the CMS inside the video monitoring system, and the address of the IVU of the IVW feedback execution policy is given to the CMS, and the destination indicated by the CMS is the PU inside the video monitoring system. Then, correspondingly, the IVU obtains the video stream from the PU indicated by the CMS as:
  • the IVU requests the CMS to request an image or video stream of the PU, and the CMS forwards the request to the corresponding PU;
  • the PU returns a response message to the CMS, and the CMS selects a VTDU for forwarding the image or video stream, and sends the response message to the IVU;
  • the CMS notifies the selected VTDU of the address of the PU transmitting the image or video stream and the address of the IVU receiving the image or video stream;
  • a session is established between the PU and the IVU through the VTDU, and the PU image or video stream is forwarded to the IVU via the VTDU.
  • the IVU obtains the video stream from the PU indicated by the CMS, and may also be:
  • the IVU requests an image or video stream of the PU from the CMS, and the CMS forwards the request to the corresponding PU;
  • the PU returns a response message to the CMS, and the CMS sends a response message to the IVU;
  • a session is established between the PU and the IVU, and the IVU receives the image or video stream sent by the PU.
  • the video processing method implemented by the above video processing system mainly includes: IVW saves and manages the capability set of the administered IVR, and selects an IVU that satisfies the capability requirement from the administered IVR according to the request of the video monitoring system; and the IVU accepts the IVW. Management and scheduling, analyzing and identifying the image or video stream input from the video surveillance system to the IVU, and outputting the processing result to the IVW.
  • Step 201 The IVU sends a Register message to the IVM.
  • Step 202 The IVM authenticates the received registration message, and returns a registration success response to the IVU when the authentication succeeds, and step 203 is performed.
  • the IVM When the authentication fails, the IVM returns a registration failure response to the IVU, and the subsequent steps are no longer performed.
  • Step 203 After receiving the registration success response of the IVM, the IVU sends an option (OPTIONS ) message to the IVM, and the above “IV IV capability set; the capability set mainly includes: the name of the intelligent algorithm, the provider, and the restriction between the intelligent algorithms. Relationships and so on.
  • Step 204 The IVM feeds back the result (success or failure) of the capability set to the IVU.
  • the IVM saves the set of capabilities reported by the IVU.
  • Step 301 The CU where the user is located sends a login request to the CMS, where the iCU is a user interface provided to the CU.
  • Step 302 When the CU logs in successfully, the CMS returns a customized intelligent application policy set to the CU.
  • Steps 303 ⁇ 304 the CU invokes the corresponding intelligent application policy configuration interface (iCU), to the CMS Send a request to read an existing smart application policy configuration.
  • iCU intelligent application policy configuration interface
  • Step 305 The CMS sends a request to the IVM to read the CU's existing smart application policy configuration.
  • Step 306 The IVM searches for the existing smart application policy configuration of the CU, and returns the searched smart application policy configuration to the CMS through the response.
  • step 307 the CMS returns a response to the iCU.
  • Step 308 The user performs configuration and modification of the smart application policy on the iCU. After the configuration is complete, the iCU sends the configuration information to the CMS through the intelligent configuration request.
  • Step 309 The CMS sends the received configuration information to the IVM.
  • Step 310 The IVM saves configuration information corresponding to the smart application policy, and returns a response to the CMS.
  • Step 311 The CMS returns a response to the iCU.
  • the user can set which PUs are identified and analyzed, and process the presentation of the results, so that the CMS can control the execution and provide the required services to the users.
  • the following is a specific application of a video processing method.
  • the user needs to obtain the traffic flow of each mall.
  • the CU where the user is located may first select the relevant PU in the configuration process through the process shown in FIG. 3, and select an appropriate IVU for analysis and identification processing. Both are saved in IVW.
  • an application task is formed, that is, an AS; the AS can be stored in the CMS, or can be stored on a dedicated external storage device, or can be a remote application (supporting remote storage).
  • Figure 4 which mainly includes:
  • Step 401 The AS initiates a content identification request.
  • the selected PUs installed in different locations of the shopping mall perform content identification to identify the traffic information at different times.
  • Step 402 The request is submitted to the CMS, and the CMS initiates a request to the IVM to request the information about the IVU to be provided to the CMS, including: a list, an address, and the like of the IVU supporting the video identification function.
  • Step 403 The IVM returns information related to the IVU (list of IVUs, addresses, etc.) to the CMS.
  • Step 404 The CMS initiates an indication to the IVU in the list, and requests the IVU to initiate a video surveillance content acquisition request to the designated PU and process the same.
  • Step 405 The IVU follows the video monitoring process to obtain the video surveillance content of the specified PU.
  • the specific operation refer to the process shown in Figure 5 below.
  • Step 406 After obtaining the video monitoring content, the IVU identifies the video monitoring content to obtain the human traffic information.
  • Steps 407 ⁇ 409 the IVU will return the obtained human traffic information to the CU where the user is located via the IVM and CMS; the IVU can also directly return the human traffic information to the CMS, and then return to the CU where the user is located through the CMS.
  • Step 501 The IVU sends an INVITE message to the CMS to request a video stream of a video source (ie, PU).
  • a video source ie, PU
  • Step 502 The CMS sends an INVITE message to the corresponding PU.
  • Step 503 The PU processes the INVITE message, returns a 200 OK response to the CMS, and provides an SDP (Session Description Protocol) offer, which includes information such as a media format list supported by the PU and a PU address.
  • SDP Session Description Protocol
  • Step 504 After receiving the 200 OK response of the PU, the CMS selects a codec mode to be used according to the media format list supported by the PU, and selects a VTDU for forwarding the video stream (also allows the PU to directly send the video stream to the IVU. There is no need to select VTDU), and the SDP offer (ie, the codec mode used in the SDP offer and the VTDU address of the forwarded video stream) is modified accordingly, and the 200 OK response is forwarded to the IVU.
  • the CMS selects a codec mode to be used according to the media format list supported by the PU, and selects a VTDU for forwarding the video stream (also allows the PU to directly send the video stream to the IVU. There is no need to select VTDU), and the SDP offer (ie, the codec mode used in the SDP offer and the VTDU address of the forwarded video stream) is modified accordingly, and the 200 OK response is forwarded to the IVU.
  • Step 505 The IVU sends an acknowledgement (ACK) message to the CMS, where the ACK message carries an SDP Answer, including the address of the IVU.
  • ACK acknowledgement
  • Step 506 the CMS responds according to the SDP Answer and the 200 OK in the received ACK message.
  • the SDP offer should control the VTDU to forward the video stream between the PU and the IVU, that is, inform the VTDU to forward the source (PU address) and destination (IVU address) of the video. If the PU sends the video stream directly to the IVU, the CMS does not need to inform the VTDU without the participation of the VTDU.
  • Step 507 The CMS modifies the SDP Answer in the ACK message from the IVU, and sends an ACK message to the PU.
  • the SDP Answer includes the codec mode selected and the VTDU for forwarding the video stream (you can also let the PU send the video stream directly to the IVU, where SDP Answer does not include VTDU).
  • Step 508 a session is established between the PU and the IVU. If the VTDU is required to forward the video stream, the PU establishes a session with the IVU through the VTDU. If the VTDU is not required to forward the video stream (that is, the PU directly sends the video stream to the IVU), the PU establishes a session directly with the IVU.
  • the PU sends the video stream to the IVU via the VTDU; if the video stream is directly sent by the PU to the IVU, the VIDU does not need to pass.
  • the session between the PU and the IVU can be established according to the Real-time Transport Protocol (RTP) or the RTP Control Protocol (PTCP, RTP Control Protocol).
  • RTP Real-time Transport Protocol
  • PTCP RTP Control Protocol
  • Step 509 The IVU sends a BYE message to the CMS requesting to terminate the session.
  • Step 510 The CMS controls the VTDU to stop forwarding the video stream from the PU to the IVU. If the PU sends the video stream directly to the IVU, you do not need to do this.
  • Step 511 The CMS sends a BYE message to the PU, and the PU stops sending the video stream.
  • step 512 the PU returns a 200 OK response to the CMS.
  • step 513 the CMS forwards the 200 OK response to the IVU.
  • the present invention provides a video analysis and recognition service in a flexible and configurable manner on the basis of the existing video surveillance system; the video content of different PUs can be flexibly selected for analysis and recognition processing, based on the existing video.
  • the monitoring system unifies the video processing services that provide video analysis and recognition capabilities and results in a flexible and configurable manner.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Telephonic Communication Services (AREA)

Abstract

Disclosed are a video processing method and system, intelligent video management platform (IVM) and intelligent video processing unit (IVU), the system comprising the IVM and the IVU; the IVW is used to store and manage the capability set of administered IVUs, and according to the request of a video monitoring system, and from the administered IVUs, to select and invoke an IVU satisfying the capability requirement; the IVU is used to accept the management and scheduling of the IVW, to analyze and recognize the image or video stream inputted into the IVU from the video monitoring system, and to output the processed result to the IVW. The present invention superimposes a video analysis and recognition technology on the basis of an existing video monitoring system, thus providing video analysis and recognition service in a flexible and configurable manner.

Description

一种视频处理方法和系统、 IVW和 IVU 技术领域  Video processing method and system, IVW and IVU technical field

本发明涉及信息领域的视频监控技术和智能视频分析技术, 尤其涉及 一种视频处理方法和系统、 IVW和 IVU。 背景技术  The present invention relates to video surveillance technology and intelligent video analysis technology in the information field, and in particular to a video processing method and system, IVW and IVU. Background technique

目前, 视频监控系统是运营商的一个重要服务, 视频监控系统被大量 部署, 以此作为城市治安、 安全防护、 远程监控等服务的基础。  At present, the video surveillance system is an important service for operators. The video surveillance system is deployed in large quantities as the basis for services such as urban security, security protection, and remote monitoring.

智能视频( IV, Intelligent Video )技术源自计算机视觉( CV, Computer Vision )与人工智能(AI, Artificial Intelligent )的研究, 其发展目标在于在 图像与事件描述之间建立一种映射关系, 使计算机从纷繁的视频图像中分 辩、 识别出关键目标物体。 这一研究应用于安防视频监控系统将能借助计 算机强大的数据处理能力过滤掉图像中无用的或干扰信息, 自动分析、 抽 取视频源中的关键有用信息, 从而使传统的监控系统中的摄像机不但成为 人的眼睛, 也使 "智能视频分析" 计算机成为人的大脑, 并具有更为 "聪 明" 的学习思考方式。  Intelligent Video (IV) technology is derived from the research of Computer Vision (CV) and Artificial Intelligence (AI). Its development goal is to establish a mapping relationship between images and event descriptions. Identify and identify key target objects from a wide range of video images. This research applied to the security video surveillance system will be able to use the powerful data processing capabilities of the computer to filter out useless or interference information in the image, automatically analyze and extract key useful information in the video source, so that the camera in the traditional monitoring system not only Being a human eye also makes the "smart video analysis" computer a human brain and has a more "smart" way of learning and thinking.

随着视频分析和处理技术的进一步提升, 目前已有的相关技术已经能 够对视频内容进行较为准确的识别和分析。 然而, 如何在现有视频监控系 统的基础上叠加视频分析识别技术, 实现以灵活的、 可配置的方式提供视 频分析识别服务, 这是目前亟待解决的问题。 发明内容  With the further enhancement of video analysis and processing technology, the existing related technologies have been able to accurately identify and analyze video content. However, how to superimpose the video analysis and recognition technology based on the existing video surveillance system to provide the video analysis and recognition service in a flexible and configurable manner is an urgent problem to be solved. Summary of the invention

有鉴于此,本发明的主要目的在于提供一种视频处理方法和系统、 IVW 和 IVU, 以实现在现有视频监控系统的基础上叠加视频分析识别技术, 实 现以灵活的、 可配置的方式提供视频分析识别服务。 In view of this, the main object of the present invention is to provide a video processing method and system, IVW and IVU, to implement superimposed video analysis and recognition technology based on an existing video monitoring system. Video analytics identification services are now available in a flexible, configurable manner.

为达到上述目的, 本发明的技术方案是这样实现的:  In order to achieve the above object, the technical solution of the present invention is achieved as follows:

本发明提供了一种视频处理系统, 该系统包括: 智能管理平台 IVM和 智能视频处理单元 IVU,  The invention provides a video processing system, comprising: an intelligent management platform IVM and an intelligent video processing unit IVU,

所述 IVW, 用于保存和管理所辖 IVU的能力集, 根据视频监控系统的 请求, 从所辖 IVU中选择满足能力要求的 IVU并调用;  The IVW is used to save and manage the capability set of the IVU under the jurisdiction, and according to the request of the video monitoring system, select an IVU that meets the capability requirement from the IVU under the jurisdiction and call it;

所述 IVU, 用于接受所述 IVW的管理和调度, 对从所述视频监控系统 输入 IVU 的图像或视频流进行分析和识别处理, 并输出处理结果给所述 IVW。  The IVU is configured to accept management and scheduling of the IVW, analyze and identify an image or video stream input from the video surveillance system, and output a processing result to the IVW.

所述 IVW进一步用于, 提供智能应用策略配置服务, 保存配置的智能 应用策略。  The IVW is further configured to provide an intelligent application policy configuration service, and save the configured intelligent application policy.

所述 IVW进一步用于, 接受视频监控系统对所述 IVW保存的智能应 用策略的调用, 并根据保存的 IVU的能力集反馈执行策略的 IVU的地址给 所述视频监控系统。  The IVW is further configured to receive a call from the video surveillance system to the IVW-supplied smart application policy, and feed back the address of the IVU of the execution policy to the video surveillance system according to the saved IVU capability set.

所述 IVU进一步用于, 当作为执行策略的 IVU被所述 IVW调用时, 从所述视频监控系统指示的目的地获取图像或视频流, 对输入的图像或视 频流进行分析和识别处理, 并输出处理结果给所述 IVW。  The IVU is further configured to: when an IVU as an execution policy is invoked by the IVW, acquire an image or a video stream from a destination indicated by the video monitoring system, analyze and identify an input image or a video stream, and The processing result is output to the IVW.

本发明还提供了一种智能管理平台 IVW, 包括:  The invention also provides an intelligent management platform IVW, comprising:

IVU管理调度模块, 用于保存和管理所辖智能视频处理单元 IVU的能 力集, 根据视频监控系统的请求, 从所辖 IVU中选择满足能力要求的 IVU 并调用;  The IVU management scheduling module is configured to save and manage the capability set of the intelligent video processing unit IVU, and select an IVU that meets the capability requirement from the IVU under the control according to the request of the video monitoring system;

分析结果保存模块, 用于接收所述 IVU对从所述视频监控系统输入 IVU的图像或视频流进行分析和识别处理的输出结果, 并保存。  The analysis result saving module is configured to receive an output result of the IVU analyzing and identifying the image or video stream input to the IVU from the video monitoring system, and save the result.

所述 IVW进一步包括: 策略管理模块, 用于提供智能应用策略配置服 务, 保存配置的智能应用策略。 所述策略管理模块进一步用于, 接受视频监控系统对所述 IVW保存的 智能应用策略的调用, 并通知所述 IVU管理调度模块; The IVW further includes: a policy management module, configured to provide a smart application policy configuration service, and save the configured smart application policy. The policy management module is further configured to: accept a call of the video monitoring system to the IVW saved smart application policy, and notify the IVU management scheduling module;

所述 IVU管理调度模块进一步用于, 根据所调用的智能应用策略、 以 及保存的 IVU的能力集,反馈执行策略的 IVU的地址给所述视频监控系统。  The IVU management scheduling module is further configured to: feed back an address of the IVU of the execution policy to the video monitoring system according to the invoked smart application policy and the saved capability set of the IVU.

本发明还提供了一种智能视频处理单元 IVU, 包括:  The invention also provides an intelligent video processing unit IVU, comprising:

能力上报模块, 用于向 IVW上报所述 IVU的能力集, 接受所述 IVW 的管理和调度;  The capability reporting module is configured to report the capability set of the IVU to the IVW, and accept management and scheduling of the IVW;

处理模块, 用于对从所述视频监控系统输入 IVU的图像或视频流进行 分析和识别处理, 并输出处理结果给所述 IVW。  And a processing module, configured to analyze and identify an image or video stream input to the IVU from the video monitoring system, and output the processing result to the IVW.

所述处理模块进一步用于, 当所述 IVU作为执行策略的 IVU被所述 IVW调用时, 从所述视频监控系统指示的目的地获取图像或视频流, 对输 入的图像或视频流进行分析和识别处理, 并输出处理结果给所述 IVW。  The processing module is further configured to: when the IVU is invoked by the IVW as an execution policy, acquire an image or a video stream from a destination indicated by the video monitoring system, analyze the input image or the video stream, and The processing is identified, and the processing result is output to the IVW.

本发明还提供了一种视频处理方法, 该方法包括:  The invention also provides a video processing method, the method comprising:

智能管理平台 IVW保存和管理所辖智能视频处理单元 IVU的能力集, 根据视频监控系统的请求,从所辖 IVU中选择满足能力要求的 IVU并调用; The intelligent management platform IVW saves and manages the capability set of the intelligent video processing unit IVU under its jurisdiction, and selects and calls the IVU that satisfies the capability requirements from the IVUs under the jurisdiction of the video surveillance system;

IVU接受所述 IVW的管理和调度,对从所述视频监控系统输入 IVU的 图像或视频流进行分析和识别处理, 并输出处理结果给所述 IVW。 The IVU accepts the management and scheduling of the IVW, analyzes and identifies the image or video stream input to the IVU from the video surveillance system, and outputs the processing result to the IVW.

该方法进一步包括: 所述 IVW提供智能应用策略配置服务, 保存配置 的智能应用策略。  The method further includes: the IVW providing an intelligent application policy configuration service, and saving the configured smart application policy.

该方法进一步包括: 所述 IVW接受视频监控系统对所述 IVW保存的 智能应用策略的调用, 并根据保存的 IVU的能力集反馈执行策略的 IVU的 地址给所述视频监控系统。  The method further includes: the IVW accepting a call from the video surveillance system to the IVW-preserved intelligent application policy, and feeding back the address of the IVU of the execution policy to the video surveillance system according to the saved IVU capability set.

该方法进一步包括: 执行策略的 IVU从所述视频监控系统指示的目的 地获取图像或视频流, 对输入的图像或视频流进行分析和识别处理, 并输 出处理结果给所述 IVW。 IVW保存的智能应用策略由视频监控系统内部的视频监控平台 CMS 调用, IVW反馈执行策略的 IVU的地址给所述 CMS, CMS指示的目的地 为视频监控系统内部的前端 PU; The method further includes: the IVU executing the policy acquiring an image or video stream from the destination indicated by the video surveillance system, analyzing and identifying the input image or video stream, and outputting the processing result to the IVW. The intelligent application policy saved by the IVW is called by the video surveillance platform CMS inside the video surveillance system, and the IVW feeds back the address of the IVU of the execution policy to the CMS, and the destination indicated by the CMS is the front-end PU inside the video surveillance system;

相应的, IVU从 CMS指示的 PU获取图像或视频流为:  Correspondingly, the IVU obtains an image or video stream from the PU indicated by the CMS as:

所述 IVU向 CMS请求所述 PU的图像或视频流, 所述 CMS转发所述 请求到相应的 PU;  The IVU requests an image or video stream of the PU from a CMS, and the CMS forwards the request to a corresponding PU;

所述 PU返回响应消息给所述 CMS ,所述 CMS选择转发图像或视频流 的视频分发单元 VTDU, 并发送所述响应消息给所述 IVU;  The PU returns a response message to the CMS, the CMS selects a video distribution unit VTDU that forwards an image or video stream, and sends the response message to the IVU;

所述 CMS将发送图像或视频流的 PU的地址、 以及接收图像或视频流 的 IVU的地址告知所选的 VTDU;  The CMS notifies the selected VTDU of the address of the PU transmitting the image or video stream and the address of the IVU receiving the image or video stream;

所述 PU与 IVU之间通过 VTDU建立会话, PU的图像或视频流经由 VTDU转发到 IVU。  A session is established between the PU and the IVU through the VTDU, and the image or video stream of the PU is forwarded to the IVU via the VTDU.

IVW保存的智能应用策略由视频监控系统内部的 CMS调用, IVW反 馈执行策略的 IVU的地址给所述 CMS , CMS指示的目的地为视频监控系 统内部的 PU;  The intelligent application policy saved by the IVW is called by the CMS inside the video surveillance system, and the address of the IVU of the IVW feedback execution policy is given to the CMS, and the destination indicated by the CMS is the PU inside the video monitoring system;

相应的, IVU从 CMS指示的 PU获取图像或视频流为:  Correspondingly, the IVU obtains an image or video stream from the PU indicated by the CMS as:

所述 IVU向 CMS请求所述 PU的图像或视频流, 所述 CMS转发所述 请求到相应的 PU;  The IVU requests an image or video stream of the PU from a CMS, and the CMS forwards the request to a corresponding PU;

所述 PU返回响应消息给所述 CMS ,所述 CMS发送所述响应消息给所 述 IVU;  The PU returns a response message to the CMS, and the CMS sends the response message to the IVU;

所述 PU与 IVU之间建立会话, IVU接收 PU发送的图像或视频流。 本发明所提供的一种视频处理方法和系统、 IVW和 IVU, 在现有视频 监控系统的基础上, 实现了以灵活的、 可配置的方式提供视频分析识别服 务; 可灵活选择不同视频前端 PU的视频内容进行分析识别处理,基于现有 视频监控体系以灵活的、 可配置的方式统一提供视频分析识别能力和结果 的视频处理服务。 附图说明 A session is established between the PU and the IVU, and the IVU receives an image or video stream sent by the PU. The video processing method and system, the IVW and the IVU provided by the invention provide a video analysis and identification service in a flexible and configurable manner on the basis of the existing video monitoring system; and can flexibly select different video front end PUs The video content is analyzed and identified, and the video analysis and recognition capabilities and results are uniformly provided in a flexible and configurable manner based on the existing video surveillance system. Video processing service. DRAWINGS

图 1为本发明实施例的一种视频处理系统的结构示意图;  1 is a schematic structural diagram of a video processing system according to an embodiment of the present invention;

图 2为本发明实施例中 IVU向 IVM注册的流程图;  2 is a flowchart of registering an IVU with an IVM in an embodiment of the present invention;

图 3为本发明实施例中智能应用策略配置的流程图;  3 is a flowchart of a smart application policy configuration according to an embodiment of the present invention;

图 4为本发明实施例的一种视频处理方法的流程图;  4 is a flowchart of a video processing method according to an embodiment of the present invention;

图 5为本发明实施例中 IVU获取视频监控图像的流程图;  FIG. 5 is a flowchart of acquiring an video surveillance image by an IVU according to an embodiment of the present invention; FIG.

图 6为本发明实施例中 IVW的结构示意图;  6 is a schematic structural diagram of an IVW according to an embodiment of the present invention;

图 7为本发明实施例中 IVU的结构示意图。 具体实施方式  FIG. 7 is a schematic structural diagram of an IVU according to an embodiment of the present invention. detailed description

下面结合附图和具体实施例对本发明的技术方案进一步详细阐述。 本发明实施例所提供的一种视频处理系统, 如图 1 所示, 主要包括: 智能管理平台 (IVM )和智能视频处理单元(IVU )。 其中, IVW主要用于 保存和管理所辖 IVU的能力集, 根据视频监控系统的请求, 从所辖 IVU中 选择满足能力要求的 IVU并调用。 IVU主要用于接受 IVW的管理和调度, 对从视频监控系统输入 IVU的图像或视频流进行分析和识别处理, 并输出 处理结果给 IVW。  The technical solutions of the present invention are further elaborated below in conjunction with the accompanying drawings and specific embodiments. A video processing system according to an embodiment of the present invention, as shown in FIG. 1, mainly includes: an intelligent management platform (IVM) and an intelligent video processing unit (IVU). Among them, IVW is mainly used to save and manage the capability set of the IVU under its jurisdiction. According to the request of the video surveillance system, the IVU that meets the capability requirements is selected and called from the IVUs under its jurisdiction. The IVU is mainly used to accept the management and scheduling of the IVW, analyze and identify the image or video stream input from the video surveillance system, and output the processing result to the IVW.

较佳的, IVW还可用于, 提供智能应用策略配置服务, 保存配置的智 能应用策略。接受视频监控系统的 IVU能力查询和 /或智能应用策略查询请 求, 并反馈查询结果给视频监控系统。  Preferably, the IVW is further configured to provide an intelligent application policy configuration service, and save the configured smart application policy. Accept the IVU capability query and/or intelligent application policy query request of the video surveillance system, and feedback the query result to the video surveillance system.

IVW接受视频监控系统对 IVW保存的智能应用策略的调用,并根据保 存的 IVU的能力集反馈执行策略的 IVU的地址给视频监控系统。 IVU作为 执行策略的 IVU被所述 IVW调用时,从视频监控系统指示的目的地获取图 像或视频流, 对输入的图像或视频流进行分析和识别处理, 并输出处理结 果给 IVW。 图像或视频流分析和识别处理的结果还可以输出给视频监控系 统。 The IVW accepts the call of the video monitoring system to the intelligent application policy saved by the IVW, and feeds back the address of the IVU of the execution strategy to the video monitoring system according to the saved IVU capability set. When the IVU as the execution strategy is called by the IVW, the image or video stream is acquired from the destination indicated by the video surveillance system, and the input image or video stream is analyzed and identified, and the processing knot is output. Give IVW. The results of the image or video stream analysis and recognition process can also be output to the video surveillance system.

视频监控系统主要包括:视频监控平台( CMS )、视频分发单元( VTDU )、 前端 (PU )、 客户端 (CU )和网络存储单元(NRU )。  The video surveillance system mainly includes: a video surveillance platform (CMS), a video distribution unit (VTDU), a front end (PU), a client (CU), and a network storage unit (NRU).

其中, CMS是视频监控系统的中心管理服务器, 实现客户 /用户管理、 前端 /平台设备管理、 呼叫控制、 管理和业务参数配置、 内容发布、 计费、 虚拟域管理及业务处理控制等功能。 可实现与 97/CRM 系统、 计费系统的 接口。  Among them, CMS is the central management server of video surveillance system, which implements functions such as client/user management, front-end/platform equipment management, call control, management and service parameter configuration, content distribution, billing, virtual domain management and business process control. It can interface with 97/CRM system and billing system.

VTDU连接 CMS, 是视频监控系统的媒体转发 /分发单元, 实现对音频 /视频接收、 转发、 分发及计费数据釆集等功能, 并可选择实现组播功能。 可多级级联、 分布式部署。  The VTDU is connected to the CMS, which is a media forwarding/distribution unit of the video surveillance system. It implements functions such as audio/video reception, forwarding, distribution, and billing data collection, and optionally implements multicast functions. Multiple levels of cascading, distributed deployment.

NRU连接 VTDU, 是视频监控系统中的网络录像存储单元, 实现对音 频 /视频的接收存储、 录像存储管理、存储介质管理及录像回放服务等功能。  NRU connection VTDU is a network video storage unit in the video surveillance system, which implements functions such as receiving/storing audio/video, recording storage management, storage medium management, and video playback service.

NRU必须可连接存储区域网络(SAN )、 网络连接存储(NAS )、 直接连接 存储(DAS )等各类物理存储设备。 NRU 可实现分布式部署。 NRU接受 CMS的管理。 The NRU must be able to connect to various physical storage devices such as Storage Area Network (SAN), Network Attached Storage (NAS), and Direct Attached Storage (DAS). NRU enables distributed deployment. NRU accepts the management of CMS.

PU连接 CMS和 VTDU, 是视频监控系统的信息釆集端, 实现视频信 息、 音频信息、 数据信息及告警信息的釆集功能, 具有语音信息和数据信 息的双向传送功能。 部分 PU可实现音视频录像的存储功能。 PU通常包括 如下设备: 前端设备(视频服务器或 DVR等)、 摄像机、 云台设备、 报警 输入输出设备等。  The PU connects the CMS and the VTDU. It is the information collection terminal of the video surveillance system. It implements the collection function of video information, audio information, data information and alarm information, and has the bidirectional transmission function of voice information and data information. Some PUs can realize the storage function of audio and video recording. PUs usually include the following devices: front-end devices (video servers or DVRs, etc.), cameras, pan/tilt devices, alarm input and output devices, and so on.

CU连接 VTDU, 是视频监控系统的客户应用端, 实现视频信息、 音频 信息、 数据信息及告警信息对用户的呈现。 根据客户端类型的不同, 部分 CU还具备对视频监控系统的设备管理、 用户管理等功能。 在本发明的实施 例中, CU可以实现对 IVM的配置, 并可以获取到 IVU处理后的结果。 下面进一步介绍 IVM和 IVU的功能。 The CU connects to the VTDU, which is the client application end of the video surveillance system, and realizes the presentation of video information, audio information, data information and alarm information to the user. Depending on the type of client, some CUs also have the functions of device management and user management for the video surveillance system. In the embodiment of the present invention, the CU can implement the configuration of the IVM, and can obtain the result after the IVU processing. The functions of the IVM and IVU are further described below.

IVM连接 IVU和 CMS , 属中心服务平台网元, 物理上可与 CMS统一 部署, 亦可独立部署; IVM具有面向的 CMS的智能应用调用和反馈接口, 可实现对 IVU能力的管理, 支持 IVU能力查询。 其中, 对 IVU的能力管理 主要包括: 接受 IVU的能力上报,保存、 管理、调度所辖 IVU的能力信息。 此外, IVM还支持用户智能应用策略配置, 保存用户配置的智能应用策略, 支持智能应用策略查询。  The IVM is connected to the IVU and CMS, which is a central service platform network element. It can be deployed in a unified manner with the CMS and can be deployed independently. The IVM has a CMS-oriented intelligent application call and feedback interface, which can realize the management of the IVU capability and support the IVU capability. Inquire. Among them, the ability management of the IVU mainly includes: Accepting the ability of the IVU to report, save, manage, and schedule the capability information of the IVU under its jurisdiction. In addition, the IVM also supports user intelligent application policy configuration, saves user-configured smart application policies, and supports intelligent application policy query.

进一步的, IVW的组成结构如图 6所示, 主要包括: IVU管理调度模 块 61和分析结果保存模块 62。 其中, IVU管理调度模块 61 , 用于保存和 管理所辖 IVU的能力集, 根据视频监控系统的请求, 从所辖 IVU中选择满 足能力要求的 IVU并调用; 分析结果保存模块 62, 连接 IVU管理调度模块 61 , 用于接收 IVU对从视频监控系统输入 IVU的图像或视频流进行分析和 识别处理的输出结果, 并保存。  Further, the composition of the IVW is as shown in FIG. 6, and mainly includes: an IVU management scheduling module 61 and an analysis result saving module 62. The IVU management scheduling module 61 is configured to save and manage the capability set of the administered IVU, select an IVU that meets the capability requirement from the administered IVR according to the request of the video monitoring system, and invoke the analysis result saving module 62, and connect the IVU management. The scheduling module 61 is configured to receive an output result of the IVU analyzing and identifying the image or video stream input from the video surveillance system to the IVU, and save the result.

IVW还可进一步包括: 策略管理模块 63 , 连接 IVU管理调度模块 61 , 用于提供智能应用策略配置服务, 保存配置的智能应用策略。  The IVW may further include: a policy management module 63, and a connection IVU management scheduling module 61, configured to provide a smart application policy configuration service, and save the configured smart application policy.

策略管理模块 63接受视频监控系统对 IVW保存的智能应用策略的调 用, 并通知 IVU管理调度模块 61 ; IVU管理调度模块 61根据所调用的智 能应用策略、 以及保存的 IVU的能力集, 反馈执行策略的 IVU的地址给视 频监控系统。  The policy management module 63 accepts the call of the video monitoring system to the IVW saved smart application policy, and notifies the IVU management scheduling module 61; the IVU management scheduling module 61 feeds back the execution strategy according to the invoked smart application policy and the saved IVU capability set. The address of the IVU is given to the video surveillance system.

IVU连接 IVM和 VTDU, 属中心服务平台网元, 可分布式部署, 物理 上可与 CMS统一部署, 亦可独立部署。 可实现从输入的视频或图片中识别 所需信息, 并输出识别结果给 IVM; 也可以直接传递客流智能统计原始信 息给 IVM。  The IVU connects to the IVM and the VTDU. It is a central service platform network element. It can be deployed in a distributed manner. It can be deployed in a unified manner with the CMS and can be deployed independently. It can realize the required information from the input video or picture and output the recognition result to the IVM; it can also directly transmit the original information of the passenger flow intelligent statistics to the IVM.

进一步的, IVU的组成结构如图 7所示, 主要包括: 能力上报模块 71 和处理模块 72。 其中, 能力上报模块 71 , 用于向 IVW上报 IVU的能力集, 接受 IVW的管理和调度; 处理模块 72 , 用于对从视频监控系统输入 IVU 的图像或视频流进行分析和识别处理, 并输出处理结果给 IVW。 Further, the composition of the IVU is as shown in FIG. 7, and mainly includes: a capability reporting module 71 and a processing module 72. The capability reporting module 71 is configured to report the capability of the IVU to the IVW. The management and scheduling of the IVW is accepted; the processing module 72 is configured to analyze and identify the image or video stream input from the video surveillance system to the IVU, and output the processing result to the IVW.

处理模块 72进一步用于,当 IVU作为执行策略的 IVU被 IVW调用时, 从视频监控系统指示的目的地获取图像或视频流, 对输入的图像或视频流 进行分析和识别处理, 并输出处理结果给 IVW。  The processing module 72 is further configured to: when the IVU is called by the IVW as the execution policy, acquire an image or a video stream from the destination indicated by the video monitoring system, analyze and identify the input image or the video stream, and output the processing result. Give IVW.

在图 1所示的视频处理系统中, IVU可在向 IVW的注册成功后, 将自 身的能力集上报给 IVW进行存储; 相应的, IVW在收到视频监控系统的请 求时, 根据自身存储的 IVU的能力集, 选择执行视频分析和识别处理的相 应 IVU。  In the video processing system shown in FIG. 1, the IVU can report its capability set to the IVW for storage after the registration to the IVW is successful; correspondingly, when the IVW receives the request from the video surveillance system, according to its own storage The set of capabilities of the IVU, selecting the corresponding IVU that performs video analysis and recognition processing.

IVW还可以存储用户配置的智能应用策略, 并提供智能应用策略的查 询和修改服务; 在收到视频监控系统的请求时, 查询存储的相应智能应用 策略, 并根据查询所得智能应用策略、 以及自身存储的 IVU的能力集, 选 择执行视频分析和识别处理的相应 IVU。  The IVW can also store the smart application policy configured by the user, and provide the query and modification service of the smart application policy; when receiving the request of the video monitoring system, query the stored smart application policy, and obtain the smart application policy according to the query, and itself The set of stored IVU capabilities, select the corresponding IVU that performs video analysis and recognition processing.

在图 1所示的视频处理系统中, IVW保存的智能应用策略由视频监控 系统内部的 CMS调用, IVW反馈执行策略的 IVU的地址给 CMS, CMS 指示的目的地为视频监控系统内部的 PU时, 那么相应的, IVU从 CMS指 示的 PU获取视频流为:  In the video processing system shown in FIG. 1, the intelligent application policy saved by the IVW is called by the CMS inside the video monitoring system, and the address of the IVU of the IVW feedback execution policy is given to the CMS, and the destination indicated by the CMS is the PU inside the video monitoring system. Then, correspondingly, the IVU obtains the video stream from the PU indicated by the CMS as:

IVU向 CMS请求 PU的图像或视频流, CMS转发该请求到相应的 PU; The IVU requests the CMS to request an image or video stream of the PU, and the CMS forwards the request to the corresponding PU;

PU返回响应消息给 CMS, CMS选择转发图像或视频流的 VTDU, 并 发送所述响应消息给 IVU; The PU returns a response message to the CMS, and the CMS selects a VTDU for forwarding the image or video stream, and sends the response message to the IVU;

CMS将发送图像或视频流的 PU的地址、以及接收图像或视频流的 IVU 的地址告知所选的 VTDU;  The CMS notifies the selected VTDU of the address of the PU transmitting the image or video stream and the address of the IVU receiving the image or video stream;

PU与 IVU之间通过 VTDU建立会话, PU的图像或视频流经由 VTDU 转发到 IVU。  A session is established between the PU and the IVU through the VTDU, and the PU image or video stream is forwarded to the IVU via the VTDU.

IVU从 CMS指示的 PU获取视频流也可以为: IVU向 CMS请求 PU的图像或视频流, CMS转发该请求到相应的 PU;The IVU obtains the video stream from the PU indicated by the CMS, and may also be: The IVU requests an image or video stream of the PU from the CMS, and the CMS forwards the request to the corresponding PU;

PU返回响应消息给 CMS , CMS发送响应消息给 IVU; The PU returns a response message to the CMS, and the CMS sends a response message to the IVU;

PU与 IVU之间建立会话, IVU接收 PU发送的图像或视频流。  A session is established between the PU and the IVU, and the IVU receives the image or video stream sent by the PU.

由上述视频处理系统实现的视频处理方法, 主要包括: IVW保存和管 理所辖 IVU的能力集, 根据视频监控系统的请求, 从所辖 IVU中选择满足 能力要求的 IVU并调用; IVU接受 IVW的管理和调度,对从视频监控系统 输入 IVU的图像或视频流进行分析和识别处理, 并输出处理结果给 IVW。  The video processing method implemented by the above video processing system mainly includes: IVW saves and manages the capability set of the administered IVR, and selects an IVU that satisfies the capability requirement from the administered IVR according to the request of the video monitoring system; and the IVU accepts the IVW. Management and scheduling, analyzing and identifying the image or video stream input from the video surveillance system to the IVU, and outputting the processing result to the IVW.

下面介绍 IVU向 IVM注册能力的流程, 如图 2所示, 主要包括: 步骤 201 , IVU发送注册( Register ) 消息到 IVM。  The process of registering the IVU with the IVM is as follows. As shown in FIG. 2, the method mainly includes: Step 201: The IVU sends a Register message to the IVM.

步骤 202, IVM对接收的注册消息进行鉴权认证, 并在认证成功时向 IVU返回注册成功响应 , 执行步骤 203。  Step 202: The IVM authenticates the received registration message, and returns a registration success response to the IVU when the authentication succeeds, and step 203 is performed.

在认证失败时, IVM向 IVU返回注册失败响应, 后续操作步骤不再执 行。  When the authentication fails, the IVM returns a registration failure response to the IVU, and the subsequent steps are no longer performed.

步骤 203 , IVU 收到 IVM 的注册成功响应后, 向 IVM 发送选项 ( OPTIONS ) 消息, 以上 "^ IVU的能力集; 该能力集主要包括: 智能算法 的名称、 提供商、 智能算法之间的制约关系等等。  Step 203: After receiving the registration success response of the IVM, the IVU sends an option ( OPTIONS ) message to the IVM, and the above “IV IV capability set; the capability set mainly includes: the name of the intelligent algorithm, the provider, and the restriction between the intelligent algorithms. Relationships and so on.

步骤 204, IVM向 IVU反馈能力集的上报结果(成功或失败)。 当上报 结果为成功时, IVM对 IVU上报的能力集进行保存。  Step 204: The IVM feeds back the result (success or failure) of the capability set to the IVU. When the reported result is successful, the IVM saves the set of capabilities reported by the IVU.

下面介绍用户通过 CU在 IVM上进行智能应用策略配置的流程, 如图 3所示, 主要包括:  The following describes the process of configuring the smart application policy on the IVM through the CU. As shown in Figure 3, it mainly includes:

步骤 301 , 用户所在的 CU向 CMS发送登录请求, 其中, iCU为提供 给 CU的用户界面。  Step 301: The CU where the user is located sends a login request to the CMS, where the iCU is a user interface provided to the CU.

步骤 302,在 CU登录成功时, CMS向 CU返回其用户定制的智能应用 策略集。  Step 302: When the CU logs in successfully, the CMS returns a customized intelligent application policy set to the CU.

步骤 303~304, CU调用相应的智能应用策略配置界面(iCU ), 向 CMS 发送读取已有智能应用策略配置的请求。 Steps 303~304, the CU invokes the corresponding intelligent application policy configuration interface (iCU), to the CMS Send a request to read an existing smart application policy configuration.

步骤 305 , CMS向 IVM发送读取 CU已有智能应用策略配置的请求。 步骤 306, IVM查找该 CU已有的智能应用策略配置,并将查找所得的 智能应用策略配置通过响应返回给 CMS。  Step 305: The CMS sends a request to the IVM to read the CU's existing smart application policy configuration. Step 306: The IVM searches for the existing smart application policy configuration of the CU, and returns the searched smart application policy configuration to the CMS through the response.

步骤 307, CMS将响应返回给 iCU。  In step 307, the CMS returns a response to the iCU.

步骤 308, 用户在 iCU执行智能应用策略的相关配置和修改, 在配置 完成后, iCU将配置信息通过智能配置请求发送给 CMS。  Step 308: The user performs configuration and modification of the smart application policy on the iCU. After the configuration is complete, the iCU sends the configuration information to the CMS through the intelligent configuration request.

步骤 309, CMS将接收的配置信息发送给 IVM。  Step 309: The CMS sends the received configuration information to the IVM.

步骤 310, IVM保存对应智能应用策略的配置信息, 并向 CMS返回响 应。  Step 310: The IVM saves configuration information corresponding to the smart application policy, and returns a response to the CMS.

步骤 311 , CMS返回响应给 iCU。  Step 311: The CMS returns a response to the iCU.

通过配置, 用户可以设置对哪些 PU进行怎样的识别和分析处理, 处理 结果的展示形式, 以让 CMS来控制执行, 向用户提供所需的服务。  Through configuration, the user can set which PUs are identified and analyzed, and process the presentation of the results, so that the CMS can control the execution and provide the required services to the users.

下面再结合一种视频处理方法的具体应用。 例如, 用户需要获取各个 商场的人流量情况,该用户所在的 CU可以先通过图 3所示流程,在配置过 程中选择相关的 PU, 并选择合适的 IVU来进行分析和识别处理, 这些配置 信息都保存在 IVW 中。 配置完成后, 形成了一个应用任务, 即成为一个 AS; 该 AS可以存储在 CMS中, 也可以存储在专门的外接存储设备上, 还 可以是远程的应用 (支持远程存储)。 具体实施的过程如图 4所示, 主要包 括:  The following is a specific application of a video processing method. For example, the user needs to obtain the traffic flow of each mall. The CU where the user is located may first select the relevant PU in the configuration process through the process shown in FIG. 3, and select an appropriate IVU for analysis and identification processing. Both are saved in IVW. After the configuration is completed, an application task is formed, that is, an AS; the AS can be stored in the CMS, or can be stored on a dedicated external storage device, or can be a remote application (supporting remote storage). The specific implementation process is shown in Figure 4, which mainly includes:

步骤 401 , AS发起内容识别请求, 在本实施例中, 即对选定的安装在 商场不同位置的 PU进行内容识别, 以识别出不同时间的人流量信息。  Step 401: The AS initiates a content identification request. In this embodiment, the selected PUs installed in different locations of the shopping mall perform content identification to identify the traffic information at different times.

步骤 402, 该请求提交到 CMS, CMS向 IVM发起请求, 请求将 IVU 的相关信息提供给 CMS , 主要包括: 支持视频识别功能的 IVU的列表、 地 址等信息。 步骤 403 , IVM向 CMS返回 IVU的相关信息( IVU的列表、地址等)。 步骤 404, CMS向列表中的 IVU发起指示, 要求这些 IVU向指定的 PU发起视频监控内容获取请求并处理。 Step 402: The request is submitted to the CMS, and the CMS initiates a request to the IVM to request the information about the IVU to be provided to the CMS, including: a list, an address, and the like of the IVU supporting the video identification function. Step 403: The IVM returns information related to the IVU (list of IVUs, addresses, etc.) to the CMS. Step 404: The CMS initiates an indication to the IVU in the list, and requests the IVU to initiate a video surveillance content acquisition request to the designated PU and process the same.

步骤 405 , IVU遵循视频监控流程, 获取指定 PU的视频监控内容, 具 体操作参见后续图 5所示流程。  Step 405: The IVU follows the video monitoring process to obtain the video surveillance content of the specified PU. For the specific operation, refer to the process shown in Figure 5 below.

步骤 406, IVU获取到视频监控内容后, 对该视频监控内容进行识别, 得到人流量信息。  Step 406: After obtaining the video monitoring content, the IVU identifies the video monitoring content to obtain the human traffic information.

步骤 407~409 , IVU将得到的人流量信息经由 IVM、 CMS返回给用户 所在的 CU; IVU也可以将人流量信息直接返回给 CMS, 再通过 CMS返回 给用户所在的 CU。  Steps 407~409, the IVU will return the obtained human traffic information to the CU where the user is located via the IVM and CMS; the IVU can also directly return the human traffic information to the CMS, and then return to the CU where the user is located through the CMS.

下面结合图 5 , 详细说明 IVU获取视频监控图像的流程, 主要包括: 步骤 501 , IVU发送邀请 ( INVITE )消息给 CMS,请求某个视频源(即 PU ) 的视频流。  The process of acquiring the video surveillance image by the IVU is described in detail below with reference to FIG. 5, which mainly includes: Step 501: The IVU sends an INVITE message to the CMS to request a video stream of a video source (ie, PU).

步骤 502, CMS将 INVITE消息发送到对应的 PU。  Step 502: The CMS sends an INVITE message to the corresponding PU.

步骤 503 , PU处理该 INVITE消息 , 返回 200 OK响应给 CMS, 同时 提供 SDP ( Session Description Protocol, 会话描述协议) offer (提供), 其 中包括 PU所支持的媒体格式列表和 PU的地址等信息。  Step 503: The PU processes the INVITE message, returns a 200 OK response to the CMS, and provides an SDP (Session Description Protocol) offer, which includes information such as a media format list supported by the PU and a PU address.

步骤 504, CMS收到 PU的 200 OK响应后, 根据 PU所支持的媒体格 式列表选择使用的编解码方式, 并选择转发视频流的 VTDU (也可以让 PU 将视频流直接发送给 IVU, 此时无需选择 VTDU ), 依此修改 SDP offer (即 SDP offer中包括使用的编解码方式和转发视频流的 VTDU地址 ), 并转发 200 OK响应给 IVU。  Step 504: After receiving the 200 OK response of the PU, the CMS selects a codec mode to be used according to the media format list supported by the PU, and selects a VTDU for forwarding the video stream (also allows the PU to directly send the video stream to the IVU. There is no need to select VTDU), and the SDP offer (ie, the codec mode used in the SDP offer and the VTDU address of the forwarded video stream) is modified accordingly, and the 200 OK response is forwarded to the IVU.

步骤 505 , IVU向 CMS发送确认( ACK ) 消息, 在所述 ACK消息中 携带 SDP Answer (应答), 其中包括 IVU的地址。  Step 505: The IVU sends an acknowledgement (ACK) message to the CMS, where the ACK message carries an SDP Answer, including the address of the IVU.

步骤 506, CMS依据接收的 ACK消息中的 SDP Answer和 200 OK响 应中的 SDP offer控制 VTDU转发 PU到 IVU之间的视频流,即告知 VTDU 转发视频的源 ( PU地址 )、 目的 ( IVU地址 )。 如果是 PU将视频流直接发 送给 IVU, 则无需 VTDU的参与, CMS无需告知 VTDU。 Step 506, the CMS responds according to the SDP Answer and the 200 OK in the received ACK message. The SDP offer should control the VTDU to forward the video stream between the PU and the IVU, that is, inform the VTDU to forward the source (PU address) and destination (IVU address) of the video. If the PU sends the video stream directly to the IVU, the CMS does not need to inform the VTDU without the participation of the VTDU.

步骤 507 , CMS修改来自 IVU的 ACK消息中的 SDP Answer,发送 ACK 消息给 PU。 SDP Answer 中包括选择使用的编解码方式和转发视频流的 VTDU (也可以让 PU将视频流直接发送给 IVU, 此时 SDP Answer中不包 括 VTDU )。  Step 507: The CMS modifies the SDP Answer in the ACK message from the IVU, and sends an ACK message to the PU. The SDP Answer includes the codec mode selected and the VTDU for forwarding the video stream (you can also let the PU send the video stream directly to the IVU, where SDP Answer does not include VTDU).

步骤 508, PU与 IVU之间建立会话。 如果需要 VTDU转发视频流, 则 PU与 IVU之间通过 VTDU建立会话; 如果不需要 VTDU转发视频流(即 PU将视频流直接发送给 IVU ) , 则 PU与 IVU之间直接建立会话。  Step 508, a session is established between the PU and the IVU. If the VTDU is required to forward the video stream, the PU establishes a session with the IVU through the VTDU. If the VTDU is not required to forward the video stream (that is, the PU directly sends the video stream to the IVU), the PU establishes a session directly with the IVU.

PU经由 VTDU将视频流发送到 IVU; 如果是由 PU直接发送视频流给 IVU, 则不需要经过 VIDU。  The PU sends the video stream to the IVU via the VTDU; if the video stream is directly sent by the PU to the IVU, the VIDU does not need to pass.

PU与 IVU之间的会话可以依据实时传输协议( RTP, Real-time Transport Protocol )建立, 或依据 RTP控制协议 ( PTCP, RTP Control Protocol )建立。  The session between the PU and the IVU can be established according to the Real-time Transport Protocol (RTP) or the RTP Control Protocol (PTCP, RTP Control Protocol).

步骤 509, IVU发送 BYE消息给 CMS , 请求终止该会话。  Step 509: The IVU sends a BYE message to the CMS requesting to terminate the session.

步骤 510, CMS控制 VTDU停止转发 PU到 IVU的视频流。如果是 PU 将视频流直接发送给 IVU , 则无需执行此操作。  Step 510: The CMS controls the VTDU to stop forwarding the video stream from the PU to the IVU. If the PU sends the video stream directly to the IVU, you do not need to do this.

步骤 511 , CMS将 BYE消息发送给 PU, PU停止发送视频流。  Step 511: The CMS sends a BYE message to the PU, and the PU stops sending the video stream.

步骤 512, PU返回 200 OK响应给 CMS。  In step 512, the PU returns a 200 OK response to the CMS.

步骤 513 , CMS将 200 OK响应转发给 IVU。  In step 513, the CMS forwards the 200 OK response to the IVU.

综上所述, 本发明在现有视频监控系统的基础上, 实现了以灵活的、 可配置的方式提供视频分析识别服务;可灵活选择不同 PU的视频内容进行 分析识别处理, 基于现有视频监控体系以灵活的、 可配置的方式统一提供 视频分析识别能力和结果的视频处理服务。  In summary, the present invention provides a video analysis and recognition service in a flexible and configurable manner on the basis of the existing video surveillance system; the video content of different PUs can be flexibly selected for analysis and recognition processing, based on the existing video. The monitoring system unifies the video processing services that provide video analysis and recognition capabilities and results in a flexible and configurable manner.

以上所述, 仅为本发明的较佳实施例而已, 并非用于限定本发明的保 护范围 The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Scope

Claims

权利要求书 Claim 1、 一种视频处理系统, 该系统包括: 智能管理平台 IVM和智能视频 处理单元 IVU, 1. A video processing system, the system comprising: an intelligent management platform IVM and an intelligent video processing unit IVU, 所述 IVW, 用于保存和管理所辖 IVU的能力集, 根据视频监控系统 的请求, 从所辖 IVU中选择满足能力要求的 IVU并调用;  The IVW is used to save and manage the capability set of the IVU under the jurisdiction, and according to the request of the video monitoring system, select an IVU that meets the capability requirement from the IVU under the jurisdiction and call it; 所述 IVU, 用于接受所述 IVW的管理和调度, 对从所述视频监控系 统输入 IVU的图像或视频流进行分析和识别处理, 并输出处理结果给所 述 IVW。  The IVU is configured to accept management and scheduling of the IVW, analyze and identify an image or video stream input from the video surveillance system to the IVU, and output the processing result to the IVW. 2、 根据权利要求 1所述视频处理系统, 其中, 所述 IVW进一步用 于, 提供智能应用策略配置服务, 保存配置的智能应用策略。  2. The video processing system according to claim 1, wherein the IVW is further configured to provide an intelligent application policy configuration service, and save the configured smart application policy. 3、 根据权利要求 2所述视频处理系统, 其中, 所述 IVW进一步用 于, 接受视频监控系统对所述 IVW保存的智能应用策略的调用, 并根据 保存的 IVU的能力集反馈执行策略的 IVU的地址给所述视频监控系统。  The video processing system according to claim 2, wherein the IVW is further configured to: accept a call of the video application system to the smart application policy saved by the IVW, and feed back an IVU that executes the policy according to the saved capability set of the IVU. The address is given to the video surveillance system. 4、根据权利要求 3所述视频处理系统,其中,所述 IVU进一步用于, 当作为执行策略的 IVU被所述 IVW调用时,从所述视频监控系统指示的 目的地获取图像或视频流, 对输入的图像或视频流进行分析和识别处理, 并输出处理结果给所述 IVW。  4. The video processing system of claim 3, wherein the IVU is further for acquiring an image or video stream from a destination indicated by the video surveillance system when an IVU acting as a policy is invoked by the IVW, The input image or video stream is analyzed and identified, and the processing result is output to the IVW. 5、 一种智能管理平台 IVW, 包括:  5. An intelligent management platform IVW, including: IVU管理调度模块, 用于保存和管理所辖智能视频处理单元 IVU的 能力集, 根据视频监控系统的请求, 从所辖 IVU中选择满足能力要求的 IVU并调用;  The IVU management scheduling module is configured to save and manage the capability set of the intelligent video processing unit IVU, and select an IVU that meets the capability requirement from the IVU under the control according to the request of the video monitoring system; 分析结果保存模块, 用于接收所述 IVU对从所述视频监控系统输入 IVU的图像或视频流进行分析和识别处理的输出结果, 并保存。  The analysis result saving module is configured to receive an output result of the IVU analyzing and identifying the image or video stream input to the IVU from the video monitoring system, and save the result. 6、 根据权利要求 5所述 IVW, 其中, 所述 IVW进一步包括: 策略 管理模块, 用于提供智能应用策略配置服务, 保存配置的智能应用策略。 The IVW according to claim 5, wherein the IVW further includes: a policy management module, configured to provide a smart application policy configuration service, and save the configured smart application policy. 7、根据权利要求 6所述 IVW,其中,所述策略管理模块进一步用于, 接受视频监控系统对所述 IVW保存的智能应用策略的调用, 并通知所述 IVU管理调度模块; The IVW according to claim 6, wherein the policy management module is further configured to: accept a call of the video monitoring system to the IVW saved smart application policy, and notify the IVU management scheduling module; 所述 IVU管理调度模块进一步用于, 根据所调用的智能应用策略、 以及保存的 IVU的能力集, 反馈执行策略的 IVU的地址给所述视频监控 系统。  The IVU management scheduling module is further configured to: according to the invoked smart application policy and the saved IVU capability set, feed back an address of the IVU of the execution policy to the video monitoring system. 8、 一种智能视频处理单元 IVU, 包括:  8. An intelligent video processing unit IVU, comprising: 能力上报模块,用于向 IVW上报所述 IVU的能力集,接受所述 IVW 的管理和调度;  The capability reporting module is configured to report the capability set of the IVU to the IVW, and accept management and scheduling of the IVW; 处理模块, 用于对从所述视频监控系统输入 IVU的图像或视频流进 行分析和识别处理, 并输出处理结果给所述 IVW。  And a processing module, configured to analyze and identify an image or video stream input to the IVU from the video monitoring system, and output the processing result to the IVW. 9、 根据权利要求 8所述 IVU, 其中, 所述处理模块进一步用于, 当 所述 IVU作为执行策略的 IVU被所述 IVW调用时, 从所述视频监控系 统指示的目的地获取图像或视频流, 对输入的图像或视频流进行分析和 识别处理, 并输出处理结果给所述 IVW。  9. The IVU according to claim 8, wherein the processing module is further configured to: acquire an image or video from a destination indicated by the video surveillance system when the IVU is invoked by the IVW as an execution policy; Flow, analyzing and identifying the input image or video stream, and outputting the processing result to the IVW. 10、 一种视频处理方法, 该方法包括:  10. A video processing method, the method comprising: 智能管理平台 IVW保存和管理所辖智能视频处理单元 IVU的能力 集, 根据视频监控系统的请求, 从所辖 IVU中选择满足能力要求的 IVU 并调用;  The intelligent management platform IVW saves and manages the capability set of the intelligent video processing unit IVU under its jurisdiction, and selects and calls the IVU that satisfies the capability requirements from the IVUs under the jurisdiction of the video surveillance system; IVU接受所述 IVW的管理和调度, 对从所述视频监控系统输入 IVU 的图像或视频流进行分析和识别处理, 并输出处理结果给所述 IVW。  The IVU accepts the management and scheduling of the IVW, analyzes and identifies the image or video stream input to the IVU from the video surveillance system, and outputs the processing result to the IVW. 11、根据权利要求 10所述视频处理方法, 其中, 该方法进一步包括: 所述 IVW提供智能应用策略配置服务, 保存配置的智能应用策略。  The video processing method according to claim 10, wherein the method further comprises: the IVW providing an intelligent application policy configuration service, and saving the configured smart application policy. 12、根据权利要求 11所述视频处理方法, 其中, 该方法进一步包括: 所述 IVW接受视频监控系统对所述 IVW保存的智能应用策略的调用, 并根据保存的 IVU的能力集反馈执行策略的 IVU的地址给所述视频监控 系统。 The video processing method according to claim 11, wherein the method further comprises: the IVW accepting a call of the video monitoring system to the smart application policy saved by the IVW, And feeding back the address of the IVU of the execution policy to the video monitoring system according to the saved IVU capability set. 13、根据权利要求 12所述视频处理方法, 其中, 该方法进一步包括: 执行策略的 IVU从所述视频监控系统指示的目的地获取图像或视频流, 对输入的图像或视频流进行分析和识别处理, 并输出处理结果给所述 13. The video processing method according to claim 12, wherein the method further comprises: the IVU executing the policy acquiring an image or a video stream from the destination indicated by the video monitoring system, and analyzing and identifying the input image or video stream Processing, and outputting the processing result to the IVW。 IVW. 14、 根据权利要求 13所述视频处理方法, 其中, IVW保存的智能应 用策略由视频监控系统内部的视频监控平台 CMS调用, IVW反馈执行策 略的 IVU的地址给所述 CMS, CMS指示的目的地为视频监控系统内部 的前端 PU;  The video processing method according to claim 13, wherein the intelligent application policy saved by the IVW is called by the video monitoring platform CMS inside the video monitoring system, and the IVW feeds back the address of the IVU of the execution policy to the CMS, the destination indicated by the CMS. The front end PU inside the video monitoring system; 相应的, IVU从 CMS指示的 PU获取图像或视频流为:  Correspondingly, the IVU obtains an image or video stream from the PU indicated by the CMS as: 所述 IVU向 CMS请求所述 PU的图像或视频流, 所述 CMS转发所 述请求到相应的 PU;  The IVU requests an image or video stream of the PU from the CMS, and the CMS forwards the request to the corresponding PU; 所述 PU返回响应消息给所述 CMS ,所述 CMS选择转发图像或视频 流的视频分发单元 VTDU, 并发送所述响应消息给所述 IVU;  The PU returns a response message to the CMS, the CMS selects a video distribution unit VTDU that forwards an image or video stream, and sends the response message to the IVU; 所述 CMS将发送图像或视频流的 PU的地址、 以及接收图像或视频 流的 IVU的地址告知所选的 VTDU;  The CMS notifies the selected VTDU of the address of the PU transmitting the image or video stream and the address of the IVU receiving the image or video stream; 所述 PU与 IVU之间通过 VTDU建立会话, PU的图像或视频流经由 VTDU转发到 IVU。  A session is established between the PU and the IVU through the VTDU, and the image or video stream of the PU is forwarded to the IVU via the VTDU. 15、 根据权利要求 13所述视频处理方法, 其中, IVW保存的智能应 用策略由视频监控系统内部的 CMS调用, IVW反馈执行策略的 IVU的 地址给所述 CMS , CMS指示的目的地为视频监控系统内部的 PU;  The video processing method according to claim 13, wherein the intelligent application policy saved by the IVW is called by the CMS inside the video monitoring system, and the address of the IVU of the IVW feedback execution policy is given to the CMS, and the destination indicated by the CMS is video monitoring. PU inside the system; 相应的, IVU从 CMS指示的 PU获取图像或视频流为:  Correspondingly, the IVU obtains an image or video stream from the PU indicated by the CMS as: 所述 IVU向 CMS请求所述 PU的图像或视频流, 所述 CMS转发所 述请求到相应的 PU; 所述 PU返回响应消息给所述 CMS,所述 CMS发送所述响应消息给 IVU; The IVU requests an image or video stream of the PU from a CMS, and the CMS forwards the request to a corresponding PU; The PU returns a response message to the CMS, and the CMS sends the response message to the IVU; 所述 PU与 IVU之间建立会话, IVU接收 PU发送的图像或视频流。 A session is established between the PU and the IVU, and the IVU receives an image or video stream sent by the PU.
PCT/CN2012/076671 2012-02-09 2012-06-08 Video processing method and system, ivw and ivu Ceased WO2013117065A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201210028260.0 2012-02-09
CN201210028260.0A CN102547250B (en) 2012-02-09 2012-02-09 Method and system for processing video, intelligent video management platform (IVM) and intelligent video processing unit (IVU)

Publications (1)

Publication Number Publication Date
WO2013117065A1 true WO2013117065A1 (en) 2013-08-15

Family

ID=46353058

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2012/076671 Ceased WO2013117065A1 (en) 2012-02-09 2012-06-08 Video processing method and system, ivw and ivu

Country Status (2)

Country Link
CN (1) CN102547250B (en)
WO (1) WO2013117065A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110971628A (en) * 2018-09-29 2020-04-07 杭州阿启视科技有限公司 Cloud video data acquisition method
CN111753584A (en) * 2019-03-28 2020-10-09 杭州海康威视数字技术股份有限公司 Intelligent analysis method and system

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110944146B (en) * 2018-09-21 2022-04-12 华为技术有限公司 Intelligent analysis equipment resource adjusting method and device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003007601A1 (en) * 2001-07-13 2003-01-23 Sony Corporation Video information recording apparatus and reproducing apparatus
US20030067387A1 (en) * 2001-10-05 2003-04-10 Kwon Sung Bok Remote control and management system
CN101115057A (en) * 2006-07-27 2008-01-30 中兴通讯股份有限公司 Firewall System and Scheduling Method Based on Policy Management
CN101196827A (en) * 2007-12-28 2008-06-11 中国科学院计算技术研究所 A parallel simulator and method
CN101702771A (en) * 2009-11-06 2010-05-05 中国电信股份有限公司 Network video intelligent monitoring system and method

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8026945B2 (en) * 2005-07-22 2011-09-27 Cernium Corporation Directed attention digital video recordation
CN102045537A (en) * 2009-10-23 2011-05-04 上海贝尔股份有限公司 Method and device for connecting video conference system and video monitoring system
CN102036054B (en) * 2010-10-19 2013-04-17 北京硅盾安全技术有限公司 Intelligent video monitoring system based on three-dimensional virtual scene

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003007601A1 (en) * 2001-07-13 2003-01-23 Sony Corporation Video information recording apparatus and reproducing apparatus
US20030067387A1 (en) * 2001-10-05 2003-04-10 Kwon Sung Bok Remote control and management system
CN101115057A (en) * 2006-07-27 2008-01-30 中兴通讯股份有限公司 Firewall System and Scheduling Method Based on Policy Management
CN101196827A (en) * 2007-12-28 2008-06-11 中国科学院计算技术研究所 A parallel simulator and method
CN101702771A (en) * 2009-11-06 2010-05-05 中国电信股份有限公司 Network video intelligent monitoring system and method

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110971628A (en) * 2018-09-29 2020-04-07 杭州阿启视科技有限公司 Cloud video data acquisition method
CN110971628B (en) * 2018-09-29 2022-04-01 杭州阿启视科技有限公司 Cloud video data acquisition method
CN111753584A (en) * 2019-03-28 2020-10-09 杭州海康威视数字技术股份有限公司 Intelligent analysis method and system
CN111753584B (en) * 2019-03-28 2023-09-26 杭州海康威视数字技术股份有限公司 Intelligent analysis methods and systems

Also Published As

Publication number Publication date
CN102547250B (en) 2015-05-20
CN102547250A (en) 2012-07-04

Similar Documents

Publication Publication Date Title
US7996540B2 (en) Method and system for replacing media stream in a communication process of a terminal
CN101365114B (en) Proxy video server for video surveillance
US10325143B2 (en) Method and system for aggregating video content
CN104065933B (en) Intelligent data acquisition method and system in video monitoring system
WO2014183540A1 (en) Method and system for video surveillance content adaptation, and central server and device
WO2009155845A1 (en) Method for realizing multimedia information interaction, system, device, user terminal
CN106303377A (en) Video monitoring processing method and processing device
WO2021093653A1 (en) Security method, apparatus and system easy to access by user
CN105657368A (en) Method for rapidly switching IPC (Inter Process Communication) camera into IP (Internet Protocol) multimedia system IMS
WO2014063511A1 (en) Monitoring method and internet protocol television set top box
US9137036B2 (en) Method and apparatus for processing event in home network
WO2022147696A1 (en) Call processing method, call processing apparatus and related device
CN103929623B (en) Video data handling procedure in a kind of video monitoring system
CN102547250B (en) Method and system for processing video, intelligent video management platform (IVM) and intelligent video processing unit (IVU)
CN111147817B (en) Video processing method, device, electronic device and storage medium
CN115665111B (en) Real-time Communication System Based on Law Enforcement Recorder
USRE50327E1 (en) Camera capture for connected devices
WO2015176392A1 (en) Kindergarten video surveillance method and device
CN111147789A (en) A method, device, device and storage medium for recording audio and video streams
CN116325696B (en) Real-time and file-based audio data processing method, electronic device and readable medium
WO2012022252A1 (en) System and method for video monitoring based on ims
WO2016177257A1 (en) Data sharing method and device
KR101941271B1 (en) Method for providing multi users with remote guard service by robot in remote guard system and remote guard system therefor
JP2013522708A (en) Method for automatically attaching tags to media content, and media server and application server for realizing such method
CN113163231B (en) Data sharing method, device, server and media

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12868323

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12868323

Country of ref document: EP

Kind code of ref document: A1