CN112185043A - Intelligent monitoring system and method - Google Patents
Intelligent monitoring system and method Download PDFInfo
- Publication number
- CN112185043A CN112185043A CN201910602655.9A CN201910602655A CN112185043A CN 112185043 A CN112185043 A CN 112185043A CN 201910602655 A CN201910602655 A CN 201910602655A CN 112185043 A CN112185043 A CN 112185043A
- Authority
- CN
- China
- Prior art keywords
- module
- information
- equipment
- area
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
- G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19602—Image analysis to detect motion of the intruder, e.g. by frame subtraction
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19678—User interface
- G08B13/19691—Signalling events for better perception by user, e.g. indicating alarms by making display brighter, adding text, creating a sound
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Computer Security & Cryptography (AREA)
- Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Multimedia (AREA)
- General Health & Medical Sciences (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Alarm Systems (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
The invention discloses an intelligent monitoring system and a method, wherein the intelligent monitoring system comprises: the system comprises an image acquisition device, a database module, an intrusion judgment module, a face tracking identification module, an equipment parameter acquisition module, a first AR module, a display module, a touch area division module, a touch area acquisition module, a control module and a second AR module. The display module is used for displaying setting information, and comprises: the real-time image information acquired by the image acquisition device, the information of an intruder displayed by the first AR module when the intruder intrudes, and the equipment information generated by the second AR module after the set area of the display module is touched by the touch screen. The intelligent monitoring system and the method can display the information of the entering personnel or send out the alarm prompt on the display screen; meanwhile, the related information of the selected equipment can be displayed, and an alarm signal can be sent out when the equipment is abnormal.
Description
Technical Field
The invention belongs to the technical field of electronic information, relates to a monitoring system, and particularly relates to an intelligent monitoring system and method.
Background
With the development of science and technology, monitoring equipment is widely applied to places such as markets, offices, network communication rooms and the like, and brings great convenience to work and life of people.
The existing monitoring system can only display the picture captured by the camera device, does not interact with a user, cannot identify that a lawbreaker enters a set place, and cannot send an alarm signal to people.
In view of the above, there is a need to design a new monitoring system to overcome the above-mentioned drawbacks of the existing monitoring systems.
Disclosure of Invention
The invention provides an intelligent monitoring system and a method, which can display the information of entering personnel or send out alarm reminding on a display screen; meanwhile, the related information of the selected equipment can be displayed, and an alarm signal can be sent out when the equipment is abnormal.
In order to solve the technical problem, according to one aspect of the present invention, the following technical solutions are adopted:
an intelligent monitoring system, the intelligent monitoring system comprising: the system comprises an image acquisition device, a database module, an intrusion judgment module, a face tracking identification module, an equipment parameter acquisition module, a first AR module, a display module, a touch area division module, a touch area acquisition module, a control module and a second AR module.
The control module is respectively connected with the image acquisition device, the database module, the intrusion judgment module, the face tracking identification module, the equipment parameter acquisition module, the first AR module, the display module, the touch area division module, the touch area acquisition module, the control module and the second AR module;
the intrusion judgment module and the face tracking identification module are respectively connected with the image acquisition device, and the face tracking identification module is also connected with the database module; the equipment parameter acquisition module is connected with the database module;
the image acquisition device is used for acquiring image information of a set area and comprises a camera device;
the database module is used for recording setting information; recording information of setting equipment and information of setting personnel, wherein the information of the setting personnel comprises face information;
the intrusion judging module is used for judging whether a person enters a set area or not according to the real-time image information acquired by the image acquiring device; the intrusion judgment module is realized in an image comparison mode, and an image of a picture without a person entering is used as a reference image; the intrusion judgment module compares images acquired in real time or at set time intervals with reference images, if the similarity is lower than a set threshold, the intrusion judgment module judges that a person or an object enters, sends a signal to the control module, and controls the face tracking identification module to work;
the face tracking identification module is used for tracking the face information of the image information acquired by the image acquisition device, comparing and identifying the acquired face information with the set face information in the database module, and judging whether an entrant has the authority or not;
the equipment parameter acquisition module is used for acquiring the setting information of the equipment; the equipment information acquired by the equipment parameter acquisition module comprises at least one of equipment temperature, equipment model and equipment continuous starting time;
the first AR module is used for generating the information of the entrants who set to run according to the recognition result of the face tracking recognition module and displaying the setting information of the entrants in the display module; the first AR module performs superposition processing on the generated setting information of the entrant and the real-time image acquired by the image acquisition device in the form of a label, and displays the image subjected to superposition processing in the display module; the position of the generated label and the face of the person entering the label meet set conditions, and the pixel value between the center of the label and the set position of the face is a set value; if the entrant has the access authority, displaying the related information of the entrant, and if the entrant has no authority or cannot identify the identity of the entrant, sending an alarm signal in a label flashing manner;
the display module is used for displaying setting information, and comprises: the real-time image information acquired by the image acquisition device, the information of an intruder displayed by the first AR module when the intruder intrudes, and the equipment information generated by the second AR module after the set area of the display module is touched by the touch screen; the display module comprises a touch display screen and can receive touch signals;
the touch area dividing module is used for dividing each area on the touch display screen and marking the corresponding identification of each area; the touch area dividing module divides the equipment area in the picture into specific areas according to the picture corresponding to the image acquisition device, and acquires area coordinate ranges corresponding to the specific areas;
the touch area acquisition module is used for acquiring touch point coordinate data of the touch display screen and judging whether the touch point is positioned in each specific area or not according to the touch point coordinate data and the area coordinate range of each specific area; if the specific area is located in a certain specific area, acquiring the corresponding specific area, and sending the identifier of the specific area to the control module;
the control module controls the second AR module to generate data of corresponding contents according to the acquired equipment information through the equipment information acquired by the equipment parameter acquisition module, and the data are displayed through the touch display screen;
the second AR module is used for generating equipment information according to the set equipment information acquired by the equipment parameter acquisition module and displaying the equipment information in the display module; the second AR module performs superposition processing on the generated information of the set equipment and the real-time image acquired by the image acquisition device in the form of a label, and displays the image subjected to superposition processing in the display module; the position of the generated label and the equipment meet the set condition, and the pixel value between the center of the generated label and the set point of the equipment is a set value; when the temperature or other parameters of the equipment do not accord with the running conditions of the equipment, an alarm signal is sent by generating a flashing label so as to remind related personnel of paying attention.
An intelligent monitoring system, the intelligent monitoring system comprising:
the image acquisition device is used for acquiring image information of the set area;
the database module is used for recording the setting information;
the intrusion judging module is used for judging whether a person enters a set area or not according to the real-time image information acquired by the image acquiring device;
the face tracking identification module is used for tracking the face information of the image information acquired by the image acquisition device, comparing and identifying the acquired face information with the set face information in the database module, and judging whether an entrant has the authority or not;
the device parameter acquisition module is used for acquiring the setting information of the device;
the first AR module is used for generating the information of the entrants who set to run according to the recognition result of the face tracking recognition module and displaying the setting information of the entrants in a display module;
the display module is used for displaying the setting information and comprises: the real-time image information acquired by the image acquisition device, the information of an intruder displayed by the first AR module when the intruder intrudes, and the equipment information generated by the second AR module after the set area of the display module is touched by the touch screen; the display module comprises a touch display screen;
the touch area dividing module is used for dividing each area on the touch display screen and marking the corresponding identification of each area; the touch area dividing module divides the equipment area in the picture into specific areas according to the picture corresponding to the image acquisition device, and acquires area coordinate ranges corresponding to the specific areas;
the touch area acquisition module is used for acquiring touch point coordinate data of the touch display screen and judging whether the touch point is positioned in each specific area; if the specific area is located in a certain specific area, acquiring the corresponding specific area, and sending the identifier of the specific area to a control module;
the control module controls a second AR module to generate data of corresponding contents according to the acquired equipment information through the equipment information acquired by the equipment parameter acquisition module, and the data are displayed through the touch display screen;
and the second AR module is used for generating equipment information according to the set equipment information acquired by the equipment parameter acquisition module and displaying the equipment information in the display module.
As an embodiment of the present invention, the device parameter obtaining module is configured to obtain information of a device, where the information includes at least one of a device temperature, a device model, and a device duration.
As an embodiment of the present invention, the device parameter acquiring module includes a temperature sensor disposed in each device, and is configured to acquire temperature information of the device.
As an embodiment of the present invention, the intelligent monitoring system further includes: an image acquisition device angle acquisition module to acquire a pose of the image acquisition device.
As an embodiment of the present invention, the touch area dividing module divides an equipment area in a screen into specific areas according to the screen acquired by the image acquisition device in different postures, and acquires different area coordinate ranges of the specific areas of the image acquisition device in different postures.
As an embodiment of the present invention, the first AR module performs a superimposition process on the generated setting information of the entrant with the real-time image acquired by the image acquisition device in the form of a label, and displays the superimposed image on a display module; the position of the generated label and the face of the person entering the label meet set conditions, and the pixel value between the center of the label and the set position of the face is a set value; if the entrant has the entrance authority, the related information of the entrant is displayed, and if the entrant has no authority or cannot identify the identity of the entrant, an alarm signal is sent out in a label flashing mode.
As an embodiment of the present invention, the second AR module performs an overlay process on the generated information of the setting device and the real-time image acquired by the image acquisition apparatus in the form of a tag, and displays the image after the overlay process in the display module; the position of the generated label and the equipment meet the set condition, and the pixel value between the center of the generated label and the set point of the equipment is a set value; when the temperature or other parameters of the equipment do not accord with the running conditions of the equipment, an alarm signal is sent by generating a flashing label so as to remind related personnel of paying attention.
An intelligent monitoring method of the intelligent monitoring system comprises the following steps:
the image acquisition device acquires image information of a set area;
the equipment parameter acquisition module acquires the setting information of the equipment;
the intrusion judgment module judges whether a person enters a set area or not according to the real-time image information acquired by the image acquisition device; if the person enters the system, controlling a face tracking recognition module to perform face tracking recognition work;
the face tracking identification module tracks the face information of the image information acquired by the image acquisition device, compares the acquired face information with the set face information in the database module for identification, and judges whether the entrant has the authority or not;
the first AR module generates the information of the entrants who set to run according to the recognition result of the face tracking recognition module, and displays the setting information of the entrants in a display module;
the display module displays the setting information, including: the real-time image information acquired by the image acquisition device, the information of an intruder displayed by the first AR module when the intruder intrudes, and the equipment information generated by the second AR module after the set area of the display module is touched by the touch screen;
the touch area dividing module divides each area on the touch display screen and marks the corresponding identification of each area; the touch area dividing module divides the equipment area in the picture into specific areas according to the picture corresponding to the image acquisition device, and acquires area coordinate ranges corresponding to the specific areas;
a touch area acquisition module acquires coordinate data of a touch point of the touch display screen and judges whether the touch point is located in each specific area; if the specific area is located in a certain specific area, acquiring the corresponding specific area, and sending the identifier of the specific area to a control module;
the control module controls a second AR module to generate data of corresponding contents according to the acquired equipment information through the equipment information acquired by the equipment parameter acquisition module, and the data are displayed through the touch display screen;
and the second AR module generates equipment information according to the set equipment information acquired by the equipment parameter acquisition module and displays the equipment information in the display module.
An intelligent monitoring method of the intelligent monitoring system comprises the following steps:
the method comprises the steps that an image acquisition device acquires image information of a set area, wherein the image acquisition device comprises a camera device;
the equipment parameter acquisition module acquires the setting information of the equipment; the equipment information acquired by the equipment parameter acquisition module comprises at least one of equipment temperature, equipment model and equipment continuous starting time;
the intrusion judgment module judges whether a person enters a set area or not according to the real-time image information acquired by the image acquisition device; the intrusion judgment module is realized in an image comparison mode, and an image of a picture without a person entering is used as a reference image; the intrusion judgment module compares images acquired in real time or at set time intervals with reference images, if the similarity is lower than a set threshold, the intrusion judgment module judges that a person or an object enters, sends a signal to the control module, and controls the face tracking identification module to work;
the face tracking identification module tracks the face information of the image information acquired by the image acquisition device, compares the acquired face information with the set face information in the database module for identification, and judges whether the entrant has the authority or not;
the first AR module generates the information of the entrants who set to run according to the recognition result of the face tracking recognition module, and displays the setting information of the entrants in the display module; the first AR module performs superposition processing on the generated setting information of the entrant and the real-time image acquired by the image acquisition device in the form of a label, and displays the image subjected to superposition processing in the display module; the position of the generated label and the face of the person entering the label meet set conditions, and the pixel value between the center of the label and the set position of the face is a set value; if the entrant has the access authority, displaying the related information of the entrant, and if the entrant has no authority or cannot identify the identity of the entrant, sending an alarm signal in a label flashing manner;
the display module displays setting information, and the displayed information comprises: the real-time image information acquired by the image acquisition device, the information of an intruder displayed by the first AR module when the intruder intrudes, and the equipment information generated by the second AR module after the set area of the display module is touched by the touch screen;
the touch area dividing module divides each area on the touch display screen and marks the corresponding identification of each area; the touch area dividing module divides the equipment area in the picture into specific areas according to the picture corresponding to the image acquisition device, and acquires area coordinate ranges corresponding to the specific areas;
the touch area acquisition module acquires touch point coordinate data of the touch display screen and judges whether the touch point is located in each specific area or not according to the touch point coordinate data and the area coordinate range of each specific area; if the specific area is located in a certain specific area, acquiring the corresponding specific area, and sending the identifier of the specific area to the control module;
the control module controls the second AR module to generate data of corresponding contents according to the acquired equipment information through the equipment information acquired by the equipment parameter acquisition module, and the data are displayed through the touch display screen;
the second AR module generates equipment information according to the set equipment information acquired by the equipment parameter acquisition module and displays the equipment information in the display module; the second AR module performs superposition processing on the generated information of the set equipment and the real-time image acquired by the image acquisition device in the form of a label, and displays the image subjected to superposition processing in the display module; the position of the generated label and the equipment meet the set condition, and the pixel value between the center of the generated label and the set point of the equipment is a set value; when the temperature or other parameters of the equipment do not accord with the running conditions of the equipment, an alarm signal is sent by generating a flashing label so as to remind related personnel of paying attention.
The invention has the beneficial effects that: the intelligent monitoring system and the method can display the information of the entering personnel or send out the alarm prompt on the display screen; meanwhile, the related information of the selected equipment can be displayed, and an alarm signal can be sent out when the equipment is abnormal.
Drawings
Fig. 1 is a schematic diagram of an intelligent monitoring system according to an embodiment of the present invention.
Fig. 2 is a schematic diagram of an image acquired by the image acquiring apparatus according to an embodiment of the present invention.
Fig. 3 is a schematic diagram illustrating the touch area dividing module performing area division according to an embodiment of the present invention.
Fig. 4 is a schematic diagram of a display module displaying a processed image according to an embodiment of the invention.
Detailed Description
Preferred embodiments of the present invention will be described in detail below with reference to the accompanying drawings.
For a further understanding of the invention, reference will now be made to the preferred embodiments of the invention by way of example, and it is to be understood that the description is intended to further illustrate features and advantages of the invention, and not to limit the scope of the claims.
The description in this section is for several exemplary embodiments only, and the present invention is not limited only to the scope of the embodiments described. It is within the scope of the present disclosure and protection that the same or similar prior art means and some features of the embodiments may be interchanged.
The invention discloses an intelligent monitoring system, and fig. 1 is a schematic composition diagram of the intelligent monitoring system in an embodiment of the invention; referring to fig. 1, in an embodiment of the present invention, the intelligent monitoring system includes: the system comprises an image acquisition device 1, a database module 2, an intrusion judgment module 3, a face tracking identification module 4, an equipment parameter acquisition module 5, a first AR module 6, a display module 7, a touch area division module 8, a touch area acquisition module 9, a control module 10 and a second AR module 11.
The control module 10 is respectively connected with the image acquisition device 1, the database module 2, the intrusion judgment module 3, the face tracking recognition module 4, the equipment parameter acquisition module 5, the first AR module 6, the display module 7, the touch area division module 8, the touch area acquisition module 9, the control module 10 and the second AR module 11.
The intrusion judgment module 3 and the face tracking recognition module 4 are respectively connected with the image acquisition device 1, and the face tracking recognition module 4 is also connected with the database module 2; the device parameter obtaining module 5 may also be connected to the database module 2 (capable of obtaining the setting information of each device).
The image acquiring apparatus 1 is used for acquiring image information of a set area. The image acquisition device may be a camera device, such as a video camera, or the like.
The database module 2 is used for recording the setting information. Such as recording information of each device, setting face information of a person, and other related information of the person.
The intrusion judgment module 3 is used for judging whether a person enters a set area or not according to the real-time image information acquired by the image acquisition device. The intrusion judgment module is realized in an image comparison mode, and an image of a picture without a person entering is used as a reference image; the intrusion judgment module compares the image acquired in real time (or every set time, such as 1 second, 2 seconds) with the reference image, if the similarity is lower than a set threshold (such as 90% or 95% or 98%), it is judged that a person (or an object of course) enters, the intrusion judgment module sends a signal to the control module, and the control module controls the face tracking identification module to work.
The face tracking and identifying module 4 is used for tracking the face information of the image information acquired by the image acquiring device, comparing and identifying the acquired face information with the set face information in the database module, and simultaneously judging whether the entrant has the authority. The face tracking recognition module may use the existing technology related to face recognition, which is not described herein.
The device parameter obtaining module 5 is used for obtaining the setting information of the device. In an embodiment of the present invention, the device parameter obtaining module is configured to obtain information of a device, where the information includes at least one of a device temperature, a device model, and a device duration; the working condition of each equipment can be conveniently known by the staff.
The first AR module 6 is configured to generate information of an entrant who is set to travel according to the recognition result of the face tracking recognition module, and display the information of the entrant in a display module. FIG. 4 is a diagram illustrating a display module displaying a processed image according to an embodiment of the present invention; referring to fig. 4, in an embodiment of the present invention, the first AR module 6 generates the setting information of the entrant in the display interface of the touch display screen through the AR technology. In an embodiment of the present invention, the first AR module performs an overlay process on the generated setting information of the entrant 20 and the real-time image acquired by the image acquisition device in the form of a tag (generates the first tag 60), and displays the image after the overlay process in the display module. In an embodiment of the present invention, the position of the generated tag and the face of the entrant satisfy a setting condition, for example, a pixel value between the center of the tag and the setting position of the face is a setting value. If the entrant has the entrance authority, only the relevant information of the entrant can be displayed, and if the entrant has no authority or cannot identify the identity of the entrant, an alarm signal can be sent out in a label flashing mode.
The display module 7 is used to display the setting information, and the displayed information may include: the real-time image information acquired by the image acquisition device, the information of an intruder displayed by the first AR module when the intruder intrudes, and the equipment information generated by the second AR module after the set area of the display module is touched by the touch screen. The display module comprises a touch display screen and can receive touch signals.
Fig. 2 is a schematic diagram of an image acquired by an image acquisition device according to an embodiment of the present invention, and fig. 3 is a schematic diagram of a touch area dividing module performing area division according to an embodiment of the present invention; referring to fig. 2 and 3, in an embodiment of the present invention, the touch area dividing module 8 is configured to divide each area on the touch display screen and mark an identifier corresponding to each area; the touch area dividing module divides the device area corresponding to the device 30 in the picture into specific areas 80 according to the picture corresponding to the image acquisition device, and acquires area coordinate ranges corresponding to the specific areas.
The touch area acquisition module 9 is configured to acquire touch point coordinate data of the touch display screen, and determine whether the touch point is located in each specific area according to the touch point coordinate data and an area coordinate range of each specific area; and if the specific area is located in a certain specific area, acquiring the corresponding specific area, and sending the identifier of the specific area to the control module.
The control module 10 controls the second AR module to generate data of corresponding content according to the acquired device information through the device information acquired by the device parameter acquisition module 5, and displays the data through the touch display screen.
The second AR module 11 is configured to generate device information according to the set device information acquired by the device parameter acquiring module, and display the device information in the display module. And the second AR module generates information for setting the equipment in a display interface of the touch display screen through an AR technology. Referring to fig. 4, in an embodiment of the present invention, the second AR module performs an overlay process on the generated information of the setting device and the real-time image acquired by the image acquisition apparatus in the form of a tag (generates the second tag 110), and displays the image after the overlay process in the display module. In an embodiment of the present invention, the position of the generated tag and the device satisfy a set condition, such as a pixel value between the center of the tag and a set point of the device is a set value. In addition, when the temperature or other parameters of the equipment do not accord with the running conditions of the equipment, an alarm signal can be sent in a label flashing mode to remind related personnel of paying attention.
In an embodiment of the present invention, the intelligent monitoring system further includes an image obtaining device angle obtaining module, configured to obtain a posture of the image obtaining device.
In an embodiment of the present invention, the touch area dividing module divides an equipment area in a picture into specific areas according to pictures acquired by the image acquisition device in different postures, and acquires different area coordinate ranges of the specific areas of the image acquisition device in the different postures.
The invention also discloses an intelligent monitoring method of the intelligent monitoring system, which comprises the following steps:
the image acquisition device acquires image information of a set area;
the equipment parameter acquisition module acquires the setting information of the equipment;
the intrusion judgment module judges whether a person enters a set area or not according to the real-time image information acquired by the image acquisition device; if the person enters the system, controlling a face tracking recognition module to perform face tracking recognition work;
the face tracking identification module tracks the face information of the image information acquired by the image acquisition device, compares the acquired face information with the set face information in the database module for identification, and judges whether the entrant has the authority or not;
the first AR module generates the information of the entrants who set to run according to the recognition result of the face tracking recognition module, and displays the setting information of the entrants in a display module;
the display module displays the setting information, including: the real-time image information acquired by the image acquisition device, the information of an intruder displayed by the first AR module when the intruder intrudes, and the equipment information generated by the second AR module after the set area of the display module is touched by the touch screen;
the touch area dividing module divides each area on the touch display screen and marks the corresponding identification of each area; the touch area dividing module divides the equipment area in the picture into specific areas according to the picture corresponding to the image acquisition device, and acquires area coordinate ranges corresponding to the specific areas;
a touch area acquisition module acquires coordinate data of a touch point of the touch display screen and judges whether the touch point is located in each specific area; if the specific area is located in a certain specific area, acquiring the corresponding specific area, and sending the identifier of the specific area to a control module;
the control module controls a second AR module to generate data of corresponding contents according to the acquired equipment information through the equipment information acquired by the equipment parameter acquisition module, and the data are displayed through the touch display screen;
and the second AR module generates equipment information according to the set equipment information acquired by the equipment parameter acquisition module and displays the equipment information in the display module.
In an embodiment of the present invention, the intelligent monitoring method specifically includes the following steps:
the method comprises the steps that an image acquisition device acquires image information of a set area, wherein the image acquisition device comprises a camera device;
the equipment parameter acquisition module acquires the setting information of the equipment; the equipment information acquired by the equipment parameter acquisition module comprises at least one of equipment temperature, equipment model and equipment continuous starting time;
the intrusion judgment module judges whether a person enters a set area or not according to the real-time image information acquired by the image acquisition device; the intrusion judgment module is realized in an image comparison mode, and an image of a picture without a person entering is used as a reference image; the intrusion judgment module compares images acquired in real time or at set time intervals with reference images, if the similarity is lower than a set threshold, the intrusion judgment module judges that a person or an object enters, sends a signal to the control module, and controls the face tracking identification module to work;
the face tracking identification module tracks the face information of the image information acquired by the image acquisition device, compares the acquired face information with the set face information in the database module for identification, and judges whether the entrant has the authority or not;
the first AR module generates the information of the entrants who set to run according to the recognition result of the face tracking recognition module, and displays the setting information of the entrants in the display module; the first AR module performs superposition processing on the generated setting information of the entrant and the real-time image acquired by the image acquisition device in the form of a label, and displays the image subjected to superposition processing in the display module; the position of the generated label and the face of the person entering the label meet set conditions, and the pixel value between the center of the label and the set position of the face is a set value; if the entrant has the access authority, displaying the related information of the entrant, and if the entrant has no authority or cannot identify the identity of the entrant, sending an alarm signal in a label flashing manner;
the display module displays setting information, and the displayed information comprises: the real-time image information acquired by the image acquisition device, the information of an intruder displayed by the first AR module when the intruder intrudes, and the equipment information generated by the second AR module after the set area of the display module is touched by the touch screen;
the touch area dividing module divides each area on the touch display screen and marks the corresponding identification of each area; the touch area dividing module divides the equipment area in the picture into specific areas according to the picture corresponding to the image acquisition device, and acquires area coordinate ranges corresponding to the specific areas;
the touch area acquisition module acquires touch point coordinate data of the touch display screen and judges whether the touch point is located in each specific area or not according to the touch point coordinate data and the area coordinate range of each specific area; if the specific area is located in a certain specific area, acquiring the corresponding specific area, and sending the identifier of the specific area to the control module;
the control module controls the second AR module to generate data of corresponding contents according to the acquired equipment information through the equipment information acquired by the equipment parameter acquisition module, and the data are displayed through the touch display screen;
the second AR module generates equipment information according to the set equipment information acquired by the equipment parameter acquisition module and displays the equipment information in the display module; the second AR module performs superposition processing on the generated information of the set equipment and the real-time image acquired by the image acquisition device in the form of a label, and displays the image subjected to superposition processing in the display module; the position of the generated label and the equipment meet the set condition, and the pixel value between the center of the generated label and the set point of the equipment is a set value; when the temperature or other parameters of the equipment do not accord with the running conditions of the equipment, an alarm signal is sent by generating a flashing label so as to remind related personnel of paying attention.
In summary, the intelligent monitoring system and method provided by the invention can display the information of the entering personnel on the display screen or send out the alarm prompt; meanwhile, the related information of the selected equipment can be displayed, and an alarm signal can be sent out when the equipment is abnormal.
The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The description and applications of the invention herein are illustrative and are not intended to limit the scope of the invention to the embodiments described above. Variations and modifications of the embodiments disclosed herein are possible, and alternative and equivalent various components of the embodiments will be apparent to those skilled in the art. It will be clear to those skilled in the art that the present invention may be embodied in other forms, structures, arrangements, proportions, and with other components, materials, and parts, without departing from the spirit or essential characteristics thereof. Other variations and modifications of the embodiments disclosed herein may be made without departing from the scope and spirit of the invention.
Claims (10)
1. An intelligent monitoring system, comprising: the system comprises an image acquisition device, a database module, an intrusion judgment module, a face tracking identification module, an equipment parameter acquisition module, a first AR module, a display module, a touch area division module, a touch area acquisition module, a control module and a second AR module.
The control module is respectively connected with the image acquisition device, the database module, the intrusion judgment module, the face tracking identification module, the equipment parameter acquisition module, the first AR module, the display module, the touch area division module, the touch area acquisition module, the control module and the second AR module;
the intrusion judgment module and the face tracking identification module are respectively connected with the image acquisition device, and the face tracking identification module is also connected with the database module; the equipment parameter acquisition module is connected with the database module;
the image acquisition device is used for acquiring image information of a set area and comprises a camera device;
the database module is used for recording setting information; recording information of setting equipment and information of setting personnel, wherein the information of the setting personnel comprises face information;
the intrusion judging module is used for judging whether a person enters a set area or not according to the real-time image information acquired by the image acquiring device; the intrusion judgment module is realized in an image comparison mode, and an image of a picture without a person entering is used as a reference image; the intrusion judgment module compares images acquired in real time or at set time intervals with reference images, if the similarity is lower than a set threshold, the intrusion judgment module judges that a person or an object enters, sends a signal to the control module, and controls the face tracking identification module to work;
the face tracking identification module is used for tracking the face information of the image information acquired by the image acquisition device, comparing and identifying the acquired face information with the set face information in the database module, and judging whether an entrant has the authority or not;
the equipment parameter acquisition module is used for acquiring the setting information of the equipment; the equipment information acquired by the equipment parameter acquisition module comprises at least one of equipment temperature, equipment model and equipment continuous starting time;
the first AR module is used for generating the information of the entrants who set to run according to the recognition result of the face tracking recognition module and displaying the setting information of the entrants in the display module; the first AR module performs superposition processing on the generated setting information of the entrant and the real-time image acquired by the image acquisition device in the form of a label, and displays the image subjected to superposition processing in the display module; the position of the generated label and the face of the person entering the label meet set conditions, and the pixel value between the center of the label and the set position of the face is a set value; if the entrant has the access authority, displaying the related information of the entrant, and if the entrant has no authority or cannot identify the identity of the entrant, sending an alarm signal in a label flashing manner;
the display module is used for displaying setting information, and comprises: the real-time image information acquired by the image acquisition device, the information of an intruder displayed by the first AR module when the intruder intrudes, and the equipment information generated by the second AR module after the set area of the display module is touched by the touch screen; the display module comprises a touch display screen and can receive touch signals;
the touch area dividing module is used for dividing each area on the touch display screen and marking the corresponding identification of each area; the touch area dividing module divides the equipment area in the picture into specific areas according to the picture corresponding to the image acquisition device, and acquires area coordinate ranges corresponding to the specific areas;
the touch area acquisition module is used for acquiring touch point coordinate data of the touch display screen and judging whether the touch point is positioned in each specific area or not according to the touch point coordinate data and the area coordinate range of each specific area; if the specific area is located in a certain specific area, acquiring the corresponding specific area, and sending the identifier of the specific area to the control module;
the control module controls the second AR module to generate data of corresponding contents according to the acquired equipment information through the equipment information acquired by the equipment parameter acquisition module, and the data are displayed through the touch display screen;
the second AR module is used for generating equipment information according to the set equipment information acquired by the equipment parameter acquisition module and displaying the equipment information in the display module; the second AR module performs superposition processing on the generated information of the set equipment and the real-time image acquired by the image acquisition device in the form of a label, and displays the image subjected to superposition processing in the display module; the position of the generated label and the equipment meet the set condition, and the pixel value between the center of the generated label and the set point of the equipment is a set value; when the temperature or other parameters of the equipment do not accord with the running conditions of the equipment, an alarm signal is sent by generating a flashing label so as to remind related personnel of paying attention.
2. An intelligent monitoring system, comprising:
the image acquisition device is used for acquiring image information of the set area;
the database module is used for recording the setting information;
the intrusion judging module is used for judging whether a person enters a set area or not according to the real-time image information acquired by the image acquiring device;
the face tracking identification module is used for tracking the face information of the image information acquired by the image acquisition device, comparing and identifying the acquired face information with the set face information in the database module, and judging whether an entrant has the authority or not;
the device parameter acquisition module is used for acquiring the setting information of the device;
the first AR module is used for generating the information of the entrants who set to run according to the recognition result of the face tracking recognition module and displaying the setting information of the entrants in a display module;
the display module is used for displaying the setting information and comprises: the real-time image information acquired by the image acquisition device, the information of an intruder displayed by the first AR module when the intruder intrudes, and the equipment information generated by the second AR module after the set area of the display module is touched by the touch screen; the display module comprises a touch display screen;
the touch area dividing module is used for dividing each area on the touch display screen and marking the corresponding identification of each area; the touch area dividing module divides the equipment area in the picture into specific areas according to the picture corresponding to the image acquisition device, and acquires area coordinate ranges corresponding to the specific areas;
the touch area acquisition module is used for acquiring touch point coordinate data of the touch display screen and judging whether the touch point is positioned in each specific area; if the specific area is located in a certain specific area, acquiring the corresponding specific area, and sending the identifier of the specific area to a control module;
the control module controls a second AR module to generate data of corresponding contents according to the acquired equipment information through the equipment information acquired by the equipment parameter acquisition module, and the data are displayed through the touch display screen;
and the second AR module is used for generating equipment information according to the set equipment information acquired by the equipment parameter acquisition module and displaying the equipment information in the display module.
3. The intelligent monitoring system of claim 2, wherein:
the device parameter obtaining module is used for obtaining information of the device, wherein the information comprises at least one of device temperature, device model and device continuous starting time.
4. The intelligent monitoring system of claim 3, wherein:
the equipment parameter acquisition module comprises temperature sensors arranged on each piece of equipment and is used for acquiring the temperature information of the equipment.
5. The intelligent monitoring system of claim 2, wherein:
the intelligent monitoring system further comprises:
an image acquisition device angle acquisition module to acquire a pose of the image acquisition device.
6. The intelligent monitoring system of claim 5, wherein:
the touch area dividing module divides the equipment area in the picture into specific areas according to the pictures acquired by the image acquisition device under different postures, and acquires different area coordinate ranges of the specific areas of the image acquisition device under different postures.
7. The intelligent monitoring system of claim 2, wherein:
the first AR module performs superposition processing on the generated setting information of the entrant and the real-time image acquired by the image acquisition device in the form of a label, and displays the image subjected to superposition processing in a display module; the position of the generated label and the face of the person entering the label meet set conditions, and the pixel value between the center of the label and the set position of the face is a set value; if the entrant has the entrance authority, the related information of the entrant is displayed, and if the entrant has no authority or cannot identify the identity of the entrant, an alarm signal is sent out in a label flashing mode.
8. The intelligent monitoring system of claim 2, wherein:
the second AR module performs superposition processing on the generated information of the setting equipment and the real-time image acquired by the image acquisition device in the form of a label, and displays the image subjected to superposition processing in a display module; the position of the generated label and the equipment meet the set condition, and the pixel value between the center of the generated label and the set point of the equipment is a set value; when the temperature or other parameters of the equipment do not accord with the running conditions of the equipment, an alarm signal is sent by generating a flashing label so as to remind related personnel of paying attention.
9. An intelligent monitoring method of the intelligent monitoring system according to any one of claims 1 to 8, wherein the intelligent monitoring method comprises:
the image acquisition device acquires image information of a set area;
the equipment parameter acquisition module acquires the setting information of the equipment;
the intrusion judgment module judges whether a person enters a set area or not according to the real-time image information acquired by the image acquisition device; if the person enters the system, controlling a face tracking recognition module to perform face tracking recognition work;
the face tracking identification module tracks the face information of the image information acquired by the image acquisition device, compares the acquired face information with the set face information in the database module for identification, and judges whether the entrant has the authority or not;
the first AR module generates the information of the entrants who set to run according to the recognition result of the face tracking recognition module, and displays the setting information of the entrants in a display module;
the display module displays the setting information, including: the real-time image information acquired by the image acquisition device, the information of an intruder displayed by the first AR module when the intruder intrudes, and the equipment information generated by the second AR module after the set area of the display module is touched by the touch screen;
the touch area dividing module divides each area on the touch display screen and marks the corresponding identification of each area; the touch area dividing module divides the equipment area in the picture into specific areas according to the picture corresponding to the image acquisition device, and acquires area coordinate ranges corresponding to the specific areas;
a touch area acquisition module acquires coordinate data of a touch point of the touch display screen and judges whether the touch point is located in each specific area; if the specific area is located in a certain specific area, acquiring the corresponding specific area, and sending the identifier of the specific area to a control module;
the control module controls a second AR module to generate data of corresponding contents according to the acquired equipment information through the equipment information acquired by the equipment parameter acquisition module, and the data are displayed through the touch display screen;
and the second AR module generates equipment information according to the set equipment information acquired by the equipment parameter acquisition module and displays the equipment information in the display module.
10. An intelligent monitoring method of the intelligent monitoring system according to claim 1, wherein the intelligent monitoring method comprises:
the method comprises the steps that an image acquisition device acquires image information of a set area, wherein the image acquisition device comprises a camera device;
the equipment parameter acquisition module acquires the setting information of the equipment; the equipment information acquired by the equipment parameter acquisition module comprises at least one of equipment temperature, equipment model and equipment continuous starting time;
the intrusion judgment module judges whether a person enters a set area or not according to the real-time image information acquired by the image acquisition device; the intrusion judgment module is realized in an image comparison mode, and an image of a picture without a person entering is used as a reference image; the intrusion judgment module compares images acquired in real time or at set time intervals with reference images, if the similarity is lower than a set threshold, the intrusion judgment module judges that a person or an object enters, sends a signal to the control module, and controls the face tracking identification module to work;
the face tracking identification module tracks the face information of the image information acquired by the image acquisition device, compares the acquired face information with the set face information in the database module for identification, and judges whether the entrant has the authority or not;
the first AR module generates the information of the entrants who set to run according to the recognition result of the face tracking recognition module, and displays the setting information of the entrants in the display module; the first AR module performs superposition processing on the generated setting information of the entrant and the real-time image acquired by the image acquisition device in the form of a label, and displays the image subjected to superposition processing in the display module; the position of the generated label and the face of the person entering the label meet set conditions, and the pixel value between the center of the label and the set position of the face is a set value; if the entrant has the access authority, displaying the related information of the entrant, and if the entrant has no authority or cannot identify the identity of the entrant, sending an alarm signal in a label flashing manner;
the display module displays setting information, and the displayed information comprises: the real-time image information acquired by the image acquisition device, the information of an intruder displayed by the first AR module when the intruder intrudes, and the equipment information generated by the second AR module after the set area of the display module is touched by the touch screen;
the touch area dividing module divides each area on the touch display screen and marks the corresponding identification of each area; the touch area dividing module divides the equipment area in the picture into specific areas according to the picture corresponding to the image acquisition device, and acquires area coordinate ranges corresponding to the specific areas;
the touch area acquisition module acquires touch point coordinate data of the touch display screen and judges whether the touch point is located in each specific area or not according to the touch point coordinate data and the area coordinate range of each specific area; if the specific area is located in a certain specific area, acquiring the corresponding specific area, and sending the identifier of the specific area to the control module;
the control module controls the second AR module to generate data of corresponding contents according to the acquired equipment information through the equipment information acquired by the equipment parameter acquisition module, and the data are displayed through the touch display screen;
the second AR module generates equipment information according to the set equipment information acquired by the equipment parameter acquisition module and displays the equipment information in the display module; the second AR module performs superposition processing on the generated information of the set equipment and the real-time image acquired by the image acquisition device in the form of a label, and displays the image subjected to superposition processing in the display module; the position of the generated label and the equipment meet the set condition, and the pixel value between the center of the generated label and the set point of the equipment is a set value; when the temperature or other parameters of the equipment do not accord with the running conditions of the equipment, an alarm signal is sent by generating a flashing label so as to remind related personnel of paying attention.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910602655.9A CN112185043A (en) | 2019-07-05 | 2019-07-05 | Intelligent monitoring system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910602655.9A CN112185043A (en) | 2019-07-05 | 2019-07-05 | Intelligent monitoring system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112185043A true CN112185043A (en) | 2021-01-05 |
Family
ID=73915702
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910602655.9A Pending CN112185043A (en) | 2019-07-05 | 2019-07-05 | Intelligent monitoring system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112185043A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114268553A (en) * | 2021-09-28 | 2022-04-01 | 上海市建筑通信网络有限公司 | Cell-sharing communication facility AR positioning guidance system and method |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| AU5219093A (en) * | 1992-12-15 | 1994-06-30 | Nielsen Media Research, Inc. | Audience measurement system and method |
| CN105488817A (en) * | 2016-01-21 | 2016-04-13 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN106961595A (en) * | 2017-03-21 | 2017-07-18 | 深圳市科漫达智能管理科技有限公司 | A kind of video frequency monitoring method and video monitoring system based on augmented reality |
| CN109309808A (en) * | 2017-07-26 | 2019-02-05 | 梭维智能科技（深圳）有限公司 | A kind of monitoring system and method based on recognition of face |
| CN109800715A (en) * | 2019-01-22 | 2019-05-24 | 广东卓商网络科技有限公司 | A kind of discrepancy garden monitoring method and system based on Internet of Things |
-
2019
- 2019-07-05 CN CN201910602655.9A patent/CN112185043A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| AU5219093A (en) * | 1992-12-15 | 1994-06-30 | Nielsen Media Research, Inc. | Audience measurement system and method |
| CN105488817A (en) * | 2016-01-21 | 2016-04-13 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN106961595A (en) * | 2017-03-21 | 2017-07-18 | 深圳市科漫达智能管理科技有限公司 | A kind of video frequency monitoring method and video monitoring system based on augmented reality |
| CN109309808A (en) * | 2017-07-26 | 2019-02-05 | 梭维智能科技（深圳）有限公司 | A kind of monitoring system and method based on recognition of face |
| CN109800715A (en) * | 2019-01-22 | 2019-05-24 | 广东卓商网络科技有限公司 | A kind of discrepancy garden monitoring method and system based on Internet of Things |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114268553A (en) * | 2021-09-28 | 2022-04-01 | 上海市建筑通信网络有限公司 | Cell-sharing communication facility AR positioning guidance system and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110044486B (en) | Method, device and equipment for avoiding repeated alarm of human body inspection and quarantine system | |
| KR102021999B1 (en) | Apparatus for alarming thermal heat detection results obtained by monitoring heat from human using thermal scanner | |
| US9977971B2 (en) | Role-based tracking and surveillance | |
| CN106951849B (en) | Monitoring method and system for preventing children from accidents | |
| US10949657B2 (en) | Person's behavior monitoring device and person's behavior monitoring system | |
| US20030095782A1 (en) | System and method for detection and analysis of video recordings | |
| EP3789979A2 (en) | Video monitoring system with privacy features | |
| CN112800901A (en) | Mine personnel safety detection method based on visual perception | |
| CN111597879A (en) | Gesture detection method, device and system based on monitoring video | |
| CN113971782B (en) | Comprehensive monitoring information management method and system | |
| CN119360309B (en) | A computer-based intelligent security monitoring platform and system | |
| JP2005086626A (en) | Wide area monitoring device | |
| KR102043922B1 (en) | A cctv divided management system and method it | |
| CN110544312A (en) | Video display method and device in virtual scene, electronic equipment and storage device | |
| JP2021168015A5 (en) | ||
| CN110244923B (en) | Image display method and device | |
| CN112185043A (en) | Intelligent monitoring system and method | |
| CN118447445B (en) | Goods anti-theft method and system based on Internet of things technology | |
| JP7486117B2 (en) | Abandoned item monitoring device, abandoned item monitoring system including the same, and abandoned item monitoring method | |
| KR20190072323A (en) | Image Monitoring System and Method for Monitoring Image | |
| CN117376527A (en) | Double-flash copper smelting intelligent control method and device based on panoramic shooting technology | |
| US20030004913A1 (en) | Vision-based method and apparatus for detecting an event requiring assistance or documentation | |
| CN216053148U (en) | Security alarm system | |
| JP2020102676A (en) | Information processing device, information processing method, and program | |
| TWI730795B (en) | Multi-target human body temperature tracking method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |