Disclosure of Invention
In order to solve at least one of the technical problems, the application provides an intelligent safe operation method and device for a power distribution room, which are used for enhancing on the basis of displaying a transformer substation or a live power distribution room in a panoramic mode, adding information such as name, position, behavior case description or illegal rendering presentation to a real-time panoramic monitoring picture, replacing or assisting the safe behavior monitoring and early warning work of the power distribution room, ensuring the safety of equipment and operators to the maximum extent, and reducing risks and accidents caused by human factors. The safety of distribution substation and the stability of supplying power are promoted.
The application provides in a first aspect an intelligent safe operation method for a power distribution room, comprising the following steps: acquiring a real-time image of a monitoring area of a power distribution room; matching users in the real-time images in a user library, and determining the access level of the users to the power distribution room, wherein the users are divided into visitors, workers and non-worker-authority personnel according to the access level; identifying illegal operations of the user in the real-time image, and generating an early warning signal, wherein the illegal operations comprise a safety tool wearing violation of a worker, a position violation of a visitor, and an unlocking operation violation of a non-work authority worker.
Preferably, the acquiring a real-time image of the monitoring area of the distribution room includes: acquiring images shot by at least two panoramic cameras installed in the power distribution room; and synthesizing the images to obtain the three-dimensional panoramic monitoring image.
Preferably, the generating the warning signal includes: calling a corresponding prompt language in a database according to the violation operation type of the user, and sending the prompt language to the user; and rendering and presenting the illegal operation user at a monitoring end.
Preferably, rendering and presenting the violation operation user at the monitoring end includes: performing linkage real-time rendering presentation on the same illegal operation user in the images acquired by the multiple paths of cameras; and splicing the video of each path after re-rendering through a splicing algorithm to obtain rendering presentation in the three-dimensional panoramic monitoring image.
Preferably, identifying the violation by the user in the real-time image comprises: for the staff, marking human key points according to the real-time image, and determining whether corresponding safety tools exist at each human key point which is to be worn with the safety tools; for the visitors, determining the distance between the position of the user and the warning line, and determining whether the user crosses the warning line; and for the non-worker authority personnel, determining whether the non-worker authority personnel unlock the equipment without the operation authority.
The second aspect of the present application provides a distribution room intelligent security operation device, includes: the video acquisition module is used for acquiring a real-time image of a monitoring area of the distribution room; the user identification module is used for matching users in the real-time images in a user library and determining the access level of the users to the power distribution room, and the users are divided into visitors, workers and non-worker-authority personnel according to the access level; and the warning information generation module is used for identifying violation operations of the user in the real-time image and generating a warning signal, wherein the violation operations comprise a violation of wearing of a safety tool of a worker, a violation of a position of a visitor and an violation of an unlocking operation of a non-work authority worker.
Preferably, the video capture module includes: the image acquisition unit is used for acquiring images shot by at least two panoramic cameras installed in the power distribution room; and the image synthesis unit is used for synthesizing the images to acquire the three-dimensional panoramic monitoring image.
Preferably, the warning information generating module includes: the user side prompting unit calls a corresponding prompting word in a database according to the violation operation type of the user and sends the prompting word to the user; and the monitoring end prompting unit is used for rendering and presenting the user who violates the operation at the monitoring end.
Preferably, the monitoring end prompting unit includes: the linkage rendering subunit is used for performing linkage real-time rendering presentation on the same illegal user in the images acquired by the multiple paths of cameras; and the splicing subunit is used for splicing the newly rendered videos through a splicing algorithm to obtain the rendering presentation in the three-dimensional panoramic monitoring image.
Preferably, the alarm information generating module further includes violation operations for different users entering the distribution room, including: for the staff, marking human key points according to the real-time image, and determining whether corresponding safety tools exist at each human key point which is to be worn with the safety tools; for the visitors, determining the distance between the position of the user and the warning line, and determining whether the user crosses the warning line; and for the non-worker authority personnel, determining whether the non-worker authority personnel unlock the equipment without the operation authority.
This application is through discernment control personnel, and the suggestion of reporting an emergency and asking for help or increased vigilance is sent back to the different personnel that get into the monitor room automatically, with the violation information feedback of control to the monitor room simultaneously, has promoted the intellectuality of control.
Detailed Description
In order to make the implementation objects, technical solutions and advantages of the present application clearer, the technical solutions in the embodiments of the present application will be described in more detail below with reference to the accompanying drawings in the embodiments of the present application. In the drawings, the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The described embodiments are some, but not all embodiments of the present application. The embodiments described below with reference to the drawings are exemplary and intended to be used for explaining the present application, and should not be construed as limiting the present application. All other embodiments obtained by a person of ordinary skill in the art without any inventive work based on the embodiments in the present application are within the scope of protection of the present application. Embodiments of the present application will be described in detail below with reference to the drawings.
The application provides an intelligent safe operation method and device for a power distribution room, which adopt an artificial intelligence technology and a panoramic three-dimensional monitoring technology. The intelligent safety operation monitoring management and control are realized through the trinity of people, equipment and the system, and the reliability and the safety of the integral operation of the station room are improved.
In a first aspect, the present application provides a method for intelligent safe operation in a power distribution room, as shown in fig. 1, including:
step S1, acquiring a real-time image of a monitoring area of the distribution room;
step S2, matching users in the real-time images in a user library, and determining the access level of the users to the power distribution room, wherein the users are divided into visitors, workers and non-worker-authority personnel according to the access level;
and step S3, identifying violation operations of the user in the real-time image, and generating an early warning signal, wherein the violation operations comprise a safety tool wearing violation of a worker, a position violation of the visitor, and an unlocking operation violation of a non-work authority person.
In some optional embodiments, the acquiring a real-time image of the monitoring area of the distribution room comprises:
step S11, images shot by at least two panoramic cameras installed in the power distribution room are obtained;
and step S12, synthesizing the images to obtain a three-dimensional panoramic monitoring image.
In this application, at first select the power distribution station suitable position installation two to three panoramic camera to form the panorama control to the electricity distribution room, for example install two 360 degrees cameras, set up respectively at the both ends in power distribution station corridor, wherein the both sides in corridor in a plurality of rack settings are in the power distribution station.
The system hardware mainly comprises a panoramic camera, a video coding server, an operator safety tool analysis server and an alarm device. The video acquisition camera system, the video server and the alarm device can use the existing equipment system in the power distribution station. The server of the early warning system needs to be provided with a high-performance neural network computing unit for supporting an intelligent monitoring function.
In step S2, relevant person information is entered first, and information is entered for workers who can operate the distribution substation equipment and for other persons who cannot operate the equipment but have authority to monitor, and the user appearing in the monitoring screen is deeply learned by using the face recognition technology based on deep learning, so that the two persons can be recognized and the other persons can be identified as visitors.
It should be noted that, the deep learning for face recognition may also be used to establish a user library, and the staff in the user library has its operating right for a specific device bound, for example, the user a has an operating right for the device a, the user B has an operating right for the device B, and the user C has an operating right for both the device a and the device B, so that when generating the alarm information in step S3, even for the staff, the alarm information is generated for the staff who exceed the operating right (for example, the user B operates the device a).
In the above embodiment, in step S3, an object recognition technique based on deep learning is also adopted, so as to implement a function of recognizing a safety tool through a video image, and achieve an early warning purpose of wearing the safety tool for a worker.
In step S3, the image information of the operator is captured by the panoramic camera, and the carrying condition of the safety tool of the operator is monitored by using an image-based detection and analysis method. And giving early warning prompt according to the actual regulation and regulation.
In some optional embodiments, the generating the warning signal comprises:
step S31, calling a corresponding prompt in a database according to the violation operation type of the user, and sending the prompt to the user;
and step S32, rendering and presenting the illegal operation user at the monitoring end.
In some optional embodiments, rendering and presenting the violation operation by the user at the monitoring end includes:
s321, performing linkage real-time rendering presentation on the same violation operation user in the images acquired by the multiple paths of cameras;
and S322, splicing the newly rendered videos through a splicing algorithm to obtain rendering presentation in the three-dimensional panoramic monitoring image.
It can be understood that the video is rendered in real time and early-warned to obtain the videos in the multiple paths of cameras, and when early-warning information occurs, the real-time rendering warning module is linked to present in the video in the paths, so that the digital twin effect is achieved. For each path of video after re-rendering, each path of video can be spliced through an efficient splicing algorithm, so that the early warning effect in the panoramic video is achieved.
In some optional embodiments, identifying the violating actions of the user in the real-time image comprises:
for the staff, marking human key points according to the real-time image, and determining whether corresponding safety tools exist at each human key point which is to be worn with the safety tools;
for the visitors, determining the distance between the position of the user and the warning line, and determining whether the user crosses the warning line;
and for the non-worker authority personnel, determining whether the non-worker authority personnel unlock the equipment without the operation authority.
For example, when a worker enters, two aspects of monitoring are mainly included, one is identity authentication, and the other is violation authentication, for identity authentication, the system firstly determines the identity of the worker, obtains the access right of the worker through the database, and comprises which devices can be operated and which devices cannot be operated, namely determines the access level of the worker relative to the devices, and for non-operated devices, the worker can be classified as a non-worker-authority person or a visiting person. For operable equipment, it is a worker.
For violation identification, since the violation identification belongs to the staff, whether the corresponding safety tool exists at each key point of the human body which should wear the safety tool is determined, for example, if the worker finds that the worker does not wear the work clothes through image recognition, the sound in the warning voice database can be called to prompt the related staff. For example, the alert and warning phrase may be:
and (3) warning of dressing irregularity of workers: "the work dressing is not standardized, please check the safety helmet"; "the work dressing is not standardized, please check the insulating gloves"; "the dress is not standard in the work, please check the insulating shoes"; "dressing is not standardized, please check cotton uniform".
It will be appreciated that no reminder is given to the visitor.
In another embodiment, a worker may enter the work area and a visitor may enter the substation, but the feet cannot touch the fence and the hands cannot touch the equipment. Reminding and early warning terms are as follows:
early warning of non-work order authority personnel: "unauthorized person, Do not unlock operation"; the work order authority personnel remind: "go to next step"; early warning for visitors: "you have crossed the warning line, please go back"; "dangerous behavior, do not need to approach" and no warning is given to the staff.
It can be understood that the method is applied to the server side, the device for reminding the user can be a handheld terminal of the user or a device installed in the distribution station, if the device is the handheld terminal of the user, the terminals installed at different devices of the distribution station need to be recorded, the server side is provided with a terminal list, and after illegal operations of different distribution station devices are detected, the called alarm information can be accurately sent to alarm terminals of different distribution station devices. In addition, the application also has a monitoring end, which comprises a plurality of monitoring devices which are installed in the monitoring room and can present a plurality of monitoring pictures, and can also comprise a handheld monitoring end, wherein the handheld monitoring end can be a 3D monitoring picture, for example, desktop software which is installed on a mobile phone and supports 3D panoramic playing is installed, so that the immersive playing of the panoramic video in the terminal is ensured. The software supports seamless switching of the plurality of panoramic cameras, and realizes a mode of switching similar scenes, so that the effect of freely switching similar roaming of the plurality of panoramic cameras is ensured.
In order to ensure the transmission performance of video or images, the method adopts
(1) The real-time stream forwarding technology ensures short playing delay of the panoramic video.
(2) The video coding and decoding compression and the effective video coding compression can greatly relieve the pressure on the bandwidth, thereby reducing the dependence on hardware equipment and greatly accelerating the transmission speed.
(3) The video is encrypted, and in the transmission process, in order to prevent the possible problems of monitoring and the like, the panoramic video is encrypted, so that the absolute safety in the transmission process of the panoramic video is ensured.
In a second aspect, the present application provides a distribution room intelligent safety operation device corresponding to the above method, as shown in fig. 2, including:
the video acquisition module 100 is used for acquiring a real-time image of a monitoring area of the distribution room;
the user identification module 200 is used for matching users in the real-time images in a user library and determining the access level of the users to the power distribution room, wherein the users are divided into visitors, workers and non-working authority personnel according to the access level;
and the warning information generating module 300 is configured to identify violation operations of the user in the real-time image, and generate a warning signal, where the violation operations include a violation of wearing of a safety tool of a worker, a violation of a location of the visitor, and a violation of an unlocking operation of a non-worker-authority person.
In some optional embodiments, the video capture module comprises:
the image acquisition unit is used for acquiring images shot by at least two panoramic cameras installed in the power distribution room;
and the image synthesis unit is used for synthesizing the images to acquire the three-dimensional panoramic monitoring image.
In some optional embodiments, the warning information generating module includes:
the user side prompting unit calls a corresponding prompting word in a database according to the violation operation type of the user and sends the prompting word to the user; and
and the monitoring end prompting unit is used for rendering and presenting the user of the illegal operation at the monitoring end.
In some optional embodiments, the monitoring end prompting unit includes:
the linkage rendering subunit is used for performing linkage real-time rendering presentation on the same illegal user in the images acquired by the multiple paths of cameras;
and the splicing subunit is used for splicing the newly rendered videos through a splicing algorithm to obtain the rendering presentation in the three-dimensional panoramic monitoring image.
In some optional embodiments, the alarm information generation module further comprises violation operations for different users entering the distribution room, including:
for the staff, marking human key points according to the real-time image, and determining whether corresponding safety tools exist at each human key point which is to be worn with the safety tools;
for the visitors, determining the distance between the position of the user and the warning line, and determining whether the user crosses the warning line;
and for the non-worker authority personnel, determining whether the non-worker authority personnel unlock the equipment without the operation authority.
This application is through discernment control personnel, and the suggestion of reporting an emergency and asking for help or increased vigilance is sent back to the different personnel that get into the monitor room automatically, with the violation information feedback of control to the monitor room simultaneously, has promoted the intellectuality of control.
In particular, according to an embodiment of the application, the procedure described above with reference to the flow chart may be implemented as a computer software program comprising program code for performing the method illustrated by the flow chart. The computer storage media of the present application may be computer-readable signal media or computer-readable storage media or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
In the present application, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In this application, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The modules or units described in the embodiments of the present application may be implemented by software or hardware. The modules or units described may also be provided in a processor, the names of which in some cases do not constitute a limitation of the module or unit itself.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present application should be covered within the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.