[go: up one dir, main page]

CN111107139A - Information pushing method and related product - Google Patents

Information pushing method and related product Download PDF

Info

Publication number
CN111107139A
CN111107139A CN201911269070.6A CN201911269070A CN111107139A CN 111107139 A CN111107139 A CN 111107139A CN 201911269070 A CN201911269070 A CN 201911269070A CN 111107139 A CN111107139 A CN 111107139A
Authority
CN
China
Prior art keywords
equipment
target
preset
abnormal
video data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201911269070.6A
Other languages
Chinese (zh)
Other versions
CN111107139B (en
Inventor
田岱
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wanyi Technology Co Ltd
Original Assignee
Wanyi Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wanyi Technology Co Ltd filed Critical Wanyi Technology Co Ltd
Priority to CN201911269070.6A priority Critical patent/CN111107139B/en
Publication of CN111107139A publication Critical patent/CN111107139A/en
Application granted granted Critical
Publication of CN111107139B publication Critical patent/CN111107139B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/55Push-based network services
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/52Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • G06V20/53Recognition of crowd images, e.g. recognition of crowd congestion
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Traffic Control Systems (AREA)
  • Alarm Systems (AREA)

Abstract

The embodiment of the application discloses an information pushing method and a related product, which are applied to an article sensing device, wherein the article sensing device is connected with a plurality of terminal devices, and the method comprises the following steps: when detecting that a target terminal device in the plurality of terminal devices is in an unconnected state, acquiring video data of a target area corresponding to the target terminal device within a preset time; executing a pedestrian detection algorithm on the video data to obtain the total number of pedestrians contained in the video data; judging whether the total number of people is greater than a preset threshold value, if so, acquiring the equipment type corresponding to the target terminal equipment, and determining that the equipment type is in an abnormal state; and generating equipment abnormal information according to the total number of people and the equipment type, and pushing the abnormal information to a preset mobile terminal. The embodiment of the application has the advantage of high user experience.

Description

Information pushing method and related product
Technical Field
The present application relates to the field of information technologies, and in particular, to an information pushing method and a related product.
Background
With the rapid development of electronic technology and the development of office equipment, various office equipment is generally placed in offices at present.
At present, office equipment quantity of offices is limited, the number of workers is far greater than the number of office equipment, the situation that the office equipment is insufficient often occurs, however, a method capable of detecting the situation that the office equipment is insufficient is still lacking at present, so that the office efficiency is low, and the user experience degree is low.
Disclosure of Invention
The embodiment of the application provides an information pushing method and a related product, which are beneficial to judging abnormal conditions according to the total number of pedestrians detected when a terminal device is used, so that the condition that the number of devices is insufficient can be found in time, and the user experience degree can be improved.
In a first aspect, an embodiment of the present application provides an information pushing method, which is applied to an article sensing device, where the article sensing device is connected to a plurality of terminal devices, and the method includes:
when detecting that a target terminal device in the plurality of terminal devices is in an unconnected state, acquiring video data of a target area corresponding to the target terminal device within a preset time;
executing a pedestrian detection algorithm on the video data to obtain the total number of pedestrians contained in the video data;
judging whether the total number of people is greater than a preset threshold value, if so, acquiring the equipment type corresponding to the target terminal equipment, and determining that the equipment type is in an abnormal state;
and generating equipment abnormal information according to the total number of people and the equipment type, and pushing the abnormal information to a preset mobile terminal.
In a second aspect, an embodiment of the present application provides an information pushing apparatus, which is applied to an article sensing device, where the article sensing device is connected to a plurality of terminal devices, and the apparatus includes:
the acquisition unit is used for acquiring video data of a target area corresponding to the target terminal device within preset time when the target terminal device in the plurality of terminal devices is detected to be in an unconnected state;
the detection unit is used for executing a pedestrian detection algorithm on the video data to obtain the total number of pedestrians contained in the video data;
the judging unit is used for judging whether the total number of people is greater than a preset threshold value, if so, acquiring the equipment type corresponding to the target terminal equipment, and determining that the equipment type is in an abnormal state;
and the pushing unit is used for generating equipment abnormal information according to the total number of people and the equipment type and pushing the abnormal information to a preset mobile terminal.
In a third aspect, an embodiment of the present application provides an article sensing apparatus, including a controller, a memory, a communication interface, and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the controller, and the program includes instructions for executing steps in any method of the first aspect of the embodiment of the present application.
In a fourth aspect, the present application provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program for electronic data exchange, where the computer program makes a computer perform part or all of the steps described in any one of the methods of the first aspect of the present application.
In a fifth aspect, the present application provides a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to perform some or all of the steps as described in any one of the methods of the first aspect of the embodiments of the present application. The computer program product may be a software installation package.
It can be seen that, in the embodiment of the application, when detecting that a target terminal device in the plurality of terminal devices is in an unconnected state, the article sensing device acquires video data of a target area corresponding to the target terminal device within a preset time; executing a pedestrian detection algorithm on the video data to obtain the total number of pedestrians contained in the video data; judging whether the total number of people is greater than a preset threshold value, if so, acquiring the equipment type corresponding to the target terminal equipment, and determining that the equipment type is in an abnormal state; and generating equipment abnormal information according to the total number of people and the equipment type, and pushing the abnormal information to a preset mobile terminal. Therefore, the total number of the pedestrians is determined by acquiring the video data to execute the pedestrian detection, the abnormal condition is determined according to the total number of the pedestrians, the condition that the number of the devices is insufficient can be found in time, and the improvement of the user experience degree is facilitated.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic flowchart of an information pushing method provided in an embodiment of the present application;
fig. 2 is a schematic flowchart of another information pushing method provided in an embodiment of the present application;
fig. 3 is a schematic flowchart of another information pushing method provided in an embodiment of the present application;
fig. 4 is a schematic flowchart of another information pushing method provided in an embodiment of the present application;
FIG. 5 is a schematic structural diagram of an article sensing device according to an embodiment of the present disclosure;
fig. 6 is a block diagram of functional units of an information pushing apparatus according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The terms "first," "second," "third," and "fourth," etc. in the description and claims of the invention and in the accompanying drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, result, or characteristic described in connection with the embodiment can be included in at least one embodiment of the invention. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
The item aware devices may include various handheld devices with wireless communication capabilities, in-vehicle devices, wearable devices (e.g., smartwatches, smartbands, pedometers, etc.), computing devices or other processing devices communicatively connected to wireless modems, as well as various forms of User Equipment (UE), Mobile Stations (MS), terminal devices (terminal device), and so forth. For convenience of description, the above-mentioned devices are collectively referred to as article sensing devices.
Referring to fig. 1, fig. 1 is a schematic flow chart of an information pushing method provided in an embodiment of the present application, and is applied to an article sensing device, where the article sensing device is connected to a plurality of terminal devices, as shown in the figure, the information pushing method includes:
step 101, when detecting that a target terminal device in the plurality of terminal devices is in an unconnected state, acquiring video data of a target area corresponding to the target terminal device within a preset time;
optionally, a current device connection report is obtained, where the current device connection report includes: and obtaining a preset terminal equipment connection record according to the terminal equipment name for performing network connection with the article sensing equipment at the current time, and determining the target terminal equipment in the unconnected state according to the current equipment connection report and the preset terminal equipment connection record.
Optionally, the plurality of terminal devices are connected to a plurality of sensors, where the plurality of sensors are connected to the article sensing device through a wireless communication network, where the wireless communication network may include: the method includes the steps that a wireless fidelity Wi-Fi network, a bluetooth network, a cellular data network and the like are not limited, when the fact that the distance between the sensor and the article sensing device is larger than a preset threshold value is detected, the sensor and the article sensing device are determined to be in an unconnected state, a terminal device corresponding to the sensor is determined to be in an unconnected state, and the terminal device is determined to be a target terminal device.
Optionally, when detecting that a target terminal device in the plurality of terminal devices is in an unconnected state, starting a camera module corresponding to the target terminal device, where a shooting area corresponding to the camera module is a target area corresponding to the target terminal device, setting a timing controller, where the timing controller is configured to control the camera module, and when the time of the timing controller is consistent with a preset time, stopping running the camera module, and receiving video data collected by the camera module within the preset time, where the video data is video data of the target area corresponding to the target terminal device within the preset time.
102, executing a pedestrian detection algorithm on the video data to obtain the total number of pedestrians contained in the video data;
wherein, the pedestrian detection algorithm may include: a pedestrian detection algorithm based on Haar wavelet features, a pedestrian detection algorithm based on HOG features, a pedestrian detection algorithm based on edgelet features, a pedestrian detection algorithm based on Shapelet features, and the like, which are not limited herein.
In the embodiment of the present application, the Pedestrian Detection (Pedestrian Detection) is to determine whether there is a Pedestrian in an image or a video sequence by using a computer vision technology and to give an accurate positioning. The technology can be combined with technologies such as pedestrian tracking and pedestrian re-identification, and is applied to the fields of artificial intelligence systems, vehicle driving assistance systems, intelligent robots, intelligent video monitoring, human body behavior analysis, intelligent transportation and the like.
103, judging whether the total number of people is greater than a preset threshold value, if so, acquiring the equipment type corresponding to the target terminal equipment, and determining that the equipment type is in an abnormal state;
wherein, the preset threshold may include: 10. 20, 30, etc., without limitation.
In the specific implementation process, a pedestrian detection algorithm is executed on video data, the total number of pedestrians contained in the video data is determined, a preset threshold value is obtained and is 10, the total number of pedestrians is determined to be larger than the preset threshold value, namely, a plurality of use requests are determined to be received in the use process of the target terminal device, if the target terminal device is determined to be a printer, the device type corresponding to the target terminal device is determined to be a printer type, the printer type is determined to be in an abnormal state, and the abnormal state is used for indicating that the device type is in an insufficient number state.
And 104, generating equipment abnormal information according to the total number of people and the equipment type, and pushing the abnormal information to a preset mobile terminal.
Optionally, generating the device abnormality information according to the total number of people and the device type may include:
in a possible example, the generating device anomaly information according to the headcount and the device type includes: determining an abnormal grade corresponding to the total number of people according to a preset mapping relation between the number of people and the grade; extracting an electronic map, acquiring a target position corresponding to the target equipment, and generating an equipment position map according to the target position and the electronic map; generating a target device strategy according to the device position diagram and the abnormal level; and generating the abnormal information according to the target equipment strategy and the abnormal grade.
Wherein, the preset mapping relationship between the number of people and the level may include:
number of people Grade
<10 1
10≤X<15 2
15≤X<20 3
≥20 4
And is not limited herein.
With reference to the foregoing embodiment, an example is described below, in which a preset mapping relationship between the number of people and the level is obtained, assuming that a pedestrian detection algorithm performed on video data determines that the total number of people in the video data is 15, and the abnormal level corresponding to the total number of people 15 is determined to be 3 according to the preset mapping relationship between the number of people and the level.
Optionally, an electronic map is extracted, where the electronic map is a planar electronic map of a current office area, and the electronic map includes: a plurality of office areas and a plurality of device areas, acquiring a target position corresponding to the target terminal device, marking the electronic map according to the target position to obtain the device position map, determining a target device area corresponding to the target terminal device according to the device position map, determining a target device policy according to the target device area and the exception level, and generating exception information according to the target policy and the exception level, wherein the exception information may further include: headcount, device location map, etc., without limitation.
In a possible example, the generating a target device policy from the device location map and the anomaly level includes: determining the equipment number corresponding to the abnormal grade according to the mapping relation between the preset grade and the equipment number; and determining a target range by taking the target position as a circle center and a preset range threshold as a radius in the equipment position diagram, and setting equipment of the equipment type corresponding to the equipment number in the target range.
In a specific implementation process, acquiring a mapping relation between a preset grade and the number of devices, determining the number of devices corresponding to an abnormal grade according to the mapping relation between the grade and the number of devices, assuming that the abnormal grade is 3, determining the number of devices corresponding to the abnormal grade 3 according to the mapping relation between the grade and the number of devices to be 4, determining a target range by taking the target terminal device as a circle center and preset range thresholds (for example, 2 meters, 3 meters, 4 meters and the like, which are not limited herein) as a radius, acquiring the number of existing devices corresponding to the type of the devices in the target range, and setting the devices of the device types corresponding to the number of the devices in the target range according to the number of the existing devices; for example, if the target terminal device is a printer, the device type is a printer type, the number of existing devices of the printer type devices included in the target range is 2, and the number of devices determined according to the abnormal level is 4, it is determined that 4 printer type devices are set in the target range, and the target device policy is determined according to the number of existing devices 2: within this target range, 2 printer-like devices were added.
Optionally, the foregoing examples may further include: determining the equipment number corresponding to the abnormal grade according to the mapping relation between the preset grade and the equipment number; and determining a target equipment area corresponding to the target terminal equipment according to the equipment position diagram, and setting equipment of the equipment type corresponding to the equipment number in the target equipment area.
The mapping relationship between the preset level and the number of the devices may include:
Figure BDA0002313663220000061
Figure BDA0002313663220000071
and is not limited herein. In a possible example, after the pushing the abnormal information to the preset mobile terminal, the method further includes: executing face recognition on the video data, and determining a plurality of target mobile terminals corresponding to a plurality of faces contained in the video data; acquiring at least one equipment address of at least one terminal equipment corresponding to the equipment type; and pushing the at least one equipment address to the plurality of target mobile terminals.
Optionally, before performing face recognition on the video data, the method further includes: when a pedestrian detection algorithm is executed on video data, a plurality of face images of the pedestrians are intercepted in the video data.
Further, performing face recognition on the video data, comprising: executing a face recognition algorithm aiming at a plurality of face images of the pedestrians to obtain a preset face database, comparing the face images in the face database, determining a plurality of face templates corresponding to the face images, and determining a plurality of preset personnel information corresponding to the face templates.
Optionally, a plurality of target mobile terminals corresponding to the plurality of faces are determined according to the plurality of pieces of preset personal information, at least one terminal device corresponding to the device type and at least one device address corresponding to the at least one terminal device are obtained, the device location map is marked according to the at least one device address, a device distribution map is obtained, and the device distribution map and the at least one device address are pushed to the plurality of target mobile terminals.
In one possible example, the item sensing apparatus comprises: an infrared module, the method further comprising: receiving an infrared data set of the target area acquired by the infrared module within a preset time, and extracting a plurality of infrared images from the infrared data set; executing face detection on the plurality of infrared images to obtain the number of faces corresponding to the plurality of infrared images; and judging whether the face number is greater than a preset face number threshold, and if the face number is greater than the face number threshold, determining that the equipment type is in an abnormal state.
Optionally, an infrared data set of a target area acquired by the infrared module within a preset time is received, where the infrared data set includes: the method includes the steps of extracting a plurality of infrared images from the infrared data set, and performing face detection on the plurality of infrared images, wherein the face detection is used for determining the number of faces contained in the plurality of infrared images and acquiring a preset face number threshold, and the face number threshold may include: 5. 10, 15, etc., which are not limited herein, determining whether the number of faces is greater than the face number threshold, and if so, determining that the type corresponding to the target terminal device is in an abnormal state.
In a possible example, the method further comprises: extracting a plurality of infrared ranging values from the infrared data; calculating the proportion of infrared ranging values smaller than a preset distance threshold value in the plurality of infrared ranging values; and judging whether the ratio is greater than a preset ratio threshold value, and if the ratio is greater than the ratio threshold value, determining that the equipment type is in an abnormal state.
Wherein the distance threshold may include: 10 meters, 20 meters, 30 meters, etc., without limitation thereto.
Optionally, calculating a ratio of the infrared ranging values smaller than the preset distance threshold among the plurality of infrared ranging values includes: determining the total number Y of the infrared ranging values, wherein Y is not less than 0, obtaining the total number X of the infrared ranging values smaller than a preset distance threshold in the infrared ranging values, wherein X is not less than 0 and not more than Y, obtaining a preset proportion calculation formula, and calculating the total number Y and the total number X as the input of the proportion calculation formula to obtain a proportion Z, wherein the proportion calculation formula can include: and Z is X/Y100%.
It can be seen that, in the embodiment of the application, when detecting that a target terminal device in the plurality of terminal devices is in an unconnected state, the article sensing device acquires video data of a target area corresponding to the target terminal device within a preset time; executing a pedestrian detection algorithm on the video data to obtain the total number of pedestrians contained in the video data; judging whether the total number of people is greater than a preset threshold value, if so, acquiring the equipment type corresponding to the target terminal equipment, and determining that the equipment type is in an abnormal state; and generating equipment abnormal information according to the total number of people and the equipment type, and pushing the abnormal information to a preset mobile terminal. Therefore, the total number of the pedestrians is determined by acquiring the video data to execute the pedestrian detection, the abnormal condition is determined according to the total number of the pedestrians, the condition that the number of the devices is insufficient can be found in time, and the improvement of the user experience degree is facilitated.
Referring to fig. 2, fig. 2 is a schematic flow chart of another information pushing method provided in an embodiment of the present application, and the information pushing method is applied to an article sensing device, where the article sensing device is connected to a plurality of terminal devices, as shown in the figure, the information pushing method includes:
step 201, when detecting that a target terminal device in the plurality of terminal devices is in an unconnected state, acquiring video data of a target area corresponding to the target terminal device within a preset time;
step 202, executing a pedestrian detection algorithm on the video data to obtain the total number of pedestrians contained in the video data;
step 203, judging whether the total number of people is greater than a preset threshold value, if so, acquiring the equipment type corresponding to the target terminal equipment, and determining that the equipment type is in an abnormal state;
step 204, determining an abnormal grade corresponding to the total number of people according to a preset mapping relation between the number of people and the grade;
step 205, extracting an electronic map, acquiring a target position corresponding to the target device, and generating a device position map according to the target position and the electronic map;
step 206, generating a target device strategy according to the device position diagram and the abnormal level;
and step 207, generating the abnormal information according to the target device strategy and the abnormal grade, and pushing the abnormal information to a preset mobile terminal.
The detailed description of the steps 201 to 207 may refer to the corresponding steps of the information pushing method described in the above fig. 1, and will not be described herein again.
It can be seen that, in the embodiment of the application, when detecting that a target terminal device in the plurality of terminal devices is in an unconnected state, the article sensing device acquires video data of a target area corresponding to the target terminal device within a preset time; executing a pedestrian detection algorithm on the video data to obtain the total number of pedestrians contained in the video data; judging whether the total number of people is greater than a preset threshold value, if so, acquiring the equipment type corresponding to the target terminal equipment, and determining that the equipment type is in an abnormal state; determining the abnormal grade corresponding to the total number of people according to the preset mapping relation between the number of people and the grade; extracting an electronic map, acquiring a target position corresponding to the target equipment, and generating an equipment position map according to the target position and the electronic map; generating a target device strategy according to the device position diagram and the abnormal level; and generating the abnormal information according to the target equipment strategy and the abnormal grade, and pushing the abnormal information to a preset mobile terminal. Therefore, the total number of the pedestrians is determined by acquiring the video data to execute the pedestrian detection, the abnormal condition is determined according to the total number of the pedestrians, the condition that the number of the devices is insufficient can be found in time, and the improvement of the user experience degree is facilitated.
Referring to fig. 3, fig. 3 is a schematic flow chart of another information pushing method provided in an embodiment of the present application, and is applied to an article sensing device, where the article sensing device is connected to a plurality of terminal devices, as shown in the figure, the information pushing method includes:
step 301, when detecting that a target terminal device in the plurality of terminal devices is in an unconnected state, acquiring video data of a target area corresponding to the target terminal device within a preset time;
step 302, executing a pedestrian detection algorithm on the video data to obtain the total number of pedestrians contained in the video data;
step 303, judging whether the total number of people is greater than a preset threshold value, if so, acquiring the equipment type corresponding to the target terminal equipment, and determining that the equipment type is in an abnormal state;
step 304, generating abnormal equipment information according to the total number of people and the equipment type, and pushing the abnormal equipment information to a preset mobile terminal;
step 305, performing face recognition on the video data, and determining a plurality of target mobile terminals corresponding to a plurality of faces contained in the video data;
step 306, acquiring at least one device address of at least one terminal device corresponding to the device type;
step 307, pushing the at least one device address to the plurality of target mobile terminals.
For the detailed description of steps 301 to 307, reference may be made to corresponding steps of the information pushing method described in fig. 1, and details are not repeated here.
It can be seen that, in the embodiment of the application, when detecting that a target terminal device in the plurality of terminal devices is in an unconnected state, the article sensing device acquires video data of a target area corresponding to the target terminal device within a preset time; executing a pedestrian detection algorithm on the video data to obtain the total number of pedestrians contained in the video data; judging whether the total number of people is greater than a preset threshold value, if so, acquiring the equipment type corresponding to the target terminal equipment, and determining that the equipment type is in an abnormal state; generating equipment abnormal information according to the total number of people and the equipment type, and pushing the abnormal information to a preset mobile terminal; executing face recognition on the video data, and determining a plurality of target mobile terminals corresponding to a plurality of faces contained in the video data; acquiring at least one equipment address of at least one terminal equipment corresponding to the equipment type; and pushing the at least one equipment address to the plurality of target mobile terminals. Therefore, the total number of pedestrians is determined by acquiring the video data and executing pedestrian detection, abnormal conditions are determined according to the total number of the pedestrians, the condition that the number of the equipment is insufficient can be found in time, a plurality of faces in the video data can be identified through face recognition, equipment addresses of the same equipment type are pushed to the faces, and improvement of user experience is facilitated.
Referring to fig. 4, fig. 4 is a schematic flow chart of another information pushing method provided in an embodiment of the present application, and the information pushing method is applied to an article sensing device, where the article sensing device is connected to a plurality of terminal devices, as shown in the figure, the information pushing method includes:
step 401, when detecting that a target terminal device in the plurality of terminal devices is in an unconnected state, receiving an infrared data set of the target area acquired by the infrared module within a preset time, and extracting a plurality of infrared images from the infrared data set;
step 402, performing face detection on the plurality of infrared images to obtain the number of faces corresponding to the plurality of infrared images;
step 403, judging whether the number of the human faces is greater than a preset human face number threshold, and if the number of the human faces is greater than the human face number threshold, determining that the equipment type is in an abnormal state.
And 404, generating equipment abnormal information according to the number of the faces and the equipment type, and pushing the abnormal information to a preset mobile terminal.
The detailed description of the steps 401 to 404 may refer to the corresponding steps of the information pushing method described in fig. 1, and is not repeated herein.
It can be seen that, in the embodiment of the present application, when detecting that a target terminal device of the plurality of terminal devices is in an unconnected state, the article sensing device receives an infrared data set of the target area, which is acquired by the infrared module within a preset time, and extracts a plurality of infrared images from the infrared data set; executing face detection on the plurality of infrared images to obtain the number of faces corresponding to the plurality of infrared images; and judging whether the face number is greater than a preset face number threshold, and if the face number is greater than the face number threshold, determining that the equipment type is in an abnormal state. And generating equipment abnormal information according to the number of the faces and the equipment type, and pushing the abnormal information to a preset mobile terminal. Therefore, the number of the faces in the preset time is determined by collecting the infrared data, the abnormal condition is determined according to the number of the faces, the condition that the number of the devices is insufficient can be found in time, and the improvement of the user experience degree is facilitated.
Referring to fig. 5, fig. 5 is a schematic structural diagram of an article sensing apparatus 500 according to an embodiment of the present application, and as shown in the drawing, the article sensing apparatus 500 includes: an application processor 510, a memory 520, a communication interface 530, and one or more programs 521, wherein the one or more programs 521 are stored in the memory 520 and configured to be executed by the application processor 510, the one or more programs 521 including instructions for: embodiments of the present application also provide a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, the computer program enabling a computer to perform part or all of the steps of any one of the methods as described in the above method embodiments, and the computer includes an article sensing device.
When detecting that a target terminal device in the plurality of terminal devices is in an unconnected state, acquiring video data of a target area corresponding to the target terminal device within a preset time;
executing a pedestrian detection algorithm on the video data to obtain the total number of pedestrians contained in the video data;
judging whether the total number of people is greater than a preset threshold value, if so, acquiring the equipment type corresponding to the target terminal equipment, and determining that the equipment type is in an abnormal state;
and generating equipment abnormal information according to the total number of people and the equipment type, and pushing the abnormal information to a preset mobile terminal.
It can be seen that, in the embodiment of the application, when detecting that a target terminal device in the plurality of terminal devices is in an unconnected state, the article sensing device acquires video data of a target area corresponding to the target terminal device within a preset time; executing a pedestrian detection algorithm on the video data to obtain the total number of pedestrians contained in the video data; judging whether the total number of people is greater than a preset threshold value, if so, acquiring the equipment type corresponding to the target terminal equipment, and determining that the equipment type is in an abnormal state; and generating equipment abnormal information according to the total number of people and the equipment type, and pushing the abnormal information to a preset mobile terminal. Therefore, the total number of the pedestrians is determined by acquiring the video data to execute the pedestrian detection, the abnormal condition is determined according to the total number of the pedestrians, the condition that the number of the devices is insufficient can be found in time, and the improvement of the user experience degree is facilitated.
In a possible example, in the aspect of generating the device abnormality information according to the headcount and the device type, the instructions in the program are specifically configured to perform the following operations: determining an abnormal grade corresponding to the total number of people according to a preset mapping relation between the number of people and the grade; extracting an electronic map, acquiring a target position corresponding to the target equipment, and generating an equipment position map according to the target position and the electronic map; generating a target device strategy according to the device position diagram and the abnormal level; and generating the abnormal information according to the target equipment strategy and the abnormal grade.
In one possible example, in the aspect of generating the target device policy according to the device location map and the anomaly level, the instructions in the program are specifically configured to perform the following operations: determining the equipment number corresponding to the abnormal grade according to the mapping relation between the preset grade and the equipment number; and determining a target range by taking the target position as a circle center and a preset range threshold as a radius in the equipment position diagram, and setting equipment of the equipment type corresponding to the equipment number in the target range.
In a possible example, in terms of after the pushing of the abnormal information to the preset mobile terminal, the instructions in the program are further configured to: executing face recognition on the video data, and determining a plurality of target mobile terminals corresponding to a plurality of faces contained in the video data; acquiring at least one equipment address of at least one terminal equipment corresponding to the equipment type; and pushing the at least one equipment address to the plurality of target mobile terminals.
In one possible example, the item sensing apparatus comprises: the infrared module, the instruction in the procedure is still used for carrying out the following operation: receiving an infrared data set of the target area acquired by the infrared module within a preset time, and extracting a plurality of infrared images from the infrared data set; executing face detection on the plurality of infrared images to obtain the number of faces corresponding to the plurality of infrared images; and judging whether the face number is greater than a preset face number threshold, and if the face number is greater than the face number threshold, determining that the equipment type is in an abnormal state.
In one possible example, the instructions in the program are further to perform the following operations: extracting a plurality of infrared ranging values from the infrared data; calculating the proportion of infrared ranging values smaller than a preset distance threshold value in the plurality of infrared ranging values; and judging whether the ratio is greater than a preset ratio threshold value, and if the ratio is greater than the ratio threshold value, determining that the equipment type is in an abnormal state.
The above description has introduced the solution of the embodiment of the present application mainly from the perspective of the method-side implementation process. It is understood that the electronic device comprises corresponding hardware structures and/or software modules for performing the respective functions in order to realize the above-mentioned functions. Those of skill in the art would readily appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiment of the present application, the electronic device may be divided into the functional units according to the method example, for example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one control unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit. It should be noted that the division of the unit in the embodiment of the present application is schematic, and is only a logic function division, and there may be another division manner in actual implementation
Fig. 6 is a block diagram of functional units of an information pushing apparatus 600 according to an embodiment of the present application. This information pusher 600 is applied to article perception equipment, article perception equipment is connected with a plurality of terminal equipment, this information pusher 600 includes acquisition unit 601, detecting element 602, judges unit 603 and propelling movement unit 604, wherein:
the acquisition unit 601 is configured to acquire video data of a target area corresponding to a target terminal device within a preset time when it is detected that the target terminal device is in an unconnected state;
a detection unit 602, configured to execute a pedestrian detection algorithm on the video data to obtain a total number of pedestrians included in the video data;
a determining unit 603, configured to determine whether the total number is greater than a preset threshold, and if the total number is greater than the preset threshold, obtain an equipment type corresponding to the target terminal equipment, and determine that the equipment type is in an abnormal state;
the pushing unit 604 is configured to generate device abnormality information according to the total number of people and the device type, and push the abnormality information to a preset mobile terminal.
It can be seen that, in the embodiment of the application, when detecting that a target terminal device in the plurality of terminal devices is in an unconnected state, the article sensing device acquires video data of a target area corresponding to the target terminal device within a preset time; executing a pedestrian detection algorithm on the video data to obtain the total number of pedestrians contained in the video data; judging whether the total number of people is greater than a preset threshold value, if so, acquiring the equipment type corresponding to the target terminal equipment, and determining that the equipment type is in an abnormal state; and generating equipment abnormal information according to the total number of people and the equipment type, and pushing the abnormal information to a preset mobile terminal. Therefore, the total number of the pedestrians is determined by acquiring the video data to execute the pedestrian detection, the abnormal condition is determined according to the total number of the pedestrians, the condition that the number of the devices is insufficient can be found in time, and the improvement of the user experience degree is facilitated.
In a possible example, in the aspect of generating the device abnormality information according to the headcount and the device type, the pushing unit 604 is specifically configured to: determining an abnormal grade corresponding to the total number of people according to a preset mapping relation between the number of people and the grade; extracting an electronic map, acquiring a target position corresponding to the target equipment, and generating an equipment position map according to the target position and the electronic map; generating a target device strategy according to the device position diagram and the abnormal level; and generating the abnormal information according to the target equipment strategy and the abnormal grade.
In a possible example, in the aspect of generating the target device policy according to the device location map and the anomaly level, the pushing unit 604 is specifically configured to: determining the equipment number corresponding to the abnormal grade according to the mapping relation between the preset grade and the equipment number; and determining a target range by taking the target position as a circle center and a preset range threshold as a radius in the equipment position diagram, and setting equipment of the equipment type corresponding to the equipment number in the target range.
In a possible example, after the pushing the abnormal information to the preset mobile terminal, the pushing unit 604 is specifically configured to: executing face recognition on the video data, and determining a plurality of target mobile terminals corresponding to a plurality of faces contained in the video data; acquiring at least one equipment address of at least one terminal equipment corresponding to the equipment type; and pushing the at least one equipment address to the plurality of target mobile terminals.
In one possible example, the item sensing apparatus comprises: the infrared module, the determining unit 603, is further configured to: receiving an infrared data set of the target area acquired by the infrared module within a preset time, and extracting a plurality of infrared images from the infrared data set; executing face detection on the plurality of infrared images to obtain the number of faces corresponding to the plurality of infrared images; and judging whether the face number is greater than a preset face number threshold, and if the face number is greater than the face number threshold, determining that the equipment type is in an abnormal state.
In a possible example, the determining unit 603 is further configured to: extracting a plurality of infrared ranging values from the infrared data; calculating the proportion of infrared ranging values smaller than a preset distance threshold value in the plurality of infrared ranging values; and judging whether the ratio is greater than a preset ratio threshold value, and if the ratio is greater than the ratio threshold value, determining that the equipment type is in an abnormal state.
Embodiments of the present application also provide a computer program product comprising a non-transitory computer readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps of any of the methods as described in the above method embodiments. The computer program product may be a software installation package, the computer comprising an electronic device.
It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present application is not limited by the order of acts described, as some steps may occur in other orders or concurrently depending on the application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, the above-described division of the units is only one type of division of logical functions, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some interfaces, devices or units, and may be an electric or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit may be stored in a computer readable memory if it is implemented in the form of a software functional unit and sold or used as a stand-alone product. Based on such understanding, the technical solution of the present application may be substantially implemented or a part of or all or part of the technical solution contributing to the prior art may be embodied in the form of a software product stored in a memory, and including several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the above-mentioned method of the embodiments of the present application. And the aforementioned memory comprises: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable memory, which may include: flash Memory disks, Read-Only memories (ROMs), Random Access Memories (RAMs), magnetic or optical disks, and the like.
The foregoing detailed description of the embodiments of the present application has been presented to illustrate the principles and implementations of the present application, and the above description of the embodiments is only provided to help understand the method and the core concept of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims (10)

1. An information pushing method is applied to an article sensing device, wherein the article sensing device is connected with a plurality of terminal devices, and the method comprises the following steps:
when detecting that a target terminal device in the plurality of terminal devices is in an unconnected state, acquiring video data of a target area corresponding to the target terminal device within a preset time;
executing a pedestrian detection algorithm on the video data to obtain the total number of pedestrians contained in the video data;
judging whether the total number of people is greater than a preset threshold value, if so, acquiring the equipment type corresponding to the target terminal equipment, and determining that the equipment type is in an abnormal state;
and generating equipment abnormal information according to the total number of people and the equipment type, and pushing the abnormal information to a preset mobile terminal.
2. The method of claim 1, wherein generating equipment anomaly information as a function of the headcount and the equipment type comprises:
determining an abnormal grade corresponding to the total number of people according to a preset mapping relation between the number of people and the grade;
extracting an electronic map, acquiring a target position corresponding to the target equipment, and generating an equipment position map according to the target position and the electronic map;
generating a target device strategy according to the device position diagram and the abnormal level;
and generating the abnormal information according to the target equipment strategy and the abnormal grade.
3. The method of claim 2, wherein generating a target device policy from the device location map and the anomaly level comprises:
determining the equipment number corresponding to the abnormal grade according to the mapping relation between the preset grade and the equipment number;
and determining a target range by taking the target position as a circle center and a preset range threshold as a radius in the equipment position diagram, and setting equipment of the equipment type corresponding to the equipment number in the target range.
4. The method according to claim 1, wherein after the pushing the abnormal information to the preset mobile terminal, the method further comprises:
executing face recognition on the video data, and determining a plurality of target mobile terminals corresponding to a plurality of faces contained in the video data;
acquiring at least one equipment address of at least one terminal equipment corresponding to the equipment type;
and pushing the at least one equipment address to the plurality of target mobile terminals.
5. The method of claim 1, wherein the item sensing device comprises: an infrared module, the method further comprising:
receiving an infrared data set of the target area acquired by the infrared module within a preset time, and extracting a plurality of infrared images from the infrared data set;
executing face detection on the plurality of infrared images to obtain the number of faces corresponding to the plurality of infrared images;
and judging whether the face number is greater than a preset face number threshold, and if the face number is greater than the face number threshold, determining that the equipment type is in an abnormal state.
6. The method of claim 5, further comprising:
extracting a plurality of infrared ranging values from the infrared data;
calculating the proportion of infrared ranging values smaller than a preset distance threshold value in the plurality of infrared ranging values;
and judging whether the ratio is greater than a preset ratio threshold value, and if the ratio is greater than the ratio threshold value, determining that the equipment type is in an abnormal state.
7. An information pushing apparatus, applied to an article sensing device, where the article sensing device is connected to a plurality of terminal devices, the apparatus comprising:
the acquisition unit is used for acquiring video data of a target area corresponding to the target terminal device within preset time when the target terminal device in the plurality of terminal devices is detected to be in an unconnected state;
the detection unit is used for executing a pedestrian detection algorithm on the video data to obtain the total number of pedestrians contained in the video data;
the judging unit is used for judging whether the total number of people is greater than a preset threshold value, if so, acquiring the equipment type corresponding to the target terminal equipment, and determining that the equipment type is in an abnormal state;
and the pushing unit is used for generating equipment abnormal information according to the total number of people and the equipment type and pushing the abnormal information to a preset mobile terminal.
8. The apparatus according to claim 7, wherein in the aspect of generating the device abnormality information according to the head count and the device type, the pushing unit is specifically configured to:
determining an abnormal grade corresponding to the total number of people according to a preset mapping relation between the number of people and the grade;
extracting an electronic map, acquiring a target position corresponding to the target equipment, and generating an equipment position map according to the target position and the electronic map;
generating a target device strategy according to the device position diagram and the abnormal level;
and generating the abnormal information according to the target equipment strategy and the abnormal grade.
9. An item awareness apparatus comprising a processor, a memory, a communication interface, and one or more programs stored in the memory and configured to be executed by the processor, the programs comprising instructions for performing the steps in the method of any of claims 1-6.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program which is executed by a processor to implement the method of any one of claims 1-6.
CN201911269070.6A 2019-12-11 2019-12-11 Information pushing method, device, equipment and storage medium Active CN111107139B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911269070.6A CN111107139B (en) 2019-12-11 2019-12-11 Information pushing method, device, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911269070.6A CN111107139B (en) 2019-12-11 2019-12-11 Information pushing method, device, equipment and storage medium

Publications (2)

Publication Number Publication Date
CN111107139A true CN111107139A (en) 2020-05-05
CN111107139B CN111107139B (en) 2022-05-17

Family

ID=70422920

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911269070.6A Active CN111107139B (en) 2019-12-11 2019-12-11 Information pushing method, device, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN111107139B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114996682A (en) * 2022-07-19 2022-09-02 中国工商银行股份有限公司 Face recognition method, device, electronic device and computer-readable storage medium
CN115687023A (en) * 2022-12-08 2023-02-03 深圳阿塔基科技有限公司 Internet big data processing method and system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110276828A1 (en) * 2009-01-14 2011-11-10 Kenji Tamaki Apparatus anomaly monitoring method and system
CN103499952A (en) * 2013-09-13 2014-01-08 广州恩次元信息科技有限公司 Self-service terminal remote intelligent management system
CN104679460A (en) * 2015-03-20 2015-06-03 重庆理工大学 Cloud print self-service system and realizing method thereof
CN107323377A (en) * 2017-05-08 2017-11-07 苏州统购信息科技有限公司 A kind of vehicle-mounted early warning system and method for early warning
WO2018049912A1 (en) * 2016-09-14 2018-03-22 广东欧珀移动通信有限公司 Data transmission method and related devices

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110276828A1 (en) * 2009-01-14 2011-11-10 Kenji Tamaki Apparatus anomaly monitoring method and system
CN103499952A (en) * 2013-09-13 2014-01-08 广州恩次元信息科技有限公司 Self-service terminal remote intelligent management system
CN104679460A (en) * 2015-03-20 2015-06-03 重庆理工大学 Cloud print self-service system and realizing method thereof
WO2018049912A1 (en) * 2016-09-14 2018-03-22 广东欧珀移动通信有限公司 Data transmission method and related devices
CN107323377A (en) * 2017-05-08 2017-11-07 苏州统购信息科技有限公司 A kind of vehicle-mounted early warning system and method for early warning

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114996682A (en) * 2022-07-19 2022-09-02 中国工商银行股份有限公司 Face recognition method, device, electronic device and computer-readable storage medium
CN115687023A (en) * 2022-12-08 2023-02-03 深圳阿塔基科技有限公司 Internet big data processing method and system

Also Published As

Publication number Publication date
CN111107139B (en) 2022-05-17

Similar Documents

Publication Publication Date Title
CN110570652B (en) Vehicle fake plate detection reminding method and related product
CN110069408A (en) Automatic driving vehicle sensory perceptual system test method and device
CN111556444A (en) Intelligent worker card positioning method and system
CN112381092B (en) Tracking method, device and computer readable storage medium
CN112861711A (en) Regional intrusion detection method and device, electronic equipment and storage medium
KR20190041775A (en) Method for registration and identity verification of using companion animal’s muzzle pattern
CN111814776B (en) Image processing method, device, server and storage medium
CN109656973A (en) A kind of target object association analysis method and device
CN111444798A (en) Method and device for identifying driving behavior of electric bicycle and computer equipment
CN112133085B (en) Vehicle information matching method, device and system, storage medium and electronic device
CN111191507A (en) Safety early warning analysis method and system for smart community
CN112016514B (en) Traffic sign recognition method, device, equipment and storage medium
CN110930715B (en) A non-motor vehicle red light recognition method, system and violation processing platform
CN116824516B (en) Road construction safety monitoring and management system
CN202940921U (en) Real-time monitoring system based on face identification
CN111107139B (en) Information pushing method, device, equipment and storage medium
CN110956165A (en) Intelligent community unbundling pet early warning method and system
CN108229240A (en) A kind of method and device of determining picture quality
CN114332707B (en) Method and device for determining device validity, storage medium, and electronic device
CN109948479B (en) Factory monitoring method, device and equipment
CN114463779A (en) Smoking identification method, device, equipment and storage medium
CN110738077B (en) Foreign matter detection method and device
CN113947795A (en) Mask wearing detection method, device, equipment and storage medium
CN110490106B (en) Information management method and related equipment
CN108304852B (en) Method and device for determining road section type, storage medium and electronic device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant