[go: up one dir, main page]

WO2018144237A1 - Détection et suivi de présence humaine en fonction de la chaleur - Google Patents

Détection et suivi de présence humaine en fonction de la chaleur Download PDF

Info

Publication number
WO2018144237A1
WO2018144237A1 PCT/US2018/014311 US2018014311W WO2018144237A1 WO 2018144237 A1 WO2018144237 A1 WO 2018144237A1 US 2018014311 W US2018014311 W US 2018014311W WO 2018144237 A1 WO2018144237 A1 WO 2018144237A1
Authority
WO
WIPO (PCT)
Prior art keywords
frame
region
area
human presence
occupant
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2018/014311
Other languages
English (en)
Inventor
Anant AGGARWAL
Christian Breuer
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Osram Sylvania Inc
Original Assignee
Osram Sylvania Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US15/422,543 external-priority patent/US20170147885A1/en
Application filed by Osram Sylvania Inc filed Critical Osram Sylvania Inc
Publication of WO2018144237A1 publication Critical patent/WO2018144237A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/19—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using infrared-radiation detection systems
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19602—Image analysis to detect motion of the intruder, e.g. by frame subtraction
    • G08B13/19608—Tracking movement of a target, e.g. by detecting an object predefined as a target, using target direction and or velocity to predict its new position

Definitions

  • This disclosure relates to presence detection techniques, and more specifically to intelligent output control systems capable of detecting and tracking human presence, such as intelligent control systems for lighting, surveillance, HVAC, and safety/alarm applications.
  • acoustic motion sensors and infrared (IR) sensors may be used to detect a human presence within a scanned space.
  • IR infrared
  • Figure 1 is a graph of the temperature over time of a room having a cyclical heat source, such as an HVAC system.
  • Figure 2 is a graph of the temperature over time of a room having a human entering and leaving the room.
  • Figure 3 illustrates the calculation of a delta frame after one minute, according to an embodiment of the present disclosure.
  • Figure 4 shows an IR frame, delta frame, and mask frame of a room at various time intervals, according to one embodiment of the present disclosure.
  • Figure 5 shows an IR frame, delta frame, and mask frame of a room at various time intervals, according to another embodiment of the present disclosure.
  • Figure 6a shows an IR frame, delta frame, mask frame, and digital mask frame of a room at various time intervals, according to one embodiment of the present disclosure.
  • Figure 6b shows an IR frame, delta frame, mask frame, and digital mask frame of a room at various time intervals, according to another embodiment of the present disclosure.
  • Figure 7a illustrates a method for detecting stationary human presence, according to an embodiment of the present disclosure.
  • Figure 7b illustrates an example system that can carry out the method of Figure 7a, according to an embodiment of the present disclosure.
  • Figure 8a illustrates an example field of view of an IR grid array sensor, in accordance with an embodiment of the present disclosure.
  • Figure 8b illustrates an example sensor map as it relates to a field of view of an IR grid array sensor, in accordance with an embodiment of the present disclosure.
  • Figures 8c-8e each illustrates sensor detection signals from pixel regions representing the field of view (FOV), in accordance with an embodiment of the present disclosure.
  • a number of IR images of a given area being monitored may be captured using an IR sensor and these IR images may be averaged over various time intervals to calculate a number of average IR frames.
  • the difference between these average IR frames provides a delta frame, and the value of the delta frame may be used to detect activity or human presence within the scanned area.
  • any delta value indicative of a significant change in heat signature may activate the presence detection system.
  • a local activity may be detected based on the location of the delta value within the delta frame, and the dimensions of the delta frame may be determined by the pixel count of the IR sensor.
  • certain pixels of the IR sensor may correspond to certain locations within the area being monitored (e.g., room), although at least some of the sensor pixels may be able to see the entire area, depending on factors such as the size of the area, obstacles within the area, and the FOV of a given IR sensor.
  • a mask frame may be calculated as the summation of delta frames over time. The value of the mask frame may be used to detect a stationary human presence even when no delta value is calculated (e.g., because the person is sitting still).
  • the value of the mask frame can be an overall value of the entire mask frame (i.e., all pixel values of the entire frame), or a partial value of the entire mask frame (i.e., only some of the pixel values of the entire frame), or some other representative value of the mask frame.
  • the dimensions of the mask frame can be determined by the pixel count of the IR sensor, and a local presence can therefore be detected based on the location of the pixel value(s) within the mask frame.
  • a digital mask frame may be calculated as a binary representation of the mask frame and a stationary human presence may be determined based on the value of the digital mask frame.
  • logical l's can be used to indicate pixel values corresponding to an occupant and logical 0's can be used to indicate pixel values corresponding to no occupant.
  • the mask frame may also be used to calculate a background frame that represents the IR signature of stationary or cyclical objects within the scanned area that are not intended to trigger the presence detection system (permanent or quasi-permanent objects present in the space, but not considered to be an occupant, such as a heating duct or a fish tank).
  • a background frame thus can be used to show a baseline profile of the area to be monitored, in which the baseline shows how the area appears to the sensor with no occupancy. As such, any occupancy of the area can be readily detected by comparing a frame including an occupant against the background frame.
  • the presence of a stationary occupant may be determined by subtracting the background frame from a current average IR frame.
  • a given spatial environment can be segmented into a plurality of regions, each region corresponding to a cluster of pixels of an IR sensor observing the environment. Some regions may include objects that effectively hide the presence of an occupant, such as a door, cubicle wall, or a high-back chair or book shelf.
  • techniques are provided to estimate hidden human presence (stationary or in-motion) in a spatial environment by tracking the heat mass captured in segmented individual pixel clusters of an infrared image over time. Such techniques allow for occupancy determination even when the occupant becomes invisible/hidden within the observed space.
  • spacial occupancy may be determined using passive infrared (PIR) sensors or ultrasonic sensors; however, these systems often rely on a fixed timeout counter and may be prone to false triggering.
  • PIR passive infrared
  • the occupancy detection system turns the output on for a fixed period of time, for example five minutes, regardless of the actual duration of occupancy. This may lead to wasting energy as the output may stay on for much longer than necessary (e.g., even though the person has left the room, the lights remain on for the remainder of the fixed time period). Also, if a person remains relatively still, the lights may go off after the time limit has run, leaving the person in the dark, until they perform some detectable movement to re-trigger the lighting system.
  • false triggering may occur from events such as flowing hot air (e.g., from a heating system) or cycling hot objects in the environment such as a machine or pet.
  • events such as flowing hot air (e.g., from a heating system) or cycling hot objects in the environment such as a machine or pet.
  • varying sunlight or shadows through windows, curtains, sunlit carpet or reflective surface, fireplace, etc. may all contribute to false triggering of IR sensors.
  • imaging technologies such as depth sensors (e.g., Kinect), time-of-flight cameras, and visible imaging cameras are very powerful, but all require a line of sight to the human presence within the field of view (FOV).
  • Such systems are unable to sense presence of an occupant as soon as that occupant is visually blocked, hidden, or otherwise made invisible by an obstacle within the area being monitored (e.g., such as the case when the occupant moves to a location behind a door, a cubicle wall, or a high back chair), and therefore susceptible to blind spots within a spatially resolved environment.
  • One way to solve the blind spot detection problem might include, for instance, using a global positioning system (GPS), but that would require each occupant to have a GPS receiver, and require a significant more amount of both processing and electrical power, relative to IR-based techniques.
  • GPS global positioning system
  • human occupancy detection and tracking techniques are disclosed.
  • the techniques can be implemented, for example, utilizing one or more infrared sensors operatively coupled to an infrared image processing block.
  • the proposed techniques not only enable detection of stationary human presence, but also enable background estimation and masking out non- occupant objects in the spatial environment, as well as the tracking of a given occupant into blind spots of the spatial environment.
  • Stationary human presence detection removes the need for occupants to periodically move or wave a hand in order to keep the system from turning off.
  • stationary human presence may include a person temporarily outside the field of view (FOV) of an IR sensor, such as behind a cubicle wall.
  • FOV field of view
  • the system can track the person's movement into that blind spot, as well as detect the person's departure from that blind spot.
  • the system is programmed or otherwise configured to understand that a person can still be present, even though that person is in a blind spot with respect to the IR sensor(s).
  • the techniques provided herein allow the sensor-controlled output (e.g., for controlling lighting, air-conditioning, surveillance/monitoring, etc) to be turned off as soon as the space is vacant, as opposed to waiting until a fixed output period concludes, and thus provides increased energy efficiency and reduced computational load.
  • Such techniques may be integrated, for example, with numerous systems, such as lighting, surveillance, HVAC, safety/alarm systems, etc.
  • an IR sensor or camera may be mounted on a ceiling to create IR images or frames of a given room or target area.
  • the IR sensor includes an IR grid array (pixelated sensor of MxN pixels) and interfaces with a microcontroller or other suitable computing system capable of processing sensor image data.
  • multiple IR sensors may work in unison to scan an area, and there may be some overlap between sensors.
  • multiple IR sensors at different angles within a room may allow for greater IR visibility such that a person is rarely out of the field of view of all the IR sensors (i.e., in a blind spot), although visibility of the entire room is not needed, as will be appreciated in light of this disclosure.
  • the sensor(s) may send a fixed number of frames per second to the microcontroller (e.g., 4, 8, or 16 frames per second) for IR image processing, in some embodiments. Image processing may alternatively be offloaded or otherwise performed on a separate computer or processor that is in communication with the microcontroller, in other embodiments.
  • the IR band selection associated with the IR sensor(s) in one embodiment is based on a number of factors including indoor/outdoor sensing, operating distance, temperature of object of interest, and the emissivity of the object of interest. In one specific example for indoor occupancy sensing, the far infrared wavelength range between 8- Hum is used, although other sensors capable of detecting a human heat signature can be used.
  • suitable sensors include the Omron D6T-44L-06 (4x4), Panasonic “GridEYE” AMG8831 (8x8), or the Melexis MLX90620 (4x16) sensor. Numerous other suitable sensors will be apparent in light of this disclosure.
  • a rolling average of the IR image frames is calculated over each of different time periods and any activity in the given space may be determined by calculating the delta between average JR image frames.
  • Averaging may be performed over various time increments and at various intervals, as will be appreciated. For example, a 1 second average (e.g., averaging 16 frames if the IR sensor captures 16 frames per second) or a 10 second average (averaging 160 frames) may be performed every minute.
  • averaging image frames and comparing averaged image frames to calculate a delta frame value may be performed at different time intervals and the averages may have different time lengths, in some embodiments.
  • Averaging multiple image frames may also provide noise filtering, in some embodiments. A large number of IR image frames per second provides increased data as well as an increased amount of noise, and this noise may be reduced by taking multiple averages with a noise filtering buffer.
  • a given room may have a specific IR profile while vacant (baseline IR profile, including cyclical heat sources such as heating vents) and any additional heat source that is not part of the baseline profile will be detected by the IR sensor, creating a finite delta value that implies activity or at least occupancy. For example, if a room is vacant for three minutes before a person enters, the average IR image frames over 10 seconds, 30 seconds, 1 minute, and 2 minutes will be substantially equal (within a given tolerance) and the delta value between those average image frames will therefore be zero (within a given tolerance).
  • the system can execute an appropriate lighting control, surveillance protocol, HVAC control, safety/alarm protocol or other action depending on the given application.
  • the detection of a significantly large delta value indicates activity/occupancy and may trigger the lights to turn on, while a mask frame is calculated over time to detect a stationary human presence and maintain the lights on.
  • a mask frame can be calculated based on a plurality of delta frames over time.
  • the threshold value for delta frame activity may depend on the specific application, and may be based on the heat signature of a human, as opposed to the discernible heat signatures of a pet, heater, laptop fan, etc.
  • the delta frame values (changes in IR scene) are integrated over time to compute a mask frame, such that non-occupant background activity (such as cycling warm objects) gets nullified by the delta summation and does not show up in the mask frame.
  • the mask frame can be used to effectively "mask” out the baseline profile of the target area.
  • typical human presence presents a non-zero value of delta and these areas clearly show up in the mask frame, essentially distinguishing between non-baseline occupants and baseline background objects.
  • a person enters a room and remains there for an hour without significant movement.
  • the delta value(s) of the pixel(s) associated with the stationary human will be zero but the overall value of the mask frame will remain a positive number (or negative, depending on how the comparison is done) reflecting the stationary human presence.
  • the average mask frame value will remain a positive number and the lights remain on; but once the person leaves the room a negative delta frame value is calculated, the negative delta is added to the mask frame, and the lights may be shut off in a relatively timely fashion.
  • the mask frame may thus distinguish a stationary human occupant in the scene from the background or any cyclical heat sources.
  • further mathematical processing may be performed on the IR image frames for background estimation and presence detection.
  • the delta summation may be divided up into individual pixel clusters, each pixel cluster including one or more pixels and corresponding to a specific location within the target area. Such pixelated-based segmentation of the target area being monitored can be used to detect a local presence (i.e., occupancy of a specific location within the overall target area).
  • such pixelated-based segmentation of the target area being monitored can be also used to detect movement of an occupant into a blind spot of the target area.
  • the system knows that the target area is occupied.
  • the IR sensors can be placed or otherwise commissioned so that any given blind spot does not include an unmonitored exit from the target area.
  • the control system knows when the target area is occupied, even if occupant is located in a blind spot of the target area.
  • the imaging sensor grid may be segmented into multiple localized regions, such that each region of the space to be monitored is associated with at least one pixel of the sensor grid. Once human presence is detected in the field of view, it is resolved into these small localized regions. Motion is tracked from one region to the next as the sum of pixels (heat) moves from one region to the next. Utilizing this principle, if a human moves from one region (where she was visible to the sensor) to the next (where she is invisible to the sensor due to an obstacle), the system can effectively know that although the human heat source became invisible within the space but the human has not left the field of view and therefore must be hidden behind an obstacle.
  • visible light sensors and/or cameras may be used instead of or in combination with IR sensors, or a passive IR sensor may turn the output on while an IR grid array may be used to turn the output off.
  • IR sensors may require visible light to be present, consume additional computational and electrical power, and/or pose privacy issues.
  • the techniques disclosed can be implemented so as to provide a digital output that may be used to control lights, HVAC systems, window blinds, surveillance cameras, or any other systems that may benefit from human presence detection, tracking, and positioning. For ease of description, however, examples are provided for controlling lighting systems.
  • the techniques disclosed may further provide an energy savings as output may be turned off as soon as the monitored space is vacated.
  • the techniques may provide a greater degree of immunity to false triggering, relative to the other systems that are incapable of distinguishing occupancy from baseline non-occupants (e.g., heating vent, fish tank, or other fixed or cyclical heat sources that may exist in a given space) or rely on movement to keep the output engaged.
  • the techniques provided herein may further provide capability to log presence in areas that are not visible to an imaging sensor, or so-called blind spots.
  • Figure 1 is a graph of the temperature of a room over time for a cyclical heat source, such as an HVAC system.
  • a cyclical heat source such as an HVAC system.
  • the heater turns on and increases the room temperature steadily up to an upper threshold value +T, at which point the heater turns off and the room slowly cools down to the lower threshold and the cycle repeats.
  • Figure 2 is a graph of the temperature of a room over time for a human entering and leaving the room.
  • the human briefly enters the room, in this example, causing a spike in the local temperature.
  • the thermal mass of a heat source may be computed based on the slope of change in temperature over time, as well as the magnitude of the heat change.
  • the local temperature in this example increases more dramatically and has a steeper slope as compared to the cyclical heat source of Figure 1 because the human body has a larger local heat signature.
  • the width and height of such frames may be determined by the digital resolution or pixel count in the IR sensor, in some embodiments.
  • the acquired frames may be averaged over time for the purpose of noise filtering, as well as to calculate the multiple frame averages used to determine the delta value, in some embodiments.
  • equation (1) may be used to calculate the frame averages, where Ft represents the IR frame value at the i th second, and F , t represents the average IR frame over t seconds.
  • the delta frame, F t( m ,n) may be calculated by subtracting two average IR frames averaged over different periods of time.
  • the delta frame will be positive (or negative, depending on how the comparison is done) when the person enters the room.
  • Subsequent delta frames remain zero while the person remains sitting at the desk (assuming the subsequent delta frames are computed based on average IR frames taken while the person is in the room).
  • the delta frame will then transition to a negative (or positive, as the case may be) when the person leaves.
  • the positive and negative transition points can be used to identify the entrance and departure times, respectively, of an occupant.
  • a cycling heat source may be periodically detected and the delta value will change accordingly. However, as illustrated in Figure 1, an average of the delta value over time will be zero. Thus, cycling heat sources ( Figure 1) can be effectively be masked out by using averaging, while non-cycling heat sources like an occupant ( Figure 2) can be identified for making an occupancy determination.
  • Table 1 Example Delta Frame Computation
  • the positive (1) and negative (-1) transition points mark the entry and departure, respectively, of the person. These positive and negative transition points effectively bookend the occupancy of the space being monitored. Note that the use of 0, 1, and -1 is not intended to imply integer values are required; rather, reasonable tolerances can be applied as appropriate. For instance, in some embodiments, the following tolerances apply: a delta frame value in the range of -v to +v may be considered a 0; anything greater than +v can be considered a 1; and anything less than -v can be considered a -1.
  • the average frames used in computing a given delta frame can be selected to provide a consistently positive delta frame when a human occupant is in the room, rather than rely on positive and negative transition points bookending the occupancy.
  • F aV e,m is the average frame when no human is in the room and is always used as the base comparison frame, while Fave,m+x is some subsequent average frame where there may or may not be human presence.
  • the delta frame is zero when there is no occupancy, and is non-zero (1 in this example case) when there is occupancy.
  • the delta frame value can be converted to a binary value (e.g., in which occupied status is represented with a logical 1 and unoccupied status is represented with a logical 0).
  • Figure 3 illustrates the calculation of a delta frame after one minute, according to an embodiment of the present disclosure.
  • T is intended to represent intensity of the heat detected.
  • two people having a larger heat signature of 2 have entered the right side of the room and the two pixels on the right of the IR frame have the value 2.
  • a light turning on, a laptop fan activating, or cat entering a room does not create a large enough value in the delta frame to trigger the lighting system, while the heat signature of a human triggers the system and turns the lights on.
  • the IR sensor may detect activity in isolated areas of a scanned space, and may also calculate a total activity magnitude value. Calculating a local activity may include, for example, scanning certain areas of space with one or more pixels of the IR sensor and calculating a local delta for each pixel or cluster of pixels. The total activity magnitude may be calculated, for example, by adding all the pixels in the delta frame at a given point in time.
  • the total activity magnitude V3 ⁇ 4j may be represented by equation (3), where P t(x,y) represents the value of pixel P at position (x,y) on the pixilated array at a given time, and VFA represents the sum of all pixels in the delta frame at that time.
  • a continued presence within the room may be determined by calculating a mask frame, in some embodiments.
  • a mask frame may be calculated by integrating the delta frames over time.
  • the mask frame may detect a stationary human presence by remaining a positive value even if no additional delta value is detected.
  • Calculating a local presence may include, for example, scanning certain areas of space with different pixels and calculating a local mask frame value for each pixel or cluster of pixels.
  • the pixels in an IR sensor array may be segmented into arrays or clusters, each cluster corresponding to, for example, a row of cubicles or a section of a conference room or other spaced being monitored.
  • an estimation of the number and location of people within a scanned area may be calculated, depending on the sensitivity and resolution of the IR sensor being used to capture IR frames.
  • the location of a single person may be continuously tracked using the techniques described herein, in some embodiments.
  • a high resolution IR sensor may determine a human presence based on the number and shape of coherent pixels within the mask frame or the motion and speed of the pixels of the mask frame.
  • a human entering or leaving the field of view of an IR sensor e.g., behind a cubicle wall or other blind spot
  • the system may be configured to account for such activity in the mask frame.
  • the mask frame FMask may be represented, in some embodiments, by equation (4), where Fn represents the delta frame at the i th second, and ⁇ represents a diminishing factor used to clear the mask over time.
  • an added static heat source could be a space heater, lamp, or desktop computer that is added to a room for a long period of time and is not a cyclical heat source.
  • the diminishing factor accounts for these situations by clearing the mask at certain intervals. Under normal circumstances, a stationary human presence will not last more than a few hours in the same place at any one time, so the diminishing factor may be chosen such that stationary heat sources are cleared from the mask frame after a few hours.
  • ⁇ is a fixed number derived from the time which the mask gets cleared.
  • Figure 4 shows the average IR frame, delta frame, and mask frame of a room at various time intervals, according to one embodiment of the present disclosure.
  • the IR sensor includes four pixels and the room being scanned is divided into four sections or quadrants. The sections/quadrants are only labeled on the first average IR frame, as I, II, III, and IV.
  • Figure 5 shows the average IR frame, delta frame, and mask frame of a room at various time intervals, according to another embodiment of the present disclosure.
  • the IR sensor includes four pixels and the room being scanned is divided into four sections or quadrants. Again, the sections/quadrants are only labeled on the first average IR frame, as I, II, III, and IV.
  • the mask frame is a summation of the delta frames (at 0, 10 seconds, and 1 minute)
  • the mask frame now has a value of 2 in the second quadrant and zero in the first quadrant.
  • a mask magnitude may be calculated, in some embodiments, as the sum of all pixels in the mask frame FMask at a given point in time.
  • the mask magnitude VFMask may be represented, for example, by equation (5), where PMask(x,y) represents the value of pixel P at position (x,y) on the pixilated array.
  • a digital mask frame may be calculated that represents the mask frame in a binary format.
  • the digital mask may be used to easily identify human presence within the scanned space by filtering out any IR delta values in the mask that are below those typically created by a human presence. Specifically, if a human presence has a heat signature value of 2, for example, and a cat enters a room with a heat signature of 1, the mask frame may include a value of 1 in one section. However, since a heat signature of 1 is below the threshold for human presence, the digital mask may disregard that value, in some embodiments. In other embodiments the threshold may be calculated as the average pixel value, or any other value suitable for filtering out unwanted values in the mask frame.
  • Figure 6a shows the average IR frame, delta frame, mask frame, and digital mask frame of a room at various time intervals, according to one embodiment of the present disclosure.
  • the IR sensor includes four pixels and the room being scanned is divided into four sections or quadrants. Again, the sections/quadrants are only labeled on the first average IR frame, as I, II, III, and IV.
  • the digital mask frame in this particular example is calculated with a pixel threshold value of 1, such that any mask frame pixels with a heat signature value greater than 1 will have a non-zero value in the digital mask frame.
  • the average IR frame is zero and the delta frame, mask frame, and digital mask frame will also be zero.
  • the digital mask frame still remains at zero because the heat signature of 1 from the heater is not greater than the threshold value for human presence.
  • the person in the upper right corner moves in front of the heater in the upper left of the room, blocking the heat signature of the heater and resulting in the second quadrant of the average IR frame now having a value of 2 and the first quadrant having a value of zero.
  • the digital mask frame in this example, still detects a heat signature of 2 in the mask frame, which is above the threshold value for human presence.
  • the digital mask frame has a value of 1 in the second quadrant, in this example, and the lights remain on.
  • the heater may be cleared from the mask frame such that it will no longer contribute to the value of the mask frame.
  • an inverse digital mask, FinvDMask may be calculated, which is a bitwise complement of the digital mask and may be used for background estimation.
  • the background frame, FBack(n+i), at time “n+1” may be represented by equation (8), where FBack(n) represents the previously calculated background frame, Fcoeff represents the frame of background weight coefficients, and F ⁇ p( n ,t) represents an average frame calculated from the frame buffer, where the average is of frames received over t seconds, n seconds ago.
  • the background frame begins at zero and slowly increases over time as the average frame increases.
  • the inverse digital mask frame, FinvDMask is the inverse compliment of the mask frame, such that the inverse digital mask will only have a positive value where the mask frame has a zero value, thus restricting the background frame to frame sections not included in the mask.
  • a background frame may represent the IR signature of stationary or cyclical hot objects within the scanned area.
  • the coefficient frame is represented by equation (9), where PMask(x,y) is the value of pixel P in the mask frame at location (x,y).
  • a stationary human presence may be detected using the background frame, in which the background frame is subtracted from a current average of IR frames.
  • Background estimation requires more IR image processing as compared to detecting stationary human presence from the mask frame; however, increased accuracy may be achieved in some embodiments by subtracting the background frame from a current average of IR frames.
  • Such a technique receives IR sensor data and removes any data relating to background objects and heat sources, effectively distinguishing between a stationary human presence and any background IR heat that may be present in a room.
  • the presence frame represents the final presence calculation after subtracting the background frame from a short term average.
  • the presence frame Fp re sence may be represented by equation (10).
  • a local presence or general presence may be calculated. Calculating a local presence may include, for example, scanning certain areas of space with different pixels and calculating a local presence value for each pixel or cluster of pixels. In other embodiments, a total presence value may be calculated using equation (11), where Ppresence(x,y) represents the value of pixel P at position (x,y) on the pixilated array, and VFPresence represents the sum of all pixels in the presence frame.
  • Figure 6b shows the average IR frame, delta frame, mask frame, and digital mask frame of a room at various time intervals, according to another embodiment of the present disclosure.
  • the IR sensor includes three pixels and the room being scanned is divided into four sections or quadrants. Again, the sections/quadrants are only labeled on the first average IR frame, as I, II, III, and IV.
  • the room configuration is such that the second quadrant includes a blind spot that cannot be seen by any active pixels of the sensor. Note that there may actually be a fourth pixel, but that pixel is obscured from seeing into the second quadrant; alternatively, there may simply be no pixel associated with the second quadrant.
  • the first quadrant includes the only entrance to (and exit from) the blind spot area of the second quadrant, such that any person passing into or out of the blind spot must pass through the first quadrant.
  • the entrance/exits of the room in the third and fourth quadrants are not shown in the other 2-by-2 grids of Figure 6b to avoid visual clutter, but can be readily envisioned.
  • the person moves from the fourth quadrant to the first quadrant of the room, resulting in the first quadrant of the average IR frame, delta frame, and mask frame now having a value of 2.
  • the value of the first quadrant of the delta frame transitions from 2 to -2 (based on subtraction of the average IR frame at 10 seconds from average IR frame at 1 minute).
  • the value of the first quadrant of the mask frame transitions from 2 to 0 (based on addition of available delta frames at 1 minute).
  • the value of the second quadrant corresponding to the blind spot in each of the delta, mask, and digital mask frames can be inferred to have a value of 0. The inferred nature of this second quadrant value is indicated with underlining.
  • the 2 in the second quadrant of the delta frame is underlined, to indicate it is an inferred value based on the known heat signature value detected in the first quadrant and that presumably moved into the second quadrant blind spot.
  • the second quadrant value in each of the mask frame and digital mask frame is underlined to indicate that value is based on an inferred value from the delta frames.
  • the mask frame now has a value of 0 in the second quadrant and a value of 2 in the first quadrant
  • the digital mask frame has a value of 0 in the second quadrant and a value of 1 in the first quadrant.
  • the lights remain on.
  • Figure 7a illustrates a method for detecting stationary human presence, according to an embodiment of the present disclosure.
  • the method may begin with detecting 701 activity through an IR sensor.
  • the IR sensor includes an array of IR pixels capable of detecting hot objects entering and moving within the scanned space.
  • the method may continue with performing 702 noise filtering, which includes averaging the IR frames detected by the IR sensor.
  • the method may continue with calculating 703 a first average frame.
  • the first average frame may include an average of IR frames over a first period of time, for example, one second. Other time periods are possible and the average frames described herein may be calculated over any number of time increments.
  • the method may continue with calculating 704 a subsequent average IR frame.
  • the method may continue with calculating 705 a delta frame.
  • the delta frame may be calculated, for example, by subtracting the subsequent average IR frame from the first average IR frame.
  • several average frames may be calculated at various time increments, and a delta frame may be calculated by subtracting any average IR frame from the previous average IR frame.
  • the method may continue with determining 706 human activity from the delta frame value.
  • the activity may include one or more of: (1) detecting entrance or exit of a human; (2) tracking movement of a human; and (3) inferring movement of a human into blind spots that don't have a hidden exit (such as the second quadrant of the example room shown in Figure 6b, or some other configuration where each exit from the blind spot is effectively monitored by a given IR sensor).
  • the lighting system may be configured to activate upon detecting a delta value associated with the heat signature of a person entering a room (generally referred to herein as a heat signature difference).
  • any delta value less than that caused by a human presence, such as a pet or heating vent will not trigger the lighting system.
  • the method may continue with determining 707 whether multiple delta frames have been calculated. If multiple delta frames have not been calculated, the method may continue with calculating 704 another subsequent average IR frame as well as calculating 705 another delta frame. If multiple delta frames have been calculated, the method may continue with summing 708 the delta frames to calculate a mask frame.
  • the method may continue with determining 709 whether background estimation is desired. If background estimation is not desired, the method may continue with determining 710 human presence based on the value of the mask frame. In some embodiments, determining human presence from the mask frame may include calculating a digital mask frame. If background estimation is desired, the method may continue with performing background estimation 711 by calculating a background frame. The method may continue with subtracting 712 the background frame from the current average frame in order to determine human presence. In some embodiments, performing background estimation and subtracting the background frame from the average frame may provide additional accuracy for human presence detection.
  • determining human presence at 710 and/or 712 may include one or more of the following activities: (1) detecting entrance or exit of a human; (2) tracking movement of a human; and (3) inferring movement of a human into egress-monitored blind spots (such as the second quadrant of the example room shown in Figure 6b).
  • Figure 7b illustrates an example system that can carry out the method of Figure 7a, according to an embodiment of the present disclosure.
  • the system includes a microcontroller or computer configured to detect human presence in a room using data collected from an IR sensor array.
  • the microcontroller or computer that is programmed or otherwise configured with a number of executable or otherwise controllable modules, including a sensor input module, noise filtering/averaging module, delta frame module, mask frame module, and background frame module.
  • the various functional modules are stored in memory 715 and executable by processor 700.
  • a sensor map 714 is provided in the memory, which associates specific pixels of the sensor array with specific regions of the area being monitored.
  • detection signals from the sensor array can be correlated to specific regions of the area being monitored, for purposes of tracking the occupant. This is particularly useful, for instance, to identify when an occupant has disappeared into a blind spot of the area being monitored, as will be appreciated in light of this disclosure. Such tracking allows reasonable inferences to be made.
  • This sensor map 714 can be generated, for instance, during commissioning of the lighting system by the installer. In such cases, the installer can purposefully place the sensors of the JR array in effort to either eliminate blind spot regions or otherwise isolate blind spot regions so that entry to and exit from those blind spot regions can be monitored by monitoring activity in neighboring non-blind spot regions.
  • the various functional modules 701-712 and sensor map 714 may vary from one embodiment to the next, as may the degree of integration.
  • the delta frame, mask frame, and background frame modules may be implemented in a single module that provides the same overall functionality.
  • the sensor map 714 may be integrated with the sensor input module 701.
  • the sensor input module is connected to a number of IR sensors S l-4, located within a room having a single entrance door, in this particular example. Further recall that the sensors can be purposefully arranged during commissioning of the system to either eliminate blind spots or limit blind spots to the type where inferential determinations of blind spot occupancy can be made based on monitored non-blind spot areas neighboring the blind spot so that entering and exiting with respect to the blind spot can be tracked, as provided herein (sensor map 714).
  • every exit from a given blind spot can be monitored by an IR sensor (or other sensor type, for that matter), such that if a person moves into and then out of that blind spot at least one sensor effectively monitoring the entrance/exit of that blind spot will detect or otherwise signal that departure.
  • an exit from a blind spot that is not monitored by an IR sensor can still be allowed.
  • other sensor types can be used to assess the occupancy of the blind spot at the hidden exit. For instance, a motion detector can be used to monitor an external exit from the blind spot and signal a person's departure from the blind spot.
  • an LED beam/detector arrangement such as a system similar to a garage door detection system having a LED beam projected across the garage opening that detects when the beam is broken, could be used to signal departure from the blind spot.
  • a sound sensor can monitor the blind spot and signal perceived departure (e.g., based on silence or an outer door closing sound).
  • the blind spot may be completely unmonitored, and an exit to the external area (outside the monitored space) can be signaled after a fixed period of time (e.g., 1 hour, or two hours, or three hours, etc). Any sensor signals generated, whether IR or otherwise, can be provided to the sensor input module such that determinations as to occupancy and tracking can be made.
  • the microcontroller or computer may be any suitable microcontroller (e.g., an iOS microcontroller or other suitable processing environment or computing system), and may include one or more co-processors or controllers.
  • a processor 700 is provided.
  • the functional modules can be implemented, for example, in any suitable programming language (e.g., C, C++, objective C, JavaScript, custom or proprietary instruction sets, etc.), and encoded on one or more non-transitory processor readable mediums, that when executed or otherwise controlled by the microcontroller (and/or coprocessors, such as processor 700), carries out the human presence detection techniques as variously described herein.
  • human presence detection may be achieved using various modules within a single microcontroller/computer, however, as discussed above image processing and human presence detection may alternatively be performed on two or more separate computers, microcontrollers, or processors that collectively communicate with each other and the IR sensors, in other embodiments.
  • image processing and human presence detection may alternatively be performed on two or more separate computers, microcontrollers, or processors that collectively communicate with each other and the IR sensors, in other embodiments.
  • the sensor input module is programmed or otherwise configured to receive input from the IR sensors S l- 4, located at various positions within the room and detects 701 activity through the IR sensors. In some cases it may be desirable to position an IR sensor on the ceiling and at least two adjacent walls in order to effectively scan a room so as to avoid any blind spots or otherwise leave only blind spots that have a single point of egress that can be monitored by at least one of the sensors S l-4.
  • a sensor map 714 of commissioned sensors can be stored in a memory or otherwise made accessible to the inference determination process, as will be further explained with reference to the example use case of Figure 8b.
  • the noise filtering/averaging module is configured to perform noise filtering 702, and calculate a number of average frames 703-704, in some embodiments.
  • the delta frame module in this example, is configured to calculate 705 a delta frame, determine 706 activity within the room based on the value of the delta frame, and determine 707 the number of delta frames calculated.
  • the mask frame module is configured to sum 708 the delta frames to calculate a mask frame value, and determine 710 presence from a mask frame value, in some embodiments. In other embodiments, the mask frame module may also be programmed or otherwise configured to calculate a digital mask as an alternative technique for determining human presence.
  • the background frame module may be configured to determine 709 whether background estimation is desired, perform 711 background estimation, and subtract 712 a background frame from an average frame to determine human presence, in some embodiments.
  • the activity determined at 706 or presence determined at 710 or 712 may include one or more of: (1) detecting entrance or exit of a human; (2) tracking movement of a human; and (3) inferring movement of a human into blind spots.
  • the microcontroller/computer further produces a digital output based on the human presence determination, and this digital output may be used to control various systems including, for example lighting, surveillance, HVAC, safety, and/or alarm systems.
  • FIG 8a illustrates an example field of view of an IR grid array sensor, in accordance with an embodiment of the present disclosure.
  • the FOV includes an office setting that generally includes a credenza, a cubicle, and a hallway.
  • the FOV can be correlated to a sensor map where one or more pixels of a given sensor array are associated with a specific region of the area being monitored. For instance, and as shown by the sensor map 714 of Figure 8b, the sensor grid array is broken into three regions or pixel groups: regions A, B, and C.
  • Region A of the sensor map 714 corresponds to the credenza area
  • region B of the sensor map 714 corresponds to the cubicle entrance
  • region C of the sensor map 714 corresponds to the hallway.
  • region A includes columns 1 through 4 of the IR grid array
  • region B includes columns 5 and 6 of the IR grid array
  • region C includes columns 7 through 10 of the IR grid array.
  • this sensor map 714 can be stored in memory of the lighting controller.
  • Figures 8c through 8e illustrate example sensor detection signals from pixel regions representing regions A, B, and C of the sensor map 714, in accordance with an embodiment of the present disclosure. The detection signals are received over a period of time covering the occupancy, as can be seen.
  • the processor 700 can correlate these specific detection signals from the array to the regions of the sensor map 714 and therefore know that an occupant entered the credenza area from the left and then passed into the area in front of the cubicle. Then, as shown in Figure 8d, the sensed thermal mass/occupant seemingly disappears as the occupant enters the blind spot within the cubicle.
  • Example 1 is a presence detection system.
  • the system includes an infrared (IR) sensor array configured to scan an area and capture a plurality of IR frames; and a processor operatively coupled to the IR sensor array, in which the processor is configured to: receive the plurality of IR frames; detect human presence and lack of human presence in the area based on heat signature differences indicated in the plurality of IR frames; and infer human presence in a known blind spot of the area based on detected human presence in non-blind spots neighboring the known blind spot so that entering and exiting with respect to the known blind spot is tracked.
  • IR infrared
  • Example 2 includes the subject matter of Example 1, in which the processor is further configured to: calculate a plurality of average IR frames over various time intervals, calculate a plurality of delta frames by subtracting a previously calculated average IR frame from a current average IR frame, and calculate a mask frame by summing the plurality of delta frames; and determine whether a human presence exists in the area based on a value of the mask frame multiplied by a diminishing factor.
  • Example 3 includes the subject matter of Example 2, in which the processor is further configured to compute a digital mask, the digital mask representing the mask frame in a binary format, in which a human presence is determined based on a value of the digital mask.
  • Example 4 includes the subject matter of any of Examples 1 through 3, and further includes a memory storing a sensor map that correlates a first group of one or more pixels of the sensor array to a first region of the area and second group of one or more pixels of the sensor array to a second region of the area, in which the processor is further configured to track the location of a human presence within the area based on the sensor map.
  • Example 5 includes the subject matter of any of Examples 1 through 4, in which the processor infers human presence in the known blind spot of the area by receiving data indicating presence of an occupant in a first region of the area, subsequently receiving data indicating no occupant being detected in the first region and no occupant being detected in a second region of the area neighboring the first region, in which the known blind spot is in the second region, and determining that the occupant moved from the first region to the known blind spot in the second region based on no occupant being detected in either of the first or second regions.
  • Example 6 includes the subject matter of Example 5, in which the processor correlates the data indicating presence of the occupant to the first region of the area using a sensor map stored in memory accessible to the processor.
  • the sensor map is stored, for instance, local to the processor.
  • the sensor map is stored remote from the processor, such as in the cloud or on a remote server accessible by the processor via a communication network (e.g., the Internet or some other wide area network, or a combination of local area network and wide area network).
  • a communication network e.g., the Internet or some other wide area network, or a combination of local area network and wide area network.
  • Example 7 includes the subject matter of any of Examples 1 through 6, in which the processor is further configured to provide an output indicating a human presence exists, in which the output is used to control at least one of an HVAC, a lighting device, window blinds, a surveillance system, and a security system.
  • Example 8 includes a method of detecting human occupancy, the method including: obtaining a plurality of IR frames of a given area based on data captured by an IR sensor, calculating, by a processor, a plurality of average IR frames over various time intervals from the plurality of IR frames, calculating, by the processor, a plurality of delta frames, in which each delta frame is the difference between a current average IR frame and a previously calculated average IR frame, calculating, by the processor, a mask frame, in which the mask frame is a summation of the plurality of delta frames, and determining whether a human presence exists in the area based on the value of the mask frame, in which the determining includes inferring human presence in a known blind spot of the area based on detected human presence in non-blind spots neighboring the known blind spot so that entering and exiting with respect to the known blind spot is tracked.
  • Example 9 includes the subject matter of Example 8, in which detecting a plurality of IR frames further includes combining IR sensor data with camera data.
  • Example 10 includes the subject matter of Example 8 or 9, and further includes computing a digital mask, in which the digital mask represents the mask frame in a binary format; and determining whether a stationary human presence exists based on the value of the digital mask.
  • Example 11 includes the subject matter of Example 10, and further includes calculating a background frame, in which the background frame represents IR sensor data not represented in the digital mask; and determining a human presence by subtracting the background frame from a current average IR frame.
  • Example 12 includes the subject matter of any of Examples 8 through 11, and further includes at least one of: determining activity within the area based on the value of the plurality of delta frames; tracking the position of a human presence based on the value of the mask frame; and estimating the number and location of human presence within a scanned area based on the value of the mask frame.
  • Example 13 includes the subject matter of any of Examples 8 through 12, in which a memory stores a sensor map that correlates a first group of one or more pixels of the sensor array to a first region of the area and second group of one or more pixels of the sensor array to a second region of the area, the method further including tracking the location of a human presence within the area based on the sensor map.
  • Example 14 includes the subject matter of any of Examples 8 through 13, in which inferring human presence in the known blind spot of the area includes: receiving data indicating presence of an occupant in a first region of the area, subsequently receiving data indicating no occupant being detected in the first region and no occupant being detected in a second region of the area neighboring the first region, in which the known blind spot is in the second region, and determining, by the processor, that the occupant moved from the first region to the known blind spot in the second region based on no occupant being detected in either of the first or second regions.
  • Example 15 includes the subject matter of Example 14, and further including correlating the data indicating presence of the occupant to the first region of the area using a sensor map stored in a memory accessible to the processor.
  • Example 16 includes the subject matter of any of Examples 8 through 15, and further includes providing an output indicating a human presence exists, in which the output is used to control at least one of an HVAC, a lighting device, window blinds, a surveillance system, and a security system.
  • Example 17 is a computer program product including one or more non-transitory processor readable mediums encoded with instructions that when executed by one or more processors cause a process to be carried out for detecting human occupancy, the process including: receiving data representative of a plurality of IR frames captured by an infrared (IR) sensor array configured to scan an area, detecting human presence and lack of human presence in the area based on heat signature differences indicated in the IR frames, and inferring human presence in a known blind spot of the area based on detected human presence in non-blind spots neighboring the known blind spot so that entering and exiting with respect to the known blind spot is tracked.
  • the non-transitory processor readable medium(s) can be any suitable memory, such as ROM, RAM, disc, thumb drive, server, hard disk, solid state drive, etc.
  • Example 18 includes the subject matter of Example 17, the process further including: provide an output indicating a human presence exists, in which the output is used to control at least one of an HVAC, a lighting device, window blinds, a surveillance system, and a security system.
  • Example 19 includes the subject matter of Example 17 or 18, in which the process further includes: calculating a plurality of average IR frames over various time intervals, calculating a plurality of delta frames by subtracting a previously calculated average IR frame from a current average IR frame, calculating a mask frame by summing the plurality of delta frames, and tracking a position of a human presence based on a value of the mask frame.
  • Example 20 includes the subject matter of Example 19, in which the process further includes determining activity within the area based on the value of the plurality of delta frames.
  • Example 21 includes the subject matter of any of Examples 17 through 20, in which a sensor map correlates a first group of one or more pixels of the sensor array to a first region of the area and a second group of one or more pixels of the sensor array to a second region of the area, the process further including tracking the location of a human presence within the area based on the sensor map.
  • Example 22 includes the subject matter of any of Examples 17 through 21, in which inferring human presence in the known blind spot of the area includes: receiving data indicating presence of an occupant in a first region of the area, subsequently receiving data indicating no occupant being detected in the first region and no occupant being detected in a second region of the area neighboring the first region, in which the known blind spot is in the second region, and determining that the occupant moved from the first region to the known blind spot in the second region based on no occupant being detected in either of the first or second regions.
  • Example 23 includes the subject matter of Example 22, in which the process further includes correlating the data indicating presence of an occupant to the first region of the area using a sensor map stored in a memory accessible to the processor.
  • the memory may be local to the processor or remote to the processor as previously explained.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Geophysics And Detection Of Objects (AREA)

Abstract

L'invention concerne des techniques de détection de présence humaine à l'aide de données de capteurs IR. Selon certains modes de réalisation, toute activité dans un espace surveillé (imagé) par un capteur IR peut être déterminée par calcul du delta entre des trames d'images moyennes, acquises par le capteur d'imagerie. Une valeur finie de delta implique une activité/présence. Selon certains modes de réalisation, les valeurs delta (c'est-à-dire des changements dans une scène de zone cible) sont intégrées au fil du temps de manière à calculer un masque. Le masque peut servir à isoler un occupant humain (qu'il soit stationnaire ou mobile) dans la scène des objets d'arrière-plan donnés de l'espace, ce qui permet une détection de présence. La présence dans des angles morts connus de la zone peut être déduite à partir d'une présence détectée dans des angles qui ne sont pas des angles morts à proximité de l'angle mort de telle sorte que l'entrée et la sortie par rapport à l'angle mort sont suivies.
PCT/US2018/014311 2017-02-02 2018-01-19 Détection et suivi de présence humaine en fonction de la chaleur Ceased WO2018144237A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US15/422,543 2017-02-02
US15/422,543 US20170147885A1 (en) 2013-11-11 2017-02-02 Heat-Based Human Presence Detection and Tracking

Publications (1)

Publication Number Publication Date
WO2018144237A1 true WO2018144237A1 (fr) 2018-08-09

Family

ID=61193027

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2018/014311 Ceased WO2018144237A1 (fr) 2017-02-02 2018-01-19 Détection et suivi de présence humaine en fonction de la chaleur

Country Status (1)

Country Link
WO (1) WO2018144237A1 (fr)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110285851A1 (en) * 2010-05-20 2011-11-24 Honeywell International Inc. Intruder situation awareness system
US20150130933A1 (en) * 2013-11-11 2015-05-14 Osram Sylvania Inc. Human presence detection techniques
US20160202678A1 (en) * 2013-11-11 2016-07-14 Osram Sylvania Inc. Human presence detection commissioning techniques

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110285851A1 (en) * 2010-05-20 2011-11-24 Honeywell International Inc. Intruder situation awareness system
US20150130933A1 (en) * 2013-11-11 2015-05-14 Osram Sylvania Inc. Human presence detection techniques
US20160202678A1 (en) * 2013-11-11 2016-07-14 Osram Sylvania Inc. Human presence detection commissioning techniques

Similar Documents

Publication Publication Date Title
US20170147885A1 (en) Heat-Based Human Presence Detection and Tracking
EP3069076B1 (fr) Techniques de détection de présence humaine
US10816945B2 (en) Human presence detection commissioning techniques
EP1782406B1 (fr) Dispositifs de surveillance
US5212547A (en) Image processing device and method for sensing moving objects and rangefinder employing the same
US20190360714A1 (en) Fusion-based occupancy sensing for building systems
JP3453870B2 (ja) 画像処理装置と画像処理装置を用いた応用機器
EP2710801A1 (fr) Système de surveillance
US10634380B2 (en) System for monitoring occupancy and activity in a space
US20140232895A1 (en) Method and System for Adjusting Exposure Settings of Video Cameras
GB2257598A (en) Video camera surveillance system detects intruders and/or fire
CA2658347A1 (fr) Detection d'intrus par video et donnees infrarouges
US10140832B2 (en) Systems and methods for behavioral based alarms
JP2009092281A (ja) 空調制御システム
KR101512658B1 (ko) 스테레오 카메라와 퍼지 로직을 이용한 화재 불꽃 감지 장치 및 방법
US11195289B2 (en) Building management system using object detection and tracking in a large space with a low resolution sensor
WO2018061792A1 (fr) Dispositif de blocage de lumière, procédé de blocage de lumière et programme
JPH08128704A (ja) 空調制御システム
WO2018144237A1 (fr) Détection et suivi de présence humaine en fonction de la chaleur
WO2018209220A1 (fr) Détecteur d'occupation à vision binoculaire
KR101083811B1 (ko) 침입 검출 방법 및 이를 이용한 보안 로봇
JP2001118155A (ja) 人体検知装置、人体検知方法およびその方法をコンピュータに実行させるプログラムを記録したコンピュータ読み取り可能な記録媒体
KR102357380B1 (ko) 안면 인식을 이용한 출입문의 자동개폐시스템
US11100651B1 (en) Infrared intrusion detection system (IRIDS)
US20070291135A1 (en) Motion characterization sensor

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18704646

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18704646

Country of ref document: EP

Kind code of ref document: A1