JP2009540460A - Video confirmation system and method for alarm monitoring in a central station - Google Patents

Abstract

The present invention relates to alarm monitors, and more particularly to a method and system for sending images to a central alarm station that visually confirms alarm conditions.
The present invention provides visual indicators to monitor station personnel in the form of one or more images that allow an operator to quickly determine if an alarm has been triggered and whether it should continue to watch. It improves the technical deficiencies associated with providing.
The present invention is a method that allows an operator to discern the difference between one image and the next, allowing unauthorized persons to enter and / or determine whether there are no people or objects are present, These deficiencies are improved by providing a series of low resolution images taken at time intervals.
[Selection] Figure 1

Description

The present invention relates to alarm monitors, and more particularly to a method and system for sending images to a central alarm station that visually confirms alarm conditions.

A typical remote monitor alarm system has one or more sensors in the monitored area. These sensors send alarm indicators directly or indirectly to a central monitoring station where monitoring personnel take action depending on the nature of the alarm. Such alarm indications are usually sent by a modem using a standard low bandwidth telephone (POTS) line or a low bandwidth cellular telephone line. However, false alarms can occur in these sensors and the entire system. False alarms not only cause unnecessary dispatch of police officers or security personnel, but also incur additional costs for contacting personnel in the area and homeowners. In addition to these additional costs, false alarms can also be used by monitoring station personnel to track down false alarms and waste time when monitoring personnel can respond to true alarms and other monitoring activities. Reduce efficiency. As a result, the time corresponding to the true alarm is delayed.

An approach to address the false alarm problem involves the use of a video camera that captures a video image associated with the alarming event. These approaches typically use real-time animated video that is always transmitted to a central monitoring station or transmitted based on sensor triggering. However, while a POTS line (or cell phone line) is sufficient to communicate the activation of an alarm to a central monitor station, the POTS line does not provide sufficient bandwidth to carry a usable video signal. With low resolution images that can be transmitted using a POTS line, it is difficult to determine whether an unauthorized intrusion has occurred in the monitor area. Furthermore, the use of high-speed transmission lines and technology requires additional expenses and is not easy to install. In short, it is impractical to use a video camera to capture an image for transmission to a central monitor station without some way of evaluating low resolution images.

Therefore, the low resolution image is transmitted to the central monitor station and the operator needs additional measures such as whether the alarm is a false alarm or whether the alarm is a true alarm and police officers are dispatched. It would be desirable to have a method and system that can be processed to display on a display in such a way that it can be quickly and easily determined.

The present invention provides visual indicators to monitor station personnel in the form of one or more images that allow an operator to quickly determine if an alarm is triggered and whether it should continue to watch. It improves the technical deficiencies associated with providing.

Means to solve the problem

The present invention is a method that allows an operator to discern the difference between one image and the next, allowing unauthorized persons to enter and / or determine whether there are no people or objects are present, These deficiencies are improved by providing a series of low resolution images taken at time intervals. Furthermore, the present invention can process a series of images and produce an image that shows the difference between one or more images. In this way, the operator can review each image and focus attention on potentially problematic changes rather than whether and where the differences are.

As one aspect of the present invention, the present invention provides a method for confirming an alarm system event when image data corresponding to a plurality of images related to an event of the alarm system is transmitted. Image data corresponding to a plurality of images is processed to produce one or more processed images so that the one or more processed images can be visually observed by an operator for changes in the plurality of images. Be prepared. One or more processed images are then displayed.

In one aspect of the invention, the invention provides a method for identifying an alarm system event in which image data corresponding to a plurality of images associated with the alarm event is transmitted. One or more processed images prepared so that image data corresponding to a plurality of images is processed and the one or more processed images allow an operator to visually observe changes in the plurality of images. Produced. One or more processed images are displayed on a display device.

In another aspect of the invention, the invention provides a visual confirmation of the alarm event.
A central monitoring station is provided that uses image data corresponding to a plurality of images associated with an alarm event, the central monitoring station having a central processing unit and a display. The central processing unit processes image data corresponding to a plurality of images to produce one or more processed images.

The one or more processed images are prepared so that an operator can visually observe changes in the plurality of images. The display device displays one or more processed images for visual confirmation by the operator.

In yet another aspect of the invention, the invention provides a system for confirming an alarm system event, the system having a camera, an alarm panel and a central monitoring station. The camera takes a plurality of images related to the event. The alarm panel transmits image data corresponding to a plurality of images related to the event. The central monitoring station has a central processing unit and a display device. The central processing unit processes image data corresponding to a plurality of images to produce one or more processed images. One or more processed images are prepared so that an operator can visually confirm changes in the plurality of images. The display device displays one or more processed images for visual confirmation by the operator.

Additional features of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The features of the invention will be realized and attained by means of the elements and combinations particularly pointed out in the appended claims. Both the general description given above and the detailed description given below are exemplary examples and are intended to be illustrative and not limiting the scope of the invention.

The drawings accompanying this application are incorporated in and constitute a part of this specification, represent embodiments of this specification, and together with the description, explain the principles of the invention. . While the embodiments described herein are understood to be presently preferred embodiments, the present invention is not limited to the present specification, the combinations depicted in the drawings, the exact arrangement and means thereof.
Is a schematic diagram of a system constructed in accordance with the principles of the present invention. FIG. 4 is a schematic diagram showing a typical image processing procedure of the present invention. FIG. 2 is a schematic diagram showing a typical image of the present invention. FIG. 4 is a schematic diagram of an image showing a difference in results by the image processing procedure of the present invention. FIG. 4 is a schematic diagram of an image showing a difference in results by the image processing procedure of the present invention. FIG. 3 is a schematic diagram showing a second typical image processing procedure of the present invention. FIG. 4 is a schematic diagram showing a third typical image processing procedure of the present invention. FIG. 4 is a schematic diagram of an exemplary image processing procedure of the present invention that takes advantage of the time delay between image acquisitions. FIG. 4 is a schematic diagram of an exemplary image processing procedure of the present invention that takes advantage of alarm triggers and time delays between image acquisitions.

Detailed Description of the Invention

The present invention provides a method and system that allows an operator of a remote monitoring station to conveniently determine the difference between a false alarm and a true alarm by viewing an image or series of images. One or more images provided to the operator can be transmitted from the monitored location to the central monitoring station using existing technology such as POTS lines. When an event occurs, the image may be represented in the form of a series of snapshots or a single composite image that shows the difference between two or more images.

It is understood that the same reference numbers in each drawing refer to the same elements as shown in FIG. 1, and when described with reference to the drawings, the system is constructed in accordance with the principles of the present invention and is generally designated "10".

The system 10 includes a monitor area 12 and a central monitor station 14 and can communicate with each other via a communication network 16. The communication network may be any communication network capable of transmitting image data from the monitor area 12 and the central monitor station 14, such as POTS (dial-up network), wireless cellular phone network, transmission control protocol / Internet protocol (TCP / IP). Including, but not limited to, networks and the like. In the case of a POTS dialup network, the communication line connecting the monitor area 12 with the elements of the communication network 16 may be an analog dialup telephone line, a dedicated analog telephone line, or the like.

The central monitoring station 14 is usually remote from the monitoring area 12, but this is not necessarily so. The central monitoring station 14 may be connected to the communication network in the same manner as the monitoring area 12. It should be noted that the central monitoring station 14 need not be connected to the communication network 16 in exactly the same manner as the monitoring area 12.

For example, the monitor area 12 may be connected to the communication network 16 via a dial-up analog telephone line, but the image data sent to the communication network 16 via this analog line is transmitted via a digital communication link using a protocol such as TCP / IP. It may be supplied to the central monitor station 14. From this point of view, the communication network 16 includes the components necessary to reproduce the image data from the analog line and transmit the same image data to the central monitor station 14 through the digital communication line.

Central monitor station 14 includes hardware and software as described herein, prepared to perform the functions of the present invention. For example, the central monitor station 14 includes a display device, a central processing unit, volatile and non-volatile storage devices, input / output devices, and a network interface that connects the central monitor station 14 to the communication network 16. The network interface may be a wired or wireless network interface. The central monitor station 14 is any suitable computer device such as a personal computer, mini or mainframe computer, personal digital assistant (PDA), etc., and can run on any suitable operating system known in the art. Anything is acceptable. Although a single central monitoring station 14 is described herein, this is simply for ease of explanation of the present invention. Multiple central monitoring stations 14 may be located in a remote area with a more complex arrangement, where multiple operators monitor alarms from multiple monitoring areas 12.

Further, as described in detail below, in actual operation, when an event occurs, an image or a series of images corresponding to an image is transmitted from the monitor area 12 to the central monitor station 14 through the communication network 16. The The central monitor station 14 processes the image data and presents one or more processed images on the display device screen to the operator. From this one image or a plurality of images, the operator can determine whether or not the triggering event is a true alarm.

The monitor area 12 has one or more cameras 18 and sensors 20 connected to the panel 22 by wire or wirelessly. The sensor 20 may be any sensor that can issue an alarm, such as a wired or wireless motion sensor, a thermal sensor, an infrared sensor, a glass breaking sensor, a microwave sensor, a sound wave sensor, an ultrasonic sensor, Including but not limited to acoustic sensors, optoelectronic sensors, pressure mat / sensors and magnetic sensors. The camera 18 is arranged to communicate with the panel 22 by wired or wireless communication. The camera 18 may be any camera that is suitable for taking images that are subsequently transmitted to the central alarm monitor station 14. Suitable cameras 18 include, but are not limited to, still or moving cameras that shoot in black and white or color. The camera 18 may be a fixed type or a pan / tilt / zoom type. The camera 18 may be arranged to send a continuous video image or still image to the panel 22, or it may be taken when the sensor 20 is activated. Camera 18 can also send a digital image to panel 22 or an analog image to panel 22. In the latter case, the panel 22 electronics digitize the analog image data for subsequent transmission to the central monitor station 14.

Panel 22 includes hardware and / or software that captures digital image data from camera 18, or digitizes an analog image received from camera 18 as seen above. Panel 22 also includes hardware and / or software that receives a start indication from sensor 20. Optionally, the panel 22 is one or more such as periodically capturing images regardless of the triggering event that captures image data based on one or more preset criteria, such as a starting index from the sensor 20. The camera 18 may be arranged so that it can be started. Hardware and / or software that communicates with the communication network 16 is also included in the panel 22. For example, the panel 22 includes an analog modem for dial-up communication, a DSL modem for digital communication, a mobile phone transmitter for wireless mobile communication, and the like.

In actual operation, the panel 22 facilitates communication from the monitor area 12 to the central monitor station 14, whereby the image data captured by the camera 18 is processed so that the operator in charge can analyze and act. Display on the display device.

As indicated above, the image data sent to the central monitoring station 14 may be based on an event that causes an alarm or simply an image transmitted periodically. For example, the images may be taken periodically in a continuous flow so that the image before the alarm is taken. In any case, the image data of a series of consecutive images is transmitted to the central monitor station 14 for display on a display device or subsequent processing. In the former case, a series of images are displayed on a single display screen, such as a thumbnail image format, which allows the operator to add additional measures that require the dispatch of police officers, security personnel, etc. in the monitor area. It can be determined whether or not the activity requesting the In the latter case, a central monitoring station 14 or other processing device (not shown) processes the image as described in detail below to facilitate subsequent analysis by the operator.

An example of obtaining image data and processing the image data to produce a display image for visually confirming an event that causes an alarm will be described. A first exemplary method for creating an image of a display device will be described with reference to FIGS. When an event that causes an alarm occurs, image data corresponding to images 24a-24e is transmitted from panel 22 to central monitoring station 14. The monitor station 14 processes the image by subtracting the image data of each image from the image data of the previous image to produce four sub-images 26a-26d. The resulting processed images 26a-26d are displayed on the monitor station 14 so that the operator can determine whether there are any conditions that require further action. In the method shown in FIG. 2, each sub-image is a difference between an image obtained by the camera 18 and a previous image taken by the camera. By showing the operator four processed images 26a-26d, the operator can quickly determine if none of the previously captured images were missing or missing from the previous images. Judgment can be made.

For example, FIGS. 3A, 3B, and 3C show three examples of two consecutive images and one processed image obtained by the method shown in FIG. 2 or by any other exemplary method described herein. Indicates. FIG. 3A shows a frame 28 that includes a person 30, a table 32 and a box 34. Such an image corresponds to, for example, the image 24a in FIG. The next photographed image shown in the frame 36 of FIG. 3B shows only the table 32 and the object 38.

In one embodiment, the frames 28 and 36 are shown to the operator of the monitor station 14 and the operator can visually determine that no person 30 is present in the frame 36 and the box 34 is missing. This has important implications and the operator must alert security personnel or police officers. Frame 36 also corresponds to image 24b of FIG. In such a case, monitor station 14 processes the image data corresponding to images 24a and 24b, respectively, shown as frames 28 and 36 in FIGS. 3A and 3B, respectively, producing a processed frame 40 shown in FIG. 3C. It corresponds to the processed image 26a shown in FIG. In such a case, the operator is provided with a processed image showing the person 30, the box 34 and the object 38.

It should be noted that when subtracting image data of an image that exists in the next frame but does not exist in the previous frame, for example, an image like the object 38 in FIG. 3B, it becomes a negative number, and the corresponding data is Since the value is less than or equal to the black image value (black value), the resulting data is not displayed as an image.

However, the data of all processed images can be scaled so that all the data can be seen visually, or the negative values of the processed image data are displayed as their absolute values. For example, if the processed image is displayed at the central monitor station 14 in a gray scale where each pixel is represented by a 0-255 value, the data corresponding to the processed image is such that all pixels fall within this range, or It may be scaled so that the processed pixel is a negative number. This is because it exists in the next frame or did not exist there and can be expressed as an absolute value. A more detailed example is given below. Further, the image data or the resulting processed image may be further processed to reduce noise present in the image. It should be noted that the normalization, absolute value, and noise reduction processing can be applied to any of the image processing methods discussed and described herein, and is not limited to the method shown in FIG.

Another exemplary method for processing image data and presenting the processed image to the operator of the central monitor station 14 will be described in relation to FIG. Assume that an alarm event has occurred and images 24a-24e have been taken. In accordance with the method herein, processed images 26a-26d are further processed to produce a single processed image 42 representing summary data corresponding to images 26a-26d.

The resulting composite processed image 42 is displayed to the operator of the central monitor station 14. This procedure conveniently displays a single image on the central monitoring station 14 to allow the operator to quickly determine the presence or absence of a person, object, etc. so that the operator can enter the monitoring area with security personnel or police. You can decide whether or not to call the officer. For example, although not shown here, if a person is walking through the room, the processed image 42 indicates that the person is in a different position in the image, thereby causing the operator to move the person in the monitor area. Can be quickly determined. In such a situation, the operator can quickly grasp this situation visually and determine whether the next action is necessary.

Furthermore, an example of another method for creating a single processed image on the display device of the monitor station 14 based on the captured image will be described with reference to FIG. In this method, images 24a-24e are processed so that image 24a serves as a starting point, the data for each subsequent image is subtracted from the image data corresponding to image 24a, and the summarized result is a single image. Is done. For example, image data corresponding to the images 24a-24e is transmitted to the monitor station 14 by the panel 22, and each of the sub-images corresponds to a difference between the image 24a and one of the images 24b-24e. Processed to produce images 44a-44e. Data corresponding to each sub-image 44a-44e is summarized to produce a processed image 46. In the method shown in FIG. 5, the first image is substantially scaled by the remaining number, and each subsequent image is subtracted from the image 24a. Pixel value normalization, denoising and / or absolute value processing may be performed on any of the sub-images 44a-44d and / or the processed image 46.

It should be noted that one or more of the images 24a-24e shown in FIGS. 2, 4, and 5 may correspond to the captured images that trigger a pre- or post-warning event. For example, the image 24a may be an image of a prior event, and the remaining captured images 24b-24e may be images that serve as an after event. Also, it should be noted that the present invention is not limited to taking and processing five images, and any number of images may be taken and processed.

Therefore, it should be understood that the use of the five captured images is merely for ease of explanation and understanding.

In the methods shown and described with respect to FIGS. 2, 4 and 5, the interval between the capture of each image 24a-24e is assumed to be a predetermined interval, but this need not necessarily be the case. For example, as shown in FIG. 6, a time delay 48 can be placed between the capture of images 24a and 24b so that the processed image 50 includes or is replaced by an additional time delay 48. Can be scheduled. The time delay 48 is based on the shooting of an event triggered by the image 24a, and any event occurring within the time delay 48 can be set to be subsequently captured as the image 24b. For example, a person running through a zone monitored by a motion detector detects an event that triggers an alarm that is triggered, and image 24a is taken and image 24b is taken before the person can exit the zone. Is filmed. Such a procedure has the advantageous benefit of reducing the amount of image data transmitted and processed. As stated above, the time delay 48 need not necessarily be provided in addition to the predetermined time interval between the capture of the images 24a and 24b. Rather, the time delay 48 can replace a predetermined time interval and can be determined on an implementation basis each time.

In addition, FIG. 7 illustrates another exemplary method in which time delay can be used to reduce the amount of image data that is transmitted and processed at the central monitoring station 14.

In the method shown in FIG. 7, time delay 48 is inserted between images 24b and 24c, where images 24a-24c are subsequently processed, image 24a serves as a starting point, and data corresponding to images 24b and 24c. Is subtracted from the image 24a. This procedure is convenient for use on a monitored door when a person is not yet in the video monitor zone. By placing a time delay between subsequent images, it is possible to allow time for a person to enter the monitored zone and in doing so create and display a useful evaluated image.

In addition to presenting one or more processed images for the operator to visually confirm the event causing the alarm, the present invention also provides that the difference between the captured images exceeds a predetermined threshold. Other indicators can also be provided. Such an indicator may be an indicator visually confirmed on a display screen such as a pop-up box, text, or icon, or by an indicator different from the display screen, for example, another light, sound, etc. It may be a thing. In this way, an alert may inform the operator that the change is significant and that the operator is serious enough to pay attention to one or more images presented for visual confirmation. good.

As noted above, image processing may also include a process for removing noise. For example, this sets the intensity threshold level of the processing software so that when two image data corresponding to two images are subtracted, only those pixels with a numerical value exceeding a predetermined threshold are displayed. This is possible. In this same context, the total number of pixels that exceed the noise threshold can be expressed as a percentage of the total image pixels that can be displayed on the screen for the operator and is significant between the two images being compared. It can be used as a figure of merit for determining whether there is a reasonable expectation that there is a significant change. This figure of merit may be stored for the purpose of record storage, for example as a database such as the database of the central monitor station 14. This figure of merit can be used as a basis to compare with a predetermined threshold to determine whether an indicator can be provided to the operator and whether it is provided.

As mentioned above, subtraction operations during processing can result in negative or non-displayable pixels, and one way to correct this is to scale the image display value. That is. One way to do this is to scale the pixels using the following method:
C = ((AB) / 2) + (R / 2)
Where C is equal to the value of the displayed pixel, A is the value of pixel A of the first image, such as image 24a, B is equal to the pixel value corresponding to the image being subtracted, such as image 24b, and R Is the full range of the levels of the two images.

If additional contrast is needed, an additional scaling factor may be added as follows:
C = (x (AB) / 2) + (R / 2)
Here, X is a normalization factor larger than 1. If X is C then R> then a restriction algorithm can be used: eg C = R if C> R, and C = O if C <0.

The contrast level is automatically set in the program software and the image is processed, while the contrast level (x) can be adjusted by the operator, for example, a display window displaying the image is provided with a slider or displayed For example, another input section is provided on the screen.

The present invention can be implemented with software that can be placed in the central monitoring station 14 and does not require the significant use of computer power to operate, process and display images, and the operator A method, system, and central monitoring station are provided that allow visual confirmation of the device. Therefore, the program software used to perform the functions described above does not perform extensive digital signal processing (DSP) and therefore does not require significant use of the computer's capabilities. Thus, the present invention is suitable to be implemented in the form of a small application program that resides at and runs on the central monitoring station 14. Of course, software applications that perform the functions described above can also be easily provided by a more centralized server, where all image data coming from one or more monitor areas is processed by the server, and subsequent visual confirmation. Can be transmitted to one or more central monitoring stations 14.

The present invention can be realized by hardware, software, or a combination of hardware and software. The method and system of the present invention may be implemented in a centralized manner by a single computer system or in a distributed manner in which different elements extend across several interconnected computer systems. Any computer system or other device suitable for performing the methods described herein is suitable for performing the functions described herein.

A typical combination of hardware and software may be a specific or general-purpose computer system having one or more processing elements and a computer program stored on a recording medium, and when the data is read and executed, the computer The computer system is controlled so that the system performs the methods described herein. The present invention may also be embedded in a computer program product that includes all of the features that enable the execution of the methods described herein and that can execute these methods when loaded into a computer system. . A recording medium refers to any volatile or non-volatile recording device.

A computer program or application as referred to in the present invention refers to a set of instructions in any representation, language, code or notation intended to perform a specific function of a system having information processing capabilities, Performed directly or after one or both of the following is performed: a) conversion to another language, code or notation; b) reproduction to a different material form . Furthermore, it should be noted that not all of the accompanying drawings are drawn to scale unless otherwise specified herein. It should be noted that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof, and as such is intended to illustrate the scope of the invention from the following specification. Reference should be made to the scope of

Claims (22)

A method for confirming an alarm system event, comprising:
Transmitting image data corresponding to a plurality of images related to the event;
Processing image data corresponding to a plurality of images to produce one or more processed images, wherein the one or more processed images are prepared such that an operator can visually confirm changes in the plurality of images; and one or more Including displaying processed images of
Said method. The method of claim 1, wherein the one or more processed images are displayed as a series of processed images. The method of claim 1, wherein a single processed image is displayed, and the single processed image is a composite image showing differences between at least two of the plurality of images. 4. The method of claim 3, further comprising providing an indication to the operator if the difference between the at least two plurality of images exceeds a predetermined threshold. The method of claim 2, wherein each of the processed images is indicative of a difference between two consecutive images in a plurality of images. The method of claim 2, wherein the processed image is a thumbnail image. 4. The method of claim 3, wherein the single processed image is indicative of a sum of differences between consecutive images. 4. The method of claim 3, wherein the single processed image is indicative of a sum of differences between the first image and each other image of the plurality of images. The method of claim 1, wherein a first image of the plurality of images corresponds to a pre-event image. The method of claim 1, wherein a predetermined time interval is provided while acquiring each of the plurality of images, wherein the method further includes adding at least two images of the plurality of images. Said method comprising providing a time delay. 4. The method of claim 3, wherein processing the image data includes scaling the data corresponding to the processed image to create a displayable processed image that can be visually recognized. A central monitoring station that uses image data corresponding to a plurality of images related to an alarm event and visually confirms the alarm event,
A central processing unit that processes image data corresponding to a plurality of images, creates one or more processed images, and the one or more processed images are prepared so that an operator can visually confirm changes in the plurality of images. A display device that displays one or more processed images so that the operator can visually confirm;
Including central monitoring station. The central monitoring station of claim 12, wherein the one or more processed images are displayed as a series of processed images. The central processing unit creates a single processed image for display, the single processed image being a composite image showing a difference between at least two of a plurality of images; The central monitoring station of claim 12. 15. The central monitoring station of claim 14, further comprising an alarm indicator that is issued to an operator if a difference between at least two of the plurality of images exceeds a predetermined threshold. The central monitoring station of claim 13, wherein each processed image is indicative of a difference between two consecutive images of the plurality of images. The central monitoring station of claim 13, wherein the processed image is a thumbnail image. The central monitoring station of claim 14, wherein the single processed image is indicative of a sum of differences between successive images. The central monitoring station of claim 14, wherein the single processed image is indicative of a sum of differences between the first image and each other of the plurality of images. The central monitoring station of claim 12, wherein a first image of the plurality of images corresponds to a pre-event image. 15. The central monitoring station of claim 14, wherein processing the image data includes creating a displayable processed image that scales the data corresponding to the processed image and is visually recognizable. A system for confirming an alarm system event, the system comprising:
A camera that captures a plurality of images related to the event;
An alarm panel for transmitting image data corresponding to a plurality of images related to the event; and a central monitoring station having a central processing unit and a display device;
The central processing unit processes image data corresponding to a plurality of images to create one or more processed images, and the one or more processed images are such that an operator can visually confirm changes in the plurality of images. And a display device displays the one or more processed images;
Said system.

Images