GB2277845A

GB2277845A - Monitoring system

Info

Publication number: GB2277845A
Application number: GB9408761A
Authority: GB
Inventors: Eric Badique
Original assignee: Philips Electronics NV
Current assignee: Koninklijke Philips NV
Priority date: 1993-05-03
Filing date: 1994-05-03
Publication date: 1994-11-09
Anticipated expiration: 2014-05-03
Also published as: JPH0773388A; GB9408761D0; DE4314483A1; GB2277845B

Description

1 2277845 The invention relates to a monitoring system comprising at least

one camera for generating a sequence of video images of a room to be monitored, and a control circuit for setting off an alarm at a significant change of a plurality of consecutive video images, A video-phone device, which is used for room monitoring, is known from DE- Al-38 27 928. This video-phone device is provided with a monitoring circuit which stores images supplied by a camera in the video-phone device. In a comparison circuit incorporated in the monitoring circuit, the image supplied by the camera is compared with a stored image which has been recorded a short time before and an alarm is 10 triggered when the. two images to be compared differ by a predetermined extent.

In the known video monitoring system the complete image ata are processed in the monitoring circuit, so that the alarm is triggered in real time only with fast and expensive circuits.

It is therefore an object of the invention to provide a monitoring system in 15 which the alarm is triggered in real time, using a reduced number of data.

This object is solved by a monitoring system of the type described in the opening paragraph, which system comprises at least one camera for generating a sequence of video images, and a control circuit which is provided for forming a difference image of two block-structured, consecutive video images, generating status bits allocated to a stationary or a moving object for each block of a difference image, characterizing, by means of an area mark, contiguous status bits constituting an area and allocated to a moving object, determining an area parameter from the status bits of an area, and 2s - triggering an alarm when a predetermined condition of one or more area parameters is reached.

By means of a control circuit, the monitoring system according to the invention forms a sequence of difference images of two consecutive video images 2 supplied by a camera. The difference images are structured in blocks of, for example 16 x 16 or 8 x 8 pixels, Such block-structured difference images can be supplied, for example by a video coding/decoding device operating in accordance with the CCITT standard R261. A status bit is formed for each block, which bit indicates whether the block is to be allocated to a stationary or a moving object or scene. A status bit can be found either from a motion vector allocated to a block (cf. CCITT standard H.261) or in accordance with a statistical method. A logic " 1 '1 for a moving object and a logic "011 for a stationary object may be allocated to the status bit. A circuit arTangernent for determining the status bits is known, for example from BP-A-0 474 304.

To eliminate interference and noise in the status image composed of status bits, a spatial and temporal filtering operation can be performed. Subsequently, the control circuit determines areas representing a moving object. An area mark is assigned to each status bit of such an object. Circuit arrangements assigning area marks and performing the mentioned filtering operation are also known from EP-A-0 474 304.

The control circuit determines given area parameters by means of the status bits. For example, the centre of each area is determined by summation of all coordinates and subsequent division by the number of status bits for each area. The size of an area may also be determined by counting the status bits allocated to the area.

The control circuit sets off an alarm when a predetermined condition of one or more area parameters is reached. For example, the alarm may be triggered when the size of an object or the centre reach a given threshold value. Moreover, the areas can also be checked on whether they have a given shape. By means of a reduced number of image data, the invention provides the possibility of triggering an alarm in a flexible way and adapted to a multitude of requirements.

It is to be noted that the control circuit can be realised with discrete components or circuits, or also by means of a processor and an associated program.

The control circuit triggers the alarm when the centre or the centres andlor the size of an object reach a predetermined condition. The control circuit is provided for triggering an alarm when - the centre of an area reaches a predetermined position of the video image, and/or the centre of an area moves in a predetermined direction, andlor a predetermined speed of the moving centre is exceeded, andlor 3 the centre moves in a predetermined path, and/or a predetermined size of an area is reached, and/or the size of the area increases or decreases in a predetermined manner, and/or a predetermined size of a given number of areas is reached.

In determining the areas corresponding to a moving object, the control circuit characterizes a status bit allocated to a moving object after it has been found. This status bit is then characterized by means of an area mark. Subsequently, all adjacent status bits are checked on whether they are also allocated to the moving object. Thus, initially all status bits of an area are searched before the next area is determined.

When the alarm is triggered under the condition that at least two consecutive status images are compared, the areas of the consecutive status images must be allocated. The following measure is used in this case. The control circuit is provided for computing the. distances between all centres of two consecutive difference images and for allocating the areas of the consecutive difference images at a minimum distance between the centres.

A status bit of a block can be determined in that, for each block, the control circuit forms the absolute value of each difference image pixel of two consecutive video images, forms a sum of the absolute values, sms the absolute values exceeding a first threshold value, and allocates a status bit to a moving object when the sum exceeds a second threshold value and the count exceeds a third threshold value. The threshold values are dependent on, for example the camera(s) used and are to be optimized in special cases. - The invention also relates to a circuit arrangement for a monitoring system which comprises at least a camera for generating a sequence of video images, and a control circuit for forming a difference image of two block-structured, consecutive video images and for generating status bits allocated to a stationary or a moving object for each block from a difference image. For example, a video coding/decoding device operating in accordance with the CCITT standard H.261 can supply such block-structured difference images to the circuit arrangement, The circuit arrangement comprises an analysis circuit which may be part of the control circuit and 4 is provided for characterizing, by means of an area mark, contiguous status bits constituting an area and allocated to a moving object, determining an area parameter from the status bits of an area, and triggering an alarm when a predetermined condition of one or more area parameters is reached.

These and other aspects of the invention will be apparent from and elucidated with reference to the embodiments described hereinafter. In the drawing Fig. I shows an embodiment of a monitoring system, Fig. 2 shows a part of a status image with two areas, and Fig. 3 shows a plurality of areas of two consecutive status images.

Fig. 1 shows a monitoring system comprising a camera 1, a control circuit 2 and an alarm device 3. The control circuit 2 comprises a preprocessing circuit 4 and an analysis circuit 5. The preprocessing circuit 4 receives video signal (video images) from the camera I and supplies status images to the analysis circuit 5 which controls the alarm device 3. The preprocessing circuit 4 and the analysis circuit 5 may comprise discrete components or a program-controiled processor with appropriate peripherl components. It will hereinafter be assumed that the preprocessing circuit 4 and the analysis circuit 5 comprise a processor each. Both circuits 4 and 5 may also be realised with a single processor.

In the preprocessing circuit 4, block-structured difference images are generated from consecutive video images. Subsequently, a status image comprising status bits is formed from a difference image. A status bit indicates whether a block is associated with a moving object. For "ample, blocks of 8 x 8 pixels are formed and the pixels of equal blocks of two consecutive video images are subtracted from one another. The absolute values of all difference image pixels of a block are summed so that the sum SU,,,,,,, is obtained:

SUh1wk = ' I Mlilt) - f(iJ,t-l) I 1'J in which f(iJ,t) denote a pixel, i denotes a column coordinate, j denotes a row coordinate and t denotes an instant. Subsequently, the count sum ANtlock is formed:

ANblock 2- 1; H(d); d > d, d with d f(ij,t) m f(iJ,t-l) I and H(d) is the frequency of d within a block (number of the pixels within a block whose value is d).

A status bit of a block is determined in accordance with the following formula., {SUblock > TI) A (ANbWk>T2) in which T, and T2 represent two threshold values and the status bit s will be logic "I" when the status bit represents a moving object and logic "0" when the status bit represents a stationary object. The threshold values d,, T, and T2 depend, for example on the camera used and are to be optimized in special cases.

In the preprocessing circuit 4 the status bits are subsequently spatially and temporally filtered so as to suppress interference and noise. The spatial filtering operation can be described by way of the following program run; - count adjacent status bits s having the same status as the status bits to be checked; is the number larger than a given threshold value T;? yes! do not change status bit to be checked; no: invert status bit to be checked.

When the number of adjacent status bits having the same status as the status bit to be checked is larger than a given threshold value Ts, which may be equal to, for example three, the checked status bit is not changed. In the opposite case, the status bit is inverted.

In the temporal filtering operation, the status bits of a plurality of consecutive images are subjected to a disjunctive combination. For example, three consecutive status bits can be combined. The status bits of the two previous images are buffered in this case.

The filtered status bits are applied to the analysis circuit 5. In the analysis circuit 5, areas corresponding to a moving object are searched, i.e. areas in which the status bits are equal to " 1 ". The area search can be described by way of the following program run:

6 is set all area marks to zero (m(y,, y,): set area counter to one (b: 1); bit counter z: = set to 0; check the status bits s(xi,yj) 1 in a given sequence until a status bit is s (start status bit); act bit counter to one (m. = 1); set associated area mark to b (m, = b); start of loop:

all status bits adjacent to the start status bit which are equal to 1 and whose associated area mark is ni = 0 to be set at m: = b and bit counters to be raised by one unit (z., = z + 1); have all neighbours of status bits whose area mark m = 1, been checked? no: fix such a status bit as a start status bit and jump to start of loop; area counter b to be raised by one unit (b: = b + 1); number of status bits (count of the bit counter) to be stored per area set bit counter to zero (z - 0); further check the status bits in given sequence until a status bit is s = 1 and associated area mark is m 9 0; set associated area mark to b (m: = b); set bit counter to one (z: = 1); jump to start of loop; end of loop.

First, all area marks rn(y,,yi) which are allocated to the status bits are set to zero. The variables xi,yj denote coordinates in the status image. An area counter b is set to one and a bit counter z is set to zero. The status bits s(xi,yj) are checked in a given sequence until a status bit s is equal to one. This status bit is referred to as the start status bit. The bit counter z is then set to one, the associated area mark m is rendered equal to the contents of the area counter b and a jump is niade in a loop. At the start of the loop, all status bits adjacent to the start status bit are checked. If a status bit s is found which is equal to one and whose associated area mark 7 m is equal to zero, this area mark m is set to b and the bit counter z is raised by one unit. Subsequently it is queried whether the neighbours of all status bits of the start status bit have been checked. If this is not the case, an adjacent status bit, whose neighbours have not yet been checked, is fixed as a start status bit and a jump back to the start of the loop is made. Thereby, a recursive method is realised with which an area is found which represents a moving object. When this area has been found, i.e. when all neighbours of the status bits whose area mark m is equal to one have been checked, the area counter b is raised by one unit. Moreover, the number of status bits (count of the bit counter z) is stored and the bit counter z is set to zero. Subsequently, the status bits are further checked in a given sequence until a status bit is found which is equal to one and whose associated area mark m is unequal to zero. The area rnark m is rendered equal to the contents of the area counter and the bit counter z is set to one. Subsequently, there is a jump back to the start of the loop.

is Fig. 2 shows diagrammatically a status image with two areas (b =: 1 and b = 2). The size of the first area (b = 1) is eight in this example and the size of the second area (b = 2) is five. The area marks of the status bits of the areas are also shown.

The centre should be determined for triggering the alarm in given cases.

The centre coordinates xh and y,, for an area b are formed in accordance with the followihg formulas:

a.

E xi X zb - i=f nb Ilk E yi Y b - M n,, in which nb indicates'the number of status bits of an area. in addition to determining the centre of gravity in the analysis circuit 5, areas between two consecutive status images are also allocated. This allocation is realised by way of the following program run:

computing the distances of all centres between two consecutive images 1 spi(t) - spj(t-1) with i = 1,..., b,,.(t) and j = 1,..., b.,,(t-1); 8 assigning corresponding designations of centres of consecutive images having a minimum distance; storing the centres, the assigned area designation and the size of the area (number of status bits) for the last n consecutive images in a list.

is First, the distances of all centres of gravity between two consecutive images are computed:

1 spi(t) - SPAt- I) in which SPi(t) denotes the centres of the areas of the last status image with i = 1,..,, b,ax(t), while SP,(t-1) denotes the centres of the areas of the penultimate status image with j = 1,..., b..,,,(t-1) and b,,,,,(t) denotes the number of areas of the last status image and b,,,,(t-1) denotes the number of areas of the last status image but one. After the distances of all centres between two consecutive images have been computed, those centres which have a minimum distance are associated with each other. This means that the centres of two consecutive images having a minimum distance are centres of corresponding areas. For given uses it is necessary that a number of n centres and area sizes of consecutive status images are stored. For example, a sequence of ten consecutive status images (n = 10) can be stored in a list.

Fig. 3 shows diagrammatically areas of two consecutive images. Centres SPi(t) arid SPl(t-1) are assigned to these areas. The centres SPIffi and SPl(t-1) are assigned to the area b = 1 and the centres SP2(t) and SP2(t-1) are assigned to the area b = 2. The area b = 3 with the centre SP3 may either have been added to, or is no longer present in the last image.

An alarm is triggered by the analysis circuit 5, Lc. a control signal is applied to the alarm device 3 when a predetermined condition of one or more area parameters has been reached. Such an area parameter may be, for example the centre of gravity or the size of an area. For example, an alarm is generated by the analysis circuit when the centre of an area reaches a given position of the status image. The centre coordinate is then compared with a stored coordinate. The alarm will be triggered if the comparison result proves that the centre coordinate is equal to the predetermined coordinate.

An alarm may also be triggered if mere consecutive centres of gravity 9 show a given direction of motion. In this case it is checked whether a given number of centre coordinates is present in predetermined image areas.

An alarm may also be triggered, for example when the centre of an object or of an area moves at a speed which exceeds a predetermined threshold value, In this case, a plurality of consecutive centres of an area is checked and the alarm will be triggered when the path covered within the image exceeds a given threshold value. Likewise, the analysis circuit 5 may apply a control signal to the alarm device 3 when the centre of an object moves in a predetermined path.

The size of an area is given as a further area parameter. As indicated above, the size of an area is defined by the number of status bits of this area. For example, an alarm may be generated when the size of an area exceed a predetermined threshold value. In this case it is compared whether this threshold value (for example, 30 status bits per area) is exceeded.

An alarm may also be triggered when the size of an area increases or decreases in a predetermined manner or when the size of a predetermined number of objects is below or above a given threshold value.

Claims

Claims:

1. A monitoring system Comprising at least One camera (1) for generating a sequence of video images, and a control circuit (2) which is provided for forming a difference image of two block-structured, consecutive video images, generating status bits allocated to a stationary or a moving object for each block of a difference image, characterizing, by means of an area mark, contiguous status bits constituting an area and allocated to a moving object, determining an area parameter from the status bits of an area, and triggering an alarm when a predetermined condition of one or more area parameters is reached, 2. A monitoring system as claimed in Claim 1, characterized in that the control circuit (2) is provided for determining the centre and/or the size of an area as an area parameter.

3. A monitoring system as claimed in Claim 2, characterized in that the control circuit (2) is provided for determining the size of an area by counting the status bits allocated to the area.

4. A monitoring system as claimed in Claim 2 or 3, characterized in that the control circuit (2) is provided for triggering an alarm when the centre of an area reaches a predetermined position of the video image, and/or the centre of an area moves in a predetermined direction, and/or a predetermined speed of the moving centre is exceeded, and/or the centre moves in a predetermined path.

A monitoring system as claimed in Claim 2, 3 or 4, characterized in that 25 the control circuit (2) is provided for triggering an alarm when 0 a predetermined size of an area is reached, and/or the size of the area inermes or decreases in a predetermined manner, and/or a predetermined size of a given number of areas is reached.

11 6. A monitoring system as claimed in any one of Claims 1 to 5, characterized in that in determining an area each time after a status bit allocated to a -moving object has been found and after said status bit has been characterized by means of an area mark, the control circuit (2) is provided for checking all adjacent status bits 5 on whether they are also allocated to the moving object. 7. A monitoring system as claimed in any one of Claims 2 to 6, characterized in that the control circuit (2) is provided for computing the distances between all centres of two consecutive difference images and for allocating the ams of the consecutive difference images at a minimum distance between the centres.

8. A monitoring system as claimed in any one of Claims 1 to 7, characterized in that, for each block, the control circuit (2) is provided for is - forming the absolute value of each difference image pixel of two consecutive video images, forming a sum of the absolute values, counting the absolute values exceeding a first threshold value, and allocating a status bit to a moving object, when the sum exceeds a second threshold value and the count exceeds a third threshold value.

9. A circuit arrangement for a monitoring system which comprises at least a carnera (1) for generating a sequence of video images, and a control circuit (2) for forming a difference image of two block-structured, consecutive video images and for generating status bits allocated to a stationary or a moving object for each block from a difference image, characterized in that an analysis circuit (5) is provided for characterizing, by means of an area mark, contiguous status bits constituting an area and allocated to a moving object, determining an area parameter from the status bits of an area, and triggering an alarm when a predetermined condition of one or more area parameters is reached.

-