JP2009071771A - Image processing apparatus, image data recording system, surveillance camera system, and image processing apparatus control method - Google Patents

Abstract

An image processing apparatus that achieves low power consumption by controlling image processing based on a result of moving object detection and that can be applied to a surveillance camera system that uses a plurality of surveillance cameras.
An image processing apparatus 1 receives image data 12-1 to N in time series, and selects at least one image data from the received image data 102-1 to N to select an image. An image data generation unit 110 that generates data 14, an image processing unit 200 that performs predetermined image processing on the image data 14, and a moving object detection unit that detects an image change in a predetermined area with respect to a predetermined input channel 130, an interrupt signal generator 140 for generating an interrupt signal 16 based on the image change detection result 132 by the moving object detector 130, and a control so that the image processor 200 starts processing based on the interrupt signal 16. And an interrupt processing unit 220.
[Selection] Figure 1

Description

  The present invention relates to an image processing apparatus, an image data recording system, a surveillance camera system, and a control method for the image processing apparatus.

Surveillance camera systems that use a plurality of surveillance cameras are used in order to monitor a plurality of different areas and widen the area to be monitored. In a surveillance camera system that uses multiple surveillance cameras, a moving object is detected by measuring temporal changes in the images captured by each surveillance camera, and the monitor video is switched to the surveillance camera image from which the motion object was detected. Or issue an alarm.
JP 2001-36893 A

  However, in the conventional surveillance camera system using a plurality of surveillance cameras, the main focus is on improving the accuracy of surveillance, and the video of the surveillance camera is constantly transmitted to a monitor or the like regardless of whether or not a moving object is detected. It was a system with high power consumption.

  The present invention has been made in view of the above-described problems, and achieves low power consumption by controlling image processing based on the result of moving object detection, and uses a plurality of surveillance cameras. An object of the present invention is to provide an image processing apparatus that can also be applied to a surveillance camera system.

(1) The image processing apparatus of the present invention
An image processing apparatus that generates predetermined image data based on a plurality of image data input to a plurality of input channels, performs image processing, and outputs the image data.
An image data receiving unit for receiving each of the plurality of image data in time series;
An image data generating unit that selects at least one image data from a plurality of image data received by the image data receiving unit and generates predetermined image data;
An image processing unit that performs predetermined image processing on the image data generated by the image data generation unit;
For each predetermined input channel, each image constituted by each image data input to the input channel and received in time series by the image data receiving unit is divided into one or more areas, and image changes in the predetermined area are performed. A moving object detection unit to detect;
An interrupt signal generator for generating a predetermined interrupt signal based on the detection result of the image change by the moving object detector;
And an interrupt processing unit that controls the image processing unit to start image processing based on the interrupt signal.

  The image data input to the image processing apparatus may be in an interlace format or a progressive format.

  The image data generation unit may generate, for example, one piece of image data selected from a plurality of pieces of image data as predetermined pieces of image data, or two or more pieces of image data selected from a plurality of pieces of image data are merged to form a predetermined portion. The image data may be generated. The image data generation unit may generate progressive image data combining the interlaced odd-numbered image data and the even-numbered image data as predetermined image data, or even-numbered lines (or odd-numbered lines). Is replaced with image data of odd lines (or even lines), or image data of even lines (or odd lines) is replaced with an average value of image data of adjacent odd lines (or even lines), etc. The image data may be generated.

  The image processing unit may stop the image processing operation when a predetermined condition is satisfied during the image processing operation. For example, when an image change is no longer detected by the moving object detection unit for a predetermined time during the image processing operation, the image processing operation may be stopped.

  The predetermined image processing performed by the image processing unit may be, for example, compression processing into JPEG format data.

  The moving object detection unit, for example, integrates the values (for example, luminance values) of the pixels constituting the image in each area, and compares the accumulated value with the integrated value in the image in the corresponding area of the previous image. A change may be detected. The moving object detection unit may detect image changes for all areas of each image, or may detect image changes only for specific areas.

  In addition, the moving object detection unit may detect an image change by fixing to one input channel, or may detect an image change constantly for all input channels, The image change may be detected in a time division manner by switching the input channels.

  The interrupt signal generation unit may generate an interrupt signal when an image change is detected for at least one input channel when the moving object detection unit detects an image change for a plurality of input channels. However, an interrupt signal may be generated only when an image change is detected for all input channels.

  The image processing apparatus of the present invention may be composed of one chip or a plurality of chips.

  According to the present invention, image processing is started when a change in an image within a predetermined area of an image constituted by input image data is detected (moving object detection). That is, image processing that is considered to have the largest power consumption can be performed only when a moving object is detected, so that the power consumption can be greatly reduced. In addition, when image-processed data is transmitted or stored, the amount of data to be transmitted or stored can be greatly reduced. In this case, the image until the moving object is detected is not transmitted or stored, but the image processing apparatus of the present invention can be applied to a monitoring camera apparatus or the like that only needs to transmit or store the image after the moving object is detected. .

  Furthermore, according to the present invention, it is possible to detect image changes for a plurality of input channels. Therefore, the presence / absence of moving object detection can be determined with higher accuracy based on the image change detection information for a plurality of input channels.

  Further, according to the present invention, predetermined image data can be generated and image-processed based on a plurality of image data, and can be output. Therefore, the image data to be output can be switched depending on the result of moving object detection. For example, only the image data input from the input channel detected by the moving object may be processed and output, or the ratio of the image data input from the input channel detected by the moving object may be output. You may make it increase.

(2) The image processing apparatus of the present invention
The moving object detection unit includes:
The image change is detected based on a clock supplied accompanying the image data input to the predetermined input channel.

  For example, the moving object detection unit may detect an image change based on a clock (camera clock) output from a camera module that supplies image data to each input channel.

  In addition, when the image processing apparatus of the present invention controls another apparatus to output a clock and the camera module outputs image data in synchronization with the clock, the moving object detection unit performs an image based on the clock. You may make it detect a change.

  According to the present invention, since the moving object is detected based on the clock supplied accompanying the image data, the moving object detection operation can always be performed if the image data is supplied. Therefore, it is possible to prevent the moving body from being overlooked.

  Further, according to the present invention, the moving object detection is performed for each input channel based on the clock supplied along with the image data, so that the moving object detection is stopped even when the input channel to be detected is switched. You can avoid it. Therefore, it is possible to prevent the moving body from being overlooked.

(3) The image processing apparatus of the present invention
The image data generation unit
An I / P conversion processor that converts the interlaced image data into progressive image data (I / P conversion);
The I / P conversion processing unit
When the moving object detection unit detects the image change, an I / P conversion process is started.

  According to the present invention, the I / P conversion process is started when a moving object is detected. That is, the I / P conversion process that is considered to have a relatively large power consumption can be performed only when a moving object is detected, so that the power consumption can be reduced.

(4) The image processing apparatus of the present invention
The moving object detection unit includes:
The image change is detected for each input channel.

  The moving object detection unit detects an image change for all input channels, and the interrupt signal generation unit generates an interrupt signal when the moving object detection unit detects an image change for at least one input channel. It may be.

  According to the present invention, since an image change is detected for each input channel, the presence / absence of moving object detection can be determined with higher accuracy based on image change detection information for each input channel.

(5) The image processing apparatus of the present invention
The moving object detection unit includes:
The image change is detected by switching an input channel to be detected based on a predetermined control signal.

  For example, the moving object detection unit may detect image changes by sequentially switching the input channels to be detected at regular time intervals, or may detect different image changes by setting different times for each input channel. May be.

  The predetermined control signal may be supplied from the outside of the image processing apparatus, or may be generated inside the image supply apparatus.

  According to the present invention, since the image change is detected by switching the input channel to be detected, it is possible to more accurately determine the presence or absence of moving object detection based on the image change detection information for a plurality of input channels.

(6) The image processing apparatus of the present invention
An image data transmission unit that transmits image data image-processed by the image processing unit to an external device;
The interrupt processing unit
Based on the interrupt signal, the image data transmission unit is controlled to start transmitting image data.

  The external device may be a directly connected storage device (non-volatile memory or the like) connected to the image processing apparatus of the present invention for recording image data, or the image processing apparatus of the present invention via a network. It may be a terminal such as a display device or a storage device connected to the device.

  According to the present invention, image data transmission to an external device is started when a moving object is detected. That is, since data transmission that is considered to have relatively high power consumption can be performed only when a moving object is detected, power consumption can be reduced.

(7) The image processing apparatus of the present invention
An integrated circuit device for image reception including a plurality of input channels, including the image data receiving unit, the image data generating unit, the moving object detecting unit, and the interrupt signal generating unit;
An image processing integrated circuit device including the image processing unit, the image data transmission unit, and the interrupt processing unit.

  According to the present invention, an image data receiving unit, an image data generating unit, a moving object detecting unit, and an interrupt are constituted by a two-chip configuration of an image receiving integrated circuit device (IC) and an image processing integrated circuit device (IC). The clock supplied to the signal generation unit and the clock supplied to the image processing unit, the image data transmission unit, and the interrupt processing unit can be easily separated. Therefore, for example, the image receiving integrated circuit device (IC) can be operated at a low speed by setting the image processing integrated circuit device (IC) to the sleep mode while the image receiving integrated circuit device (IC) is normally operated in order to perform moving object detection. Therefore, an image processing apparatus with low power consumption can be provided.

(8) The image processing apparatus of the present invention
The image processing integrated circuit device comprises:
An image output clock generation unit that starts generating an image output clock based on the interrupt signal and outputs the image output clock to the integrated circuit device for image reception;
The image receiving integrated circuit device comprises:
The image data generation unit generates the predetermined image data based on the image output clock, and outputs the image data to the integrated circuit device for image processing.

According to the present invention,
According to the present invention, an integrated circuit device (IC) for image processing generates an image output clock when a moving object is detected, and an image output clock to an image data generation unit of the integrated circuit device (IC) for image reception. Start supplying. That is, in an integrated circuit device (IC) for image reception, an image data generation unit that is considered to have relatively high power consumption is operated only when a moving object is detected, while the moving object detection unit is always operated. be able to. Therefore, an image processing apparatus with low power consumption can be provided.

(9) The present invention
An image processing apparatus as described above;
A plurality of imaging means for supplying a plurality of image data to the image processing apparatus;
An image data recording system comprising: storage means for recording image data output by the image processing apparatus.

  According to the present invention, when a moving object is detected, the image processing apparatus starts image processing and outputs image data, and the image data is recorded in the storage unit. Therefore, it is possible to selectively save the image data after moving object detection. Therefore, it is possible to provide an image data recording system that greatly reduces the amount of data to be stored and the power consumption.

(10) The present invention
A monitoring camera system in which the image processing device described above and a monitoring camera device including a plurality of imaging means and at least one terminal are connected via a network,
The image processing apparatus includes:
When the image change is detected based on the plurality of images captured by the plurality of imaging units, predetermined image data is sequentially generated based on the plurality of image data, and the terminal is connected via the network. It is characterized by transmitting to.

  According to the present invention, the image processing apparatus starts image processing when a moving object is detected, and transmits image data to the terminal via the network. Therefore, it is possible to selectively transmit the image data after moving object detection. Therefore, it is possible to provide a surveillance camera system that greatly reduces the amount of transmission data and power consumption.

(11) The present invention
An image data receiving unit that receives a plurality of image data input to a plurality of input channels in time series, and at least one image data selected from the plurality of image data received by the image data receiving unit, and predetermined image data An image data generation unit that generates image data and an image processing unit that performs predetermined image processing on the image data generated by the image data generation unit, and generates predetermined image data based on the plurality of image data And an image processing apparatus control method for image processing and outputting,
For each predetermined input channel, each image constituted by each image data input to the input channel and received in time series by the image data receiving unit is divided into one or more areas, and image changes in the predetermined area are performed. Detecting step;
Generating a predetermined interrupt signal when the image change is detected;
And a step of controlling the image processing unit to start image processing based on the interrupt signal.

  DESCRIPTION OF EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings. The embodiments described below do not unduly limit the contents of the present invention described in the claims. Moreover, not all of the configurations described below are essential constituent requirements of the present invention.

1. Image Processing Device FIG. 1 is a functional block diagram of an image processing device according to the present embodiment.

  The image processing apparatus 1 generates predetermined image data 14 based on a plurality (N) of image data 12-1 to 12-N input to a plurality (N) of input channels, performs image processing, and outputs the image data 14 It works like this.

  The image processing apparatus 1 includes an image data receiving unit 100. The image data receiving unit 100 receives a plurality (N) of image data 12-1 to 12-N in time series. For example, the image data receiving unit 100 receives N pieces of image data 12-1 (t) to 12-N (t) at time t, and N pieces of next image data 12-1 (t + 1) to 12 at time t + 1. 12-N (t + 1) is received. The image data receiving unit 100 may be configured to be able to receive interlaced or progressive image data 12-1 to 12-N.

  The image processing apparatus 1 includes an image data generation unit 110. The image data generation unit 110 selects at least one image data from the plurality of image data 102-1 to 102-N received by the image data reception unit 100 and generates predetermined image data 14. In addition, when the image data receiving unit 100 receives the interlaced image data 12-1 to 12-N, the image data generating unit 110 converts the interlaced image data 102-1 to 12-N into the progressive image. An I / P conversion processing unit 120 that converts data (I / P conversion) may be included. The I / P conversion processing unit 120 may start the I / P conversion processing when the moving object detection unit 130 detects an image change. By doing so, the I / P conversion process that is considered to have a relatively large power consumption can be performed only when a moving object is detected, so that the power consumption can be reduced.

  The image processing apparatus 1 includes an image processing unit 200. The image processing unit 200 performs predetermined image processing (for example, conversion processing to JPEG format) on the image data 14 generated by the image data generation unit 110.

  The image processing apparatus 1 may include an image data transmission unit 210. The image data transmission unit 210 transmits the image data 202 (22) image-processed by the image processing unit 200 to an external device (not shown).

  The image processing apparatus 1 includes a moving object detection unit 130. The moving object detection unit 130 divides each image composed of each image data input to the input channel and received in time series by the image data receiving unit into one or more areas for a predetermined input channel. The image change in the area is detected. For example, the moving object detection unit 130 may generate the image change detection signal 132 when detecting an image change.

  The moving object detection unit 130 includes only one area sensor, and may be fixed to any one of the image data 102-1 to 102-N to detect an image change, or all the image data 102 may be detected. Image changes may be detected for −1 to 102-N.

  The moving object detection unit 130 may detect an image change based on a clock supplied accompanying the image data (12-1 to 12-N) input to a predetermined input channel. For example, when the moving object detection unit 130 detects an image change based on the image data 12-1, the clock (supplied in synchronization with the image data 12-1) is supplied along with the image data 12-1. The image change may be detected based on the clock.

  The clock may be supplied only to the image data reception unit 100, the moving object detection unit 130, and the interrupt signal generation unit 140, and the supply of the clock may be stopped or a low-speed clock may be supplied to the other parts. By doing so, since the moving object detection operation can always be performed if the image data 12-1 to 12-N is supplied, it is possible to prevent the moving object from being overlooked with low power consumption. In addition, even if the input channel to be subjected to moving object detection is switched, it is possible to prevent the moving object detection from being stopped, so that it is possible to prevent the moving object from being overlooked while having low power consumption.

  Further, the moving object detection unit 130 may detect an image change for each input channel. By doing so, it is possible to more accurately determine the presence or absence of moving object detection based on image change detection information for each input channel. For example, the moving object detection unit 130 may include N area sensors that detect image changes for the image data 102-1 to 102-N. In addition, when the moving object detection unit 130 includes N area sensors, the moving object detection unit 130 generates N image change detection signals 132 (132-1 to 132-N) based on the detection results of the area sensors. Also good.

  Further, the moving object detection unit 130 may detect an image change by switching an input channel to be detected based on a predetermined control signal 18. By doing so, it is possible to more accurately determine the presence or absence of moving object detection based on image change detection information for each input channel. For example, the moving object detection unit 130 includes only one area sensor that detects an image change in common with respect to the image data 102-1 to 102 -N, and the image data 102 at predetermined time intervals based on the control signal 18. -1 to 102-N may be selected in order, and an image change detection signal 132 may be generated when an image change is detected.

  The image processing apparatus 1 includes an interrupt signal generation unit 140. The interrupt signal generator 140 generates a predetermined interrupt signal 16 based on the detection result of the image change by the moving object detector 130. For example, the interrupt signal generator 140 may always generate the interrupt signal 16 when the image change detection signal 132 is supplied, or the image change detection signal 132 and the input channel where the image change is detected can be generated. Whether to generate the interrupt signal 16 may be determined based on the information.

  Further, the interrupt signal generation unit 140 always detects an interrupt signal when the moving object detection unit 130 detects an image change for at least one input channel when the moving object detection unit 130 detects an image change for each input channel. 16 may be generated.

  The image processing apparatus 1 includes an interrupt processing unit 220. The interrupt processing unit 220 controls the image processing unit 200 to start processing based on the interrupt signal 16.

  Further, the interrupt processing unit 220 may control the image data transmission unit 210 to start transmitting the image data 22 based on the interrupt signal 16. By doing so, data transmission that is considered to have relatively high power consumption can be performed only when a moving object is detected, so that power consumption can be reduced. For example, the interrupt processing unit 220 generates a clock enable signal 222 that enables clocks (not shown) supplied to the image processing unit 200 and the image data transmission unit 210 when the interrupt signal 16 is generated. Also good.

  The image data receiving unit 100, the image data generating unit 110, the moving object detecting unit 130, and the interrupt signal generating unit 140 are integrated into one chip of an integrated circuit device for image reception (multi-channel image receiving IC) 10 having a plurality of input channels. It may be included. The multi-channel image receiving IC (10) causes the image data generating unit 110 to generate predetermined image data 14 based on the image output clock 24, and output the image data 14 to the image processing IC (20). It may be.

  The image processing unit 200, the image data transmission unit 210, and the interrupt processing unit 220 may be included in one chip of the integrated circuit device (image processing IC) 20 for image processing. The image processing IC (20) may include an image output clock generation unit 230. The image output clock generation unit 230 may start generating the image output clock 24 based on the interrupt signal 16 and output the image output clock 24 to the multi-channel image receiving IC (10).

  According to the image processing apparatus of the present embodiment, when an image change in a predetermined area of an image constituted by any of the image data 12-1 to 12-N is detected (moving object detection), the image processing unit 200 starts image processing. That is, image processing that is considered to have the largest power consumption can be performed only when a moving object is detected, so that the power consumption can be greatly reduced. In addition, when the image-processed data 22 is transmitted or stored, the amount of data to be transmitted or stored can be greatly reduced. In this case, the image until the moving object is detected is not transmitted or stored, but the image processing apparatus according to the present embodiment is applied to a monitoring camera apparatus or the like that only needs to transmit or store the image after the moving object is detected. Can do.

  Also, according to the image processing apparatus of the present embodiment, the moving object detection unit 130 can detect image changes for a plurality of input channels. Therefore, based on the image change detection information 132 for a plurality of input channels, the interrupt signal generation unit 140 can more accurately determine the presence or absence of moving object detection.

  In addition, according to the image processing apparatus of the present embodiment, it is possible to generate predetermined image data based on the plurality of image data 12-1 to 12-N, perform image processing, and output it. The output image data 22 can be switched depending on the result. For example, only the image data input from the input channel detected by the moving object may be processed and output, or the ratio of the image data input from the input channel detected by the moving object may be output. You may make it increase.

  Further, according to the image processing apparatus of the present embodiment, the image data receiving unit 100, the image data generating unit 110, and the moving object are configured by a two-chip configuration of the image receiving IC (10) and the image processing IC (20). The clock supplied to the detection unit 130 and the interrupt signal generation unit 140 and the clock supplied to the image processing unit 200, the image data transmission unit 210, and the interrupt processing unit 220 can be easily separated. For this reason, for example, the image receiving IC (10) can be operated in a sleep mode at a low speed while the image receiving IC (10) is normally operated in order to detect a moving object. Therefore, an image processing apparatus with low power consumption can be provided.

  Also, according to the image processing apparatus of the present embodiment, the image processing IC (20) generates the image output clock 24 and moves to the image data generation unit 110 of the image reception IC (10) when a moving object is detected. Supply of the image output clock 24 is started. In other words, in the image receiving IC (10), while the moving object detection unit 130 is always operated, the image data generation unit 110 considered to have relatively large power consumption is operated only when the moving object is detected. Can do. Therefore, an image processing apparatus with low power consumption can be provided.

2. Image Data Recording System FIG. 2 is a configuration diagram of an image data recording system (for example, a surveillance camera) according to the present embodiment.

  Reference numerals 30-1 to 30-4 denote camera modules (for example, NTSC / PAL compatible cameras) (imaging means), and 32-1 to 32-4 denote decoders (for example, NTSC / PAL compatible video decoders).

  Reference numeral 10 denotes the multi-channel image receiving IC described with reference to FIG. The multi-channel image receiving IC (10) has a plurality of video input channels. For example, the multi-channel image receiving IC (10) has four channels of video input, and the four image data 12-1 to 12-4 output by the four decoders 32-1 to 32-4 are each channel. Is input. By using a set of a 4-channel image receiving IC and a single camera type image processing IC, it is possible to connect to a maximum of four camera sets (camera module + NTSC / PAL compatible video decoder).

  An image processing IC 20 described with reference to FIG. 1 includes, for example, various interfaces such as a CF memory, an SD memory, a USB, and a multi-channel ADC in addition to a camera interface function and a JPEG encoder function. By combining the multi-channel image receiving IC (10) with the image processing IC (20), the digital signals from the NTSC / PAL compatible video decoders 32-1 to 32-4 can be converted into JPEG images. .

  The image processing IC (20) may have a plurality of camera interface functions. For example, as shown in FIG. 15, the outputs OUT1 and OUT2 of the multi-channel image receiving ICs (10-1 and 10-2) are connected to the two inputs I1 and I2 of the image processing IC (20), respectively. Thus, for example, connection with eight camera sets C1 to C8 becomes possible.

  Reference numeral 40 denotes a non-volatile memory (storage means) such as a CF memory card or an SD memory card, in which image data 22 subjected to image processing (JPEG conversion, etc.) by the image processing IC (20) is recorded.

  The multi-channel image receiving IC (10) and the image processing IC (20) constitute the image processing apparatus 1 described with reference to FIG. 1, and include camera modules 30-1 to 30-4, SDRAM, and external storage. By connecting a flash ROM storing firmware (CF memory card or SD memory card) and an image data recording system such as a surveillance camera.

  The multi-channel image receiving IC (10) has a built-in moving object detection function, and generates an interrupt signal 16 to the built-in CPU of the image processing IC (20) by moving object detection to start the image processing function. Can save power. In response to the interrupt signal 16, the built-in CPU of the image processing IC (20) supplies a clock (image output clock 24) for IP conversion processing and image data (14) output of the multi-channel image receiving IC (10). Can be controlled to start.

  When the data recording system is used as a surveillance camera, the output of the multi-channel image receiving IC (10) may be connected to the LCD controller, the bidet decoder 50 and the display 60 and displayed on the display 60. .

  According to the image data recording system of the present embodiment, the image processing apparatus 1 starts image processing and outputs image data 22 when moving objects are detected, and the image data 22 is recorded in the nonvolatile memory (storage means) 40. Is done. Therefore, it is possible to selectively save the image data after moving object detection. Therefore, it is possible to provide an image data recording system that greatly reduces the amount of data to be stored and the power consumption.

3. Integrated Circuit Device for Image Reception FIGS. 3A to 3D are diagrams for explaining the output mode of the integrated circuit device for image reception (multi-channel image reception IC) of this embodiment. is there.

  In this embodiment, multiple modes including the fixed mode, auto scan mode, reduction mode, and merge mode are prepared as output formats for images input from multiple input channels, and they correspond to the selected output mode. The output format image is output.

  In the case of the fixed mode, an image of one predetermined input channel is output as shown in FIG. In the auto scan mode, as shown in FIG. 3B, the input channels are sequentially switched and output. In the reduction mode, as shown in FIG. 3C, the image is reduced (eg, resized from VGA to QVGA) and output. For example, when the data size is 1/4, four images are output during a period in which one image is output in the fixed mode. In the merge mode, as shown in FIG. 3D, the image of each channel is resized to QVGA, and four screens are combined to be output as one image.

  FIG. 4 is a diagram showing an example of the configuration of the integrated circuit device for receiving images (multi-channel image receiving IC) of the present embodiment.

  The multi-channel image receiving IC (10) of the present embodiment has four video inputs, and converts the interlace signals output from the video decoders (digital cameras) 32-1 to 32-4 into progressive signals. IC. Since the multi-channel image receiving IC (10) of the present embodiment incorporates a sufficient SRAM 130 to convert an interlace signal into a progressive signal, the interlace signal is progressively transmitted without using an external RAM. Can be converted to a signal.

  The multi-channel image receiving IC (10) of the present embodiment includes input controllers 100-1 to 100-4 that control and receive input timings of image data 12-1 to 12-4 from four channels. The input controllers 100-1 to 100-4 function as the image data receiving unit 100 described with reference to FIG.

  The multi-channel image receiving IC (10) of the present embodiment is a scaler 112-1 to 112-4 that performs a resizing process on the image data 102-1 to 102-4 output from the input controllers 100-1 to 100-4. including. In the reduction mode or the merge mode, the scalers 112-1 to 112-4 perform processing to thin out the number of pixels of each line of the input image to ½ and resize the column length to ½.

  The multi-channel image receiving IC (10) of the present embodiment writes the outputs 114-1 to 114-4 of the scalers 112-1 to 112-4 to the SRAM 118 and reads the image data from the SRAM 118 at a predetermined timing. A memory controller 116 for outputting to one output line 122, a second output line 124, and a third output line 126.

  The multi-channel image receiving IC (10) according to the present embodiment receives the first output line 122, the second output line 124, and the third output line 126, and outputs progressive format image data. A conversion unit 128 is included.

  The multi-channel image receiving IC (10) of the present embodiment includes an area sensor 130 that performs moving object detection and an interrupt controller 140 that generates an interrupt signal 16 based on a detection result (image change detection signal) 132 of moving object detection. Including.

  The memory controller 116, the SRAM 118, and the I / P conversion unit 128 function as the I / P conversion processing unit 120 described with reference to FIG. The scalers 112-1 to 112-4, the memory controller 116, the SRAM 118, and the I / P converter 128 function as the image data generator 110 described with reference to FIG. The area sensor 130 and the interrupt controller 140 function as the moving object detection unit 130 and the interrupt signal generation unit 140 described with reference to FIG.

  The scalers 112-1 to 112-4, the memory controller 116, the SRAM 118, and the I / P converter 128 operate with the image output clock 24 supplied from the image processing IC (20). The image processing IC (20) starts generating the image output clock 24 based on the interrupt signal 16. Therefore, in the multi-channel image receiving IC (10), the memory controller 116, the SRAM 118, and the I / P conversion unit 128 (the image data generation unit 110 described in FIG. 1), which are considered to have relatively high power consumption, are connected to the area sensor. The operation can be performed only when 130 detects a moving object. Therefore, the power consumption of the multi-channel image receiving IC (10) can be greatly reduced.

  FIG. 5 is a diagram illustrating an example of a block diagram of the area sensor according to the present embodiment.

  The area sensor 130 of this embodiment selects an image data from the image data 102-1 to 102-4 output from the input controllers 100-1 to 100-4 described in FIG. A circuit 300 is included. The area sensor 130 of this embodiment may include a selection mode setting register 380 for setting an image selection mode by the image selection circuit 300. Then, the image selection circuit 300 may select any one of the image data 102-1 to 102-4 based on the value of the selection mode setting register 380 and output the image data 302. For example, the image selection circuit 300 includes the image data 102-1 → the image data 102-2 → the image data 102-3 → the image data 102-4 → the image data 102 at a predetermined time interval (for example, every ¼ second). The selection may be switched in the order of −1... And the image data 302 may be output. In addition, the image selection circuit 300 performs image data 102-1 → image data 102-1 → image data 102-2 → image data 102-2 → image data 102 at predetermined time intervals (for example, every ¼ second). -3 → image data 102-3 → image data 102-4 → image data 102-4 → image data 102-1 →...

  The area sensor 130 according to the present embodiment includes an image change detection circuit 310 that receives the image data 302 selected by the image selection circuit 300 in time series, detects an image change, and generates an image change detection signal 132.

  The image change detection circuit 310 divides the image into one or more areas, and the pixel data (or luminance related pixels) belonging to each area in the area unit for the image data of the first image and the second image received in time series. An integration circuit 320 that integrates the values and stores them in the integration registers 340 and 350 is included.

  Further, the image change detection circuit 310 compares the integrated values of the corresponding areas of the first image and the second image held in the integration registers 340 and 350, detects the presence or absence of the change, and determines that there is a change. In such a case, a change detection signal generation circuit 330 that generates the image change detection signal 132 is included.

  In addition, the area sensor 130 of the present embodiment includes integration registers 340 and 350 that hold integration values in area units for the image data of the first image and the second image received in time series. For example, the integrated value of the pixel value in the area unit of the image data of the first image is held in the integrating register 340, and then the integrated value held in the integrating register 340 is moved to the second integrating register 350. Good. Then, the integration value for each area of the image data of the second image received after the first image is held in the integration register 340 again, and the first image and the second image held in the integration registers 340 and 350 are stored. The integrated values of the corresponding areas may be compared to detect the presence or absence of a change.

  In addition, for example, the image selection circuit 300 performs (first) image data 102-1 → (first) image data 102-2 → (first) image data 102-3 → (first) image data 102. -4 → (second) image data 102-1 → (second) image data 102-2 → (second) image data 102-3 → (second) image data 102-4. When the image data 302 is output by sequentially switching the selection, four sets of integration registers (340-1, 350-1) to (340-2, 350) corresponding to the image data 102-1 to 102-4 are used. -2) may be provided.

  In addition, for example, the image selection circuit 300 performs (first) image data 102-1 → (second) image data 102-1 → (first) image data 102-2 → (second) image data 102. -2 → (first) image data 102-3 → (second) image data 102-3 → (first) image data 102-4 → (second) image data 102-4 →. When the selection is switched in this order and the image data 302 is output, only one set of integration registers 340 and 350 may be provided.

Further, the area sensor 130 according to the present embodiment may be configured to include the change area specifying register 360. Then, the change detection signal generation circuit 330 compares the integrated values of the corresponding areas of the first image and the second image held in the integration registers 340 and 350 to detect whether there is a change, and for each area. Further, the change area specifying register 360 may hold the presence / absence of change in the area sensor 130 according to the present embodiment. The area sensor 130 according to the present embodiment is configured to set various integration condition setting registers 370 for setting the integration condition by the image change detection circuit 310. May be included. For example, the area sensor 130 of the present embodiment may include an integration period setting register 372 for setting the integration period. The integration circuit 320 includes an image selection unit 324 that specifies an integration cycle based on the value of the integration cycle setting register 372 and determines whether or not the received image data 302 matches the specified integration cycle. For the image data 302 that matches the above, pixel values of pixels belonging to each area (or luminance) may be integrated and held in the integration registers 340 and 350 in area units.

  In addition, the area sensor 130 of the present embodiment may include a reference change rate setting register 374 for setting a reference change rate that is a reference for detecting a change. Then, the change detection signal generation circuit 330 specifies the reference change rate based on the value of the reference change rate setting register 374, and the corresponding areas of the first image and the second image held in the integration registers 340 and 350 are identified. You may make it detect the presence or absence of a change based on the said reference | standard change rate by comparing an integrated value.

  In addition, the area sensor 130 of the present embodiment may include an area specifying information setting register 376 for setting area specifying information for specifying an area to be subjected to change detection. Then, the change detection signal generation circuit 330 determines whether or not the area is a detection target area based on the value of the area identification information setting register 376. If the area is not the detection target area, the change detection signal generation circuit 330 generates the image change detection signal 132. An omitted change mask processing unit 332 may be included.

  Further, the area sensor 130 of the present embodiment may include an integrated component specifying information setting register 378 for specifying a component to be integrated among pixel values. Then, the integration circuit 320 may select a pixel component based on the value of the integration component specifying information setting register 378 and integrate the selected pixel component in the image data.

  The integration circuit 320 receives the horizontal synchronization signal 390 and the vertical synchronization signal 392, determines the area to which each pixel belongs based on the received horizontal synchronization signal 390 and vertical synchronization signal 392, and the number of horizontal divisions and the number of vertical divisions. The area detecting unit 322 may be included.

  The image may be divided into N parts in the horizontal direction and M parts in the vertical direction to provide M × N divided areas. The image change detection circuit 310 includes a current integration register 340 for holding M × N integration values and a previous integration register 350 for holding M × N integration values. After storing the integrated value of the image data of the second image in the current register 340, the change detection signal generation circuit 330 holds the integrated value of the current integrated register 340 and the integrated value of the image data of the first image. The previous integrated register 350 may be compared with the corresponding integrated value to detect the presence or absence of the change, and the integrated value of the current integrated register 340 may be transferred to the previous integrated register 350 after the comparison.

  The image may be divided into N parts in the horizontal direction and M parts in the vertical direction to provide M × N divided areas. The image change detection circuit 310 includes a current integration register 340 for holding N integration values and a previous integration register 350 for holding M × N integration values. After storing the integrated values of N areas in the horizontal direction of the current image in the current integration register 340, the change detection signal generation circuit 330 integrates the integrated value of the current integration register 340 and the image data of the first image. It is also possible to detect the presence or absence of a change by comparing with the corresponding integrated value of the previous integration register 350 that holds the value, and to move the integrated value of the current integration register 340 to the previous integration register 350 after the comparison.

  FIG. 6 is a diagram for explaining integration of pixel values in area units by the area sensor according to the present embodiment.

  Reference numerals 400 and 402 denote a first image and a second image input in time series. In the present embodiment, the first image 400 and the second image 402 are divided into a plurality of areas with the same division pattern. For example, in the figure, each image is divided into N × M areas by dividing the image into N equal parts in the horizontal direction and M equal parts in the vertical direction.

A given area 410 (for example, area A ₁₁ ) of the first image is composed of, for example, m × n pixels P ₁₁ , P ₁₂ ,..., P _mn , and each pixel P ₁₁ , P _{12 ,. Suppose that} the pixel values of P _mn are a ₁₁ , a ₁₂ ,..., A _mn . Here, a ₁₁ , a ₁₂ ,..., A _mn may be, for example, values of any of YUV components and RGB components.

In this case, if the integrated value of the pixel values in the area A ₁₁ of the first image is sum (A ₁₁ ), sum (A ₁₁ ) can be expressed by the following equation, for example.

sum (A ₁₁ ) = a ₁₁ + a ₁₂ +... + a _mn
Note _{a 11, a 12, ···,} a 11 is the value of the upper bits of _{a mn ', a 12',} seek _{···, a mn} 'the integration to the integrated value sum _{(A 11)'} You may do it.

Similarly, a given area 412 (for example, area B ₁₁ ) of the second image is composed of, for example, m × n pixels P ₁₁ , P ₁₂ ,..., P _mn , and each pixel P ₁₁ , P It is assumed that the pixel values of ₁₂ ,..., P _mn are b ₁₁ , b _{12 ,.} Here, b ₁₁ , b ₁₂ ,..., B _mn may be, for example, values of any of YUV components and RGB components (however, they are the same component values as a ₁₁ , a ₁₂ ,..., A _mn ). is there).

In this case, if the integrated value of the pixel values of the area B ₁₁ of the second image is sum (B ₁₁ ), sum (B ₁₁ ) can be expressed by the following equation, for example.

sum (B ₁₁ ) = b ₁₁ + b ₁₂ +... + b _mn
Note _{b 11, b 12, ···,} b 11 is the upper bits of the values of _{b mn ', b 12',} seek _{···, b mn} 'the integration to the integrated value sum _{(B 11)'} You may do it.

In this embodiment, an integrated value (for example, sum (A ₁₁ ) and sum (B ₁₁ )) is compared for each area to detect the presence or absence of a change. Here, a condition relating to a reference change rate that is a reference for detecting a change is set in the reference change rate setting register, and the first image and the second image held in the integration register correspond to the reference change rate. The integrated values of the areas may be compared to detect the presence or absence of a change. The reference change rate can be set by the rate of change relative to the whole. For example, when the reference change rate is set to h%, (sum (B ₁₁ ) −sum (A ₁₁ )) / sum (A ₁₁ ) When the value (change rate) is equal to or higher than h%, it is determined that there is a change (a change is detected). Here, when a reference change rate of h1 <h2 is given, the sensitivity of change detection is higher when h1 is used than when h2 is used. Therefore, it is preferable to set the reference change rate according to the usage of the surveillance camera or the like, the situation of the shooting location, and the like.

  For example, a plurality of reference change rates are prepared (the first reference change rate is 3% to 6%, the second change rate is 3%, and the third change rate is 25%). May be.

The integrated value of _{A MN} from the area _{A 11} of the first image sum _(A 11) ~sum the integration register for holding _{(A MN)} M × N number provided, each area _{B 11} in the second image the integration registers for holding the integrated value of _{B MN sum (B 11) ~sum} (B MN) from may be the M × N provided.

  Note that the value to be integrated may be, for example, the upper few bits of each pixel value. For example, the upper 5 bits of the pixel value may be integrated, and the integration register may have a 24-bit configuration. The hardware scale can be reduced by setting the value to be integrated to the upper few bits of each pixel value.

  FIG. 7 is a diagram illustrating an example of the configuration of the memory controller 116 according to the present embodiment.

  The memory controller 116 performs write control on the SRAM 118 described with reference to FIG. 4. The first write control unit 500-0 to the fifth write control unit 500-4 and the first write control unit 500-0 to 500th. In response to the write control of the write control unit 500-4 and the read control of the read control unit 520, the first address management control units 510-0 to 510-0 to perform address management control of reading and writing of image data with respect to the SRAM 118. 5 address management control unit 510-4, read control unit 520 that performs read control on the SRAM 118, and at least one line of the display image provided before the first output line 122 to which the read image data is output. A line buffer 522 capable of holding a plurality of image data, a buffer 524 on the second output line 124, and a second Buffer 526 on the output line 126 of an output timing controller 530 for controlling the output timing of each output line.

  The memory controller 116 receives the image data 114-1 to 114-4 output from the scalers 112-1 to 112-4 corresponding to the input channels 1 to 4. Here, 114-1 to 114-4 are non-reduced image data in the case of the fixed mode or the auto scan mode, and are reduced image data in the case of the reduction mode or the merge mode.

  Image data 114-1 to 114-4 from four input channels are input to the first write control unit 500-0, and image data of the first input channel is input to the second write control unit 500-1. 114-1 is input, the image data 114-2 of the second input channel is input to the third writing control unit 500-2, and the third input channel 500-3 is input to the fourth writing control unit 500-3. The image data 114-3 is input, and the image data 114-4 of the fourth input channel is input to the fifth writing control unit 500-4.

  In the fixed mode or the auto scan mode, the first write control unit 500-0 operates. In the fixed mode, image data of a predetermined input channel is held in the SRAM 118, and in the auto scan mode. The image data selected as the output target from the image data of each input channel is held in the SRAM 118. The configuration of the first write control unit 500-0 will be described with reference to FIG.

  In the reduction mode or the merge mode, the second write control unit 500-1 to the fifth write control unit 500-4 operate. In the reduction mode or the merge mode, the second writing control unit 500-1 performs control to write the reduced image data of the first input channel into the SRAM 118, and the third writing control unit 500-2 performs the second writing control unit 500-2. The fourth write control unit 500-3 performs control to write the reduced image data of the input channel to the SRAM 118, and performs control to write the reduced image data of the third input channel to the SRAM 118, and the fifth write control unit 500-4. Controls to write the reduced image data of the fourth input channel into the SRAM 118.

  The read control unit 520 reads the image data held in the SRAM 118, sets the previous line output to the first output line, the odd line output to the second output line, and the even line output to the third output line. Control to output.

  FIG. 8 is a flowchart showing the flow of processing of the read control unit 520.

  First, it is determined whether the output target line is an odd line or an even line (step S10). If the output target line is an odd line, the odd line data corresponding to the output target line is read from the SRAM 118; The read data for one line is output to the second output line 124 and written to the line buffer 522 at the preceding stage of the first output line 122 (step S20).

  When the output target line is an even line, the even line data corresponding to the output target line is read from the SRAM 118, and the read data for one line is output to the third output line 126 and the next odd line. Is read out and output to the second output line 124, and at the same time, the image data for one line stored in the line buffer 522 is output to the first output line 122 (step S30).

  FIG. 9 is a diagram illustrating an example of the configuration of the first write control unit 500-0.

  The first write control unit 500-0 includes a selection unit 502, a selection condition setting register 509, an input switching control unit 504, and a write control unit 508. The selection unit 502 receives the image data 114-1 to 114-4 corresponding to the first to fourth input channels, selects any input data based on the selection control signal 505, and outputs the selected image data 503. . In the selection condition setting register 509, a value indicating a condition regarding the selection ratio of each input channel is set. The value of the selection condition setting register 509 may be set and changed based on an external input. The input switching control unit 504 includes a counter 506, determines the number of times of selecting images of each input channel continuously based on the value of the selection condition setting register, and a selection control signal 505 for switching the input channel according to the number of times. Is generated. The write control unit 508 performs control to write the selected image data 503 selected by the selection unit into the SRAM 118.

  In this way, in the auto scan mode, input image data can be selected and stored in the SRAM 118 in accordance with the selection ratio set in the selection condition setting register. In the case of the fixed mode, the selection ratio of the channel that is fixedly selected may be set to 1 and the selection ratio of the other channels may be set to 0 in the selection condition setting register.

  FIG. 10 is a diagram illustrating an example of the configuration of the I / P conversion unit 128.

  In this embodiment, when interlace format image data is converted to progressive format image data, the normal mode for synthesizing the preceding and succeeding fields to form one frame, only one field is used and each line is doubled to 1 It is configured to be selectable from three types of modes: a one-side field mode for creating a frame, and a complementary mode that uses only one field and linearly interpolates from the upper and lower lines to create one frame.

  The I / P conversion unit 128 includes a progressive image generation unit 540 and an edge detection unit 550.

  The progressive image generation unit 540 receives the image data 122 of the first output line, the image data 124 of the second output line, and the image data 126 of the third output line, and in a format corresponding to the interlace / progressive conversion mode. Generate and output progressive images.

  In the complement mode, the edge detection unit 550 outputs the image data of the odd-numbered line (n-th line) immediately before the even-numbered line corresponding to the output target line, and the even-numbered line (n + 1-th line) corresponding to the output target line. Based on the image data, the image data of the odd line (n + 2 line) immediately after the even line corresponding to the output target line, each pixel value of the image data of the even line (n + 1 line) corresponding to the output target line, The pixel value of the image data of the odd-numbered line (n-th line) immediately before the even-numbered line corresponding to the output target line having a predetermined positional relationship with the pixel value and the next of the even-numbered line corresponding to the output target line Based on the pixel value of the image data of the odd line (n + 2 line), the complementary value of each pixel of the image data of the even line (n + 1 line) corresponding to the output target line is displayed. It acts as a complementary state determining section for determining whether to output a complementary presence control signal 552.

  In the complement mode, the progressive image generation unit 540 generates the even line (n + 1th line) corresponding to the output target line based on the complement presence / absence control signal 552 for each pixel. Is used as it is, or whether complementary values calculated based on pixel values having a predetermined relationship between the preceding and following odd lines (for example, the pixel values in the corresponding column) are used, and even line image data is Generate.

  FIG. 11 is an example of the configuration of the progressive image generation unit 540.

  The progressive image generation unit 540 includes a complementary value calculation unit 544, an output selection unit 542, a selection signal generation unit 546, and a conversion mode setting register 548. The progressive image generation unit 540 receives image data of DIN2 (previous odd line), DIN1 (even line), and DIN0 (odd line). The complementary value calculation unit 544 generates a complementary value 545 by performing a complementary calculation based on corresponding pixel values (pixel values in the same column) of DIN2 (previous odd line) and DIN0 (odd line).

  In the conversion mode setting register 548, a value indicating whether the conversion mode is the normal mode, the one-side field mode, or the complement mode is set.

  The output selection unit 542 inputs DIN2 (previous odd line) image data at input 1, complementary image data 505 at input 2, DIN0 (odd line) image data at input 3, and DIN1 (even line) at input 4. Are selected based on the selection control signal 547 and output.

  The selection signal generation unit 546 generates a selection control signal 547 for controlling the input value selected by the output selection unit 542 based on the value of the conversion mode setting register 548 and the complementation presence / absence control signal 552 output by the edge detection unit 550. To do.

  In the normal mode, DIN0 (odd line) and DIN1 (even line) are alternately selected and output. That is, a selection control signal (3-4-3-4,...) For alternately selecting the input 3 and the input 4 is generated for each line.

  In the one-side field mode, DIN2 (previous odd line) and DIN0 (odd line) are alternately selected and output. That is, a selection control signal (3-1-1-3-1,...) For alternately selecting the input 3 and the input 1 is generated for each line.

  In the complement mode, when the output target is an odd line, DIN0 (odd line) is selected, and when the output target is an even number, depending on the value of the complement control signal 552 for each pixel. Either DIN1 (even number line) or complementary value 545 is selected and output. That is, a selection control signal (3-4 or 2-3-4 or 2,...) For alternately selecting the input 3 and the input 4 or 2 is generated for each line.

4). Image Processing Integrated Circuit Device FIG. 12 is a diagram showing an example of the configuration of an image processing integrated circuit device (image processing IC) according to this embodiment.

  The image processing IC (20) includes an image processing unit 200-1 that processes the first image data 14-1. The image processing unit 200-1 includes a camera interface 204-1, a resizing processing unit 206-1, a compression processing unit 208-1, and the like. The image processing IC (20) may include an image processing unit 200-2 that processes the second image data 14-2. The image processing unit 200-2 includes a camera interface 204-2, a resizing processing unit 206-2, a compression processing unit 208-2, and the like. The compression processing unit 208-1 and the compression processing unit 208-2 realize JPEG encoding by hardware. The image data 14 output from the multi-channel image receiving IC (10) may be supplied to the image processing unit 200-1 as the first image data 14-1, or the second image data 14- 2 may be supplied to the image processing unit 200-1.

  The image processing IC (20) has two hardware JPEG encoders (compression processors 208-1 and 208-2) for each camera interface.

The image processing IC (20) may include an I ² S interface 260 that supports audio data.

  Further, the image processing IC (20) may include a CF card interface 266 for supporting a CF memory card connection.

  The image processing IC (20) may be configured to be compatible with a wireless LAN interface (802.11b / g).

  Further, the image processing IC (20) may include an SD card interface 264 for supporting the SD memory card connection.

  The image processing IC (20) may include a USB interface 252 for enabling connection with a PC.

  The image processing IC (20) may include an ADC (254) that can be connected to various analog sensors such as a gyro sensor.

  The image processing IC (20) may include an event counter timer 248 for measuring vehicle speed pulses, for example.

  The image processing IC (20) may include a 2-port memory bus (for example, a flash ROM, a 16-bit bus for SRAN connection, and a 32-bit bus for SDRAM connection).

  The image processing IC (20) includes an interrupt controller 250. The interrupt controller 250 receives, for example, the interrupt signal 16 generated by the multi-channel image receiving IC (10) by moving object detection from the GPIO (262) via the internal bus and generates an interrupt signal to the CPU (240). Let

  The CPU (240) operates at a low speed (for example, operates with a 32 kHz clock) in the sleep mode until an interrupt signal is supplied. When the CPU (240) receives the interrupt signal, the CPU (240) shifts to the normal operation mode based on the system clock. Then, the CPU (240), for example, sends clocks to these blocks so that blocks necessary for image processing and data transmission (image processing units 200-1, 200-2, USB interface 252 and the like) start processing. Start supplying. Further, when the CPU (240) receives the interrupt signal, for example, the clock is supplied to these blocks so that the SD card interface 264, the CF card interface 266, the SPI interface 268, the memory control unit 272, and the like start processing. May be started. By doing this, the image data processed by the image processing unit 200-1 or 200-2 is converted into an external SD card, CF card, EEPROM (274), flash ROM (276), SRAM (278), SDRAM (280), etc. Can be recorded.

  Further, the image processing IC (20) may start supplying the image output clock 24 to the multi-channel image receiving IC (10) via the GPIO (262) when an interrupt signal is generated. .

  The image processing unit 200-1 or 200-2 functions as the image processing unit 200 described with reference to FIG. Further, the USB interface 252 and the UART (256) function as the image data transmission unit 210 described with reference to FIG. The interrupt controller 250 and the CPU 240 function as the interrupt processing unit 220 described with reference to FIG. The CPU (240) and the setting register (not shown) that control the GPIO (262) and the GPIO (262) function as the image output clock generation unit 230 described in FIG.

  According to the image processing IC (20) of the present embodiment, the image processing that is considered to have the largest power consumption is performed only when the multi-channel image reception IC (10) detects a moving object. Therefore, power consumption can be greatly reduced. In addition, when image-processed data is transmitted or stored, the amount of data to be transmitted or stored can be greatly reduced. In this case, the image until the moving object is detected is not transmitted or stored, but the image processing apparatus of the present invention can be applied to a monitoring camera apparatus or the like that only needs to transmit or store the image after the moving object is detected. .

5). Surveillance Camera System FIG. 13 is a diagram for explaining an example of the surveillance camera system according to the present embodiment.

  A monitoring camera system 600 according to the present embodiment includes a monitoring camera device 610 and a plurality of terminals to which image data is distributed from the monitoring camera device 610 (monitoring monitor 620, storage device 1 (630), storage device 2 (640)), and the like. These are connected via a network such as a LAN 650 or 660.

  The monitoring camera device 610 includes the image processing device (for example, the image processing device shown in FIG. 1) 1 of the present embodiment and four monitoring cameras 1 to 4 (30-1 to 30-4) that capture different images. Including.

  Reference numeral 670 schematically represents a range of images acquired by the monitoring camera 1 (30-1). The monitoring camera 1 (30-1) continuously captures images in a range including, for example, two ATMs 676 and 678 and two doorways 672 and 674. For example, it may be taken as a moving image, or still images may be taken continuously at a predetermined interval.

  The image processing apparatus 1 receives image data in units of pixels captured by the monitoring cameras 1 to 4 (30-1 to 30-4) in time series, and detects the presence or absence of image changes in area units in real time.

  Here, the IP addresses of the monitor monitor (IP address is IP-1) 620, the storage device 1 (IP address is IP-2) 630, and the storage device 2 (IP address is IP-3) 640 are set as image destinations. ing.

  The monitor monitor 620 displays an image received via a network (for example, LAN 650) on the monitor. In the storage device 1 (630) and the storage device 2 (640), the image received via the network (for example, the LAN 650) is stored in the storage unit.

  In the present embodiment, image data continuously acquired by the monitoring camera device 610 may be transmitted to all of the monitoring monitor 620, the storage device 1 (630), and the storage device 2 (640). You may make it transmit to either of them. For example, the destinations may be circulated and distributed according to a given rule (for example, the monitor monitor 620, the storage device 1 (630), and the storage device 2 (640) are alternately assigned in units of a predetermined number of images). It may be)

  Here, when the area sensor included in the image processing apparatus 1 detects a change in the image, the image is transmitted to a destination (here, the storage apparatus 1 (630) or the storage apparatus 2 (640)) assigned to a predetermined rule. If no change is detected, it may be transmitted to a default transmission destination (here, the monitor 620).

  Then, the entire image 670 may be transmitted to the monitoring monitor 620, and the image of the area where the change is detected may be transmitted to the storage device 1 (630) and the storage device 2 (640). For example, when a change is detected in areas A and C, it may be transmitted to the storage apparatus 1 (630), and when a change is detected in areas B and D, it may be transmitted to the storage apparatus 2 (640).

  When a change is detected in area A, the entire area image may be cut out and the area A portion image may be transmitted instead of transmitting the entire image. When a change is detected in a plurality of areas, any one area may be cut out and transmitted in order, or the entire image may be transmitted. When one of the areas is cut out and transmitted, the image to be transmitted is ¼, so that the image data can be reduced accordingly.

  When transmitting the entire image, the image size may be compressed and transmitted, or may be transmitted after being resized (reduced) to 1/4 size, for example. In the latter case, since the image to be transmitted becomes ¼, the image data can be reduced accordingly.

  For example, if no change in the image is detected, resize information for instructing to reduce the original image is generated, and the image is reduced with respect to the image data in pixel units received in time series based on the resize information. You may make it transmit. In this way, it is possible to reduce the amount of data to be transmitted. If there is no change, it is only output to the monitor, so there is no problem even if the resolution of the image is somewhat reduced due to the reduction.

  Also, for example, when a change in the image is detected, resize information that instructs to cut out the area in which the change is detected from the original image is generated, and image data in units of pixels received in time series based on the resize information Alternatively, the area where the change is detected may be cut out from the original image. When there is a change, it is preferable that there is a detailed image of the changed portion. Therefore, the amount of data to be transmitted can be reduced by cutting and sending the area.

  In addition, a compressed image can be generated by changing the image capture position in accordance with the area in which a change in the image is detected, and transmitted to the terminal. It is also possible to change the transmission destination terminal address according to the area where the change of the image is detected. It is also possible to switch between the whole image and the area image for transmission.

  Further, the entire image may be transmitted normally, and the area image that has changed may be mixed and transmitted only when the image has changed. Also, only when there is a change in the image, the entire image and the area image that has changed may be mixed and transmitted.

  According to the surveillance camera system of the present embodiment, the image processing apparatus 1 starts image processing when a moving object is detected, and transmits the image data 22 to the terminal via the network. Therefore, it is possible to selectively transmit the image data after moving object detection. Therefore, it is possible to provide a surveillance camera system that greatly reduces the amount of transmission data and power consumption.

  In addition, this invention is not limited to this embodiment, A various deformation | transformation implementation is possible within the range of the summary of this invention.

  For example, the integrated circuit device for image reception according to the present embodiment described with reference to FIG. 4 has a configuration having only one area sensor, but is not limited thereto. For example, as shown in FIG. 14, four area sensors 130-1 to 130-4 may be provided, and the moving object detection may be performed individually for each input channel. In this case, the interrupt controller 140 may generate the interrupt signal 16 based on the image change detection signals 132-1 to 132-4 generated by the area sensors 130-1 to 130-4, respectively. Further, the configuration of the four area sensors 130-1 to 130-4 may be basically the same as the configuration described in FIG. However, the image selection circuit 300 and the selection mode setting register 380 are not necessary.

  Further, for example, in the monitoring camera system according to the present embodiment described with reference to FIG. 13, the monitoring monitor (IP address is IP-1) 620, the storage device 1 (IP address is IP-2) 630 as the image distribution destination, storage The case where three terminals of the apparatus 2 (IP address is IP-3) 640 is set as an example, but is not limited thereto. For example, two terminals may be set as image distribution destinations, or four or more terminals may be set. Further, only a plurality of monitor devices may be set as image distribution destinations, or only a plurality of storage devices may be set.

1 is a functional block diagram of an image processing apparatus according to an embodiment. 1 is a configuration diagram of an image data recording system of an embodiment. FIG. 3A to FIG. 3D are diagrams for describing an output mode of the integrated circuit device for image reception according to the present embodiment. 1 is a diagram illustrating an example of a configuration of an integrated circuit device for image reception according to an embodiment; The figure which shows an example of the block diagram of the area sensor of this Embodiment. The figure for demonstrating integration | accumulation of the pixel value of the area unit by the area sensor of this Embodiment. FIG. 3 illustrates an example of a configuration of a memory controller according to an embodiment. The flowchart which shows the flow of a process of a read-out control part. The figure which shows an example of a structure of a 1st write-control part. The figure which shows an example of a structure of an I / P conversion part. An example of a structure of a progressive image generation part. 1 is a diagram illustrating an example of a configuration of an integrated circuit device for image processing according to an embodiment; The figure for demonstrating an example of the surveillance camera system of this Embodiment. 1 is a diagram illustrating an example of a configuration of an integrated circuit device for image reception according to an embodiment; The figure for demonstrating the structure which increases an input channel.

Explanation of symbols

1 image processing apparatus, 10 multi-channel image receiving IC, 12-1 to 12-N image data, 14 image data, 16 interrupt signal, 18 selection signal, 20 image processing IC, 22 image data, 24 image output clock , 30-1 to 30-4 camera module (imaging means), 32-1 to 32-4 decoder, 40 nonvolatile memory (storage means), 50 LCD controller (video decoder), 60 display, 100 image data receiving unit, 100-1 to 100-4 input controller, 102-1 to 102-N image data, 110 image data generation unit, 112-1 to 112-4 scaler, 114-1 to 114-4 image data, 116 memory controller, 118 SRAM, 120 I / P conversion processing unit, 122 first output line, 12 Second output line, 126 Third output line, 128 I / P conversion unit, 130 Moving object detection unit (area sensor), 132 Image change detection signal, 140 Interrupt signal generation unit (interrupt controller), 200 Image processing unit, 202 image data, 210 image data transmission unit, 220 interrupt processing unit, 222 clock enable signal, 230 image output clock generation unit, 300 image selection circuit, 302 image data, 320 integration circuit, 332 area detection unit, 334 image selection unit, 336 Pixel component selection unit, 330 Change detection signal generation circuit, 332 Change mask processing unit, 340 Current integration register, 350 Previous integration register, 360 Change area specification register, 370 Integration condition setting register, 372 Integration cycle setting register, 374 Reference change Establishment Register, 376 Area specific information setting register, 378 Integrated component specific information setting register, 380 Selection mode setting register, 390 Horizontal synchronization signal, 392 Vertical synchronization signal, 400 First image, 402 Second image, 410 First image Area, 412 second image area, 500-0 to 500-4 write control unit, 502 selection unit, 503 selection image data, 504 input switching control unit, 505 selection control signal, 506 counter, 508 write control unit, 509 Selection condition setting register, 510-0 to 510-4 Address management control unit, 520 read control unit, 522 line buffer, 524 buffer on second output line, 526 buffer on third output line, 530 output timing Control unit, 540 progressive picture Generation unit, 542 Output selection unit, 544 Complement value calculation unit, 545 Complement value, 546 Selection signal generation unit, 547 Selection control signal, 548 Conversion mode setting register, 550 Edge detection unit, 552 Complement presence / absence control signal, 600 Surveillance camera system 610 Monitoring camera device 620 Monitoring monitor 630 Storage device 1 640 Storage device 2 650 LAN 660 LAN

Claims (11)

An image processing apparatus that generates predetermined image data based on a plurality of image data input to a plurality of input channels, performs image processing, and outputs the image data.
An image data receiving unit for receiving each of the plurality of image data in time series;
An image data generating unit that selects at least one image data from a plurality of image data received by the image data receiving unit and generates predetermined image data;
An image processing unit that performs predetermined image processing on the image data generated by the image data generation unit;
For each predetermined input channel, each image constituted by each image data input to the input channel and received in time series by the image data receiving unit is divided into one or more areas, and image changes in the predetermined area are performed. A moving object detection unit to detect;
An interrupt signal generator for generating a predetermined interrupt signal based on the detection result of the image change by the moving object detector;
An image processing apparatus comprising: an interrupt processing unit that controls the image processing unit to start image processing based on the interrupt signal. In claim 1,
The moving object detection unit includes:
The image processing apparatus, wherein the image change is detected based on a clock supplied accompanying the image data input to the predetermined input channel. In claim 1 or 2,
The image data generation unit
An I / P conversion processor that converts the interlaced image data into progressive image data (I / P conversion);
The I / P conversion processing unit
An image processing apparatus, wherein an I / P conversion process is started when the moving object detection unit detects the image change. In any one of Claims 1 thru | or 3,
The moving object detection unit includes:
An image processing apparatus, wherein the image change is detected for each input channel. In any one of Claims 1 thru | or 3,
The moving object detection unit includes:
An image processing apparatus that detects an image change by switching an input channel to be detected based on a predetermined control signal. In any one of Claims 1 thru | or 5,
An image data transmission unit that transmits image data image-processed by the image processing unit to an external device;
The interrupt processing unit
An image processing apparatus that controls the image data transmitting unit to start transmitting image data based on the interrupt signal. In claim 6,
An integrated circuit device for image reception including a plurality of input channels, including the image data receiving unit, the image data generating unit, the moving object detecting unit, and the interrupt signal generating unit;
An image processing device comprising: an image processing integrated circuit device including the image processing unit, the image data transmission unit, and the interrupt processing unit. In claim 7,
The image processing integrated circuit device comprises:
An image output clock generation unit that starts generating an image output clock based on the interrupt signal and outputs the image output clock to the integrated circuit device for image reception;
The image receiving integrated circuit device comprises:
An image processing apparatus, wherein the image data generation unit generates the predetermined image data based on the image output clock, and outputs the image data to the integrated circuit device for image processing. An image processing apparatus according to any one of claims 1 to 8,
A plurality of imaging means for supplying a plurality of image data to the image processing apparatus;
An image data recording system comprising: storage means for recording image data output by the image processing apparatus. A surveillance camera system in which the image processing device according to any one of claims 6 to 8, a surveillance camera device including a plurality of imaging means, and at least one terminal are connected via a network,
The image processing apparatus includes:
When the image change is detected based on the plurality of images captured by the plurality of imaging units, predetermined image data is sequentially generated based on the plurality of image data, and the terminal is connected via the network. The surveillance camera system characterized by transmitting to. An image data receiving unit that receives a plurality of image data input to a plurality of input channels in time series, and at least one image data selected from the plurality of image data received by the image data receiving unit, and predetermined image data An image data generation unit that generates image data and an image processing unit that performs predetermined image processing on the image data generated by the image data generation unit, and generates predetermined image data based on the plurality of image data And an image processing apparatus control method for image processing and outputting,
For each predetermined input channel, each image constituted by each image data input to the input channel and received in time series by the image data receiving unit is divided into one or more areas, and image changes in the predetermined area are performed. Detecting step;
Generating a predetermined interrupt signal when the image change is detected;
And a step of controlling the image processing unit to start image processing based on the interrupt signal.

Images