JP2015168378A - monitoring system and monitoring method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a monitoring system capable of improving monitoring accuracy without increasing a camera installation cost, and a monitoring method.SOLUTION: A monitoring system 1 according to the present invention includes an imaging part 71, an abnormality detection part 72, and an imaging control part 73. The imaging part 71 takes an image of a monitoring target. The abnormality detection part 72 detects an abnormality in the monitoring target on the basis of information different from data on the image taken by the imaging part 71. The imaging control part 73 controls an imaging direction of the imaging part 71 on the basis of the result of detection performed by the abnormality detection part 72.

Description

  The present invention relates to a monitoring system and a monitoring method.

  In recent years, home security systems using a 3G communication system capable of stable high-quality and long-distance communication have been known. Patent Document 1 discloses a home security system that performs communication using a specific low-power radio instead of a 3G line.

  Patent Document 2 discloses a car security device that takes a preset countermeasure when an abnormality occurs in a vehicle to be monitored. Countermeasures include, for example, mail transmission to a user or a security company, output of an alarm sound, and recording of a captured image using an in-vehicle camera.

JP2013-78030A JP 2008-155862 A

  At this time, the above-described home security system performs monitoring by a security camera capturing an image of a specific place such as a house garden or a front door. Considering application of such home security to vehicle monitoring, for example, a method of monitoring the approach of a suspicious person to a vehicle parked at home by imaging a parking lot of the house can be considered.

  However, the vehicle cannot be monitored while the vehicle is not at home. At this time, a method of monitoring the vehicle using an in-vehicle camera is conceivable. In this case, the in-vehicle camera cannot pick up an image of the vehicle as in the above home security system. That is, in the case where there is one on-vehicle camera, only one direction in which the on-vehicle camera is facing can be imaged. Therefore, it is difficult to image a suspicious person approaching from the blind spot of the in-vehicle camera, and there is a problem that the monitoring accuracy cannot be improved.

  Although it is conceivable to mount a plurality of cameras so that all directions of the vehicle can be imaged, there is a problem that the equipment cost of the cameras increases.

  The present invention has been made to solve such problems, and an object of the present invention is to provide a monitoring system and a monitoring method capable of improving the monitoring accuracy without increasing the installation cost of the camera.

  The monitoring system according to the present invention includes an imaging unit that images a monitoring target, an abnormality detection unit that detects an abnormality of the monitoring target based on information different from image data captured by the imaging unit, and the abnormality detection Imaging control means for controlling the imaging direction of the imaging means based on the detection result of the means.

  The monitoring method according to the present invention is a monitoring method using an imaging unit for imaging a monitoring target, and detecting an abnormality of the monitoring target based on information different from image data captured by the imaging unit. And a step of controlling an imaging direction of the imaging means based on an abnormality detection result.

  According to the present invention, it is possible to provide a monitoring system and a monitoring method capable of improving the monitoring accuracy without increasing the installation cost of the camera.

1 is a diagram illustrating a configuration of a monitoring system according to a first embodiment. 1 is a block diagram of a monitoring apparatus according to a first embodiment. FIG. 3 is a diagram for explaining a placement position of the microphone according to the first embodiment; It is a block diagram of the user terminal concerning Embodiment 1. FIG. FIG. 3 is a state transition diagram illustrating an operation of the monitoring system according to the first exemplary embodiment. It is a figure which shows an example of the display screen of the user terminal concerning Embodiment 1. FIG. 3 is a table for determining an urgency level according to the first embodiment; 3 is a table for determining a threatening method according to the first exemplary embodiment; 3 is a table for determining an imaging direction according to the first embodiment; FIG. 3 is a block diagram of a communication system according to a second exemplary embodiment. It is for demonstrating the arrangement position of the various sensors concerning Embodiment 2. FIG. It is a block diagram of the monitoring system concerning the present invention.

<Embodiment 1>
Embodiment 1 of the present invention will be described below with reference to the drawings. FIG. 1 is a diagram showing a configuration of a monitoring system 1 according to the present embodiment. As shown in FIG. 1, the monitoring system 1 includes a monitoring device 10 and a user terminal 20. Each unit of the monitoring device 10 is mounted on a monitoring target. In the present embodiment, the monitoring target is described as an automobile. The user terminal 20 is a terminal having a wireless function, such as a mobile phone, a smartphone, a PC (Personal Computer), a tablet terminal, and a portable music player. The monitoring apparatus 10 and the user terminal 20 communicate using specific low power radio.

<Configuration of monitoring device 10>
As shown in FIG. 1, the monitoring device 10 includes a vehicle monitoring notification device 11, various sensors 12, a camera 13, a speaker 14, an LED (Light Emitting Diode) 15, and a wireless antenna 16. The vehicle monitoring and reporting device 11 is connected to a vehicle battery 17.

  The vehicle monitoring notification device 11 is a control unit that commands each block of the monitoring device 10 and controls the entire monitoring device 10. A detailed block diagram of the vehicle monitoring and reporting device 11 is shown in FIG. The vehicle monitoring and reporting device 11 includes a CPU (Central Processing Unit) 111, a sensor monitoring microcomputer 112, a battery detection unit 113, a built-in rechargeable battery 114, a recording medium 115, a radio unit 116, and an amplifier (AMP) 117. And a driver 118.

  The CPU 111 (level determination unit, level notification unit) is connected to each block of the vehicle monitoring notification device 111. The CPU 111 controls each block of the vehicle monitoring notification device 11 based on a program stored in advance.

  The sensor monitoring microcomputer 112 is connected to various sensors 12. The sensor monitoring microcomputer 112 acquires the detection results of the various sensors 12 and notifies the CPU 111 of them.

  The battery detection unit 113 is connected to the battery 17 of the automobile. The battery detection unit 113 detects that the connection (wiring) to the battery 17 has been disconnected (the battery 17 has been removed), and notifies the sensor monitoring microcomputer 112 of the detection result. Note that the monitoring target is not limited to an automobile, as long as it is a mobile body equipped with a battery.

  The built-in rechargeable battery 114 supplies power to each block in order to operate the vehicle monitoring and reporting device 11 when the battery 17 has an abnormality (voltage drop or battery disconnection).

  The recording medium 115 is a memory device such as a RAM (Random Access Memory), a ROM (Read Only Memory), and an HDD (Hard Disk Drive). The recording medium 115 stores the detection results of the various sensors 12, the captured image of the camera 13, the notification sound from the speaker 14, the display pattern of the LED 15, and the like.

  The wireless unit 116 is connected to the wireless antenna 16. The radio unit 116 controls transmission / reception of data via the specific low power radio.

  The amplifier 117 is connected to the speaker 14. The amplifier 117 amplifies the audio signal output to the speaker 14 in response to an instruction from the CPU 111.

  The driver 118 is connected to the LED 15. The driver 118 performs LED drive control (control of lighting, extinguishing, coloring, blinking cycle, etc.) in accordance with instructions from the CPU 111.

  The various sensors 12 (abnormality detection means) include a microphone 121, an impact sensor 122, an acceleration sensor 123, a pyroelectric sensor 124, a door lock sensor 125, and a temperature sensor 126.

  The microphone 121 detects sound inside or outside the vehicle. The microphone 121 outputs the detected audio data to the sensor monitoring microcomputer 112. In order to specify the position of the abnormal sound generated in the vehicle, it is preferable that a plurality of microphones 121 are provided in the vehicle. By providing the microphone 121, it is possible to detect abnormal sounds generated inside or outside the vehicle.

  Here, an example of the arrangement position of the microphone 121 is shown in FIG. FIG. 3 is a view of the vehicle 900 as viewed from above. As shown in FIG. 3, the microphones 121a to 121d are located at the four corners in the vehicle. Specifically, two microphones 121 a and 121 b are located in front of the camera 13 provided in the center of the vehicle 900, and two microphones 121 c and 121 d are located behind the camera 13. Two microphones 121 a and 121 c are located on the right side of the camera 13, and microphones 121 b and 121 d are located on the left side of the camera 13. In other words, the camera 13 is located at the center of a quadrangle whose vertices are the microphones 121a to 121d. Thus, by arranging the microphones 121a to 121d at the vertices of a quadrangle including the center of the vehicle 900, the position where the sound is generated can be easily specified.

  The impact sensor 122 detects an impact applied to the vehicle. The impact sensor 122 is provided, for example, on a vehicle door, window glass, windshield, rear glass, or the like. The impact sensor 122 outputs a detection result such as the strength of impact to the sensor monitoring microcomputer 112. By providing the impact sensor 122, it is possible to detect an impact such as breaking the glass.

  The acceleration sensor 123 detects a change in posture (tilt) or posture of the vehicle. The posture of the vehicle can be expressed using, for example, an inclination with respect to a three-dimensional (xyz) axis with the vertical direction as the z axis. The acceleration sensor 123 outputs data indicating the detected vehicle inclination and vehicle vibration to the sensor monitoring microcomputer 112. By providing the acceleration sensor 123, it is possible to detect that the vehicle has been lifted using a jack or the like.

  The pyroelectric sensor (infrared sensor) 124 is a so-called human sensor and detects the approach of a person. The pyroelectric sensor 124 is provided, for example, on a handle or seat in the vehicle. The pyroelectric sensor 124 outputs data indicating the presence or absence of the detected person to the sensor monitoring microcomputer 112. By providing the pyroelectric sensor 124, it is possible to detect that a person has entered the vehicle.

  The door lock sensor 125 detects opening / closing of the door of the vehicle. As the door lock sensor 125, a door lock sensor 125 mounted on a general vehicle can be used. The door lock sensor 125 outputs data indicating opening / closing of the door to the sensor monitoring microcomputer 112. By providing the door lock sensor 125, it can be detected that a suspicious person opened the door.

  The temperature sensor 126 detects the temperature inside the vehicle. As the temperature sensor 126, a temperature sensor mounted on a general vehicle can be used. The temperature sensor 126 outputs the detected temperature to the sensor monitoring microcomputer 112. By providing the temperature sensor 126, it is possible to detect a temperature change in the vehicle due to the intrusion of a suspicious person, ignition in the vehicle, or the like.

  The camera 13 (imaging means) images a vehicle to be monitored. Specifically, as shown in FIG. 3, the camera 13 is provided in the center of the ceiling inside the vehicle. The camera 13 is installed in the vehicle via a rotation unit 131 (imaging control means). The rotation unit 131 controls the imaging direction of the camera 13 in accordance with an instruction from the CPU 111. Specifically, the rotation unit 131 changes the imaging direction of the camera 13 by rotating the camera 13 about the height direction of the vehicle 900 (direction perpendicular to the paper surface of FIG. 3). Note that the optical axis (imaging direction) of the camera 13 is orthogonal to the rotation axis or inclined at a predetermined angle. The camera 13 can take images of the front and rear, left and right of the vehicle 900 inside and outside the vehicle by rotating.

  The speaker 14 outputs the sound output from the amplifier 117. As the speaker 14, a speaker mounted on a general vehicle can be used.

  The LED 15 is provided in the vehicle and emits light based on the control of the driver 118. The LED 15 is a light different from a front light, a brake lamp, and a blinker lamp mounted on a general vehicle, and lights up with, for example, three colors of RGB.

  The wireless antenna 16 communicates with the user terminal 20. In the present embodiment, the monitoring device 10 performs communication using the specific low power radio with the user terminal 20 via the radio antenna 16. The radio band of the specific low power radio is, for example, 920 MHz.

<Configuration of user terminal 20>
Next, the configuration of the user terminal 20 will be described. A detailed block diagram of the user terminal 20 is shown in FIG. As illustrated in FIG. 4, the user terminal 20 includes an LCD (Liquid Crystal Display) display unit 21, an operation switch 22, a microphone 23, a speaker 24, a CPU 25, a wireless antenna 26, a wireless unit 27, and a built-in device. A rechargeable battery 28 and an amplifier (AMP) 29 are provided.

  The LCD display unit 21 displays an image transmitted from the monitoring device 10 using the specific low power radio. That is, the LCD display unit 21 displays an image captured by the camera 13.

  The operation switch 22 is a switch or button for operating the user terminal 20. Instead of a physical switch, a touch panel formed integrally with the LCD display unit 21 may be used as the operation switch 22.

  The microphone 23 is a microphone that collects a user's voice. When the user terminal 20 has a call function, a microphone used for a call can be used.

  The speaker 24 outputs the sound collected by the microphone 121 of the monitoring device 10. When the user terminal 20 has a call function, a receiver used for a call can be used.

  The CPU 25 is a control unit that instructs each block of the user terminal 20 and controls the entire user terminal 20.

  The radio antenna 26 performs communication using the specific low power radio with the monitoring device 10.

  The radio unit 27 is connected to the radio antenna 26. The radio unit 27 controls transmission / reception of data via the specific low power radio. For example, the wireless unit 27 transmits a command to the monitoring device 10 according to the operation of the operation switch 22. The wireless unit 27 receives image data, audio data, and the like from the monitoring device 10.

  The built-in rechargeable battery 28 supplies power to each block in order to operate the user terminal 20.

  The amplifier 29 is connected to the speaker 24. The amplifier 29 amplifies the audio signal output to the speaker 24 in response to an instruction from the CPU 25.

<Operation of monitoring system>
Next, the operation of the monitoring system 1 according to the present embodiment will be described using the transition diagram shown in FIG. FIG. 5 shows a mode in which the monitoring system 1 can transition. There are four modes in which the monitoring system 1 can transition: a monitoring mode, a normal mode, a wireless communication mode A, and a wireless communication mode B.

  First, the monitoring mode will be described. In the monitoring mode, the sensor monitoring microcomputer 112 performs an intermittent operation. For example, the sensor monitoring microcomputer 112 operates once per second and checks the detection results of the various sensors 12. Further, the sensor monitoring microcomputer 112 instructs the driver 118 to blink the LED 15 once. Thereby, the user can confirm that the monitoring device 10 is in the monitoring mode. The various sensors 12 are always operating even in the monitoring mode, and detect an abnormality.

  In the monitoring mode, the CPU 111 performs only the memory backup operation and pauses other operations.

  Next, the wireless communication mode A will be described. When there is a wireless communication request from the user terminal 20 in the monitoring mode or when periodic communication with the user terminal 20 is performed, the monitoring device 10 transitions from the monitoring mode to the wireless communication mode A.

  In the wireless communication mode A, the wireless unit 116 performs wireless communication with the wireless unit 27 of the user terminal 20 at a low speed. For example, when there is a request for operation confirmation from the user terminal 20, the monitoring device 10 replies to the request that the monitoring device 10 is operating. The wireless communication at this time is performed using a specific low power radio. Thereby, power consumption can be reduced as compared with wireless communication using a 3G line. Note that when the wireless communication between the monitoring device 10 and the user terminal 20 ends, the monitoring device 10 transitions to the monitoring mode again.

  Next, the normal mode will be described. When the various sensors 12 detect an abnormality in the monitoring mode, or when the connection with the battery 17 is disconnected, the monitoring device 10 transitions to the normal mode.

  In the normal mode, the sensor monitoring microcomputer 112 operates constantly, not intermittently, and always obtains detection results from the various sensors 12. Further, the sensor monitoring microcomputer 112 outputs the acquired detection result to the CPU 111.

  The CPU 111 instructs the camera 13 to perform an imaging process in the normal mode. As a result, the camera 13 is activated and starts imaging processing. The camera 13 is in a dormant state until receiving an instruction from the CPU 111. That is, in the monitoring mode, the camera 13 is not activated and is not performing an imaging process (rest state).

  Further, the CPU 111 determines the level of urgency based on the detection results of the various sensors 12, and notifies the urgency level to a predetermined terminal (for example, the user terminal 20 or a security company terminal). The CPU 111 automatically threatens according to the level of urgency. In addition, the CPU 111 controls the imaging direction of the camera 13 based on the detection results of the various sensors 12. The details of the determination process of the level of urgency, the threatening method, and the imaging direction control method will be described later.

  In addition, the CPU 111 stores the sound collected by the microphone 121 in the recording medium 115. In addition, the CPU 111 causes the speaker 14 to output sound stored in the recording medium 115 in advance.

  When the abnormality is notified from the vehicle monitoring and reporting device 11 to the user terminal 20 via wireless communication, the CPU 25 of the user terminal is activated. Then, the CPU 25 decodes the compressed moving image and sound, displays these data on the LCD display unit 21, and causes the speaker 24 to reproduce them.

  Further, according to the operation of the operation switch 22 by the user, the user terminal 20 can instruct execution of the following operation. (1) The user terminal 20 can operate the position of the camera 13. (2) The user terminal 20 can display the state in the vehicle in real time (can receive image data captured in real time). (3) Since the moving image is also recorded on the recording medium 115 of the monitoring apparatus 10, the user terminal 20 can reproduce the past moving image. (4) The user terminal 20 can pause the moving image and display only the high-resolution still image on the screen. (5) The user terminal 20 can compress the user's voice input from the microphone 23 into a commonly used MP3 format or AAC format and transfer the compressed audio to the monitoring device 10. Thereby, a user's voice can be reproduced from the speaker 14 of the monitoring device 10. (6) In addition to the real-time voice, the user terminal 20 can sound a voice or a warning sound stored in advance in the recording medium 115 of the monitoring device 10. (7) The user terminal 20 can be turned on by designating the blinking period and color of the RGB three-color LED 15. In order to notify the monitoring state to the outside, the LED 15 can be turned on even in the monitoring mode.

  When these series of processes are completed, the monitoring device 10 transitions to the wireless communication mode B. In the wireless communication mode B, the monitoring device 10 performs wireless communication with the user terminal 20 at a higher communication speed than the wireless communication mode A. At this time, the monitoring apparatus 10 transmits to the user terminal 20 an image captured using the camera 13, a sound collected by the microphone 121, and the like. When the wireless communication between the monitoring device 10 and the user terminal 20 ends, the monitoring device 10 transitions again to the normal mode.

  Note that the monitoring device 10 can capture a captured image using a commonly used CIF size H.264. H.264 (MPEG4) format, transmission speed is 64 Kbps. In addition, when transferring the sound simultaneously with the moving image, the monitoring apparatus 10 transmits the sound after compressing the sound into a commonly used MP3 format or AAC format. At this time, the moving image from the camera 13 is not only transferred wirelessly, but also has a higher resolution than the wireless recording medium 115 (for example, H.264 format, transmission speed 1 Mbps, resolution VGA (Video Graphics Array) 640 × 480, 30 fps). (Frame per second)). For this reason, a suspicious person can be reconfirmed later. In addition, the user terminal 20 can play back a moving image recorded in the recording medium 115 in the past.

  Here, an example of an image transmitted from the monitoring apparatus 10 to the user terminal 20 is shown in FIG. That is, the LCD display unit 21 of the user terminal 20 displays the image shown in FIG. As shown in FIG. 6, the image displayed on the LCD display unit 21 includes a camera image area 31 and various data areas 32.

  In the camera image area 31, an image captured by the camera 13 is displayed. In the example illustrated in FIG. 6, an image in which the front of the vehicle is imaged through the vehicle dashboard or the windshield is illustrated.

  In the various data areas 32, the date, time, level of urgency, presence / absence of tilt / abnormal sound, tilt / abnormal sound direction, temperature, humidity, battery voltage, tilt angle, GPS position information when the image was captured, The intensity of impact and the sound pressure of abnormal sound are displayed. By displaying such data together with the camera image, the user can easily confirm what happened at the same time as viewing the camera image.

  When a normal mode end command is received from the user terminal 20 or when a response from the user terminal 20 has passed for a certain period of time, the monitoring apparatus 10 returns from the normal mode to the monitoring mode in order to prevent battery consumption.

<Urgent level determination processing>
Here, the urgency level determination process by the monitoring device 10 will be specifically described. The urgency level determination process is performed by the CPU 111 in the normal mode. The CPU 111 determines the degree of urgency based on the detection results of the various sensors 12 acquired by the sensor monitoring microcomputer 112. Specifically, the CPU 111 determines the urgency level with reference to the table shown in FIG. The urgency level (abnormal level) is a value indicating the degree of abnormality.

  The table shown in FIG. 7 is a table in which the detection results of the various sensors 12 and the level of urgency are associated in advance. When the microphone 121 detects abnormal sound outside the vehicle, the acceleration sensor 123 detects tilt or vibration, the impact sensor 122 detects a light impact, or the sensor monitoring microcomputer 112 detects the voltage of the battery 17. When the decrease is detected, it is determined that the urgency level is level 1.

  Further, when the microphone 121 detects an abnormal sound in the vehicle or when the impact sensor 122 detects a strong impact, the CPU 111 determines that the degree of urgency is level 2.

  The CPU 111 detects that the sensor monitoring microcomputer 112 has disconnected from the battery 17, the door lock sensor 125 detects the release of the door lock, or the pyroelectric sensor 124 detects a person. If it is, the urgency level is determined to be level 3.

  If any one condition is satisfied at each level, it is determined that the urgency level is the level. When a plurality of conditions are satisfied, a value obtained by adding the levels corresponding to the satisfied conditions is set as the level of urgency. For example, when the impact sensor 122 detects a light impact (level 1) and the microphone 121 detects an abnormal sound outside the vehicle (level 1), the CPU 111 determines that the urgency level is level 2. Further, when the acceleration sensor 123 detects the inclination of the vehicle (level 1) and the impact sensor 122 detects a light impact (level 1), the CPU 111 determines that the degree of urgency is level 2. Further, when the impact sensor 122 detects a strong impact (level 2) and the microphone 121 detects an abnormal sound outside the vehicle (level 1), the CPU 111 determines that the urgency level is level 3.

  Next, a threatening method according to the level of urgency will be described with reference to the table of FIG. The table shown in FIG. 8 is an example of a table in which an urgency level and a threatening method are associated in advance.

  When the urgency level determined using the table of FIG. 7 is level 1, the monitoring device 10 causes the LED 15 to blink. When the degree of urgency is level 2, the monitoring device 10 blinks various lights (front light, brake lamp, hazard lamp) of the vehicle. When the urgency level is level 3, the monitoring device 10 outputs a preset voice message from the speaker 14 in the vehicle. When the urgency level is 4 or higher, the monitoring device 10 sounds the vehicle horn intermittently. Thereby, even in a situation where the user cannot set a threatening method, the monitoring device 10 can automatically threaten according to the degree of urgency without receiving a user instruction. In the present embodiment, LED 15, various lights, speaker 14, and horn are used as threatening means, but the present invention is not limited to this.

  In addition to the level of urgency, the current time may be taken into account as a determination criterion for the threatening method. Specifically, the monitoring device 10 includes a clock (time acquisition means) that acquires the current time, and adjusts the threatening method according to time zones of early morning, daytime, nighttime, and midnight. For example, since the outside is bright in the early morning and the daytime, the monitoring device 10 may preferentially perform threats using voice or horn instead of threats using light (LED 15, headlight, etc.). In addition, since a loud sound disturbs the neighborhood at night, the monitoring device 10 may stop the threat using the horn.

<Imaging direction control processing>
Next, control of the imaging direction of the camera 13 will be described. Based on the detection results of the various sensors 12, the CPU 111 rotates the rotation unit 131 to which the camera 13 is fixed, and controls the imaging direction of the camera 13.

  Here, with reference to FIG. 9, the detection result of the various sensors 12 and the imaging direction according to the result are demonstrated. FIG. 9 is a table showing detection results of various sensors 12 and imaging directions corresponding to the results.

  First, a case where the microphone 121 detects an abnormal sound will be described. When the microphone 121 detects an abnormal sound, the CPU 111 calculates (estimates) an abnormal sound occurrence position (sound source position) based on the detection result of the microphone 121. As shown in FIG. 3, in the present embodiment, four microphones 121a to 121d are arranged at the four corners in the vehicle. The CPU 111 calculates the occurrence position of the abnormal sound by using the arrangement positions and the detection results (sound pressure, phase, etc.) of these four microphones 121a to 121d. Then, the CPU 111 directs the camera 13 to the abnormal sound generation position (direction). In addition, about the calculation method of the sound source position using a some microphone, since the existing technique can be used, detailed description is abbreviate | omitted.

  Next, a case where the impact sensor 122 detects an impact will be described. When the impact sensor 122 detects an impact, an abnormal sound (such as a sound that breaks the glass) is usually generated. For this reason, when the impact sensor 122 detects an impact, the CPU 111 identifies the position where the abnormality has occurred in accordance with the detection result of the microphone 121 and directs the camera 13 to the position (direction) where the abnormal sound is generated. In addition, you may provide the impact sensor 122 in each of each window glass, a windshield, and a rear glass. Thereby, when the glass is broken, it can be easily specified which glass is broken. In this case, the CPU 111 points the camera 13 in the direction of the impacted glass.

  Next, the case where the acceleration sensor 123 detects the inclination of the vehicle will be described. When the acceleration sensor 123 detects a change in the inclination of the vehicle, the vehicle may be jacked up by a suspicious person. Therefore, the CPU 111 points the camera 13 in the direction in which the vehicle is raised (the direction opposite to the direction in which the vehicle is tilted, the direction in which the vehicle is lifted).

  Next, a case where the pyroelectric sensor 124 detects the presence of a person will be described. As described above, the pyroelectric sensor 124 is disposed in the vehicle. For this reason, when the pyroelectric sensor 124 detects a person, there is a high possibility that a suspicious person has entered the vehicle. Therefore, the CPU 111 does not cause the camera 13 to image a specific direction, but causes the camera 13 to image while rotating the camera 13 so that the camera 13 images the entire interior of the vehicle. Thereby, the camera 13 can image the suspicious person wherever the suspicious person is in the vehicle. Note that the CPU 111 does not necessarily have to rotate the camera 13. For example, it is sufficient that at least a plurality of different positions in the vehicle such as the front and rear can be imaged.

  Next, the case where the door lock sensor 125 detects the release of the door lock will be described. When the door lock is released, there is a high possibility that a suspicious person has entered the vehicle. Therefore, the CPU 111 does not cause the camera 13 to image a specific direction, but causes the camera 13 to image while rotating the camera 13 so that the camera 13 images the entire interior of the vehicle. As described above, the camera 13 does not necessarily have to be rotated.

  Next, a case where the battery detection unit 113 detects disconnection with the battery 17 will be described. When the connection with the battery 17 is disconnected, there is a possibility that a suspicious person is in the vicinity of the battery 17. Therefore, the CPU 111 points the camera 13 toward the battery 17 mounting position. It is assumed that the CPU 111 recognizes the mounting position of the battery 17 in advance.

  As described above, according to the configuration of the monitoring system 1 according to the present embodiment, various sensors 12 such as the microphone 121 and the acceleration sensor 123 are monitored based on information different from the image data captured by the camera 13. An abnormality of the target vehicle is detected. Then, the CPU 111 controls the imaging direction of the camera 13 based on the detection results of the various sensors 12. For this reason, even if there is one camera mounted on the vehicle, the camera can be automatically directed in the direction in which the abnormality occurred. As a result, there is no need to mount a plurality of cameras, and the monitoring accuracy can be improved compared to a camera in which the imaging direction is fixed.

  Further, since the monitoring system 1 detects an abnormality based on data different from the image data of the camera 13, even if an abnormality occurs outside the angle of view of the camera 13 (the blind spot of the camera 13), the abnormality is detected. Can be detected.

  Furthermore, the various sensors 12 detect an abnormality of the vehicle without using the image data captured by the camera 13. Then, triggered by the detection of an abnormality, the camera 13 is activated and starts imaging. That is, it is not necessary for the camera 13 to be constantly activated in order to detect a vehicle abnormality. As a result, the power consumption can be reduced compared to a configuration in which the camera is always activated and an abnormality is detected using image processing or the like.

<Embodiment 2>
A second embodiment according to the present invention will be described. In the first embodiment described above, an automobile is used as a monitoring target. However, in this embodiment, a warehouse (hut) is set as a monitoring target.

  FIG. 10 shows a block diagram of the monitoring system 2 according to the present embodiment. The monitoring device 10 includes a solar cell 41 instead of the battery 17 of the monitoring system 1 shown in FIG. The monitoring apparatus 10 includes a plurality of impact sensors 122 and pyroelectric sensors 124, and does not include an acceleration sensor or a door lock sensor. Since other configurations are the same as those of the communication system 1, description thereof will be omitted as appropriate.

  An example of arrangement of various sensors in the warehouse 50 is shown in FIG. A microphone 121 and a pyroelectric sensor 124 are disposed on the upper part of each wall of the warehouse 50. Further, an impact sensor 122 is disposed in each window 51 of the warehouse 50. A camera 13 and a rotation unit 131 are arranged at the center of the ceiling (not shown) of the warehouse 50. That is, also in this embodiment, the camera 13 is located at the center of a quadrangle having the four microphones 121 as vertices. The vehicle monitoring and reporting device 11, the speaker 14, the LED 15, and the wireless antenna 16 are arranged at the corner of the warehouse 50.

  Solar cell 41 is arranged on the roof (rooftop) of warehouse 50. The electric power generated by the solar cell 41 is supplied to each block of the monitoring device 10.

  In addition, the user confirms whether there is an abnormality, confirms the state in the warehouse 50 at the home 60 away from the warehouse 50, using the user terminal 20, as in the first embodiment. It can be threatened against it. The operations of the camera 13, the determination of the degree of urgency, the automatic control of the imaging direction of the camera 13, and the like are the same as those in the first embodiment.

  As described above, the present invention is not limited to automobiles but can be applied to monitoring buildings such as warehouses. Further, even in an environment without a battery, power can be supplied by providing the solar cell 41.

  The present invention is not limited to the above-described embodiment, and can be appropriately changed and combined without departing from the spirit of the present invention. For example, the types of the various sensors 12 and the types of monitoring targets are not limited to the above-described embodiments.

  Further, as shown in FIG. 12, the monitoring system 70 according to the present invention includes an imaging unit 71 that images at least the monitoring target and an abnormality that detects an abnormality of the monitoring target based on information different from the image data captured by the imaging unit 71. It is only necessary to include the detection unit 72 and the imaging control unit 73 that controls the imaging direction of the imaging unit 71 based on the detection result of the abnormality detection unit 72. Thereby, even when the imaging unit 71 has an abnormality outside the imaging range, the imaging control unit 73 changes the imaging direction of the imaging unit 71 in a direction corresponding to the abnormality. Therefore, even if there is one imaging unit 71, the monitoring accuracy can be improved. In addition, since a plurality of imaging units 71 are not required, the camera cost can be reduced.

  Further, the arbitrary processing of the above-described monitoring system can be realized by causing a CPU (Central Processing Unit) to execute a computer program. In this case, the computer program can be stored using various types of non-transitory computer readable media and supplied to the computer. Non-transitory computer readable media include various types of tangible storage media. Examples of non-transitory computer-readable media include magnetic recording media (for example, flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (for example, magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / W and semiconductor memory (for example, mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (random access memory)) are included. The program may also be supplied to the computer by various types of transitory computer readable media. Examples of transitory computer readable media include electrical signals, optical signals, and electromagnetic waves. The temporary computer-readable medium can supply the program to the computer via a wired communication path such as an electric wire and an optical fiber, or a wireless communication path.

  In addition to the case where the function of the above-described embodiment is realized by the computer executing the program that realizes the function of the above-described embodiment, this program is not limited to the OS ( A case where the functions of the above-described embodiment are realized in cooperation with an operating system or application software is also included in the embodiment of the present invention. Furthermore, the present invention is also applicable to the case where the functions of the above-described embodiment are realized by performing all or part of the processing of the program by a function expansion board inserted into the computer or a function expansion unit connected to the computer. It is included in the embodiment.

1, 2 Monitoring system 10 Monitoring device 20 User terminal 11 Vehicle monitoring notification device 12 Various sensors 13 Camera 14 Speaker 15 LED
16 Wireless antenna 17 Battery 21 Display unit 22 Operation switch 23 Microphone 24 Speaker 25 CPU
26 Radio antenna 27 Radio unit 28 Built-in rechargeable battery 29 Amplifier 31 Camera image area 32 Various data areas 41 Solar cell 50 Warehouse 51 Window 60 Home 71 Imaging unit 72 Abnormality detection unit 73 Imaging control unit 111 CPU
112 sensor monitoring microcomputer 113 battery detection unit 114 built-in rechargeable battery 115 recording medium 116 wireless unit 117 amplifier 118 driver 121 microphone 122 impact sensor 123 acceleration sensor 124 pyroelectric sensor 125 door lock sensor 126 temperature sensor

Claims (10)

An imaging means for imaging a monitoring target;
An anomaly detection means for detecting an anomaly of the monitoring target based on information different from the image data imaged by the imaging means;
An imaging control unit that controls an imaging direction of the imaging unit based on a detection result of the abnormality detection unit;
A monitoring system comprising: The abnormality detection means includes a plurality of microphones,
When the plurality of microphones detect abnormal sounds, the imaging control means calculates the abnormal sound generation direction based on the detection results of the plurality of microphones, and according to the abnormal sound generation direction, The monitoring system according to claim 1 which controls an imaging direction. The abnormality detection means detects a change in the inclination of the monitoring target,
The monitoring system according to claim 1, wherein the imaging control unit controls the imaging direction according to a direction in which the monitoring target is tilted when the abnormality detection unit detects a change in the tilt of the monitoring target. . The monitoring target includes a moving body equipped with a battery,
The abnormality detecting means detects that the wiring of the battery is disconnected;
The said imaging control means controls the said imaging direction according to the mounting position of the said battery, when the said abnormality detection means detects the cutting | disconnection of the wiring of the said battery. Monitoring system. The monitoring object includes a car,
The abnormality detection means is provided in the automobile and includes a human sensor for detecting a person in the vehicle,
The said imaging control means controls the imaging direction of the said imaging means so that the said imaging means can image at least 2 different positions in the inside of the said vehicle, when the said abnormality detection means detects a person. 5. The monitoring system according to any one of 4. The monitoring object includes a car,
The abnormality detecting means detects release of the door lock of the automobile,
The imaging control means controls the imaging direction of the imaging means so that the imaging means can image at least two different positions in the vehicle of the automobile when the abnormality detection means detects the release of the door lock. The monitoring system according to any one of claims 1 to 5. Level determination means for determining an abnormality level indicating the degree of abnormality based on the detection result of the abnormality detection means;
Level notification means for notifying a predetermined terminal of the abnormal level determined by the level determination means;
The monitoring system according to any one of claims 1 to 6, further comprising:   The monitoring system according to claim 7, further comprising threatening means for performing threatening using a threatening method set in advance according to the abnormality level. It further comprises time acquisition means for acquiring the current time,
The monitoring system according to claim 8, wherein the threatening means threatens based on the abnormal level and the current time. A monitoring method using an imaging means for imaging a monitoring target,
Detecting an abnormality of the monitoring target based on information different from image data imaged by the imaging means;
Controlling the imaging direction of the imaging means based on an abnormality detection result;
A monitoring method comprising:

Images