JP2013041489A - On-vehicle camera control unit, on-vehicle camera control system and on-vehicle camera system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an in-vehicle camera control device, an in-vehicle camera control system, an in-vehicle camera system, and the like capable of performing different processes according to a traveling state of a vehicle.
An in-vehicle camera control device 100 performs communication processing between an image acquisition unit 110 that acquires infrared image data from an infrared image capturing unit 210, a processing unit 120 that performs processing based on infrared image data, and an external device 300. The communication part 140 to perform and the driving | running | working state determination part 130 which determines whether a vehicle is a driving | running | working state are included. Then, the processing unit 120 performs image processing based on the infrared image data when it is determined that the vehicle is in a traveling state. Further, the communication unit 140 transmits infrared image data or detection information based on the infrared image data to the external device 300 when it is determined that the vehicle is in a non-traveling state.
[Selection] Figure 1

Description

  The present invention relates to an in-vehicle camera control device, an in-vehicle camera control system, an in-vehicle camera system, and the like.

  In recent years, in order to cope with the worsening and more sophisticated crime, crime prevention measures have been strengthened and various crime prevention items have been desired.

  For example, with regard to crime prevention in residences, it is described in Patent Document 1 that, when unauthorized opening / closing by a suspicious person to a door or window of a residence is detected, an alarm such as an imaging by an infrared camera or a buzzer is given to notify the resident. There is such a conventional technology.

  However, simply increasing the number of crime prevention items increases the cost of the crime prevention system as the crime prevention system increases, resulting in an increase in the cost burden on the user.

  On the other hand, a vehicle-mounted night vision device that captures and displays a near-infrared image in front of the vehicle body with an in-vehicle infrared camera, detects a pedestrian from the captured image, and displays the detection result superimposed on the near-infrared image. Has been put to practical use. As a pedestrian detection technique used in such a night vision device, there is a conventional technique described in Patent Document 2.

  In the prior art of Patent Document 2, a search is made as to whether or not a part having the same shape as the shape of the predetermined part in the detection target is continuously present in the target, and the part having the same shape is continuously present. In this case, it is determined that the object is an artificial object, and a pedestrian is recognized from the remaining objects excluding the object.

  Under such circumstances, the present applicant is examining a method of using a vehicle-mounted camera for both intruder prevention use in a residence and pedestrian detection use on a road.

JP 2002-150438 A JP 2005-352974 A

  When using an in-vehicle camera for both pedestrian detection on the road and prevention of intruders in the house, image data processing appropriate for each application is different, and the vehicle is running Different processing needs to be performed when the vehicle is parked.

  According to some aspects of the present invention, it is possible to provide an in-vehicle camera control device, an in-vehicle camera control system, an in-vehicle camera system, and the like that perform different processes depending on the traveling state of the vehicle.

  In addition, according to some aspects of the present invention, an in-vehicle camera control device, an in-vehicle camera control system, and an in-vehicle camera system capable of monitoring an object according to the traveling state of the vehicle while suppressing power consumption. Etc. can be provided.

  One aspect of the present invention is an image acquisition unit that acquires infrared image data from an infrared image capturing unit, a processing unit that performs processing based on the infrared image data, a communication unit that performs communication processing with an external device, and a vehicle. A traveling state determination unit that determines whether the vehicle is in a traveling state or a non-driving state, and the processing unit performs image processing based on the infrared image data when the vehicle is determined to be in the traveling state, The communication unit relates to an in-vehicle camera control device that transmits the infrared image data or detection information based on the infrared image data to the external device when it is determined that the vehicle is in a non-running state.

  In one embodiment of the present invention, different processing can be performed when the vehicle is in a running state and when the vehicle is in a non-running state. Thereby, it becomes possible to monitor the object according to the situation of the vehicle and the surroundings of the vehicle while suppressing power consumption.

  In one aspect of the present invention, the processing unit generates display image data including detection information of an object based on the infrared image data when the vehicle is determined to be in the traveling state. Processing may be performed as the image processing.

  Thereby, when it is determined that the vehicle is in a running state, for example, it is possible to present a contour image or the like of a pedestrian or a preceding vehicle to the user to call attention to the object.

  In one aspect of the present invention, the image acquisition unit acquires visible image data from a visible image capturing unit, and the processing unit corresponds to the position where the object is present as the display image data. Processing for generating image data in which an alert image is superimposed at a position on a visible image may be performed as the image processing.

  Thereby, when the vehicle is in a running state, the alert image is superimposed on the visible image that matches the scenery that the user actually sees, and the display image is generated. It is possible to call attention to an object without making the user feel uncomfortable.

  Further, in one aspect of the present invention, the processing unit performs a residential crime prevention process when the vehicle is determined to be in the non-running state, and the running state when the residential crime prevention process is being performed. When the determination unit determines that the vehicle has changed from the non-traveling state to the traveling state, a vehicle crime prevention process may be performed.

  As a result, it is possible to perform vehicle crime prevention processing or the like when there is a possibility that the vehicle has been stolen while performing residential crime prevention processing.

  Moreover, in one aspect of the present invention, when the processing unit is determined that the vehicle is in the non-running state, the infrared image capturing unit is set to a position or direction for the residential crime prevention process. The communication unit performs the residential crime prevention process based on the infrared image data, and the communication unit detects the infrared image data or the detection information based on the infrared image data based on the result of the residential crime prevention process. May be sent to.

  As a result, it is possible to avoid unnecessary activation switching of the infrared image capturing unit 210 and the visible image capturing unit 220 by frequently switching the processing to be executed, and to avoid wasting unnecessary power.

  Moreover, in one aspect of the present invention, the storage unit stores the infrared image data, and the processing unit stores the infrared image data in the storage unit at given time intervals as the residential crime prevention process, Comparing the stored first infrared image data and the second infrared image data acquired at a timing different from the first infrared image data, the communication unit in the comparison process, When it is determined that there is a difference between the first infrared image data and the second infrared image data, the detection information based on the infrared image data or the infrared image data may be transmitted to the external device. Good.

  As a result, when the home crime prevention process is being executed, it is possible to detect the object using only the infrared image data, and to notify the user of the presence of the intruder when the object is detected. become.

  In one aspect of the present invention, the processing unit detects that the vehicle is in the traveling state when the infrared image capturing unit is set to a position or direction for the residential crime prevention process. In such a case, the vehicle crime prevention process may be performed.

  This makes it possible to notify the user that the vehicle has been stolen or that the user has forgotten that the user is performing the residential crime prevention process and has moved the vehicle.

  Moreover, in one aspect of the present invention, the processing unit sets the visible image capturing unit to an operation-off state when performing the residential security process, and the visible image capturing when performing the vehicle security process. The unit may be set to an operation on state.

  As a result, when the vehicle crime prevention process is being executed, the unnecessary infrared image capturing unit is set to the operation-off state to reduce power consumption, while the visible image capturing unit is set to the operation-on state to It is possible to take an image of the location where the vehicle is located.

  In the aspect of the invention, the image acquisition unit performs a process of acquiring visible image data from the visible image imaging unit as the vehicle crime prevention process, and the communication unit acquires the visible image data from the external device. May be sent to.

  Thereby, when the vehicle crime prevention process is being executed, it becomes possible to notify the user of a visible image obtained by imaging the location where the vehicle is currently located.

  In one aspect of the present invention, the image acquisition unit acquires visible image data from a visible image imaging unit, and the processing unit determines that the infrared ray is in the case where the vehicle is determined to be in the traveling state. Of the image capturing unit, the visible image capturing unit, and the communication unit, the infrared image capturing unit and the visible image capturing unit are set to the operation on state, and the vehicle is determined to be in the non-running state. In this case, among the infrared image capturing unit, the visible image capturing unit, and the communication unit, the infrared image capturing unit and the communication unit may be set in an operation on state.

  As a result, when it is determined that the vehicle is in the traveling state and when it is determined that the vehicle is in the non-traveling state, it is possible to drive only the necessary functional units to reduce power consumption.

  In the aspect of the invention, the processing unit may capture the infrared image when the vehicle is determined to be in the non-traveling state, compared to a frame rate when the vehicle is in the traveling state. The frame rate of the part may be set low.

  Accordingly, it is possible to suppress the consumption of power used for driving the infrared image capturing unit 210 and image processing of infrared image data.

  In another aspect of the present invention, an image acquisition unit that acquires infrared image data from an infrared image capturing unit, a processing unit that performs processing based on the infrared image data, and a communication unit that performs communication processing with an external device; A traveling state determination unit that determines whether the vehicle is in a traveling state or a non-driving state, and the processing unit performs image processing based on the infrared image data when it is determined that the vehicle is in the traveling state When the vehicle is determined to be in the non-running state, the communication unit transmits the detection information based on the infrared image data or the infrared image data to the in-vehicle camera control system. Involved.

  Moreover, the other aspect of this invention is related with the vehicle-mounted camera system containing the said vehicle-mounted camera control apparatus and the said infrared image imaging part.

The system block diagram of this embodiment. 2A is a plan view showing attachment positions of the infrared image capturing unit and the visible image capturing unit, FIG. 2B is a side view of FIG. 2A, and FIG. 2C is an external device. An example. The flowchart explaining the process of this embodiment. 4A to 4D are explanatory diagrams of processing when the vehicle is in a traveling state. FIG. 5A and FIG. 5B are explanatory diagrams of alert images. FIG. 6A to FIG. 6C are explanatory diagrams of residential crime prevention processing. FIG. 7A to FIG. 7C are explanatory diagrams of vehicle crime prevention processing. The flowchart explaining the process of this embodiment.

  Hereinafter, this embodiment will be described. First, a system configuration example of the present embodiment will be described, and then features of the present embodiment will be described. Finally, the flow of processing of this embodiment will be described using a flowchart. In addition, this embodiment demonstrated below does not unduly limit the content of this invention described in the claim. In addition, all the configurations described in the present embodiment are not necessarily essential configuration requirements of the present invention.

1. System Configuration Example First, FIG. 1 shows a configuration example of an in-vehicle camera control device of this embodiment and an in-vehicle camera system including the same.

  The in-vehicle camera control device 100 includes an image acquisition unit 110, a processing unit 120, a traveling state determination unit 130, a communication unit 140, and a storage unit 150. Examples of the in-vehicle camera system 200 including the in-vehicle camera control device 100 include an in-vehicle camera system including an infrared image capturing unit 210, a visible image capturing unit 220, a presentation unit 230, a sensor 240, and the like. The in-vehicle camera control device 100 and the in-vehicle camera system 200 including the same are not limited to the configuration in FIG. 1, and various modifications such as omitting some of these components or adding other components. Implementation is possible. For example, some or all of the functions of the in-vehicle camera control device 100 may be realized by the infrared image capturing unit 210 or the visible image capturing unit 220. Further, some or all of the functions of the in-vehicle camera control device 100 according to the present embodiment may be realized by a server connected by communication.

  Next, processing performed in each unit will be described.

  First, the image acquisition unit 110 acquires infrared image data representing an infrared image from the infrared image capturing unit 210 and acquires visible image data representing a visible image from the visible image capturing unit 220.

  Then, the processing unit 120 performs various processes using data obtained from the storage unit 150 in accordance with the traveling state determined by the traveling state determination unit 130.

  Furthermore, the traveling state determination unit 130 determines whether or not the vehicle is traveling.

  Note that the functions of the image acquisition unit 110, the processing unit 120, and the traveling state determination unit 130 can be realized by hardware such as various processors (CPU and the like), ASIC (gate array and the like), a program, and the like.

  The communication unit 140 transmits and receives information between the in-vehicle camera control device 100 and the external device 300. Note that the communication unit 140 may perform communication by wire or may perform communication by radio.

  The storage unit 150 stores a database and serves as a work area for the processing unit 120 and the like, and its function can be realized by a memory such as a RAM or an HDD (hard disk drive).

  The infrared image capturing unit 210 captures an infrared image. The infrared image includes a far-infrared image and a mid-infrared image. When the human body is included in the detection target, the infrared imaging unit 210 may be sensitive to a far infrared wavelength region of 8 to 12 μm, and it is necessary to obtain sensitivity at a longer distance (approximately 200 m away). If there is, it is desirable to use a pyroelectric infrared sensor camera as the infrared image capturing unit 210. Using a pyroelectric sensor camera, thermal images (infrared images) from a long distance to a short distance can be acquired with a single sensor film, and the body temperature of the human body and the boundary line of other stationary objects can be clearly displayed. Therefore, it is optimal for human body extraction, and costs are significantly lower than other infrared sensors.

  Further, in the present embodiment, the infrared image capturing unit 210 is used for crime prevention purposes such as prevention of intrusion of a house. In this case, the monitoring area is an area including a window and a door of the house. Therefore, in order to detect an intruder into the monitoring area, it is desirable that the infrared imaging unit 210 has sensitivity in the far infrared wavelength region of 8 to 12 μm as described above. Therefore, the same infrared image pick-up part can also be shared at the time of driving | running | working and a house crime prevention. Furthermore, compared to detecting pedestrians while the vehicle is running, when detecting an intruder during crime prevention in a residence, the background image does not change in time, and only the presence or absence of the intruder needs to be detected. Therefore, image processing is very simple as compared to when traveling. In addition, since the time for the intruder to pass through the imaging area is longer than that for the pedestrian, it is possible to detect the intruder while setting the frame rate low and performing thinning imaging. It is possible to reduce the amount.

  On the other hand, the visible image capturing unit 220 captures a visible image. The visible image capturing unit 220 may be a camera using a CCD or CMOS as an image sensor, and may be a monochrome camera or a color camera. When a monochrome camera is used, a grayscale image is captured as a visible image, and when a color camera is used, a color image is captured as a visible image.

  The infrared image capturing unit 210 and the visible image capturing unit 220 may include a device (processor) used for image processing or the like. In the present embodiment, infrared image data or visible image data is output as it is to the in-vehicle camera control device 100, but the present invention is not limited to this. For example, a part of the processing unit of the in-vehicle camera control device 100 may be provided in the infrared image capturing unit 210 or the visible image capturing unit 220. In this case, information after image processing is performed on the infrared image or the visible image is output to the in-vehicle camera control device 100.

  Next, FIG. 2A and FIG. 2B show examples of attachment positions of the infrared image capturing unit, the visible image capturing unit, and the like.

  As shown in FIGS. 2A and 2B, the infrared image capturing unit 210 has a pan angle formed by the horizontal component direction HLL1 of the optical axis of the lens and the vehicle body centerline CL1 as PA1, and the optical axis of the lens. It is mounted in the bumper or grill of the vehicle body so that the tilt angle formed by the horizontal line HL1 between the vertical component direction PLL1 and the ground is TA1. Here, the infrared image capturing unit 210 may include an electric motor that swings the infrared image capturing unit 210 vertically and horizontally. In this case, the rotation angle can be freely adjusted so that the road ahead or the side of the road can be imaged.

  As shown in FIGS. 2A and 2B, the visible image capturing unit 220 has PA2 as the pan angle formed by the horizontal component direction HLL2 of the optical axis of the lens and the vehicle body centerline CL2, and the optical axis of the lens. It is attached to the upper part of the front window so that the tilt angle formed by the horizontal line HL2 between the vertical component direction PLL2 and the ground is TA2. Here, similarly to the infrared image capturing unit 210, the visible image capturing unit 220 may include an electric motor that swings the visible image capturing unit 220 up and down and left and right. In this case, the rotation angle can be freely adjusted so that the road ahead or the side of the road can be imaged.

  In FIG. 2A, PA1 and PA2 are 0 ° or more for easy understanding. However, when imaging the front in the vehicle body traveling direction, PA1 = PA2 = 0 ° and TA1 = TA2. Is desirable. Further, the infrared image capturing unit 210 and the visible image capturing unit 220 may be installed on the side surface of the vehicle body, or a plurality of each of the image capturing units may be installed.

  Further, the infrared image capturing unit 210 and the visible image capturing unit 220 are provided with a selector switch in the vehicle so that the driver can arbitrarily determine the shooting direction and the shooting position. 210 or the driving of the visible image capturing unit 220 can be turned ON / OFF, and the positions and directions of the infrared image capturing unit 210 and the visible image capturing unit 220 can be changed. Note that the selector switch is omitted in FIGS. 1, 2A, and 2B.

  Next, the presentation unit 230 shows the processing result of the in-vehicle camera control device 100 to the user. The presentation unit 230 may be an alarm device or a display.

  When the presenting unit 230 is an alarm device, the alarm device issues an alarm (voice) based on the output signal obtained from the processing unit 120 when the presence of a pedestrian or an intruder in a residence is detected. If the horn and front light of the vehicle body are used as an alarm device, the horn can be sounded or the front light can be blinked when an intruder is detected in the residence, and there is no need to install new equipment. There is.

  Further, when the presentation unit 230 is a display, the display displays an image indicating these positions when the processing unit 120 detects a preceding vehicle, a pedestrian, or an intruder into the residence, or detects An image generated by superimposing a contour image of an object on a visible image may be acquired from the processing unit 120 and displayed.

  In the present embodiment, a gyro sensor is used as the sensor 240. The gyro sensor has low power consumption and can detect minute vibrations. In addition, the sensor 240 may be a vehicle speed sensor that obtains the vehicle speed from the rotational speed of the front wheels of the vehicle, or may be an acceleration sensor or a GPS sensor.

  Finally, the external device 300 is an information terminal such as a mobile phone, a PDA (Personal Digital Assistant), or a notebook PC as shown in FIG. 2C. For example, a processor (CPU), a memory, an operation panel, a communication device Or a display (sub-display). The external device 300 may be a device that is also used as a wristwatch or a portable audio device.

  FIG. 3 shows a hardware configuration diagram of this embodiment. First, the in-vehicle camera control device 100 of FIG. 1 can be realized by the CPU 450 and the memory 470 of FIG. Here, the image acquisition unit 110, the processing unit 120, the traveling state determination unit 130, and the communication unit 140 in FIG. 1 can be realized by the CPU 470 in FIG. 1, and the storage unit 150 in FIG. 1 can be realized by the memory 470 in FIG. .

  The in-vehicle camera system 200 in FIG. 1 includes the infrared camera 410, the CPU 450, and the memory 470 in FIG. Here, the infrared image capturing unit 210 in FIG. 1 is realized by the infrared camera 410 in FIG. 3 and includes an electric motor 420.

  Further, the visible image capturing unit 220 in FIG. 1 is realized by the visible camera 430 in FIG. 3 and includes an electric motor 440. Furthermore, the presentation unit 230 in FIG. 1 can be realized by the display 490 in FIG. 3. 1 can be realized by the gyro sensor 460, the GPS 480, or the like shown in FIG.

2. In the above embodiment, the image acquisition unit 110 that acquires infrared image data from the infrared image capturing unit 210, the processing unit 120 that performs processing based on the infrared image data, and the communication processing with the external device 300 are performed. The communication part 140 which performs and the driving | running | working state determination part 130 which determines whether a vehicle is a driving | running | working state are included. Then, the processing unit 120 performs image processing based on the infrared image data when it is determined that the vehicle is in a traveling state. Further, the communication unit 140 transmits infrared image data or detection information based on the infrared image data to the external device 300 when it is determined that the vehicle is in a non-traveling state.

  Thereby, different processes can be performed when the vehicle is in a traveling state and when the vehicle is in a non-traveling state.

  In the determination process of the running state of the vehicle, for example, when the sensor 240 provided on the vehicle body continuously detects a vibration having a frequency of 1 Hz to 20 Hz for a predetermined time, it is determined that the vehicle is in the traveling state. Good. In addition, the user operates the selector switch to change the position of the infrared image capturing unit 210 or the visible image capturing unit 220 to the position for traveling, etc. It may be determined by any method.

  When it is determined that the vehicle is in a running state, the target object is a pedestrian or a preceding vehicle, and optimal processing is performed for monitoring these objects. On the other hand, when it is determined that the vehicle is in a non-running state, the object becomes an intruder into a residence or the like, and optimal processing is performed for these monitoring. That is, it is possible to monitor an object according to the situation of the vehicle such as when the vehicle is traveling or parked.

  In addition, when it is determined that the vehicle is in a running state, infrared image data is acquired, so that monitoring of an object in accordance with the situation around the vehicle such as a large number of pedestrians or a large number of other vehicles is performed. It is possible to

  For example, FIG. 4A shows a state where the vehicle CA1 is traveling. At this time, the infrared image capturing unit 210 provided in the vehicle CA1 captures the front of the vehicle and captures the preceding vehicle CA2, the pedestrian WP1, the person WP2 riding the bicycle, and the like.

  Here, the infrared image data is information representing an infrared image (thermal image) captured by the infrared image capturing unit 210. The infrared image is as described above. For example, FIG. 4C illustrates an infrared image IIM captured by the infrared image capturing unit 210 provided in the vehicle CA1 illustrated in FIG. 4A as an example of the infrared image. In the infrared image IIM, a pedestrian WP1, a preceding vehicle CA2, a person WP2 riding a bicycle, and the like are projected darkly at portions where the temperature is high. An infrared image is not suitable for identifying a landscape or the like, but it is easy to identify a temperature distribution or the like, and is useful for distinguishing between a background and an object.

  When it is determined that the vehicle is in a running state, image processing based on infrared image data is performed. Details of the image processing will be described later.

  On the other hand, if it is determined that the vehicle is in a non-running state, the infrared image data of the infrared image captured by the infrared image capturing unit 210 or detection information based on the infrared image data is transmitted to the external device 300.

  Here, the detection information is information indicating that the object is reflected in the infrared image. For example, as an example of detection information, a flag indicating ON when an object is reflected in an infrared image, character information or image information that informs the user that there is an intruder into a residence, or the external device 300 There is a command to generate a warning sound.

  In this case, it is only necessary to communicate with the external device 300 only when there is an intruder or the like in the monitoring area. Therefore, in the non-running state, the power consumption of the in-vehicle camera control device 100 can be suppressed compared to the case where communication with the external device 300 is always required.

  Here, the monitoring area is an area that needs to be monitored in order to detect an object of the in-vehicle camera system 200. For example, the infrared image capturing unit 210 or the visible image capturing unit 220 The range to be imaged. In the example of FIG. 6A to be described later, this is a range including the door DR and the window WD of the house captured by the infrared image capturing unit 210.

  The detection information may be information indicating that the object is not shown. In this case, when the vehicle is in a non-running state, the in-vehicle camera control device 100 generally communicates with the external device 300 and does not communicate when an intruder or the like is detected. Then, when the external device 300 becomes unable to receive the detection information, the external device 300 may determine that an abnormality has occurred in the monitoring area and issue a warning sound to notify the user. Since this method always communicates, the power consumption is larger than the method of communicating with the external device 300 only when there is an intruder or the like in the monitoring area. Even if it is destroyed, it is useful in that it can notify the user of an abnormality.

  Furthermore, regardless of the running state of the vehicle, the visible image capturing unit 220 is not driven, and only the infrared image capturing unit 210 is driven to monitor pedestrians and intruders in the house in the traveling direction of the vehicle. Therefore, it is possible to suppress power used for driving the visible image capturing unit 220 and image processing of the visible image data obtained by the visible image capturing unit 220. That is, power consumption can be reduced as compared with the case where both the visible image capturing unit 220 and the infrared image capturing unit 210 are driven.

  As described above, when the vehicle is in a running state and when the vehicle is in a non-running state, different processing is performed to suppress power consumption and monitor the object according to the situation of the vehicle and the surroundings of the vehicle. It becomes possible to do.

  In addition, when it is determined that the vehicle is in a traveling state, the processing unit 120 may perform, as image processing, processing for generating display image data including detection information of an object based on infrared image data. .

  In the above-described example, when the vehicle is in a non-running state, information indicating that the object is reflected in the infrared image is called object detection information, but the vehicle is in the running state. In some cases, the same meaning is used. In this case, the detection information is, for example, character information or image information that informs the user that there is a pedestrian or a preceding vehicle ahead of the vehicle.

  Here, the display image data is data representing a display image.

  The display image is an image for informing the user of the presence of an object such as a pedestrian or a preceding vehicle when it is determined that the vehicle is in a running state, and the image itself displayed on the presentation unit 230. Say. For example, the display image is an image representing the outline of the object, an image representing a symbol for notifying that the object is nearby, or an outline image such as a pedestrian or a preceding vehicle superimposed on an infrared image. And the like. Further, a warning sound or the like may be emitted simultaneously with displaying the display image. The display image may be the detection information itself of the object. Further, the display image may be an image including a part of the detection information of the object. In this case, the position of the detection information of the object in the display image is not limited.

  Thereby, when it is determined that the vehicle is in a running state, for example, it is possible to present a contour image or the like of a pedestrian or a preceding vehicle to the user to call attention to the object.

  However, display images such as contour images and images with contour images superimposed on infrared images look very different from the scenery that the user actually sees while driving the vehicle, and were obtained from the display images. Information may not be immediately reflected in driving the vehicle by the user.

  Therefore, the image acquisition unit 110 may acquire visible image data from the visible image capturing unit 220. And the process part 120 may perform the process which produces | generates the image data which superimposed the alert image on the position on the visible image corresponding to the position where a target object exists as display image data as an image process.

  Here, the visible image data is information representing a visible image captured by the visible image capturing unit 220. The visible image is as described above. For example, as an example of the visible image, a visible image VIM captured by the visible image capturing unit 220 provided in the vehicle CA1 illustrated in FIG. 4A is illustrated in FIG. The visible image VIM also shows a pedestrian WP1, a preceding vehicle CA2, a person WP2 riding a bicycle, and the like. Since the visible image VIM has almost no difference from the scenery seen by the user, it is easy to grasp the entire image including the scenery at a glance. Conversely, it is difficult to distinguish a landscape from an object using only a visible image. Therefore, in the present embodiment, the object is distinguished using the infrared image having the characteristics as described above.

  Further, a specific example of a display image generated using a visible image is shown in FIG. When generating the display image CIM, for example, based on the characteristics of the temperature distribution represented by the infrared image IIM shown in FIG. WP2) and other than people (background and preceding car CA2) are distinguished. Then, a display image CIM is generated by superimposing alert images (ALIM1 and ALIM2), which will be described later, so as to surround a portion where a person is located on the visible image. By presenting such an image, the user is warned to pay attention to the pedestrian.

  Here, the alert image is an image for notifying the user of the presence of the target object, and means an image that is a part of the display image displayed on the presentation unit 230. Examples of the alert image include an exclamation mark, a schematic diagram showing a pedestrian and a preceding vehicle, and an emphasis character indicating that a danger is imminent.

  Specifically, images ALIM1 and ALIM2 shown in FIG. 4D correspond to alert images. In addition, an exclamation mark such as ALIM3 displayed on the head of the pedestrian WP1 on the image CIM1 shown in FIG. 5A, or a walk on the image CIM2 shown in FIG. There are an image ALIM4 for emphasizing the outline of the person WP1, and a band image such as ALIM5 for emphasizing that the danger is imminent using characters and symbols.

  Thereby, when the vehicle is in a running state, the alert image is superimposed on the visible image that matches the scenery that the user actually sees, and the display image is generated. It is possible to call attention to an object without making the user feel uncomfortable. Furthermore, by using the alert image, the user can easily distinguish the background from the object.

  By the way, when monitoring a residence etc., the vehicle itself may be stolen. Specifically, when the house crime prevention process is being executed, if the vehicle is changed from the non-traveling state to the traveling state, there is a high possibility that the vehicle has been stolen.

  Therefore, the processing unit 120 performs the residential crime prevention process when it is determined that the vehicle is in the non-running state, and the running state determination unit 130 causes the vehicle to travel from the non-running state when the residential crime prevention process is being executed. When it is determined that the vehicle is in a state, vehicle security processing may be performed.

  Here, the residential crime prevention process is a process performed by the in-vehicle camera control device 100 when the vehicle is in a non-traveling state, as shown in FIG. 6 (A), and an intruder into a residence or facility. This is processing for the purpose of detecting such as. Details and specific examples of the residential crime prevention process will be described later.

  On the other hand, the vehicle crime prevention process is a process performed by the in-vehicle camera control device 100 when the vehicle is in a running state, as shown in FIG. 7A, and is a process intended to detect vehicle theft or the like. I mean. The details and specific examples of the vehicle crime prevention process will be described later.

  As a result, it is possible to perform vehicle crime prevention processing or the like when there is a possibility that the vehicle has been stolen while performing residential crime prevention processing.

  By the way, the residential crime prevention process is performed when the vehicle is in a non-running state, but it is assumed that the residential crime prevention process is executed when the vehicle is parked in a parking lot or the like. There is no need to execute when the vehicle stops at an intersection or the like. In addition, when performing residential crime prevention processing, the infrared image capturing unit 210 needs to be directed to a door or window of a residence.

  Therefore, when it is determined that the vehicle is in a non-running state, the processing unit 120 is configured to perform the home crime prevention based on the infrared image data when the infrared image capturing unit 210 is set to the position or direction for the home crime prevention processing. Processing may be performed. And the communication part 140 may transmit the detection information based on infrared image data or infrared image data to the external device 300 based on the result of a house crime prevention process.

  Here, the position or direction for residential crime prevention processing is, for example, the position or direction of the infrared image capturing unit 210 that can capture a location that the user wants to monitor, such as a door or window of a residence or facility. A plurality of combinations are stored in advance in the storage unit 150 or the like for the position or direction for the home crime prevention processing. The imaging unit 210 may be moved. In addition, the user may manually move and arrange the position or direction of the infrared image capturing unit 210 and input to the in-vehicle camera control device 100 that the arrangement has been completed.

  A specific example is shown in FIG. FIG. 6A shows a state in which the vehicle CA is parked on the parking in front of the residence, and shows a state in which the residential crime prevention process is performed. In FIG. 6A, the position and direction of the infrared image capturing unit 210 are adjusted so that the infrared image capturing unit 210 can capture the door DR and the window WD where an intruder is likely to enter a residence or the like. . In this example, when the infrared image capturing unit 210 is moved to such a position and direction, the process proceeds to the residential crime prevention process.

  Thereby, when the vehicle is in a non-traveling state and the infrared image capturing unit 210 is set to the position or direction for the residential crime prevention process, it is possible to limit the opportunity of executing the residential crime prevention process. Therefore, it is possible to avoid unnecessary activation switching of the infrared image capturing unit 210 and the visible image capturing unit 220 by frequently switching processing to be executed, and to avoid wasting unnecessary power.

  Moreover, in this embodiment, you may include the memory | storage part 150 which memorize | stores infrared image data. And the process part 120 preserve | saves infrared image data in the memory | storage part 150 at a predetermined time interval as a residential crime prevention process, and the timing from which the preserve | saved 1st infrared image data and 1st infrared image data differ A comparison process with the second infrared image data acquired in step (b) may be performed. Further, when it is determined that there is a difference between the first infrared image data and the second infrared image data in the comparison process, the communication unit 140 transmits the detection information based on the infrared image data or the infrared image data to the external You may transmit to the apparatus 300. FIG.

  Here, the first infrared image data and the second infrared image data refer to infrared image data representing infrared images captured at different timings. For example, infrared image data for a certain timing 1 is acquired, this is used as first infrared image data, and infrared image data acquired at every predetermined period thereafter is used as second infrared image data for comparison processing. Also good. In addition, the infrared image data acquired at the timing next to the first infrared image data is the second infrared image data, and the infrared image data acquired at the timing next to the second infrared image data is the first infrared image data. Comparison processing may be performed assuming that the image data is infrared image data.

  For example, in the example of FIG. 6A, the infrared image captured by the infrared image capturing unit 210 at a certain timing t is IIM1 illustrated in FIG. 6B, and the infrared image captured at timing (t + 1) is illustrated in FIG. It is referred to as IIM2 shown in (C). In this case, first, the infrared image data indicating the infrared image IIM1 is stored in the storage unit as the first infrared image data, and when the infrared image data indicating the infrared image IIM2 is acquired, the infrared image data of the IIM2 is acquired. Is compared with the first infrared image data as the second infrared image data. As a result, in this example, it is assumed that no object is shown in the infrared image IIM1, but a figure that appears to be an intruder IV is confirmed in the infrared image IIM2. In this case, in FIG. 6A, at timing t, it is assumed that the person IV who was at the position P1 outside the monitoring area moved to the position P2 and entered the monitoring area before the timing (t + 1). This person IV is recognized as an intruder. Then, it is determined that there is a difference between the first infrared image data and the second infrared image data, and an email notifying that there is an intruder is transmitted to the user's mobile phone or the like.

  As a result, when the home crime prevention process is being executed, it is possible to detect the object using only the infrared image data, and to notify the user of the presence of the intruder when the object is detected. become.

  In addition, when the owner of the vehicle tries to move the vehicle during the residential crime prevention process, usually the residential crime prevention process is stopped and the position of the infrared image capturing unit 210 is changed before the vehicle is moved. It is considered to run. Therefore, when the vehicle is in a running state without changing the position of the infrared imaging unit 210, the vehicle is stolen or the vehicle owner forgets that the house crime prevention process is being executed. Probability is high.

  Specifically, this is the case as shown in FIG. In FIG. 7A, the in-vehicle camera system originally mounted on the vehicle CA performed the home crime prevention process and monitored the neighborhood of the residence at the point P1, but the vehicle CA was stolen by the theft. , It shows a situation where he has run away without completing the home crime prevention process. In such a case, it is not necessary to continue the residential crime prevention process, and it is necessary to take measures against vehicle theft.

  Therefore, when the infrared image capturing unit 210 is set to the position or direction for residential security processing, the processing unit 120 performs the vehicle security processing when it is detected that the vehicle is in a running state. Also good.

  This makes it possible to notify the user that the vehicle has been stolen or that the user has forgotten that the user is performing the residential crime prevention process and has moved the vehicle.

  When the vehicle is stolen, it is necessary to notify the user or the like of the current position of the vehicle. For this purpose, a visible image that can be easily identified at first glance is more useful than an infrared image.

  Therefore, the processing unit 120 sets the visible image capturing unit 220 to the operation-off state when performing the residential crime prevention process, and sets the visible image capturing unit 220 to the operation-on state when performing the vehicle security process. May be.

  Thereby, when the vehicle crime prevention process is being executed, the unnecessary infrared image capturing unit is set to the operation-off state and the power consumption is reduced, while the visible image capturing unit 220 is set to the operation-on state to It is possible to take an image of the location where the vehicle is currently located.

  Moreover, the image acquisition part 110 may perform the process which acquires visible image data from the visible image imaging part 220 as a vehicle crime prevention process. Then, the communication unit 140 may transmit the visible image data to the external device 300.

  Specifically, in the example of FIG. 7A, first, the driving of the infrared image capturing unit 210 is stopped and the visible image capturing unit 220 is driven. Then, a visible image VIM as shown in FIG. When a signboard or the like as shown in FIG. 7B is reflected in the acquired visible image VIM, there is a possibility that the current position of the vehicle can be specified. Therefore, in this example, as shown in FIG. 7C, a message PVIF that informs that the vehicle has been stolen and the visible image VIM of FIG. 7B are transmitted to the user's mobile phone 300 or the like.

  Thereby, when the vehicle crime prevention process is being executed, it becomes possible to notify the user of a visible image obtained by imaging the location where the vehicle is currently located.

  In addition, since the processing to be executed is different between when it is in the running state and when it is in the non-running state, it is possible to further reduce the power consumption if only the necessary functional units are driven in each state. Become.

  Therefore, the image acquisition unit 110 may acquire visible image data from the visible image capturing unit 220. When the processing unit 120 determines that the vehicle is in a traveling state, the infrared image capturing unit 210 and the visible image capturing unit 220 among the infrared image capturing unit 210, the visible image capturing unit 220, and the communication unit 140. Are set to the operation on state, and it is determined that the vehicle is in the non-traveling state, and the infrared image capturing unit 210, the visible image capturing unit 220, and the communication unit 140 communicate with the infrared image capturing unit 210. The unit 140 may be set in an operation-on state.

  As a result, when it is determined that the vehicle is in the traveling state and when it is determined that the vehicle is in the non-traveling state, it is possible to drive only the necessary functional units to reduce power consumption.

  By the way, it is known that intruders in a residence or the like often stay in a certain place in order to hear the state of the residence, and the passing time of the monitoring area is longer than that of a pedestrian or the like. In addition, when the vehicle is parked, the background image does not change with time, so image processing is easier than when the vehicle is in a running state, and it is not necessary to set a high frame rate.

  Therefore, when it is determined that the vehicle is in the non-traveling state, the processing unit 120 may set the frame rate of the infrared image capturing unit 210 to be lower than the frame rate when the vehicle is in the traveling state. .

  Accordingly, it is possible to suppress the consumption of power used for driving the infrared image capturing unit 210 and image processing of infrared image data.

  In addition, you may implement | achieve functions, such as a vehicle-mounted camera control apparatus of this embodiment, with a program. In this case, a function such as the in-vehicle camera control device of the present embodiment is realized by a processor such as a CPU executing a program. Specifically, a program stored in the information storage medium is read, and a processor such as a CPU executes the read program. Here, the information storage medium (computer-readable medium) stores programs, data, and the like, and functions as an optical disk (DVD, CD, etc.), HDD (hard disk drive), or memory (card type). It can be realized by memory, ROM, etc. A processor such as a CPU performs various processes of this embodiment based on a program (data) stored in the information storage medium. That is, the information storage medium includes a program (a program for causing the computer to execute the processing of each unit) for causing a computer (an apparatus including an operation unit, a processing unit, a storage unit, and an output unit) to function as each unit of the present embodiment. Remembered.

3. Processing Flow Hereinafter, the processing flow of this embodiment will be described with reference to the flowchart of FIG.

  First, initial parameter settings are performed (S0). Next, in order to grasp the state of the vehicle, the vibration of the vehicle body is detected (S1). If vibration is detected in step S1, it is determined that the vehicle is running, and if vibration is not detected, it is determined that the vehicle is parked or stopped.

  If it is determined that the vehicle is traveling, the front of the vehicle body is imaged using the infrared image capturing unit, and a thermal image (infrared image) is acquired (S2). Then, the visible image capturing unit captures the front in the vehicle body traveling direction and acquires a visible image (S3). Note that the order of step S2 and step S3 may be either one as long as the interval between steps is short. In some cases, both may be processed in parallel.

  Here, in order to acquire an image without image blur when the vehicle is traveling, it is necessary to first detect vibration of the in-vehicle camera and perform image blur suppression according to the detected value. In general, the vibration of the traveling vehicle body usually has a frequency of 1 Hz to 20 Hz unless there is a special step. In this example, such vibration is detected based on the amount of change such as acceleration, angular acceleration, angular velocity, and angular displacement. Then, based on this detection information, the photographing optical axis is decentered to suppress image blur.

  Next, from the thermal image obtained in step S3, a region having a temperature equal to or higher than a given temperature range is extracted as a candidate region for the detection target (S4).

  For example, the case where the detection target is a preceding vehicle or a pedestrian (person) will be described below. First, when the detection target is a preceding vehicle, a given temperature range is set to 80 ° C. or higher by utilizing the fact that the muffler region becomes a high temperature of about 100 ° C. Then, a region having a temperature of 80 ° C. or higher is searched from the thermal image, and position information and temperature information of the region are detected.

  On the other hand, when the object to be detected is a pedestrian, the given temperature range is set to 28 ° C. or higher and lower than 37 ° C. by utilizing the fact that the surface temperature of the exposed face is about 30 ° C. To do. Then, a region having a temperature of 28 ° C. or higher and lower than 37 ° C. is searched from the thermal image, and position information and temperature information of the region are detected.

  Here, among the results detected in each region, the position information may be, for example, the barycentric coordinate position of the candidate region, and the temperature information may be, for example, the average temperature of the candidate region.

  In addition, when the detection object is a thing other than the preceding person and the pedestrian, the given temperature range is set based on the temperature information that the detection object is assumed to have, and The detection process may be performed as follows.

  And the position and temperature list which matched the positional information and temperature information of each candidate area | region obtained by step S4 are produced (S5).

  Next, it is determined whether there is a candidate area for the detection target in the list created in step S5 (S6). When no candidate area of the detection target is extracted from the list, there is no preceding vehicle or pedestrian that is the detection target in the thermal image captured by the current infrared image capturing unit. It returns to step S3 for the next process.

  On the other hand, if there are one or more candidate areas for the detection target in the list, the candidate areas are superimposed on the visible image based on the list created in step S5 (S7).

  Next, template matching processing is performed for each candidate region superimposed on the visible image in step S7, and it is determined whether or not the candidate region is a region representing a detection target.

  In the template matching process, first, a template to be used for the template matching process is selected based on the temperature information in the list created in step S5 (S8). For example, a template in which the difference between the temperature information pre-assigned to the template and the average temperature of the candidate area is within a given threshold (± ΔT) is selected as the template to be used. Note that the template may represent a tendency of the temperature distribution of the detection target.

  As a specific example, for example, when temperature information of 100 ° C. is assigned to the preceding vehicle template and the given threshold value ΔT is ± 3 ° C., the average temperature of the candidate region is 100 ± 3 ° C. In addition, the preceding vehicle template is selected as a template to be used.

  On the other hand, for example, temperature information of 28 ° C. is assigned to the template for the pedestrian, and when the given threshold ΔT is ± 3 ° C., when the average temperature of the candidate region is 28 ± 3 ° C., It is selected as a template to be used by the pedestrian template. In addition, regarding the high temperature part, it is necessary to consider that the temperature changes within a predetermined range even for the same object, considering that it is affected by the outside air temperature. In this example, the object having medium temperature information is a pedestrian. For example, in order to distinguish it from an animal (such as a dog) that is a similar object having medium temperature information, an animal template is used in this step. Can also be selected as the template to use.

  Then, the template selected in step S8 is compared with the candidate area to determine whether the candidate area is an area representing the detection target (S9). For example, when the candidate region has a similar temperature distribution tendency to the template, or when the error between the contour of the shape of the detection target assigned to the template and the contour of the candidate region is smaller than a predetermined threshold, etc. The candidate area is determined to be related to the same detection target as the template, and the position of the detection target is acquired.

  As another method of template matching processing, the density value (gray value) in the candidate area superimposed on the visible image is obtained based on the visible image, and the correlation with the density value (gray value) of the selected template is obtained. It may be determined by calculation whether or not the candidate region is a region representing a detection target. In addition, by preparing an edge image as a template, detecting edge information of the candidate area, and performing a correlation calculation of the edge information, it is determined whether or not the candidate area is an area representing the detection target. You may judge.

  Then, it is determined whether template matching processing has been performed for all candidate regions in the list created in step S5 (S10). If the template matching process has not been completed for all candidate areas in the list, the process returns to step S7. If the template matching process has been completed for all candidate areas in the list, the detection result is output to the external device (S11).

  For example, in order to display the position of the preceding vehicle or pedestrian as the detection result, the detection result of this process may be output to the presentation unit (in-vehicle display). In addition, in order to notify the presence or absence of a pedestrian or the danger of a collision, it may be output to the notification device by an alarm or an email with an image.

  Finally, the process returns to step S1 in order to perform the subsequent processing.

  Next, processing when the vehicle is parked in a residence and the vehicle-mounted camera control device of the present embodiment is used for crime prevention of the residence will be described.

  If vibration is not detected in step S1, it is determined that the vehicle is parked or stopped, and the drive sources of the infrared image capturing unit and the visible image capturing unit are stopped (S12).

  And when using a vehicle-mounted camera system for house crime prevention, the imaging direction and imaging position of an infrared image imaging part are changed so that the monitoring area including the entrance of a residence, a window, etc. can be imaged (S13). ). The change of the imaging direction and the imaging position of the infrared imaging unit may be performed manually or automatically based on a control signal from the in-vehicle camera control device.

  Next, after a predetermined time has elapsed since the position of the infrared image capturing unit is changed (S14), the infrared image capturing unit is driven. Note that the reason for driving the infrared image capturing unit after a certain period of time here is not only waiting for completion of the adjustment operation of the position and direction of the infrared image capturing unit and focusing, but also immediately after installation There is also a reason for the lack of necessity. For times when crime prevention is scarce, power consumption is reduced by not operating the in-vehicle camera system.

  Then, after waiting for a certain time, the infrared image capturing unit is caused to capture the monitoring area, and a thermal image at time t is acquired (S15). At this time, the counter i is initialized. Here, the sensitivity of the infrared image capturing unit may be reduced. This is because the distance between the vehicle body and the object (window / door) is short, and there is little outline blur due to the overlap of the background portion and the image of the intruder (object).

  Next, the infrared image captured in step S15 is transmitted to an external device such as a user's mobile phone in order to grasp the start time of crime prevention and to inform that the infrared image capturing unit is operating normally. (S16). At the same time, the infrared image captured in step S15 is stored in the storage unit as a master image (first infrared image data).

  Then, after elapse of a predetermined time, the counter i is updated, the front is captured by the infrared image capturing unit, and a new thermal image is acquired (S17).

  Here, when the vibration of the vehicle body is detected during the acquisition of the thermal image (S18), the process from step S22 is performed as the vehicle crime prevention process. The process after step S22 will be described later.

  On the other hand, when the vibration of the vehicle body is not detected during the thermal image acquisition (S18), the imaging position or the imaging direction of the infrared imaging unit is changed to determine whether or not to continue the house crime prevention process. It is determined whether it has been done (S19).

  When the imaging position or imaging direction of the infrared image capturing unit is changed, for example, it is determined that the user who is the owner of the vehicle has stopped the home crime prevention process for the reason of running the vehicle. Then, the process returns to S0.

  On the other hand, when the imaging position or imaging direction of the infrared image capturing unit is not changed, the thermal image acquired in step S15 (first infrared image data) and the thermal image acquired in step S17 (second infrared image) The image data is compared (S20). This comparison process is performed, for example, by comparing the temperature feature amounts of two thermal images.

  When it is determined that there is a difference between the two thermal images, there is a high possibility that there is an intruder in the monitoring area, so there is a thermal image (second infrared image data) acquired in step S17 or an intruder. The alarm information to notify this is transmitted to the user's external device (S21). Then, the process returns to step S17.

  On the other hand, when it is determined that there is no difference between the two thermal images, it can be determined that there is no intruder or the like in the monitoring area and there is no abnormality. Therefore, the process returns to step S17 to continue monitoring.

  In step S18, if vibration of the vehicle body is detected during the acquisition of the thermal image, vehicle security processing is executed. In this case, it means that the vehicle is in a running state with the position and orientation of the infrared image capturing unit being used for residential crime prevention processing. If it is the owner of the vehicle, it is considered that the vehicle is usually run after stopping the residential crime prevention process and changing the position of the infrared image capturing unit. Therefore, in this case, either the vehicle has been stolen or the vehicle owner has forgotten to perform the residential crime prevention process.

  Therefore, first, driving of the infrared image capturing unit is stopped, and the residential crime prevention process is stopped (S22). Next, when the vehicle is stolen, in order to know the current position of the vehicle, the visible image capturing unit is driven to obtain a visible image (S23). Then, the visible image captured in step S23 is transmitted to the external terminal held by the user to notify the user that an abnormality has occurred (S24). In addition, the information transmitted at this time may be a visible image, or may be information notifying that the in-vehicle camera control device has started the vehicle crime prevention process.

  Although the present embodiment has been described in detail as described above, it will be easily understood by those skilled in the art that many modifications can be made without departing from the novel matters and effects of the present invention. Accordingly, all such modifications are intended to be included in the scope of the present invention. For example, a term described at least once together with a different term having a broader meaning or the same meaning in the specification or the drawings can be replaced with the different term in any part of the specification or the drawings. Further, the configurations and operations of the in-vehicle camera control device, the in-vehicle camera control system, and the in-vehicle camera system are not limited to those described in the present embodiment, and various modifications can be made.

100 on-vehicle camera control device, 110 image acquisition unit, 120 processing unit,
130 traveling state determination unit, 140 communication unit, 150 storage unit,
200 vehicle-mounted camera system, 210 infrared image capturing unit, 220 visible image capturing unit,
230 presentation unit, 240 sensor, 300 external device,
410 infrared camera, 420 electric motor, 430 visible camera,
440 electric motor, 450 CPU, 460 gyro sensor,
470 memory, 480 GPS, 490 display

Claims (13)

An image acquisition unit for acquiring infrared image data from the infrared image capturing unit;
A processing unit for performing processing based on the infrared image data;
A communication unit that performs communication processing with an external device;
A traveling state determination unit that determines whether the vehicle is in a traveling state or a non-driving state;
Including
The processor is
When it is determined that the vehicle is in the traveling state, image processing based on the infrared image data is performed,
The communication unit is
An in-vehicle camera control device, wherein when it is determined that the vehicle is in the non-running state, the infrared image data or detection information based on the infrared image data is transmitted to the external device. In claim 1,
The processor is
When the vehicle is determined to be in the traveling state, a process of generating display image data including detection information of an object based on the infrared image data is performed as the image process. Camera control device. In claim 2,
The image acquisition unit
Visible image data is acquired from the visible image capturing unit,
The processor is
An in-vehicle camera that performs, as the image processing, processing for generating image data in which an alert image is superimposed at a position on the visible image corresponding to a position where the object is present as the display image data Control device. In any one of Claims 1 thru | or 3,
The processor is
When it is determined that the vehicle is in the non-running state, a residential crime prevention process is performed,
An in-vehicle camera that performs vehicle crime prevention processing when it is determined that the vehicle has changed from the non-running state to the running state when the running state determination unit is executing the residential crime prevention process. Control device. In claim 4,
The processor is
When it is determined that the vehicle is in the non-running state, when the infrared image capturing unit is set to the position or direction for the residential crime prevention process, the residential crime prevention process is performed based on the infrared image data. Done
The communication unit is
An in-vehicle camera control device that transmits the infrared image data or the detection information based on the infrared image data to the external device based on a result of the residential crime prevention process. In claim 4 or 5,
A storage unit for storing the infrared image data;
The processor is
As the residential crime prevention process, the infrared image data is stored in the storage unit at given time intervals, and the stored first infrared image data and the first infrared image data are acquired at different timings. Perform comparison processing with the second infrared image data,
The communication unit is
In the comparison process, when it is determined that there is a difference between the first infrared image data and the second infrared image data, the detection information based on the infrared image data or the infrared image data is used as the external information. An in-vehicle camera control device that transmits to a device. In any one of Claims 4 thru | or 6.
The processor is
When the infrared image capturing unit is set at the position or direction for the residential crime prevention process, the vehicle crime prevention process is performed when the vehicle is detected to be in the traveling state. In-vehicle camera control device. In any of claims 4 to 7,
The processor is
When performing the residential crime prevention process, set the visible image capturing unit in the operation off state,
When performing the vehicle crime prevention process, the vehicle-mounted camera control device is characterized in that the visible image capturing unit is set to an operation-on state. In claim 8,
The image acquisition unit
As the vehicle crime prevention process, performing a process of obtaining visible image data from the visible image capturing unit,
The communication unit is
An in-vehicle camera control device that transmits the visible image data to the external device. In any one of Claims 1 thru | or 9,
The image acquisition unit
Visible image data is acquired from the visible image capturing unit,
The processor is
When it is determined that the vehicle is in the traveling state, the infrared image capturing unit and the visible image capturing unit among the infrared image capturing unit, the visible image capturing unit, and the communication unit are in an operation-on state. Set to
When it is determined that the vehicle is in the non-running state, the infrared image capturing unit and the communication unit are turned on among the infrared image capturing unit, the visible image capturing unit, and the communication unit. An in-vehicle camera control device characterized by setting. In any one of Claims 1 thru | or 10.
The processor is
When the vehicle is determined to be in the non-running state, the vehicle image is configured to set the frame rate of the infrared image capturing unit to be lower than the frame rate when the vehicle is in the running state. Camera control device. An image acquisition unit for acquiring infrared image data from the infrared image capturing unit;
A processing unit for performing processing based on the infrared image data;
A communication unit that performs communication processing with an external device;
A traveling state determination unit that determines whether the vehicle is in a traveling state or a non-driving state;
Including
The processor is
When it is determined that the vehicle is in the traveling state, image processing based on the infrared image data is performed,
The communication unit is
An in-vehicle camera control system that transmits the infrared image data or detection information based on the infrared image data to the external device when it is determined that the vehicle is in the non-running state. The in-vehicle camera control device according to any one of claims 1 to 11,
The infrared imaging unit;
An in-vehicle camera system characterized by including: