JP2004330979A - Vehicle drive control device - Google Patents

Abstract

A driver can drive more safely in consideration of an installation position of an image input device provided in a drive control device of a vehicle.
A face recognition device for recognizing a face of a driver acquired by an imaging camera (driver image data acquisition means) installed in a vehicle, the face of the driver in a state of sitting in a driver seat. And a face direction judging device 26 for judging the face direction. The face image data in which the face of the driver 13 is stored in advance and the face image data of the driver 13 acquired by the imaging camera 21 are compared and collated. And a vehicle drive unit 18 that can be started when the vehicle control system 12 receives the vehicle drive unit start permission signal h1 output from the face orientation determination unit 26 when the two match.
[Selection diagram] Fig. 1

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a vehicle device provided with a face recognition device that recognizes a driver who drives a vehicle, and more particularly to a drive control device for a vehicle that enables safe driving, theft prevention, and comfortable driving.
[0002]
[Prior art]
As a conventional vehicle drive control device, a vehicle has a function of recognizing a driver's face on the vehicle side, and by recognizing the driver's face, the vehicle can be driven so that safe driving is possible. It has been known.
[0003]
For example, as shown in FIG. 7, there is a drive control device 4 for a vehicle in which an image input device 3 is attached to a front portion of a driver's seat 2 of an automobile 1 (see Patent Document 1).
[0004]
The image input device 3 can move along a rail 5 in the vehicle width direction provided on the roof of the vehicle, and the movement of the driver 6 of the driver's seat from an arbitrary direction within a predetermined range by such movement. A face image can be obtained and functions as a face recognition device.
[0005]
Therefore, even when the position or orientation of the face of the driver 6 changes, the image input device 3 can recognize the face by following the driver's face.
[0006]
By recognizing the face in this way, it is possible to recognize the face of the driver 6 who is looking aside at the driver 6 or driving while falling asleep, and determine the abnormality.
[0007]
The image input device 3 is capable of inputting not only visible light but also an infrared image, and can capture a face image of the driver 6 even at night or when traveling in a tunnel.
[0008]
Then, based on the image data acquired by the image input device 3, a face direction detector (not shown) detects the face direction of the driver 6, and a face recognizer (not shown) recognizes the face.
[0009]
Thus, by providing the face recognition device (image input device) for recognizing the face of the driver 6 driving the automobile 1, the driver 6 can be identified by the face, or the driver 6 can be identified based on the facial expression. It is possible to detect the degree of fatigue and arousal of the person.
[0010]
In addition, it is possible to drive a drive device provided in the vehicle 1 so that the driving device contributes to the safe driving of the vehicle 1.
[0011]
[Patent Document 1]
Japanese Patent Application Laid-Open No. 2001-243466 [Page 7, left column, lines 32 to 47 and FIG. 10 (means for identifying a driver and detecting a face direction of the driver)]
[0012]
[Problems to be solved by the invention]
According to the drive control device 4 of the conventional vehicle, the position and the direction of the face of the driver 6 are changed by the image input device 3 that can acquire the image of the face of the driver 6 sitting in the driver's seat 2 from an arbitrary direction. Also in this case, the image input device 2 can follow the face.
[0013]
For this reason, since the face direction information of the driver 6 in the driver's seat 2 can be obtained, for example, data on the driving situation of the driver 6 during driving of the car on the road is obtained, and the data for safe driving of the car 1 is obtained. It is possible to perform drive control.
[0014]
However, the driving image information of the driver 6 obtained by the image input device 3 does not disclose a specific configuration of a driving device for contributing to the safe driving of the driver 6, for example, a driving device for safe driving. However, a sufficient effect (safety) could not be expected even if the image was used.
[0015]
Today, various measures relating to the vehicle system have been adopted for safe driving, and application of the driving image information of the driver to the drive control device 4 of the vehicle has been expected.
[0016]
The present invention has been made in view of the above points, and is provided with a means for recognizing a driver's face image, so that the driver can drive more safely and prevent the vehicle from being stolen. It is another object of the present invention to provide a drive control device for a vehicle that can perform the above operation.
[0017]
It is another object of the present invention to provide a drive control device for a vehicle that enables a more comfortable driving by obtaining a driving environment desired by a specific driver.
[0018]
[Means for Solving the Problems]
In order to achieve the above object, according to the first aspect of the present invention, based on a face image processing system that acquires driver's face image data, and based on the driver's face image data acquired by the face image processing system, A vehicle control system for performing vehicle control, wherein the face image processing system recognizes a driver's face obtained by the driver image data obtaining means installed in the vehicle and the driver image data obtaining means; A face recognition device, a face direction determination device for recognizing a driver's face sitting in a driver's seat by the face recognition device to determine a face direction, and a face recognition device provided in the face recognition device. A face image data dictionary registration unit that stores image data in advance, wherein the vehicle control system stores the driver's face image data acquired by the driver image data acquisition unit and the face image data dictionary registration unit. Face image day If There is a match, it receives the driving system start permission signal of the vehicle output from the face recognizer comprises a vehicle driving unit that can drive the vehicle engine.
[0019]
In order to achieve the above object, according to the invention of claim 13, a vehicle engine key device for starting a vehicle engine, a face image processing system for acquiring driver's face image data, and a face image processing system A vehicle control system for performing vehicle control based on the obtained driver's face image data, provided in the vehicle engine key device, wherein face image data of the driver is previously stored in the vehicle engine key A dictionary registration unit, the face image processing system includes a driver image data acquisition unit installed in the vehicle, a face recognition device that recognizes a driver's face acquired by the driver image data acquisition unit, A face direction determining device that recognizes a driver's face in a state of being seated by the face recognition device to determine a face direction; and Face image data reading means for reading the face image data stored in the image data dictionary registration unit, wherein the vehicle control system includes a driver's face image data and the face image data obtained by the driver image data obtaining means. A vehicle drive unit that receives a vehicle drive system start permission signal output from the face recognition device when the face image data stored in the dictionary registration unit matches, and enables the vehicle engine to start.
[0020]
BEST MODE FOR CARRYING OUT THE INVENTION
A vehicle drive control device according to the present invention will be described with reference to the accompanying drawings.
[0021]
(1st Embodiment)
1 and 2 are schematic diagrams showing a first embodiment of a drive control device for a vehicle according to the present invention.
[0022]
The vehicle drive control device 10 includes a vehicle control system 12 that controls a drive device provided in a vehicle body 11 and a face image (individual feature image) of a driver 13 that is installed on the vehicle body 11 and serves as a recognition target. A face image processing system 14 for acquiring and performing data processing. The vehicle control system 12 includes a door opening detection device 15, a vehicle drive system 16 for controlling the driving of the vehicle body 11, and an integrated control means 17 for controlling the vehicle drive system 16 collectively. As shown, it is installed at the bottom of the vehicle compartment 11d of the vehicle body 11, or at the vehicle door 11c and the rear machine room 11b.
[0023]
The face image processing system 14 is installed in the front machine room 11 a and the handle operation unit 22.
[0024]
The door opening detecting device 15 of the vehicle control system 12 is provided on the side of the vehicle door 11c. By releasing the vehicle door 11c, the opening of the vehicle door 11c is detected, and the door opening signal a is transmitted to the integrated control means 17 side. Output to
[0025]
The integrated control means 17 has a function of giving permission to start the driving device of the vehicle to the vehicle drive system 16 when the face image of the driver 13 is recognized. When an abnormality is detected in the face direction of the thirteen, a signal is output to the vehicle drive system 16 so as to emit a warning sound, and the driver is alerted to prevent an accident.
[0026]
The vehicle drive system 16 is installed in the rear machine room 11b of the vehicle main body 11, and includes a vehicle drive device 18, a vehicle actuator drive device 19, and an alarm device 20, as shown in FIG. The vehicle driving device 18 includes a driving device that drives the vehicle body 11 with the engine and a stopping device 18a that stops driving the engine.
[0027]
The vehicle actuator drive device 19 includes an actuator device that can automatically adjust the position of a seat or the like, and personalization data storage means 19a serving as a reference for the automatic adjustment.
[0028]
The alarm device 20 includes a speaker device 20a that issues an alarm to the driver 13 when necessary while the vehicle body 11 is running.
[0029]
Specifically, when the vehicle door 11c is opened, as shown in FIG. 2, the vehicle control system 12 sends a door opening signal a output from the door opening detecting device 15 to an integrated control means for controlling the communication control first. 17 is input. Upon receiving the door opening signal a, the integrated control means 17 outputs the door opening signal a to the imaging camera 21 on the face image processing system 14 side.
[0030]
On the other hand, from the face image processing means 25 side, the integrated control means 17 uses the face image of the driver 13 as the face authentication signal e while the vehicle body 11 is traveling, and the face image is abnormal (different from the predetermined face image). In this case, the face direction abnormal signal g is received. Upon receiving the face authentication signal e, the integrated control means 17 generates a vehicle drive system start permission signal h and outputs it to the vehicle drive system 16 side. The vehicle drive system start permission signal h includes a vehicle drive start permission signal h1 and a vehicle actuator drive permission signal h2.
[0031]
Further, when the integrated control means 17 receives the face direction abnormal signal g from the face image processing means 25 side, the accident control signal j is generated and output to the vehicle drive system 16 side. The accident prevention signal j includes a vehicle braking signal j1 and a warning signal j2.
[0032]
On the other hand, the face image processing system 14 includes an imaging camera 21 that obtains image data of the driver 13, a face image processing unit that processes the image data to recognize that the image data is face image data, and that determines a face direction at the same time. 25.
[0033]
In order to acquire an image data signal b including image data of the front and side faces of the driver 13, the imaging camera 21 is moved face-to-face with, for example, a handle shaft (not shown) of the handle operation unit 22 of the vehicle body 11. The driver 13 is installed so as to be inconspicuous to the driver 13.
[0034]
When the vehicle door 11c is opened, the imaging camera 21 receives a door opening signal a transmitted from the door opening detecting device 15 via the integrated control means 17, and the driver 13 Image data in a state of being seated on a driver's seat (not shown) of the main body 11 is output to the integrated control means 17 side by an image data signal b.
[0035]
The imaging camera 21 uses, for example, a CCD (Charge Coupled Device) as an imaging device. According to the CCD type imaging camera 21, in recognizing the face of the driver 13 by the face recognition device 23, a good resolution is obtained and the image data is excellent in comparison and collation.
[0036]
The face image processing means 25 of the face image processing system 14 recognizes that the image data acquired by the imaging camera 21 is face image data, authenticates that the image data is a specific face image, Has a function of determining that the direction is abnormal, such as a state in which the driver 13 is looking aside.
[0037]
The face image processing means 25 determines a face recognition device 23 for recognizing the face of the driver 13 sitting on the driver's seat of the vehicle body 11 and a face direction of the driver 13 after the vehicle body 11 starts running. An operation mode switching device 27 is provided for switching from the operation mode of the face recognition device 23 before traveling of the vehicle body 11 to the operation mode of the face orientation determination device 26 during traveling.
[0038]
The face recognition device 23 includes a face image data recognition program unit 28 for authenticating the driver 13, and when authenticating the driver 13 with the face image data recognition program unit 28, first, it is determined whether or not the face image is a face image. The image processing apparatus includes a face image recognition unit 29 for recognition and a face image data dictionary registration unit 30 in which face image data of the driver 13 is registered in advance.
[0039]
Further, an image data signal b is input to the face recognition device 23 directly from the image camera 21 or via the integrated control means 17.
[0040]
Further, the face recognition device 23 authenticates whether the face image data included in the image data signal b received from the operation mode switching device 27 is the face of the driver 13, and as a result of this authentication, the face authentication signal e.
[0041]
Specifically, the image data signal b received by the face image data recognizing program unit 28 is recognized as a face image by the face image recognizing unit 29. The data is transmitted to the image data dictionary registration unit 30 side.
[0042]
The face image data dictionary registration unit 30 that has received the face image recognition data signal c uses the registered face image data of one or more drivers 13 as the registered face image data signal d to the image data recognition program unit 28 side. Output to The face image data recognizing program unit 28 compares and matches the registered face image data signal d received from the face image data dictionary registration unit 30 with the image data signal b previously received from the operation mode switching device 27 side. In this case, an output signal to that effect is output to the integrated control means 17 of the vehicle control system 12 via the operation mode switching device 27 as a face authentication signal e.
[0043]
If the result of the comparison and comparison by the face image recognition program section 28 does not match, the face authentication signal e is not output from the face image recognition program section 28 to the integrated control means 17 side. Therefore, the vehicle drive system 16 does not drive.
[0044]
On the other hand, the face direction determining device 26 includes a face direction determining dictionary data unit 31 for determining whether image data included in the input image data signal b is face image data, and a face direction determining dictionary data unit 31. If the result of the determination made by 31 is face image data, a face direction determination program section 32 for determining the face direction indicated by the face image data is provided.
[0045]
The face direction determination device 26 outputs a face direction abnormality signal g to the operation mode switching device 27 when it is determined based on the image data signal b received from the operation mode switching device 27 that the driver 13 has an abnormal face direction. Output to Then, the face direction determination program section 32 that has received the image data signal b from the operation mode switching device 27 transmits this image data signal b to the face direction determination dictionary data section 31 side.
[0046]
Based on the image data signal b, the face direction determining dictionary data unit 31 extracts face direction determining face image data that is optimal for determining the face direction of the face image data, and converts the extracted face image data into the face direction. It is transmitted to the face direction determination program section 32 as a determination data signal f. The face direction determination program unit 32 compares and compares the received determination data signal f with the previously received image data signal b, and determines that the face direction of the driver 13 is abnormal. ) Is determined. When it is determined that there is an abnormality, the face direction determining program unit 32 generates a face direction abnormal signal g, and outputs the face direction abnormal signal g to the operation mode switching device 27 side.
[0047]
When the face direction determination program unit 32 determines that the face direction of the driver 13 is normal, the face direction abnormal signal g is not output.
[0048]
On the other hand, the operation mode switching device 27 connects the face recognition device 23 and the integrated control means 17 of the vehicle control system 12 when the vehicle main body 11 stops running, and when the vehicle main body 11 starts running. The connection mode to the face recognition device 23 can be switched from the connection mode to the face recognition device 23.
[0049]
Accordingly, the face direction abnormality signal g output from the face direction determination device 26 is transmitted to the integrated control means 17 side of the vehicle control system 12 via the operation mode switching device 27.
[0050]
The integrated control means 17 receives the face direction abnormality signal g or the face authentication signal e transmitted from the face recognition device 23, and thereby transmits the vehicle drive system start permission signal h or the accident prevention signal j to the vehicle drive system 16 side. Output to
[0051]
The vehicle drive system 16, the vehicle drive device 18, the vehicle actuator drive device 19, and the alarm device 20 receive the vehicle drive system start permission signal h or the accident prevention signal j from the integrated control means 17 side, and thereby each signal h Alternatively, a predetermined operation is performed according to j.
[0052]
The vehicle drive device 18 can receive the vehicle drive device start permission signal h1 and make the driver 13 drive the vehicle engine (not shown). The stopping device 18a of the vehicle driving device 18 receives the vehicle braking signal j1 from the integrated control means 17 and stops the vehicle engine.
[0053]
The warning device 20 similarly receives the warning signal j2 and transmits a warning. This alarm is generated from a speaker device 20a provided in an upper rear portion of the cabin 11d of the vehicle main body 1, for example, to produce a sound similar to a horn sound.
[0054]
The vehicle actuator drive device 19 of the vehicle drive system 16 activates a vehicle actuator (not shown) by receiving the vehicle actuator device start permission signal h2 so that personalization adjustment corresponding to the driver 13 is automatically performed. It has become. The vehicle actuator driving device 19 is a device for driving a driving device (not shown) attached to, for example, a seat, a mirror, a car air conditioner, an audio device, or a video device provided in the vehicle body 11.
[0055]
For example, in the case of a seat, the setting data at the time of adjusting the seat position at the time of the first boarding is automatically stored once the adjustment is completed, the seat position is automatically stored after the second time, and thereafter, automatically. (Hereinafter referred to as personalization adjustment).
[0056]
Since the personalization adjustment setting data is always stored in the personalization data storage means 19a as personalization data k, the driver 13 can check the height position of the driver's seat and various devices in the cabin 11d when first riding. If the driver's own driving environment is set, the above personalization adjustment is automatically performed when the same driver 13 gets on the vehicle for the second time or later.
[0057]
When the alarm device 20 of the vehicle drive system 16 receives the accident prevention signal j transmitted from the integrated control means 17, an alarm is transmitted from the speaker device 20a based on the alarm signal j2 included in the accident prevention signal j. It has become.
[0058]
Next, the operation of the vehicle drive control device 10 will be described with reference to FIGS.
[0059]
FIG. 3 shows steps from when the driver 13 gets on the vehicle to when the driver 13 gets off the vehicle.
[0060]
A case where the driver 13 gets on and off the vehicle main body 11 for the first time and a case where the driver 13 gets on and off the second and subsequent times will be described.
[0061]
[When the driver gets on and off for the first time]
The vehicle door 11c of the vehicle body 11 is opened, and the driver 13 sits on the driver's seat.
[0062]
When the vehicle door 12c is opened, the door opening signal a is transmitted to the imaging camera 21 via the integrated control means 17, and the face of the driver 13 is imaged by the imaging camera 21 <Step 1>.
[0063]
Then, the image data signal b of the face of the driver 13 acquired by the imaging camera 21 is transmitted to the face recognition device 23 on the face image processing system 14 side, and the face image data dictionary registration unit 30 of the face recognition device 23 A dictionary is registered <Step 2a>.
[0064]
At the same time, the face recognition device 23 registers the dictionary and transmits the vehicle driving system start permission signal h to the vehicle control system 12 side, and the driver 13 is authenticated <Step 3>.
[0065]
At the same time as the authentication of the driver 13, the driving of the vehicle driving device 18 is permitted (the vehicle engine can be started) <Step 4a>.
If the driver 13 has not been authenticated, the face authentication signal e is not output and the vehicle drive system 16 remains in a non-driven state.
The driver 13 starts the vehicle main body 11 and performs personalization adjustment on the vehicle actuator driving device 35 such that a driving environment suitable for the driver 13 is obtained. The personalization adjustment is performed on the assumption that the adjustment is automatically performed at the time of the second or subsequent riding on the vehicle main body 11 (step 4b).
[0066]
Next, when the driver 13 drives the vehicle main body 11, the face orientation determination device 26 is operated, and the face orientation of the driver 13 during driving is determined <Step 5>.
At this time, when the face orientation determination device 26 determines that the face orientation of the driver 13 is abnormal (step in the N direction), the vehicle braking signal j1 of the accident prevention signal j output from the face orientation determination device 26 As a result, braking is applied to the vehicle drive device 18 on the vehicle drive system 16 side <Step 6a>.
At the same time, the alarm device 20 of the vehicle drive system 16 is activated by the alarm signal j2 of the accident prevention signal j, and an alarm is issued <Step 6b>.
[0067]
After a predetermined time has elapsed (avoidance of sudden braking), the vehicle engine of the vehicle body 11 is stopped <Step 7>.
Simultaneously with the stop of the running of the vehicle body 11, the personalized data k of the driver 13 is stored in the vehicle actuator driving device 19 <Step 8>.
[0068]
It should be noted that if the face direction of the driver 13 is determined to be normal (step in the Y direction) as a result of the determination of the face direction of the driver 13 in <Step 5>, no signal is output from the face direction determination device 26. Therefore, the face direction abnormal signal g is not transmitted to the vehicle control system 12 side, and the vehicle drive system 16 receives only the face authentication signal e and starts.
[0069]
[When the driver gets on and off after the second time]
Next, a case where the driver 13 gets on and off the vehicle for the second time or later will be described.
[0070]
The vehicle door 11c of the vehicle body 11 is opened, and the driver 13 sits on the driver's seat. When the vehicle door 11c is opened, the door opening signal a is transmitted to the imaging camera 21 via the integrated control means 17, and the face of the driver 13 is imaged by the imaging camera 21 <Step 1>.
[0071]
When the driver 13 sits and closes the vehicle door 11c, the face image data of the driver 13 and the face image stored in the face image data dictionary registration unit 30 at the time of [when the driver gets on and off for the first time] are registered. The data is compared and collated <Step 2b>.
If the two face image data are compared and matched as a result (step in the Y direction), a face authentication signal e is transmitted from the face recognition device 23 to the integrated control means 17 of the vehicle control system 12. Is done.
[0072]
The integrated control means 17, which has received the face authentication signal e, generates a vehicle drive system start permission signal h (h1, h2), and sends the vehicle drive start permission signal h1 to the vehicle drive unit 18 to the vehicle actuator device. The start permission signal h2 is transmitted to the vehicle actuator driving device 19 side.
As a result, the vehicle engine can be started, and the vehicle actuator driving device 19 stores the personalized data k of the driver 13 stored at the time of [when the driver gets on and off for the first time] stored in the personalized data storage means 19a. Is called, and personalization adjustment is automatically performed <Step 4b>.
[0073]
Note that <Step 3> to <Step 7> are the same steps as [when the driver gets on and off for the first time], and thus description thereof will be omitted.
[0074]
Also, the description of <Step 8> will be omitted because the personalized data k of the driver 13 has already been stored in [When the driver gets on and off for the first time].
[0075]
As described above, the driver 13 can drive the vehicle body 11 safely and comfortably through <Step 1> to <Step 7>.
[0076]
In the vehicle drive control device according to the first embodiment described above, the face image processing unit 25 of the face image processing system 14 converts the image data signal b captured by the imaging camera 21 from the operation mode switching device 27 to the face direction determination device. Although the data has been transmitted to the face direction determination dictionary data unit 31 via the face direction determination program unit 26 of FIG. 26, the operation mode switching device 27 has been directly transmitted to the face direction determination dictionary data unit 31. A configuration may be used.
[0077]
The face image recognition section 29 of the face recognition apparatus 23 of the face image processing system 14 is incorporated in the function of the face image data recognition program section 28, or the face image data recognition program section 28 outputs the image data signal b. Is received, the presence or absence of reception of the image data signal b is input to the face image data dictionary registration unit 30 so that the registered face image data signal d can be received from the face image data dictionary registration unit 30 side. You may. In this case, the face image recognition unit 29 can be omitted.
[0078]
Furthermore, the operation mode switching device 27 provided in the face image processing means 25 of the face image processing system 14 switches from the face recognition device 23 to the face direction determination device 26 at the same time as the vehicle body 11 travels. , A changeover switch (not shown) may be provided so that the driver 13 can be operated arbitrarily when it is deemed necessary.
[0079]
Furthermore, the integrated control means 17 of the vehicle control system 12 simultaneously transmits the vehicle drive device start permission signal h1 to the vehicle drive device 18 and the vehicle actuator device start permission signal h2 to the vehicle actuator drive device 19 side. However, a time lag is provided, for example, the vehicle driving device 18 is first started, and then the vehicle actuator driving device 19 is driven by using the driving force of the vehicle engine accompanying the starting. It is also possible.
[0080]
Further, the vehicle drive system 16 receives the accident prevention signal j (j1, j2) output from the face direction determination device 26 when the face direction of the driver 13 is abnormal, and Although the alarm is issued by the alarm device 20 first, these may be performed simultaneously, or only one of them may be operated.
[0081]
Further, in a step until the driver 13 gets on and gets off the vehicle shown in FIG. 3, the driving of the driving engine of the vehicle driving device 18 is permitted (step 4 a). The <step 4b> of the personalized adjustment which is performed in a targeted manner may be performed at the same time or at the opposite step.
[0082]
In addition, the personalization data k of the driver 13 is registered in the face image data dictionary registration unit 30 of the face recognition device 23 <Step 8> in the case where the driver gets on and off after the second time. It is also possible to store and update the personalized data k each time the vehicle is boarded.
[0083]
(Second embodiment)
Next, a second embodiment of the drive control device for a vehicle according to the present invention will be described with reference to FIGS.
[0084]
The same parts as those of the vehicle drive control device 10 shown in the first embodiment are denoted by the same reference numerals, and description thereof will be omitted.
[0085]
The drive control device 100 of the vehicle includes a vehicle control system 12 that controls a drive device provided in the vehicle body 11 and a face image (individual characteristic image) of a driver 13 as a recognition target installed on the vehicle body 11 side. A face image processing system 101 that acquires and performs data processing, and a vehicle engine key device 102 (see FIG. 5) that is provided to transmit the face image data of the driver 13 to the face image processing system 101. .
[0086]
As shown in FIG. 4, the face image processing system 101 is provided in a cabin 11 d of the vehicle body 11 and obtains a driver image data acquisition unit (hereinafter, referred to as a driver image data acquisition unit) that acquires a face image of a driver 13 sitting in a driver seat. The camera 21 recognizes the face image of the driver 13 acquired by the imaging camera 21 to authenticate the specific driver 13 and determine the face direction to determine the face direction of the driver. And a face image processing means 103 for generating and outputting a signal for prevention.
[0087]
As shown in FIG. 5, the face image processing means 103 includes a face recognition device 104, a face orientation determination device 26, and an operation mode switching device for switching the operation mode of the face recognition device 104 to the operation mode of the face orientation determination device 26. And a device 27.
[0088]
The face recognizing device 104 includes a face image data recognizing program unit 28 and a face image recognizing unit 28 for recognizing the driver 13 when the face image data recognizing program unit 28 recognizes the driver 13. It comprises a unit 29 and a face image data reading device (connection interface) 105 for reading the registered face image data d of the driver 13 from the vehicle engine key device 102.
[0089]
The face image data reading device 105 receives the face image recognition data signal c from the face image recognition unit 29, and transmits the registered face image data signal d to the face image data recognition program unit 28 side. The data signal d is received from the vehicle engine key device 102 when the face image data reading device 105 receives the face image recognition data signal c from the face image recognition unit 29 side.
[0090]
Description of the configuration of the transmitting and receiving means of the registered face image data signal d in the face image data reading device 105 is omitted.
[0091]
On the other hand, the vehicle engine key device 102 is inserted into a key hole (not shown) of the vehicle door 11c of the vehicle body 11, and has a function of starting the vehicle engine. The unit 106a is composed of a face image data dictionary registration memory 107 embedded integrally. The face image data dictionary registration memory 107 has a storage function corresponding to the face image data dictionary registration unit 30 of the face recognition device 23 shown in the first embodiment, and is previously stored in the face image data dictionary registration unit 30. And a function of outputting registered face image data. The registered face image data stored in advance may be, for example, the owner or user of the vehicle body 11 or a driver registered in advance using the vehicle body 11 such as the family of the owner. Thirteen face image data.
[0092]
The vehicle engine key device 102 inserts the insertion key portion 106a of the vehicle engine key 106 into the key hole of the vehicle door 11c of the vehicle body 11 so that the face image data dictionary registration memory 107 contacts or does not contact the key hole. The contact image data of the driver 13 is read into the face image data reading device 105 by the registered face image data signal d in the face image data dictionary registration memory 107 upon contact.
[0093]
An image data signal b is input to the face image processing unit 103 directly from the imaging camera 21 or via the integrated control unit 17.
[0094]
The face recognition device 104 authenticates whether the face image data incorporated in the image data signal b received from the operation mode switching device 27 is the face of the driver 13, and as a result of this authentication, the face authentication signal e Is output.
[0095]
Specifically, the image data signal b received by the face image data recognizing program unit 28 is recognized as a face image by the face image recognizing unit 29. The face image data reading device 105, which has been transmitted to the image data reading device 105 and has received the face image recognition data signal c, converts the registered face image data of one or more drivers 13 into a registered face image data signal d. Output to the image data recognition program section 28 side.
[0096]
The face image data recognition program unit 28 compares and matches the registered face image data signal d received from the face image data reading device 105 with the image data signal b previously received from the operation mode switching device 27 side. In such a case, an output signal to that effect is output to the integrated control means 17 of the vehicle control system 12 via the operation mode switching device 27 as the face authentication signal e.
[0097]
If the result of the comparison and comparison by the face image recognition program section 28 does not match, the face authentication signal e is not output from the face image recognition program section 28 to the integrated control means 17 side. Therefore, the vehicle drive system 16 does not drive.
[0098]
On the other hand, the face direction determination device 26 outputs a face direction abnormality signal g when the face direction of the driver 13 is determined to be abnormal based on the image data signal b received from the operation mode switching device 27 side. Output to the 27 side. The configuration of the face direction determination device 26 and the configuration of the vehicle control system 12 are the same as the configuration shown in the first embodiment, and thus description thereof will be omitted.
[0099]
Next, the operation of the vehicle drive control device 100 will be described with reference to FIG.
[0100]
FIG. 6 shows steps from when the driver 13 gets on the vehicle (opens the vehicle door 12c) and gets off the vehicle.
[0101]
A case where the driver 13 gets on and off the vehicle body 11 for the first time and a case where the driver 13 gets on and off for the second time and thereafter will be described.
[0102]
[When the driver gets on and off for the first time]
The vehicle door 11c of the vehicle body 11 is opened, the driver 13 is seated in the driver's seat, the vehicle door 12c is closed, and the insertion key portion 106a of the vehicle engine key 106 of the vehicle engine key device 102 is moved to the key of the vehicle door 11c. Insert into the hole.
[0103]
At the stage when the vehicle door 11c is opened, the door opening signal a is transmitted to the imaging camera 21 via the integrated control means 17, and the face of the driver 13 is imaged by the imaging camera 21 <Step 1>.
[0104]
The image data signal b of the face of the driver 13 captured by the imaging camera 21 is transmitted to the face image processing means 103 of the face image processing system 101 via the integrated control means 17, and further transmitted via the operation mode switching device 27. And transmitted to the face recognition device 104. The transmitted image data signal b is transmitted to the face image recognition unit 29 via the face image data recognition program unit 28. When the face image recognition unit 29 recognizes that the received image data signal b is image data of a face, the image data signal b is transmitted to the face recognition device 104.
[0105]
When the face recognition device 104 receives the image data signal b, the registered face image data signal d is transmitted to the face image data recognition program unit 28, and the face image data recognition program unit 28 The signal b and the registered face image data signal d received from the face image data reading device 105 are compared and collated (step 2).
[0106]
If the two data signals b and d are compared and collated by the face image data recognizing program unit 28 and they match, the driver 13 is authenticated as a registered driver by the face image data recognizing program unit 28. <Step 3>.
[0107]
At the same time, the vehicle control system 12 permits the start of the vehicle drive system 16, and the vehicle engine becomes automatic <step 4a>.
[0108]
If the driver 13 is not authenticated, the face authentication signal e is not output, and the vehicle drive system 16 remains in a non-driven state.
[0109]
The driver 13 automatically performs personalization adjustment when the driver 13 operates the vehicle actuator driving device 19 (input operation for calling up personalization data from the personalization storage unit 19a) so that a driving environment suitable for the driver 13 is obtained. . After performing the personalization adjustment, the driver 13 starts running the vehicle body 11 (step 4b).
[0110]
Next, when the driver 13 drives the vehicle main body 11, the face orientation determination device 26 is operated, and the face orientation of the driver 13 during driving is determined <Step 5>.
[0111]
When the face orientation determination device 26 determines that the face orientation of the driver 13 during driving is abnormal (step in the N direction), the face orientation determination device 26 transmits a face orientation abnormality signal g to the vehicle control system 12 side. Is done. The vehicle control system 12 that has received the abnormal face direction signal g generates an accident prevention signal j by the integrated control means 17 and transmits it to the vehicle drive system 16 side. The vehicle drive device 18 that has received the transmitted vehicle braking signal j1 of the accident prevention signal j applies braking to the vehicle engine of the vehicle body 11 (step 6a).
[0112]
At the same time, the alarm device 20 that has received the alarm signal j2 can issue an alarm from the speaker device 20a (step 6b).
[0113]
After a predetermined time has elapsed, the running of the vehicle body 11 is stopped. The time until the vehicle main body 11 stops is appropriately set so that the vehicle main body 11 does not enter the sudden braking state (safe driving) <Step 7>.
[0114]
Then, as a result of the personalization adjustment in the above <Step 4b>, the obtained personalization data k is stored in the personalization data storage means 19a of the vehicle actuator driving device 19 <Step 8>.
[0115]
The personalization data k of the driver 13 is called from the personalization data storage means 19a at the time of the next driving, and the personalization adjustment in <Step 4b> is automatically performed.
[0116]
If it is determined in step 5 that the face direction of the driver 13 is normal (step in the Y direction), no signal is output from the face direction determination unit 26. Therefore, the face direction abnormal signal g is not transmitted to the vehicle control system 12 side, and the vehicle drive system 16 receives only the face authentication signal e and starts.
[0117]
After the start, the driving of the vehicle body 11 is stopped by the driver 13's intention.
[0118]
Then, when the vehicle body 11 stops, the personalization data obtained by the personalization adjustment performed in <Step 4b> is stored in the vehicle drive system 16 <Step 8>.
[0119]
Next, a case where the driver gets on and off after the second time will be described.
[0120]
When the driver 13 gets on the vehicle for the second time or later, the steps from <Step 1> to <Step 4> are the same as in the case where the driver gets on and off for the first time.
[0121]
In <Step 4b>, when making the personalization adjustment, the driver 13 does not make another adjustment if it is the same as when the driver got on the vehicle before. That is, in the second and subsequent rides, personalization adjustment is automatically performed on the vehicle actuator driving device 19 side based on the personalization data k stored in the personalization data storage means 19a of the vehicle actuator driving device 19.
[0122]
If it is desired to re-adjust the personalization of the vehicle actuator driving device 19, the re-adjustment can be performed. In this case, the same steps as <Step 8> of [When the driver gets on and off for the first time] may be performed.
[0123]
The other steps are the same as those in the case where the driver gets on and off for the first time, and thus the description is omitted.
[0124]
In this way, the driver 13 can safely drive the vehicle body 11 through <Step 1> to <Step 8>.
[0125]
The vehicle engine key device 102 according to the second embodiment uses registered face image data of the driver 13 registered in the face image data dictionary registration memory 107 in advance, and the other driver 13 gets off the vehicle. In this case, the face image data of the face image of the driver 13 may be newly registered in the dictionary. In this case, the steps from when the driver 13 gets on the board to when the driver 13 gets off are performed in the same manner as the steps in the first embodiment.
[0126]
Further, the face image data dictionary registration memory 107 of the vehicle engine key device 102 stores not only the face image data of the driver 13 but also personalized data k of a plurality of drivers 13 who have boarded the vehicle. , The image data signal b and the personalized data k unique to the plurality of drivers 13 are used. Therefore, personalization adjustment of each driver 13 can be performed in accordance with authentication of each driver 13.
[0127]
The vehicle engine key device 102 can be used not only for a vehicle but also as a key device for entering and leaving a building or a room or a key device used for authentication. In this case, the vehicle engine key device 102 can be handled as a single master key by the driver 13, so that the portability is good and the handling is easy.
[0128]
【The invention's effect】
According to the present invention, in a specific driver who drives a vehicle, the driver's favorite driving environment can be obtained in the vehicle main body, so that the driver can drive comfortably and at the same time, A drive control device for a vehicle that can contribute to safe driving can be provided.
[0129]
In addition, when a vehicle engine key device having a driver's face image data dictionary registration memory is applied, only a specific driver registered in advance can drive, and theft of the vehicle can be prevented. It is possible to provide a vehicle drive control device capable of preventing such a problem.
[Brief description of the drawings]
FIG. 1 is a schematic diagram showing a drive control device for a vehicle according to a first embodiment of the present invention.
FIG. 2 is a block diagram showing functions and means mounted on the vehicle drive control device according to the first embodiment of the present invention.
FIG. 3 is a diagram showing steps from when a driver gets on the vehicle drive control device to get off the vehicle according to the first embodiment of the present invention.
FIG. 4 is a diagram showing an outline of a vehicle drive control device according to a second embodiment of the present invention.
FIG. 5 is a block diagram showing functions and means mounted in a vehicle drive control device according to a second embodiment of the present invention.
FIG. 6 is a view showing steps from when a driver gets on a vehicle drive control device to get off the vehicle according to a second embodiment of the present invention.
FIG. 7 is a diagram showing an outline of a conventional vehicle drive control device.
[Explanation of symbols]
10 Vehicle drive control device
11 Vehicle body
11a Front machine room
11b Rear machine room
11c Vehicle door
11d car room
12 Vehicle control system
13 Driver
14 Face image processing system
15 Door open detection device
16 Vehicle drive system
17 Integrated control means
18 Vehicle drive device
18a Stop device
19 Vehicle actuator drive
19a Personalized data storage means
20 Alarm device
20a speaker device
21 imaging camera (driver image data acquisition means)
22 Handle operation unit
23 Face recognition device
25 face image processing means
26 Face direction determination device
27 Operation mode switching device
28 Face Image Data Recognition Program
29 Face image recognition unit
30 face image data dictionary registration unit
31 Dictionary data part for face direction determination
32 face direction determination program
100 Vehicle drive control device
101 face image processing system
102 Vehicle engine key device
103 face image processing means
104 face recognition device
105 face image data reading device
106 Vehicle engine key
106a Insert key
107 face image data dictionary registration memory
a Door open signal
b Image data signal
c Face image recognition data signal
d Registered face image data signal
e Face authentication signal
f Data signal for face direction determination
g abnormal face direction signal
h Vehicle drive system start permission signal
h1 Vehicle drive start permission signal
h2 Vehicle actuator device start permission signal
j Accident prevention signal
j1 Vehicle braking signal
j2 Warning signal
k personalized data

Claims (14)

A face image processing system for acquiring driver's face image data,
A vehicle control system for controlling the vehicle based on the driver's face image data obtained by the face image processing system,
The face image processing system, driver image data acquisition means installed in the vehicle,
A face recognition device for recognizing the driver's face acquired by the driver image data acquisition means,
A face orientation determining device that recognizes a driver's face in a state of being seated in a driver's seat and determines a face orientation by recognizing the face by the face recognition device;
A face image data dictionary registration unit that is provided in the face recognition device and stores driver's face image data in advance,
The vehicle control system outputs from the face recognition device when the driver's face image data obtained by the driver image data obtaining means matches the face image data stored in the face image data dictionary registration unit. A vehicle drive control device comprising: a vehicle drive unit that receives a vehicle drive system start permission signal and enables driving of a vehicle engine. The said face image processing system was equipped with the operation mode switching apparatus switched so that a face direction determination apparatus may operate, when a driver's face is recognized by a face recognition apparatus. 2. The drive control device for a vehicle according to claim 1. 2. The vehicle according to claim 1, wherein the face image processing system is provided so as to start upon receiving a door opening signal output from a door opening detecting device that operates when the vehicle door is opened. Drive control device. The drive control device for a vehicle according to claim 1, wherein the driver image data acquisition unit is an imaging camera that recognizes a driver's face. The face recognition device, based on an image data signal received from the vehicle control system, a face image recognition unit that recognizes a face image,
A face image data dictionary registration unit for storing in advance the face image data of the driver;
The face image data stored in the face image data dictionary registration unit is compared with the face image data recognized by the face image recognition unit, and the face image data for outputting a face authentication signal to the vehicle control system when they match with each other. The drive control device for a vehicle according to claim 1, further comprising a recognition program unit. The face direction determination device includes a face direction determination dictionary data section, and a vehicle drive system start permission signal to a vehicle control system when the face direction of the driver is determined to be normal by the face direction determination dictionary data section. 2. The drive control device for a vehicle according to claim 1, further comprising: a face direction determination program unit that outputs the program. 2. The face direction determination device according to claim 1, further comprising: a face direction determination program unit that outputs an accident prevention signal to a vehicle control system when the driver determines that the driver's face direction is abnormal. The drive control device for a vehicle according to any one of the preceding claims. 2. The face direction determining device according to claim 1, further comprising: a face direction determining program unit configured to output a warning signal to a vehicle control system when determining that the driver's face direction is abnormal. Vehicle drive control device. The drive control device for a vehicle according to claim 1, wherein the vehicle drive system includes a vehicle drive device that drives a vehicle engine. The vehicle drive control device according to claim 1, wherein the vehicle drive system includes a vehicle actuator device that maintains a driving environment of a driver. 11. The drive control device for a vehicle according to claim 10, wherein the vehicle actuator device includes personalization data storage means for storing personalization data of a driver in advance. The personalized data storage means stores at least one of a seat position, a mirror angle, a temperature setting level of a car air conditioner, a volume / sound quality of an audio device, and a channel / image quality of a video device which can be desired or adapted by a driver. The drive control device for a vehicle according to claim 11, wherein: A vehicle engine key device for starting the vehicle engine;
A face image processing system for acquiring driver's face image data,
A vehicle control system for controlling the vehicle based on the driver's face image data obtained by the face image processing system,
A face image data dictionary registration unit that is provided in the vehicle engine key device and that previously stores driver's face image data in the vehicle engine key;
The face image processing system, driver image data acquisition means installed in the vehicle,
A face recognition device for recognizing the driver's face acquired by the driver image data acquisition means,
A face orientation determining device that recognizes a driver's face in a state of being seated in a driver's seat and determines a face orientation by recognizing the face by the face recognition device;
When the vehicle engine key is inserted into the vehicle body side, the image processing apparatus further includes face image data reading means for reading face image data stored in the face image data dictionary registration unit,
The vehicle control system is configured to output a vehicle output from the face recognition device when the driver's face image data obtained by the driver image data obtaining unit matches the face image data stored in the face image data dictionary registration unit. A drive control device for a vehicle, comprising: vehicle drive means for receiving a drive system start permission signal and enabling a start of a vehicle engine. 14. The drive control device for a vehicle according to claim 13, wherein the vehicle engine key device includes a vehicle engine key and a face image data dictionary registration unit provided in the vehicle engine key.

Images