[go: up one dir, main page]

WO2018163552A1 - Dispositif, procédé et programme de commande de changement de mode de conduite - Google Patents

Dispositif, procédé et programme de commande de changement de mode de conduite Download PDF

Info

Publication number
WO2018163552A1
WO2018163552A1 PCT/JP2017/044488 JP2017044488W WO2018163552A1 WO 2018163552 A1 WO2018163552 A1 WO 2018163552A1 JP 2017044488 W JP2017044488 W JP 2017044488W WO 2018163552 A1 WO2018163552 A1 WO 2018163552A1
Authority
WO
WIPO (PCT)
Prior art keywords
driver
state
operation mode
determination
driving
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2017/044488
Other languages
English (en)
Japanese (ja)
Inventor
初美 青位
相澤　知禎
岡地　一喜
啓 菅原
充恵 鵜野
光司 滝沢
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Omron Corp
Original Assignee
Omron Corp
Omron Tateisi Electronics Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Omron Corp, Omron Tateisi Electronics Co filed Critical Omron Corp
Publication of WO2018163552A1 publication Critical patent/WO2018163552A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/12—Limiting control by the driver depending on vehicle state, e.g. interlocking means for the control input for preventing unsafe operation
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems

Definitions

  • the present invention relates to an operation mode switching control device, method and program for switching a vehicle operation mode between a manual operation mode and an automatic operation mode.
  • Autonomous driving mode includes, for example, navigation system information using the Global Positioning System (GPS), traffic information acquired by road-to-vehicle communication, and information on the surrounding monitoring system that monitors the position and movement of people and vehicles in the vicinity.
  • GPS Global Positioning System
  • the vehicle can be automatically driven by controlling a power unit, a steering device, a brake, and the like.
  • the automatic driving mode can be expected to reduce the burden on the driving operation of the driver and alleviate traffic congestion, it is practically difficult to automate all the driving operations from the start to the end of driving. For this reason, it is required to appropriately switch from the automatic operation mode to the manual operation mode.
  • a trigger for switching the automatic operation mode to the manual operation mode for example, there is a driving operation (hereinafter referred to as an override operation) by the driver during the automatic driving (see, for example, JP-A-2016-151815).
  • an override operation it is necessary to detect the state of the driver and determine that it is in a state where a manual driving operation is possible prior to switching.
  • the override operation as described above is usually an emergency operation that is consciously performed by the driver.
  • the driver's state is detected and determined prior to the switching even though the driver desires a quick switching. For this reason, it takes a long time to switch from the emergency operation to the manual operation mode, and there is a concern that the driving operation by the driver is delayed. In addition, the driver feels uneasy before switching to the manual operation mode, which is very undesirable.
  • This invention is intended to provide an operation mode switching control device, method, and program capable of shortening the time from the override operation to the manual operation mode.
  • a first aspect of the present invention is an operation mode switching control device for switching a vehicle operation mode from an automatic operation mode to a manual operation mode for monitoring a driver's state.
  • An acquisition unit that acquires sensing data representing the driver's state from a monitoring sensor, and whether or not the driver's state is in a state where a driving operation in the manual driving mode can be performed based on the acquired sensing data Is detected at an arbitrary time interval, and the override operation by the driver is detected based on a determination unit that holds the determination result and a detection signal output from an in-vehicle sensor that can detect the driving operation by the driver.
  • a switching signal for switching the automatic operation mode to the manual operation mode when the state of the driver is in a state where the operation operation by the manual operation mode can be performed based on a determination result corresponding to the state immediately before the bar ride operation is detected.
  • a switching signal output unit for outputting.
  • the automatic driving mode is changed to the manual driving mode when the driver is in a state where the driving operation can be performed in the manual driving mode based on a determination result corresponding immediately before the override operation is detected.
  • a switching signal for switching is output. For this reason, since it is not necessary to detect and determine the state of the driver after the override operation, the time until the switching signal from the override operation to the manual operation mode is output can be shortened.
  • the determination unit includes a concentration level detection unit and a concentration level determination unit, and the concentration level detection unit determines the concentration level of the driver with respect to driving based on the acquired sensing data. Whether or not the state of the driver is in a state where the driver can perform the driving operation in the manual driving mode based on the latest concentration degree detected by the detecting unit. The determination is made at every time interval.
  • the degree of concentration of the driver with respect to driving is periodically detected, and based on the detected latest degree of concentration, the driver's state is a driving operation in the manual driving mode. It is determined at each time interval whether or not it is in a state where it can be performed. For this reason, prior to switching, it is possible to check the determination result indicating whether or not the driver is in a state where the driver can perform the driving operation depending on whether or not the latest concentration of the driver is high.
  • the concentration determination unit executes the determination based on a plurality of past concentrations including the latest concentration detected by the concentration detection unit. It is.
  • the determination is executed based on a plurality of past concentrations including the detected latest concentration. For this reason, prior to the switching, it is possible to check a determination result indicating whether or not the driver is in a state where the driver can perform the driving operation according to a plurality of degrees of concentration in the past past of the driver.
  • the determination is executed by the concentration determination unit based on a tendency that the plurality of concentrations vary from the past to the present.
  • the determination is performed based on a tendency that the plurality of concentration levels fluctuate from the past to the present. Therefore, prior to switching, whether or not the driver is in a state where the driver can perform the driving operation based on a tendency that the plurality of degrees of concentration of the driver increase, substantially stabilize, or decrease from the past to the present. It is possible to confirm the determination result shown. For example, when the driver's concentration degree tends to increase or is almost stable, a determination result indicating that the driving operation can be performed can be confirmed. When the driver's concentration tends to decrease, a determination result indicating that the driver cannot perform the driving operation can be confirmed.
  • the determination unit includes an estimation unit and a state determination unit, the estimation unit estimates the driver's state based on the acquired sensing data, and the state determination unit. Thus, based on the state estimated by the estimation unit, it is determined at each time interval whether or not the driver is in a state where the driving operation can be performed in the manual driving mode.
  • the state of the driver is estimated, and it is determined at each time interval whether or not the estimated state of the driver is in a state where the driving operation in the manual driving mode can be performed. . For this reason, prior to switching, it is possible to confirm a determination result indicating whether or not the estimated state is in a state where a driving operation can be performed.
  • the state determination unit executes the determination based on a tendency that the estimated state varies from the past to the present.
  • the determination is executed based on a tendency that the estimated state varies from the past to the present. For this reason, prior to switching, the driver's state indicates whether or not the driver's state is ready for driving based on the tendency of the driver's state to change from a certain state to a state suitable for driving from the past to the present.
  • the determination result can be confirmed. For example, when the driver's state tends to approach a state suitable for driving or is generally stable in a state suitable for driving, the determination result indicating that the driver can perform a driving operation can be confirmed.
  • the driver's state tends to approach a state unsuitable for driving or tends to be substantially stable in a state unsuitable for driving, it is possible to confirm the determination result that the driver is not in a state capable of performing a driving operation.
  • the determination unit further includes an adjustment unit, and the adjustment unit adjusts the time interval based on the tendency.
  • the time interval of the determination by the determination unit is adjusted based on the tendency that the driver's concentration or state varies. For this reason, for example, when there is a tendency to change so as to obtain a determination result indicating that the driving operation in the manual operation mode can be performed, the determination time interval is adjusted to be longer. On the other hand, for example, when there is a tendency to fluctuate so that a determination result indicating that the driving operation in the manual operation mode cannot be performed is obtained, the determination time interval is adjusted to be short.
  • an operation mode switching control device, method, and program capable of shortening the time from the override operation to the manual operation mode.
  • FIG. 1 is a diagram showing an overall configuration of an automatic operation control system including an operation mode switching control device according to a first embodiment of the present invention.
  • FIG. 2 is a block diagram showing a functional configuration of the operation mode switching control apparatus according to the first embodiment of the present invention.
  • FIG. 3 is a flowchart showing the procedure and control contents of the operation mode switching control by the operation mode switching control device shown in FIG.
  • FIG. 4 is a flowchart showing the procedure for determining whether or not manual operation is possible and the control content in the flow shown in FIG.
  • FIG. 5 is a flowchart showing another procedure and control contents of the flow shown in FIG.
  • FIG. 6 is a flowchart showing the procedure and control contents of a specific example of the flow shown in FIG. FIG.
  • FIG. 7 is a flowchart showing the procedure and control contents of a further specific example of the flow shown in FIG.
  • FIG. 8 is a flowchart showing a procedure for determining whether or not manual operation is possible by the operation mode switching control device according to the second embodiment of the present invention and the control contents.
  • FIG. 9 is a flowchart showing the procedure and control contents of a specific example of the flow shown in FIG.
  • FIG. 10 is a flowchart showing a procedure and control contents of a further specific example of the flow shown in FIG.
  • FIG. 1 is a diagram showing an overall configuration of an automatic operation control system including an operation mode switching control device according to a first embodiment of the present invention.
  • This automatic driving control system is mounted on a vehicle 1 such as a passenger car.
  • the vehicle 1 includes, as basic equipment, a power unit 2 including a power source and a transmission, and a steering device 3 equipped with a steering wheel 4. Moreover, the vehicle 1 has a manual operation mode and an automatic operation mode as operation modes. An engine and / or a motor is used as the power source.
  • the manual driving mode is a mode in which the vehicle 1 is driven mainly by a driver's manual driving operation, for example.
  • the manual operation mode includes, for example, an operation mode for driving the vehicle based only on the driver's driving operation, and an operation mode for performing driving operation support control for supporting the driving operation of the driver while mainly driving the driver's driving operation. Is included.
  • the driving operation support control assists the steering torque so that the driver's steering becomes an appropriate steering amount based on the curvature of the curve when the vehicle 1 is traveling on the curve, for example.
  • the driving operation support control includes control for assisting a driver's accelerator operation (for example, operation of an accelerator pedal) or brake operation (for example, operation of a brake pedal), manual steering (manual operation of steering), and manual speed adjustment (speed). Adjustment manual operation).
  • a driver's accelerator operation for example, operation of an accelerator pedal
  • brake operation for example, operation of a brake pedal
  • manual steering manual operation of steering
  • speed manual speed adjustment
  • Adjustment manual operation In manual steering, the vehicle 1 is steered mainly by the driver's operation of the steering wheel 4.
  • the speed of the vehicle is adjusted mainly by the driver's accelerator operation or brake operation.
  • the driving operation support control does not include control for forcibly intervening in the driving operation of the driver and automatically driving the vehicle.
  • the driving operation of the driver is reflected in the driving of the vehicle within a preset allowable range, but forcibly intervenes in the driving of the vehicle under certain conditions (for example, deviation from the lane of the vehicle). Control to do is not included.
  • the automatic operation mode is a mode that realizes an operation state in which the vehicle automatically travels along the road on which the vehicle travels, for example.
  • the automatic driving mode includes, for example, a driving state in which the vehicle automatically travels toward a preset destination without driving by the driver.
  • the automatic driving mode does not necessarily need to automatically perform all the control of the vehicle, and includes a driving state in which the driving operation of the driver is reflected in the traveling of the vehicle within a preset allowable range. That is, the automatic driving mode includes control for forcibly intervening in driving of the vehicle under certain conditions, while reflecting the driving operation of the driver in driving of the vehicle within a preset allowable range.
  • the automatic operation control device 5 performs operation control in the automatic operation mode.
  • the automatic driving control device 5 acquires sensing data from the steering sensor 11, the accelerator pedal sensor 12, the brake pedal sensor 13, the GPS receiver 14, the gyro sensor 15, and the vehicle speed sensor 16, respectively.
  • the automatic driving control device 5 monitors these sensing data, route information generated by a navigation system (not shown), traffic information acquired by road-to-vehicle communication, and the positions and movements of surrounding people and vehicles.
  • the travel of the vehicle 1 is automatically controlled based on information obtained by the monitoring system.
  • Automatic control includes, for example, automatic steering (automatic steering operation) and automatic speed adjustment (automatic driving of speed).
  • Automatic steering is an operating state in which the steering device 3 is automatically controlled.
  • Automatic steering includes Lane Keeping Assist (LKA).
  • LKA Lane Keeping Assist
  • the LKA automatically controls the steering device 3 so that the vehicle 1 does not deviate from the traveling lane even when the driver does not perform the steering operation.
  • the driver's steering operation may be reflected in the steering of the vehicle in a range where the vehicle 1 does not deviate from the travel lane (allowable range).
  • automatic steering is not limited to LKA.
  • Automatic speed adjustment is an operating state in which the speed of the vehicle 1 is automatically controlled.
  • Automatic speed adjustment includes Adaptive Cruise Control (ACC). For example, when there is no preceding vehicle ahead of the vehicle 1, ACC performs constant speed control that causes the vehicle 1 to travel at a constant speed at a preset speed, and when the preceding vehicle exists ahead of the vehicle 1. Is a follow-up control that adjusts the vehicle speed of the vehicle 1 in accordance with the inter-vehicle distance from the preceding vehicle.
  • the automatic operation control device 5 decelerates the vehicle 1 according to the driver's brake operation (for example, operation of the brake pedal) even when ACC is being executed.
  • the automatic operation control device 5 can perform the driver's accelerator operation (for example, accelerator) up to a preset maximum allowable speed (for example, the maximum speed legally determined on the traveling road) even during execution of ACC.
  • the vehicle can be accelerated according to the pedal operation.
  • the automatic speed adjustment is not limited to ACC, but also includes Cruise Control (CC) that performs only constant speed control.
  • CC Cruise Control
  • the automatic operation control system of this embodiment is an operation mode switching control device 6 and a driver camera 7 as a first monitoring sensor as devices for switching between the manual operation mode and the automatic operation mode. And a torque sensor 8 as a second monitoring sensor and an alarm generator 9.
  • the driver camera 7 is installed, for example, at a position in front of the driver as on the dashboard, and images the driver and outputs a video signal thereof to the driving mode switching control device 6.
  • the torque sensor 8 detects torque generated when the driver operates the steering wheel 4, and outputs a detection signal to the operation mode switching control device 6.
  • the alarm generator 9 includes a speaker and a display. The alarm generator 9 outputs the voice signal of the message output from the operation mode switching control device 6 from the speaker and displays the display signal of the message on the display.
  • the operation mode switching control device 6 controls the switching of the operation modes as a whole, and is configured as follows.
  • FIG. 2 is a block diagram showing the functional configuration.
  • the operation mode switching control device 6 includes a control unit 61, an input / output interface unit 62, and a storage unit 63.
  • the input / output interface unit 62 receives the video signal and the torque detection signal output from the driver camera 7 and the torque sensor 8, respectively, and converts them into digital data. Similarly, the input / output interface unit 62 receives detection signals as sensing data output from the steering sensor 11, the accelerator pedal sensor 12, and the brake pedal sensor 13, and converts them into digital data. The input / output interface unit 62 converts the message output from the control unit 61 into an audio signal and a display signal, and outputs them to the alarm generator 9. Further, the input / output interface unit 62 outputs the switching signal output from the control unit 61 to the automatic operation control device 5.
  • the storage unit 63 uses, as a storage medium, a non-volatile memory that can be written and read at any time, such as, for example, Solid State Drive (SSD) or Hard Disk Drive (HDD).
  • the storage unit 63 includes a driver monitoring video storage unit 631 and a determination result storage unit 632 as storage areas used for carrying out this embodiment.
  • the control unit 61 has a central processing unit (CPU) and a program memory that constitute a computer.
  • the control unit 61 includes a driver monitoring video acquisition unit 611, a determination unit 612, an operation detection unit 613, and a switching signal output unit 614 as control functions necessary for carrying out this embodiment. Each of these control functions is realized by causing the CPU to execute a program stored in the program memory.
  • the driver monitoring video acquisition unit 611 receives digital data (driver monitoring video data) of the driver video signal output from the driver camera 7 from the input / output interface unit 62, and stores the acquired driver monitoring video data in the storage unit 63. Are stored in the driver monitoring video storage unit 631.
  • the determination unit 612 reads the driver monitoring video data from the driver monitoring video storage unit 631 at a preset time interval. Then, each time the driver monitoring video data is read, the determination unit 612 performs a process of determining whether or not the driver can manually perform a driving operation based on the driver monitoring video data. For example, the determination unit 612 determines whether or not the driver is in a sleep state by checking whether or not the driver has closed his / her eyes. Then, the determination unit 612 stores information indicating the determination result in the determination result storage unit 632 in association with a time stamp indicating the determination timing.
  • the determination unit 612 may execute the following processes.
  • (A1) Concentration detection processing for periodically detecting the driver's concentration on driving based on sensing data acquired from the driver camera 7 (via the input / output interface unit 62 and the driver monitoring video storage unit 631). .
  • the determination unit 612 may acquire sensing data from the driver camera 7 without using the input / output interface unit 62 and the driver monitoring video storage unit 631. The same applies to the following embodiments.
  • (A2) Concentration that determines at every time interval whether or not the driver is in a state where the driver can perform the driving operation in the manual operation mode based on the latest concentration detected by the concentration detection process of (A1) above. Degree determination process.
  • the time interval of the concentration level determination process and the detection cycle of the concentration level detection process may be the same or different.
  • the time interval of the concentration level determination process is preferably longer than the detection cycle of the concentration level detection process from the viewpoint of enabling determination based on a plurality of concentration levels.
  • the concentration determination process of (A2) is performed based on a plurality of past concentrations including the latest concentration detected by the concentration detection process of (A2a) (A1). Also good.
  • the determination may be executed based on a tendency that the concentration levels fluctuate from the past to the present.
  • the driver's state may be predicted based on the tendency (A2c), and the determination may be executed based on the prediction result. It is preferable that the prediction here is directed to the state of the driver at the next determination timing from the viewpoint of improving the prediction accuracy.
  • the concentration determination process of (A2a), (A2b), or (A2c) above is a driver-specific process based on multiple concentrations for each driver because there are individual differences in the human condition. May be executed as
  • each driver can be identified by face authentication from sensing data stored in the driver monitoring video storage unit 631.
  • the determination unit 612 may further execute an adjustment process for adjusting the time interval based on the tendency of (A2b) or (A2c).
  • the determination unit 612 may include a concentration level detection unit that executes the concentration level detection process, a concentration level determination unit that executes the concentration level determination process, and an adjustment unit that executes the adjustment process. Of course, it may be distributed in each part.
  • the operation detection unit 613 detects an emergency override operation or a non-emergency override operation by the driver based on a detection signal output from the torque sensor 8 as an in-vehicle sensor capable of detecting a driving operation by the driver.
  • a detection signal output from the torque sensor 8 as an in-vehicle sensor capable of detecting a driving operation by the driver.
  • the steering sensor 11, the accelerator pedal sensor 12, and the brake pedal sensor 13 can be used suitably.
  • the switching signal output unit 614 determines the driver based on the determination result corresponding immediately before the override operation is detected among the determination results held by the determination unit 612. Is in a state where the operation operation in the manual operation mode can be performed, a switching signal for switching the automatic operation mode to the manual operation mode is output to the automatic operation control device 5.
  • FIG. 3 is a flowchart showing the overall control procedure and control contents.
  • the driver camera 7 is activated, and continuously captures a predetermined range including the driver's face and outputs the video signal.
  • the operation mode switching control device 6 first outputs the digital data (driver monitoring video data) of the video signal output from the driver camera 7 in step S1 to the input / output interface unit.
  • the captured driver monitoring video data is stored in the driver monitoring video storage unit 631 of the storage unit 63 in step S2.
  • the imaging of the driver may be intermittently performed at a period shorter than a determination period of a determination unit 612 described later.
  • the driver camera 7 or the input / output interface unit 62 may encode the video signal according to a predetermined encoding method. In this way, it is possible to save the storage capacity of the driver monitoring video storage unit 631 by reducing the information amount of the monitoring video data.
  • step S10 the driver monitoring video data is read from the driver monitoring video storage unit 631. Then, from each of the read driver monitoring video data, it is determined as shown in the following steps S11 to S12 whether or not the driver can perform a driving operation manually.
  • FIG. 4 is a flowchart showing the control procedure and control contents.
  • the determination unit 612 periodically detects the driver's concentration on driving based on the sensing data stored in the driver monitoring video storage unit 631 in step S11. For example, based on the driver monitoring video data, the eye open state of the driver's eyes, the frequency of blinking, or eye movements are detected to recognize the driver's arousal level.
  • This arousal level is an example of the degree of concentration and is represented by a numerical value within a range of 0 to 100%.
  • the degree of concentration is not limited to a numerical value within the range of 0 to 100%. For example, “1” is set when the driver's line-of-sight direction is within a predetermined range, and “0” is set when the driver is not within the predetermined range. For example, a value (flag) of “1” or “0” may be used.
  • step S12 the determination unit 612 determines, based on the latest concentration level detected in step S11, whether or not the driver is in a state where the driving operation in the manual operation mode can be performed at every time interval. . For example, it is determined whether or not the driver can manually perform a driving operation by comparing the recognized arousal level with a threshold value. Thus, the process of step S10 is completed.
  • the determination unit 612 associates the information indicating the determination result with information indicating the determination timing, for example, time stamp information in step S4.
  • the determination result is stored in the determination result storage unit 632.
  • the determination part 612 adjusts the time interval which performs determination of step S10 by step S5 based on the concentration degree detected by step S11. For example, the determination unit 612 adjusts the time interval based on a tendency that a plurality of concentrations vary from the past to the present. Note that step S5 is not limited to after step S4, and may be executed at any time or may be omitted.
  • step S6 The operation mode switching control device 6 subsequently executes step S6 under the control of the operation detection unit 613.
  • the torque sensor 8 as an in-vehicle sensor outputs a detection signal according to the driving operation by the driver.
  • the driving mode switching control device 6 detects an override operation by the driver based on a detection signal corresponding to the driving operation.
  • step S6 when an override operation is not detected, the process returns to step S1, and when an override operation is detected, the process proceeds to step S7.
  • the operation mode switching control device 6 determines the determination result by the determination unit 612 immediately before the override operation is detected under the control of the switching signal output unit 614. Reading from the result storage unit 632.
  • step S7 the switching signal output unit 614 determines whether or not the read determination result indicates that a manual driving operation is possible. If not, the process returns to step S1.
  • the switching signal output unit 614 outputs a switching signal for switching the automatic operation mode to the manual operation mode to the automatic operation control device 5 (step S8).
  • the automatic driving control device 5 ends the automatic driving mode, and thereafter, driving control according to the manual operation of the driver is performed.
  • the driver is determined at any time interval whether or not the driver is in a state where the driving operation can be performed in the manual driving mode.
  • an override operation is detected by the operation detection unit 613
  • automatic driving is performed when the driver is in a state where the driver can perform a driving operation in the manual driving mode based on a corresponding determination result immediately before the override operation is detected.
  • a switching signal for switching the mode to the manual operation mode is output.
  • time for detecting and determining the state of the driver after the override operation becomes unnecessary. For this reason, the time until the switching signal from the override operation to the manual operation mode is output can be shortened.
  • the driver's concentration on driving is periodically detected, and based on the latest detected concentration, it is determined at each time interval whether or not the driver is in a state where the driving operation can be performed in the manual operation mode. Is done. For this reason, prior to switching, it is possible to check the determination result indicating whether or not the driver is in a state where the driver can perform the driving operation depending on whether or not the latest concentration of the driver is high.
  • the determination time interval by the determination unit 612 is adjusted based on the tendency of the driver's concentration to vary. For this reason, for example, when it tends to fluctuate toward a state in which the driving operation in the manual operation mode can be performed, the determination time interval is adjusted to be longer. On the other hand, for example, when there is a tendency to fluctuate toward a state where the driving operation in the manual operation mode cannot be performed, the determination time interval is adjusted to be short. Therefore, the determination time interval can be appropriately adjusted according to the tendency of the driver's concentration to vary.
  • the present invention is not limited to the above embodiment.
  • the flowchart shown in FIG. 4 may be modified as shown in FIG. That is, the determination unit 612 determines whether or not the above-described manual driving operation is possible based on a plurality of past concentrations including the latest concentration detected in step S11 instead of step S12. (Step S12a). In this case, prior to the switching, it is possible to confirm a determination result indicating whether or not the driver is in a state where the driver can perform the driving operation according to a plurality of degrees of concentration in the past past of the driver.
  • the flowchart shown in FIG. 5 may be modified as shown in FIG. That is, instead of step S12a, the determination unit 612 determines whether or not the above-described manual driving operation is possible based on a tendency that a plurality of concentrations vary from the past to the present (step S12b). .
  • the driver's state indicates whether or not the driver is in a state where the driver can perform the driving operation based on the tendency that the driver's concentration is increasing, substantially stable, or decreasing from the past to the present.
  • the determination result can be confirmed. For example, when the driver's concentration degree tends to increase or is almost stable, a determination result indicating that the driving operation can be performed can be confirmed. When the driver's concentration tends to decrease, a determination result indicating that the driver cannot perform the driving operation can be confirmed.
  • step S12b the determination unit 612 predicts the driver's state based on a tendency that a plurality of concentrations vary (step S12c-1), and based on the prediction result, the manual driving operation described above is performed. A determination is made as to whether or not this is possible (step S12c-2). In this case, prior to switching, it is possible to confirm a determination result indicating whether or not the predicted state is in a state where a driving operation can be performed.
  • the second embodiment is another specific example of the determination unit 612 described above, and the determination unit 612 uses the estimated driver state as shown in FIG. Yes.
  • “driver state” is described as “driver state”.
  • the determination unit 612 reads the driver monitoring video data from the driver monitoring video storage unit 631 at a preset time interval, and the driver manually operates the driver based on the driver monitoring video data. A process of determining whether or not it is ready to be performed is performed.
  • the determination unit 612 may execute the following processes instead of the processes (A1), (A2), (A2a), (A2b), and (A2c).
  • Each process described below may be executed as a driver-specific process based on past data for each driver because there are individual differences in the human state.
  • Each driver can be identified by face authentication as described above.
  • (B1) Estimation process for estimating the driver's state based on the sensing data acquired from the driver camera 7 (via the input / output interface unit 62 and the driver monitoring video storage unit 631).
  • the state of emotion such as joy, anger, grief, comfort, and calm of the driver is estimated based on the driver monitoring video data.
  • Such a determination unit 612 can be implemented using, for example, Artificial Intelligence (AI) that can estimate human emotions.
  • AI Artificial Intelligence
  • (B2) ⁇ A state determination process that determines, based on the state estimated by the estimation process in (B1) above, whether or not the driver is in a state where the driving operation can be performed in the manual operation mode.
  • this state determination process for example, it is determined whether or not the driver is in a state where the driver can manually perform a driving operation by comparing the estimated emotion with a preset condition.
  • the set condition for example, when the estimated emotional state is joy, grief, comfort, or calm, it may be determined that manual driving is possible. Alternatively, as the set condition, for example, it may be determined that manual driving is not possible when the estimated emotional state is anger.
  • the state determination process (B2) may be performed based on a tendency that the estimated state changes from the past to the present.
  • the driver state may be predicted based on the trend (B2c) and the determination may be executed based on the prediction result. It is preferable that the prediction here is directed to the state of the driver at the next determination timing from the viewpoint of improving the prediction accuracy.
  • the determination unit 612 may further execute an adjustment unit that adjusts the time interval based on the tendency of (B2b) or (B2c).
  • the determination unit 612 may include an estimation unit that executes the estimation process, a state determination unit that executes the state determination process, and an adjustment unit that executes the adjustment process. May be implemented.
  • the driving mode switching control device 6 reads the driver monitoring video data from the driver monitoring video storage unit 631 in step S10 every time a predetermined time is determined in step S3 under the control of the determination unit 612. . Then, the determination unit 612 determines, from each of the read driver monitoring video data, whether or not the driver can manually perform the driving operation as shown in steps S15 to S16 below.
  • FIG. 8 is a flowchart showing the control procedure and control contents.
  • the determination unit 612 estimates the driver's state based on the sensing data stored in the driver monitoring video storage unit 631 in step S15. For example, the state of emotion such as joy, anger, grief, comfort, or calm of the driver is estimated.
  • step S16 the determination unit 612 determines, based on the state estimated in step S15, whether or not the driver is in a state where the driving operation in the manual operation mode can be performed at every time interval. For example, when the estimated emotional state is joy, sadness, comfort, or calm, it is determined that manual driving is possible. If the estimated emotional state is anger, it is determined that manual driving is not possible. Thus, the process of step S10 is completed.
  • the determination unit 612 associates the information indicating the determination result with information indicating the determination timing, for example, time stamp information in step S4.
  • the determination result is stored in the determination result storage unit 632.
  • the determination part 612 adjusts the time interval which performs determination of step S10 by step S5 based on the driver state estimated by step S15. For example, the determination unit 612 adjusts the time interval based on a tendency that a plurality of driver states fluctuate from the past to the present. Note that step S5 is not limited to after step S4, and may be executed at any time or may be omitted.
  • steps S1 to S8 are executed as in the first embodiment. For this reason, as described above, it is not necessary to detect and determine the state of the driver after the override operation. Therefore, it is possible to shorten the time until the switching signal from the override operation to the manual operation mode is output. . Accordingly, it is possible to reduce the time from the override operation to the manual operation mode.
  • step S10 the state of the driver is estimated, and it is determined for each time interval whether the estimated state of the driver is in a state where the driving operation in the manual operation mode can be performed. For this reason, prior to switching, it is possible to confirm a determination result indicating whether or not the estimated state is in a state where a driving operation can be performed.
  • the present invention is not limited to the above embodiment.
  • the flowchart shown in FIG. 8 may be modified as shown in FIG. That is, the determination unit 612 determines whether or not the above-described manual driving operation is possible based on a tendency that the estimated state varies from the past to the present instead of step S16 (step S16b). .
  • a determination indicating whether or not the driver is in a state where the driver can perform a driving operation based on a tendency that the driver's state changes from any state to a state suitable for driving from the past to the present. The result can be confirmed.
  • the driver's state tends to approach a state suitable for driving or a state that is substantially stable in a state suitable for driving, such as the tendency of an angry emotional state to approach a calm emotional state Can be confirmed.
  • a state suitable for driving or a state that is substantially stable in a state suitable for driving such as the tendency of an angry emotional state to approach a calm emotional state.
  • the driver's state tends to approach a state unsuitable for driving or tends to be substantially stable in a state unsuitable for driving, it is possible to confirm the determination result that the driver is not in a state capable of performing a driving operation.
  • the flowchart shown in FIG. 9 may be modified as shown in FIG. That is, the determination unit 612 predicts the driver's state based on the tendency of the estimated state to change instead of step S16b (step S16c-1), and based on the prediction result, the above-described manual driving operation is performed. It is determined whether or not it is possible (step S16c-2). In this case, prior to switching, it is possible to confirm a determination result indicating whether or not the predicted state is in a state where a driving operation can be performed.
  • Still other embodiments include, for example, the following.
  • the case where the video signal including the driver's face obtained by the driver camera 7 is used as the means for determining the driver's state has been described as an example. However, it is not limited to that. For example, based on a biological signal obtained by a biological sensor, for example, a pulse wave signal or a heartbeat signal of a driver detected by a pulse wave sensor or a heartbeat sensor, or a signal representing vertical movement of the diaphragm detected by a pressure sensor, You may make it determine a driver
  • the steering torque of the driver's steering operation detected by the torque sensor 8 is used, and the driver performs a manual driving operation when a torque exceeding a predetermined value is detected. It may be determined that it is in a state where it can be performed.
  • an operation input means that allows the driver to input that manual driving operation is possible, such as a push button provided on the steering wheel 4 or a soft button provided on the touch panel. May be used to determine the state of the driver.
  • the vehicle type, the function of the automatic operation control device, the control function and control procedure of the operation mode switching control device, and the control contents can be variously modified and implemented without departing from the gist of the present invention.
  • the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the scope of the invention in the implementation stage.
  • the embodiments may be appropriately combined as much as possible, and in that case, the combined effect can be obtained.
  • various inventions can be extracted by an appropriate combination of a plurality of constituent elements disclosed in the one embodiment.
  • An operation mode switching control device for switching a vehicle operation mode from an automatic operation mode to a manual operation mode, A memory for storing a determination result obtained by determining whether or not the driver's state is in a state where the driving operation in the manual driving mode can be performed; And at least one hardware processor connected to the memory, The at least one hardware processor comprises: From the monitoring sensor for monitoring the state of the driver, obtaining sensing data representing the state of the driver, Based on the acquired sensing data, it is determined at an arbitrary time interval whether or not the driver's state is in a state where the driving operation in the manual driving mode can be performed, and the determination result is held in the memory, Based on a detection signal output from an in-vehicle sensor capable of detecting a driving operation by the driver, an override operation by the driver is detected, When the override operation is detected, based on the determination result corresponding to immediately before the override operation
  • a switching signal output process for outputting a switching signal for switching the automatic driving mode to the manual driving mode when the driver

Landscapes

  • Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Traffic Control Systems (AREA)
  • Control Of Driving Devices And Active Controlling Of Vehicle (AREA)

Abstract

L'objectif de la présente invention est de réduire la durée entre une opération de prise de contrôle et la réalisation du changement, et l'invention adopte les mesures suivantes pour atteindre cet objectif. Ce dispositif de commande de changement de mode de conduite détermine, à un intervalle de temps défini arbitrairement, si le conducteur est dans un état dans lequel il est capable d'effectuer une opération de conduite dans un mode de conduite manuelle. Lorsqu'une opération de prise de contrôle est détectée par une unité de détection d'opération (613), le dispositif de commande de changement de mode de conduite fournit en sortie un signal de changement qui passe du mode de conduite automatique au mode de conduite manuelle si l'état du conducteur est tel qu'il est capable d'effectuer une opération de conduite en mode de conduite manuelle, en fonction de résultats de détermination correspondant à l'instant immédiatement avant l'instant où l'opération de prise de contrôle a été détectée.
PCT/JP2017/044488 2017-03-09 2017-12-12 Dispositif, procédé et programme de commande de changement de mode de conduite Ceased WO2018163552A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2017045222A JP6627810B2 (ja) 2017-03-09 2017-03-09 運転モード切替制御装置、方法およびプログラム
JP2017-045222 2017-03-09

Publications (1)

Publication Number Publication Date
WO2018163552A1 true WO2018163552A1 (fr) 2018-09-13

Family

ID=63447476

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/044488 Ceased WO2018163552A1 (fr) 2017-03-09 2017-12-12 Dispositif, procédé et programme de commande de changement de mode de conduite

Country Status (2)

Country Link
JP (1) JP6627810B2 (fr)
WO (1) WO2018163552A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112147982A (zh) * 2020-09-25 2020-12-29 上海汽车集团股份有限公司 一种自动驾驶汽车的人工接管测试方法、装置和测试系统

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7076357B2 (ja) * 2018-10-30 2022-05-27 本田技研工業株式会社 感情推定装置
JP7358956B2 (ja) * 2019-12-10 2023-10-11 沖電気工業株式会社 自動取引装置
JP7587107B2 (ja) * 2020-07-29 2024-11-20 テイ・エス テック株式会社 車内環境設定装置、車両および車内環境設定方法
US20240034324A1 (en) * 2022-07-29 2024-02-01 Subaru Corporation Vehicle

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005173636A (ja) * 2003-12-05 2005-06-30 Fujitsu Ten Ltd 居眠り検出方法および装置
WO2014147828A1 (fr) * 2013-03-22 2014-09-25 トヨタ自動車株式会社 Dispositif d'assistance de conduite, procédé d'assistance de conduite, dispositif de fourniture d'informations, procédé de fourniture d'informations, dispositif de navigation et procédé de navigation
WO2016132848A1 (fr) * 2015-02-16 2016-08-25 株式会社デンソー Dispositif d'aide à la conduite et procédé d'aide à la conduite

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6287728B2 (ja) * 2014-09-25 2018-03-07 株式会社デンソー 車載システム、車両制御装置、および車両制御装置用のプログラム

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005173636A (ja) * 2003-12-05 2005-06-30 Fujitsu Ten Ltd 居眠り検出方法および装置
WO2014147828A1 (fr) * 2013-03-22 2014-09-25 トヨタ自動車株式会社 Dispositif d'assistance de conduite, procédé d'assistance de conduite, dispositif de fourniture d'informations, procédé de fourniture d'informations, dispositif de navigation et procédé de navigation
WO2016132848A1 (fr) * 2015-02-16 2016-08-25 株式会社デンソー Dispositif d'aide à la conduite et procédé d'aide à la conduite

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112147982A (zh) * 2020-09-25 2020-12-29 上海汽车集团股份有限公司 一种自动驾驶汽车的人工接管测试方法、装置和测试系统

Also Published As

Publication number Publication date
JP2018151684A (ja) 2018-09-27
JP6627810B2 (ja) 2020-01-08

Similar Documents

Publication Publication Date Title
JP6447647B2 (ja) 運転モード切替制御装置、方法およびプログラム
US20190227547A1 (en) Drive mode switch controller, method, and program
JP6690581B2 (ja) 運転モード切替制御装置、方法およびプログラム
WO2018163552A1 (fr) Dispositif, procédé et programme de commande de changement de mode de conduite
US20200017123A1 (en) Drive mode switch controller, method, and program
CN109843690B (zh) 驾驶模式切换控制装置、系统以及方法
WO2018168051A1 (fr) Dispositif de détermination de degré de concentration, procédé de détermination de degré de concentration et programme de détermination de degré de concentration
JP2020187456A (ja) 走行情報記録装置、走行情報記録方法及び走行情報記録プログラム
WO2018163474A1 (fr) Dispositif, procédé et programme de commande de commutation de mode de conduite
US9886034B2 (en) Vehicle control based on connectivity of a portable device
US11491993B2 (en) Information processing system, program, and control method
US20200023863A1 (en) Concentration degree determination device, concentration degree determination method, and program for determining concentration degree
JP2020091524A (ja) 情報処理システム、プログラム、及び制御方法
JP6648722B2 (ja) 故障判定装置、方法およびプログラム
JP6631564B2 (ja) 自動運転車両監視装置、方法およびプログラム
JP2017220171A (ja) 安全運転支援装置及び安全運転支援プログラム
JP2020125089A (ja) 車両制御装置
JP2018149862A (ja) 運転モード切替制御装置、方法およびプログラム
WO2018168048A1 (fr) Dispositif de détermination de degré de concentration, procédé de détermination de degré de concentration, et programme permettant de déterminer un degré de concentration
WO2018168046A1 (fr) Dispositif de détermination de niveau de concentration, procédé de détermination de niveau de concentration, et programme de détermination de niveau de concentration
WO2018163536A1 (fr) Dispositif, procédé et programme de support de récupération d'état de corps de conducteur
US12198449B2 (en) Driving assistance apparatus, computer program, and recording medium storing computer program
JP2024072394A (ja) 運転支援装置及び運転支援システム。

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17899968

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17899968

Country of ref document: EP

Kind code of ref document: A1