US20180345909A1

US20180345909A1 - Vehicle with wearable for identifying one or more vehicle occupants

Info

Publication number: US20180345909A1
Application number: US16/040,799
Authority: US
Inventors: Peter Vincent Boesen
Original assignee: Bragi GmbH
Current assignee: Bragi GmbH
Priority date: 2015-11-27
Filing date: 2018-07-20
Publication date: 2018-12-06
Also published as: EP3416554A1; US20170151930A1; WO2017089537A1; US10040423B2

Abstract

A system includes a vehicle, the vehicle comprising a control system and a wireless transceiver operatively connected to the control system. The control system is configured to wirelessly communicate with a wearable device worn by a user using the wireless transceiver. The control system is configured to receive biometric input from one or more sensors of the wearable device to identify an occupant of the vehicle or individual proximate the vehicle. The wearable device may be a wearable earpiece with one or more sensors.

Description

PRIORITY STATEMENT

This application is continuation of U.S. patent application Ser. No. 15/356,839 filed on Nov. 21, 2016, which claims priority to U.S. Provisional Patent Application No. 62/260,436, filed on Nov. 27, 2015, all of which are titled “Vehicle with Wearable for Identifying One or More Vehicle Occupants” and all of which are hereby incorporated by reference in their entirety.

FIELD OF THE INVENTION

The illustrative embodiments relate to vehicles. More particularly, but not exclusively, the illustrative embodiments relate to a vehicle which integrates with or communicates with a wearable device such as an earpiece or a set of earpieces to identify one or more vehicle occupants.

BACKGROUND

Vehicles may come with various types of electronics packages. These packages may be standard or optional and include electronics associated with communications or entertainment. However, there are various problems and deficiencies with such offerings. What is needed are vehicles with improved electronics options which create, improve, or enhance safety and overall experience of vehicles.

SUMMARY

Therefore, it is a primary object, feature, or advantage of the illustrative embodiments to improve over the state of the art.
It is another object, feature, or advantage of the illustrative embodiments to communicate between vehicle systems and wearable devices.
It is a further object, feature, or advantage of the illustrative embodiments to use wearable devices to increase safety in vehicles.
It is a still further object, feature, or advantage of the illustrative embodiments to allow a user to control one or more functions of a vehicle using one or more wearable devices, such as wireless earpieces.
It is a still further object, feature, or advantage of the illustrative embodiments to allow a vehicle to identify a driver based on the presence of a wearable device.
It is a still further object, feature, or advantage of the illustrative embodiments to allow a vehicle to identify one or more passengers of a vehicle based on the presence of wearable devices.
Yet another object, feature, or advantage of the illustrative embodiments is to allow a vehicle to obtain biometric information about a driver or passenger using one or more wearable devices.
It is another object, feature, or advantage of the illustrative embodiments to enhance an existing vehicle through addition of a wearable device.
One or more of these and/or other objects, features, or advantages of the illustrative embodiments will become apparent from the specification and claims following. No single embodiment need provide every object, feature, or advantage. Different embodiments may have different objects, features, or advantages. Therefore, the present invention is not to be limited to or by an objects, features, or advantages stated herein.
According to one aspect a system includes a vehicle, the vehicle comprising a control system and a wireless transceiver operatively connected to the control system. The control system is configured to wirelessly communicate with a wearable device worn by a user using the wireless transceiver. The control system is configured to receive biometric input from one or more sensors of the wearable device to identify an occupant of the vehicle or individual proximate the vehicle.
According to another aspect a system includes a vehicle, the vehicle comprising a control system, a first wireless transceiver operatively connected to the control system, and a wearable device for being worn by a user, a second wireless transceiver disposed within the wearable device and configured to wirelessly communicate with the first wireless transceiver. The wearable device includes at least one sensor for obtaining biometric input. The wearable device is configured to identify a wearer of the wearable device using the biometric input and convey an identity of the wearer of the wearable device to the control system.
According to another aspect, a system includes a vehicle, the vehicle comprising a vehicle network with a plurality of devices in operative communication with the vehicle network and a wireless transceiver operatively connected to the vehicle network. The wireless transceiver is configured to wirelessly communicate with a wearable device worn by a user and after the user is identified, convey sensor data from the wearable device over the vehicle network to one or more of the plurality of devices.
According to yet another aspect a method includes obtaining sensor data at a wearable device, determining a user's identity based on the sensor data and if the user has appropriate access rights, communicating data or commands over a vehicle network to perform vehicle functions.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates one example of a vehicle which integrates with wearable technology.

FIG. 2 illustrates one example of a set of wearable devices in the form of earpieces.

FIG. 3 is a block diagram of one example of a wearable device in the form of an earpiece.

FIG. 4 illustrates a vehicle network or bus allowing different electronic modules to communicate with a wearable device.

FIG. 5 illustrates one example of a method.

DETAILED DESCRIPTION

Some of the most important factors in selecting a vehicle such as a car may be the technology available to enhance the experience. This may be of importance in certain vehicle segments, such as for luxury vehicles. Another important factor in selecting a vehicle may be the available safety features. According to various aspects, the illustrative embodiments allow for wearable devices including earpieces to enhance the experience of vehicles and according to some aspects, the illustrative embodiments allow for wearable devices, such as earpieces to enhance the overall safety of the vehicle. Therefore, it is expected the technology described herein will make any vehicle so equipped more desirable to customers, more satisfying to customers, and potentially more profitable for the vehicle manufacturer and the presence or absence of such technology may drive buying decisions of the consumer. Similarly, at least some of the various aspects may be added to existing vehicles as after-market accessories to improve the safety, accessibility, or experience of existing vehicles.
FIG. 1 illustrates one example of use of a wearable device in conjunction with a vehicle. As shown in FIG. 1 there is a vehicle 2. Although the vehicle 2 shown is a full-size sedan, it is contemplated the vehicle 2 may be of any number of types of cars, trucks, sport utility vehicles, vans, mini-vans, automotive vehicles, commercial vehicles, agricultural vehicles, construction vehicles, specialty vehicles, recreational vehicles, buses, motorcycles, aircraft, boats, ships, yachts, trains, spacecraft, or other types of vehicles. The vehicle 2 may be gas-powered, diesel powered, electric, fuel cell, hydrogen, solar-powered, or human-powered. The vehicle 2 may be actively operated by a driver or may be partially or completely autonomous or self-driving. The vehicle 2 may have vehicle control systems 40. The vehicle control systems 40 are systems which may include any number of mechanical and electromechanical subsystems.
As shown in FIG. 1, such systems may include a navigation system 42, an entertainment system 44, a vehicle security system 45, an audio system 46, a safety system 47, a communications system 48 preferably with a wireless transceiver, a driver assistance system 49, a passenger comfort system 50, and engine/transmission/chassis electronics systems 51. Of course, other examples of vehicle control sub-systems are contemplated. In addition, it is to be understood there may be overlap between some of these different vehicle systems and the presence or absence of these vehicle systems as well as other vehicle systems may depend upon the type of vehicle, the type of fuel or propulsion system, the size of the vehicle, and other factors and variables. All or portions of the vehicle control systems 40 may be integrated together or in separate locations of the vehicle 2.
In the automotive context, examples of the driver assistance system 49 may include one or more subsystems such as a lane assist system, autopilot, a speed assist system, a blind spot detection system, a park assist system, and an adaptive cruise control system. In the automotive context, examples of the passenger comfort system 50 may include one or more subsystems such as automatic climate control, electronic seat adjustment, automatic wipers, automatic headlamps, and automatic cooling. In the automotive context, examples of the safety system 47 may include active safety systems such as air bags, hill descent control, and an emergency brake assist system. Aspects of the navigation system 42, the entertainment system 44, the audio system 46, and the communications system 48 may be combined into an infotainment system.
One or more wearable devices such as a set of earpieces 10 including a left earpiece 12A and a right earpiece 12B may in operative communication with the vehicle control system 40, such as through the communication system 48. For example, the communication system 48 may provide a Bluetooth, Wi-Fi, or BLE link to wearable devices or may otherwise provide for communications with the wearable devices through wireless communications. The vehicle 2 may communicate with the wearable device(s) directly, or alternatively, or in addition, the vehicle 2 may communicate with the wearable device(s) through an intermediary device such as a mobile device 4 which may be a mobile phone, a tablet, gaming device, media device, computing device, or other type of mobile device.
As will be explained in further details with respect to various examples, one or more of the earpieces 10 interact with the vehicle control system 40 in any number of different ways. For example, the earpieces 10 may provide sensor data, identity information, stored information, streamed information, or other types of information to the vehicle. Based on this information, the vehicle may take any number of actions which may include one or more actions taken by the vehicle control system (or subsystems thereof). In addition, the vehicle 2 may communicate sensor data, identity information, stored information, streamed information or other types of information to the earpieces 10.
FIG. 2 illustrates one example of a wearable device in the form of a set of earpieces 10 in greater detail. FIG. 1 illustrates a set of earpiece wearables 10 which includes a left earpiece 12A and a right earpiece 12B. Each of the earpieces 12A, 12B has an earpiece wearable housing 14A, 14B which may be in the form of a protective shell or casing and may be an in-the-ear earpiece housing. A left infrared through ultraviolet spectrometer 16A and right infrared through ultraviolet spectrometer 16B is also shown. Each earpiece 12A, 12B may include one or more microphones 70A, 70B. Note the air microphones 70A, 70B are outward facing so the air microphones 70A, 70B may capture ambient environmental sound. It is to be understood any number of microphones may be present including air conduction microphones, bone conduction microphones, or other audio sensors.
FIG. 3 is a block diagram illustrating an earpiece 12. In other embodiments, the earpieces 12 may represent an over-ear headphone, headband, jewelry, or other wearable device. The earpiece 12 may include one or more LEDs 20 electrically connected to an intelligent control system 30. The intelligent control system 30 may include one or more processors, microcontrollers, application specific integrated circuits, or other types of integrated circuits. The intelligent control system 30 may also be electrically connected to one or more sensors 32. Where the device is an earpiece 12, the sensors 32 may include an inertial sensor 74 and another inertial sensor 76. Each inertial sensor 74, 76 may include an accelerometer, a gyro sensor or gyrometer, a magnetometer, or other type of inertial sensor. The sensors 32 may also include one or more contact sensors 72, one or more bone conduction microphones 71, one or more air conduction microphones 70, one or more chemical sensors 79, a pulse oximeter 76, a temperature sensor 80, or other physiological or biological sensor(s). Further examples of physiological or biological sensors include an alcohol sensor 83, glucose sensor 85, or bilirubin sensor 87. Other examples of physiological or biological sensors may also be included in the earpieces 12. These may include a blood pressure sensor 82, an electroencephalogram (EEG) 84, an Adenosine Triphosphate (ATP) sensor, a lactic acid sensor 88, a hemoglobin sensor 90, a hematocrit sensor 92, or other biological or chemical sensors.
A spectrometer 16 is also shown. The spectrometer 16 may be an infrared (IR) through ultraviolet (UV) spectrometer although it is contemplated any number of wavelengths in the infrared, visible, X-ray, gamma ray, radio, or ultraviolet spectrums may be detected. The spectrometer 16 may be adapted to measure environmental wavelengths for analysis and recommendations and thus may be located on or at the external facing side of the earpiece 12.
A gesture control interface 36 is also operatively connected to or integrated into the intelligent control system 30. The gesture control interface 36 may include one or more emitters 82 and one or more detectors 84 for sensing user gestures. The emitters 82 may be one of any number of types including infrared LEDs. The earpiece 12 may include a transceiver 35 which may allow for induction transmissions such as through near field magnetic induction. A short-range transceiver 34 using Bluetooth, BLE, UWB, Wi-Fi or other means of radio communication may also be present. The short-range transceiver 34 may be used to communicate with the vehicle control system. In operation, the intelligent control system 30 may be configured to convey different information using one or more of the LED(s) 20 based on context or mode of operation of the device. The various sensors 32, the processor 30, and other electronic components may be located on one or more printed circuit boards, chips, or circuits of the earpiece 12. One or more speakers 73 may also be operatively connected to the intelligent control system 30.
A magnetic induction electric conduction electromagnetic (E/M) field transceiver 37 or other type of electromagnetic field receiver is also operatively connected to the intelligent control system 30 to link the processor 30 to the electromagnetic field of the user. The use of the E/M transceiver 37 allows the earpiece 12 to link electromagnetically into a personal area network or body area network or another device.
According to another aspect, earpiece wearables may be used to identify one or more users. Each earpiece wearable may include its own identifier (e.g., IMEI, RFID tag, unique frequency, serial number, electronic identifier, user-specified name, etc.). In addition, each earpiece 12 may be used to determine or confirm identity of an individual wearing it. This may be accomplished in various ways including through voice imprint. An individual may speak, and their voice may be analyzed by the earpiece 12 and compared to known samples or metrics to identify the individual. Fingerprints, gestures, tactile feedback, height, skin conductivity, passwords, or other information may also be determined by the sensors 32 or the earpiece 12 and utilized for authentication.
Other types of user identification and authentication may also be used. For example, an individual may be asked to specify other information to the earpiece 12 to confirm identity. This may include answering specific questions. For example, the earpiece 12 may ask multiple questions with yes, no, multiple choice, or free form answers which the correct individual will know but others are not likely to know. These questions may be stored within a database and are questions which the individual associated with the earpiece 12 specifically provided answers for. These questions may also be based on activities of the user which are stored on the earpiece 12 or are retrievable from a system in operative communication with the earpiece 12. These may include information about physical activities, locations, or other activities.
Alternatively, instead of the earpiece performing the analysis associated with user identification and authentication, necessary information, such as voice samples or voice or gestural responses may be collected by the earpiece 12 and communicated to the vehicle, mobile device, or other device for performing the analysis.
Once a user has been identified the user may be authorized to perform various functions in various ways. For example, the vehicle may be unlocked such as by a person saying “unlock” or the vehicle may be remote started and environmental controls set by a person saying, “start my car and set temperature to 72 degrees.” These actions may be taken by the vehicle control system or its subsystems such as an access and security subsystem or a climate control subsystem. In addition, actions may be taken based on proximity of the individual to the user or based on other contextual information.
Various types of vehicle controls may be a part of the vehicle access and security subsystems. These may include actuators such as actuators associated with door locks or locks associated with other compartments. Other types of vehicle controls may include an ignition lock switch which may be unlocked or locked. Other types of vehicle controls may include actuators associated with windows. In addition to these functions, any number of different vehicle functions or related processes may be performed. The vehicle functions performed by a properly identified individual may be the same types of vehicle functions an individual may perform as a driver of the vehicle. Other types of vehicle controls may include any number of settings such as audio system settings, engine controls/components, temperature control settings, entertainment system settings, navigation settings, or other types of settings. The earpiece 12 may also be utilized to control (e.g., initiate, end, adjust settings, etc.) vehicle tracking systems, camera systems, anti-locking breaks, traction control systems, four wheel drive systems, electronic stability control (ESC), dynamic steering response, driver wakefulness monitoring, assured clear distance ahead, adaptive headlamps, advanced automatic collision notification, automotive night vision, blind spot monitoring, precrash systems, safe speed governing, traffic sign recognition, dead man's switch, and so forth.
FIG. 4 illustrates another example. In FIG. 4, a vehicle network 100 is shown. According to one aspect, the left earpiece and the right earpiece 12A, 12B may communicate information through a vehicle network 100 associated with the vehicle 2. Thus, once an identity of a user has been established, commands may be communicated over the vehicle network 100 or vehicle bus to perform one or more vehicle functions. Protocols which are used may include a Controller Area Network (CAN), Local Interconnect Network (LIN), local area network (LAN), personal area network (PAN), or others including proprietary network protocols or network protocol overlays.
Various types of electronic control modules 102, 104, 106, 108 or electronic control units may communicate over the network 100 of the vehicle 102. These may include electronic modules such as an engine control unit (ECU), a transmission control unit (TCU), an anti-lock braking system (ABS), a body control module (BCM), a door control unit (DCU), an electric power steering control unit (PSCU), a human-machine interface (HMI), powertrain control module (PCM), speed control unit (SCU), telematic control unit (TCU), brake control unit (BCM), battery management system, and numerous others. Any number of electronic control modules may be operatively connected to the vehicle network 100. The commands may represent audio or verbal commands, tactile commands (e.g., taps, swipes, etc.), head gestures, hand motions near the earpieces 12, or another detectable user feedback. In one embodiment, the various commands may be associated with different components and functions of the electronic control modules 102, 104, 106, 108. The earpieces 10, an associated wireless device, an electronic device, or the vehicle 2 interface may be utilized to associate the commands with specific actions. Databases, memory data, macro, or scripts may associate the user command, input, or feedback with the implemented action. For example, an application or set of instructions executed by the vehicle 2 may associate a head gesture, such as two head nods, with an unlock function for the driver's side door of the vehicle 12.
In one embodiment, a wireless transceiver module 110 is operatively connected to a vehicle network 100 and it is the wireless transceiver module 110 which is in operative communication with one or more wearable devices, such as the wearable earpieces 10. Once an earpiece 12A, 12B or the vehicle 2 has identified a user, then the user is permitted to give instructions which are translated into commands which are communicated over the vehicle network 100 to an appropriate system or component of the vehicle or to communicate data such as data from one or more sensors of each of the earpieces 12A, 12B. Data from the earpieces 10 may be used by any number of different electronic control modules or electronic control units 102, 104, 106, 108 connected to the vehicle network 100 to perform any number of different vehicle functions.
FIG. 5 illustrates one example of a methodology. In one embodiment, the one or more wearable devices may represent one or more wireless earpieces, such as those shown and described in the various embodiments. As shown in FIG. 5 at step 120 sensor data is obtained at one or more wearable devices. As previously explained the sensor data may be one of any number of types. For example, the sensor data may be voice data or other biometric data. In step 122 a determination is made of the user identity based on the sensor data. Where the sensor data is voice data this determination may be as the result of a voice print or voice sample analysis. Any number of different products or components may be used to perform this analysis. Examples of commercial products for performing such functionality include Nuance VocalPassword, Watson, Siri, Alexa, Google Voice, VoiceIT, and numerous others. It should be further understood other types of biometric data may be used. For example, where the wearable device is a pair of glasses than retina identification and authentication may be used. Where the wearable device is a pair of gloves, finger print analysis may be used. Similarly, wireless earpieces may be utilized to scan fingerprints as well. The determination of the user identity based on sensor data may be performed in one of several different locations based on the type of analysis and available computational resources.
For example, the determination may be performed on or at the wearable device itself. Alternatively, the determination may be performed on or at the vehicle. Alternatively, still, the determination may be performed by a mobile device such as a smart phone which is in operative communication with either the wearable device(s) or the vehicle, or both.
Once the individual has been identified or recognized, in step 124 a determination is made as to whether the user has access rights. In one implementation, if the user is identified then the user has appropriate access rights. In alternative implementations, identifying the user does not necessarily give the individual all rights. Where the user has appropriate access rights, or none are required, in step 126 data or commands may be communicated over the vehicle network to perform various vehicle functions. Data from the wearable device(s) may be used by any electronic control modules associated with the vehicle network to provide input to be used in any number of different decision-making processes. Similarly, commands may be given from the user to the vehicle using the wearable device such as when the wearable device is an earpiece and the commands may be given through voice input from the user.
Any number of actions or access may be granted for implementation utilizing one or more of the earpieces, vehicle systems, wireless devices, or other networked devices. In one example, the user may receive a phone call through a wireless device within the vehicle or by a communication system within the vehicle. In response to the user being authorized or authenticated, the user may provide feedback utilizing the wireless earpieces, such as a double head nod, thereby accepting the phone call for communication through the speakers and microphones of the vehicle. In addition, the communications may be communicated through the wireless earpieces and augmented by the vehicle communication systems (e.g., displaying the caller, call length, etc.).
In another example, the user may provide a verbal command, such as “enter sport mode”, thereby providing a command to the vehicle to adjust the performance of the vehicle (e.g., engine torque/output, transmission performance, suspension settings, etc.). The wireless earpieces may be configured to listen for or receive a command at any time. In other embodiments, a “listen” mode may be activated in response to an input, such as a finger tap of the wireless earpieces, initiation of a vehicle feature, head motion, or so forth. The listen mode may prepare the wireless earpieces to receive a command, input, or feedback from the user.
In another example, the wireless earpieces may provide a method of monitoring biometrics of the user, such as heart rate, blood pressure, blood oxygenation, respiration rate, head position, voice output, or other measurements or readings detectable by the various sensors within the wireless earpieces and/or the vehicle. For example, the wireless earpieces may determine the user is fatigued based on the user's heart rate, respiration, and head motion to provide an alert through the vehicle systems, such as a message indicating the user should pull over communicated through the infotainment system, a heads-up display (e.g., electronic glass), or other vehicle systems. For example, the user settings may indicate the windows are rolled down and the music is turned up until the user can find a suitable place to stop or park. The wireless earpieces may also warn the user if he is impaired based on a determined blood alcohol level, cognition test, slurred speech, or other relevant factors. As a result, the wireless earpieces may help protect the user from his or herself, passengers within the vehicle, and third parties outside the vehicle. In one embodiment, the wireless earpieces may be configured to lock out one or more vehicle systems in response to determining the user is impaired.
The wireless earpieces may also indicate biometrics in the event there is an accident, health event, or so forth. For example, the wireless earpieces may send a command for the vehicle to enter an emergency pullover mode in response to determining the user is experiencing a health event, such as a heart attack, stroke, seizure, or other event or condition preventing the user from safely operating the vehicle. The wireless earpieces may also send one or more communications to emergency services, emergency contacts, or so forth.
In another example, the wireless earpieces may be utilized to monitor a younger or inexperienced user operating the vehicle. For example, to operate the vehicle, an administrator of the vehicle may require the wireless earpieces be worn to determine the watchfulness of the user determined by factors, such as head position, conversations or audio detected, activation/utilization of and associated cellular phone, the wireless earpieces, or the vehicle systems. As a result, the wireless earpieces may be utilized as a parental monitoring feature wall the user is within the vehicle.
The wireless earpieces may also be utilized to perform any number of small tasks significantly enhancing the user experience, such as opening individual doors, unlocking the trunk, opening windows/sunroofs, starting the vehicle, turning off the vehicle, turning on or off the air conditioning/heater, adjust a seat configuration, turning on a movie/music, or any number of other features commonly utilized by the user.
The wireless earpieces in conjunction with the vehicle systems, may also learn the preferences of the user over time to perform automatic features and settings of the vehicle.
It is further contemplated commands may be automatically communicated based on the identity of the user. In other words, once the user has been identified the vehicle may perform one or more vehicle functions automatically based on the identity of the user. These functions may be any number of different functions previously discussed including functions granting access or deny access to the user.
Various methods, system, and apparatus have been shown and described relating to vehicles with wearable integration or communication. The present invention is not to be limited to these specific examples but contemplates any number of related methods, system, and apparatus and these examples may vary based on the specific type of vehicle, the specific type of wearable device, and other considerations.

Claims

What is claimed is:

1. A system comprising:

a vehicle, the vehicle comprising a control system; and

a wireless transceiver operatively connected to the control system;

a set of wireless earpieces in operative communication with the wireless transceiver, the set of wireless earpieces including one or more sensors for providing biometric input;

wherein the control system is configured to receive biometric input from the set of wireless earpieces and identify an individual using the set of wireless earpieces by using the biometric input, wherein the individual is an occupant of the vehicle;

wherein the set of wireless earpieces is configured to confirm identity of the individual using the wireless earpieces.

2. The system of claim 1 wherein the control system is configured to provide access to the vehicle after the individual has been identified by the control system using the biometric input and the identity of the individual is confirmed using the wireless earpieces.

3. The system of claim 1 wherein the access is provided by unlocking an ignition of the vehicle.

4. The system of claim 1 wherein the access is provided by opening a door or compartment of the vehicle.

5. The system of claim 1 wherein the control system is configured to deny access to the vehicle after identifying the individual.

6. The system of claim 1 wherein the control system is configured to alter one or more vehicle settings based on an identity of the individual.

7. The system of claim 1 wherein the one or more sensors comprises a microphone and wherein the biometric input comprises voice input from the individual.

8. The system of claim 1 wherein the biometric input comprises inertial data.