DK178288B1 - Attention feedback loop for sustaining conscious breathing inside a vehicle - Google Patents

Abstract

An interactive system uses vehicle´s existing electronic systems to provide feedback, to reward a person´s conscious choice of actively attending to the breath, inside a vehicle. This is achieved by comparing the sensed respiration signal with a predefned threshold to determine whether the person is breathing slowly and calmly. As for a person to breath slowly and calmly, it always requires that the person consciously direct attention to the breath, as only then he can self-regulate the breath. Therefore, to sense the slow and calm breathing is in essence sensing the active attending to the breath. If the person is breathing slowly and calmly, the system uses in-vehicle electronics (including infotainment system, dashboard, lighting... etc) as output elements to augment the sensed slow and calm respiration with meaningful feedback. The person is in turn naturally encouraged, by the feedback, to continuously breath slowly and calmly. In this way a feedback loop [Figure 1] is formed to engage the person to sustain a slow and calm breathing inside a vehicle. And the feedback loop in it´s essence is to sustain the person´s moment to moment attention to own breath. The system is fexible and adaptable to different contexts inside a vehicle, from the parked situation to normal driving situation

Description

FIELD OF THE INVENTION

This invention relates to in-vehicle electronic system, particularly the in-vehicleelectronic systems become interactive with driver’s respiration, with the goal toengage the driver to actively influence own physiological and mental state bybreathing calmly.

BACKGROUND OF THE INVENTION

Driving as an activity is, to a large degree, an automatic behaviour. Our mind andbody know exactly what to do, which leaves a large part of our attention unfocusedand bored. It causes people to do other activities while driving. In the US, 3328people were killed, and 421,000 people injured in crashes involved a distracteddriver in 2012 alone. At the same time, driving (especially in the city) can also beone of the most stressful daily activities. Further more, we often need to drive whilewe are already tired, i.e. after a long day of work, or traveling long distance. Studysays 20% of traffic accidents are caused by driver fatigue.

Car manufactures mainly focused on two areas to keep our alertness while driving.The first area is to embed high quality entertainment systems into the car in orderto enhance the driving experience, such as the Apple Car Play and Volvo SensusConnected Touch. The second area is about developing sophisticated technology tomonitor driver’s driving behaviour and physiological conditions in order to detectpotential danger, so that the car can remind driver to take a break, such as theDriver alert assistance system, or even automatically respond to the situation toprevent a potential accident, such as the Ford Smart Car, which blocks incomingcalls if sensed the driver is already stressed. Specialised products, such as Anti SleepPilot, have been developed to maintain driving alertness by asking driver to interactwith the device once in a while.

In the area of detecting driver’s physiological conditions, respiration pattern as ascientifically proven factor is used to assess driver’s physiological state and mentalcapacity. U.S.Pat.No. 20130193727, JP.Pat.No. 20 III 82826 and KR.Pat.No.

1020040046502A focused on how to easily enhance the existing safety belt withsensors to monitor the respiration. Other inventions such asCN.Pat.No. 103300869, CN.Pat.No. 201790818, CN.Pat.No. 203043424 exist forusing a separate device to sense driver’s respiration data, in order to detect drivingfatigue. These prior arts confirm the feasibility for accurately sensing respirationinside a vehicle. The question is how to use the sensed respiratory signal.

Respiration is an unique physiological parameter, which normally operates withoutour attention but also can be consciously regulated once we attend to it. Most of usare unaware of our breathing most of the times, and we tend to hold our breath orbreath irregularly when stressed. Until now, majority of technology developmentfocused on sensing the ‘unconscious breathing’ to evaluate driver’s stress and/orfatigue level. Ford smart car concept uses respiration data to determine the driver’sstress level. It blocks incoming calls (an additional stressor) if sensed the driver is already stressed. U.S.Pat. No. 201 1015468 describes a method for maintaining the desired state for a subject, the desired range is defined by setting an upper threshold(too stressed) and a lower threshold (too relaxed). If the sensed signal is outside therange, system provides feedback, to alert and guide the person back to the desiredrange. These developments views the driver as an ‘unstable factor’, wheretechnology takes care of the person by monitoring the instability of the person,filtering information, providing warnings, and takes over the control of the vehiclewhen determined necessary.

It is a general knowledge that respiration can be regulated. Sustaining a slow andcalm breathing is one of the most well documented and practised self-regulationtechniques. Breath awareness is a key element in meditative practise. By becomingaware of and continuously observe the breath, the breath naturally slows down. Wecan also choose to consciously breath slowly and calmly, as Harvard Medical Schoolstates, it “allows you to tap one of your body’s strongest self-healing mechanisms.”The challenge, however, is to remember breathing calmly amidst daily activities, andit requires a moment to moment conscious choice of attending to the breath, inorder to sustain the slow and calm way of breathing. This is difficult, as ourattention habitually follows other stimulations, and wanders away from thebreathing. Therefore, respiratory regulation has been an active field for research anddevelopment of technology intervention, which can be categorised in below twodistinctive approaches:

The first approach is ‘technology guided respiratory regulation’: In this approach,technology dominates the process by setting the pace to gradually guide the personto slow down respiration. The person passively follows the stimulations technologyprovided to reach a target condition. Various commercial products are availableusing this approach. RESPeRATE is aWalkman-like device that uses auditory tonesto guide relaxed breathing to reduce blood pressure. StressEraser and emWave areportable devices uses visual guidance to slow down breathing and reduce stress.Calm Down is an app sets the computer screen fade in and out to guide peoplebreath calmly. This approach has also been introduced into the vehicle context:JP.Pat. No. 2005237456 and WO.Pat.No. 2012039368 both focused on usingtechnology generated stimulations to guide respiration inside vehicle. This approachviews the person as ‘incapable of actively self-regulate’, thus needs to passivelyfollow technology guidance.

The second approach is ’technology augmented respiratory self-regulation’:

Everyone knows breathing slowly and calmly is healthy, and everyone can do it forfew times. But most of us can not sustain a slow and calm breathing, unlessspecifically trained. The key for sustaining a slow and calm breathing, is that theperson is able to sustain the attention on the breath, as only then he can activelyself-regulate the breath moment to moment. Therefore, the focus of this approachis to use technology as feedback, to make attending to own breathing meaningfuland rewarding, in that way engages people to keep sustaining the attention to the breath and breath slowly and calmly. BellyBio is a mobile app, which turns the phoneinto a respiration sensor. By placing the phone on the lower part of the belly whilelying down, it senses the breathing by measuring the increase/decrease of the anglebetween the phone and your body. The app plays a relaxing music once detectedthe person is actively breathing slowly and deeply. In 2012, Neema Moraveji(Stanford University) published a Ph.D. Dissertation “Augmented self-regulation”,states with technology augmented feedback, people can work effectively, whilesustaining part of attention to keep breathing slowly and calmly. It does notnegatively impact people’s performance on cognitive intensive tasks. In this study,people were wearing a waist belt like respiration sensor, and an augmented feedbackof the breathing rate is indicated to people via their computer in real-time, to helppeople self-regulating own respiration while working. This approach honours ourability to actively self-regulate, and technology passively provides feedback toenhance our ability of attending to our own breathing.

The present invention focus on bringing the ‘technology augmented respiratory self¬regulation’ seamlessly integrated into the in-vehicle context, by introducing afeedback loop between the moment to moment conscious choice of attending tothe breath (measured by slow and calm breathing) and the feedback provided byvehicle’s existing electronics. It takes advantage of below 3 aspects, which makes thein-vehicle environment an unique space for technology augmented respiratory self¬regulation: 1) it is a true private space for solitude in the social world we live in.

2) everything is ergonomically designed to support comfort.

3) surrounded with sophisticated technology.

SUMMARY OF THE INVENTION

This invention focus on a novel approach to utilise sensed respiration signal inside avehicle, regardless what sensing technology (could be sensor enhanced safety belt,sensor enhanced seat, microphone, special waist belt sensor...etc) was used fordetection.

The essence of this invention is a feedback loop consists of the person’s slow andcalm respiration as the input, and the vehicle’s electronic system’s feedback as theoutput. There are 2 primary ways for the electronic system to provide feedback.

1) ‘Amplified reflection’.

2) ‘Augmented media’.

Further more, the invention includes the social aspects, where the electronicsystems inside a vehicle responds to multiple people breathing calmly together,either inside the same vehicle, or remotely in other places. In this way people canstay in the solitude and at the same time, feel connected.

The invention also includes 3 different ways that the in-vehicle electronic systemhelp the person transition from normal way of breathing to the slow and calmbreathing, in order to trigger the feedback loop mentioned above.

1) Discrete reflection.

2) Guidance.

3) A special ‘breathing gesture’

The invention further includes intuitive ways to initiate respiration sensing system.

Finally, depending on the contexts of how the vehicle is being used, the electronicsystem provides the adapted ways to give feedbacks to the person’s respiration.Identified according to the level of attention the vehicle requires from the person,this invention describes below 4 different use contexts, and how the feedback loopsystems may work accordingly: 1) Parked.

2) Automatic driving.

3) Stuck in traffic jam or traffic light.

4) Normal driving.

The invention covers for all kinds of transportation vehicles including aircraft, boat,train... etc, and for drivers, pilots, crews and passengers.

OBJECTIVES OF THE INVENTION

1) To engage driver and/or passengers to attend to own respiration inside a vehicle,in order to positively influence own physiological and mental states.

2) To enhance the electronic system in a vehicle to be sensitive to driver and/orpassenger’s slow and calm respiration, and provide engaging feedback.

3) To add an extra layer of meaning (a relaxing music, nature sound, ambientimages... etc) for driver and/or passenger to enjoy, as long as s/he sustain ownbreathing slowly and calmly. This means breathing slowly and calmly is beingrewarded by the electronic system in a vehicle.

4) To create intuitive ways to help driver and/or passengers to transition fromnormal way of breathing into slow and calm breathing, inside a vehicle environment.

5) To anchor the driver and/or passenger’s attention (at least part of the attention isneeded to sustain a slow and clam breathing) always at the present moment(breathing is part of the present moment), provides a way to gradually train thestability of the person’s attention.

6) To anchor the driver and/or passenger’s attention (at least part of the attention isneeded to sustain a slow and clam breathing) always at the present moment, itcreates a good opportunity to establish richer relationships with the environmentinside a vehicle (car environment is also part of the present moment), and the carbrand.

7) To add a social dimension (both with other people inside the same vehicle, orremote) for slow and calm breathing inside a vehicle, which creates an environmentfor people to be in the solitude and at the same time feel connected.

8) To design the electronic system in a vehicle only responds to driver and/orpassenger’s sustained slow and calm respiration inside a vehicle, depends on thedifferent context, the way electronic system give feedbacks is configurable andadaptable to how the vehicle is being used. Thus the system does not interfere thenormal functionality of a vehicle as a driving tool and an entertainment tool.

9) The overall objective is to promote the in-vehicle environment as an uniquespace for people to release/prevent stress, and access solitude amidst the busynessof daily activities.

DETAILS OF THE INVENTION

I. The feedback loop

The essence of the invention is the attention (measured by slow and calm breathing)feedback loop. [Figure2] The pre-requisite of the feedback loop is that the vehicle isable to sense the person’s current breathing pattern in a clean and stable manner.This means the system will exit the feedback loop if the sensed respiration signalbecomes unstable or with too much noise (as this might imply the person’sattention is not on maintaining the slow and calm breathing anymore)

The feedback loop consists two parts. When the slow & calm breathing signal issensed and fed into the system, the in-vehicle electronic system provides feedbacksto recognise and engage the person to continuously breath slowly and calmly. Theslow and calm breathing can be determined by breath rate (breaths per min, orbpm), which is calculated by the number of times the chest rises (inhalations) in aminute. For instance, when the breath rate is less than 10 bpm, the system regardsthe breathing as slow and calm. It can also be measured by the length of aninhalation and/or exhalation. For instance when the inhalation is longer than 2seconds, the system regards the breathing as slow and calm.

The system consists a personalisation module to learn about individuals comfortableway of breathing slowly and calmly, and uses that as the threshold to trigger thefeedback system.

The feedback system has 2 primary ways to respond to the slow and calm breathing.First is ‘Amplified reflection’, and second is ‘Augmented media’.

I) Amplified reflection of the person’s slow and calm breathing is to use theelectronic systems inside a vehicle to reflect the person’s breathing in real-time, forexample, the vehicle’s infotainment display glowing in sync with the person’s slowand calm breathing, to create a sense that the vehicle is breathing together with theperson. The effect of the reflection can be amplified with having multiple electronicelements gradually joining the reflection. In this example, the lighting system couldjoin the infotainment display and glowing together, after the driver has sustained theslow and calm breathing for a while. [Figure 3] 2) Augmented media means the electronic system inside the vehicle responds to theperson’s slow and calm breathing by adding an extra layer of meaning, for instanceplaying a relaxing music, nature sound, display ambient animations, and game...etc. Itrewards the person with enjoyable and restful contents, to recognise the person isactively sustaining the breathing slowly and calmly. [Figure 4] 2. Types of feedbacks

This invention includes all possible feedbacks the in-vehicle electronic system canprovide to a person, in order to indicate that the vehicle is aware the person isbreathing slowly and calmly[Figure 5]. It may includes (but not limited to) belowcategories: - displays of infotainment and navigation system - lighting system - stereo sound system - tactile feedback, such as vibration or massaging - augmented windows - etc...

3. Social dimension

This invention further includes 2 different ways of embedding social dimension intothe activity of breathing slowly and calmly inside a vehicle[Figure 6]: 1) Social breathing (remote): the vehicle creates an experience for the person tobreath slowly and calmly together with people from elsewhere, who are breathingthe same way at the same time. The vehicle’s electronic system generates feedbackin a harmonious way, which expressing your slow and calm breathing is in sync withother people’s breathing at this moment. This creates an opportunity to connectwith others at a level beyond words and information, it creates connection throughconscious breathing. In this way the person stays in the solitude, and at the sametime feels connected. [Figure 7] 2) Social breathing (in-vehicle): same principle can also apply to multiple personbreathing slowly and calmly at the same time inside the same vehicle.

4. Transitions

This invention also includes 3 different ways of helping people to easily transit fromnormal way of unconscious breathing (fast and shallow) to the slow and calm way ofbreathing, which triggers the feedback loop. [Figure 8]: I) Discrete reflection to enhance awareness: the electronic system providesdiscrete reflection to the person’s current respiration, with the goal to make theperson more aware of own breathing. The idea is when we become more aware ofour breath, the breathing rate naturally slows down. One example can be the carlogo located at the centre of the steering wheel glow in sync with the driver’sbreathing. [Figure 9] 2) Guidance: the driver can choose a program from the infotainment system toguide her to gradually slows down her breathing. It can be a visual guide, a voiceguide, or other kinds of guidance. [Figure 10] 3) A special ‘breathing gesture’: the person can consciously choose to breath in aspecial way. It works as an intuitive command to trigger the feedback loop. Oneexample is a deep and slow inhalation and/or exhalation.

5. Activate respiration sensing

Intuitive ways of activating the respiration sensing system are included withoutrequiring to start the engine. For instance, if the safety belt was used as the sensor,the respiration sensing system is activated, as soon as the person clicks in safety belt.Or if the seat was enhanced with respiration sensor, the sensing starts as soon asthe person is seated. [Figure I I] 6. Context adaptability

Breathing consciously in a slow and calm way (attending to the breath) is possible todo in different in-vehicle situations. However, the amount of attention the vehiclerequires from the person (especially the driver) varies quite a lot depending ondifferent situation. This invention includes an context adaptable element, it’s purposeis to configure the in-vehicle electronics system to dynamically find a balancebetween conveying outward information(entertainment, navigation, internet...etc)and inward information (providing feedback for slow and calm breathing, to helppeople self-regulate), according to different situations and personal preferences.

4 different in-vehicle contexts has been identified according the required attentionand whether the vehicle is moving or not. This is one possible configuration of theAttention feedback loop system could be available in different in-vehicle contexts[figure 12]. For instance the function of ‘the vehicle is breathing together with you’(amplified reflection [figure 2]) is only available while the vehicle is parked, wherethe playing a relaxing music (augmented media with audio [figure 4, right]) can beavailable across all kinds of in-vehicle situations.

Claims (17)

1. A method for maintaining conscious breathing inside a vehicle, said fremgangsmådeomfatter: processing by a signal processing means, of a respirationssignalinput in real time from enperson who is breathing inside the vehicle; the determination of whether the person is breathing consciously or not consciously aware of the breath at the pågældendetidspunkt, in response to the constant comparison of respirationssignalinputtet in real time with at least énforuddefineret limit; generating feedback through at least one of the vehicle's electronic sound system, visual alert systems, infotainment system or other electronic reaction indications, if the person is breathing consciously pådet time; wherein said feedback is designed to encourage the person to continue to breathe consciously; characterized in that the generation of feedback through the vehicle's electronic sound system, visual alert systems, infotainment system or other electronic reaction indications stopped when it is determined that the person ikkeer aware of the breath at the time.

2. The method of claim 1, further comprising: continuously monitoring afåndedrættet of the vehicle occupant, the generation of the respiration signal in real time and the transmission afrespirationssignalet in real time to the signal processing means.

3. The method of claim 2, wherein the monitoring of the breath from one point to another foranstaltesaf at least one movement sensor, sound sensor or a visual sensor which is dedicated to detect and measure the person's breathing.

4. The method of claim 3, wherein the motion sensor is a seat belt which is extended with ensensor, and wherein the sensor detects and measures the body movement caused by the fact that the person is breathing.

5. The method of claim 4, further comprising: activating the overvågningenaf breath from one point to another as soon as the person sitting in the seat in the normal way, and clicks the seat belt onto the vehicle without the need to turn on the engine of the vehicle.

6. The method of claim 1, wherein said predefined threshold is the respiratory frequency: a. Respirationssignalinputtet if the real-time representative of a lower frequency than the respiratory denforuddefinerede limit value for the respiratory rate, it is assumed that the person on the pågældendetidspunkt conscious breathing; b. if respirationssignalinputtet in real time represents a breathing frequency that is equal to or højereend the predefined threshold for respiratory rate, it is assumed that the person on detpågældende time is not conscious of his breathing.

7. The method of claim 6, wherein said predefined threshold value is a personalized value, sombestemmes by measuring the breathing frequency of the person is at rest and lowering this åndedrætsfrekvensi rest with a value of between 5% and 50%.

8. The method of claim 1, wherein said predefined threshold is a temporal duration, the time duration may be the duration of the inhalation or exhalation, or a full respiratory cycle consisting of both an inhalation and an exhalation: a. If respirationssignalinputtet in real time is of longer duration than the predefined threshold value forvarigheden, it is assumed that the person at the time conscious breathing; b. if said respiration signal in real time represents a duration equal to or shorter than denforuddefinerede limit the duration, it is assumed that the person at that time is not conscious of his breathing.

9. The method of claim 8, wherein said predefined threshold value is a personalized value, sombestemmes by measuring the duration of a person's inhalation and exhalation or at rest and heleåndedrætscyklussen increase this duration at rest with a value of between 5% and 50%.

10. The method of claim 1, wherein the generated feedback is adapted to reflect the person's conscious breathing from one point to another; it starts with at least one indication from a elektronisklydanlæg, visual indication system, infotainment system or other electronic systems såledesafspejler person's conscious breathing, after several vehicle systems (electronic sound system, visual indication system, infotainment system or other electronic systems) may gradually contribute tilat amplify said reflection of their conscious breathing.

11. The method according to claim 1, wherein the generated feedback arranged so as to add an extra layer of meaning to the person's conscious breathing at the time when the person using the vehicle systems (electronic sound system, visual indication system, infotainment system or other electronic systems) are told to pay attention in conscious breathing; said signals include visual signals, natural sounds, quiet music, games-related incentives and social contexts.

12. The method of claim 1, further comprising generating the feedback information through at least one of the systems in the vehicle (the electronic audio equipment, visual indication system infotainment system or other electronic system), if more than one person at the same time breathe pådet that time, thereby forming a feedback loop to help people with atopretholde conscious breathing as a joint activity.

13. The method of claim 12, wherein the generated feedback is a combined feedback; it may be the form of a dynamic, visual composition, with each of several persons simultaneously befindersig in the vehicle represents a certain color, a visual pattern or a dynamic sound composition in which each of several persons simultaneously are in the vehicle, or bestemtlyd represents a musical instrument.

14. The method of claim 12, wherein the entities which together conscious breathing, either all kanvære within said vehicle or distributed elsewhere with at least one person physically located within ikøretøjet.

15. The method of claim 1, further comprising means to change the person's unconscious respiration to conscious breathing, wherein at least one of the systems in the car (elektronisklydanlæg, visual indication system infotainment system or other electronic systems) generating failed response that reflect the person's unconscious respiration at the the time to help the person being aware of the status of his own breath.

16. The method of claim 15, wherein said electronic response indication in the vehicle is etelektronisk improved billogo that is located in the middle of the steering wheel, wherein the discrete reflects the person's respiration by light of varying brightness or change the color, or change the visual pattern as medden rhythm that the person breathes with at that time.

17. The method according to claim 1, further comprising dynamic adaptation afadgangen to the various forms of the generated feedback, depending on the different situations ikøretøjet, especially if the person sitting in the driver's seat of the vehicle, eg .: a. If the vehicle is parked, or the vehicle is set to run automatically; in this case erder access to all kinds of feedback, since the person in the driver's seat does not need to be aware of the vehicle in question; b. where the vehicle is stuck in traffic; in this case, the generated feedback, which draws on the person's visual attention in that driver's seat is limited; where the vehicle is running normally; in this case, the generated feedback, which draws on the visual attention of the person in the driver's seat, to a minimum.