WO2023208032A1 - Physiological state detection method and apparatus, device, storage medium and program product - Google Patents

Abstract

Disclosed in embodiments of the present disclosure are a physiological state detection method and apparatus, a device, a storage medium and a program product. The method comprises: in response to receiving a request for physiological state detection of a passenger in a vehicle, obtaining an image of the passenger acquired by means of a vehicle-mounted camera; detecting a physiological state of the passenger on the basis of the image to obtain the physiological state detection result; and analyzing the physiological state detection result, and when an abnormal index exists in the physiological state detection result, pushing an online health consultation service to the passenger.

Description

Physiological state detection methods, devices, equipment, storage media and program products

Cross-references to related applications

This disclosure is based on a Chinese patent application with the application number 202210494009.7, the filing date is April 29, 2022, and the application name is "Physiological state detection method, device, equipment and storage medium", and claims the priority of this Chinese patent application, The entire content of the Chinese patent application is hereby incorporated into this disclosure in its entirety.

Technical field

The present disclosure relates to but is not limited to the field of smart car technology, and in particular, to a physiological state detection method, device, equipment, storage medium and program product.

Background technique

As cars continue to develop on the road to intelligence, mobile travel will take up more and more time, and the scene inside the car will predictably become the third living space. In this third living space, in addition to necessary driving functions and entertainment functions, health-related functions will attract more and more attention from users and car manufacturers. Because health-related functions not only care about users in a practical way, but also express the car manufacturer's concern for users' health.

In related technologies, the health-related functions of smart car cabins will focus more on the quality and safety of the air in the car and the safety of vehicle driving. However, there are still major deficiencies in health-related functions related to the human body itself.

Contents of the invention

Embodiments of the present disclosure provide at least one physiological state detection method, device, equipment, storage medium and program product.

The technical solution of the embodiment of the present disclosure is implemented as follows:

In a first aspect, embodiments of the present disclosure provide a physiological state detection method, which method includes:

In response to receiving a request to detect the physiological state of the occupant in the vehicle, obtain an image of the occupant collected by a vehicle-mounted camera; detect the physiological state of the occupant based on the image to obtain a physiological state detection result; The physiological state detection results are analyzed, and if there are abnormal indicators in the physiological state detection results, online health consultation services are pushed to the occupants.

In the above embodiment, in response to receiving a request to detect the physiological status of the occupant in the vehicle, the image of the occupant collected by the vehicle camera is first obtained; and then the physiological status of the occupant is detected based on the image, and the result is Physiological state detection results; finally, the physiological state detection results are analyzed, and if there are abnormal indicators in the physiological state detection results, online health consultation services are pushed to the occupants, so that the user can complete the physiological state detection after the physiological state detection results are completed. When abnormal indicators appear, professional doctors will be contacted promptly for evaluation and analysis. Through the targeted introduction of the health consulting service function of the medical platform, the health functions of smart cars have been broadened.

In a second aspect, embodiments of the present disclosure provide a physiological state detection device, which includes an acquisition part, a detection part and a health consultation part, wherein:

The acquisition part is configured to acquire the image of the occupant collected by the vehicle camera in response to receiving a request to detect the physiological state of the occupant in the vehicle;

The detection part is configured to detect the physiological state of the occupant based on the image and obtain a physiological state detection result;

The health consultation part is configured to analyze the physiological status detection results, and push online health consultation services to the occupants if there are abnormal indicators in the physiological status detection results.

In a third aspect, embodiments of the present disclosure provide a computer device, including a memory and a processor. The memory stores a computer program that can be run on the processor. When the processor executes the program, part of the above method is implemented. or all steps.

In a fourth aspect, embodiments of the present disclosure provide a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, some or all of the steps in the above method are implemented.

In a fifth aspect, embodiments of the present disclosure provide a computer program, including computer readable code. When the computer readable code is run in a computer device, the processor in the computer device executes a configuration configured to implement the above method. Some or all of the steps.

In a sixth aspect, embodiments of the present disclosure provide a computer program product. The computer program product includes a non-transitory computer-readable storage medium storing a computer program. When the computer program is read and executed by a computer, the above method is implemented. some or all of the steps.

It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and do not limit the technical solution of the present disclosure.

Description of the drawings

The accompanying drawings herein are incorporated into and constitute a part of this specification. They illustrate embodiments consistent with the disclosure and, together with the description, serve to explain the technical solutions of the disclosure.

Figure 1 is an optional flow diagram of a physiological state detection method provided by an embodiment of the present disclosure;

Figure 2 is an optional flow diagram of a physiological state detection method provided by an embodiment of the present disclosure;

Figure 3 is an optional flow diagram of a physiological state detection method provided by an embodiment of the present disclosure;

Figure 4 is an optional flow diagram of a physiological state detection method provided by an embodiment of the present disclosure;

Figure 5 is a schematic flowchart of the implementation of a physiological state detection method provided by an embodiment of the present disclosure;

Figure 6 is a schematic structural diagram of a physiological state detection device provided by an embodiment of the present disclosure;

FIG. 7 is a schematic diagram of a hardware entity of a computer device provided by an embodiment of the present disclosure.

Detailed ways

In order to make the purpose, technical solutions and advantages of the present disclosure clearer, the technical solutions of the present disclosure are further elaborated below in conjunction with the accompanying drawings and examples. The described embodiments should not be regarded as limiting the present disclosure. Those of ordinary skill in the art will All other embodiments obtained without creative efforts belong to the scope of protection of this disclosure.

In the following description, reference is made to "some embodiments" which describe a subset of all possible embodiments, but it is understood that "some embodiments" may be the same subset or a different subset of all possible embodiments, and Can be combined with each other without conflict.

The terms "first/second/third" involved are only used to distinguish similar objects and do not represent a specific ordering of objects. It is understood that "first/second/third" can be used interchangeably if permitted. The specific order or sequence may be changed so that the embodiments of the disclosure described herein can be implemented in an order other than that illustrated or described herein.

Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure belongs. The terminology used herein is for the purpose of describing the disclosure only and is not intended to be limiting of the disclosure.

Embodiments of the present disclosure provide a physiological state detection method, which can be executed by a processor of a computer device. Among them, computer equipment can refer to servers, laptops, tablets, desktop computers, smart TVs, Set-top boxes, mobile devices (such as mobile phones, portable video players, personal digital assistants, dedicated messaging devices, portable game devices) and other devices with physiological state detection capabilities are not limited in the embodiments of the present disclosure.

Figure 1 is an optional flow diagram of a physiological state detection method provided by an embodiment of the present disclosure. As shown in Figure 1, the method includes the following steps S101 to S103:

Step S101, in response to receiving a request to detect the physiological status of the occupant in the vehicle, obtain the image of the occupant collected by the vehicle camera;

Here, the physiological state detection is to detect the physiological indicators of the human body. The physiological indicators of the human body will include multiple indicators, such as body temperature, heart rate, heart rate variability, blood oxygen saturation, respiratory rate and blood pressure. Through these physiological indicators, Indicators can roughly obtain the health status of the occupants.

In some implementations, the vehicle-mounted camera can be a Driver Monitor System (DMS) camera, which can perform high-precision real-time detection of dangerous behaviors such as driver fatigue and distraction; in other implementations, the vehicle-mounted camera The camera can be an Occupant Monitoring System (OMS) camera to detect passengers, pets and leftover objects in the car cabin to ensure the safety of the occupants.

Based on different types of in-vehicle cameras, the occupants in the vehicle can be drivers or ordinary passengers.

The image of the occupant can be the original image collected by the above-mentioned DMS or OMS camera, or it can be the image of the specified occupant obtained by performing face detection/human body detection and image segmentation based on the original image.

Step S102, detect the physiological state of the occupant based on the image, and obtain a physiological state detection result;

In human body images, the imaging brightness of the human skin surface is directly related to physiological states such as breathing and heart rate. The relevant physiological state information can be extracted from the image of the occupant through image processing methods. In the implementation, the images of the driver and the occupants collected through the on-board camera can be used as signal input, the brightness information of the occupant images can be analyzed, and then the frequency domain signals can be extracted, and analysis and calculation can be performed based on the frequency domain signals to obtain real-time heart rate, respiration Frequency, blood pressure and other parameters to achieve the purpose of physiological status detection. The embodiment of the present disclosure implements the physiological state detection function in the detection application program, and obtains the physiological state detection results of various physiological indicators and stores them locally, which can be used for subsequent viewing and analysis.

Step S103: Analyze the physiological state detection results, and push online health consultation services to the occupants if there are abnormal indicators in the physiological state detection results.

Here, the detected physiological state detection results are analyzed one by one. Specific analysis may include but is not limited to at least one of the following: stability of the occupant's corresponding indicators over a period of time, analysis of the physical state related to each indicator value, and physical state assessment combining multiple indicator values.

For example, the specific medical meaning of each physiological indicator can be explained, or whether the physiological state detection result is normal, etc., which are not limited in the embodiments of the present disclosure.

In some embodiments, prompt information can also be output based on the analysis of the physiological state detection results. The prompt information is used to indicate the medical meaning of each physiological indicator and/or to give passengers lifestyle and dietary suggestions for abnormal indicators.

For example, when it is detected that the occupant's blood pressure index is higher than the maximum value of the preset index interval, the medical meaning of blood pressure will be explained first, what risks high blood pressure indicates, and related suggestions on food, clothing, housing and transportation, such as what should be done in daily life. Eat a light diet and do more physical exercise. At the same time, passengers are reminded that if they feel unwell, they should seek professional health consultation with a doctor.

Here, assuming that the detected physiological state detection result contains a detection value of the first indicator that is not in the preset indicator interval, the first indicator is determined to be an abnormal indicator, where the preset index interval is a medically fixed indicator interval. For example, if it is detected that user A's breathing frequency (the preset index range is 12 to 20 times/min) exceeds 20 times/min, then the respiratory frequency indicator is an abnormal indicator.

In some implementations, based on different categories of abnormal indicators, doctors in corresponding departments of cooperative hospitals are connected to the Internet of Vehicles to provide remote health consultation services for the occupants. For example, for the department corresponding to the respiratory frequency For respiratory medicine, the passenger will be connected to a doctor in the respiratory medicine department for health consultation.

During the implementation, the health consultation service function of the medical platform is introduced into the detection application in advance. When the user needs health consultation, an online conversation between the occupant and the doctor from the corresponding department is established through the in-vehicle device or the mobile device carried by the occupant. To enable consultation through detection applications.

In the embodiment of the present disclosure, first in response to receiving a request to detect the physiological status of the occupant in the vehicle, an image of the occupant collected through a vehicle-mounted camera is obtained; and then the physiological status of the occupant is detected based on the image. Obtain the physiological status detection results; finally analyze the physiological status detection results, and push online health consultation services to the occupants if there are abnormal indicators in the physiological status detection results, thereby allowing the user to detect physiological status When abnormal indicators appear after the test, you can get professional advice in time, so that vehicle occupants can quickly understand their physical status for safe driving and riding. Through the targeted introduction of the health consulting service function of the medical platform, the health functions of smart cars have been broadened.

In some embodiments, the method is applied to a vehicle-mounted device or a user's mobile device, and the method further includes: obtaining the in-vehicle information sent to the vehicle-mounted device or the user's mobile device through a central control screen in the vehicle. The passenger's request for physiological status detection.

Here, the central control screen is the screen of the vehicle-mounted device, that is, the vehicle screen. An icon of the detection application is displayed on the central control screen. When the user clicks the icon or speaks the corresponding voice command, the detection application is started. That is to say, the detection application is installed in the vehicle device and is launched based on the user's indicator detection requirements.

It should be noted that the central control screen includes an operation interface mainly controlled by manual touch and a gaze interface mainly controlled by voice commands. In some embodiments, when the user is waiting for traffic lights, parking, and other stationary scenes, the user can intuitively click on the detection application icon on the operating interface to start the program and perform indicator detection. In other embodiments, when the user is driving the vehicle on the road, the user can control the detection application to start and perform indicator detection through voice commands.

In some embodiments, after acquiring the image of the occupant collected through a vehicle-mounted camera, the method further includes the following steps 121 to 123:

Step 121: Perform face recognition on the image of the passenger to obtain the recognition result;

Here, the face recognition is a biometric technology that performs identity recognition based on a person's facial feature information. In the implementation, images or video streams containing human faces are collected using on-board cameras and imported into the detection application to automatically detect and track faces, and then perform facial recognition on the detected faces.

In the implementation, face detection is first used to determine whether there is a face in the image of the occupant. If there is a face, the position and size information of each face is further given. Face key point detection and facial feature extraction can also be used. and other methods to obtain features such as position information of each major facial organ of the human face. Based on these feature information, face recognition is further performed and compared with the registered face features to identify the identity of the person corresponding to each face and obtain the recognition result.

Step 122: If it is determined that the passenger is not registered according to the identification result, create a profile of the passenger;

Here, if face recognition fails, that is, if the occupant's facial features fail to match the features in the registered facial feature database, it can be determined that the occupant is not registered, and a corresponding profile can be further created based on the occupant's facial features. Specifically, the facial features of the occupant are stored in the registered facial feature database, and the occupant is identified in the file with the identity mark corresponding to the facial feature. The file may include one or more basic information of the passenger's age, gender, height, and weight, as well as personal preference information such as the passenger's driving data, riding data, and riding habit data.

Step 123: Store the occupant's physiological state detection results in the occupant's file.

After completing the physiological state detection of the vehicle occupant, the physiological state detection results can be stored in the occupant's file.

In the above embodiment, combined with the images of the occupants captured by the on-board camera, the images of the occupants are first identified and verified. Verify the identity of the occupant, and if the verification fails, create a file for the occupant and store the test results in the file, so that the physiological status test results of unregistered occupants can be saved.

In some embodiments, if it is determined that the occupant has been registered according to the recognition result of step 121, step S102 can be directly entered to start physiological state detection based on the image of the occupant.

In some embodiments, "analyzing the physiological state detection results" in step S103 above may include the following steps 131 and 132:

Step 131: Determine whether the value of each physiological indicator in the physiological state detection result is within the corresponding preset indicator interval, and obtain a determination result;

Here, the preset index interval is a medically fixed index interval. There is a fixed medical index interval for each physiological index. For example, the preset index interval for blood pressure, that is, the normal range of blood pressure, is: systolic blood pressure is between 90 and 140 mmHg. Column (mmHg), diastolic blood pressure is between 60 and 90 mmHg; the preset index range for respiratory rate is 12 to 20 times/min.

When the detection value of the first physiological index satisfies the preset index interval, it is determined that the first physiological index is normal; when the detection value of the first physiological index does not meet the preset index interval, it is determined that the first physiological index is abnormal.

Step 132: Based on the determination result, output prompt information to the occupant;

Here, the prompt information includes the medical meaning of each of the physiological indicators and/or suggestions for abnormal physiological indicators of the occupant.

In some embodiments, when all physiological state detection results are normal, the prompt information output is used to encourage the user to continue maintaining the condition.

In other embodiments, when the physiological status detection result of a certain physiological indicator is abnormal, the output prompt information is used to give the user suggestions on food, clothing, housing and transportation, such as eating a light diet, doing more physical exercises, etc., or reminding the user If the user feels unwell, seek medical attention promptly.

In the above embodiment, after obtaining the physiological state detection results, it is determined whether the value of each physiological indicator falls within the corresponding preset indicator interval, and relevant medical meaning interpretation or relevant suggestions on food, clothing, housing and transportation are output based on the determination results, thereby reducing When users detect abnormal indicators, they go to other search engine platforms for consultation and receive unprofessional or inaccurate search results, which misleads users.

In some embodiments, after the above step S102 "detect the physiological state of the occupant based on the image and obtain the physiological state detection result", the method further includes the following steps:

Step 1021: Generate this detection record based on the obtained physiological state detection results;

Here, the current detection record may include information such as the detection value of each physiological indicator in the physiological state detection results, detection time, and the identity of the occupant.

Step 1022, store the current detection record in the passenger's personal file;

Here, the personal file includes at least the passenger's identity information and historical physiological state detection records. That is to say, the personal files of the occupants are established in advance, and sequential detection records are generated for each inspection and stored in the personal files to facilitate the occupants to view after logging in.

In the above embodiment, after the detection application completes the detection of the occupant, the current detection record is generated based on the physiological state detection results and stored in the personal file of the occupant. In this way, the user's identity information and each physiological status test result are organized into a personal file in the form of a test record and stored in the on-board device, making it easier for the user to subsequently view the previous physiological status test results and understand the long-term changes in each physiological indicator.

In some embodiments, before detecting the physiological state of the occupant based on the image, the method further includes: determining that the vehicle is in a parked state based on the acquired body signal, or determining that the vehicle is in a parked state based on the acquired body signal. The vehicle is running smoothly.

In this way, detection is performed only after ensuring that the vehicle is in a parking state or driving smoothly. It is possible to detect the physiological state of passengers in real time while ensuring traffic safety, and the physiological state detection results of the occupants are achieved when the vehicle is in a stable state. The result is that it is not susceptible to interference from other external factors and can obtain more accurate detection results.

The embodiment of the present disclosure provides an optional physiological state detection method, as shown in Figure 2. The method includes the following steps S201 to S204:

Step S201, in response to receiving a request to detect the physiological state of the occupant in the vehicle, obtain the image of the occupant collected by the vehicle camera;

Step S202, detect the physiological state of the occupant based on the image, and obtain a physiological state detection result;

Step S203: Analyze the physiological state detection results. If there are abnormal indicators in the physiological state detection results, match the passenger with an online doctor in the department corresponding to the abnormal indicators;

Here, the physiological state detection method can be run in the form of a detection application in a user-side interactive device such as a vehicle-mounted device or an occupant's mobile smart device, and the online doctor is from a hospital that cooperates with the detection application. In the implementation, the target department is first determined based on the category to which the abnormal indicator belongs, and then the online doctors who are currently idle are selected from the target department.

It is worth noting that when the physiological status test results of the occupants contain multiple physiological indicators of different categories, it may involve doctors from multiple different departments or professions conducting online health consultations with the occupants. Therefore, when the number of online doctors matched to a passenger is multiple, after the online health consultation between the passenger and the current online doctor is completed, the passenger will be matched with other online doctors who are idle and meet the classification results, that is, the current online health consultation results. After that, the user will continue to be matched with other online doctors, and the other online doctors here will continue to explain and analyze other abnormal indicator items for the user.

Step S204: Establish an online session between the passenger and the online doctor for online health consultation.

Here, the passenger's client is connected to the client of the online doctor in the department corresponding to the abnormal indicator through the Internet of Vehicles, and an online session between the passenger and the online doctor is established.

It is worth noting that when the passenger is a registered user of the medical platform of the hospital where the online doctor is located, the connection is directly through the Internet of Vehicles; when the passenger is a non-registered user of the medical platform of the hospital where the online doctor is located, the identity needs to be verified first. Verification and account registration processes.

In the embodiment of the present disclosure, when there are abnormal indicators in the physiological state detection results, an online session is established to connect the occupants to corresponding professional doctors to provide remote health consultation to the occupants. In this way, corresponding professional doctors are imported according to abnormal indicators, and users and doctors can directly communicate face-to-face remotely through online health consultation. Users can obtain professional advice without going to the hospital in person, forming a more flexible health consultation method in the car.

Based on Figure 2, the embodiment of the present disclosure provides an optional physiological state detection method. As shown in Figure 3, the above-mentioned step S204 "Establishes an online session between the occupant and the online doctor for online health consultation." Including the following steps S301 to step S303:

Step S301, display the online health consultation window corresponding to the online doctor through the central control screen in the vehicle;

Here, the online health consultation pop-up window is displayed to remind the occupants whether they currently need online health consultation, making the online health consultation function more user-friendly. Users can click whether to start according to their personal circumstances, for example, they can start in stationary scenes such as parking or parking. An online health consultation, otherwise it may bring certain safety risks.

The pop-up of the above-mentioned online consultation window can be triggered by "the vehicle is in a stable running or parked state", that is, the vehicle's speed, external environment information, etc. can be obtained to determine whether it is appropriate to carry out health consultation for the occupants in the vehicle. If the result is "Yes", the online consultation window will pop up.

Step S302, in response to the passenger's confirmation opening operation in the online health consultation window, establish a video call with the online doctor, and display the video call screen through the central control screen in the vehicle;

Here, the online doctor's video call screen is displayed on the central control screen, and at the same time, the client interface where the online doctor is located also displays the passenger's screen captured in real time by the on-board camera.

Here, through an online conversation between the online doctor and the passenger, the online doctor can inquire about the passenger and understand The passenger's physical condition and abnormal indicators; the passenger can also describe recent physical symptoms, diet, etc. to the online doctor so that the online doctor can provide suggestions to the passenger.

Step S303, in response to the end of the online health consultation, close the video call screen and output a consultation report to the passenger.

Here, the consultation report is generated and uploaded by the online doctor based on the occupant's online health consultation.

A pop-up window for online health consultation pops up on the central control screen to users. Users can click whether to start an online health consultation according to their personal circumstances to ensure traffic safety; at the same time, the video call screen of the doctor in the corresponding department is displayed through the connection, allowing the user to communicate with the doctor. remote face-to-face communication. Thus, the health consultation function of the medical platform is introduced into the detection application in a targeted manner, so as to realize online health consultation for the occupants through the detection application and broaden the health functions of smart cars.

In some embodiments, before step S303, the method further includes the following steps: with the authorization of the passenger, obtaining the historical physiological state detection record of the passenger; determining the historical physiological state detection record of the passenger. historical detection results corresponding to the abnormal indicators; and sending historical detection results corresponding to the abnormal indicators to the online doctor.

In this way, during the online health consultation process, the stored historical physiological status detection records of the occupants are retrieved with the consent of the user, and the historical detection results corresponding to the abnormal indicators are screened out and provided to the online doctor, which facilitates the online doctor to analyze the changes in the physiological status of the occupants. Assessment and analysis to accurately determine the user's health status.

The embodiment of the present disclosure provides an optional physiological state detection method, as shown in Figure 4. The method includes the following steps S401 and S402:

Step S401, in response to receiving a trigger operation through the online health consultation control in the central control screen in the vehicle, initiate an online health consultation request;

Here, an online health consultation control is provided in the detection application, and when the control is manually triggered, the online health consultation will be started directly. That is, before the indicator detection is started, the occupant can initiate a health consultation request by operating this control.

Step S402: Based on the online health consultation request, establish a session between the passenger and the online doctor for online health consultation.

Here, the online doctor defaults to a general practitioner, and the general practitioner can be understood to be able to conduct a comprehensive analysis based on the detection results of various physiological indicators. Directly connect the client used by the passenger to the client used by the general practitioner through the Internet of Vehicles. Specialists can also be automatically matched based on the user's physiological status test results, or the user can manually select an online specialist.

Here, by establishing an online conversation between the doctor and the crew, the doctor can inquire about the crew and learn about the crew's physical condition and disease history; the crew can also directly describe recent symptoms of physical discomfort and diet to the general practitioner. etc. so that the doctor can conduct a comprehensive assessment.

In the above embodiment, the user can directly click the functional control in the central control screen to trigger an online health consultation request. At this time, an online session is established between the passenger and the general practitioner of the cooperative hospital to realize online health consultation, thereby supporting the user. Actively initiate online consultation, which improves the flexibility of on-board monitoring functions.

The following describes specific examples of the physiological state detection method provided by the embodiments of the present disclosure in actual scenarios. However, it is worth noting that this specific example is only to better illustrate the present disclosure and does not constitute an improper limitation of the present disclosure.

With the application research of visual health detection methods, physiological indicators such as heart rate, heart rate variability, blood oxygen saturation, respiratory rate and blood pressure can be detected with the help of vehicle cameras. Through these physiological indicators, the user's current health status can be roughly obtained. The health detection method provided by the embodiment of the present disclosure implements the physiological indicator detection function through a detection application and installs it in the vehicle system. At the same time, the physiological status detection results are analyzed through the detection application, and the health of the medical platform is introduced in a targeted manner. Consultation function to enable online health consultation through testing applications Inquire.

An embodiment of the present disclosure provides a physiological state detection method, as shown in Figure 5. The method includes the following steps S501 to S507:

Step S501, start the detection application;

Here, the user starts the detection application by clicking the icon of the detection application on the central control screen or waking it up by voice.

Step S502, detect the physiological state of the occupant;

Here, after the detection application is started, it automatically imports the images of the occupants collected by the on-board camera and recognizes the face. After the recognition results match the occupants, the indicator detection starts.

Step S503, generate this detection record based on the physiological state detection results, and store it in the occupant's personal file;

Here, after a period of time, the detection process in step S502 is completed, and the physiological state detection results are displayed on the interface of the detection application, including heart rate, heart rate variability, respiratory frequency, blood oxygen, blood pressure and other index items. Then, the detection record is generated based on the occupant's identity, physiological status detection results, detection time and other information, and stored in the occupant's personal file.

Step S504, analyze and interpret the physiological state detection results, and output prompt information;

Here, when the physiological status detection results show that all physiological indicators are normal, the detection application will output a prompt message to encourage the occupants, hoping that the occupants will continue to maintain their performance; if there is an abnormal detection result of a certain physiological indicator (i.e. abnormal indicator ), the relevant interpretation and medical meaning of the corresponding indicator are output in the detection application.

Compared with related technologies that use wearable devices to provide users with analysis and suggestions based on abnormal indicators, the embodiments of the present disclosure detect the user's physiological indicators through the detection application installed on the vehicle system, and further analyze and interpret the physiological status detection results. Provide suggested tips.

Step S505, import doctors from corresponding departments of the cooperative hospital according to the category of the abnormal indicators, and display an online health consultation pop-up window;

Here, the detection application can pop up a window to prompt the occupants whether they need remote online health consultation when abnormal indicators are detected.

Step S506, in response to the passenger's confirmation opening operation on the online health consultation pop-up window, connect to the online doctor in the corresponding department of the cooperative hospital;

Here, after the occupant clicks the confirmation control on the online health consultation pop-up window, he is connected to the online doctor in the corresponding department through the Internet of Vehicles. The online doctor's picture is displayed on the central control screen, and the doctor also obtains the picture of the on-board camera.

The online doctor can conduct online inquiries to the crew to understand the crew's abnormal indicators. They can also, with the consent of the crew, retrieve the historical data stored locally and view the historical records of the indicators to gain an in-depth understanding of the crew's condition. . Passengers can also provide some of their other physical problems to the online doctor, who will ultimately provide comprehensive physical status assessment results and suggestions. During the consultation process, doctors can submit evaluation results, suggestions and other related content, and the backend will form a report based on the content submitted by the doctor. If the passenger's problem cannot be solved through remote health consultation, the passenger can be recommended to go to the hospital for in-person health consultation in time. After the health consultation, the two parties ended the video call. The occupants can also receive the health consultation result report in the detection application.

Step S507: Upon receiving the occupant's triggering operation on the online health consultation control on the interface, the vehicle is directly connected to the general practitioner of the cooperative hospital for online health consultation.

Here, after the detection application is started in the above-mentioned step S501, an online health consultation control is displayed on the interface for the occupants to independently start an online health consultation according to their own needs. At this time, the detection application will connect the occupant to the general practitioner in the partner hospital for health consultation. The specific health consultation process is the same as the process in step S506.

In the embodiment of the present disclosure, after the physiological index detection is completed, the user can connect to the doctor of the hospital that the detection application cooperates with through the Internet of Vehicles to conduct remote health consultation for abnormal indicators or when the user feels uncomfortable in the car. Professional advice. On the one hand, it expands the functions of detection applications, and on the other hand, it can also provide more timely Consulting services to solve users’ real-time consulting needs. Especially when users want to know a certain indicator information instantly, they can quickly contact online doctors remotely.

The disclosed embodiments are at least applicable to the following scenarios: 1) The user drives the vehicle on the road and can control it with voice, open the detection application and start an indicator detection. If there is a problem with a certain indicator, the detection application will give corresponding health advice. and reminders; 2) When users are waiting for traffic lights, parking, and other stationary scenes, they can manually click on the detection application to start an indicator detection. If there is a problem with a certain indicator, the detection application will give corresponding health suggestions. and reminders. At the same time, it is recommended that users conduct remote health consultation and timely health consultation: 3) When users feel uncomfortable in the car or have a sudden illness, and it is too late or inconvenient to go to the hospital, they can directly click on remote health consultation.

Based on the foregoing embodiments, embodiments of the present disclosure provide a physiological state detection device, which includes various parts and sub-parts included in each part, and can be implemented by a processor in a computer device; of course, it can also It can be realized through specific logic circuits; during the implementation process, the processor can be a central processing unit (Central Processing Unit, CPU), a microprocessor (Microprocessor Unit, MPU), or a digital signal processor (Digital Signal Processor, DSP) Or Field Programmable Gate Array (FPGA), etc.

Figure 6 is a schematic structural diagram of a physiological state detection device provided by an embodiment of the present disclosure. As shown in Figure 6, the device 600 includes: an acquisition part 610, a detection part 620 and a health consultation part 630, wherein:

The acquisition part 610 is configured to acquire the image of the occupant collected by the vehicle camera in response to receiving a request to detect the physiological state of the occupant in the vehicle;

The detection part 620 is configured to detect the physiological state of the occupant based on the image and obtain a physiological state detection result;

The health consultation part 630 is configured to analyze the physiological status detection results, and push online health consultation services to the occupants if there are abnormal indicators in the physiological status detection results.

In some possible embodiments, the method is applied to vehicle-mounted equipment or user mobile equipment, and the device further includes a request acquisition part configured to obtain a request to the vehicle-mounted equipment or the user through a central control screen in the vehicle. A request sent by the mobile device to detect the physiological status of the occupants in the vehicle.

In some possible embodiments, after acquiring the image of the occupant collected through a vehicle-mounted camera, the device further includes an identification part, a filing part and an archiving part, wherein: the identification part is configured to Face recognition is performed on the image to obtain the recognition result; the archiving part is configured to create a profile of the occupant if it is determined that the occupant is not registered according to the recognition result; the archiving part is configured to The physiological status detection results of the occupant are stored in the occupant's file.

In some possible embodiments, the detection part 620 is also configured to determine whether the value of each physiological indicator in the physiological state detection result is within the corresponding preset indicator interval, and obtain a determination result; the device further includes an output A sub-part configured to output prompt information to the occupant based on the determination result; the prompt information includes the medical meaning of each of the physiological indicators and/or suggestions for abnormal physiological indicators of the occupant.

In some possible embodiments, the health consultation part 630 includes a matching sub-part and a health consultation sub-part, wherein: the matching sub-part is configured to respond to the presence of abnormal indicators in the physiological state detection results, for the The passenger matches the online doctor in the department corresponding to the abnormal indicator; the health consultation sub-section is configured to establish an online session between the passenger and the online doctor for online health consultation.

In some possible embodiments, the health consultation sub-part includes a pop-up window display unit and a conversation display unit, wherein: the pop-up window display unit is configured to display the online doctor's correspondence through the central control screen in the vehicle. The online health consultation window; the session display unit is configured to respond to the occupant's confirmation opening operation in the online health consultation window, establish a video call with the online doctor, and communicate through the central control in the vehicle The screen displays the picture of the video call.

In some possible embodiments, the health consultation sub-part further includes a report output unit configured to close the video call screen and output a consultation report to the occupant in response to the end of the online health consultation; the consultation report is generated by the The online doctor generates and uploads the online health consultation based on the passenger.

In some possible embodiments, the health consultation sub-part further includes an acquisition unit, a determination unit and a sending unit, wherein: the acquisition unit is configured to, with the authorization of the occupant, during the online health consultation process Obtain the historical physiological state detection record of the occupant; the determination unit is configured to determine the historical detection results corresponding to the abnormal indicators in the historical physiological state detection record; the sending unit is configured to provide the online doctor with Send historical detection results corresponding to the abnormal indicators.

In some possible embodiments, the device further includes a request part and a session establishment part, wherein: the request part is configured to initiate, in response to receiving a trigger operation through the online health consultation control in the central control screen in the vehicle, Online health consultation request; the session establishment part is configured to establish a session between the passenger and the online doctor based on the online health consultation request for online health consultation.

In some possible embodiments, before detecting the physiological state of the occupant based on the image, the device further includes a determining part configured to determine that the vehicle is in a parked state based on the acquired body signal, or based on The obtained vehicle body signal determines that the vehicle is in a smooth driving state.

The description of the above device embodiment is similar to the description of the above method embodiment, and has similar beneficial effects as the method embodiment. In some embodiments, the functions or included parts of the device provided by the embodiments of the present disclosure can be configured to perform the methods described in the above method embodiments. For technical details not disclosed in the embodiments of the device of the present disclosure, please refer to the methods of the present disclosure. be understood from the description of the embodiments.

If the disclosed technical solution involves personal information, the products applying the disclosed technical solution will clearly inform the personal information processing rules and obtain the individual's independent consent before processing personal information. If the disclosed technical solution involves sensitive personal information, the product applying the disclosed technical solution must obtain the individual's separate consent before processing the sensitive personal information, and at the same time meet the requirement of "express consent". For example, setting up clear and conspicuous signs on personal information collection devices such as cameras to inform them that they have entered the scope of personal information collection, and that personal information will be collected. If an individual voluntarily enters the collection scope, it is deemed to have agreed to the collection of his or her personal information; or On personal information processing devices, when using obvious logos/information to inform personal information processing rules, obtain personal authorization through pop-up messages or asking individuals to upload their personal information; among them, personal information processing rules may include personal information processing rules. Information processors, purposes of personal information processing, processing methods, types of personal information processed, etc.

It should be noted that in the embodiments of the present disclosure, if the above physiological state detection method is implemented in the form of a software functional part and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of the present disclosure can be embodied in the form of software products that are essentially or contribute to related technologies. The software product is stored in a storage medium and includes a number of instructions to enable a A computer device (which may be a personal computer, a server, a network device, etc.) executes all or part of the methods described in various embodiments of the present disclosure. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (Read Only Memory, ROM), magnetic disk or optical disk and other media that can store program code. In this way, the embodiments of the present disclosure are not limited to any specific hardware, software, or firmware, or any combination of hardware, software, and firmware.

An embodiment of the present disclosure provides a computer device, including a memory and a processor. The memory stores a computer program that can be run on the processor. When the processor executes the program, some or all of the steps in the above method are implemented.

Embodiments of the present disclosure provide a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, some or all of the steps in the above method are implemented. The computer-readable storage medium may be transient or non-transitory.

Embodiments of the present disclosure provide a computer program, including computer readable code, where the computer readable code When running in a computer device, the processor in the computer device executes some or all of the steps for implementing the above method.

Embodiments of the present disclosure provide a computer program product. The computer program product includes a non-transitory computer-readable storage medium storing a computer program. When the computer program is read and executed by a computer, some of the above methods are implemented or All steps. The computer program product can be implemented specifically through hardware, software or a combination thereof. In some embodiments, the computer program product is embodied as a computer storage medium. In other embodiments, the computer program product is embodied as a software product, such as a software development kit (Software Development Kit, SDK) and so on.

It should be noted here that the above description of various embodiments tends to emphasize the differences between the various embodiments, and the similarities or similarities may be referred to each other. The description of the above embodiments of equipment, storage media, computer programs and computer program products is similar to the description of the above method embodiments, and has similar beneficial effects as the method embodiments. For technical details not disclosed in the embodiments of the disclosed equipment, storage media, computer programs and computer program products, please refer to the description of the disclosed method embodiments for understanding.

It should be noted that Figure 7 is a schematic diagram of a hardware entity of a computer device in an embodiment of the present disclosure. As shown in Figure 7, the hardware entity of the computer device 700 includes: a processor 701, a communication interface 702 and a memory 703, where:

Processor 701 generally controls the overall operation of computer device 700 .

Communication interface 702 can enable the computer device to communicate with other terminals or servers through a network.

The memory 703 is configured to store instructions and applications executable by the processor 701, and can also cache data to be processed or processed by the processor 701 and various parts of the computer device 700 (for example, image data, audio data, voice communication data and Video communication data), which can be implemented through flash memory (FLASH) or random access memory (Random Access Memory, RAM). Data transmission can be carried out between the processor 701, the communication interface 702 and the memory 703 through the bus 704.

It will be understood that reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure, or characteristic associated with the embodiment is included in at least one embodiment of the present disclosure. Thus, the appearances of "in one embodiment" or "in an embodiment" in various places throughout this specification are not necessarily referring to the same embodiment. Furthermore, the particular features, structures or characteristics may be combined in any suitable manner in one or more embodiments. It should be understood that in various embodiments of the present disclosure, the size of the serial numbers of the above steps/processes does not mean the order of execution. The execution order of each step/process should be determined by its functions and internal logic, and should not be The implementation process of the embodiments of the present disclosure constitutes no limitations. The above serial numbers of the embodiments of the present disclosure are only for description and do not represent the advantages and disadvantages of the embodiments.

It should be noted that, in this document, the terms "comprising", "comprises" or any other variations thereof are intended to cover a non-exclusive inclusion, such that a process, method, article or device that includes a series of elements not only includes those elements, It also includes other elements not expressly listed or inherent in the process, method, article or apparatus. Without further limitation, an element defined by the statement "comprises a..." does not exclude the presence of additional identical elements in a process, method, article or apparatus that includes that element.

In the several embodiments provided in this disclosure, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods, such as: multiple units or components may be combined, or can be integrated into another system, or some features can be ignored, or not implemented. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection of the devices or units may be electrical, mechanical, or other forms. of.

The units described above as separate components may or may not be physically separated; the components shown as units may or may not be physical units; they may be located in one place or distributed to multiple network units; Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment. In addition, each functional unit in each embodiment of the present disclosure can be all integrated into one processing unit, or each unit can be separately used as a unit, or two or more units can be integrated into one unit; the above-mentioned integration The unit can be implemented in the form of hardware or in the form of hardware plus software functional units.

Those of ordinary skill in the art can understand that all or part of the steps to implement the above method embodiments can be completed through hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, the execution includes: The steps of the above method embodiment; and the aforementioned storage media include: mobile storage devices, read-only memory (Read Only Memory, ROM), magnetic disks or optical disks and other various media that can store program codes.

Alternatively, if the above-mentioned integrated units of the present disclosure are implemented in the form of software functional parts and sold or used as independent products, they can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present disclosure can be embodied in the form of a software product in essence or that contributes to related technologies. The computer software product is stored in a storage medium and includes a number of instructions to enable a computer. A computer device (which may be a personal computer, a server, a network device, etc.) executes all or part of the methods described in various embodiments of the present disclosure. The aforementioned storage media include: mobile storage devices, ROMs, magnetic disks or optical disks and other media that can store program codes.

The above are only embodiments of the present disclosure, but the protection scope of the present disclosure is not limited thereto. Any person familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present disclosure, and should are covered by the protection scope of this disclosure.

Industrial applicability

In the embodiment of the present disclosure, in response to receiving a request to detect the physiological status of the occupant in the vehicle, an image of the occupant collected through a vehicle-mounted camera is obtained; the physiological status of the occupant is detected based on the image, and the physiological status of the occupant is obtained. Status detection results: analyze the physiological status detection results, and push online health consultation services to the occupants if there are abnormal indicators in the physiological status detection results. The above solution allows users to promptly contact professional doctors for evaluation and analysis when abnormal indicators appear after physiological status testing. Through the targeted introduction of the health consulting service function of the medical platform, the health functions of smart cars have been broadened.

Claims (23)

A physiological state detection method, the method includes: In response to receiving a request to detect the physiological state of an occupant in the vehicle, obtain an image of the occupant collected through a vehicle-mounted camera; Detect the physiological state of the occupant based on the image and obtain a physiological state detection result; The physiological state detection results are analyzed, and if there are abnormal indicators in the physiological state detection results, online health consultation services are pushed to the occupants. The method according to claim 1, wherein the method is applied to vehicle-mounted equipment or user mobile equipment, and the method further includes: Obtain a request for physiological status detection of the occupants in the vehicle sent to the vehicle-mounted device or the user mobile device through the central control screen in the vehicle. The method of claim 1 or 2, wherein after obtaining the image of the occupant collected by a vehicle-mounted camera, the method further includes: Perform face recognition on the image of the passenger to obtain the recognition result; If it is determined that the passenger is not registered based on the identification result, create a profile of the passenger; The occupant's physiological state detection results are stored in the occupant's file. The method according to any one of claims 1 to 3, wherein analyzing the physiological state detection results includes: Determine whether the value of each physiological indicator in the physiological state detection result is within the corresponding preset indicator interval, and obtain a determination result; The method also includes: Based on the determination result, prompt information is output to the occupant; the prompt information includes the medical meaning of each physiological indicator and/or suggestions for abnormal physiological indicators of the occupant. The method according to any one of claims 1 to 4, wherein, when there are abnormal indicators in the physiological state detection results, pushing online health consultation services to the occupants includes: If there are abnormal indicators in the physiological state detection results, match the passenger with an online doctor in the department corresponding to the abnormal indicators; An online session is established between the occupant and the online doctor for online health consultation. The method of claim 5, wherein establishing an online session between the occupant and the online doctor for online health consultation includes: Display the online health consultation window corresponding to the online doctor through the central control screen in the vehicle; In response to the passenger's confirmation opening operation on the online health consultation window, a video call with the online doctor is established, and the video call picture is displayed on the central control screen in the vehicle. The method of claim 6, further comprising: In response to the end of the online health consultation, the video call is closed and a consultation report is output to the occupant; the consultation report is generated and uploaded by the online doctor based on the occupant's online health consultation. The method according to any one of claims 5 to 7, wherein the method further includes: With the authorization of the passenger, obtain the historical physiological state detection record of the passenger; Determine the historical detection results corresponding to the abnormal indicators in the historical physiological state detection records; Send historical detection results corresponding to the abnormal indicators to the online doctor. The method according to any one of claims 1 to 8, wherein the method further includes: In response to receiving a trigger operation for the online health consultation control in the central control screen in the vehicle, initiate an online health consultation request; Based on the online health consultation request, a session between the passenger and an online doctor is established for online health consultation. The method according to any one of claims 1 to 9, wherein before detecting the physiological state of the occupant based on the image, the method further includes: Determine that the vehicle is in a parked state based on the obtained body signal, or It is determined that the vehicle is in a smooth driving state based on the obtained vehicle body signals. A physiological state detection device, the device includes: an acquisition part, a detection part and a health consultation part, wherein: The acquisition part is configured to acquire the image of the occupant collected by the vehicle camera in response to receiving a request to detect the physiological state of the occupant in the vehicle; The detection part is configured to detect the physiological state of the occupant based on the image and obtain a physiological state detection result; The health consultation part is configured to analyze the physiological status detection results, and push online health consultation services to the occupants if there are abnormal indicators in the physiological status detection results. The device of claim 11, wherein the device is applied to vehicle-mounted equipment or user mobile equipment, and the device further includes a request acquisition part configured to obtain a request to the vehicle-mounted equipment or user through a central control screen in the vehicle. A request sent by the user's mobile device to detect the physiological status of the occupants in the vehicle. The device according to claim 11 or 12, wherein after acquiring the image of the occupant collected by a vehicle-mounted camera, the device further includes: The recognition part is configured to perform face recognition on the image of the passenger and obtain the recognition result; A profile creation part configured to create a profile of the occupant if it is determined that the occupant is not registered based on the recognition result; The archiving part is configured to store the physiological status detection results of the occupant in the occupant's file. The device according to any one of claims 11 to 13, wherein the detection part is further configured to determine whether the value of each physiological indicator in the physiological state detection result is within the corresponding preset indicator interval, and obtain a determination result. ; The device further includes: an output sub-section configured to output prompt information to the occupant based on the determination result; the prompt information includes the medical meaning of each of the physiological indicators and/or abnormalities for the occupant Recommendations for physiological indicators. The device according to any one of claims 11 to 14, wherein the health consultation part includes: The matching sub-part is configured to, in response to the presence of an abnormal indicator in the physiological state detection result, match the passenger with an online doctor in a department corresponding to the abnormal indicator; The health consultation sub-section is configured to establish an online session between the passenger and the online doctor for online health consultation. The device of claim 15, wherein the health advisory subsection includes: A pop-up window display unit configured to display the online health consultation window corresponding to the online doctor through the central control screen in the vehicle; A session display unit configured to respond to the occupant's confirmation opening operation on the online health consultation window, establish a video call with the online doctor, and display the video call screen through the central control screen in the vehicle . The device of claim 16, wherein the health consultation subsection further includes: The report output unit is configured to close the video call screen and output a consultation report to the occupant in response to the end of the online health consultation; the consultation report is generated and uploaded by the online doctor based on the online health consultation of the occupant. The device according to any one of claims 15 to 17, wherein the health consultation sub-part further includes: An acquisition unit configured to acquire the online health consultation process with the authorization of the occupant. The historical physiological status detection record of the occupants; a determination unit configured to determine historical detection results corresponding to the abnormal indicators in the historical physiological state detection records; A sending unit configured to send historical detection results corresponding to the abnormal indicators to the online doctor. The device according to any one of claims 11 to 18, wherein the device further includes: The request part is configured to initiate an online health consultation request in response to receiving a trigger operation through the online health consultation control in the central control screen in the vehicle; The session establishment part is configured to establish a session between the passenger and the online doctor based on the online health consultation request for online health consultation. The device according to any one of claims 11 to 19, wherein before detecting the physiological state of the occupant based on the image, the device further includes: The determining part is configured to determine that the vehicle is in a parked state according to the acquired body signal, or to determine that the vehicle is in a smooth driving state based on the acquired body signal. A computer device, including a memory and a processor. The memory stores a computer program that can be run on the processor. When the processor executes the program, the steps in the method of any one of claims 1 to 10 are implemented. . A computer-readable storage medium on which a computer program is stored, which implements the steps of the method of any one of claims 1 to 10 when executed by a processor. A computer program product comprising computer readable code, when the computer readable code is run in an electronic device, a processor in the electronic device executes a configuration configured to implement any one of claims 1 to 10 method.