HK1248006B - Health tracking device - Google Patents
Health tracking device Download PDFInfo
- Publication number
- HK1248006B HK1248006B HK18107175.2A HK18107175A HK1248006B HK 1248006 B HK1248006 B HK 1248006B HK 18107175 A HK18107175 A HK 18107175A HK 1248006 B HK1248006 B HK 1248006B
- Authority
- HK
- Hong Kong
- Prior art keywords
- user
- classification model
- sensor data
- processors
- user device
- Prior art date
Links
Description
技术领域Technical Field
本发明涉及健康跟踪设备。The present invention relates to health tracking devices.
背景技术Background Art
可佩戴式健身跟踪器可基于接收自传感器的传感器数据对用户活动执行测量。例如,可佩戴式健身跟踪器可包括加速度计,所述加速度计提供传感器数据以估计锻炼阶段期间的用户活动。可佩戴式健身跟踪器可提供与锻炼阶段期间的用户活动相关联的信息以供显示。例如,可佩戴式健身跟踪器可基于来自加速度计的传感器数据估计一个或多个度量(诸如估计的行进距离、估计的卡路里消耗度量、估计的代谢当量(MET)度量等),并且可提供所述一个或多个度量以供显示。A wearable fitness tracker may perform measurements of user activity based on sensor data received from a sensor. For example, a wearable fitness tracker may include an accelerometer that provides sensor data to estimate user activity during an exercise session. The wearable fitness tracker may provide information associated with the user activity during the exercise session for display. For example, the wearable fitness tracker may estimate one or more metrics (such as an estimated distance traveled, an estimated calorie expenditure metric, an estimated metabolic equivalent (MET) metric, etc.) based on the sensor data from the accelerometer and may provide the one or more metrics for display.
发明内容Summary of the Invention
根据某些可能的实施方式,一种设备可包括一个或多个处理器。所述一个或多个处理器可从多个传感器接收与用户有关的传感器数据。所述多个传感器可包括多种类型的传感器,所述多种类型的传感器包括加速度计、心率传感器、血压传感器、血糖传感器、汗液传感器、皮肤导电率传感器或成像传感器中的一个或多个、以及光谱仪。所述一个或多个处理器可处理所述传感器数据以确定所述用户的健康状况,所述传感器数据来自所述多种类型的传感器且与所述用户有关。所述一个或多个处理器可基于处理所述传感器数据,经由用户界面提供识别所述用户的健康状况的信息,所述传感器数据来自所述多种类型的传感器且与所述用户有关。According to some possible embodiments, a device may include one or more processors. The one or more processors may receive sensor data related to a user from a plurality of sensors. The plurality of sensors may include multiple types of sensors, the multiple types of sensors including one or more of an accelerometer, a heart rate sensor, a blood pressure sensor, a blood glucose sensor, a sweat sensor, a skin conductivity sensor, or an imaging sensor, and a spectrometer. The one or more processors may process the sensor data to determine the health status of the user, the sensor data being from the multiple types of sensors and being related to the user. The one or more processors may provide information identifying the health status of the user via a user interface based on processing the sensor data, the sensor data being from the multiple types of sensors and being related to the user.
根据某些可能的实施方式,一种非暂时性计算机可读介质可存储一个或多个指令,所述一个或多个指令在由一个或多个处理器执行时可使得所述一个或多个处理器接收第一光谱分类模型。所述第一光谱分类模型可与基于化学计量特征识别健康状况相关联。所述第一光谱分类模型可基于利用光谱仪对一组对象执行的校准而生成。所述一个或多个指令在由一个或多个处理器执行时可使得所述一个或多个处理器获得关于用户的一组属性。所述一组属性包括关于所述用户的第一传感器数据。所述一个或多个指令在由一个或多个处理器执行时可使得所述一个或多个处理器基于所述第一光谱分类模型和关于所述用户的所述一组属性生成第二光谱分类模型。所述第二光谱分类模型可允许确定所述用户或食品(food item)的特性。所述一个或多个指令在由一个或多个处理器执行时可使得所述一个或多个处理器基于关于所述用户的第二传感器数据周期性地更新所述第二光谱分类模型。According to certain possible embodiments, a non-transitory computer-readable medium may store one or more instructions that, when executed by one or more processors, may cause the one or more processors to receive a first spectral classification model. The first spectral classification model may be associated with identifying a health condition based on chemometric features. The first spectral classification model may be generated based on a calibration performed on a group of objects using a spectrometer. When executed by one or more processors, the one or more instructions may cause the one or more processors to obtain a set of attributes about a user. The set of attributes includes first sensor data about the user. When executed by one or more processors, the one or more instructions may cause the one or more processors to generate a second spectral classification model based on the first spectral classification model and the set of attributes about the user. The second spectral classification model may allow the characteristics of the user or food item to be determined. When executed by one or more processors, the one or more instructions may cause the one or more processors to periodically update the second spectral classification model based on second sensor data about the user.
根据某些可能的实施方式,一种方法可包括由设备基于第一传感器数据确定用户的活动水平,所述第一传感器数据与所述用户的所述活动水平有关且来自第一组传感器。所述方法可包括由所述设备基于第二传感器数据确定用于由所述用户消耗的一组食品的营养含量,所述第二传感器数据与所述一组食品的营养含量有关且来自第二组传感器。所述第二传感器数据可从光谱仪获得。所述方法可包括由所述设备获得针对所述用户的存储的饮食和锻炼计划。所存储的饮食和锻炼计划可包括与所述用户的活动水平以及用于由所述用户消耗的所述一组食品的营养含量有关的目标。所述方法可包括由所述设备基于所述用户的活动水平以及所述一组食品的营养含量确定用户对所存储的饮食和锻炼计划的遵从性。所述方法可包括由所述设备基于确定用户对所存储的饮食和锻炼计划的遵从性,提供与用户对所存储的饮食和锻炼计划的遵从性有关的建议。According to certain possible embodiments, a method may include determining, by a device, an activity level of a user based on first sensor data, the first sensor data being related to the activity level of the user and coming from a first set of sensors. The method may include determining, by the device, a nutritional content of a group of foods for consumption by the user based on second sensor data, the second sensor data being related to the nutritional content of the group of foods and coming from a second set of sensors. The second sensor data may be obtained from a spectrometer. The method may include obtaining, by the device, a stored diet and exercise plan for the user. The stored diet and exercise plan may include goals related to the activity level of the user and the nutritional content of the group of foods for consumption by the user. The method may include determining, by the device, the user's compliance with the stored diet and exercise plan based on the user's activity level and the nutritional content of the group of foods. The method may include providing, by the device, recommendations related to the user's compliance with the stored diet and exercise plan based on the determination of the user's compliance with the stored diet and exercise plan.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
图1为本文所述的示例性实施方式的概述的图;FIG1 is a diagram outlining an exemplary embodiment described herein;
图2为可实施本文所述的系统和/或方法的示例性环境的图;FIG2 is a diagram of an exemplary environment in which the systems and/or methods described herein may be implemented;
图3为图2的一个或多个设备的示例性组件的图;FIG3 is a diagram of exemplary components of one or more devices of FIG2;
图4为用于基于与多个传感器相关联的传感器数据提供健康信息的示例性处理的流程图;4 is a flow chart of an exemplary process for providing health information based on sensor data associated with a plurality of sensors;
图5A至5D为与图4中所示的示例性处理有关的示例性实施方式的图;5A to 5D are diagrams of exemplary embodiments related to the exemplary process shown in FIG. 4 ;
图6为用于将分类模型进行动态地更新以用于光谱分析的示例性处理的流程图;以及FIG6 is a flow chart of an exemplary process for dynamically updating a classification model for spectral analysis; and
图7A和7B为与图6中所示的示例性处理有关的示例性实施方式的图。7A and 7B are diagrams of an exemplary embodiment related to the exemplary process shown in FIG. 6 .
具体实施方式DETAILED DESCRIPTION
以下对示例性实施方式的详细描述参照附图。不同附图中的相同附图标号可表示相同或类似元件。The following detailed description of exemplary embodiments refers to the accompanying drawings, in which the same reference numerals in different drawings may represent the same or similar elements.
可佩戴式健身跟踪器可利用一组加速度计来获得关于用户活动的传感器数据。例如,可佩戴式健身跟踪器可基于识别可佩戴式健身跟踪器的移动的传感器数据,确定所估计的用户的行进距离。可佩戴式健身跟踪器可包括可用于估计与用户活动有关的一个或多个度量的信息。例如,可佩戴式健身跟踪器可基于所估计的行进距离和将行驶距离与普通人的卡路里消耗量相关的通用信息,估计卡路里消耗量。A wearable fitness tracker may utilize a set of accelerometers to obtain sensor data regarding a user's activity. For example, the wearable fitness tracker may determine an estimated distance traveled by the user based on the sensor data identifying movement of the wearable fitness tracker. The wearable fitness tracker may include information that can be used to estimate one or more metrics related to the user's activity. For example, the wearable fitness tracker may estimate calorie consumption based on the estimated distance traveled and general information relating travel distance to calorie consumption for an average person.
然而,利用通用相关性来确定一个或多个度量可造成对于特定用户的不精确计算。另外,可佩戴式健身跟踪器可能无法考虑除了锻炼除之外的影响用户健康的因素(营养、情绪、疾病等),由此限制了可佩戴式健身跟踪器的有用性。本文所述的实施方式可利用与多个传感器相关联的传感器数据来提供与用户相关联的健康信息。以此方式,单个用户设备可确定用户的健康信息,从而消除了用户对利用多个不同设备的需要,由此相对于利用多个不同设备用于健康跟踪而降低了成本、功耗等。另外,用户设备可利用来自多个传感器的传感器数据来促进对模型的校准以用于光谱分析,由此相对于利用未基于来自其它传感器的传感器数据校准的模型而改善了模型的精确度。However, utilizing general correlations to determine one or more metrics may result in inaccurate calculations for a particular user. Additionally, a wearable fitness tracker may not take into account factors other than exercise that affect a user's health (nutrition, mood, illness, etc.), thereby limiting the usefulness of the wearable fitness tracker. The embodiments described herein may utilize sensor data associated with multiple sensors to provide health information associated with a user. In this manner, a single user device may determine the user's health information, thereby eliminating the need for the user to utilize multiple different devices, thereby reducing costs, power consumption, etc. relative to utilizing multiple different devices for health tracking. Additionally, the user device may utilize sensor data from multiple sensors to facilitate calibration of a model for spectral analysis, thereby improving the accuracy of the model relative to utilizing a model that has not been calibrated based on sensor data from other sensors.
图1为本文所述的示例性实施方式100的概述的图。如图1中所示,示例性实施方式100包括用户设备、健康护理提供商应用服务器以及光谱校准应用服务器。Figure 1 is a diagram that provides an overview of an exemplary embodiment 100 described herein. As shown in Figure 1, exemplary embodiment 100 includes a user device, a healthcare provider application server, and a spectral calibration application server.
如图1中进一步所示,用户设备可从多个传感器接收传感器数据(例如,从第一传感器接收第一传感器数据、从第二传感器接收第二传感器数据、……、从第n传感器接收第n传感器数据)。例如,用户设备210可利用一组集成式传感器来获得传感器数据(诸如利用集成式加速度计传感器来获得用户活动数据、利用集成式心率传感器来获得心率数据,利用集成式温度传感器来获得温度数据,等等)。另外、或替代地,用户设备可利用相机来获得传感器数据。例如,用户设备可利用集成式相机来捕捉图像,诸如用户面部的图像(例如,用于面部识别分析)、用户皮肤的图像(例如,用于皮肤状况分析)、一组食物(food)图像(例如,用于对食物执行体积(volumetric)分析的一组图像)等。另外、或替代地,用户设备可利用光谱传感器来获得传感器数据。例如,用户设备可利用光谱传感器来确定对象(例如,用户或食品)的化学计量特征(signature),并且可基于化学计量特征和分类模型将对象分类。在另一个实例中,用户设备可与一个或多个传感器进行通信以获得传感器数据。例如,用户设备可利用至医疗设备的连接以获得由医疗设备记录的传感器数据。As further shown in FIG. 1 , the user device may receive sensor data from multiple sensors (e.g., receiving first sensor data from a first sensor, receiving second sensor data from a second sensor, ..., receiving nth sensor data from an nth sensor). For example, the user device 210 may utilize a set of integrated sensors to obtain sensor data (such as utilizing an integrated accelerometer sensor to obtain user activity data, utilizing an integrated heart rate sensor to obtain heart rate data, utilizing an integrated temperature sensor to obtain temperature data, etc.). Additionally or alternatively, the user device may utilize a camera to obtain sensor data. For example, the user device may utilize an integrated camera to capture images, such as images of a user's face (e.g., for facial recognition analysis), images of a user's skin (e.g., for skin condition analysis), a set of food images (e.g., a set of images for performing volumetric analysis on the food), etc. Additionally or alternatively, the user device may utilize a spectral sensor to obtain sensor data. For example, the user device may utilize a spectral sensor to determine a chemometric signature of an object (e.g., a user or food) and may classify the object based on the chemometric signature and a classification model. In another example, the user device can communicate with one or more sensors to obtain sensor data. For example, the user device can utilize a connection to a medical device to obtain sensor data recorded by the medical device.
如图1中进一步所示,用户设备可将来自多个传感器的传感器数据进行组合以生成关于用户的健康信息。例如,基于关于用户活动水平、用户心率、用户体温等的传感器数据以及存储的关于用户身高、用户体重等的信息,用户设备可确定用户的卡路里消耗量,所述卡路里消耗量与锻炼安排相关联。基于还利用除加速度计数据之外的信息(例如,用户心率数据和/或用户体温数据),与基于仅利用加速度计数据相比,用户设备可获得卡路里消耗量的更精确确定。As further shown in FIG1 , the user device may combine sensor data from multiple sensors to generate health information about the user. For example, based on sensor data about the user's activity level, the user's heart rate, the user's body temperature, etc., and stored information about the user's height, the user's weight, etc., the user device may determine the user's calorie consumption, which is associated with an exercise schedule. By also utilizing information other than accelerometer data (e.g., user's heart rate data and/or user's body temperature data), the user device may obtain a more accurate determination of calorie consumption than would be possible based on utilizing only accelerometer data.
类似地,基于图像传感器数据和光谱传感器数据,用户设备可分别确定食品的体积和食品的营养含量。基于利用识别食品的成分的光谱传感器数据和识别食品的体积的传感器数据,与基于利用对营养价值进行的用户估计相比,所述用户设备可获得用户的卡路里摄入量的更精确确定。基于卡路里消耗量确定和卡路里摄入量确定,用户设备可确定用户的净卡路里消耗,并且可生成与净卡路里消耗相关联的建议,诸如营养建议、锻炼建议等,以改善用户健康和/或用户对饮食和锻炼计划的遵从性。以此方式,用户设备执行比由可佩戴式健身跟踪器执行的确定更精确的与用户健康有关的确定,由此允许改善健身跟踪。Similarly, based on the image sensor data and the spectral sensor data, the user device can determine the volume of the food and the nutritional content of the food, respectively. Based on the use of spectral sensor data that identifies the ingredients of the food and sensor data that identifies the volume of the food, the user device can obtain a more accurate determination of the user's caloric intake than based on the use of user estimates of nutritional value. Based on the calorie expenditure determination and the calorie intake determination, the user device can determine the user's net calorie expenditure and can generate recommendations associated with the net calorie expenditure, such as nutritional recommendations, exercise recommendations, etc., to improve the user's health and/or the user's compliance with a diet and exercise plan. In this way, the user device performs more accurate determinations related to the user's health than determinations performed by a wearable fitness tracker, thereby allowing for improved fitness tracking.
作为另一个实例,用户设备可处理传感器数据以确定关于用户的诊断信息。例如,基于对用户的图像执行图案识别分析,用户设备可检测与红斑痤疮状况相关联的面部发红和丘疹。类似地,基于对用户的图像执行图案识别分析,用户设备可确定用户处于舒适状态,并且可将舒适状态与其它传感器数据(诸如指示用户先前已经吃了特定食品的传感器数据)进行关联。在此情况中,用户设备可周期性地提供与改变用户情绪有关的建议,诸如用户吃与舒适状态相关的特定食品的建议。As another example, a user device may process sensor data to determine diagnostic information about the user. For example, based on pattern recognition analysis performed on an image of the user, the user device may detect facial redness and pimples associated with the condition rosacea. Similarly, based on pattern recognition analysis performed on an image of the user, the user device may determine that the user is in a state of well-being and may correlate this state of well-being with other sensor data, such as sensor data indicating that the user has previously eaten a particular food. In this case, the user device may periodically provide suggestions related to altering the user's mood, such as suggesting that the user eat a particular food associated with the state of well-being.
作为另一个实例,用户设备可处理光谱传感器数据以校准用于光谱学的分类模型。例如,用户设备可利用第一模型来对第一光谱传感器数据执行第一分类,诸如将观察到的化学计量特征分类为与有特定的血压并且吃了特定食品后的特定的人有关。在此情况中,用户设备可基于第一光谱传感器数据和其它传感器数据(例如,识别特定血压和特定食品的传感器数据)校准第一模型以生成第二模型,并且可利用第二模型来对第二光谱传感器数据执行另一分类。例如,用户设备可利用第二分类模型来在当与特定的血压相关联时的特定的人和当与另一血压相关联时的特定的人之间进行区分。以此方式,用户设备改进分类模型以相对于未基于其它传感器数据改进的分类模型而以改善的精确度执行光谱学。As another example, the user device may process spectral sensor data to calibrate a classification model for spectroscopy. For example, the user device may utilize a first model to perform a first classification on the first spectral sensor data, such as classifying an observed chemometric feature as being associated with a specific person having a specific blood pressure and after eating a specific food. In this case, the user device may calibrate the first model based on the first spectral sensor data and other sensor data (e.g., sensor data identifying a specific blood pressure and a specific food) to generate a second model, and may utilize the second model to perform another classification on the second spectral sensor data. For example, the user device may utilize the second classification model to distinguish between a specific person when associated with a specific blood pressure and a specific person when associated with another blood pressure. In this way, the user device improves the classification model to perform spectroscopy with improved accuracy relative to a classification model that is not improved based on other sensor data.
如图1中进一步所示,用户设备可基于处理来自多个传感器的传感器数据提供信息,诸如与用户有关的健康信息、与用户的健康状况有关的诊断信息、与改善用户健康和/或对饮食和锻炼计划的遵从性有关的建议等。对饮食和锻炼计划的遵从性可与降低健康状况(例如,心脏病状况或肥胖症状况)的严重程度、管理健康状况的症状(例如,糖尿病健康状况或压力状况)、降低健康状况恶化的可能性(例如,退行性疾病)、实现期望的健康状况(例如,改善饮食、增加全谷物摄入量、增加肌肉质量或改善运动表现)相关联。例如,用户设备可提供实时健康更新以经由用户界面进行显示,所述实时健康更新诸如指示基于卡路里消耗量和卡路里摄入量确定的净卡路里消耗的信息。另外、或替代地,用户设备可提供指示针对用户检测到特定状况的诊断信息,并且可将数据自动地发送至专家以建立用户与专家的预约。另外、或替代地,用户设备可生成建议(诸如对允许用户遵从饮食和锻炼计划的锻炼方案的建议),并且可提供关于用户对饮食和锻炼计划的遵从性的更新以经由另一个设备(例如,私人教练或营养师所利用的用户设备)进行显示。以此方式,用户设备提供针对用户定制的信息而非通用信息。As further shown in FIG1 , the user device may provide information based on processing sensor data from multiple sensors, such as health information related to the user, diagnostic information related to the user's health condition, and recommendations for improving the user's health and/or adherence to a diet and exercise plan. Adherence to a diet and exercise plan may be associated with reducing the severity of a health condition (e.g., a heart condition or an obesity condition), managing symptoms of a health condition (e.g., a diabetic health condition or a stress condition), reducing the likelihood of a health condition worsening (e.g., a degenerative disease), and achieving a desired health condition (e.g., improving diet, increasing whole grain intake, increasing muscle mass, or improving athletic performance). For example, the user device may provide real-time health updates for display via a user interface, such as information indicating net calorie expenditure determined based on calorie consumption and calorie intake. Additionally or alternatively, the user device may provide diagnostic information indicating that a particular condition has been detected for the user, and the data may be automatically sent to a specialist to establish an appointment between the user and the specialist. Additionally or alternatively, the user device may generate recommendations (such as suggestions for exercise regimens that allow the user to adhere to the diet and exercise plan) and may provide updates regarding the user's adherence to the diet and exercise plan for display via another device (e.g., a user device utilized by a personal trainer or nutritionist). In this way, the user device provides information customized to the user rather than generic information.
如图1中进一步所示,用户设备可向健康护理提供商应用服务器提供健康信息,用于将其包括在与用户有关的患者文件中。以此方式,用户设备通过相对于医生依赖于对饮食、锻炼等的手动患者报告而改善数据精确度、并且相对于提供用于接收患者报告的输入和/或修正患者报告的输入的一个或多个用户界面而降低处理资源的利用和/或功耗,来改善医生患者咨询。另外、或替代地,用户设备可向光谱校准应用服务器提供校准数据。例如,用户设备可提供从光谱传感器和/或其它传感器确定的校准信息,以用于在校准和/或改进被提供给一个或多个其它用户设备的分类模型时利用,由此相对于接收未基于校准信息校准的模型的所述一个或多个其它用户设备而改善了用于所述一个或多个其它用户设备的光谱精确度。As further shown in Figure 1, the user device may provide health information to a healthcare provider application server for inclusion in a patient file associated with the user. In this way, the user device improves physician-patient consultations by improving data accuracy relative to a physician's reliance on manual patient reports of diet, exercise, etc., and reducing utilization of processing resources and/or power consumption relative to providing one or more user interfaces for receiving input for and/or modifying patient reports. In addition, or alternatively, the user device may provide calibration data to a spectral calibration application server. For example, the user device may provide calibration information determined from a spectral sensor and/or other sensor for use in calibrating and/or improving a classification model provided to one or more other user devices, thereby improving the spectral accuracy for the one or more other user devices relative to the one or more other user devices receiving a model that is not calibrated based on the calibration information.
以此方式,用户设备提供基于从多个传感器获得的传感器数据确定的健康信息,由此相对于用户利用多个不同的设备而降低了成本和功耗。另外,基于将传感器数据收集和处理集成至单个用户设备中,用户设备允许对不可经由单个传感器获得的健康信息进行确定(诸如基于体积分析和光谱分析这二者获得营养信息,等等)。另外,相对于经由单个设备进行的单次初始校准,用户设备根据基于关于光谱分析的对象的光谱数据和其它传感器数据这二者执行模型校准和模型改进,改善了对用于光谱分析的分类模型的校准。In this way, the user device provides health information determined based on sensor data obtained from multiple sensors, thereby reducing costs and power consumption relative to the user utilizing multiple different devices. In addition, based on the integration of sensor data collection and processing into a single user device, the user device allows for the determination of health information that cannot be obtained via a single sensor (such as nutritional information obtained based on both volumetric analysis and spectral analysis, etc.). In addition, relative to a single initial calibration performed via a single device, the user device performs model calibration and model improvement based on both spectral data of an object for spectral analysis and other sensor data, thereby improving the calibration of the classification model used for spectral analysis.
如上文所指示,图1仅仅是作为实例而提供。其它实例是可能的并且可不同于已关于图1所述的实例。As indicated above, FIG1 is provided merely as an example. Other examples are possible and may differ from the example that has been described with respect to FIG1 .
图2为可实施本文所述的系统和/或方法的示例性环境200的图。如图2中所示,环境200可包括用户设备210、应用服务器220和网络230。环境200的设备可经由有线连接、无线连接或有线连接与无线连接的组合进行互连。Figure 2 is a diagram of an exemplary environment 200 in which the systems and/or methods described herein may be implemented. As shown in Figure 2, environment 200 may include user devices 210, application servers 220, and network 230. The devices of environment 200 may be interconnected via wired connections, wireless connections, or a combination of wired and wireless connections.
用户设备210包括能够接收、生成、存储、处理和/或提供健康信息的一个或多个设备。例如,用户设备210可包括通信和/或计算设备,诸如移动电话(例如,智能电话、无线电话等)、膝上型计算机、平板计算机、手持式计算机、游戏设备、可佩戴式设备(例如,智能腕表、一副智能眼镜、智能腕带等)、医疗设备、光谱设备(例如,可佩戴式光谱仪设备,其执行近红外(NIR)光谱学、中红外(中-IR)光谱学或拉曼光谱学)或类似类型的设备。在某些实施方式中,光谱设备可包括高光谱仪(例如,高光谱成像传感器)。在某些实施方式中,用户设备210可从环境200中的另一个设备接收信息和/或将信息发送至环境200中的另一个设备。The user device 210 includes one or more devices capable of receiving, generating, storing, processing, and/or providing health information. For example, the user device 210 may include a communication and/or computing device, such as a mobile phone (e.g., a smartphone, a wireless phone, etc.), a laptop computer, a tablet computer, a handheld computer, a gaming device, a wearable device (e.g., a smartwatch, a pair of smart glasses, a smart wristband, etc.), a medical device, a spectroscopic device (e.g., a wearable spectrometer device that performs near-infrared (NIR) spectroscopy, mid-infrared (mid-IR) spectroscopy, or Raman spectroscopy), or a similar type of device. In some embodiments, the spectroscopic device may include a hyperspectrometer (e.g., a hyperspectral imaging sensor). In some embodiments, the user device 210 may receive information from another device in the environment 200 and/or send information to another device in the environment 200.
应用服务器220包括能够存储、处理和/或路由信息(诸如健康信息、校准信息等)的一个或多个设备。例如,应用服务器220可包括利用健康信息和/或与用户设备210相关联的信息的服务器。在某些实施方式中,应用服务器220可包括校准应用服务器220,所述校准应用服务器220接收与基于由一个或多个用户设备210执行的一组测量对光谱模型进行的校准相关联的信息。另外、或替代地,应用服务器220可包括与路由用于健康护理提供商的信息相关联的健康护理提供商应用服务器220(诸如医院服务器等)。在某些实施方式中,应用服务器220可从环境200中的另一个设备接收信息和/或将信息发送至环境200中的另一个设备。The application server 220 includes one or more devices capable of storing, processing, and/or routing information (such as health information, calibration information, etc.). For example, the application server 220 may include a server that utilizes health information and/or information associated with the user device 210. In some embodiments, the application server 220 may include a calibration application server 220 that receives information associated with calibration of a spectral model based on a set of measurements performed by one or more user devices 210. Additionally or alternatively, the application server 220 may include a healthcare provider application server 220 (such as a hospital server, etc.) associated with routing information for healthcare providers. In some embodiments, the application server 220 may receive information from another device in the environment 200 and/or send information to another device in the environment 200.
网络230包括一个或多个有线和/或无线网络。例如,网络230可包括蜂窝网络(例如,长期演进(LTE)网络、3G网络,码分多址(CDMA)网络等)、公共陆地移动网络(PLMN)、局域网(LAN)、广域网(WAN)、城域网(MAN)、电话网络(例如,公共交换电话网络(PSTN))、专用网络、自组织(ad hoc)网络、内联网、因特网、基于光纤的网络、云计算网络等、和/或这些或其它类型的网络的组合。The network 230 includes one or more wired and/or wireless networks. For example, the network 230 may include a cellular network (e.g., a Long Term Evolution (LTE) network, a 3G network, a Code Division Multiple Access (CDMA) network, etc.), a public land mobile network (PLMN), a local area network (LAN), a wide area network (WAN), a metropolitan area network (MAN), a telephone network (e.g., a public switched telephone network (PSTN)), a private network, an ad hoc network, an intranet, the Internet, a fiber-optic-based network, a cloud computing network, etc., and/or a combination of these or other types of networks.
图2中所示的设备和网络的数量和布置是作为实例而提供。实际上,与图2中所示的这些设备和网络相比,可能存在额外的设备和/或网络、更少的设备和/或网络、不同的设备和/或网络、或不同布置的设备和/或网络。另外,图2中所示的两个或更多个设备可在单个设备内实施,或图2中所示的单个设备可被实施为多个分布式设备。另外、或替代地,环境200的一组设备(例如,一个或多个设备)可执行一个或多个功能,所述一个或多个功能被描述为由环境200的另一组设备执行。The number and arrangement of the devices and networks shown in Figure 2 are provided as examples. In fact, there may be additional devices and/or networks, fewer devices and/or networks, different devices and/or networks, or devices and/or networks of different arrangements compared to the devices and networks shown in Figure 2. In addition, two or more devices shown in Figure 2 may be implemented within a single device, or the single device shown in Figure 2 may be implemented as multiple distributed devices. Additionally or alternatively, a group of devices (e.g., one or more devices) of environment 200 may perform one or more functions, which are described as being performed by another group of devices of environment 200.
图3为设备300的示例性组件的图。设备300可对应于用户设备210和/或应用服务器220。在某些实施方式中,用户设备210和/或应用服务器220可包括一个或多个设备300和/或设备300的一个或多个组件。如图3中所示,设备300可包括总线310、处理器320、存储器330、存储组件340、输入组件350、输出组件360以及通信接口370。FIG3 is a diagram of exemplary components of a device 300. Device 300 may correspond to user device 210 and/or application server 220. In some embodiments, user device 210 and/or application server 220 may include one or more devices 300 and/or one or more components of device 300. As shown in FIG3 , device 300 may include a bus 310, a processor 320, a memory 330, a storage component 340, an input component 350, an output component 360, and a communication interface 370.
总线310包括允许设备300的组件之间进行通信的组件。处理器320在硬件、固件或硬件与软件的组合中实施。处理器320可包括处理器(例如,中央处理单元(CPU)、图形处理单元(GPU)、加速处理单元(APU)等)、微处理器和/或解译和/或执行指令的任何处理组件(例如,现场可编程门阵列(FPGA)、专用集成电路(ASIC)等)。在某些实施方式中,处理器320可包括能够被编程以执行功能的一个或多个处理器。存储器330包括随机存取存储器(RAM)、只读存储器(ROM)和/或另一种类型的动态或静态存储设备(例如,闪存、磁存储器、光存储器等),所述存储设备存储用于由处理器320使用的信息和/或指令。The bus 310 includes components that allow communication between components of the device 300. The processor 320 is implemented in hardware, firmware, or a combination of hardware and software. The processor 320 may include a processor (e.g., a central processing unit (CPU), a graphics processing unit (GPU), an accelerated processing unit (APU), etc.), a microprocessor, and/or any processing component that interprets and/or executes instructions (e.g., a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), etc.). In certain embodiments, the processor 320 may include one or more processors that can be programmed to perform functions. The memory 330 includes a random access memory (RAM), a read-only memory (ROM), and/or another type of dynamic or static storage device (e.g., flash memory, magnetic storage, optical storage, etc.) that stores information and/or instructions for use by the processor 320.
存储组件340存储与设备300的操作和使用有关的信息和/或软件。例如,存储组件340可包括硬盘(例如,磁盘、光盘、磁光盘、固态盘等)、光盘(CD)、数字通用盘(DVD)、软盘、盒式磁带、磁带和/或另一种类型的非暂时性计算机可读介质,连同对应的驱动器。Storage component 340 stores information and/or software related to the operation and use of device 300. For example, storage component 340 may include a hard disk (e.g., a magnetic disk, an optical disk, a magneto-optical disk, a solid-state disk, etc.), a compact disk (CD), a digital versatile disk (DVD), a floppy disk, a cassette, a magnetic tape, and/or another type of non-transitory computer-readable medium, along with a corresponding drive.
输入组件350包括允许设备300诸如经由用户输入(例如,触摸屏显示器、键盘、小键盘、鼠标、按钮、开关、麦克风等)接收信息的组件。另外、或替代地,输入组件350可包括用于感测信息的传感器(例如,全球定位系统(GPS)组件、加速度计、陀螺仪、致动器等)。输出组件360包括从设备300提供输出信息的组件(例如,显示器、扬声器、一个或多个发光二极管(LED)等)。Input components 350 include components that allow device 300 to receive information, such as via user input (e.g., a touch screen display, a keyboard, a keypad, a mouse, buttons, switches, a microphone, etc.). Additionally or alternatively, input components 350 may include sensors for sensing information (e.g., a global positioning system (GPS) component, an accelerometer, a gyroscope, an actuator, etc.). Output components 360 include components that provide output information from device 300 (e.g., a display, a speaker, one or more light emitting diodes (LEDs), etc.).
通信接口370包括收发器类组件(例如,收发器、单独的接收器和发送器等),其使得设备300能够诸如经由有线连接、无线连接或有线连接与无线连接的组合与其它设备进行通信。通信接口370可允许设备300从另一个设备接收信息和/或向另一个设备提供信息。例如,通信接口370可包括以太网接口、光接口、同轴接口、红外接口、射频(RF)接口、通用串行总线(USB)接口、Wi-Fi接口、蜂窝网络接口等。The communication interface 370 includes transceiver-type components (e.g., a transceiver, a separate receiver and transmitter, etc.) that enable the device 300 to communicate with other devices, such as via a wired connection, a wireless connection, or a combination of a wired connection and a wireless connection. The communication interface 370 can allow the device 300 to receive information from another device and/or provide information to another device. For example, the communication interface 370 can include an Ethernet interface, an optical interface, a coaxial interface, an infrared interface, a radio frequency (RF) interface, a universal serial bus (USB) interface, a Wi-Fi interface, a cellular network interface, etc.
设备300可执行本文所述的一个或多个处理。设备300可响应于处理器320执行由非暂时性计算机可读介质(诸如存储器330和/或存储组件340)存储的软件指令而执行这些处理。计算机可读介质在本文被定义为非暂时性存储器设备。存储器设备包括单个物理存储设备内的存储器空间、或分布遍及多个物理存储设备的存储器空间。Device 300 may perform one or more of the processes described herein. Device 300 may perform these processes in response to processor 320 executing software instructions stored by a non-transitory computer-readable medium, such as memory 330 and/or storage component 340. A computer-readable medium is defined herein as a non-transitory memory device. A memory device includes memory space within a single physical storage device or memory space distributed across multiple physical storage devices.
软件指令可经由通信接口370从另一个计算机可读介质或从另一个设备读取至存储器330和/或存储组件340中。存储在存储器330和/或存储组件340中的软件指令在被执行时可使得处理器320执行本文所述的一个或多个处理。另外、或替代地,可使用硬接线电路替代软件指令或与软件指令进行组合以执行本文所述的一个或多个处理。因此,本文所述的实施方式不受限于硬件电路与软件的任何具体组合。The software instructions may be read from another computer-readable medium or from another device into the memory 330 and/or storage component 340 via the communication interface 370. The software instructions stored in the memory 330 and/or storage component 340, when executed, may cause the processor 320 to perform one or more of the processes described herein. Additionally or alternatively, hard-wired circuitry may be used in place of or in combination with the software instructions to perform one or more of the processes described herein. Thus, the embodiments described herein are not limited to any specific combination of hardware circuitry and software.
图3中所示的组件的数量和布置是作为实例而提供。实际上,与图3中所示的这些组件相比,设备300可包括额外的组件、更少的组件、不同的组件、或不同布置的组件。另外、或替代地,设备300的一组组件(例如,一个或多个组件)可执行一个或多个功能,所述一个或多个功能被描述为由设备300的另一组组件执行。The number and arrangement of components shown in FIG3 are provided as examples. In practice, device 300 may include additional components, fewer components, different components, or components arranged differently than those shown in FIG3. Additionally or alternatively, a group of components (e.g., one or more components) of device 300 may perform one or more functions that are described as being performed by another group of components of device 300.
图4为用于基于与多个传感器相关联的传感器数据提供健康信息的示例性处理400的流程图。在某些实施方式中,图4的一个或多个处理框可由用户设备210执行。在某些实施方式中,图4的一个或多个处理框可由与用户设备210分离或包括用户设备210的另一个设备或一组设备(诸如应用服务器220等)执行。FIG4 is a flow chart of an exemplary process 400 for providing health information based on sensor data associated with a plurality of sensors. In some embodiments, one or more processing blocks of FIG4 may be performed by user device 210. In some embodiments, one or more processing blocks of FIG4 may be performed by another device or group of devices (such as application server 220, etc.) that is separate from or includes user device 210.
如图4中所示,处理400可包括从一组传感器获得传感器数据(框410)。例如,用户设备210可从用户设备210的该组传感器获得传感器数据。在某些实施方式中,用户设备210可基于与该组传感器进行通信而获得传感器数据。例如,用户设备210可使得用户设备210的心跳传感器激活并且记录关于用户的心跳的传感器数据。类似地,用户设备210可使得用户设备210的加速度计传感器激活并且记录关于用户设备210的移动(例如,使用用户设备210的用户的活动)的加速度计传感器数据。As shown in FIG4 , process 400 may include obtaining sensor data from a set of sensors (block 410). For example, user device 210 may obtain sensor data from the set of sensors of user device 210. In some embodiments, user device 210 may obtain sensor data based on communicating with the set of sensors. For example, user device 210 may cause a heartbeat sensor of user device 210 to activate and record sensor data regarding the user's heartbeat. Similarly, user device 210 may cause an accelerometer sensor of user device 210 to activate and record accelerometer sensor data regarding movement of user device 210 (e.g., activity of a user using user device 210).
在某些实施方式中,用户设备210可基于经由用户界面提供提示而获得传感器数据。例如,用户设备210可提供提示以使得用户利用用户设备210来捕捉用户的图像(例如,用户面部的相片或用户皮肤的一部分的相片)。另外、或替代地,用户设备210可提供提示以使得用户利用用户设备210来捕捉食品的图像。例如,用户设备210可用于捕捉膳食的图像,并且可处理膳食的图像以识别膳食的营养含量。另外、或替代地,用户设备210可自动地捕捉图像。例如,用户设备210可诸如基于一天中的时间、基于指示用户设备210在饭店的位置数据、基于指示用户设备210在饭店的社交媒体信息等确定膳食已准备好了,并且可自动地激活成像传感器以捕捉图像。类似地,用户设备210可基于加速度计、基于触摸传感器等确定用户设备210的成像传感器指向用户,并且可使得成像传感器捕捉用户的图像。In certain embodiments, user device 210 may obtain sensor data based on prompts provided via a user interface. For example, user device 210 may provide a prompt to cause the user to utilize user device 210 to capture an image of the user (e.g., a photograph of the user's face or a photograph of a portion of the user's skin). Additionally or alternatively, user device 210 may provide a prompt to cause the user to utilize user device 210 to capture an image of food. For example, user device 210 may be configured to capture an image of a meal and may process the image of the meal to identify the nutritional content of the meal. Additionally or alternatively, user device 210 may capture the image automatically. For example, user device 210 may determine that a meal is ready, such as based on the time of day, location data indicating that user device 210 is at a restaurant, social media information indicating that user device 210 is at a restaurant, etc., and may automatically activate an imaging sensor to capture an image. Similarly, user device 210 may determine that an imaging sensor of user device 210 is pointed at the user based on an accelerometer, a touch sensor, etc., and may cause the imaging sensor to capture an image of the user.
在某些实施方式中,用户设备210可监测成像传感器以获得传感器数据。例如,用户设备210可对经由成像传感器捕捉的一组图像执行目标识别技术,以确定所捕捉的该组图像是否包括可用于提供健康报告的信息,诸如确定特定图像包括食品、确定特定图像包括用户,等等。在此情况中,用户设备210可选择特定图像用于处理(例如,体积分析处理技术、情绪分析处理技术或皮肤状况处理技术)。In certain embodiments, user device 210 may monitor an imaging sensor to obtain sensor data. For example, user device 210 may perform object recognition techniques on a set of images captured via the imaging sensor to determine whether the captured set of images includes information that can be used to provide a health report, such as determining that a particular image includes food, determining that a particular image includes a user, etc. In this case, user device 210 may select a particular image for processing (e.g., a volume analysis processing technique, an emotion analysis processing technique, or a skin condition processing technique).
在某些实施方式中,用户设备210可基于触发获得传感器数据。例如,用户设备210可检测到用户与用户界面的交互,并且可被使得获得传感器数据。另外、或替代地,用户设备210可周期性地获得传感器数据。例如,基于确定已经经过了阈值时间段(例如,一小时、一天或一周),用户设备210可获得传感器数据。类似地,在一天中的特定时间,用户设备210可获得传感器数据。在某些实施方式中,用户设备210可基于其它传感器数据获得所述传感器数据。例如,用户设备210可基于监测心率传感器(例如,基于心率传感器数据)而检测到用户已完成锻炼方案,并且可基于确定用户已完成锻炼方案而获得其它传感器数据。类似地,用户设备210可基于来自光谱仪传感器的化学计量特征传感器数据识别用户,并且可基于识别用户来获得其它传感器数据。In some embodiments, the user device 210 may obtain sensor data based on a trigger. For example, the user device 210 may detect a user's interaction with a user interface and may be caused to obtain sensor data. Additionally or alternatively, the user device 210 may periodically obtain sensor data. For example, based on determining that a threshold time period (e.g., one hour, one day, or one week) has passed, the user device 210 may obtain sensor data. Similarly, at a specific time of day, the user device 210 may obtain sensor data. In some embodiments, the user device 210 may obtain the sensor data based on other sensor data. For example, the user device 210 may detect that the user has completed an exercise program based on monitoring a heart rate sensor (e.g., based on heart rate sensor data), and may obtain other sensor data based on determining that the user has completed the exercise program. Similarly, the user device 210 may identify the user based on chemometric signature sensor data from a spectrometer sensor, and may obtain other sensor data based on identifying the user.
如图4中进一步所示,处理400可包括处理传感器数据以获得健康信息(框420)。例如,用户设备210可处理传感器数据以获得健康信息。在某些实施方式中,用户设备210可处理传感器数据以识别与用户健康有关的一个或多个度量。例如,用户设备210可基于与多种类型的传感器(诸如加速度计、心率传感器、皮肤温度传感器、血压传感器等)相关联的传感器数据来确定活动水平度量。类似地,用户设备210可基于与血压传感器、血糖传感器、汗液传感器、皮肤导电率传感器等相关联的传感器数据确定营养度量。As further shown in FIG4 , process 400 may include processing sensor data to obtain health information (block 420). For example, user device 210 may process sensor data to obtain health information. In some embodiments, user device 210 may process sensor data to identify one or more metrics related to the user's health. For example, user device 210 may determine an activity level metric based on sensor data associated with various types of sensors, such as an accelerometer, a heart rate sensor, a skin temperature sensor, a blood pressure sensor, and the like. Similarly, user device 210 may determine a nutritional metric based on sensor data associated with a blood pressure sensor, a blood glucose sensor, a sweat sensor, a skin conductivity sensor, and the like.
在某些实施方式中,用户设备210可利用特定处理技术来处理传感器数据。例如,用户设备210可利用与分类模型相关联的分类技术来基于光谱测量(例如,化学计量特征)识别食品的含量,并且可基于识别食品的含量来确定与食物消耗有关的健康信息。在某些实施方式中,用户设备210可基于从高光谱仪接收的传感器数据执行分类,这相对于利用另一种类型的传感器可能有用户难度和与距对象的距离有关的误差。另外、或替代地,用户设备210可将图案检测技术、面部识别技术、三维深度感测技术等施加于用户的图像以确定用户情绪、疲劳程度、压力水平、偏头痛症状、皮肤状况等。另外、或替代地,用户设备210可利用颜色分类技术来确定图像中的尿液颜色对应于特定健康状况,诸如特定维生素的不足或过量消耗(例如,B维生素缺乏症)等。In certain embodiments, the user device 210 may utilize specific processing techniques to process the sensor data. For example, the user device 210 may utilize a classification technique associated with a classification model to identify the content of a food based on spectral measurements (e.g., chemometric features), and may determine health information related to food consumption based on the identified content of the food. In certain embodiments, the user device 210 may perform classification based on sensor data received from a hyperspectrometer, which may be user-difficult and have errors related to the distance from the object compared to utilizing another type of sensor. Additionally or alternatively, the user device 210 may apply pattern detection techniques, facial recognition techniques, three-dimensional depth sensing techniques, and the like to an image of the user to determine the user's mood, fatigue level, stress level, migraine symptoms, skin condition, and the like. Additionally or alternatively, the user device 210 may utilize color classification techniques to determine that the color of urine in an image corresponds to a specific health condition, such as insufficient or excessive consumption of a specific vitamin (e.g., B vitamin deficiency), and the like.
另外、或替代地,用户设备210可利用体积分析技术来处理传感器数据。例如,用户设备210可利用食品的一组图像(例如,从不同方向和/或位置捕捉的一组图像)来确定食品的体积。另外、或替代地,用户设备210可利用由深度感测模块、姿势识别模块等捕捉的传感器数据来执行体积分析。在某些实施方式中,用户设备210可基于体积分析确定食品质量。例如,用户设备210可利用识别食品密度的信息(例如,传感器数据、食品的图像识别、或用户对食品的选择和对应的存储的食品密度数据),并且可基于密度来确定食物的质量(例如,其可用于基于以每质量为基础指示营养含量的光谱分析来确定食物的营养含量)。另外、或替代地,用户设备210可利用用户的一组图像来确定用户的一部分的体积,诸如肩峰、皮肤肿块等的体积。以此方式,用户设备210识别对象的体积用于与所述对象在另一时间的体积进行比较,以确定所述对象的营养含量(例如,通过识别作为所述对象的食品的类型的其它传感器数据)等。Additionally or alternatively, the user device 210 may utilize volumetric analysis techniques to process sensor data. For example, the user device 210 may utilize a set of images of the food (e.g., a set of images captured from different directions and/or positions) to determine the volume of the food. Additionally or alternatively, the user device 210 may utilize sensor data captured by a depth sensing module, a gesture recognition module, etc. to perform volumetric analysis. In certain embodiments, the user device 210 may determine the quality of the food based on the volumetric analysis. For example, the user device 210 may utilize information that identifies the density of the food (e.g., sensor data, image recognition of the food, or the user's selection of the food and the corresponding stored food density data), and may determine the quality of the food based on the density (e.g., which may be used to determine the nutritional content of the food based on spectral analysis that indicates the nutritional content on a per-mass basis). Additionally or alternatively, the user device 210 may utilize a set of images of the user to determine the volume of a part of the user, such as the volume of the shoulder, a skin lump, etc. In this manner, user device 210 identifies the volume of an object for comparison with the volume of the object at another time to determine the nutritional content of the object (e.g., by identifying other sensor data as the type of food for the object), etc.
在某些实施方式中,用户设备210可使用比较技术(诸如将在第一时间记录的第一传感器数据与在第二时间记录的第二传感器数据进行比较)处理传感器数据。例如,用户设备210可将用户在第一时间段的第一三维图像与用户在第二时间段的第二三维图像进行比较,以识别用户外貌的变化,诸如痣的生长(例如,对应于肿瘤生长)、乳房形状的变化(例如,对应于囊肿生长)、体形的变化(例如,对应于体重增加)、化学计量特征的变化(例如,对应于与糖尿病型障碍相关联的血液成分的变化)等。In some embodiments, the user device 210 may process the sensor data using a comparison technique (such as comparing first sensor data recorded at a first time with second sensor data recorded at a second time). For example, the user device 210 may compare a first three-dimensional image of the user at a first time period with a second three-dimensional image of the user at a second time period to identify changes in the user's appearance, such as mole growth (e.g., corresponding to tumor growth), changes in breast shape (e.g., corresponding to cyst growth), changes in body shape (e.g., corresponding to weight gain), changes in stoichiometric characteristics (e.g., corresponding to changes in blood composition associated with a diabetic-type disorder), etc.
如图4中进一步所示,处理400可包括提供健康信息(框430)。例如,用户设备210可提供健康信息。在某些实施方式中,用户设备210可经由用户界面提供健康报告以供用户查看。例如,用户设备210可提供包括识别用户的净卡路里消耗(例如,卡路里摄入量与卡路里消耗量的比较)的健康信息的报告。另外、或替代地,用户设备210可提供识别由用户设备210处理的传感器数据的一部分的信息,诸如针对用户确定的一组重要统计数据(例如,血压、体温、心率或汗液水平)。As further shown in FIG4 , process 400 may include providing health information (block 430). For example, user device 210 may provide health information. In some embodiments, user device 210 may provide a health report via a user interface for the user to review. For example, user device 210 may provide a report including health information identifying the user's net calorie expenditure (e.g., a comparison of calorie intake to calorie expenditure). Additionally or alternatively, user device 210 may provide information identifying a portion of sensor data processed by user device 210, such as a set of vital statistics determined for the user (e.g., blood pressure, body temperature, heart rate, or sweat level).
在某些实施方式中,用户设备210可基于传感器数据提供建议。例如,用户设备210可确定一组健康建议(例如,改善肥胖症状况、管理糖尿病状况、预防退行性疾病、改善运动表现或满足营养目标),可选择该组健康建议中的特定健康建议(例如,基于用户的代谢率,用户在特定膳食期间消耗特定量的卡路里),并且可提供健康信息,所述健康信息包括特定健康建议以用于经由用户界面进行显示。另外、或替代地,用户设备210可选择另一个健康建议(例如,基于消耗特定食物或参与特定的锻炼方案,预测用户体验改善的情绪水平),并且可提供其它健康建议以用于经由另一个用户设备210(例如,由医师、生活教练、教练或私人厨师所利用的用户设备)进行显示。In some embodiments, the user device 210 may provide recommendations based on sensor data. For example, the user device 210 may determine a set of health recommendations (e.g., improving obesity conditions, managing diabetes conditions, preventing degenerative diseases, improving athletic performance, or meeting nutritional goals), may select a specific health recommendation from the set of health recommendations (e.g., based on the user's metabolic rate, the user consumes a specific amount of calories during a specific meal), and may provide health information including the specific health recommendation for display via a user interface. Additionally or alternatively, the user device 210 may select another health recommendation (e.g., predicting the user's improved mood level based on consuming specific foods or participating in a specific exercise regimen), and may provide other health recommendations for display via another user device 210 (e.g., a user device utilized by a physician, life coach, trainer, or personal chef).
在某些实施方式中,用户设备210可基于传感器数据提供警告。例如,用户设备210可基于识别用户的健康状况的传感器数据,提供识别健康状况的特定的警告以用于经由用户界面进行显示。在此情况中,警告可识别健康状况、健康状况的严重程度等。另外、或替代地,用户设备210可提供警告以用于经由另一个用户设备210进行显示。例如,用户设备210可识别与健康状况相关联的专科医生,并且可发送警告以用于经由由专科医生所利用的另一个用户设备210进行显示。类似地,用户设备210可发送警告以使得针对用户派遣应急管理人员。例如,当用户设备210确定健康状况的严重程度满足阈值严重程度时,用户设备210可利用位置确定技术来确定用户的位置,并且可向救护车派遣系统、医院等发送警告以使得应急管理人员被派遣至用户的位置。在某些实施方式中,用户设备210可在提供警告时提供健康报告。例如,用户设备210可提供识别用户的血压、用户的心率、用户的体温等的信息,以供医生、应急管理人员等利用。In certain embodiments, user device 210 may provide alerts based on sensor data. For example, based on sensor data identifying a user's health condition, user device 210 may provide a specific alert identifying the health condition for display via a user interface. In this case, the alert may identify the health condition, the severity of the health condition, and so on. Additionally or alternatively, user device 210 may provide an alert for display via another user device 210. For example, user device 210 may identify a medical specialist associated with the health condition and send an alert for display via another user device 210 utilized by the medical specialist. Similarly, user device 210 may send an alert to dispatch emergency response personnel to the user. For example, when user device 210 determines that the severity of the health condition meets a threshold severity, user device 210 may utilize location-determination technology to determine the user's location and send an alert to an ambulance dispatch system, a hospital, or the like to dispatch emergency response personnel to the user's location. In certain embodiments, user device 210 may provide a health report along with the alert. For example, user device 210 may provide information identifying the user's blood pressure, the user's heart rate, the user's body temperature, etc. for use by doctors, emergency management personnel, etc.
在某些实施方式中,用户设备210可提供校准数据。例如,当用户设备210发送关于用户的光谱数据以用于校准模型时,用户设备210可提供关于用户的健康信息以用于校准模型。在此情况中,健康信息可用于将模型与特定健康状况校准(例如,第一化学计量特征可被确定为对应于第一汗液水平,且第二化学计量特征可被确定为对应于第二汗液水平)。In some embodiments, user device 210 may provide calibration data. For example, when user device 210 sends spectral data about a user for use in calibrating a model, user device 210 may also provide health information about the user for use in calibrating the model. In this case, the health information may be used to calibrate the model to a specific health condition (e.g., a first chemometric characteristic may be determined to correspond to a first sweat level, and a second chemometric characteristic may be determined to correspond to a second sweat level).
在某些实施方式中,用户设备210可基于传感器数据提供增强现实图像以供显示。例如,当用户设备210基于食品的图像确定食品的卡路里含量时,用户设备210可确定食品的在被消耗时对应于满足营养目标的一部分。在此情况中,用户设备210可提供食品的图像(其中食品的该部分被高亮显示)、对食品的增强现实显示(其中食品的该部分被高亮显示)等以供显示。以此方式,用户可被提供指示要满足营养目标需要消耗多少食品的信息。In certain embodiments, user device 210 may provide an augmented reality image for display based on sensor data. For example, when user device 210 determines the calorie content of a food item based on an image of the food item, user device 210 may determine a portion of the food item that, when consumed, would correspond to meeting a nutritional goal. In this case, user device 210 may provide an image of the food item (with the portion of the food item highlighted), an augmented reality display of the food item (with the portion of the food item highlighted), and the like for display. In this manner, the user may be provided with information indicating how much food item needs to be consumed to meet a nutritional goal.
虽然图4示出了处理400的示例框,但是在某些实施方式中,与图4中所描绘的这些框相比,处理400可包括额外的框、更少的框、不同的框或不同布置的框。另外、或替代地,可并行执行处理400的两个或更多个框。Although Figure 4 illustrates example blocks of process 400, in some implementations, process 400 may include additional blocks, fewer blocks, different blocks, or a different arrangement of blocks than those depicted in Figure 4. Additionally or alternatively, two or more blocks of process 400 may be performed in parallel.
图5A至5D为与图4中所示的示例性处理400有关的示例性实施方式500的图。图5A至5D示出了基于与多个传感器相关联的传感器数据提供健康信息的实例。Figures 5A through 5D are diagrams of an example implementation 500 related to the example process 400 shown in Figure 4. Figures 5A through 5D illustrate an example of providing health information based on sensor data associated with a plurality of sensors.
如图5A中且由附图标号510所示,可佩戴式用户设备210(例如,包括一组传感器的智能手表)可存储从健康护理提供商应用服务器220接收的一组饮食和锻炼目标。例如,该组饮食和锻炼目标可基于用户对健康护理提供商(例如,医生、私人教练或营养师)的咨询而生成,并且可被发送至可佩戴式用户设备210以允许可佩戴式用户设备210监测用户饮食和锻炼以确定并改善对该组饮食和锻炼目标的遵从性。假设该组饮食和锻炼目标包括与该用户一天中具有阈值量的碳水化合物的摄入量相关联的饮食目标、与该用户满足该一天期间的阈值身体活动水平相关联的锻炼目标,以及与该用户满足阈值净卡路里消耗(例如,在该一天期间卡路里消耗量大于卡路里摄入量)相关联的组合的饮食和锻炼目标。5A and shown by reference numeral 510, a wearable user device 210 (e.g., a smartwatch including a set of sensors) may store a set of diet and exercise goals received from a healthcare provider application server 220. For example, the set of diet and exercise goals may be generated based on a user's consultation with a healthcare provider (e.g., a doctor, a personal trainer, or a nutritionist) and may be sent to the wearable user device 210 to allow the wearable user device 210 to monitor the user's diet and exercise to determine and improve compliance with the set of diet and exercise goals. Assume that the set of diet and exercise goals includes a diet goal associated with the user having a threshold amount of carbohydrate intake during the day, an exercise goal associated with the user meeting a threshold level of physical activity during the day, and a combined diet and exercise goal associated with the user meeting a threshold net calorie expenditure (e.g., calorie consumption is greater than calorie intake during the day).
如图5B中且由附图标号515所示,可佩戴式用户设备210使用来自光谱传感器的数据,对食品执行光谱分析以确定食品的含量,诸如蛋白质含量、脂肪含量或碳水化合物含量。如由附图标号520所示,可佩戴式用户设备210使用来自成像传感器的一组图像,对食品执行图像分析以确定食品的体积。假设可佩戴式用户设备210基于食品的含量(例如,指示食物含量的光谱分析)和食品的体积(例如,指示食物含量的体积分析)确定用户的碳水化合物摄入量和卡路里摄入量。假设基于碳水化合物摄入量,可佩戴式用户设备210经由用户界面提供指示对饮食目标的遵从性的信息,诸如指示用户被允许在一天的剩余时间期间消耗的碳水化合物的量的警告。5B and shown by reference numeral 515, the wearable user device 210 uses data from a spectral sensor to perform spectral analysis on the food to determine the content of the food, such as protein content, fat content, or carbohydrate content. As shown by reference numeral 520, the wearable user device 210 uses a set of images from an imaging sensor to perform image analysis on the food to determine the volume of the food. It is assumed that the wearable user device 210 determines the user's carbohydrate intake and calorie intake based on the content of the food (e.g., a spectral analysis indicating the food content) and the volume of the food (e.g., a volumetric analysis indicating the food content). It is assumed that based on the carbohydrate intake, the wearable user device 210 provides information indicating compliance with the diet goal via the user interface, such as a warning indicating the amount of carbohydrates the user is allowed to consume during the remainder of the day.
如图5C中且由附图标号525所示,可佩戴式用户设备210使用来自心率传感器、加速度计传感器等的数据对用户锻炼方案执行活动分析。假设可佩戴式用户设备210基于对用户锻炼方案执行活动分析来确定卡路里消耗量和身体活动水平。假设基于身体活动水平,可佩戴式用户设备210经由用户界面提供指示对锻炼目标的遵从性的信息,诸如指示用户满足了一天的阈值身体活动水平的信息。As shown in FIG5C and by reference numeral 525, the wearable user device 210 performs activity analysis on the user's exercise regimen using data from a heart rate sensor, an accelerometer sensor, and the like. Assume that the wearable user device 210 determines calorie consumption and a physical activity level based on the activity analysis performed on the user's exercise regimen. Assume that based on the physical activity level, the wearable user device 210 provides information indicating compliance with the exercise goal via the user interface, such as information indicating that the user has met a threshold physical activity level for the day.
如图5D中且由附图标号530所示,可佩戴式用户设备210确定对组合的饮食和锻炼目标的遵从性,并且生成针对用户的活动计划,所述活动计划与使得用户执行特定活动(例如,特定步数)相关联,所述特定活动与对与用户相关联的传感器数据的对应改变相关联(例如,使得传感器数据指示用户一天的卡路里消耗量已经增加)。假设可佩戴式用户设备210基于用户的卡路里摄入量超过用户的卡路里消耗量来确定用户未能满足组合的饮食和锻炼目标。还假设可佩戴式用户设备210基于用户的先前活动确定用户在一天结束之前行走特定步数对应于实现组合的饮食和锻炼目标。如由附图标号535所示,可佩戴式用户设备210提供指示用户在一天结束之前要行走特定步数的警告,并且继续监测用户活动且提供警告以使得用户行走特定步数。以此方式,可佩戴式用户设备210相对于计步器设备改善对组合的饮食和锻炼目标的遵从性,所述计步器设备仅提供指示走的步数和估计的卡路里消耗量的信息,而不包括其它数据且不将估计的卡路里消耗量与卡路里摄入量进行比较。As shown in Figure 5D and by reference numeral 530, wearable user device 210 determines compliance with the combined diet and exercise goal and generates an activity plan for the user, the activity plan being associated with causing the user to perform a specific activity (e.g., a specific number of steps) that is associated with corresponding changes to sensor data associated with the user (e.g., causing the sensor data to indicate that the user's calorie consumption for the day has increased). Assume that wearable user device 210 determines that the user has failed to meet the combined diet and exercise goal based on the user's calorie intake exceeding the user's calorie consumption. Assume also that wearable user device 210 determines that the user's walking a specific number of steps before the end of the day corresponds to achieving the combined diet and exercise goal based on the user's previous activity. As shown by reference numeral 535, wearable user device 210 provides a warning indicating that the user is to walk a specific number of steps before the end of the day, and continues to monitor user activity and provides warnings to cause the user to walk a specific number of steps. In this way, the wearable user device 210 can improve compliance with combined diet and exercise goals relative to a pedometer device that only provides information indicating the number of steps taken and estimated calorie consumption without including other data and without comparing estimated calorie consumption with calorie intake.
如上文所指示,图5A至5D仅仅是作为实例而提供。其它实例是可能的并且可不同于已关于图5A至5D所述的实例。As indicated above, Figures 5A to 5D are provided merely as examples. Other examples are possible and may differ from the examples that have been described with respect to Figures 5A to 5D.
图6为用于对分类模型进行动态地更新以用于光谱分析的示例性处理600的流程图。在某些实施方式中,图6的一个或多个处理框可由用户设备210执行。在某些实施方式中,图6的一个或多个处理框可由与用户设备210分离或包括用户设备210的另一个设备或一组设备(诸如应用服务器220)执行。FIG6 is a flow chart of an exemplary process 600 for dynamically updating a classification model for spectral analysis. In some embodiments, one or more processing blocks of FIG6 may be performed by user device 210. In some embodiments, one or more processing blocks of FIG6 may be performed by another device or group of devices, such as application server 220, that is separate from or includes user device 210.
如图6中所示,处理600可包括获得第一分类模型用于光谱分析(框610)。例如,用户设备210可获得第一分类模型用于光谱分析。分类模型(例如,光谱分类模型)可指代可用于基于针对光谱分析的对象获得的化学计量特征识别所述对象或所述对象的特性的模型。例如,分类模型可包括与一组样本(例如,一组人或一组食品)的一组化学计量特征相关联的信息,且用户设备210可利用分类模型来确定人的化学计量特征对应于人的特定特性(例如,血糖水平)。类似地,用户设备210可利用另一个分类模型来确定食品的化学计量特征对应于食品的特定营养含量。As shown in FIG6 , process 600 may include obtaining a first classification model for spectral analysis (block 610). For example, user device 210 may obtain a first classification model for spectral analysis. A classification model (e.g., a spectral classification model) may refer to a model that can be used to identify an object or a characteristic of the object based on chemometric features obtained for the object being spectrally analyzed. For example, a classification model may include information associated with a set of chemometric features for a set of samples (e.g., a set of people or a set of foods), and user device 210 may utilize the classification model to determine whether the chemometric features of a person correspond to a specific characteristic of the person (e.g., blood sugar level). Similarly, user device 210 may utilize another classification model to determine whether the chemometric features of a food correspond to a specific nutritional content of the food.
在某些实施方式中,用户设备210可从特定应用服务器220获得第一分类模型,所述应用服务器220与校准第一分类模型相关联。例如,特定应用服务器220可使用光谱仪对校准组(例如,一组识别的对象)执行光谱分析,并且可利用处理技术(例如,优化技术,用于在校准组的各个化学计量特征之间进行区分)以生成第一分类模型。在此情况中,用户设备210可基于由应用服务器220进行优化的校准模型接收第一分类模型。在某些实施方式中,用户设备210可获得特定分类模型,所述特定分类模型是基于对一组人执行的光谱分析而校准的。例如,应用服务器220可对第一人执行第一光谱分析并且对第二人执行第二光谱分析,并且可生成第一分类模型以考虑第一人和第二人的化学计量特征(例如与血糖水平相关联)的差异(例如,与不同的身体成分有关)。In certain embodiments, the user device 210 may obtain a first classification model from a specific application server 220, which is associated with calibrating the first classification model. For example, the specific application server 220 may perform spectral analysis on a calibration set (e.g., a set of identified subjects) using a spectrometer and may utilize processing techniques (e.g., optimization techniques for distinguishing between various chemometric characteristics of the calibration set) to generate the first classification model. In this case, the user device 210 may receive the first classification model based on the calibration model optimized by the application server 220. In certain embodiments, the user device 210 may obtain a specific classification model that was calibrated based on spectral analysis performed on a group of individuals. For example, the application server 220 may perform a first spectral analysis on a first individual and a second spectral analysis on a second individual, and may generate the first classification model to account for differences (e.g., related to different body compositions) in the chemometric characteristics (e.g., associated with blood glucose levels) of the first and second individuals.
在某些实施方式中,用户设备210可基于请求第一分类模型,获得第一分类模型。例如,用户设备210可发送对第一分类模型的请求,并且可基于发送所述请求而从应用服务器220接收第一分类模型。另外、或替代地,用户设备210可从用户设备210的数据结构获得第一分类模型。例如,用户设备210可包括经由数据结构存储的第一分类模型。在某些实施方式中,用户设备210可生成第一分类模型。例如,用户设备210可接收与一组对象相关联的一组化学计量特征,并且可基于该组化学计量特征生成第一分类模型。另外、或替代地,用户设备210可对一组已知对象执行一组光谱测量以获得该组已知对象的化学计量特征,并且可基于该组已知对象的化学计量特征生成第一分类模型。In some embodiments, the user device 210 may obtain the first classification model based on requesting the first classification model. For example, the user device 210 may send a request for the first classification model and may receive the first classification model from the application server 220 based on sending the request. Additionally or alternatively, the user device 210 may obtain the first classification model from a data structure of the user device 210. For example, the user device 210 may include the first classification model stored via the data structure. In some embodiments, the user device 210 may generate the first classification model. For example, the user device 210 may receive a set of chemometric features associated with a set of objects and may generate the first classification model based on the set of chemometric features. Additionally or alternatively, the user device 210 may perform a set of spectral measurements on a set of known objects to obtain the chemometric features of the set of known objects and may generate the first classification model based on the chemometric features of the set of known objects.
如图6中进一步所示,处理600可包括获得对象的一组属性用于光谱分析(框620)。例如,用户设备210可获得对象的该组属性用于光谱分析。在某些实施方式中,用户设备210可基于来自一个或多个传感器的传感器数据确定该组属性。例如,用户设备210可利用用户设备210的传感器来基于由传感器记录的传感器数据来确定关于用户的血糖水平、体温等。另外、或替代地,用户设备210可(例如,经由网络230)与传感器(例如,启用蓝牙的传感器)进行通信,以接收与用于光谱分析的对象(例如,用户)的属性相关联的传感器数据。As further shown in FIG6 , process 600 may include obtaining a set of attributes of an object for spectral analysis (block 620). For example, user device 210 may obtain the set of attributes of the object for spectral analysis. In some embodiments, user device 210 may determine the set of attributes based on sensor data from one or more sensors. For example, user device 210 may utilize sensors of user device 210 to determine blood glucose level, body temperature, etc., about the user based on sensor data recorded by the sensors. Additionally or alternatively, user device 210 may communicate with a sensor (e.g., a Bluetooth-enabled sensor) (e.g., via network 230) to receive sensor data associated with attributes of an object (e.g., a user) for spectral analysis.
在某些实施方式中,用户设备210可获得对象的一个或多个属性,所述属性与对对象进行归类相关联。例如,用户设备210可获得识别对象的性别、对象的年龄、对象的种族等的信息。在此情况中,用户设备210可从由用户设备210存储的数据结构获得信息。另外、或替代地,用户设备210可从应用服务器220(例如,与健康护理提供商相关联并且存储关于用户的信息的应用服务器)获得信息。在某些实施方式中,用户设备210可经由用户界面获得信息。例如,用户设备210可生成用户界面并且提供一组提示以用于经由用户界面进行显示,并且可检测用户与用户界面的交互,所述交互与提供对该组提示的一组响应相关联。In some embodiments, the user device 210 may obtain one or more attributes of an object, which are associated with classifying the object. For example, the user device 210 may obtain information identifying the gender of an object, the age of an object, the race of an object, etc. In this case, the user device 210 may obtain information from a data structure stored by the user device 210. Additionally or alternatively, the user device 210 may obtain information from an application server 220 (e.g., an application server associated with a health care provider and storing information about the user). In some embodiments, the user device 210 may obtain information via a user interface. For example, the user device 210 may generate a user interface and provide a set of prompts for display via the user interface, and may detect an interaction of the user with the user interface, wherein the interaction is associated with providing a set of responses to the set of prompts.
在某些实施方式中,用户设备210可获得光谱分析的对象的属性,所述属性与光谱分析的对象的原始吸收光谱有关。例如,用户设备210可利用集成式光谱传感器来对用户执行光谱测量并且确定用户的化学计量特征(例如,原始吸收光谱)。另外、或替代地,用户设备210可与光谱传感器进行通信以使得光谱传感器确定与用户相关联的化学计量特征,且用户设备210可基于与光谱传感器进行通信而从光谱传感器接收化学计量特征。In certain embodiments, user device 210 may obtain properties of a subject for spectral analysis, the properties being related to a raw absorption spectrum of the subject for spectral analysis. For example, user device 210 may utilize an integrated spectral sensor to perform spectral measurements on a user and determine a chemometric signature of the user (e.g., a raw absorption spectrum). Additionally or alternatively, user device 210 may communicate with the spectral sensor to cause the spectral sensor to determine a chemometric signature associated with the user, and user device 210 may receive the chemometric signature from the spectral sensor based on the communication with the spectral sensor.
如图6中进一步所示,处理600可包括基于该组属性和第一分类模型来生成第二分类模型用于光谱分析(框630)。例如,用户设备210可基于该组属性和第一分类模型来生成第二分类模型用于光谱分析。在某些实施方式中,用户设备210可利用模型优化技术(诸如支持向量机分类器(SVM)优化技术或支持向量回归(SVR)优化技术等)来对第一分类(或定量)模型进行优化,并且生成第二分类(或定量)模型。例如,用户设备210可对(例如,基于一组人生成的)第一分类模型进行优化以生成第二分类模型以用于执行与用户设备的用户有关的分类(例如,确定用户的血糖水平)。以此方式,用户设备210考虑人之间的差异(例如,身体成分差异)。As further shown in FIG6 , the process 600 may include generating a second classification model for spectral analysis based on the set of attributes and the first classification model (block 630). For example, the user device 210 may generate the second classification model for spectral analysis based on the set of attributes and the first classification model. In some embodiments, the user device 210 may optimize the first classification (or quantitative) model using a model optimization technique (such as a support vector machine classifier (SVM) optimization technique or a support vector regression (SVR) optimization technique, etc.) and generate the second classification (or quantitative) model. For example, the user device 210 may optimize the first classification model (e.g., generated based on a group of people) to generate a second classification model for performing classification related to the user of the user device (e.g., determining the user's blood glucose level). In this way, the user device 210 takes into account differences between people (e.g., differences in body composition).
另外、或替代地,用户设备210可对(例如,基于与应用服务器220相关联的第一光谱仪生成的)第一分类模型进行优化,以生成第二分类模型以供与用户设备210相关联的第二光谱仪所利用。例如,用户设备210可基于经由第二光谱仪获得的光谱传感器数据来生成第二分类模型以用于对食品进行分类。以此方式,用户设备210考虑光谱仪之间的差异,由此相对于利用由应用服务器220针对由每个用户利用的每个用户设备210生成的单个分类模型,改善了光谱精确度。Additionally or alternatively, the user device 210 may optimize a first classification model (e.g., generated based on a first spectrometer associated with the application server 220) to generate a second classification model for use with a second spectrometer associated with the user device 210. For example, the user device 210 may generate a second classification model for classifying food products based on spectral sensor data obtained via the second spectrometer. In this manner, the user device 210 accounts for differences between spectrometers, thereby improving spectral accuracy relative to utilizing a single classification model generated by the application server 220 for each user device 210 utilized by each user.
如图6中进一步所示,处理600可包括利用第二分类模型来执行光谱分析(框640)。例如,用户设备210可利用第二分类模型来执行光谱分析。在某些实施方式中,用户设备210可利用第二分类模型来确定与用户(例如,光谱分析的对象)相关联的度量。例如,用户设备210可基于与用户相关联的光谱传感器数据以及第二分类模型(例如,第一化学计量特征在基于第二分类模型进行分类时可对应于用户的第一甘油三酯水平,第二化学计量特征在基于第二分类模型进行分类时可对应于第二甘油三酯水平)来识别特性(例如,血糖水平、甘油三酯水平、酮水平、胰岛素水平、皮肤状况或个人身份)。在此情况中,用户设备210可基于检测到所述特性来识别健康状况,诸如皮肤厚度的变化、皮肤密度的变化、皮肤胶原蛋白水平的变化、毛细血管密度的变化等。As further shown in FIG6 , process 600 may include performing spectral analysis using a second classification model (block 640). For example, user device 210 may perform spectral analysis using the second classification model. In some embodiments, user device 210 may determine a metric associated with a user (e.g., the subject of the spectral analysis) using the second classification model. For example, user device 210 may identify a characteristic (e.g., blood sugar level, triglyceride level, ketone level, insulin level, skin condition, or personal identity) based on spectral sensor data associated with the user and the second classification model (e.g., a first chemometric feature may correspond to a first triglyceride level of the user when classified based on the second classification model, and a second chemometric feature may correspond to a second triglyceride level when classified based on the second classification model). In this case, user device 210 may identify a health condition, such as a change in skin thickness, a change in skin density, a change in skin collagen level, a change in capillary density, etc., based on detecting the characteristic.
在某些实施方式中,用户设备210可利用关于用户的其它传感器数据来执行光谱分析。例如,用户设备210可基于用户的化学计量特征和关于用户的皮肤导电率传感器数据这二者来确定用户与特定皮肤状况相关联。类似地,用户设备210可基于食品的化学计量特征和食品的体积分析这二者来确定食品的营养含量(例如,卡路里含量、碳水化合物含量、蛋白质含量或脂肪含量)。以此方式,用户设备210可将来自多个传感器的传感器数据进行组合以确定并提供与用户相关联的健康信息。In certain embodiments, user device 210 may utilize other sensor data about the user to perform spectral analysis. For example, user device 210 may determine that a user is associated with a particular skin condition based on both the user's chemometric characteristics and skin conductivity sensor data about the user. Similarly, user device 210 may determine the nutritional content (e.g., calorie content, carbohydrate content, protein content, or fat content) of a food based on both the food's chemometric characteristics and a volumetric analysis of the food. In this way, user device 210 may combine sensor data from multiple sensors to determine and provide health information associated with the user.
在某些实施方式中,用户设备210可基于执行光谱分析而提供识别健康状况的信息。例如,用户设备210可生成用户界面,并且可提供识别健康状况的信息以用于经由用户界面进行显示。另外、或替代地,用户设备210可向应用服务器220提供识别健康状况的信息(例如,用于包括在与用户相关联的患者医疗记录中)。另外、或替代地,用户设备210可提供识别食品的营养含量的信息。在某些实施方式中,用户设备210可提供执行光谱分析的结果以用于进一步处理。例如,用户设备210可执行光谱分析,并且可将识别光谱分析的数据包括在数据集中,所述数据集被处理以确定并提供健康信息,如本文关于图4所述的。In some embodiments, user device 210 may provide information identifying a health condition based on performing spectral analysis. For example, user device 210 may generate a user interface and may provide information identifying a health condition for display via the user interface. Additionally or alternatively, user device 210 may provide information identifying a health condition to application server 220 (e.g., for inclusion in a patient medical record associated with the user). Additionally or alternatively, user device 210 may provide information identifying the nutritional content of a food. In some embodiments, user device 210 may provide the results of performing spectral analysis for further processing. For example, user device 210 may perform spectral analysis and may include data identifying the spectral analysis in a data set that is processed to determine and provide health information, as described herein with respect to FIG. 4 .
如图6中进一步所示,处理600可包括周期性地更新第二分类模型(框650)。例如,用户设备210可周期性地更新第二分类模型。在某些实施方式中,用户设备210可对第二分类模型进行优化。例如,当用户设备210对用户执行光谱分析时,用户设备210可利用光谱分析和/或其它传感器数据来使用优化技术(诸如SVM优化技术等)改进第二模型。在此情况中,用户设备210可利用改进的第二模型用于执行后续光谱分析。以此方式,用户设备210相对于利用不会基于光谱分析和/或其它传感器数据执行改进过程的第二分类模型,改善了第二分类模型的精确度。另外,随着时间的经过,所述模型对于模型的用户而言继续变得更精确和/或更特定,由此允许用户设备210对用户的特性执行更精确识别、对用户的状况执行更精确诊断,等等。另外,相对于生成新的分类模型,基于利用SVM优化技术,用户设备210降低了处理器和/或存储器资源的利用以及大大减少了时间。另外,增量训练方法可允许用户设备210在用户设备210接收到传感器数据时开发精确模型,而非需要足够的处理和/或存储器资源来基于大量与增加与物联网有关的传感器的数量有关的传感器数据生成初始模型。As further shown in FIG6 , process 600 may include periodically updating the second classification model (block 650). For example, user device 210 may periodically update the second classification model. In certain embodiments, user device 210 may optimize the second classification model. For example, when user device 210 performs spectral analysis on a user, user device 210 may utilize the spectral analysis and/or other sensor data to improve the second model using an optimization technique (such as an SVM optimization technique). In this case, user device 210 may utilize the improved second model for subsequent spectral analysis. In this manner, user device 210 improves the accuracy of the second classification model relative to utilizing a second classification model that does not utilize the spectral analysis and/or other sensor data for the improvement process. Furthermore, over time, the model continues to become more accurate and/or more specific to the user of the model, thereby allowing user device 210 to more accurately identify the user's characteristics, perform more accurate diagnosis of the user's condition, and so on. Furthermore, utilizing the SVM optimization technique reduces the utilization of processor and/or memory resources and significantly reduces the time required to generate a new classification model. Additionally, the incremental training approach may allow user device 210 to develop accurate models as user device 210 receives sensor data, rather than requiring sufficient processing and/or memory resources to generate an initial model based on a large amount of sensor data associated with an increasing number of sensors associated with the Internet of Things.
如图6中进一步所示,处理600可包括周期性地提供与使得对第一分类模型进行更新相关联的反馈信息(框660)。例如,用户设备210可提供与使得对第一分类模型进行更新相关联的反馈信息。在某些实施方式中,用户设备210可提供识别第二分类模型的信息以使得对第一分类模型进行更新。例如,用户设备210可向应用服务器220提供识别第二分类模型的信息,以使得应用服务器220对第一分类模型进行更新。As further shown in FIG6 , the process 600 may include periodically providing feedback information associated with causing the first classification model to be updated (block 660). For example, the user device 210 may provide feedback information associated with causing the first classification model to be updated. In some embodiments, the user device 210 may provide information identifying a second classification model to cause the first classification model to be updated. For example, the user device 210 may provide information identifying the second classification model to the application server 220 to cause the application server 220 to update the first classification model.
在某些实施方式中,用户设备210可提供识别由用户设备210获得的传感器数据的信息,以使得对第一分类模型进行更新。例如,当用户设备210获得指示特定体温的传感器数据并且对具有特定体温的用户执行光谱测量以获得用户在特定体温的化学计量特征时,用户设备210可提供识别特定体温和化学计量特征的信息以包括在第一分类模型中(例如,用于基于类似的化学计量特征识别特定体温)。In some embodiments, the user device 210 may provide information identifying sensor data obtained by the user device 210 to enable updating of the first classification model. For example, when the user device 210 obtains sensor data indicating a specific body temperature and performs spectroscopic measurements on a user having the specific body temperature to obtain a chemometric signature of the user at the specific body temperature, the user device 210 may provide information identifying the specific body temperature and the chemometric signature to be included in the first classification model (e.g., for identifying the specific body temperature based on similar chemometric signatures).
另外、或替代地,用户设备210可提供人口统计信息以对第一分类模型进行更新。例如,当基于对应于男人组的血糖水平的化学计量特征生成第一分类模型时,用户设备210可确定对应于女人的血糖水平的化学计量特征。在此情况中,用户设备210可发送识别女人的化学计量特征的信息以使得对第一分类模型进行优化,由此对模型执行分布式校准以相对于利用静态校准的基于有限样本组(例如,男人组)而生成的分类模型而改善了模型的精确度。Additionally or alternatively, the user device 210 may provide demographic information to update the first classification model. For example, when the first classification model is generated based on the chemometric characteristics of the blood glucose levels of a group of men, the user device 210 may determine the chemometric characteristics of the blood glucose levels of women. In this case, the user device 210 may transmit information identifying the chemometric characteristics of women to optimize the first classification model, thereby performing distributed calibration on the model to improve the accuracy of the model relative to a classification model generated using static calibration based on a limited sample group (e.g., a group of men).
虽然图6示出了处理600的示例框,但是在某些实施方式中,与图6中所描绘的这些框相比,处理600可包括额外的框、更少的框、不同的框或不同布置的框。另外、或替代地,可并行执行处理600的两个或更多个框。Although Figure 6 illustrates example blocks of process 600, in some implementations, process 600 may include additional blocks, fewer blocks, different blocks, or a different arrangement of blocks than those depicted in Figure 6. Additionally or alternatively, two or more blocks of process 600 may be performed in parallel.
图7A和7B为与图6中所示的示例性处理600有关的示例性实施方式700的图。图7A和7B示出了动态地更新分类模型以用于光谱分析的实例。Figures 7A and 7B are diagrams of an exemplary embodiment 700 related to the exemplary process 600 shown in Figure 6. Figures 7A and 7B illustrate an example of dynamically updating a classification model for spectral analysis.
如图7A中且由附图标号705所示,校准应用服务器220可基于样本数据生成通用模型(例如,通用分类模型),所述样本数据经由与校准应用服务器220相关联的光谱传感器而获得且与一组样本人有关。如由附图标号710所示,可佩戴式用户设备210从校准应用服务器220接收通用模型。如由附图标号715所示,可佩戴式用户设备210可获得与用户有关的化学计量特征数据,诸如用户身体的一部分的化学计量特征。如由附图标号720所示,可佩戴式用户设备210可利用SVM优化技术来基于化学计量特征数据、其它数据(诸如传感器数据(例如,用户的心率、用户的皮肤导电率或用户的血糖水平)、人口统计数据(例如,用户的年龄、用户的体重指数或用户的性别)等)来生成针对用户的局部模型(例如,另一个分类模型)。假设可佩戴式用户设备210存储局部分类模型用于对获得的关于用户的一个或多个其它化学计量特征进行分类(例如,用于对用户的状况进行诊断)。As shown in FIG7A and by reference numeral 705, the calibration application server 220 may generate a general model (e.g., a general classification model) based on sample data obtained via a spectral sensor associated with the calibration application server 220 and related to a sample group of people. As shown by reference numeral 710, the wearable user device 210 receives the general model from the calibration application server 220. As shown by reference numeral 715, the wearable user device 210 may obtain chemometric feature data related to the user, such as chemometric features of a portion of the user's body. As shown by reference numeral 720, the wearable user device 210 may utilize support vector machine (SVM) optimization techniques to generate a local model (e.g., another classification model) for the user based on the chemometric feature data, other data (e.g., sensor data (e.g., the user's heart rate, the user's skin conductivity, or the user's blood glucose level), demographic data (e.g., the user's age, the user's body mass index, or the user's gender), etc.). It is assumed that the wearable user device 210 stores the local classification model for classifying one or more other chemometric features obtained about the user (e.g., for diagnosing a condition of the user).
如图7B中且由附图标号725所示,可佩戴式用户设备210提供与局部模型相关联的信息(诸如化学计量特征数据、一个或多个其它化学计量特征、关于用户的数据等)以对通用模型进行更新。如由附图标号730所示,使得校准应用服务器220基于接收到与局部模型相关联的信息对通用模型执行更新。As shown in FIG7B and by reference numeral 725, the wearable user device 210 provides information associated with the local model (such as chemometric characteristic data, one or more other chemometric characteristics, data about the user, etc.) to update the general model. As shown by reference numeral 730, the calibration application server 220 performs an update on the general model based on the received information associated with the local model.
如上文所指示,图7A和7B仅仅是作为实例而提供。其它实例是可能的并且可不同于已关于图7A和7B所述的实例。As indicated above, Figures 7A and 7B are provided merely as examples. Other examples are possible and may differ from the examples that have been described with respect to Figures 7A and 7B.
以此方式,用户设备210利用来自多个传感器的传感器数据以提供关于用户的健康信息、改善一个或多个传感器的校准(例如,与光谱传感器相关联的分类模型的校准),等等。另外,基于利用来自多个传感器的传感器数据,用户设备210降低了与需要针对每个传感器的设备相关联的成本和功耗。另外,基于利用优化技术来校准光谱传感器,用户设备210相对于每当有额外的样本数据时都生成新的分类模型而降低了处理和/或存储器资源的利用,并且相对于基于足够的样本数据生成分类模型以执行所有未改进的分类而降低了成本。In this manner, the user device 210 utilizes sensor data from multiple sensors to provide health information about the user, improve the calibration of one or more sensors (e.g., calibration of a classification model associated with a spectral sensor), and the like. Furthermore, by utilizing sensor data from multiple sensors, the user device 210 reduces the cost and power consumption associated with requiring a device for each sensor. Furthermore, by utilizing optimization techniques to calibrate the spectral sensor, the user device 210 reduces the utilization of processing and/or memory resources relative to generating a new classification model each time additional sample data is available, and reduces costs relative to generating a classification model based on sufficient sample data to perform all unimproved classifications.
前述公开提供了说明和描述,但不旨在详尽的或将实施方式限于所公开的精确形式。修改和改变鉴于以上公开是可能的,或可获取自实施方式的实践。The foregoing disclosure provides illustration and description, but is not intended to be exhaustive or to limit the embodiments to the precise form disclosed. Modifications and variations are possible in light of the above disclosure or may be acquired from practice of the embodiments.
如本文所使用,术语组件旨在被宽泛地解释为硬件、固件和/或硬件与软件的组合。As used herein, the term component is intended to be broadly interpreted as hardware, firmware, and/or a combination of hardware and software.
某些实施方式在本文是结合阈值来描述的。如本文所使用,满足阈值可指值大于阈值、多于阈值、高于阈值、大于或等于阈值、小于阈值、少于阈值、低于阈值、小于或等于阈值、等于阈值,等等。Certain embodiments are described herein in conjunction with threshold values. As used herein, satisfying a threshold value may refer to a value being greater than a threshold value, more than a threshold value, above a threshold value, greater than or equal to a threshold value, less than a threshold value, less than a threshold value, below a threshold value, less than or equal to a threshold value, equal to a threshold value, and the like.
本文已经描述和/或图中已经示出了某些用户界面。用户界面可包括图形用户界面、非图形用户界面、基于文字的用户界面等。用户界面可提供信息以供显示。在某些实施方式中,用户可诸如通过经由提供用户界面以供显示的设备的输入组件提供输入来与信息交互。在某些实施方式中,用户界面可由设备和/或用户配置(例如,用户可改变用户界面的大小、经由用户界面提供的信息、经由用户界面提供的信息的位置等)。另外、或替代地,用户界面可被预配置为标准配置、基于显示用户界面的设备的类型的具体配置和/或基于与显示用户界面的设备相关联的能力和/或规范的一组配置。Certain user interfaces have been described herein and/or shown in the figures. User interfaces may include graphical user interfaces, non-graphical user interfaces, text-based user interfaces, and the like. A user interface may provide information for display. In some embodiments, a user may interact with the information, such as by providing input via an input component of a device that provides the user interface for display. In some embodiments, the user interface may be configurable by the device and/or the user (e.g., the user may change the size of the user interface, the information provided via the user interface, the location of the information provided via the user interface, etc.). Additionally or alternatively, the user interface may be preconfigured to a standard configuration, a specific configuration based on the type of device that displays the user interface, and/or a set of configurations based on the capabilities and/or specifications associated with the device that displays the user interface.
将显而易见的是,本文所述的系统和/或方法可以硬件、固件或硬件与软件的组合的不同形式来实施。用于实施这些系统和/或方法的实际专用控制硬件或软件代码并不限制实施方式。因此,系统和/或方法的操作和行为在本文并未参照具体软件代码来描述——应当理解的是,软件和硬件可被设计成基于本文的描述来实施系统和/或方法。It will be apparent that the systems and/or methods described herein can be implemented in various forms of hardware, firmware, or a combination of hardware and software. The actual dedicated control hardware or software code used to implement these systems and/or methods does not limit the implementation. Therefore, the operation and behavior of the systems and/or methods are not described herein with reference to specific software code - it should be understood that software and hardware can be designed to implement the systems and/or methods based on the description herein.
即使权利要求书中叙述和/或说明书中公开了特征的特定组合,这些组合也不旨在限制可能实施方式的公开。实际上,这些特征中的许多特征可以权利要求书中未具体叙述和/或说明书中未具体公开的方式来组合。虽然下文列出的每个从属权利要求可直接仅从属于一个权利要求,但是可能实施方式的公开包括与权利要求组中的每个其它权利要求进行组合的每个从属权利要求。Even though particular combinations of features are recited in the claims and/or disclosed in the specification, these combinations are not intended to limit the disclosure of possible implementations. In fact, many of these features can be combined in ways not specifically recited in the claims and/or disclosed in the specification. Although each dependent claim listed below may directly depend on only one claim, the disclosure of possible implementations includes each dependent claim in combination with every other claim in the claim group.
本文所使用的元件、动作或指令不应被解释为至关重要或必需的,除非这样明确描述。另外,如本文所使用的,冠词“a”和“an”旨在包括一个或多个项,并且可与“一个或多个”进行互换使用。另外,如本文所使用的,术语“组”旨在包括一个或多个项(例如,相关项、不相关项、相关项与不相关项的组合等),并且可与“一个或多个”进行互换使用。当旨在仅一个项时,使用术语“一个”或类似语言。另外,如本文所使用,术语“具有(has)”、“具有(have)”、“具有(having)”等旨在为开放式术语。另外,除非另有明确说明,否则词语“基于”旨在意指“至少部分基于”。As used herein, the elements, actions or instructions should not be interpreted as being essential or necessary unless clearly described in this way. In addition, as used herein, the articles "a" and "an" are intended to include one or more items and can be used interchangeably with "one or more". In addition, as used herein, the term "group" is intended to include one or more items (e.g., related items, unrelated items, combinations of related items and unrelated items, etc.), and can be used interchangeably with "one or more". When intended to only one item, the term "one" or similar language is used. In addition, as used herein, the terms "has", "have", "having" etc. are intended to be open terms. In addition, unless expressly stated otherwise, the term "based on" is intended to mean "at least partially based on".
Claims (20)
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US15/135,110 | 2016-04-21 | ||
| US15/135,110 US10251597B2 (en) | 2016-04-21 | 2016-04-21 | Health tracking device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| HK1248006A1 HK1248006A1 (en) | 2018-10-05 |
| HK1248006B true HK1248006B (en) | 2021-12-17 |
Family
ID=
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7127086B2 (en) | health tracking device | |
| US11642086B2 (en) | Apparatus and method for correcting error of bio-information sensor, and apparatus and method for estimating bio-information | |
| US20210391081A1 (en) | Predictive guidance systems for personalized health and self-care, and associated methods | |
| US11517223B2 (en) | Apparatus and method for estimating blood glucose | |
| CN104207753A (en) | Personal health monitoring system | |
| KR20190063954A (en) | Method for predicting change of nutrient metabolism by artificial intelligence cloud and method for measuring nutrient metabolism by artificial intelligence cloud and method managing diease by using it | |
| Roy et al. | OBESEYE: Interpretable Diet Recommender for Obesity Management using Machine Learning and Explainable AI | |
| JP6954568B2 (en) | Health management support system, health management support method, and program | |
| KR20190094725A (en) | Dietary habits management apparatus and method | |
| Seto et al. | Prediction of personal cardiovascular risk using machine learning for smartphone applications | |
| JP6992505B2 (en) | Information processing equipment, methods and programs | |
| HK1248006B (en) | Health tracking device | |
| US20250046466A1 (en) | Predicting analyte levels based on intermittent sensor data | |
| CN116246754B (en) | Human body weight monitoring evaluation intervention management method and system | |
| KR102762992B1 (en) | Method and system for predicting blood glucose | |
| WO2025034456A1 (en) | Predicting analyte levels based on intermittent sensor data | |
| WO2025231209A9 (en) | Non-invasive prediction of insulin resistance using sensor data | |
| Das et al. | Diabetes prediction framework: A unified approach to enhanced healthcare management |