WO2024262325A1 - Display control device, private booth, display method, and program - Google Patents

Abstract

This display control device comprises: an acquisition unit (34) that acquires body movement data of a user measured using a body movement sensor (20); and a display control unit (37) that displays, on a display device (50) in real time, a waveform of a signal related to heartbeats obtained from the acquired body movement data. While displaying the waveform of the signal related to the heartbeats on the display device (50) in real time, the display control unit (37) displays, on the display device (50), an example of a waveform of a signal related to heartbeats obtained when body movement data is correctly measured and an example of a waveform of a signal related to heartbeats obtained when body movement data is not correctly measured.

Description

Display control device, private booth, display method, and program

The present invention relates to a display control device, a private booth, a display method, and a program.

Patent document 1 discloses an abnormality notification device that monitors biological information and notifies if an abnormality is detected.

JP 2016-130886 A

The present invention provides a display control device, a private booth, a display method, and a program that can assist in the appropriate measurement of body movement data.

A display control device according to one aspect of the present invention includes an acquisition unit that acquires body movement data of a user measured by a sensor, and a display control unit that displays, on a display device in real time, a waveform of a signal related to a heart rate obtained from the acquired body movement data, and the display control unit displays, on the display device, an example of a waveform of the signal related to a heart rate obtained when the body movement data is measured correctly and an example of a waveform of the signal related to a heart rate obtained when the body movement data is not measured correctly, when the waveform of the signal related to a heart rate is displayed on the display device in real time.

The private booth according to one aspect of the present invention includes the display control device, the sensor, a bed on which the sensor is provided, and the display device.

The private booth according to one aspect of the present invention includes the display control device, the sensor, a chair on which the sensor is mounted, and the display device.

A display method according to one aspect of the present invention is a display method executed by a computer, and includes an acquisition step of acquiring body movement data of a user measured by a sensor, and a display step of displaying in real time on a display device a waveform of a signal related to a heart rate obtained from the acquired body movement data, and in the display step, when the waveform of the signal related to a heart rate is displayed in real time on the display device, an example of a waveform of the signal related to a heart rate obtained when the body movement data is measured correctly and an example of a waveform of the signal related to a heart rate obtained when the body movement data is not measured correctly are displayed on the display device.

A program according to one aspect of the present invention is a program for causing the computer to execute the display method.

The display control device, private booth, display method, and program of the present invention can assist in the appropriate measurement of body movement data.

FIG. 1 is an external view of a sleeping booth. FIG. 2 is a block diagram showing the functional configuration of the sleeping booth according to the embodiment. FIG. 3 is a flowchart of an assist operation for assisting in appropriate measurement of body movement data. FIG. 4 is a diagram showing an example of a waveform of a BCG signal. FIG. 5 is a flowchart of a method for calculating the reliability. FIG. 6 is a flow chart of a method for determining signal strength. FIG. 7 is a diagram showing an example of the support image.

Below, the embodiments are described with reference to the drawings. Note that the embodiments described below are all comprehensive or specific examples. The numerical values, shapes, materials, components, component placement and connection forms, steps, and order of steps shown in the following embodiments are merely examples and are not intended to limit the present invention. Furthermore, among the components in the following embodiments, components that are not described in an independent claim are described as optional components.

Note that each figure is a schematic diagram and is not necessarily a precise illustration. In addition, in each figure, the same reference numerals are used for substantially the same configurations, and duplicate explanations may be omitted or simplified.

(Embodiment)
[composition]
First, the configuration of the sleeping booth according to the embodiment will be described with reference to Fig. 1, which is an external view of the sleeping booth, and Fig. 2, which is a block diagram showing the functional configuration of the sleeping booth according to the embodiment.

The nap booth 10 is a private unit used by employees of a medical facility (hereinafter also referred to as users) to take a nap during work hours (night shifts, etc.). A bed is provided inside the nap booth 10, and the environment (brightness, temperature, scent, airflow, etc.) surrounding the user lying in the bed is adjusted according to the depth of sleep of the user (in other words, sleep stage). In this way, the nap booth 10 is a device that can provide a comfortable sleep environment that makes it easy for the user to fall asleep and wake up. Specifically, the nap booth 10 comprises a body movement sensor 20, a control device 30, an environmental adjustment device 40, and a display device 50.

The body movement sensor 20 is a contact-type sensor that measures body movement data of a user lying on the bed. The body movement sensor 20 is a mat-shaped (in other words, sheet-shaped) sensor that is installed on the bed, and can measure the movement of the body surface of the user lying on the bed as body movement data. The body movement sensor 20 measures the movement of the user's back to measure body movement data including components derived from the heartbeat. The body movement sensor 20 described here is an example, and the form of the sensor is not important as long as it can measure body movement. For example, the body movement sensor 20 may be a radio wave sensor that detects vibrations without contact using radio waves, or a pressure sensor that is installed on the legs of a bed or chair and can measure body movement data including components derived from the heartbeat. The body movement sensor 20 may be an acceleration sensor installed on bedding.

The control device 30 estimates the user's sleep depth from a BCG (Ballistocardiogram) signal obtained from body movement data measured by the body movement sensor 20, and controls the environmental adjustment device 40 based on the estimated sleep depth. BCG is a term that means vibrations caused by the movement of blood vessels or the heart. The control device 30 is realized, for example, by a personal computer or a tablet terminal, but may also be realized as a dedicated device for the nap booth 10. The control device 30 includes a communication unit 31, an information processing unit 32, and a memory unit 33.

The communication unit 31 is a communication module (communication circuit) that enables the control device 30 to communicate with the body movement sensor 20, the environmental adjustment device 40, and the display device 50. The communication performed by the communication unit 31 is, for example, wired communication, but may also be wireless communication. There is no particular limitation on the communication standard used for the communication.

The information processing unit 32 is realized by a processor or a microcomputer. The information processing unit 32 includes an acquisition unit 34 that acquires body movement data received by the communication unit 31, a calculation unit 35 that calculates a BCG signal from the acquired body movement data, an equipment control unit 36 that estimates sleep depth from parameters such as heart rate and breathing rate obtained from the calculated BCG signal and controls the environmental adjustment device 40 based on the estimated sleep depth, and a display control unit 37 that controls the display of images on the display device 50. The functions of the acquisition unit 34, calculation unit 35, equipment control unit 36, and display control unit 37 are realized by the processor or microcomputer constituting the information processing unit 32 executing a computer program stored in the memory unit 33.

The storage unit 33 is a storage device that stores various information used by the information processing unit 32, such as the computer programs executed by the information processing unit 32. Specifically, the storage unit 33 is realized by a semiconductor memory or the like.

The environmental adjustment device 40 adjusts the environment around the user lying on the bed in the internal space of the sleeping booth 10. The environmental adjustment device 40 includes at least one of a lighting device, an air conditioner, a fragrance emitting device, and an airflow generating device. The environmental adjustment device 40 is not limited to these devices, and may be, for example, any device that adjusts the user's sleeping environment, such as a vibration applying device that shakes the bed. The environmental adjustment device 40 is controlled by the device control unit 36.

The display device 50 is a display that displays an image that is visually recognized by a user located in the internal space of the sleeping booth 10. The display device 50 is realized by a display panel such as a liquid crystal panel or an organic EL panel. The display device 50 may be included in the control device 30. For example, if the control device 30 is realized as a tablet terminal, the display of the tablet terminal corresponds to the display device 50.

[Assistive actions to assist in appropriate measurement of body movement data]
In order to accurately estimate the depth of sleep, it is necessary for the body movement data to be appropriately measured by the body movement sensor 20. The waveform of the body movement data is likely to change depending on the position of the user lying on the body movement sensor 20 (the positional relationship between the body movement sensor 20 and the user), but it is difficult for the user to adjust the position of his or her own body so that the body movement data is appropriately measured.

Then, in the sleep booth 10, the BCG signal obtained from the currently measured body movement data is displayed in real time on the display device 50, thereby assisting the user in adjusting his or her body position so that the body movement data is measured appropriately. The following describes the assistance operation that assists in the appropriate measurement of body movement data. Figure 3 is a flowchart of the assistance operation that assists in the appropriate measurement of body movement data.

The communication unit 31 of the control device 30 receives the user's body movement data measured by the body movement sensor 20 from the body movement sensor 20 (S11), and the acquisition unit 34 acquires the received body movement data (S12).

The calculation unit 35 calculates a BCG signal from the acquired body movement data (S13). Specifically, the calculation unit 35 applies a bandpass filter to the body movement data to remove baseline fluctuations and noise. The bandpass filter is, for example, a filter with a passband of 1 Hz to 40 Hz. The calculation unit 35 also calculates the BCG signal by performing various processes to emphasize peaks derived from heartbeats in the body movement data after application of the bandpass filter. FIG. 4 is a diagram showing an example of a waveform of a BCG signal. In FIG. 4, the part surrounded by a dotted circle is the peak of the BCG signal. Note that the process of calculating the BCG signal described here is just one example, and the specific content of the process does not matter as long as it is a process of calculating a BCG signal from body movement data. For example, the type of filter does not matter as long as it can remove noise.

Next, the calculation unit 35 calculates the reliability of the BCG signal calculated in step S13 (S14). Figure 5 is a flowchart of the reliability calculation method.

The calculation unit 35, for example, detects peaks in the BCG signal (S14a) and calculates the time interval T (see FIG. 4) between adjacent peaks in a certain section of the BCG signal (S14b). If the certain section contains n peaks (n is a natural number), the calculation unit 35 can calculate the time intervals of n-1 peaks. Note that this time interval between peaks can be considered a parameter equivalent to the RR interval in an ECG (Electrocardiogram) signal.

Then, the calculation unit 35 calculates the average value of n-1 time intervals (S14c) and identifies the number k (k is a natural number) of time intervals that fall within a predetermined range (e.g., the average value ± the average value × 20%) centered on the average value (S14d). The number k means the number of time intervals that are considered to be normal. The calculation unit 35 calculates the reliability as (k/n-1) × 100 [%] (S14e).

Note that the process for calculating the reliability described here is just one example, and any process that calculates a parameter that reflects the reliability of the BCG signal may be used, and the method for calculating the reliability is not particularly limited.

Next, the calculation unit 35 determines the signal strength of the BCG signal calculated in step S13 (S15). Figure 6 is a flowchart of the method for determining the signal strength.

The calculation unit 35, for example, detects peaks in the BCG signal (S15a) and calculates the average value of the signal levels of the detected peaks (hereinafter also simply referred to as peak levels) in a certain section of the BCG signal (S15b).

The calculation unit 35 determines whether the average value of the peak levels calculated in step S15b is greater than the first threshold value and less than the second threshold value (>first threshold value) (S15c). If the average value of the peak levels is greater than the first threshold value and less than the second threshold value (Yes in S15c), the calculation unit 35 determines that the signal strength is normal (S15d).

On the other hand, if the average value of the peak levels is equal to or less than the first threshold (first threshold or less in S15c), the calculation unit 35 determines that the signal strength is weak (S15e), and if the average value of the peak levels is equal to or greater than the second threshold (second threshold or more in S15c), the calculation unit 35 determines that the user is not stationary relative to the body movement sensor 20 (there is body movement) (S15f). Note that the first threshold and the second threshold may be appropriately determined empirically or experimentally. Note that the method of determining the signal strength described here is one example. The signal strength may be determined, for example, based on the difference between the maximum and minimum values in one pulse, rather than the peak level. The method of determining the signal strength is not particularly limited.

Next, the display control unit 37 displays on the display device 50 a support image including the waveform of the BCG signal calculated in step S13, the reliability calculated in step S14, and the result of the signal strength determination in step S15 (S16). The display control unit 37 displays the support image on the display device 50, for example, by transmitting information for displaying the support image to the display device 50 using the communication unit 31. Figure 7 is a diagram showing an example of a support image.

As shown in FIG. 7, the display control unit 37 displays the waveform of the BCG signal (corresponding to the waveform currently being measured in FIG. 7), the reliability, and the result of the signal strength judgment as a support image on the display device 50. Note that, for the signal strength, either "normal", "weak signal", or "body movement" is displayed based on the flowchart in FIG. 6, but the numerical value of the signal strength may also be displayed.

The waveform, reliability, and signal strength of the BCG signal are updated periodically. In other words, the waveform, reliability, and signal strength of the BCG signal are displayed in real time. Real time here does not mean in the strict sense, but essentially in real time. When we say "displayed in real time," it is possible that the BCG signal, etc. is displayed after a delay time due to signal processing, etc. has elapsed since the body movement data was measured by the body movement sensor 20.

Also, as shown in FIG. 7, when the display control unit 37 is displaying the waveform of the BCG signal in real time on the display device 50, it displays on the display device 50 an example of the waveform of the BCG signal when the body movement data is measured correctly (hereinafter also simply referred to as an OK example) and an example of the waveform of the BCG signal when the body movement data is not measured correctly (hereinafter also simply referred to as an NG example). In other words, the display control unit 37 simultaneously displays on the display device 50 the waveform of the BCG signal currently being measured, the OK example, and the NG example. The OK example and the NG example are still images prepared in advance and are stored in the memory unit 33, for example.

With such support images, even a user who has no knowledge of the body movement sensor 20 and BCG signals can adjust the position or orientation of his or her body relative to the body movement sensor 20 while looking at the display device 50 so that the waveform of his or her own BCG signal displayed in real time becomes similar to the waveform of the OK example. Alternatively, the user can adjust the position or orientation of the body movement sensor 20 while looking at the display device 50. In other words, the control device 30 can support the user in adjusting the position or orientation of his or her own body or the body movement sensor 20 so that body movement data is measured appropriately.

In this support operation, the BCG signal is displayed on the support image, but the processing of step S13 may be omitted, and the support image may display body movement data (original data transmitted by body movement sensor 20) in real time. In this case, the display device 50 displays the user's current body movement data in real time, and further displays OK examples of body movement data and NG examples of body movement data. In this way, the display device 50 only needs to display the waveform of a signal related to the heart rate obtained from the body movement data (i.e., the waveform of the body movement data itself including components derived from the heart rate, or the waveform of a signal obtained by processing body movement data such as a BCG signal).

Furthermore, it is not essential that the reliability and signal strength judgment results are displayed in the support image, and the processing of steps S14 and S15 may be omitted.

[Modification]
In the above embodiment, the assisting operation for assisting a user taking a nap in the sleeping booth 10 in appropriately measuring body movement data has been described, but the assisting operation is not limited to being effective in the sleeping booth 10 and may be used during a normal night's sleep. Also, the assisting operation may be used, for example, by installing the body movement sensor 20 on a chair in an office or the like, so that the user can check their own condition.

When the assistive motion is used in an office, the user's mood or alertness state may be estimated based on the body movement data appropriately measured by the assistive motion, and the environment around the user (brightness, temperature, scent, air flow, etc.) may be adjusted based on the estimation result to alert or calm the user. This can have the effect of improving work efficiency and reducing the accumulation of fatigue.

The method (adjustment means) for adjusting the user's surrounding environment is not limited to the above items, and other methods that have the effect of improving work efficiency or reducing fatigue may be adopted. Also, while the effects of improving sleep onset in the sleeping booth 10, improving efficiency in the office, and reducing fatigue have been described as examples here, this is not intended to limit the use as long as it has a similar effect.

[Other Modifications]
In the above embodiment, the body movement data is used to measure the depth of sleep. However, the use of the body movement data is not particularly limited. For example, the body movement data may be used to estimate a change in the state of the user before and after a nap.

Furthermore, it is not essential that the support image be displayed on a display device 50 provided in the sleeping booth 10. For example, the method of displaying the support image described in the above embodiment may be performed on a display device provided in a sleeping room (a room that is originally provided in the building) provided in a building such as an office building.

Furthermore, the method of displaying support images only needs to be used to improve the measurement accuracy of body movement data, and may be used for purposes unrelated to sleep. If the method of displaying support images is used for purposes unrelated to sleep, the body movement sensor 20 may be provided on the backrest, seat, or surrounding area of a chair instead of a bed.

[Effects, etc.]
Inventions derived from the disclosure of this specification are, for example, the following inventions. Hereinafter, the inventions derived from the disclosure of this specification will be described together with the effects and the like obtained by the inventions.

Invention 1 includes an acquisition unit 34 that acquires body movement data of a user measured by a body movement sensor 20, and a display control unit 37 that displays in real time on a display device 50 a waveform of a signal related to a heart rate obtained from the acquired body movement data. The display control unit 37 is a display control device that displays on the display device 50, when the waveform of the signal related to a heart rate is displayed in real time on the display device 50, an example of a waveform of the signal related to a heart rate obtained when the body movement data is measured correctly, and an example of a waveform of the signal related to a heart rate obtained when the body movement data is not measured correctly. The display control device corresponds to the control device 30 in the above embodiment.

Such a display control device can assist the user in adjusting the position or orientation of their own body or the sensor so that body movement data is appropriately measured by simultaneously displaying OK and NG examples while the waveform of the heart rate-related signal is being displayed in real time on the display device 50.

Invention 2 is a display control device of Invention 1, which further includes a calculation unit 35 that calculates a BCG signal from body movement data, and a display control unit 37 that displays the calculated BCG signal waveform on the display device 50 in real time as the waveform of a signal related to the heart rate, and displays on the display device 50 an example of the BCG signal waveform when the body movement data is measured correctly and an example of the BCG signal waveform when the body movement data is not measured correctly, when the calculated BCG signal waveform is displayed in real time on the display device 50.

Such a display control device can assist the user in adjusting the position or orientation of his or her own body or the sensor so that body movement data is appropriately measured by simultaneously displaying OK and NG examples while the waveform of the BCG signal is being displayed in real time on the display device 50.

Invention 3, the calculation unit 35 further calculates the reliability of the calculated BCG signal based on the time interval of the peaks of the calculated BCG signal, and the display control unit 37 displays the calculated reliability on the display device 50 when the waveform of the calculated BCG signal is displayed in real time on the display device 50.

Such a display control device can assist the user in adjusting the position or orientation of his or her own body or the sensor so that body movement data is appropriately measured by simultaneously displaying the reliability while the waveform of the BCG signal is being displayed in real time on the display device 50.

Invention 4, the calculation unit 35 further determines the signal strength of the calculated BCG signal based on the signal level of the peak of the calculated BCG signal, and the display control unit 37 displays the result of the determination of the calculated signal strength on the display device 50 while the waveform of the calculated BCG signal is displayed in real time on the display device 50, which is the display control device of invention 2 or 3.

Such a display control device can assist the user in adjusting the position or orientation of his or her own body or the sensor so that body movement data is appropriately measured by simultaneously displaying the signal strength judgment result while the waveform of the BCG signal is being displayed in real time on the display device 50.

Invention 5 is a private booth that includes a display control device according to any one of inventions 1 to 4, a body movement sensor 20, a bed on which the body movement sensor 20 is provided, and a display device 50. The private booth corresponds to the nap booth 10 of the above embodiment.

Such a private booth can assist a user lying on a bed in the private booth in adjusting the position or orientation of their body or the sensor so that body movement data is appropriately measured by simultaneously displaying OK and NG examples while the waveform of the heart rate-related signal is displayed in real time on the display device 50.

Invention 6 is a private booth that includes a display control device according to any one of inventions 1 to 4, a body movement sensor 20, a chair on which the body movement sensor 20 is provided, and a display device 50.

Such a private booth can assist a user sitting in a chair in the private booth in adjusting the position or orientation of their body or the sensor so that body movement data is appropriately measured by simultaneously displaying OK and NG examples while the waveform of the heart rate-related signal is displayed in real time on the display device 50.

Invention 7 is a display method executed by a computer, and includes an acquisition step S12 of acquiring body movement data of a user measured by a body movement sensor 20, and a display step S16 of displaying in real time on a display device 50 a waveform of a signal related to a heart rate obtained from the acquired body movement data, and in the display step S16, when the waveform of the signal related to a heart rate is displayed in real time on the display device 50, an example of a waveform of a signal related to a heart rate obtained when the body movement data is measured correctly and an example of a waveform of a signal related to a heart rate obtained when the body movement data is not measured correctly are displayed on the display device 50.

Such a display method can assist the user in adjusting the position or orientation of their own body or the sensor so that body movement data is appropriately measured by simultaneously displaying OK and NG examples while the waveform of the heart rate-related signal is being displayed in real time on the display device 50.

Invention 8 is a program for causing a computer to execute the display method of invention 7.

According to such a program, the computer can assist the user in adjusting the position or orientation of their own body or the sensor so that body movement data is measured appropriately by simultaneously displaying OK and NG examples while the waveform of the heart rate-related signal is being displayed in real time on the display device 50.

Other Embodiments
Although the sleeping booth according to the embodiment has been described above, the present invention is not limited to the above embodiment.

For example, in the above embodiment, the processing performed by a specific processing unit may be executed by another processing unit. Also, the order of multiple processes may be changed, and multiple processes may be executed in parallel.

Furthermore, in the above embodiment, each component may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or processor reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory.

Furthermore, each component may be realized by hardware. For example, each component may be a circuit (or an integrated circuit). These circuits may form a single circuit as a whole, or each may be a separate circuit. Furthermore, each of these circuits may be a general-purpose circuit, or a dedicated circuit.

Furthermore, the general or specific aspects of the present invention may be realized as a system, an apparatus, a method, an integrated circuit, a computer program, or a computer-readable recording medium such as a CD-ROM. Furthermore, the present invention may be realized as any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium. For example, the present invention may be realized as a display system, or as a display method executed by a computer such as a display control device. Furthermore, the present invention may be realized as a program for causing a computer to execute the display method, or as a computer-readable non-transitory recording medium on which such a program is stored.

In addition, the present invention also includes forms obtained by applying various modifications to each embodiment that a person skilled in the art may conceive, or forms realized by arbitrarily combining the components and functions of each embodiment within the scope of the spirit of the present invention.

REFERENCE SIGNS LIST 10 Sleeping booth 20 Body movement sensor 30 Control device 31 Communication unit 32 Information processing unit 33 Storage unit 34 Acquisition unit 35 Calculation unit 36 Device control unit 37 Display control unit 40 Environmental adjustment device 50 Display device

Claims (8)

an acquisition unit that acquires body movement data of a user measured by a sensor;
a display control unit that displays, on a display device in real time, a waveform of a signal related to a heartbeat obtained from the acquired body movement data;
The display control unit displays, on the display device, an example of a waveform of the signal related to the heart rate obtained when the body movement data is measured correctly and an example of a waveform of the signal related to the heart rate obtained when the body movement data is not measured correctly, when the waveform of the signal related to the heart rate is displayed in real time on the display device. Further, a calculation unit is provided for calculating a BCG (Ballistocardiogram) signal from the body movement data,
The display control unit is
displaying the calculated waveform of the BCG signal on the display device in real time as the waveform of the signal related to the heartbeat;
2. The display control device according to claim 1, wherein, when the calculated waveform of the BCG signal is displayed in real time on the display device, an example of the waveform of the BCG signal when the body movement data is measured correctly and an example of the waveform of the BCG signal when the body movement data is not measured correctly are displayed on the display device. The calculation unit further calculates a reliability of the calculated BCG signal based on a time interval between peaks of the calculated BCG signal;
The display control device according to claim 2 , wherein the display control unit displays the calculated reliability on the display device when the calculated waveform of the BCG signal is displayed in real time on the display device. The calculation unit further determines a signal strength of the calculated BCG signal based on a signal level of a peak of the calculated BCG signal;
The display control device according to claim 2 , wherein the display control unit displays the calculated result of the determination of the signal strength on the display device when the calculated waveform of the BCG signal is displayed in real time on the display device. A display control device according to any one of claims 1 to 4,
The sensor;
a bed on which the sensor is provided;
A private booth equipped with the display device. A display control device according to any one of claims 1 to 4,
The sensor;
a chair on which the sensor is provided;
A private booth equipped with the display device. 1. A computer-implemented display method comprising:
An acquisition step of acquiring body movement data of a user measured by a sensor;
and displaying, on a display device, a waveform of a signal related to a heart rate obtained from the acquired body movement data in real time;
In the display step, when the waveform of the signal related to the heart rate is displayed in real time on the display device, an example of the waveform of the signal related to the heart rate obtained when the body movement data is measured correctly and an example of the waveform of the signal related to the heart rate obtained when the body movement data is not measured correctly are displayed on the display device. A program for causing the computer to execute the display method described in claim 7.

Images