WO2022190187A1

WO2022190187A1 - Vibration information-providing system, vibration information-providing server device, vibration information acquisition device, vibration information-providing method, program for vibration information provision and program for vibration information acquisition

Info

Publication number: WO2022190187A1
Application number: PCT/JP2021/009158
Authority: WO
Inventors: 理絵子鈴木
Original assignee: 株式会社ファセテラピー
Priority date: 2021-03-09
Filing date: 2021-03-09
Publication date: 2022-09-15
Also published as: JP7554515B2; JPWO2022190187A1

Abstract

A vibration information-providing system equipped with a diagnostic information acquisition unit 31 for acquiring diagnostic information pertaining to the physical condition or mental state of a user, a vibration information acquisition unit 32 for acquiring vibration information which pertains to vibrations having a tactile quality corresponding to the diagnostic information acquired by the diagnostic information acquisition unit 31 from among the plurality of units of vibration information which pertain to vibrations having different tactile qualities, which are the properties of vibrations which cause a specific tactile sensation, and a vibration information-providing unit 33 for providing vibration information acquired by the vibration information acquisition unit 32 to the user, wherein vibration information, which has the tactile quality corresponding to the diagnostic information pertaining to the physical condition or mental state of the user, is acquired from among the plurality of units of vibration information which have different tactile qualities, and is provided to the user, and by doing so, for example, it is possible to provide vibration information pertaining to vibrations which cause a specific tactile sensation from the perspective of alleviating or improving certain symptoms, according to diagnostic information pertaining to a physical condition or mental state caused by said symptoms, to a user who has said symptoms.

Description

Vibration Information Providing System, Vibration Information Providing Server Device, Vibration Information Acquiring Device, Vibration Information Providing Method, Vibration Information Providing Program, and Vibration Information Acquiring Program

TECHNICAL FIELD The present invention relates to a vibration information providing system, a vibration information providing server device, a vibration information acquiring device, a vibration information providing method, a vibration information providing program, and a vibration information acquiring program, and particularly to providing vibration information having a predetermined tactile quality. It is related to the technology for

Conventionally, target information such as voice information, image information, text information, heartbeat, body movement, and blood flow rate is analyzed to identify the tactile mode, and vibration information (predetermined tactile sensation) is provided to the user according to the tactile mode. A system is known in which tactile content generated so as to make an image is supplied to a content utilization device (see, for example, Patent Document 1). According to the technique described in Patent Document 1, tactile content that causes a specific tactile sensation by vibration is appropriately selected according to the tactile quality of the target information used by the user or the target information related to the user's biological body. It becomes possible to provide

The technology described in Patent Document 1 supplies tactile content that matches the tactile quality analyzed from target information to a content-using device. , beauty instruments, in-vehicle equipment, home appliances, audio equipment, virtual experience equipment, medical equipment, welfare equipment, toys, game machines or their controllers, switches and buttons, vibration alarms, touch panels with vibration feedback, etc. However, it does not specifically describe how the haptic content is used in the medical field.

On the other hand, when a medical worker uses tools such as an endoscope, a scalpel, forceps, and an operating handle to perform work on a subject, a sensor detects information about the body tissue of the subject and A device is known that generates a stimulation signal based on a detection result and applies vibration stimulation to tendons of muscles of a plurality of fingers of a worker holding a tool (see, for example, Patent Document 2).

The tactile force sense information presentation device described in Patent Document 2 can be used by a worker who holds a special tool necessary for work and concentrates his vision on the work without reducing workability and operability. , to present information tactilely. As an example, a contact state between the head portion of the endoscope and the subject is detected by a sensor, a stimulus signal having a magnitude corresponding to the degree of contact is generated, and a plurality of fingers of an operator holding the endoscope are generated. Vibration stimulation is applied to the tendons of each muscle.

There are also known therapeutic devices that generate vibrations according to symptoms (see Patent Documents 3 to 5, for example). In the sound wave therapy device described in Patent Document 3, a bone conduction speaker is applied as a vibrator of a massager, and a signal with a frequency and output that matches the symptom is sent to the bone conduction speaker to vibrate it. In the massage machine described in Patent Document 4, a plurality of massage modes (vibration modes) are displayed on a massage selection screen, and a vibrator is operated based on the massage mode selected and input by the user to perform massage according to the symptom of stiffness. I am trying to provide an effect.

In addition, the massage device described in Patent Document 5 uses an artificial intelligence unit to make a diagnosis according to the user based on the data on the doctor's knowledge and know-how based on the user's voice information input by dialogue with the user. Based on the diagnosis result, it is configured to recommend a suitable massage course. Patent Literature 5 also discloses that a diagnosis is made in consideration of physical conditions such as the user's pulse rate, body weight, body fat percentage, and stress index.

However, the tactile force sense information presentation device described in Patent Document 2 conveys information useful for the work to a worker performing medical treatment in the form of vibration stimulation. It does not apply vibration stimulation to the subject who is in the room. On the other hand, in the therapy devices described in Patent Documents 3 to 5, vibrations corresponding to symptoms are given to the user, but there is no mention of selecting vibrations corresponding to symptoms from the viewpoint of tactile sensation.

Japanese Patent No. 6644293 JP 2013-52046 A JP 2012-101018 A JP-A-2002-84344 JP 2018-183474 A

An object of the present invention is to provide the user with vibration information related to vibration that produces an appropriate tactile sensation according to the user's physical or mental state.

In order to solve the above-described problems, the present invention acquires diagnostic information about a user's physical condition or mental condition, and selects among a plurality of pieces of vibration information about vibrations with different tactile qualities (characteristics of vibrations that cause specific tactile sensations). Therefore, the vibration information about the vibration having the tactile quality corresponding to the diagnostic information is acquired and provided to the user.

According to the present invention configured as described above, it is possible to provide the user with vibration information related to vibration that produces an appropriate tactile sensation according to the physical or mental state of the user. For example, for a user who has a certain symptom, in accordance with the diagnostic information about the physical or mental state caused by the symptom, provides vibration information about vibration that produces a specific tactile sensation from the viewpoint of alleviating or improving the symptom. be able to.

BRIEF DESCRIPTION OF THE DRAWINGS It is a figure which shows the whole structural example of the vibration information provision system by 1st Embodiment. FIG. 2 is a block diagram showing an example functional configuration of a user terminal according to the first embodiment; FIG. 3 is a block diagram showing a functional configuration example of a server device according to the first embodiment; FIG. It is a figure which shows an example of the screen displayed on a display by a face image display part. FIG. 4 is a diagram showing an example of classification of diagnostic information and vibration information; It is a figure for demonstrating two tactile parameters. FIG. 11 is a diagram for explaining another example of section division; FIG. 4 is a diagram showing an example of classification of diagnostic information and vibration information; FIG. 4 is a diagram showing an example of classification of diagnostic information and vibration information; FIG. 11 is a block diagram showing an example functional configuration of a user terminal according to the second embodiment; FIG. 11 is a block diagram showing an example of the functional configuration of a server device according to the second embodiment; FIG. It is a figure which shows an example of the screen displayed on a display by an answer information display part. FIG. 12 is a block diagram showing an example of functional configuration of a user terminal according to the third embodiment; FIG. FIG. 11 is a block diagram showing an example of the functional configuration of a medical institution terminal according to the third embodiment; FIG. 11 is a block diagram showing an example of the functional configuration of a server device according to a third embodiment; FIG.

(First embodiment)
A first embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is a diagram showing an overall configuration example of a vibration information providing system according to a first embodiment. As shown in FIG. 1, the vibration information providing system according to the first embodiment includes a user terminal 100 used by a user, a medical institution terminal 200 used in a medical institution, and signals from the user terminal 100 and the medical institution terminal 200. and a server device 300 that receives access and provides information. The user terminal 100 and the server device 300 and the medical institution terminal 200 and the server device 300 are connected via a communication network 500 such as the Internet or a mobile phone network.

The user terminal 100 is configured by, for example, a personal computer, tablet, smartphone, or the like. Similarly, the medical institution terminal 200 is configured by, for example, a personal computer, a tablet, or a smart phone. The user terminal 100 has a camera for capturing images (either the user terminal 100 itself is equipped with a camera or the user terminal 100 is configured to be connectable with a camera). The user terminal 100 and the medical institution terminal 200 have displays for displaying images and the like.

In the first embodiment, the user terminal 100 functions as a vibration information acquisition device, and the server device 300 functions as a vibration information providing server device. That is, in the first embodiment, the camera of the user terminal 100 captures an image of the user's face and transmits the captured image to the server device 300 . The server device 300 analyzes the photographed image of the face transmitted from the user terminal 100 , selects vibration information according to the diagnosis result based on the face image, and provides the user terminal 100 with the vibration information.

The vibration information provided here is selected according to the diagnosis result regarding the user's physical condition or mental condition analyzed from the captured image of the face, and is vibration related to vibration having a tactile quality that causes a specific tactile sensation. Information. The vibration information is waveform information (either analog information or digital information) that serves as a vibration source for generating vibration by a vibrator or the like. Using this vibration information, the user can apply vibrations generated by a vibrator to his or her face, thereby alleviating or improving physical or mental disorders and symptoms.

The server device 300 also provides the user terminal 100 with diagnostic information indicating the results of diagnosis performed by the server device 300 using the captured image of the face in association with the captured image of the face transmitted from the user terminal 100 . In addition, the server device 300 provides the medical institution terminal 200 with the photographed image of the face transmitted from the user terminal 100 and diagnostic information generated by the server device 300 using the photographed image. Thereby, the photographed image of the face and the diagnostic information are shared between the user and the medical institution. The user can use the shared information to have a dialogue with the medical institution when using the vibration information to improve the disorder or symptoms, and it is also possible to receive appropriate advice from the medical institution.

As described above, the user terminal 100 has a function of transmitting a photographed face image to the server device 300, a function of receiving vibration information and diagnostic information from the server device 300, and displaying the photographed face image and diagnostic information on the display. An application having functions (hereinafter referred to as vibration-related application) is installed.

FIG. 2 is a block diagram showing a functional configuration example of the user terminal 100 according to the first embodiment. As shown in FIG. 2, the user terminal 100 includes, as a functional configuration, a facial image capturing unit 11, a facial image recording unit 12, a facial image transmitting unit 13, a vibration information receiving unit 14, a vibration information recording unit 15, and a diagnostic information receiving unit. 16 , a diagnostic information recording unit 17 , a vibration applying unit 18 and a face image display unit 19 . The user terminal 100 also includes a face image storage unit 10A and a vibration information storage unit 10B as storage media.

Each of the above functional blocks 11 to 19 can be configured by hardware, DSP (Digital Signal Processor), or software. For example, when configured by software, each of the functional blocks 11 to 19 is actually configured with a computer CPU, RAM, ROM, etc., and vibration stored in a storage medium such as RAM, ROM, hard disk, or semiconductor memory. It is realized by the operation of related application programs. In particular, the functions of the facial image photographing unit 11, the facial image transmitting unit 13, the vibration information receiving unit 14, and the diagnostic information receiving unit 16 are realized by the vibration information acquisition program.

The face image capturing unit 11 uses the camera provided in the user terminal 100 to capture the user's face. Actually, the face image capturing unit 11 captures an image including the user's face and its surrounding background. The face image recording unit 12 stores the photographed image of the face obtained by the photographing by the face image photographing unit 11 in the face image storage unit 10A together with information indicating the photographing date and time. Storing the photographed image together with the photographing date/time information includes storing the photographed image in a manner in which the photographing date/time information is included as one of the attribute information attached to the image data (image file).

The facial image transmission unit 13 transmits to the server device 300 the photographed image of the face obtained by the photographing by the facial image photographing unit 11 . Here, the face image transmission unit 13 extracts only the user's face from the captured image including the background, and transmits the image of the extracted face to the server device 300 . Alternatively, the photographed image of the face including the background may be transmitted to the server device 300 as it is, and the server device 300 may extract only the face of the user from the photographed image including the background. Alternatively, the server device 300 may recognize the user's facial portion in the photographed image including the background, and perform analysis for diagnosis on the recognized facial portion. In the following description, a photographed image of a face with or without a background may simply be referred to as a face image.

For example, when a face image is captured by the face image capturing unit 11, the face image transmitting unit 13 transmits the captured image to the server device 300. In addition, after the face image captured by the face image capturing unit 11 is stored in the face image storage unit 10A by the face image recording unit 12, the face image transmission unit 13, at an arbitrary timing designated by the user, It is also possible to read the photographed image from the face image storage unit 10A and transmit it to the server device 300. FIG.

Here, the facial image transmission unit 13 transmits the photographed image of the user's face to the server device 300 together with the photographing date/time information and the user ID. The user ID is identification information set for the vibration-related application when installing the vibration-related application in the user terminal 100, for example. The shooting date/time information is used as information for specifying the user's face image. A user ID is used as information for identifying a user.

The vibration information receiving unit 14 receives vibration information provided from the server device 300 . The details of the function of server device 300 to provide vibration information will be described later. The vibration information recording unit 15 stores the vibration information received by the vibration information receiving unit 14 in the vibration information storage unit 10B.

The diagnostic information receiving unit 16 receives diagnostic information provided from the server device 300 in association with the photographed image of the face. As will be described later, the association between the diagnostic information and the photographed image of the face is performed based on the user ID and photographing date and time information. The details of the function of the server device 300 to provide diagnostic information will be described later.

The diagnostic information recording unit 17 stores the diagnostic information received by the diagnostic information receiving unit 16 in the face image storage unit 10A in association with the photographed image of the face to be diagnosed. The photographed image of the face to be diagnosed is specified by the photographing date and time information.

The vibration applying unit 18 performs processing for applying vibration to the user's face by supplying the vibration information stored in the vibration information storage unit 10B to a vibrator for generating vibration. The vibrator may be equipped with the user terminal 100, or may be equipped with a vibration supplier connected to the user terminal 100 by wire or wirelessly. The vibration supplier may be a sheet or mask that is put on the user's face, or a pad that is put on the user's face. Also, the vibration supplier may be a speaker unit that reproduces low frequencies, such as a woofer, and instead of applying vibrations directly to the user, low-frequency vibrations may be emitted into the space where the user is present. .

When the user terminal 100 is equipped with a vibrator, the vibration information stored in the vibration information storage unit 10B is supplied to the vibrator by operating a user interface for instructing vibration generation provided by a vibration-related application, for example. By doing so, the user terminal 100 is brought into contact with the user's face in a state of generating vibration. On the other hand, when connecting the vibration supplier to the user terminal 100, the vibration information storage unit 10B is operated by operating the user interface for instructing vibration generation while the vibration supplier is in contact with the user's face. vibrate the vibration supplier by supplying the vibration information stored in the vibrator to the vibrator. When the vibration supplier is a speaker unit, the speaker unit is installed at an arbitrary place in the space, and the vibration information stored in the vibration information storage unit 10B is supplied to the vibrator, thereby emitting vibration to the space.

The facial image display unit 19 causes the display to display the user's facial image stored in the facial image storage unit 10A and diagnostic information associated with the facial image. FIG. 4 is a diagram showing an example of a screen displayed on the display by the face image display section 19. As shown in FIG. As shown in FIG. 4, the face image display unit 19 displays one or more pieces of set information, with a photographed image of the face, information indicating the photographing date and time of the photographed face, and diagnosis information acquired from the server device 300 as one piece of set information. List on screen.

The user captures an image of the face on a certain date and time and transmits the captured image to the server device 300 . As a result, the user terminal 100 acquires from the server device 300 vibration information and diagnosis information obtained by analyzing the captured image. The photographed image of the face obtained at this time, photographing date and time information, and diagnostic information constitute one set of information, which are stored in the face image storage unit 10A in association with each other. Using the vibration information acquired at this time, the user causes the vibrator to generate vibration and vibrate the face.

After that, the user takes an image of the face on another date and time and transmits the taken image to the server device 300 . As a result, the user terminal 100 acquires from the server device 300 vibration information and diagnosis information obtained by analyzing the captured image. The photographed image of the face obtained at this time, photographing date and time information, and diagnostic information are separate set information, and are stored in the face image storage unit 10A in association with each other. The user applies vibration to the face using the vibration information acquired at this time.

One or more pieces of set information sequentially accumulated in the face image storage unit 10A in this manner are displayed by the face image display unit 19 as a list as shown in FIG. This list display allows the user to confirm changes in the facial image and diagnostic information resulting from the application of vibration.

FIG. 3 is a block diagram showing a functional configuration example of the server device 300 according to the first embodiment. As shown in FIG. 3, the server device 300 of the present embodiment includes a diagnostic information acquiring unit 31, a vibration information acquiring unit 32, a vibration information providing unit 33, a diagnostic information providing unit 34, and a diagnostic information providing unit 35 as functional configurations. It has The diagnostic information acquisition unit 31 has a face image acquisition unit 31a and an image analysis unit 31b as more specific functional configurations. The server device 300 also includes a face image storage section 30A and a vibration information storage section 30B as storage media.

Each of the functional blocks 31 to 35 can be configured by hardware, DSP, or software. For example, when configured by software, each of the functional blocks 31 to 35 is actually configured with a computer CPU, RAM, ROM, etc., and vibration stored in a storage medium such as RAM, ROM, hard disk, or semiconductor memory. It is realized by running the information providing program.

The diagnostic information acquisition unit 31 acquires diagnostic information regarding the user's physical condition or mental condition. Specifically, the diagnostic information acquisition unit 31 acquires diagnostic information by the face image acquisition unit 31a and the image analysis unit 31b. The facial image acquiring unit 31a acquires the photographed image of the user's face transmitted by the facial image transmitting unit 13 of the user terminal 100, and stores it in the facial image storage unit 30A together with the photographing date/time information and the user ID.

The image analysis unit 31b acquires diagnostic information by analyzing the physical state or mental state of the user based on the photographed image of the face acquired by the face image acquisition unit 31a, and obtains the photographed image of the face (image date and time information). and stored in the face image storage unit 30A in association with the user ID. In the first embodiment, as an example, the image analysis unit 31b analyzes the photographed image of the face acquired by the face image acquisition unit 31a to obtain hardness information indicating the degree of hardness of the facial expression and facial expression. Distortion information indicating the degree of distortion is acquired as diagnostic information.

Here, the hardness information indicating the degree of hardness of facial expressions is information that classifies the degree of hardness of facial expressions into a plurality of levels. In this embodiment, as the simplest example, the degrees of facial expression hardness are classified into two levels. In this case, the facial expression hardness information is information indicating whether the facial expression is "hard" or "soft." Note that the number of classification levels is not limited to two.

Similarly, the distortion information indicating the degree of facial distortion is information that classifies the degree of facial distortion into a plurality of levels. In this embodiment, as the simplest example, the degree of facial distortion is classified into two levels. In this case, the facial distortion information is information indicating whether the distortion is "large" or "small." Note that the number of classification levels is not limited to two.

In general, when people move their skin, eyebrows, eyes, lips, cheeks, etc. to create facial expressions, their facial muscles become stiff and stiff, and their facial expressions become stiff. It is known that facial muscles become stiff when a person is tense, tired, uncomfortable, worried or stressed. Therefore, the firmness of the facial expression can be used as information suggesting the degree of tension, fatigue, discomfort, worries, and stress of a person.

As an example, it is possible to analyze the hardness of facial expressions based on captured images of faces using a classification model generated by machine learning. For example, by performing machine learning using multiple face images taken of multiple people as learning data, the neural network parameter It is possible to generate an adjusted classification model. The learning data used here are images of a person's face when he/she feels tense, tired, uncomfortable, worried, or stressed, and images of the same person's face when he/she feels tense, tired, uncomfortable, worried, or stress-free. It is assumed that the photographed image of the face when the person is in the room is provided with label information indicating whether the facial expression is "hard" or "soft". Note that the form of the generated classification model is not limited to the neural network model. For example, any one of a regression model, a tree model, a Bayesian model, a clustering model, etc. is also possible.

In addition, it is generally known that the face becomes distorted asymmetrically when the muscles of the face and head weaken with age, or when the facial muscles become stiff due to tension, fatigue, discomfort, worries and stress. ing. Therefore, the image analysis unit 31b acquires distortion information indicating the degree of distortion of the face by analyzing the left-right symmetry of the face.

For example, the image analysis unit 31b sets a vertical virtual line passing through the center point of the nose, and determines the amount of deviation between each part of the face on the left side of the virtual line and each part of the face on the right side of the virtual line. It is possible to analyze and determine that the distortion is "large" if the magnitude of the deviation is greater than or equal to the threshold, and that the distortion is "small" if the magnitude of the deviation is less than the threshold. For example, the magnitude of the deviation of each part is obtained by generating a line-symmetrical mirror image from the facial image on the left side of the virtual line, and superimposing this mirror image on the facial image on the right side of the virtual line. can be detected as the amount of difference between the pixel positions corresponding to .

Here, the amount of misalignment is detected and scored for each part such as the eyebrows, eyes, lips, cheeks, etc., and the total score is calculated by weighting and adding the scores obtained for each part. The distortion of the face may be classified as either "large" or "small" depending on whether it is equal to or greater than the threshold.

It is possible to classify the user's facial image into four types by combining the facial expression hardness information and the facial distortion information acquired as described above. That is, as shown in FIG. 5A, a first type F1 with a “hard” facial expression and “large” distortion, a second type F2 with a “soft” facial expression and a “large” distortion, and a “soft” and “large” facial expression It is possible to classify face images into either a third type F3 with "small distortion" or a fourth type F4 with a "hard" facial expression and a "small distortion". These types F1 to F4 are hereinafter referred to as diagnostic result types.

The vibration information acquisition unit 32 selects the diagnostic information acquired by the diagnostic information acquisition unit 31 from among a plurality of pieces of vibration information related to vibrations with different tactile qualities (characteristics of vibration that cause a specific tactile sensation). Vibration information related to vibration having a tactile quality corresponding to the diagnostic information stored in the face image storage unit 30A is acquired. That is, the vibration information acquisition unit 32 acquires vibration information about vibration having a tactile quality corresponding to the hardness information and distortion information of the user's face analyzed by the image analysis unit 31b.

Here, a plurality of pieces of vibration information about vibrations with different tactile qualities are stored in advance in the vibration information storage unit 30B in a manner classified in association with the hardness (softness) and roughness (smoothness) of the tactile sensation of the vibration. It is That is, as shown in FIG. 5(b), the vibration information includes a first type V1 with a “hard” and “coarse” tactile sensation, a first type V1 with a “soft” and “coarse” tactile sensation, and a second type V1 with a “soft” and “coarse” tactile sensation. It is classified into two types V2, a third type V3 having a "soft" and "smooth" tactile sensation, and a fourth type V4 having a "hard" and "smooth" tactile sensation. These types V1 to V4 are hereinafter referred to as vibration tactile sensation types.

For example, one piece of vibration information is stored in the vibration information storage unit 30B in advance for each type in a mode classified into four vibration tactile sensation types V1 to V4 in association with the hardness and roughness of the tactile sensation. The vibration information is preferably low-frequency vibration information of 40 Hz or less (preferably 20 Hz or less, more preferably 10 Hz or less, still more preferably 5 Hz or less). It should be noted that audible sound such as music may be mixed with low-frequency vibration information.

The vibration information acquisition unit 32 obtains the diagnosis result types F1 to F4 specified by the combination of the hardness information of the user's facial expression and the facial distortion information, and the hardness (softness) and roughness of the tactile sensation of the vibration ( Vibration information of the tactile quality corresponding to the diagnosis information is acquired from the vibration information storage unit 30B based on the correspondence relationship with the vibration tactile sensation types V1 to V4 specified by the combination of the smoothness). Details of the vibration information stored in the vibration information storage unit 30B and the operation of the vibration information acquisition unit 32 will be described later.

The vibration information providing unit 33 provides the user terminal 100 with the vibration information acquired by the vibration information acquiring unit 32 . The vibration information provided by the vibration information providing unit 33 is received by the vibration information receiving unit 14 of the user terminal 100, and is stored by the vibration information recording unit 15 in the vibration information storage unit 10B.

The diagnostic information providing unit 34 provides the user terminal 100 with the diagnostic information acquired by the image analysis unit 31b in association with the photographed image of the face acquired by the face image acquisition unit 31a. That is, the diagnostic information providing unit 34 provides the user terminal 100 with the diagnostic information stored in the face image storage unit 30A in association with the photographed image of the face, together with the photographing date and time information capable of specifying the photographed image of the face. do. The diagnostic information provided by the diagnostic information providing unit 34 together with the photographing date/time information is received by the diagnostic information receiving unit 16 of the user terminal 100, and the diagnostic information recording unit 17 associates the face image with the face image corresponding to the photographing date/time information. It is stored in the storage unit 10A.

For example, in response to a request from the medical institution terminal 200, the diagnostic information providing unit 35 obtains the photographed image of the user's face obtained by the face image obtaining unit 31a and the diagnostic information (facial image storage) obtained by the image analysis unit 31b. The photographed image of the face stored in the unit 30A and diagnostic information associated therewith) is provided to the medical institution terminal 200 as diagnostic information.

For example, the medical institution terminal 200 accesses the server device 300, designates the user ID provided by the user, and requests acquisition of diagnostic information. In response to this request, the medical examination information providing unit 35 generates a screen containing a list of photographed images of the user's face and diagnostic information stored in the facial image storage unit 30A in association with the user ID, and sends it to the medical institution terminal. 200 offers. As a result, a screen including information similar to the screen example shown in FIG. 4 is displayed on the display of the medical institution terminal 200 as well.

Details of the vibration information stored in the vibration information storage unit 30B will now be described. As described above, a plurality of pieces of vibration information with different tactile qualities are classified in association with the hardness (softness) and roughness (smoothness) of the tactile sensation of the vibration information. That is, the vibration information stored in the vibration information storage section 30B has a unique tactile effect with respect to the hardness and roughness of the tactile sensation. The haptic effect of vibration information is specified by the inherent tactile parameters of the vibration information.

The tactile parameter is a parameter representing the degree of opposing tactile qualities (hereinafter referred to as a tactile pair) such as <hard-soft> and <rough-smooth>, and constitutes one element of tactile sensation. For example, it is possible to use the intensity of the vibration waveform (first tactile parameter h) as the tactile parameter for the <hard-soft> tactile pair. That is, the larger the strength value, the harder the material, and the smaller the strength value, the softer the material. Further, as a tactile parameter related to the <rough-smooth> tactile pair, it is possible to use the length of the divided section of the vibration waveform (second tactile parameter t). That is, the larger the value representing the length of the divided section, the smoother it is, and the smaller the value representing the length, the rougher it is.

FIG. 6 is a diagram for explaining two tactile parameters h and t, and schematically shows an envelope waveform (hereinafter referred to as a vibration waveform) of vibration information. As shown in FIG. 6, the vibration waveform is divided into a plurality of parts along the time axis. In FIG. 6, as an example, it is divided for each time when the amplitude of the vibration waveform becomes minimum. That is, the first divided section T1 is from the start point of the vibration waveform to the first minimum value, the second divided section T2 is from the first minimum value to the second minimum value, and the second minimum The vibration waveform is divided into a plurality of sections in the direction of the time axis such as a third division section T3, . . .

It should be noted that the method of dividing the vibration waveform is not limited to the example shown in FIG. For example, the vibration waveform may be divided into a plurality of sections at each time when the amplitude reaches its maximum. Alternatively, in the case of vibration information having a positive amplitude and a negative amplitude, the vibration waveform may be divided into a plurality of sections each time the amplitude value becomes zero.

Alternatively, as shown in FIG. 7A, a plurality of characteristic points that can be distinguished from other points in the vibration waveform may be extracted, and the vibration waveform may be divided into a plurality of sections for each characteristic point. As an example, characteristic points F ₁ , F ₂ , F ₃ _, . . . may be extracted, and _a plurality of _divided sections T1, T2, T3, .

As another example, as shown in FIG. 7B, vibration information is configured by a pattern in which the same vibration waveform is repeated multiple times, and a plurality of divided sections T1, T2, T3, .・ may be set.

Then, representative amplitudes h1, h2, h3, . Identify the lengths of time t1, t2, t3, . Here, the representative amplitudes h1, h2, h3, . The values of the differences from the maximum values in the intervals T1, T2, T3, . . . are shown.

That is, since there is only one local minimum value for the divided section T1, the difference between this local minimum value and the local maximum value is the representative amplitude h1. Regarding the divided section T2, since the minimum value at the start point of the section is larger than the minimum value at the end point, the difference between the minimum value and the maximum value at the start point becomes the representative amplitude h2. As for the divided section T3, the minimum value at the end point is larger than the minimum value at the start point of the section, so the difference between the minimum value and the maximum value at the end point is the representative amplitude h3.

It should be noted that the method of specifying the representative amplitude shown here is an example, and is not limited to this. For example, the smaller one of the minimum value of the start point or the minimum value of the end point in each divided section T1, T2, T3, . . . and the maximum value in the divided section T1, T2, T3, may be specified as the representative amplitude.

Further, when the vibration information having a positive amplitude value and a negative value amplitude is divided for each time when the amplitude value is zero, the positive maximum value or negative minimum value in each divided section is the first It may be specified as a representative amplitude of the tactile parameter h. Here, the absolute value of the negative minimum value may be specified as the representative amplitude of the first tactile parameter h.

The first tactile parameter h is, for example, the average value, maximum value, minimum value, or median value of the representative amplitudes h1, h2, h3, . The second tactile parameter t is the average value, maximum value, minimum value, or median value of the time lengths t1, t2, t3, . .

As another example, the number of representative amplitudes h1, h2, h3, . , . . . exceeding a threshold value or the ratio to the total number may be used as the second tactile parameter t.

In this way, the vibration information includes the first tactile parameter h (intensity of the vibration waveform) representing the hardness of the tactile sensation of vibration, and the second tactile parameter t (the number of divided sections) representing the roughness of the tactile sensation of vibration. length), and can be classified into any of four vibrotactile sensation types V1 to V4 by the combination of the first tactile parameter h and the second tactile parameter t. .

For example, the vibration information is a first type V1 in which the first tactile parameter h is equal to or greater than the first threshold Th1 and the reciprocal (1/t) of the second tactile parameter t is equal to or greater than the second threshold Th2. A second type V2 in which the quality parameter h is less than the first threshold Th1 and the reciprocal of the second tactile parameter t is equal to or greater than the second threshold Th2, the first tactile parameter h is less than the first threshold Th1 and the second tactile A third type V3 in which the reciprocal of the parameter t is less than the second threshold Th2, and a fourth type V3 in which the first tactile parameter h is equal to or greater than the first threshold Th1 and the reciprocal of the second tactile parameter t is less than the second threshold Th2 It is classified into four types of type V4.

As described above, the vibration information acquisition unit 32 acquires the diagnosis result types F1 to F4 specified by the combination of the facial expression hardness information and the facial distortion information of the user, and the hardness and coarseness of the tactile sensation of the vibration information. Vibration information of the tactile quality corresponding to the diagnosis information of the user's face is obtained from the vibration information storage unit 30B based on the corresponding relationship with the vibration tactile sensation types V1 to V4 specified by the combination of the tactile sensations.

For example, the vibration information acquisition unit 32 selects the diagnosis result type F1 so that both the hardness of the facial expression and the facial distortion of the user approach a moderate state (the state of the position indicated by Fc in FIG. 5A). Vibration information belonging to the vibration tactile sensation types V1 to V4 associated with F4 is obtained from the vibration information storage unit 30B. Here, the diagnosis result types F1 to F4 and the vibration tactile sensation types V1 to V4 are associated as <F1-V3>, <F2-V4>, <F3-V1> and <F4-V2>.

This provides vibration information of a third type V3 on the opposite side when the diagnostic information is of the first type F1, and provides vibration information of a fourth type V4 on the opposite side when the diagnostic information is of the second type F2. When the diagnostic information is the third type F3, the vibration information of the first type V1 on the opposite electrode side is provided, and when the diagnostic information is the fourth type F4, the vibration information of the second type V2 on the opposite electrode side is provided. means to provide.

As a result, for example, when the diagnostic information is of the first type F1, that is, when the image analysis unit 31b diagnoses that the user's facial expression is "hard" and the facial distortion is "large", the diagnostic information is of the third type V3. Vibration information, that is, vibration information having a "soft" and "smooth" tactile sensation, is provided to the user. This vibration information acts to soften the hard expression of the user's face and to smooth and reduce the distortion of the user's face. When the user actually applies this vibration to the face, it is expected that the state of the face belonging to the first type F1 approaches the moderate state Fc.

As described above in detail, in the first embodiment, hardness information indicating the degree of hardness of the user's facial expression and distortion indicating the degree of facial distortion are used as diagnostic information regarding the user's physical state or mental state. Information is acquired, and vibration information having a tactile quality corresponding to the diagnostic information is acquired from among a plurality of pieces of vibration information having different tactile qualities, and is provided to the user.

According to the first embodiment configured in this way, it is possible to provide the user with vibration information regarding vibrations that produce an appropriate tactile sensation according to the user's physical or mental state. For example, for a user with a certain symptom, vibration information that produces an effective tactile sensation from the viewpoint of alleviating or improving the symptom according to diagnostic information on the physical condition or mental condition that appears on the face due to the symptom. can be provided.

In addition, the first embodiment provides a mechanism for sharing the photographed image of the user's face and diagnostic information between the user and the medical institution. As a result, the user can use the shared information to have a dialogue with the medical institution when using the vibration information to improve the disorder and symptoms, and it is also possible to receive appropriate advice from the medical institution. be.

In the above-described first embodiment, the diagnostic information is classified into four diagnostic result types F1 to F4 from the two viewpoints of the hardness of the user's facial expression and the degree of facial distortion, and the hardness of the tactile sensation is classified into four types. Although an example in which vibration information is classified into four vibration tactile sensation types V1 to V4 from the two viewpoints of roughness and roughness has been described, the present invention is not limited to this. For example, as shown in FIG. 8, the diagnostic information is classified into two diagnostic result types F1′ and F2′ from the viewpoint of the hardness of the facial expression of the user, and the vibration information is divided into two types from the viewpoint of the hardness of the tactile sensation. It may be classified into vibration tactile sensation types V1' and V2'. Further, as shown in FIG. 9, the diagnostic information is classified into two diagnostic result types F1'' and F2'' from the viewpoint of the degree of distortion of the user's face, and the vibration information is divided into two types from the viewpoint of the roughness of the tactile sensation. It may be classified into vibration tactile sensation types V1″ and V2″.

Also, in the first embodiment, the face image captured by the face image capturing unit 11 may be a moving image. In the case of moving images, for example, the image analysis shown in the above embodiment is executed for each frame, and index values relating to at least one of changes in the degree of facial expression hardness and changes in the degree of facial distortion are calculated based on the physical state of the user. Or you may make it acquire as diagnostic information regarding a mental state.

(Second embodiment)
Next, a second embodiment of the present invention will be described with reference to the drawings. The overall configuration of the vibration information providing system according to the second embodiment is the same as in FIG. FIG. 10 is a block diagram showing a functional configuration example of the user terminal 100 according to the second embodiment. In FIG. 10, the parts denoted by the same reference numerals as those shown in FIG. 2 have the same functions, and redundant description will be omitted here.

As shown in FIG. 10, the user terminal 100 according to the second embodiment includes the face image photographing unit 11, the face image recording unit 12, the face image transmitting unit 13, the diagnostic information receiving unit 16, and the diagnostic information recording unit shown in FIG. In place of the unit 17, the face image display unit 19, and the face image storage unit 10A, an inquiry execution unit 21, an answer information recording unit 22, an answer information transmission unit 23, a diagnosis information reception unit 26, a diagnosis information recording unit 27, and an answer information display It has a section 29 and an answer information storage section 20A.

The medical inquiry execution unit 21 provides the user with medical inquiry information for performing self-diagnosis on a specific symptom, and acquires answer information indicating the answer input by the user to the medical inquiry information. Particular symptoms are, for example, depression, dementia, insomnia, and the like. Self-diagnosis includes, for example, SDS (Self-rating Depression Scale), SDC (Symbol Digit Coding), EQ5D (EuroQol 5 Dimension), QIDS (Quick Inventory of Depressive Symptomatology), BDI (Beck Depression Inventory), CES-D (Center for Epidemiologic Studies Depression Scale), DSM-IV (The Diagnostic and Statistical Manual of Mental Disorders), EPDS (Edinburgh Postnatal Depression Scale), MMSE (Mini Mental State Examination:), HDS-R (Hasegawa's) Dementia Scale-Revised: Revised Hasegawa Simple Intelligence Assessment Scale), ADAS-cog (Alzheimer's Disease Assessment Scale-cognitive subscale), CDR (Clinical Dementia Rating), CDT (Clock Drawing Test), COGNISTAT (Neurobehavioral Cognitive Status Examination), Self-rating scales for dementia such as Seven Minute Screening, Athens Insomnia Scale, Epworth Sleepiness Scale (ESS) are used for insomnia self-rating scales.

For example, the medical interview execution unit 21 outputs a message prompting the medical interview to the display at a predetermined timing in accordance with an appropriate predetermined cycle (for example, every other day cycle) according to the self-assessment scale used in the medical interview. Then, the medical inquiry execution unit 21 presents the medical inquiry information to the user through a predetermined medical inquiry screen in accordance with the instruction operation by the user who has seen this message. The inquiry executing unit 21 inputs the user's answer information to the inquiry information presented through the inquiry screen.

The answer information recording unit 22 stores the answer information obtained by executing the inquiry by the inquiry execution unit 21 in the answer information storage unit 20A together with the information indicating the date and time of the inquiry. Storing the answer information together with the implementation date/time information includes storing the answer information in a manner in which the implementation date/time information is included as one of the attribute information accompanying the text data (text file) of the answer. The response information transmission unit 23 transmits the response information acquired by the medical inquiry execution unit 21 to the server device 300 together with the date and time information of the medical inquiry and the user ID.

The diagnostic information receiving unit 26 receives the diagnostic information provided from the server device 300 in association with the answer information of the inquiry. Diagnosis information and inquiry response information are associated based on the user ID and inquiry date and time information.

The diagnostic information recording unit 27 causes the diagnostic information received by the diagnostic information receiving unit 26 to be stored in the answer information storage unit 20A in association with the answer information of the medical interview targeted for diagnosis. Questionnaire response information that is the target of diagnosis is specified based on the date and time information of the inquiry.

The answer information display unit 29 causes the display to display the inquiry answer information stored in the answer information storage unit 20A and diagnostic information (symptom degree information described later) associated with the answer information. FIG. 12 is a diagram showing an example of a screen displayed on the display by the answer information display section 29. As shown in FIG. As shown in FIG. 12 , the answer information display unit 29 displays one or more sets of information including the answer information of the medical inquiry, the information indicating the date and time of the medical inquiry, and the diagnostic information acquired from the server device 300 as one piece of set information. are listed on the screen.

FIG. 11 is a block diagram showing a functional configuration example of the server device 300 according to the second embodiment. In FIG. 11, the same reference numerals as those shown in FIG. 3 have the same functions, and redundant description will be omitted here.

As shown in FIG. 11, the server device 300 according to the second embodiment includes the diagnostic information acquiring unit 31, the vibration information acquiring unit 32, the diagnostic information providing unit 34, the diagnostic information providing unit 35, and the facial image shown in FIG. Instead of the storage section 30A and the vibration information storage section 30B, a diagnostic information acquisition section 41, a vibration information acquisition section 42, a diagnostic information provision section 44, a medical examination information provision section 45, an answer information storage section 40A and a vibration information storage section 40B are provided. Prepare. Moreover, the server device 300 according to the second embodiment further includes an answer information acquisition unit 46 .

The response information acquisition unit 46 acquires the response information transmitted by the response information transmission unit 23 of the user terminal 100, and stores it in the response information storage unit 40A together with the date and time information of the medical interview and the user ID.

The diagnostic information acquisition unit 41 analyzes the response information acquired by the response information acquisition unit 46, and obtains symptom degree information indicating the user's self-diagnosis result regarding the degree of specific symptoms related to the user's physical condition or mental condition. is acquired as diagnostic information, and stored in the answer information storage unit 40A in association with the answer information of the inquiry and the user ID.

That is, the diagnostic information acquisition unit 41 calculates the score of the self-assessment scale based on the answer information, and classifies the degree of symptoms into a plurality of levels according to the score. In this embodiment, as the simplest example, the degree of symptoms is classified into two levels of "large" and "small" depending on whether the score of the self-assessment scale is equal to or higher than the threshold. Information indicating any level classified in this way is symptom degree information.

The vibration information acquiring unit 42 selects diagnostic information acquired by the diagnostic information acquiring unit 41 (diagnostic information stored in the answer information storage unit 40A in association with question answer information) from among a plurality of pieces of vibration information related to vibrations having different tactile properties. ) to acquire vibration information about vibration having a tactile quality according to That is, the vibration information acquisition unit 42 acquires vibration information regarding vibration having a tactile quality corresponding to the symptom degree information acquired by the vibration information acquisition unit 42 .

Here, the plurality of pieces of vibration information related to vibrations with different tactile qualities are classified in association with the hardness (softness) or roughness (smoothness) of the tactile sensation of the vibrations. is pre-stored in For example, similar to FIG. 8B, the vibration information is pre-stored in the vibration information storage unit 40B in a manner classified into a first type V1′ with a “hard” tactile sensation and a second type V2′ with a “soft” tactile sensation. It is Alternatively, as in FIG. 9B, the vibration information is stored in advance in the vibration information storage unit 40B in a manner classified into a first type V1 with a "rough" tactile sensation and a second type V2 with a "smooth" tactile sensation. remembered.

When the symptom degree information acquired by the diagnostic information acquisition unit 41 indicates that the degree of the symptom is "high", the vibration information acquisition unit 42 performs the operation shown in FIG. 8 ( In the case of b), the vibration information of the first type V1′ is acquired from the vibration information storage unit 40B, and in the case of FIG. If the symptom level information indicates that the symptom level is "small", the vibration information acquisition unit 42 selects the second type V2 in the case of FIG. ', and in the case of FIG. 9B, the vibration information of the second type V2'' is acquired from the vibration information storage unit 40B.

The diagnostic information providing unit 44 provides the user terminal 100 with the diagnostic information (symptom degree information) acquired by the diagnostic information acquiring unit 41 in association with the answer information acquired by the answer information acquiring unit 46 . That is, the diagnostic information providing unit 44 provides the user terminal 100 with the diagnostic information stored in the answer information storage unit 40A in association with the answer information of the medical inquiry, together with the date and time information of the medical inquiry that can specify the answer information. do. The diagnostic information provided by the diagnostic information providing unit 44 together with the implementation date and time information is received by the diagnostic information receiving unit 26 of the user terminal 100, and the diagnostic information recording unit 27 associates the response information with the response information corresponding to the implementation date and time information. It is stored in the storage unit 20A.

The medical examination information providing unit 45 stores the answer information acquired by the answer information acquisition unit 46 and the diagnostic information acquired by the diagnostic information acquisition unit 41 (stored in the answer information storage unit 40A), for example, in response to a request from the medical institution terminal 200. The stored answer information and symptom degree information associated therewith) are provided to the medical institution terminal 200 as examination information.

As described in detail above, in the second embodiment, symptom degree information indicating a self-diagnosis result based on a rating scale corresponding to a specific symptom is acquired as diagnostic information about the user's physical condition or mental condition. Vibration information having a tactile quality corresponding to the symptom degree information is acquired from among a plurality of pieces of vibration information having different degrees of symptoms, and is provided to the user.

According to the second embodiment configured in this way, it is possible to provide the user with appropriate vibration information having a tactile quality corresponding to the degree of symptoms (results of self-diagnosis) related to the user's physical condition or mental condition. . For example, for a user who has a certain symptom, it is possible to provide vibration information that produces an effective tactile sensation from the viewpoint of alleviating or improving the symptom according to diagnostic information regarding the degree of the symptom.

In addition, the second embodiment provides a mechanism for sharing the answer information and diagnosis information of the medical interview between the user and the medical institution. As a result, the user can use the shared information to have a dialogue with the medical institution when using the vibration information to improve the disorder and symptoms, and it is also possible to receive appropriate advice from the medical institution. be.

(Third Embodiment)
Next, a third embodiment of the present invention will be described with reference to the drawings. In the above-described second embodiment, an example of acquiring symptom degree information indicating the user's self-diagnosis result for a specific symptom related to physical condition or mental condition has been described. On the other hand, in the third embodiment, symptom degree information indicating the diagnosis result by a doctor is acquired as diagnosis information.

The overall configuration of the vibration information providing system according to the third embodiment is the same as in FIG. FIG. 13 is a block diagram showing a functional configuration example of the user terminal 100 according to the third embodiment. In FIG. 13, the components denoted by the same reference numerals as those shown in FIG. 10 have the same functions, and redundant description will be omitted here. FIG. 14 is a block diagram showing a functional configuration example of the server device 300 according to the third embodiment. In FIG. 14, the same reference numerals as those shown in FIG. 11 have the same functions, and redundant description will be omitted here. FIG. 15 is a block diagram showing a functional configuration example of the medical institution terminal 200 according to the third embodiment.

As shown in FIG. 15, the functional configuration of the medical institution terminal 200 according to the third embodiment includes a medical examination information input section 71, a medical examination information recording section 72, a medical examination information transmitting section 73, a diagnostic information receiving section 76, and a diagnostic information recording section 77. and an examination information display section 79 . Further, the medical institution terminal 200 according to the third embodiment includes a medical examination information storage unit 70A as a storage medium.

The medical examination information input unit 71 inputs medical examination information indicating the results of medical examinations performed on the user by doctors of medical institutions regarding specific symptoms. Medical examinations performed by a doctor include medical examinations by interviewing the user, medical examinations by observing the inside or outside of the user's body using medical equipment, and medical examinations by measuring the user's biometric information using measuring equipment. . The medical examination information input unit 71 acquires medical examination information input by a doctor by operating an input device such as a keyboard. Further, the medical examination information input unit 71 may input biological information measured by a measuring device as part of the medical examination information.

The medical examination information recording unit 72 stores the medical examination information input by the medical examination information input unit 71 in the medical examination information storage unit 70A together with the medical examination date and time information. The medical examination information transmission unit 73 transmits the medical examination information input by the medical examination information input unit 71 to the server device 300 together with the medical examination date/time information and the user ID.

The diagnostic information receiving unit 76 receives diagnostic information (symptom degree information described later) provided from the server device 300 in association with the medical examination information. Diagnosis information and consultation information are associated based on the user ID and consultation date/time information. The diagnostic information recording section 77 stores the diagnostic information received by the diagnostic information receiving section 76 in the medical examination information storage section 70A in association with the medical examination information that is the target of the diagnosis. The examination information targeted for diagnosis is specified based on the examination date and time information.

The medical examination information display unit 79 displays the medical examination information stored in the medical examination information storage unit 70A and the diagnostic information (symptom degree information) associated with the medical examination information on the display. The screen displayed on the display by the examination information display unit 79 is a list of one or more pieces of set information, for example, including examination information, examination date and time information, and diagnosis information. Alternatively, the diagnosis information may be added to the chart screen displaying the consultation information and the consultation date/time information.

As shown in FIG. 14, the server device 300 according to the third embodiment includes the answer information acquiring unit 46, the diagnostic information acquiring unit 41, the diagnostic information providing unit 44, the diagnostic information providing unit 45, and the answer information shown in FIG. In place of the storage unit 40A, a diagnosis information acquisition unit 66, a diagnosis information acquisition unit 61, a diagnosis information provision unit 64, a diagnosis result information provision unit 65, and a diagnosis information storage unit 60A are provided.

The consultation information acquisition unit 66 acquires the consultation information transmitted by the consultation information transmission unit 73 of the medical institution terminal 200, and stores it in the consultation information storage unit 60A together with the consultation date/time information and the user ID.

The diagnostic information acquisition unit 61 analyzes the medical examination information acquired by the medical examination information acquisition unit 66 to acquire symptom level information indicating the degree of specific symptoms related to the user's physical condition or mental condition as diagnostic information. The information is stored in the medical examination information storage unit 60A in association with the information and the user ID. For example, the diagnostic information acquisition unit 61 classifies the degree of symptoms into a plurality of levels based on the medical examination information, and acquires information indicating one of the classified levels as symptom degree information. In this embodiment, as the simplest example, the degree of symptoms is classified into two levels of "large" and "small".

Classification according to the degree of symptoms based on medical examination information can be performed, for example, using a classification model generated by machine learning. For example, by performing machine learning using medical examination information obtained from multiple people as learning data, a classification in which neural network parameters are adjusted so that symptom degree information is output when medical examination information is input. It is possible to generate a model. Instead of the neural network model, it is also possible to generate a classification model in any form of a regression model, a tree model, a Bayesian model, a clustering model, and the like.

The diagnostic information providing unit 64 provides the medical institution terminal 200 with the diagnostic information (symptom degree information) acquired by the diagnostic information acquiring unit 61 in association with the medical examination information acquired by the medical examination information acquiring unit 66 . That is, the diagnostic information providing unit 64 provides the medical institution terminal 200 with the diagnostic information stored in the medical examination information storage unit 60A in association with the medical examination information together with the medical examination date and time information that can specify the medical examination information. The diagnostic information provided by the diagnostic information providing unit 64 together with the examination date and time information is received by the diagnostic information receiving unit 76 of the medical institution terminal 200, and the diagnostic information recording unit 77 associates the examination date and time information with the examination information corresponding to the examination date information. It is stored in the information storage unit 70A.

The diagnostic result information providing unit 65 receives the medical examination information acquired by the medical examination information acquiring unit 66 and the diagnostic information acquired by the diagnostic information acquiring unit 61 (the medical examination information stored in the medical examination information storage unit 60A and the symptom degree associated therewith). information) is provided to the user terminal 100 as diagnosis result information.

As shown in FIG. 13, the user terminal 100 according to the third embodiment does not include the medical interview execution unit 21, answer information recording unit 22, and answer information transmission unit 23 shown in FIG. 10 as functional configurations. Further, in the user terminal 100 according to the third embodiment, instead of the diagnostic information receiving section 26, the diagnostic information recording section 27, the answer information display section 29, and the answer information storage section 20A shown in FIG. 56, a diagnostic result information recording unit 57, a diagnostic result information display unit 25, and a diagnostic result information storage unit 50A.

The diagnostic result information receiving unit 56 receives diagnostic result information provided from the server device 300 . The diagnostic result information recording unit 57 stores the diagnostic result information received by the diagnostic result information receiving unit 56 in the diagnostic result information storage unit 50A. The diagnostic result information display unit 59 displays the diagnostic result information stored in the diagnostic result information storage unit 50A on the display.

Also in the third embodiment configured as described above, it is possible to provide the user with appropriate vibration information having a tactile quality corresponding to the degree of symptoms related to the user's physical condition or mental condition (result of medical examination by a doctor). can. Further, in the third embodiment, a mechanism is provided for sharing between the user and the medical institution the examination information indicating the examination result by the doctor and the diagnostic information (symptom degree information) analyzed based on the examination result. there is As a result, the user can use the shared information to have a dialogue with the medical institution when using the vibration information to improve the disorder and symptoms, and it is also possible to receive appropriate advice from the medical institution. be.

In the above-described first to third embodiments, the vibration waveform (substance of vibration) that is the source of vibration is stored as vibration information in the vibration

information storage units

30B and 40B, and the vibration is transmitted from the server device 300 to the user terminal 100. Although examples have been described that provide the substance of the invention, the invention is not so limited. For example, the vibration information storage units 30</b>B and 40</b>B may store vibration identification information for specifying the entity of vibration as vibration information, and provide the vibration identification information from the server device 300 to the user terminal 100 . In this case, the user terminal 100 accesses the server device 300 or another server device and downloads the substance of the vibration by making a request using the vibration identification information. The vibration identification information may be a URL (Uniform Resource Locator) for accessing the download destination.

Further, in the first to third embodiments described above, for a plurality of vibration tactile sensation types classified in association with at least one of the hardness and roughness of the tactile sensation, one piece of vibration information is stored in the vibration information storage unit 30B for each type. , 40B, and obtains one piece of vibration information belonging to the vibration tactile sensation type associated with the diagnosis result type from the vibration

information storage units

30B and 40B, but the present invention is not limited to this. .

For example, a plurality of pieces of vibration information are stored in advance in the vibration

information storage units

30B and 40B for one vibration tactile sensation type, and any one of the plurality of pieces of vibration information belonging to the vibration tactile sensation type associated with the diagnosis result type is selected. One may be selected and acquired from the vibration

information storage units

30B and 40B. The selection in this case may be automatically performed by the vibration

information acquisition units

32 and 42, or may be manually performed by the user.

When the vibration

information acquisition units

32 and 42 automatically select, for example, it is possible to select randomly. Alternatively, selection is made so that the same vibration information is not continuously provided to the same user every time a photographed image of the face or answer information to an inquiry is sent from one user. good too. For example, if the diagnostic information is continuously classified into the same diagnostic result type, vibration information that is different from the previously selected vibration information among a plurality of vibration information belonging to the vibration tactile sensation type corresponding to the diagnostic result type. to get

On the other hand, when the user manually selects the vibration information, for example, the user terminal 100 is presented with vibration identification information representing a plurality of pieces of vibration information belonging to the vibration tactile sensation type associated with the diagnosis result type. It is possible to select vibration information (substance of vibration) corresponding to the vibration identification information selected by . Along with the vibration identification information, comment information describing the tactile sensation of the vibration and the like may be presented to the user.

Further, in the above-described first to third embodiments, the hardness information indicating the degree of facial expression hardness and the distortion information indicating the degree of facial distortion are used as diagnostic information regarding the user's physical condition or mental condition. , an example of using symptom degree information indicating a diagnosis result by oneself or by a doctor regarding the degree of a specific symptom has been described, but the present invention is not limited to this. For example, regarding the user's biometric information measured regarding the user's physical condition or mental condition, deviation degree information indicating the degree of deviation from the standard value or normal value of the biometric information is used as diagnostic information, and a touch corresponding to the deviation degree information is used. Qualitative vibration information may be provided. Alternatively, symptom degree information or the like may be acquired as diagnostic information by analyzing the user's physical condition or mental condition based on the audio information of the user's voice.

Further, in the first to third embodiments described above, the configuration in which the server device 300 includes the diagnostic information acquiring units 31, 41, the vibration

information acquiring units

32, 42, and the vibration information providing unit 33 has been described. is not limited to For example, the user terminal 100 may include the diagnostic information acquisition units 31 and 41 and transmit diagnostic information from the user terminal 100 to the server device 300 . Alternatively, the user terminal 100 may be provided with all the functional configurations provided by the server device 300 . In this case, the vibration information providing unit 33 presents the vibration identification information to the user, accesses the server device 300 or another server device from the user terminal 100, and makes a request using the vibration identification information, You may make it download the substance of a vibration.

Also, in the first to third embodiments, the configuration including the medical institution terminal 200 has been described, but the first and second embodiments may be configured without the medical institution terminal 200.

In addition, the above-described first to third embodiments are merely examples of specific implementations of the present invention, and the technical scope of the present invention should not be construed to be limited by these. It should not be. Thus, the invention may be embodied in various forms without departing from its spirit or essential characteristics.

10A face image storage unit 10B vibration information storage unit 11 face image photographing unit 12 face image recording unit 13 face image transmission unit 14 vibration information reception unit 15 vibration information recording unit 16 diagnosis information reception unit 17 diagnosis information recording unit 18 vibration imparting unit 19 Face image display unit 20A Face image storage unit 21 Interview execution unit 22 Answer information recording unit 23 Answer information transmission unit 26 Diagnosis information reception unit 27 Diagnosis information recording unit 29 Answer information display unit 30A Face image storage unit 30B Vibration information storage unit 31 Diagnosis Information Acquisition Part 31a Face Image Acquisition Part 31b Image Analysis Part 32 Vibration Information Acquisition Part 33 Vibration Information Provision Part 34 Diagnosis Information Provision Part 35 Diagnostic Information Provision Part 40A Answer Information Storage Part 40B Vibration Information Storage Part 41 Diagnosis Information Acquisition Part 42 Vibration Information acquisition unit 44 Diagnosis information provision unit 45 Diagnosis information provision unit 46 Answer information acquisition unit 50A Diagnosis result information storage unit 56 Diagnosis result information reception unit 57 Diagnosis result information recording unit 59 Diagnosis result information display unit 60A Diagnosis information storage unit 61 Diagnosis Information acquisition unit 64 Diagnosis information provision unit 65 Diagnosis result information provision unit 66 Diagnosis information acquisition unit 70A Diagnosis information storage unit 71 Diagnosis information input unit 72 Diagnosis information recording unit 73 Diagnosis information transmission unit 76 Diagnosis information reception unit 77 Diagnosis information recording unit 79 Medical examination information display unit 100 User terminal 200 Medical institution terminal 300 Server device

Claims

a diagnostic information acquisition unit that acquires diagnostic information about the user's physical condition or mental condition;
Vibration for obtaining vibration information about vibration having a tactile quality corresponding to the diagnostic information obtained by the diagnostic information obtaining unit, among a plurality of pieces of vibration information about vibration with different tactile quality, which is a property of vibration that causes a specific tactile sensation. an information acquisition unit;
and a vibration information providing unit that provides the user with the vibration information acquired by the vibration information acquiring unit.
The above diagnostic information acquisition unit
a face image acquisition unit that acquires a photographed image of the user's face;
and an image analysis unit for obtaining the diagnostic information by analyzing the user's physical condition or mental condition based on the photographed image of the face acquired by the face image acquisition unit. 2. The vibration information providing system according to 1.
The image analysis unit analyzes the photographed image of the face acquired by the face image acquisition unit to obtain at least hardness information indicating the degree of hardness of expression and distortion information indicating the degree of distortion of the face. Acquire one as the above diagnostic information,
3. The vibration information providing system according to claim 2, wherein the vibration information acquiring unit acquires vibration information relating to vibration having a tactile quality corresponding to at least one of the hardness information and the strain information.
The diagnostic information acquiring unit acquires, as the diagnostic information, symptom degree information indicating a diagnosis result by the patient or a doctor regarding the degree of a specific symptom related to the physical condition or the mental condition,
2. The vibration information providing system according to claim 1, wherein the vibration information acquiring unit acquires vibration information relating to vibration having a tactile quality corresponding to the symptom degree information.
A user terminal used by the user, and a server device that receives access from the user terminal and provides information,
The server device includes the diagnostic information acquisition unit, the vibration information acquisition unit, and the vibration information provision unit,
5. The vibration information providing system according to claim 1, wherein the vibration information providing unit provides the user terminal with the vibration information acquired by the vibration information acquiring unit.
A user terminal used by the user, and a server device that receives access from the user terminal and provides information,
The above user terminal is
a face image capturing unit that captures the face of the user;
a face image transmission unit configured to transmit a photographed image of the face obtained by photographing by the face image photographing unit to the server device;
a vibration information receiving unit that receives the vibration information provided from the server device;
The server device includes the face image acquisition unit, the image analysis unit, the vibration information acquisition unit, and the vibration information provision unit,
The face image acquisition unit acquires the photographed image of the face transmitted by the face image transmission unit of the user terminal,
4. The vibration information providing system according to claim 2, wherein the vibration information providing unit provides the user terminal with the vibration information acquired by the vibration information acquiring unit.
The server device further includes a diagnostic information providing unit that provides the user terminal with the diagnostic information acquired by the image analysis unit in association with the photographed image of the face acquired by the face image acquisition unit. 7. The vibration information providing system according to claim 6, characterized by:
Further equipped with a medical institution terminal used in medical institutions,
The server device further includes a diagnostic information providing unit that provides the medical institution terminal with the photographed image of the face acquired by the facial image acquisition unit and the diagnostic information acquired by the image analysis unit as diagnostic information. 8. The vibration information providing system according to claim 6 or 7, comprising:
A user terminal used by the user, and a server device that receives access from the user terminal and provides information,
The above user terminal is
an inquiry execution unit that provides the user with inquiry information for performing self-diagnosis on the specific symptom, and acquires answer information indicating an answer input by the user to the inquiry information;
an answer information transmission unit that transmits the answer information acquired by the medical interview execution unit to the server device;
a vibration information receiving unit that receives the vibration information provided from the server device;
The above server device
a response information acquisition unit that acquires the response information transmitted by the response information transmission unit;
comprising the diagnostic information acquiring unit, the vibration information acquiring unit, and the vibration information providing unit;
The diagnostic information acquiring unit acquires the symptom degree information by analyzing the answer information acquired by the answer information acquiring unit,
5. The vibration information providing system according to claim 4, wherein the vibration information providing unit provides the user terminal with the vibration information acquired by the vibration information acquiring unit.
The server device further includes a diagnostic information providing unit that provides the user terminal with the diagnostic information acquired by the diagnostic information acquiring unit in association with the answer information acquired by the answer information acquiring unit. 10. The vibration information providing system according to claim 9.
Further equipped with a medical institution terminal used in medical institutions,
The server device further includes a diagnostic information providing unit that provides the medical institution terminal with the reply information acquired by the reply information acquiring unit and the diagnostic information acquired by the diagnostic information acquiring unit as diagnostic information. 11. The vibration information providing system according to claim 9 or 10, characterized in that:
A user terminal used by the user, a medical institution terminal used in a medical institution, and a server device that receives access from the user terminal and the medical institution terminal and provides information,
The above user terminal is
A vibration information receiving unit that receives the vibration information provided from the server device,
The above medical institution terminal,
a medical examination information input unit for inputting medical examination information indicating the result of medical examination performed by a doctor on the user regarding the specific symptom;
a medical examination information transmission unit for transmitting the medical examination information input by the medical examination information input unit to the server device;
The above server device
a medical examination information obtaining unit for obtaining the medical examination information transmitted by the medical examination information transmitting unit;
comprising the diagnostic information acquiring unit, the vibration information acquiring unit, and the vibration information providing unit;
The diagnostic information acquiring unit acquires the symptom degree information by analyzing the medical examination information acquired by the medical examination information acquiring unit,
5. The vibration information providing system according to claim 4, wherein the vibration information providing unit provides the user terminal with the vibration information acquired by the vibration information acquiring unit.
The server device further includes a diagnostic information providing unit that provides the medical institution terminal with the diagnostic information acquired by the diagnostic information acquiring unit in association with the medical examination information acquired by the medical examination information acquiring unit. 13. The vibration information providing system according to claim 12, characterized by:
The server device further includes a diagnosis result information providing unit that provides the user terminal with the diagnosis information acquired by the diagnosis information acquisition unit and the diagnosis information acquired by the diagnosis information acquisition unit as diagnosis result information. 14. The vibration information providing system according to claim 12 or 13, characterized in that:
a diagnostic information acquisition unit that acquires diagnostic information about the user's physical condition or mental condition;
Vibration for obtaining vibration information about vibration having a tactile quality corresponding to the diagnostic information obtained by the diagnostic information obtaining unit, among a plurality of pieces of vibration information about vibration with different tactile quality, which is a property of vibration that causes a specific tactile sensation. an information acquisition unit;
and a vibration information providing unit for providing the user with the vibration information acquired by the vibration information acquiring unit.
The above diagnostic information acquisition unit
a face image acquisition unit that acquires a photographed image of the user's face;
and an image analysis unit for obtaining the diagnostic information by analyzing the user's physical condition or mental condition based on the photographed image of the face acquired by the face image acquisition unit. 16. The vibration information providing server device according to 15.
The image analysis unit analyzes the photographed image of the face acquired by the face image acquisition unit to obtain at least hardness information indicating the degree of hardness of expression and distortion information indicating the degree of distortion of the face. Acquire one as the above diagnostic information,
17. The vibration information providing server apparatus according to claim 16, wherein the vibration information acquisition unit acquires vibration information having a tactile quality corresponding to at least one of the hardness information and the strain information.
The diagnostic information acquiring unit acquires, as the diagnostic information, symptom degree information indicating a diagnosis result by the patient or a doctor regarding the degree of a specific symptom related to the physical condition or the mental condition,
16. The vibration information providing server apparatus according to claim 15, wherein the vibration information acquisition unit acquires vibration information relating to vibration having a tactile quality corresponding to the symptom degree information.
A vibration information acquisition device mounted on the user terminal in the vibration information providing system according to claim 6,
A vibration information acquisition device comprising the face image capturing unit, the face image transmission unit, and the vibration information reception unit.
A vibration information acquisition device mounted on the user terminal in the vibration information providing system according to claim 7,
the face image capturing unit;
the face image transmission unit;
the vibration information receiving unit;
and a diagnostic information receiving section for receiving the diagnostic information provided by the diagnostic information providing section from the server device in association with the photographed image of the face.
A vibration information acquisition device mounted on the user terminal in the vibration information providing system according to claim 9,
A vibration information acquisition device comprising the medical interview execution unit, the response information transmission unit, and the vibration information reception unit.
A vibration information acquisition device mounted on the user terminal in the vibration information providing system according to claim 10,
the medical interview execution unit;
the answer information transmission unit;
the vibration information receiving unit;
and a diagnostic information receiving section for receiving the diagnostic information provided by the diagnostic information providing section from the server device in association with the reply information.
a first step in which a diagnostic information acquisition unit of a computer acquires diagnostic information regarding the user's physical or mental state;
The vibration information acquisition unit of the computer selects a tactile quality corresponding to the diagnostic information acquired by the diagnostic information acquisition unit from among a plurality of pieces of vibration information related to vibrations having different tactile qualities, which are vibration characteristics that cause a specific tactile sensation. a second step of obtaining vibration information about vibrations having
and a third step in which the vibration information providing unit of the computer provides the vibration information acquired by the vibration information acquiring unit to the user.
diagnostic information acquiring means for acquiring diagnostic information regarding the user's physical condition or mental condition;
Vibration for obtaining vibration information about vibration having a tactile quality corresponding to the diagnostic information obtained by the diagnostic information obtaining means, among a plurality of vibration information about vibrations having different tactile qualities, which are vibration properties that cause a specific tactile sensation. Information obtaining means, and a vibration information providing program for causing a computer to function as vibration information providing means for providing the user with the vibration information obtained by the vibration information obtaining means.
A vibration information acquisition program installed in the user terminal in the vibration information providing system according to claim 6,
face image capturing means for providing the function of the face image capturing unit;
A vibration information acquisition program for causing a computer to function as face image transmission means that provides the function of the face image transmission section, and vibration information reception means that provides the function of the vibration information reception section.
A vibration information acquisition program installed in the user terminal in the vibration information providing system according to claim 9,
an inquiry execution means for providing the function of the inquiry execution unit;
A vibration information acquisition program for causing a computer to function as response information transmission means that provides the function of the response information transmission section, and vibration information reception means that provides the function of the vibration information reception section.