JP7662246B1 - Finger motion recognition device, finger alphabet output method using said device, and glove-type device for operation in virtual space - Google Patents

Abstract

[Problem] The objective of the present invention is to provide a finger movement recognition device and a finger alphabet output method using the device that can recognize finger and hand movements such as opening, bending, and placing fingers with a high degree of accuracy by using the device, converting the movements into finger alphabets, and outputting the results as voice, text, Braille, or other means via the finger alphabet on an external device such as a personal computer or smartphone, thereby enabling smooth communication between visually impaired people and people in another space.
[Solution] The present invention provides a hand movement recognition device 1 having a movement detection unit 2 that uses a sensor to detect multiple predetermined types of human movements, and a finger alphabet information output unit 3 that outputs finger alphabet information for inputting finger alphabets corresponding to human movements to an external device UT, where the movement detection unit 2 is worn on the five fingers of the hand and has a glove-type device 2 equipped with sensors that detect the movements of each of the five fingers.
[Selected Figure] Figure 1

Description

The present invention relates to a hand and finger motion recognition device that recognizes hand and finger motions, a method for outputting finger alphabets using the device, and a glove-type device that enables an operator to control his or her own avatar in a virtual space (such as the metaverse). In particular, the present invention relates to a technology that uses a glove-type device to detect the shape and orientation of hands and fingers and recognizes this as finger alphabets.

Conventionally, there are known technologies that detect finger movements and use them as input information. For example, Patent Document 1 discloses a technology that detects finger movements using a glove-type device. Furthermore, Patent Document 2 discloses a technology that recognizes specific movements based on finger movements.

Japanese Unexamined Patent Publication No. 6-138815 JP 2014-38543 A

However, communication between visually impaired and able-bodied people mainly relies on Braille or voice output, and although technology that recognizes the shape and movements of hands and fingers is being researched, in order for everyone to use these communication tools effectively, it is necessary to use a dedicated Braille device or to learn voice output technology. In particular, if Braille or finger spelling is output using a device and the Braille or finger spelling differs from the intended Braille or finger spelling, it is cumbersome to cancel the Braille or finger spelling and re-input the correct Braille or finger spelling.

The object of the present invention is to provide a finger movement recognition device and a finger alphabet output method using the device, which can convert finger and hand movements such as opening, bending, and placing fingers together into finger alphabets by using the device, and can also perform additional operations such as confirming or canceling the converted finger alphabet, and further enable the conversion result to be output as voice via finger alphabets on an external device such as a personal computer or smartphone, thereby facilitating smooth communication between visually impaired people and able-bodied people.

In order to achieve this object, the present invention provides a hand movement recognition device comprising a movement detection unit which detects a number of predetermined types of human movements using a sensor, and a finger alphabet information output unit which outputs finger alphabet information for inputting finger alphabets corresponding to the human movements to an external device , wherein the movement detection unit comprises a glove-type device which is worn on the five fingers of the hand and detects the movements of the five fingers to recognize them as finger alphabets and then confirms or cancels the finger alphabet, and the movement detection unit further comprises a leg-mounted device which detects the predetermined foot movements using an acceleration sensor and confirms or cancels the finger alphabet, and the finger alphabet information output unit outputs the finger alphabet information to an external device when the foot movement is detected .

The glove-type device also has a first to fifth sensor group attached to the joint positions on the back of each of the five fingers, a sixth sensor attached to either the palm or the back of the hand, and a seventh sensor attached to the wrist, where the first to fifth sensor groups are bending sensors that detect bending and straightening of the fingers, the sixth sensor is a sensor that detects the inclination of the hand, and the seventh sensor is a sensor that detects the direction of movement of the hand.

The present invention detects finger and hand movements, recognizes them as finger alphabets, converts those movements into finger alphabets, and also enables additional operations such as confirming or canceling the converted finger alphabet. Furthermore, by connecting to an external device, it is possible to output audio via finger alphabets, which has the effect of enabling smooth communication between visually impaired people and people in different spaces.

1 is a schematic configuration diagram of a hand movement recognition device 1 according to an embodiment of the present invention; FIG. 2 is a front view of the glove-type device 20 of the first embodiment. FIG. 2 is a rear view of the glove-type device 20 of the first embodiment. FIG. 2 is a left side view of the glove type device 20 of the first embodiment. FIG. 13 is a perspective view of a leg-mounted device 28 according to a second embodiment. FIG. 11 is a perspective view of a leg-mounted device 29 according to a second embodiment. 2 is a flowchart of a finger character output method according to a first embodiment of the present invention.

The following describes in detail an embodiment of the present invention with reference to the accompanying drawings. In the following, similar elements in all drawings are given the same reference numerals, and duplicate explanations will be omitted. In addition, in the explanations in the text, previously mentioned reference numerals will be used as necessary.

1 shows a schematic diagram of a finger action recognition device 1 according to an embodiment of the present invention. As shown in FIG. 1, the finger action recognition device 1 according to the present invention is broadly divided into a motion detection unit 2 for detecting the motion of a person (operator) and a finger character information output unit 3 for outputting information as finger characters corresponding to the motion detected by the motion detection unit 2 to an external device UT, and these are connected to each other via a wiring H1. In addition, the finger character information output unit 3 can output as voice via finger character data by connecting to an external device UT such as a smartphone, a personal computer, or a tablet terminal via wiring H2 and H3. Furthermore, the finger character information output unit 3 can output information as finger characters as braille by connecting to a braille output device such as a braille printer or a braille display. Details of the motion detection unit 2 and the finger character information output unit 3 will be described below.

<Motion detection unit 2>
The motion detection unit 2 is an element constituting the hand motion recognition device of the present invention, which detects multiple predetermined types of motions of a person's hands, feet, etc., using sensors. When the motion detection unit 2 is a glove-type device as shown in Fig. 1, it detects the motions of the five fingers of a person's (operator's) hand and collects electrical signals sent from various sensors provided in the glove-type device as data.

The electrical signals collected as data are transmitted to the finger alphabet information output unit described below via wireless or wired communication means. In addition to the glove-type device described above, the motion detection unit 2 can also use a leg-mounted device that detects predetermined foot movements using a sensor attached to the thigh or ankle. Details of the glove-type device 20, which is a first embodiment of the motion detection unit 2, and the leg-mounted devices 28 and 29, which are second embodiments, are described below.

(Glove-Type Device 20)
FIG. 2 shows a front view of a glove-type device 20 as a first embodiment of the motion detection unit, FIG. 3 shows a rear view of the glove-type device 20, and FIG. 4 shows a left side view of the glove-type device 20. The glove-type device 20 as a first embodiment of the motion detection unit is a device equipped with a function of detecting the motion of five fingers of a hand with high accuracy by attaching various sensors to a glove body made of a durable material such as fiber-reinforced plastic or Kevlar fiber. By the action of the various sensors attached to the glove body, for example, the bending sensor measures the bending degree of the fingers, and the acceleration sensor captures the movement of the entire hand, so that minute movements such as bending and straightening of the fingers and the movement of the wrist can be accurately captured as information of an electrical signal. Here, the bending sensor is, for example, two thin plate-like elastic bodies each having a resistance such as a strain gauge formed on the surface. The degree of bending of the elastic body can be detected by detecting the dimensional change of the strain gauge generated on the front side and the back side as a resistance value when the elastic body is bent. In addition, an acceleration sensor has a weight and a sensor element inside, and when the weight moves, a compressive or tensile force is generated in the sensor element. The change in resonance frequency caused by this compressive or tensile force can be detected as vibration, inclination, or linear motion generated in an object using a predetermined calculation formula.

The glove-type device 20 is a glove-type device with multiple sensors attached in a distributed manner as shown in Figures 2 to 4, and can be used by inserting a hand inside. As shown in Figures 2 to 4, the sensors attached to the glove-type device 20 are made up of at least first to fifth sensor groups 21 to 25 attached to the joint positions on the back of each of the five fingers (thumb, index finger, middle finger, ring finger, and little finger), a sixth sensor 26 attached to the palm or back of the hand, and a seventh sensor 27 attached to the wrist.

As shown in FIG. 2, the first to fifth sensor groups are attached to the thumb (the thumb), the second sensor group 22 to the index finger (the index finger), the third sensor group 23 to the middle finger, the fourth sensor group 24 to the ring finger (the ring finger), and the fifth sensor group 25 to the little finger. Furthermore, the sensors attached to each finger are divided into three types according to the joint position of each finger.

For example, the first sensor group 21 attached to the thumb is divided into three types of sensors: a first upper end sensor 21A attached to the first joint (the most distal joint) of the thumb, a first central sensor 21B attached to the second joint of the thumb, and a first lower end sensor 21C attached to the third joint of the thumb, as shown in Figure 2. These first upper end sensor 21A, first central sensor 21B, and first lower end sensor 21C are connected to each other by wiring W21 as shown in Figure 2, and wiring W21 is connected to wiring H1 that is connected to the finger character information output unit 3 described below.

Therefore, the degree of bending of the thumb is detected by each sensor and transmitted as an electrical signal to the finger character information output unit 3, which is connected via the wiring H1 shown in FIG. 2 and will be described later. The second to fifth sensor groups 22 to 25 attached to the other four fingers, the index finger, middle finger, ring finger, and little finger, have the same configuration, so a detailed description will be omitted.

The sensors applied to the first to fifth sensor groups 21 to 25 are preferably bend sensors that can detect the degree of bending of the fingers (how much each finger is bent) by arranging them at the dorsal (nail side) joints of each finger. As shown in FIG. 2, the first sensor group 21 attached to the thumb is illustrated as having all three types of sensors, the first upper end sensor 21A, the first central sensor 21B, and the first lower end sensor 21C, attached to the dorsal (nail side). However, by attaching the sensors to the side or ventral side (palm side) of the thumb, the strain gauge in the attached bend sensor changes its resistance value as it deforms, and the degree of bending of the thumb, that is, the degree of fine movements such as opening the thumb outward or placing it on the index finger, can be detected. Furthermore, by attaching a bend sensor to the joint position of the finger, for example, when the index finger (index finger) is bent 90 degrees, it can be converted into a specific finger alphabet by setting it in advance as a gesture that represents a specific finger alphabet.

The sixth sensor 26 is a sensor that is attached to the palm of the hand as shown in Figures 3 and 4 to detect the state of the hand (part from the wrist down), such as tilt or twist. The sixth sensor 26 is connected to the seventh sensor 27 (described below) via wiring W26.

In addition, the sixth sensor 26 can, for example, pre-set a state in which only the hand is moved without bending the fingers as a gesture that indicates confirmation or cancellation of a specific input content, and can use movements such as tilting the hand by tilting the wrist forward or backward, or twisting the wrist left or right as a function for inputting or outputting finger alphabets.

For this reason, it is preferable that the type of sensor be a bending sensor or an acceleration sensor. Note that although the sixth sensor shown in Figures 3 and 4 is attached to the palm of the hand, it may also be attached to the back of the hand.

The seventh sensor 27 is a sensor that is attached to the wrist as shown in Figs. 3 and 4 and detects the action of tilting the hand (or forearm) forward (operating side) or backward (opponent side) or bending the hand (or forearm) to the left or right. The seventh sensor 27 is connected to the sixth sensor 26 described above via a wire W26, and is also connected to a wire H1 that is connected to the finger alphabet information output unit via a separate wire W27. The seventh sensor is preferably an acceleration sensor or a vibration sensor. Here, the vibration sensor is, for example, a sensor that has a piezoelectric element sandwiched between two weights inside. When an object vibrates, the piezoelectric element deforms in response to the movement of the two weights and outputs an electrical signal, and the sensor can detect the vibration of the object from the measured voltage.

As described above, the glove-type device is equipped with the various sensors described above, and can capture the bending and straightening of each of the five fingers and the up, down, left and right movements of the wrist as electrical signal information. Therefore, for example, based on small operations such as opening, placing and bending the thumb (upper finger) as described above, it is possible for a single glove-type device to handle a series of steps such as confirming or canceling characters in addition to displaying letters, numbers, punctuation marks and the like corresponding to the 50 Japanese syllabary.

(Leg-mounted devices 28, 29)
A perspective view of a leg-mounted device 28 of a second embodiment of the motion detection unit wrapped around the thigh and fixed thereto is shown in Fig. 5, and a perspective view of a leg-mounted device 29 of the second embodiment of the motion detection unit wrapped around the ankle is shown in Fig. 6. The leg-mounted device of the second embodiment of the motion detection unit is equipped with various sensors such as an acceleration sensor, and is a device that is fixed to a person's leg when used. For example, there is a type (leg-mounted device 28) in which a belt-type part is wrapped around the thigh and fixed thereto as shown in Fig. 5, and a type (leg-mounted device 29) in which a ring-shaped part is attached to the ankle as shown in Fig. 6.

The leg-mounted device 28 also has a wiring W28 as shown in FIG. 5, which is connected to the wiring H1 connected to the finger alphabet information output unit 3. Similarly, the leg-mounted device 29 also has a wiring W29 as shown in FIG. 6, which is connected to the wiring H1 connected to the finger alphabet information output unit. Furthermore, the leg-mounted devices 28, 29 are devices that have the function of accurately detecting movements such as swinging up (or down) the leg or kicking up when attached to the thigh or ankle as shown in FIG. 5 and FIG. 6. The various sensors attached to these devices, for example an acceleration sensor, can grasp the instantaneous movement of the thigh in the up and down direction, and accurately capture such movements as electrical signal information.

As described above, by using a leg-mounted device in addition to the glove-type device 20 described above, for example, steps such as confirming or canceling the finger alphabet displayed using the glove-type device can be performed individually by swinging up the foot wearing the leg-mounted device. Therefore, while performing a series of steps from displaying the finger alphabet to confirming it with one hand and foot (e.g., the right hand and right foot), the other hand (e.g., the left hand) can be used to operate devices such as sending emails using external devices such as smartphones, personal computers, and tablet terminals.

<Finger alphabet information output unit 3>
The finger alphabet information output unit 3 is a device that generates finger alphabet information corresponding to the human motion detected by the motion detection unit and outputs it to an external device. It analyzes the data sent from the motion detection unit, generates finger alphabet information based on a correspondence between the motion and the finger alphabet determined in advance, and transmits it to the external device.

The finger alphabet information output unit 3 analyzes the motion data, maps the motions and finger alphabets, generates finger alphabet information, and transmits it to an external device as finger alphabet data via wired or wireless means. Note that, as shown in FIG. 1, the finger alphabet information output unit 3 is illustrated as a device separate and independent from the motion detection unit 2, but it can also be integrated by being embedded in a device such as the glove-type device or leg-mounted device of the motion detection unit 2.

Next, an embodiment of a method for outputting finger characters using a hand gesture recognition device will be described. The method for outputting finger characters using a hand gesture recognition device of the present invention is mainly composed of the following first to ninth steps.
Step 1: Detecting the movement of the sensor based on the movement of the fingers; Step 2: Transmitting an electrical signal representing the detected movement; Step 3: Checking whether the electrical signal has been received; Step 4: Selecting the corresponding alphabet based on the analysis of the electrical signal; Step 5: Checking the selection of the alphabet by analyzing the electrical signal; Step 6: Audio output of the selected alphabet in the external device; Step 7: Checking the selected alphabet; Step 8: Finalizing the selected alphabet; Step 9: Outputting the alphabet data to the external device by audio, characters, or Braille. Below, the details of steps 1 to 9 will be described with reference to the drawings when the glove-type device shown in Figures 2 to 4 or the leg-mounted device shown in Figures 5 and 6 is used as the movement detection unit. A flowchart of a method for outputting alphabets using a hand movement recognition device according to one embodiment of the present invention is shown in Figure 7.

(First step: Sensor motion detection based on finger motion)
First, a person (operator) wears a glove-type device on one hand. This glove-type device is equipped with multiple types of sensors, such as a bending sensor and an acceleration sensor, and detects the movements of the hand and five fingers (first step S001 shown in FIG. 7).

The bending sensor accurately detects the bending direction and bending angle of each finger joint, and measures the degree of bending of the fingers by capturing changes in the resistance value of the strain gauge inside the sensor according to the finger movement. The acceleration sensor also detects the direction and speed of hand movement, and determines the speed and direction of movement by measuring the acceleration associated with the hand movement.

The output of these sensors can be continuously monitored and calibrated as necessary to maintain measurement accuracy. For example, recalibration during initial use or at regular intervals can be performed to correct any misalignment or errors in the sensors, ensuring that accurate data is always obtained.

(Second step: transmitting an electrical signal indicating that motion has been detected)
In a second step, the electric signal detected in the above-mentioned first step is transmitted from the glove type device 20 to the finger character information output unit 3 (second step S002 shown in FIG. 7). The glove type device 20 can transmit the electric signal to the finger character information output unit quickly and reliably via a wired or wireless communication means.

Specifically, by using Bluetooth (registered trademark) or Wi-Fi (registered trademark) for wireless communication, it is possible to transmit information quickly without being subject to the physical constraints of wired communication such as cables. In addition, by using a recording medium such as a USB for wired communication, high-speed and stable communication is possible.

(Third step: Check whether electrical signal is received or not)
The finger character information output unit 3 checks whether an electrical signal has been received from the glove type device 20. If the finger character information output unit 3 has not received an electrical signal, it sends a command to the glove type device 20 to retransmit the electrical signal (retransmission command: third step S003).

At this time, the timestamp of the received signal and the sensor identification information are also transmitted, making it possible to identify the time of signal generation and its source. In this way, the signal transmitted from the glove-type device 20 is appropriately managed and processed by the finger character information output unit 3, enabling a smooth transition to the next step.

Note that in order to increase the reliability of communication, a security protocol such as encryption technology can be introduced into the communication between the glove-type device 20 and the finger character information output unit 3. This prevents a third party from intercepting or tampering with the electrical signal, ensuring highly confidential communication. In this way, in the second step, an electrical signal is transmitted from the glove-type device to the finger character information output unit 3, and it is ensured that the signal is received accurately and safely.

(Fourth step: Selection of corresponding finger spelling based on analysis of electrical signals)
(Fifth step: Confirmation of finger alphabet selection by analyzing electrical signals)
In the fourth and fifth steps, the finger alphabet information output unit 3 analyzes the electrical signal received in the second step (fourth step S004 in FIG. 7) to select a finger alphabet corresponding to the electrical signal (fifth step S005 in FIG. 7). The finger alphabet information output unit 3 includes a plurality of processes for analyzing the received electrical signal. This analysis process is composed of a signal pre-processing process, a feature extraction process, and a finger alphabet correspondence process.

First, the signal pre-processing process involves noise removal and normalization of the received electrical signal. For noise removal, filtering techniques are used to remove noise from the external environment or the device itself. For example, applying a low-pass filter can remove high-frequency and low-frequency components from the electrical signal, improving the quality of the electrical signal. Normalization is performed to unify the range and scale of the electrical signal obtained from the sensor, and is an important process for improving the accuracy of analysis.

Next, in the feature extraction process, important features are extracted from the preprocessed electrical signal. Feature extraction includes the bending angle of each finger, the speed and direction of hand movement, and the pressure on the fingertips. These features are analyzed using machine learning algorithms and existing finger alphabet recognition technology. For example, using an algorithm such as a neural network, it is possible to identify the corresponding finger alphabet from the extracted features with high accuracy. Note that if the analysis in the fourth step S004 shown in FIG. 7 shows that the corresponding finger alphabet cannot be selected in the fifth step S005, a command to reanalyze the electrical signal is sent to the finger alphabet information output unit 3 (reanalysis command).

(Sixth step: Voice output of selected finger alphabet on external device)
Finally, in the finger alphabet matching process, the extracted features are used to select the corresponding finger alphabet using a pre-trained model, which is pre-trained to match each specific finger flexion pattern or hand movement to a specific finger alphabet (digital alphabet).

For example, a highly accurate model is constructed based on a large amount of data using machine learning technology. This allows the finger alphabet to be quickly and accurately selected to correspond to the operator's hand and finger movements. The selected finger alphabet is then displayed on the screen of an external device such as a personal computer or smartphone connected to the finger alphabet information output unit via a wired or wireless communication means, and is simultaneously output as audio using an application (app) with a reading function and a speaker of the external device (sixth step S006 shown in FIG. 7).

(Seventh step: Confirmation of selected finger spelling)
In the seventh step, the operator performs a confirmation action to finally determine the finger alphabet selected in the fifth step (seventh step S007 shown in FIG. 7). Specifically, the finger alphabet selected in the fifth step is displayed on an external device connected to the finger alphabet information output unit 3, and is simultaneously output as voice using an application (app) with a reading function of the external device and a speaker. If the voice output finger alphabet matches the finger alphabet intended by the operator, the operator confirms it by performing a specific action using the hand or finger. This confirmation action can be determined to determine the selected finger alphabet by a predetermined action pattern, such as a movement of tilting the hand forward, a movement of raising the hand (arm), or a movement of moving the hand (arm) outside the body.

If the selected finger alphabet is different from the finger alphabet intended by the operator, an action can be taken to cancel the finger alphabet (seventh step S007 shown in FIG. 7). For example, when the glove-type device 20 is used as the motion detection unit, an electrical signal can be sent to cancel the selected finger alphabet by performing a specific motion, such as bending the hand towards the operator, lowering the hand (arm), or moving the hand (arm) inward toward the body.

In addition, when a leg-mounted device is used as the motion detection unit 2, an electrical signal can be sent to cancel the selected finger alphabet by performing a thigh-raising motion or a kicking motion (for example, of a ball). This prevents an incorrect finger alphabet from being determined, and enables the finger alphabet to be input again accurately. After re-inputting the finger alphabet, a command is sent to re-display the re-inputted finger alphabet on the screen of an external device and simultaneously output it as audio (re-display command).

(Eighth step: Confirmation of selected finger alphabet)
When the operator performs a confirmation action, the glove type device transmits an electric signal corresponding to the action again to the finger alphabet information output unit (eighth step S008 shown in FIG. 7). This electric signal is for finalizing the previously selected finger alphabet, and indicates that the confirmation action has been performed properly. At this time, in order to correctly detect the confirmation action, the glove type device detects the action with high sensitivity, and a filtering process is performed to prevent erroneous recognition.

When the confirmation operation is performed correctly and the selected finger alphabet is finally confirmed, the finger alphabet is prepared to be output to an external device in the next step, the fifth step. In this way, in the fourth step, the process by which the selected finger alphabet is finally determined through the confirmation operation is managed in detail.

(9th step: outputting finger alphabet data to an external device using voice, characters, and Braille)
In the ninth step, the finger character data finally determined in the eighth step is displayed as characters from the finger character information output unit to the external device, and is also output as any of voice, characters, braille, etc. (ninth step S009 shown in FIG. 7). This output step is performed via a wired or wireless communication means between the finger character information output unit and the external device. The external device includes a wide variety of devices such as a computer, a smartphone, a tablet, and further various Internet-connected devices.

Bluetooth (registered trademark) and Wi-Fi (registered trademark) are commonly used as wireless communication methods. Bluetooth (registered trademark) is suitable for short-distance data transmission with low power consumption, and provides stable communication between paired devices. On the other hand, Wi-Fi enables high-speed data transfer over a wide area, and also enables communication via the Internet using a home network or public wireless LAN. USB and serial cables are used as wired communication methods, and provide high-speed and stable data transfer.

When sending finger alphabet data, error checking functions and encryption technology are applied to ensure the reliability and integrity of the transmitted data. For example, by adding a checksum to the transmitted data, the receiving side can detect data errors and request a resend if necessary. In addition, the confidentiality of the transmitted data and the security of communications can be ensured by using encryption technology.

The transmitted finger alphabet data can be used by various applications and software on the external device. For example, it can be used as finger alphabet input in real time in text editors, messaging applications, email clients, etc. This also enables quick and efficient information exchange between different users, and provides an intuitive finger alphabet input interface through hand movements.

Furthermore, the process of sending finger alphabet data can be customized according to the user's needs. It can accommodate a variety of usage scenarios, such as a mode in which data is entered directly into a specific application, or a mode in which data is sent to a cloud service and synchronized with remote devices.

Thus, in the final ninth step, the finger alphabet data finalized in the eighth step is transmitted to an external device via wireless or wired communication means, and the processes used by various applications and software are managed in detail.

By using the above-mentioned hand gesture recognition device, any kind of finger alphabet can be expressed, and furthermore, by using the finger alphabet output method using the device, the device can accurately detect the movements of the fingers and hands, recognize them as finger alphabets, convert these movements into finger alphabets, and perform additional operations such as deciding or confirming the converted finger alphabet. By connecting to an external device, it is possible to output the finger alphabet data as voice. This allows smooth communication between visually impaired people and people in different spaces.

1 Finger motion recognition device 2 Motion detection unit 3 Finger character information output unit 20 Glove type device 21-25 First to fifth sensor groups 21A-21&#8557; First (top, center, bottom) sensor group 22A-22&#8557; Second (top, center, bottom) sensor group 23A-23&#8557; Third (top, center, bottom) sensor group 24A-24&#8557; Fourth (top, center, bottom) sensor group 25A-25&#8557; Fifth (top, center, bottom) sensor group 26 Sixth sensor 27 Seventh sensor 28, 29 Leg-mounted device H1-H3 Wiring S001-S009 First to ninth steps UT External device W21-W29 Wiring

Claims (2)

a motion detection unit that detects a plurality of predetermined types of human motions using a sensor;
a finger alphabet information output unit that outputs finger alphabet information for inputting a finger alphabet corresponding to the human motion to an external device;
It has
the motion detection unit has a glove-type device that is worn on five fingers of a hand and detects motions of the five fingers to recognize the finger alphabet and then confirms or cancels the finger alphabet,
The finger movement recognition device is characterized in that the movement detection unit further has a leg-mounted device that determines or cancels the finger alphabet by detecting a predetermined foot movement using an acceleration sensor attached to the foot, and the finger alphabet information output unit outputs the finger alphabet information to an external device when the foot movement is detected . A finger motion recognition device according to claim 1, characterized in that the sensor of the glove-type device has a first to fifth sensor group attached to the joint positions on the back side of each of the five fingers, a sixth sensor attached to either the palm or the back of the hand, and a seventh sensor attached to the wrist, the first to fifth sensor groups being bending sensors that detect bending and straightening of the fingers, the sixth sensor being a sensor that detects the inclination of the hand, and the seventh sensor being a sensor that detects the direction of movement of the hand.