HK1262822B - Information terminal device, motion capture system, and motion capture method - Google Patents

Description

Information terminal device, motion capture system and motion capture method

This application is a divisional application with the application date of September 4, 2015, the invention name of which is “Information terminal device, motion capture system and motion capture method” and the application number is 201580059902.5.

Technical Field

The present invention relates to a so-called wearable information terminal device having a clock function, a GPS function, a communication function, etc., and a motion capture system and a motion capture method using the information terminal device.

Background Art

In recent years, as information terminal devices have become increasingly compact, lightweight, and multifunctional, various wearable information processing terminals, known as wearable terminals, that can be worn on the user's body have been proposed (e.g., Patent Document 1). The technology disclosed in Patent Document 1 is a wristwatch-type information terminal that is worn on the user's wrist. The terminal separates the display or functions that consume high current (such as organic EL, GPS, or calls) between the main body and the base. The base function can be added or changed depending on the intended purpose, allowing for both integration and charging. As a result, the terminal achieves thinness, compactness, and waterproofing in a minimal size.

In addition, as another example of the above-mentioned wearable terminal, patent document 2 discloses a terminal that can be worn on the wrist, which can identify time, location, or motion information through built-in sensors to store and communicate, and can also be connected and linked with a mobile phone or PC, or with health equipment, etc. via short-range communication.

Furthermore, since wearable terminals are lightweight and, in addition to clock and GPS functions, also have communication functions with various sensors such as heart rate sensors, systems have been developed that can be worn during sports training or exercise such as running, walking, and cycling to record or monitor body movements (for example, Patent Document 3).

According to the system disclosed in patent document 3, a device for measuring motion parameters is installed on the soles of users' shoes, and the motion parameters obtained by monitoring athletes during exercise activities are compared with basic baseline data. Depending on whether the comparison results are within the allowable range, the music played can be changed, etc., to provide real-time feedback to the user during exercise activities.

Prior art literature

Patent Literature

Patent Document 1: Japanese Patent Application Laid-Open No. 2001-103536;

Patent Document 2: Japanese Patent Application Laid-Open No. 2002-269508;

Patent Document 1: Japanese Patent Application Laid-Open No. 2013-215590.

Summary of the Invention

Problems to be solved by the invention

However, the technologies disclosed in Patent Documents 1 and 2 tend to integrate all functions into a single information terminal device. This limits their compactness and lightness, and thus their portability. Furthermore, users may find it difficult to master all functions. Consequently, users desire terminals that incorporate their desired functions. However, since user usage varies greatly, providing terminals that meet their needs is difficult.

Furthermore, the system disclosed in Patent Document 3 compares only the measurement results from sensors mounted on the shoe soles with baseline data. Therefore, while it is possible to analyze deviations from the ideal posture, it is unable to identify the cause of the deviation and analyze the interactions between parameters necessary to eliminate the cause. For example, in a bicycle's riding posture, for efficient pedal rotation, it is ideal to align pedal rotation with the moment the athlete's foot force acts on the pedals. However, due to the complex movements of the foot bones and muscles involved in pedaling, it is difficult to analyze the cause of posture deviation simply by measuring shoe sole parameters.

On the other hand, in order to improve the monitoring accuracy of athletes, it is considered to increase the number of sensors worn by athletes, or to install sensors on the side of competitive equipment such as bicycles. However, increasing the number of sensors installed will hinder exercise and not only put pressure on athletes, but when sensors are also needed on the side of competitive equipment, sometimes multiple event categories such as swimming, cycling, and running are mixed according to the competition, such as triathlon. Therefore, when changing the event category, it is necessary to wear measuring equipment or switch settings, which leads to a lack of practicality.

Therefore, the purpose of the present invention is to provide a system that solves the above-mentioned problems and, in a wearable terminal that can be worn on the user's body, can combine the required functions according to the application, consistent with the requirements of a wearable terminal, and can improve portability and operability. In addition, the purpose of the present invention is to provide a system that avoids the need to increase the number of sensors or replace them when monitoring athletes, thereby minimizing the stress on athletes. It is also a purpose of the present invention to provide a system that can analyze the influence of parameters in exercise posture across multiple categories, thereby appropriately adjusting the posture deviation.

Means for solving problems

In order to solve the above-mentioned problems, the present invention is characterized in that it comprises: a wearable terminal having two side portions of an outer casing having a display portion on its upper surface, each of which can be connected to a belt member; and a base device, which is engaged with the bottom of the outer casing of the wearable terminal via a mechanism that can be attached and detached, and is electrically connected to the wearable terminal via a first connecting terminal. The wearable terminal and the base device have the function of sending and receiving data for display on the display portion via the first connecting terminal.

According to the present invention, basic functions such as a clock function, information display functions such as location information, and an operational interface function can be integrated into the wearable terminal through a display unit such as buttons and a touch panel. Meanwhile, since the base device has other functions such as near-field wireless communication and can be electrically connected to the wearable terminal via a connection terminal, it is possible to add desired functions to the wearable terminal by selecting the base device and connecting it via the connection terminal. Consequently, according to the present invention, since devices with various functions can be combined, users can attach and detach devices according to their intended use and select the desired functions, thereby improving the portability of the wearable terminal.

In the above invention, preferably, the wearable terminal includes a first antenna for first wireless communication, and the docking device includes a second antenna for second wireless communication, the second antenna being arranged so as to overlap with the bottom of the outer casing of the docking device body when viewed from above, and the first antenna being arranged at the outer edge of the outer casing so as not to interfere with the second antenna. In this case, since the first and second antennas for wireless communication provided by the wearable terminal and the docking device are arranged so as not to interfere with each other, interference between the radio waves of the respective antennas can be prevented, thereby preventing a decrease in reception performance.

In the above invention, the display unit is preferably curved or bent in the direction connecting the two side portions of the connecting band member. In this case, since the display screen is curved or bent, when the wearable terminal is worn on the wrist, the display area of the display unit can be ensured and adapted to the curved surface shape of the user's wrist. Moreover, when the information terminal is worn on the wrist and the display screen is viewed, the viewing angle of the display unit can be expanded, thereby allowing for immediate confirmation of the displayed content.

The above invention may further include a power supply device that is detachably engaged with the bottom of the base device, electrically connected to the base device via the second connection terminal, and supplies power via the first and second connection terminals. In this case, the power supply device is detachably engaged with the bottom of the base device, supplying power via the first and second connection terminals. Therefore, when the power supply device is engaged with the base device while the wearable terminal is engaged with the base device, power is supplied to the wearable terminal or the base device. Furthermore, when power is supplied to the wearable terminal or the base device, it is supplied to the base device after the wearable terminal.

In the above invention, the power supply device preferably includes a data communication unit that transmits and receives data with the wearable terminal or the docking device via the first and second connection terminals, and the data communication unit is capable of transmitting and receiving data with the external device via an external terminal provided on the outside of the power supply device. In this case, since the power supply device includes the data communication unit that transmits and receives data with the wearable terminal or the docking device via the first and second connection terminals, various data can be recorded in the wearable terminal or the docking device from an external terminal such as a personal computer via the power supply device.

In addition, another invention is a motion capture system for detecting the body movement of the wearer, characterized in that the system comprises: a body motion sensor, which is installed on various parts of the wearer's body to detect the three-dimensional displacement or acceleration of each part; a sole sensor, which is arranged on the sole of the wearer's shoe to detect the pressure acting on the sole; a body motion recording unit, which accumulates the detection results of the body motion sensor and the sole sensor as body motion data; a body motion calculation unit, which calculates the wearer's body movement as body motion reproduction data based on the detection results of the body motion sensors accumulated in the body motion recording unit and the relative position relationship of each body motion sensor; a correction unit, which corrects the body motion reproduction data calculated by the body motion calculation unit based on the detection results of the sole sensor; an analysis unit, which analyzes the wearer's body movement based on the body motion reproduction data corrected by the correction unit; and an output device, which displays or outputs the analysis result of the analysis unit.

Furthermore, another invention is a motion capture method for detecting body movements of a wearer, characterized in that the method comprises the following steps:

(1) a detection step, wherein body motion sensors installed on various parts of the wearer's body detect three-dimensional displacement or acceleration of each part, and sole sensors installed on the wearer's soles detect pressure acting on the soles;

(2) a body movement recording step, wherein the body movement recording unit accumulates detection results of the body movement sensor and the shoe sole sensor as body movement data;

(3) a step of generating body motion reproduction data, wherein the body motion calculation unit calculates the wearer's body motion as body motion reproduction data based on the detection results of the body motion sensors accumulated in the body motion recording unit and the relative positional relationship of the body motion sensors;

(4) a body motion reproduction data correction step, wherein the correction unit corrects the body motion reproduction data calculated by the body motion calculation unit based on the detection result of the sole sensor;

(5) an analysis step, wherein the analysis unit analyzes the body movement of the wearer based on the body movement reproduction data corrected by the body movement reproduction data correction step; and

(6) An output step of displaying or outputting the analysis result of the analysis unit through an output device.

Here, "body motion sensor" refers to a sensor that detects the three-dimensional displacement or acceleration of each part of the body, and has: a three-axis accelerometer that detects the acceleration of an object, a three-axis gyroscope that detects the angular velocity of an object, and a three-axis magnetic sensor that measures the magnitude/direction of the magnetic field, including sensors that can detect 9-axis movement.

According to these present inventions, a body motion sensor and a shoe sole sensor are attached to the wearer's body, and the wearer's body performance is calculated as body motion reproduction data based on the detection results of each sensor. The body motion reproduction data is then analyzed, and the analysis results are displayed on a display device. This allows the wearer to recognize their own body motion, and suggestions for improving the wearer's body motion are provided. In this case, a correction unit corrects the body motion reproduction data calculated by the body motion calculation unit based on the detection results of the shoe sole sensor. Therefore, even if the relative position of the body motion reproduction data with respect to the ground is incorrect due to noise or errors generated by a body motion sensor such as a 9-axis sensor, the values of each body motion sensor are corrected (e.g., to 0) using the moment of contact with the floor surface detected by the shoe sole sensor, thereby enabling appropriate construction and display/output of the body motion reproduction data.

In the above invention, it is preferred that the device further comprises: a data collection unit that obtains detection results from the body motion sensors and shoe sole sensors; and a data forwarding unit that converts the detection results obtained by the data collection unit into a unified data format and transmits the data to the body motion recording unit. In this case, by grouping multiple body motion sensors, collecting data by group, and then converting the data into a final unified data format, the data can be forwarded to other terminals in a unified manner. Therefore, even when multiple body motion sensors or shoe sole sensors are worn, the data collection unit and data forwarding unit can be used as a hub. Even when there are restrictions on the number of connected communication devices or the amount of data forwarded, the data can be temporarily aggregated and unified by the data forwarding unit, making it possible to process multiple sensors or a large amount of data.

In the above invention, preferably, the body motion recording unit is the above information terminal device. In this case, the device for storing body motion data can be made into a highly portable wearable watch type, thereby making it possible to easily collect body motion data during exercise or sports activities.

To solve the above-mentioned problems, the present invention provides a motion capture system for detecting body movements of a wearer, characterized in that the system comprises:

A plurality of body motion sensors, mounted on the left and right parts of the wearer's body, capable of measuring three-dimensional displacement or acceleration of each part;

a body motion recording unit that accumulates detection results of the body motion sensor as body motion data;

a body motion calculation unit that calculates the wearer's body motion as body motion reproduction data based on the detection results of the body motion sensors and changes in relative positional relationships between the body motion sensors;

a period extraction unit that extracts periodic changes based on the body motion reproduction data accumulated in the body motion recording unit;

a correction unit that corrects the body motion reproduction data calculated by the body motion calculation unit based on the periodic change extracted by the period extraction unit;

an analyzing unit that analyzes the body motion of the wearer based on the body motion reproduction data corrected by the correcting unit; and

An output device displays or outputs the analysis result of the analyzing unit.

Furthermore, the present invention provides a motion capture method for detecting body movements of a wearer, characterized in that the method comprises:

(1) a detection step of detecting three-dimensional displacement or acceleration of each body part by installing a plurality of body motion sensors on each body part of the wearer;

(2) a body movement recording step, wherein the body movement recording unit accumulates the detection results of the body movement sensor as body movement data;

(3) a step of generating body motion reproduction data, wherein the body motion calculation unit calculates the wearer's body motion as body motion reproduction data based on the detection results of the body motion sensors accumulated in the body motion recording unit and the relative positional relationship of the body motion sensors, and a period extraction unit extracts periodic changes based on the body motion reproduction data accumulated in the body motion recording unit;

(4) a body motion reproduction data correction step, wherein a correction unit corrects the body motion reproduction data calculated by the body motion calculation unit based on the periodic changes extracted by the period extraction unit;

(5) an analysis step, wherein an analysis unit analyzes the body movement of the wearer based on the body movement reproduction data corrected by the body movement reproduction data correction step; and

(6) An output step of displaying or outputting the analysis result of the analysis unit through an output device.

Furthermore, the present invention is a motion capture program for detecting body movements of a wearer, characterized in that the motion capture program causes a computer to execute a process comprising the following steps:

(1) a detection step of detecting three-dimensional displacement or acceleration of each body part by installing a plurality of body motion sensors on each body part of the wearer;

(2) a body movement recording step, wherein the body movement recording unit accumulates the detection results of the body movement sensor as body movement data;

(3) a step of generating body motion reproduction data, wherein the body motion calculation unit calculates the wearer's body motion as body motion reproduction data based on the detection results of the body motion sensors accumulated in the body motion recording unit and the relative positional relationship of the body motion sensors, and a period extraction unit extracts periodic changes based on the body motion reproduction data accumulated in the body motion recording unit;

(4) a body motion reproduction data correction step, wherein a correction unit corrects the body motion reproduction data calculated by the body motion calculation unit based on the periodic changes extracted by the period extraction unit;

(5) an analysis step, wherein an analysis unit analyzes the body movement of the wearer based on the body movement reproduction data corrected by the body movement reproduction data correction step; and

(6) An output step of displaying or outputting the analysis result of the analysis unit through an output device.

According to these present inventions, physical activity reproduction data is calculated based on the detection results of the physical activity sensors and the changes in the relative positional relationship of each physical activity sensor, and periodic changes are extracted based on the physical activity reproduction data accumulated in the physical activity recording unit.

According to these present inventions, multiple body motion sensors are attached to the wearer's body, and the wearer's body performance is calculated as body motion reproduction data based on the detection results of each sensor. The body motion reproduction data is then analyzed and the analysis results are displayed on a display device. This allows the wearer to recognize their own body motions and receive suggestions for improving their body motions. In this case, the correction unit corrects the body motion reproduction data calculated by the body motion calculation unit based on the periodic changes extracted by the cycle extraction unit. Therefore, even if the relative position of the body motion reproduction data relative to the ground is incorrect due to noise or errors generated by body motion sensors such as a 9-axis sensor, the values of each body motion sensor are corrected (for example, to zero) using the timing of the periodic changes extracted by the cycle extraction unit, allowing for appropriate construction and display/output of the body motion reproduction data.

Effects of the Invention

As described above, according to the present invention, in addition to the clock function, GPS function, and communication function, it can also have the function of a biological monitor. In the information processing terminal that can be worn on the user's body, the required functions can be combined according to the purpose, which is consistent with the requirements as a wearable terminal, and each device can be made lighter (miniaturized) and more portable/operable.

In addition, according to the present invention, when monitoring athletes, it is possible to avoid increasing the number of sensors or replacing them, thereby minimizing the pressure on the athletes. It is also possible to analyze the mutual influence of parameters in the sports posture across multiple project categories and appropriately adjust the shape of the sports posture.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1 is a perspective view showing the overall configuration of an information terminal device according to a first embodiment.

FIG. 2 is a perspective view showing an exploded structure of the information terminal device according to the first embodiment.

FIG3 is a top view showing the positional relationship between the GPS antenna and the wireless antenna according to the first embodiment.

FIG4 is a top view showing the wearing terminal according to the first embodiment from the top surface, and FIG4(b) is a part of the A-A cross-sectional view in FIG4(a).

FIG5(a) is an explanatory diagram showing the internal structure of the wearable terminal according to the first embodiment from the inside, and FIG5(b) is an explanatory diagram showing a modified example of the pin layout of the terminal-side connecting terminals.

FIG6 is a block diagram showing a circuit configuration of the wearable terminal according to the first embodiment.

FIG. 7 is a block diagram showing a circuit configuration of the susceptor device according to the first embodiment.

FIG8 is a perspective view showing a mounted state of the information terminal device according to the first embodiment.

FIG9 is a perspective view showing the overall configuration of an information terminal device according to a second embodiment.

FIG10 is a perspective view showing an exploded structure of an information terminal device according to a second embodiment.

FIG. 11 is a block diagram showing a circuit configuration of a susceptor device according to the second embodiment.

FIG. 12 is a diagram schematically showing the configuration of an Internet service using an information terminal device according to the third embodiment.

In FIG. 13 , (a) and (b) are screen configuration diagrams showing contents displayed on the display screen of each device according to the third embodiment.

In FIG. 14 , (a) and (b) are screen configuration diagrams showing contents displayed on the display screen of each device according to the third embodiment.

In FIG. 15 , (a) is a schematic configuration diagram of a motion capture system according to the fourth embodiment, and (b) is an example of body motion reproduction data obtained in this embodiment.

FIG16 is a block diagram showing the internal structure of each device according to the fourth embodiment.

FIG. 17 is a sequence diagram showing the motion capture method according to the fourth embodiment.

FIG18 is a schematic configuration diagram of a motion capture system according to Modification 1. FIG.

FIG19 is a block diagram showing the internal structure of each device according to Modification 1. In FIG.

FIG. 20 is a sequence diagram showing the motion capture method according to Modification 1. FIG.

FIG21 is a schematic structural diagram of a motion capture system according to Modification 2. FIG.

FIG22 is a block diagram showing the internal structure of each device according to Modification 2. In FIG.

FIG. 23 is a sequence diagram showing a motion capture method according to Modification 2. FIG.

Figure 24 is an explanatory diagram of the motion capture system involved in the fifth embodiment, wherein (a) is a three-dimensional diagram showing the overall structure of the information terminal device involved in the embodiment (when a large display is actually installed), and (b) is an explanatory diagram showing its usage form.

In FIG. 25 , (a) is a perspective view showing the overall structure of the information terminal device according to the fifth embodiment (when a small display is actually mounted), and (b) is an explanatory view showing its usage form.

In FIG. 26 , (a) is a perspective view showing a state where the information terminal device according to the fifth embodiment is mounted on a mounting tool, and (b) is an explanatory view showing a usage form thereof.

27 is an explanatory diagram of a motion capture method using the information terminal device 100 b according to the fifth embodiment, wherein (a) is a schematic diagram of motion capture during running, and (b) is a schematic diagram of motion capture during cycling competition.

FIG. 28 is an explanatory diagram showing a periodicity extraction process in a motion capture system during a bicycle competition according to the fifth embodiment.

FIG29 is a block diagram showing the internal structure of each device according to the fifth embodiment.

FIG30 is a sequence diagram showing the motion capture method according to the fifth embodiment.

DETAILED DESCRIPTION

[First embodiment]

The following describes in detail an embodiment of an information terminal device according to the present invention with reference to the accompanying drawings. FIG1 is a perspective view showing the overall structure of an information terminal device 100 according to a first embodiment, and FIG2 is a perspective view showing the structure of the information terminal device 100 according to the first embodiment after disassembly. FIG3 is a top view showing the positional relationship between the GPS antenna and the wireless antenna according to the first embodiment. In the following description of the information terminal device 100, the surface that contacts the wrist is referred to as the bottom surface, and the surface on the opposite side is referred to as the top surface.

As shown in Figures 1 and 2, the information terminal device 100 according to this embodiment is a watch-like wearable terminal that a user can wear with a strap. It consists of a wearable terminal 1 that can be worn on the user's wrist, a base device 2, and a power supply device 3 that is detachably engaged with the base device 2. Furthermore, the wearable terminal 1 and the base device 2 are also detachable from each other, allowing them to be separated and combined as needed. Furthermore, the wearable terminal 1 and the base device 2 come in multiple versions, each with different additional functions or designs depending on the intended use. This allows for flexible selection and combination based on the intended use.

Furthermore, the wearable terminal 1 and the base device 2 can also be attached and detached using a release mechanism or a locking mechanism secured by magnets. Specifically, as shown in Figure 1, magnets 80a and 80b are positioned at predetermined locations on the top surface of the base device 2. These magnets 80a and 80b serve as the magnetic release mechanism, and components attracted by the magnets are positioned on the bottom surface of the wearable terminal 1 at positions corresponding to these magnets 80a and 80b.

The wearable terminal 1 comprises an outer housing 10 having a display unit 131 on its upper surface, and straps 4a and 4b that connect the two sides of the outer housing 10. The straps 4a and 4b are used to attach the wearable terminal 1 to the wrist. Various straps can be used depending on the user's needs, including metal straps, rubber straps, leather straps, and nylon straps. Furthermore, the wearable terminal 1 is configured to be capable of expanding its functionality by using the straps 4a and 4b or other accessories, such as for attachment to a bicycle, automobile, or other device.

The exterior housing 10 is a housing component that houses a PCB and other components that perform information processing. It is a frame with openings formed on both the top and bottom surfaces. The display unit 131 is located in the top opening of the exterior housing 10, while the back cover 19 is located in the bottom opening. In this embodiment, the back cover and the center portion of the bottom surface of the exterior housing 10 are formed from a non-conductive material such as plastic, while the end portions are formed from metal such as stainless steel. The top surface is formed from a synthetic resin such as polyurethane.

The display unit 131 of the outer casing 10 is a display for displaying messages or inputting text to the user, and a touch panel is integrally formed on its upper surface. The touch panel detects the touched position on the display using a pressure-sensitive, optical, electrostatic, or electromagnetic induction detection method, for example, in units of dots constituting the display, and outputs a signal of the detected position (hereinafter referred to as the "touch position") as the touch position. The touch position is represented by an XY coordinate system set as the coordinate system of the detection surface of the touch panel. The user can perform various operations by touching the display using a touch pen PN, a finger, or the like.

This waterproof touch panel detects the touched location on the display even on the surface of water using a unique electrostatic capacitance detection method and outputs a detection signal as the touch location. The touch location is expressed using an XY coordinate system, which is set as the coordinate system of the touch panel's detection surface. Users can perform various operations and inputs by touching the display, even underwater. Furthermore, the clock body can be operated using mechanical buttons attached to the clock body.

The display unit 131 is formed into a generally rectangular shape, with the longer side of the rectangular shape extending in the direction connecting the two side portions connecting the strap members 4a and 4b (the Y-axis direction in FIG. 1 ). The display unit 131 is bent in the direction connecting the two side portions connecting the strap members 4a and 4b. Specifically, as shown in FIG. 1 and FIG. 2 , the display unit 131 has two fold lines 132a and 132b parallel to the X-axis direction, which is perpendicular to the Y-axis direction. The liquid crystal panel of the display unit 131 is formed by folding the fold lines 132a and 132b to form three display screens 131a to 131c, which are folded and bent at different angles.

In addition, in the wearable terminal 1, the GPS antenna 18a and the wireless antenna 18b are respectively arranged on the outer edge of the outer shell 10. The GPS antenna 18a is an antenna (first antenna) for wireless communication that extracts a 1.5GHz frequency band satellite signal from a SAW file (not shown) to obtain satellite information such as satellite orbit information, GPS time information, or position information containing navigation messages, and is formed of a conductive component such as stainless steel. The wireless antenna 18b is an antenna (first antenna) for BTLE (Bluetooth (registered trademark) Low Energy) and ANT+, which are extremely low-power short-range wireless standards, and is used to communicate with various sensors or other small devices carried on the body. The wireless antenna 18b is also formed of a conductive component such as stainless steel. In addition, in this embodiment, although the GPS antenna 18a and the wireless antenna 18b are arranged on the left and right as shown in the example not shown, the present invention is not limited to this, and the left and right arrangements can also be appropriately changed.

In this embodiment, the wearable terminal 1 has operation buttons 12a to 12c installed on the side of the outer casing 10 for manual operation by the user. In this embodiment, three operation buttons 12a to 12c are arranged on one side of the outer casing 10. Furthermore, in this embodiment, the wearable terminal 1 is waterproof and has the function of processing radio waves (radio signals) from GPS satellites to obtain and display speed and location information. Furthermore, the wearable terminal 1 may also include a built-in accelerometer, etc., and function as an actimeter based on acceleration generated by body movement.

Meanwhile, the base device 2 is an information terminal device that removably engages with the wearable terminal 1. It is the same size as the outer casing 10 of the wearable terminal 1 and is formed into a thin, roughly rectangular box. In this embodiment, the base device 2 is formed from a synthetic resin such as hardened plastic and contains information terminal components such as a CPU. Furthermore, in this embodiment, the base device 2 has a base-side connection terminal (first connection terminal) 21 formed on its top surface. This connection terminal 2 removably engages with the back cover 19, the bottom of the outer casing of the wearable terminal 1, via the base-side connection terminal 21.

Specifically, terminal-side connection terminals 11 are provided on the bottom of the wearable terminal 1, i.e., the back cover 19, at positions corresponding to the base-side connection terminals 21. The base-side connection terminals 21 contact the terminal-side connection terminals 11, thereby electrically connecting the base device 2 and the wearable terminal 1. Furthermore, the wearable terminal 1 and the base device 2 communicate with each other via the base-side connection terminals 21, with the base device 2 supplying power to the wearable terminal 1 and transmitting and receiving data for display on the display unit 131.

The base device 2 also includes a battery and an RFID communication function that allows contactless reading and writing of data via radio waves. This allows wireless communication with an external reader/writer device using a wireless antenna (second antenna) 24 for wireless communication, which is provided within the base device 2. This wireless antenna 24 is an antenna for contactless wireless communication (NFC (Near Field Communication)) that transmits and receives data using weak radio waves transmitted by an external reader/writer device.

Furthermore, in this embodiment, as shown in Figure 3, the wireless antenna 24, the GPS antenna 18a, and the wireless antenna 18b of the wearable terminal 1 are positioned so as not to overlap when viewed from above. Specifically, as shown in Figure 3, the wireless antenna 24 is positioned so as to overlap the bottom of the outer casing 10 of the base device 2. Furthermore, the GPS antenna 18a and the wireless antenna 18b of the wearable terminal 1 are positioned at opposite ends of the outer casing 10 so as not to interfere with the wireless antenna 24.

The power supply device 3 is a device that detachably engages the bottom of the base device 2 and supplies power to the wearable terminal 1 and the base device 2. It is a thin, roughly rectangular box made of a resin such as hardened plastic. In this embodiment, the power supply device 3 can be installed indoors, such as in a user's home, or it can be portable, such as in a car or bicycle. In the case of an indoor installation, power is supplied via an outlet and a power cable. On the other hand, in the case of a portable device, a battery can be included to store power supplied from an external AC adapter. In addition, the battery can also include a built-in transformer or rectifier that converts AC to DC, a stabilization circuit, etc.

In addition, in this embodiment, the power supply device 3 includes a USB terminal 33 for electrically connecting to an external device such as a personal computer. The USB terminal 33 is provided on the outside of the power supply device 3 and is connected to the external device via a USB cable. The USB terminal 33 is built into a connector 32 that protects the USB terminal 33 provided on the side of the power supply device 3.

As shown in Figures 1 and 2, the connector 32 is composed of a cylindrical component 35 and a cover 34. The cylindrical component 35 is arranged on the side of the outer shell 10 and has a USB terminal 33 arranged inside. The cover 34 is embedded in the space of the cylindrical component 35 and the USB terminal 33, covering the gap between the USB terminal 33 and its periphery. The cylindrical component 35 and the cover 34 make the USB terminal 33 waterproof. In addition, as a standard for the USB terminal 33, various USB terminals such as series A and B USB, mini USB, micro USB, etc. can be used. In addition, as an external connection terminal, it is not limited to a USB terminal. For example, it can be applied to a power terminal or a LAN, telephone, or other modular connectors.

Furthermore, in this embodiment, the power supply device 3 is removably attached to the bottom of the base device 2 and has the function of supplying power to the base device 2 and the wearable terminal 1 using power supplied from the USB terminal 33 and the AC adapter, as well as power stored in the battery. Specifically, a power supply device-side connection terminal (second connection terminal) 31 protrudes from the top surface of the power supply device 3, corresponding to the base-side connection terminal 21 of the base device 2. When the power supply device 3 is attached to the bottom of the base device 2, the base-side connection terminal 21 and the power supply device-side connection terminal 31 come into contact. This electrically connects the power supply device 3 to the base device 2 via the power supply device-side connection terminal 31, supplying power to the base device 2. Furthermore, since the base-side connection terminal 21 is in electrical contact with the terminal-side connection terminal 11 located on the bottom surface of the wearable terminal 1, power is also supplied to the wearable terminal 1 via the base-side connection terminal 21 and the power supply device-side connection terminal 31.

Furthermore, the pin layout of the terminal-side connecting terminal 11 may be arranged in a horizontal line as shown in FIG. 5( a ) or may be arranged with pins staggered as shown in FIG. 5( b ).

In addition, the power supply device 3 also has the function of serving as a data communication unit for transmitting and receiving data with the wearing terminal 1 and the base device 2 through the base side connection terminal 21 and the power supply device side connection terminal 31. It transmits and receives data with the external device via the external terminal provided on the outside of the power supply device 3 and engaged with the USB terminal 33, and transmits and receives data to the base side connection terminal 21 and the power supply device side connection terminal 31.

The structure of the power supply device 3 can be changed according to the intended use. For example, when it is placed on a table, it has a mounting base on the lower surface, and when it is placed on a bicycle, it has accessory parts for storing or fixing to the handle portion.

(Internal Structure of the Wearable Terminal 1)

Next, the internal structure of the wearable terminal 1 will be described. Figure 4(a) is a top view of the wearable terminal 1 according to this embodiment, and Figure 4(b) is a partial A-A cross-sectional view taken along line A in Figure 4(a). Furthermore, Figure 5 is an explanatory diagram showing the internal structure of the wearable terminal 1 according to this embodiment from the inside.

Inside the exterior housing 10, on the sides of the exterior housing 10, as shown in FIG4(b), a GPS antenna 18a and a wireless antenna 18b are positioned. As shown in FIG4(b), the GPS antenna 18a and wireless antenna 18b comprise a main body 181 located outside the exterior housing 10 and a protrusion 184 extending from the main body 181 into the exterior housing 10. The protrusion 184 is positioned so as to contact the antenna spring 16 within the exterior housing 10. The antenna spring 16 is formed from a conductive material such as stainless steel. Connecting terminals electrically connecting the GPS antenna 18a and wireless antenna 18b, as well as the respective receiving units equipped with an IC chip for GPS or BTLE reception, contact the protrusion 184 at one end and the respective receiving units at the other end. Consequently, GPS signals transmitted from GPS satellites are received by the GPS receiving unit 119a via the GPS antenna 18a, while wireless signals are received by the wireless communication unit 119b via the wireless antenna 18b.

An O-ring 182 is formed between the GPS antenna 18a, the wireless antenna 18b, and the outer case 10, and is held so as to fit within the outer periphery of the protrusion 184. This secures the GPS antenna 18 and the outer case 10, thereby sealing the interior of the outer case 10. The O-ring 182 is made of a conductive material such as stainless steel.

In addition, in the internal space of the outer shell 10 involved in the wearable terminal 1, as shown in (b) in Figure 4, the display unit 131, the display unit support plate 15, the antenna spring 16, the circuit substrate 17, and the back cover 19 are arranged in order from the display unit 131 (upper surface) to the back cover 19 side (lower surface side).

The display unit 131 is a touch panel that serves as an input device for inputting operation signals, and is composed of a display panel 136 that displays graphics on the display unit support plate 15, a touch sensor 135 that receives an operation signal corresponding to the coordinate position of the graphics displayed on the display panel 136, and a protective cover 134 that protects the touch sensor 135 and the display panel 136.

The display panel 136 is formed by a panel using an organic EL (OLED (Organic Light-Emitting Diode)) or electronic paper, a thin-film liquid crystal, etc., and is electrically connected to the circuit substrate 17 via flexible printed circuit substrates 176, 177. It displays various information, such as information generated based on signals contained in radio waves received by GPS antennas 18, 18, in accordance with a display control signal from a control unit 170 configured on the circuit substrate 17.

The touch sensor 135 detects the position touched by the user. In this embodiment, it is a capacitance-type sensor utilizing a transparent conductive film. Alternatively, a pressure-sensitive, electromagnetic induction-type, magnetostrictive-type, or other coordinate recognition sensor may be used as the touch sensor 135. The touch sensor 135 is also electrically connected to the circuit board 17 and inputs information about the detected operation position to the control unit 170 disposed on the circuit board 17.

Protective cover 134 is suitable for glass substrates such as white glass, sapphire glass, borosilicate glass, or other alkali glass, alkali-free glass, acrylic (polycarbonate), or chemically strengthened glass. Protective cover 134 is attached to the top surface of exterior case 10, sealing the top surface opening with gasket 14 provided at the edge of the opening, thereby hermetically sealing the interior of exterior case 10.

The display unit support plate 15 is a plate-shaped member that supports and protects the display unit 131. The display unit support plate 15 is provided so as to cover all components of the display unit 131 when viewed from above. The display unit support plate 15 is bonded to the lower surface of the display unit 131 via a bonding member. Furthermore, the display unit support plate 15 is electrically connected to the circuit substrate 17, and power is supplied from the circuit substrate 17 to the display unit 131 via the display unit support plate 15.

The circuit board 17 is formed of a resin or a material containing a dielectric, and is mounted with an MCU (memory control unit), or control unit 170. This circuit board 170 is composed of various ICs that control the display on the display unit 131 and process satellite signals received by the GPS antennas 18, 18. Various information is displayed on the display unit 131 under the control of a main controller mounted on this control unit 170.

Furthermore, as shown in FIG5 , the exterior housing 10 includes a flexible printed circuit board 176 for the liquid crystal panel of the display unit 131 and a flexible printed circuit board 175 for the touch panel. Each flexible printed circuit board 175, 176 is a substrate in which a circuit is formed by laminating a thin, insulating, flexible base film (e.g., polyimide) to a conductive metal such as copper foil. Each flexible printed circuit board 175, 176 is connected to a liquid crystal panel connector 171 and a touch panel connector 172, respectively, provided on the circuit board 17. One end of each flexible printed circuit board is electrically connected to the circuit board 17, and the other end is connected to the display panel 136, the touch sensor 135, or the like.

Furthermore, as shown in FIG5 , the circuit substrate 17 includes an insertion hole 11a through which a terminal-side connection terminal 11 is inserted, which contacts the connection terminal 21 of the base device 2. Terminal-side connection terminal 11 is disposed in this insertion hole 11a, thereby supplying power from the base device 2 or the power supply device 3 to the substrate. Furthermore, in this embodiment, the terminal-side connection terminal 11 is disposed in a position that does not overlap with an area 174 where the control unit 170, the GPS receiver 119a, the wireless communication unit 119b, and the like are located when viewed from above. Furthermore, an area 174 is provided on the upper side of the circuit substrate 17 as shown in FIG5 , where the control unit 170, the GPS receiver 119a, the wireless communication unit 119b, and the acceleration sensor 115 for detecting acceleration are located.

Meanwhile, in Figures 4(a) and 4(b), a battery 178 for storing power is located below the circuit board 17, closer to the bottom surface. This battery 178 is electrically connected to the circuit board 17, storing power supplied via the terminal-side connection terminals 11 within the battery 178 and supplying power to the various devices. Furthermore, a plate-shaped protective member 173 made of a non-conductive material such as plastic is located between the battery 178 and the flexible printed circuit boards 175 and 176.

(Circuit Structure of Each Device)

Next, the circuit configuration of each device will be described. FIG6 is a block diagram showing the circuit configuration of the wearable terminal 1 , and FIG7 is a block diagram showing the circuit configuration of the base device 2 .

(1) Circuit Structure of the Wearable Terminal 1

As shown in FIG6 , the wearable terminal 1 includes: a control unit 170, an output interface 111, an input interface 112, a battery 178, a memory 114, a terminal-side connection terminal 11, an acceleration sensor 115, a GPS antenna 18a, a wireless antenna 18b, a GPS receiving unit 119a, and a wireless communication unit 119b.

The control unit 170 is a computing module composed of hardware such as a processor (CPU or DSP), memory, and other electronic circuits, or software such as programs that perform the required functions, or a combination thereof. By appropriately reading and executing programs, various functional modules are virtually constructed. These constructed functional modules control the operation of each component and perform various user operations. In this embodiment, the control unit 170 acquires location information based on information acquired from satellites using GPS, and incorporates various programs related to information from the acceleration sensor and information received from the wireless communication unit, thereby displaying various information on the display 131.

The input interface 112 is a device for inputting user operations such as the operation buttons 12a to 12c and the touch sensor 135. The output interface 111 is a device for outputting images from a display, and includes a display unit 131 such as an organic EL.

The battery 178 is a power storage device that continues to receive power via the connection terminals 21 of the base device 2 and the terminal-side connection terminals 11. It supplies driving power to the display unit 131, the communication antenna 18, and other components. The memory 114 is a storage device that stores the operating system (OS), various application programs, and other data. In this embodiment, it stores identification information for the wearable terminal 1, as well as applications for displaying the time and for running.

The accelerometer 115 is a sensor for measuring acceleration. In this embodiment, a miniaturized accelerometer utilizing MEMS (Micro Electro Mechanical System) technology can be used. This accelerometer 115 can detect acceleration in the following directions: the X-axis, which corresponds to the horizontal direction when viewing the wearable terminal 1 from the front; the Y-axis, which corresponds to the vertical direction; and the Z-axis, which corresponds to the direction perpendicular to the display unit 131 of the wearable terminal 1.

The wireless communication unit 119b is capable of performing wireless communications based on data communication protocols such as BTLE and ANT. This data communication allows for external data communication and data acquisition from sensors within the device. For example, data can be transmitted and received with an accelerometer or temperature sensor attached to the user's body, thereby recording the user's physical movements or health status, or displaying location information or external information on the display unit 131. While BTLE is used as the protocol for low-power communication in this embodiment, ANT+ and other protocols may also be used.

Furthermore, in this embodiment, the wireless communication unit 119b includes a short-range communication interface for performing BTLE-based short-range wireless communication. In this embodiment, a low-power wireless communication device, such as BTLE or ANT/ANT+, a low-power version of Bluetooth (registered trademark), is used. This allows various data to be directly transmitted and received between devices via a wireless antenna 18b that transmits and receives electromagnetic waves in a predetermined frequency band within a short range. For example, log data stored in the wearable terminal 1 can be sent to a personal computer. Alternatively, this short-range wireless communication function can be implemented as an interface for short-range communication, such as infrared communication, conventional Bluetooth (registered trademark), or UWB (Ultra Wide Band) communication.

The GPS receiver 119a receives signals from GPS (Global Positioning System) satellites via the GPS antenna 18a. Based on the GPS signals, it acquires satellite information such as satellite orbit information, GPS time information, and location information. The GPS receiver 119a receives GPS signals from GPS satellites via the GPS antenna 18a, demodulates the signals, and transmits the demodulated signals to the control unit 170, which then acquires location or time information based on the signals.

On the other hand, the wireless communication 119b is a module that receives BTLE signals via the wireless antenna 18b and transmits and receives data based on a predetermined communication protocol.

(2) Circuit Structure of Base Device 2

As shown in FIG. 7 , the base device 2 includes a control unit 200 , a battery 202 , a memory 203 , a base-side connection terminal 21 , a wireless communication unit 206 , and a wireless antenna 24 .

The control unit 200 is a computing module composed of hardware such as a processor such as a CPU or DSP (Digital Signal Processor), memory and other electronic circuits, or software such as programs having their functions, or a combination thereof. By appropriately reading the program and executing it, various functional modules are virtually constructed, and various processing of the action control of each unit and user operations are performed through the constructed functional modules.

The battery 202 is a power storage device that stores power supplied by the power supply device 3 via the connection terminal 21 of the base device 2, and supplies driving power to the wireless antenna 24 and other devices. The memory 203 is a storage device that stores firmware, programs for various application programs, and other data. For example, it stores electronic money information and identification information for the base device 2. The memory 203 may also store an operating system (OS) as needed for the system.

The wireless communication unit 206 has a function of performing short-range wireless communication based on a data communication protocol such as Bluetooth (registered trademark). Specifically, the wireless communication unit 206 is a device that reads data written to the memory 203 at a short distance and can transmit and receive data between peripheral devices such as a personal computer or a smartphone.

(How to use)

The method of using this information terminal device 100 is described below. Figure 8 is a three-dimensional diagram showing the information terminal device involved in the first embodiment in the wearing state. As shown in Figure 8, the information terminal device 100 is worn by wrapping the strap parts 4a and 4b around the user's wrist. In addition, since the GPS receiving unit 119 obtains the GPS signal, the time information is displayed on the display unit 131 under the control of the control unit 170 of the wearing terminal 1. In addition, on the control unit 170, by executing the software for running, the running information such as the running speed, running distance, running time, running pace, interval (number of steps per minute), and number of steps is displayed. At this time, the current position can also be displayed based on the GPS signal obtained from the GPS receiving unit 119. As a method of displaying the current position, in addition to displaying a mark on the map, a simple display based on a simplified map or elevation difference to reduce the data size of the map can also be used.

Furthermore, by electrically connecting the wearing terminal 1 and the base device 2 via the base side connection terminal 21, the wireless communication unit 206 of the base device 2 can be used to perform contactless wireless communication with the outside for personal authentication or to purchase goods as electronic currency.

(Action/Effect)

According to this first embodiment, since the wearable terminal on the display unit 131 includes functions such as time information and running software, when only the wearable terminal is worn, the wearable terminal 1 can be used as a clock or to display the current location on a map while running. Furthermore, by adding a near-field wireless communication function to the base device 2 and adding electronic money information to the memory 203, the base device 2 can be engaged with the wearable terminal 1 to add the electronic money function to the information terminal 100, allowing users to run without carrying cash. Thus, according to this embodiment, since devices with various functions can be combined, users can attach and detach the devices according to their intended use, thereby improving user convenience.

In addition, in this embodiment, the wireless antenna 24 for short-range wireless communication of the base device 2 is configured to overlap with the back cover 19 of the outer shell 10 of the base device body, and the GPS antennas 18, 18 are configured at the outer edge of the outer shell and are configured not to overlap with the wireless antenna 24, thereby preventing radio wave interference between the GPS antennas 18, 18 and the wireless antenna 24, resulting in preventing deterioration of reception performance.

Furthermore, in the present embodiment, the display portion 131 is bent in the direction connecting both side portions of the connecting belt members 4 a and 4 b , so that the visibility of the display portion 131 can be improved.

In this embodiment, since the power supply device 3 can be detachably engaged with the bottom of the base device 2 and power is supplied through the base side connection terminal 21 and the power supply device side connection terminal 31, when the wearable terminal 1 and the base device 2 are engaged, power can be supplied to the wearable terminal 1 and the base device 2 at the same time.

Furthermore, according to this embodiment, the power supply device 3 has a USB terminal 33 for transmitting and receiving data with the wearable terminal 1 or the base device 2 through the base-side connection terminal 21 and the power supply device-side connection terminal 31. Data can be transmitted and received between the external device and the external device through the external terminal provided on the outside of the power supply device. Therefore, various data can be recorded in the wearable terminal 1 and the base device 2 from an external terminal such as a personal computer via the power supply device 3.

[Second embodiment]

Next, the second embodiment of the present invention will be described. In this embodiment, a wearable terminal 1a and a base device 2a having shapes and functions different from those of the first embodiment will be described. Figure 9 is a perspective view showing the overall structure of the information terminal device involved in the second embodiment, and Figure 10 is a perspective view showing the structure of the information terminal device involved in the second embodiment after being decomposed. In the following embodiments, the same reference numerals are assigned to the same structural elements as in the first embodiment, and unless otherwise specified, their functions and other aspects are the same, and their description will be omitted.

The information terminal device 100a according to this embodiment comprises a wearable terminal 1a, a base device 2a, and a power supply device 3. Even in this embodiment, the wearable terminal 1a includes an outer housing 10 having a display portion 133 on its upper surface, and straps 4a and 4b that connect the two sides of the outer housing 10. The wearable terminal 1a according to this embodiment differs from the wearable terminal 1 according to the first embodiment in that the display portion 133 is shaped differently. The display portion 133 is curved in the direction connecting the two sides of the straps 4a and 4b (the Y-axis direction in FIG. 8 ). Specifically, the display portion 133 is formed into a roughly rectangular shape, with the long side being the direction connecting the two sides of the straps 4a and 4b. The display portion 133 is curved in a dome-like shape, with the center portion thereof protruding outward.

The base device 2a is an information terminal device that is removably attached to the wearable terminal 1. In this embodiment, as shown in Figure 10, a microphone 23 and a speaker 25 are provided on the side of the housing. By electrically connecting to the wearable terminal 1a, music can be output or calls can be made. Furthermore, the base device 2a is provided with operation buttons 22a and 22b for manual operation by the user. For example, operation buttons 22a and 22b can be used to start or end a call or music playback. Furthermore, the base device 2a has a built-in vibrator that can be used to provide notifications of various events, such as the arrival of a set time (time signal), the stopwatch's lap time (laptime), and incoming email notifications.

Furthermore, in this embodiment, the wearable terminal 1a and the base device 2a can be electrically connected via the base-side connection terminal 21. The placement of the base-side connection terminal 21 or the terminal-side connection terminal 11 is the same as in the first embodiment. Specifically, the base-side connection terminal 21 is formed on the base device 2a, and the base-side connection terminal 21 removably engages with the bottom of the outer casing of the wearable terminal 1, i.e., the back cover 19. Specifically, the terminal-side connection terminal 11 is provided on the bottom of the wearable terminal 1, i.e., on the surface of the back cover 19, at a position corresponding to the base-side connection terminal 21. The base-side connection terminal 21 contacts the terminal-side connection terminal 11, thereby electrically connecting the base device 2a and the wearable terminal 1a. Furthermore, the wearable terminal 1a and the base device 2a transmit and receive data for display on the display unit 133 via the base-side connection terminal 21.

In addition, in this embodiment, on the wearable terminal 1a, GPS antennas 18, 18 are still respectively arranged on the outer edge of the outer shell 10, and are arranged so as not to overlap with the wireless communication antenna (second antenna) 24a provided on the base device 2a in a plan view.

In this embodiment, the wireless antenna 24 provided in the base device 2 is a short-range wireless communication antenna that performs wireless communication based on the Bluetooth (registered trademark) protocol for data communication, and can transmit and receive signals or data with external devices. This allows the use of a protocol with higher radio wave strength to connect to external devices.

Furthermore, the wireless antenna 24 is positioned in the same position as the wireless antenna 24 in the first embodiment. Specifically, the wireless antenna 24a is positioned so as to overlap the bottom of the outer casing 10 of the base device 2a when viewed from above. Furthermore, the GPS antennas 18, 18 provided in the wearable terminal 1a are positioned so as not to interfere with the wireless antenna 24a.

(Circuit Structure of Each Device)

Next, the circuit structure of the base device 2a will be described. Figure 11 is a block diagram showing the circuit structure of the base device 2a according to the second embodiment. Since the wearable terminal 1a has the same circuit structure as the wearable terminal 1 according to the first embodiment, its description will be omitted. As shown in Figure 11, the circuit structure of the base device 2a includes a control unit 200, a battery 202, a memory 203, a base-side connection terminal 21, a wireless communication unit 206a, a wireless antenna 24a, a vibration motor 204, and an input interface 207.

The control unit 200 is a computing module composed of hardware such as a processor such as a CPU or DSP (Digital Signal Processor), memory and other electronic circuits, or software such as programs having their functions, or a combination thereof. By appropriately reading the program and executing it, various functional modules are virtually constructed, and various processing for the action control of each unit and user operations are performed through the constructed functional modules.

The input interface 207 includes a device for inputting user operations such as operation buttons 22a and 22b, and a microphone 23 for acquiring audio. The output interface 201 also includes a speaker 25 for outputting audio.

The battery 202 is a power storage device that stores power supplied from the power supply device 3 via the connection terminal 21 of the base device 2. It supplies driving power to the control unit 200, the wireless antenna 24a, and the like. The memory 203 is a storage device that stores firmware, programs for various application programs, and other data. For example, it stores electronic money information and identification information for the base device 2. The memory 203 may also store an operating system (OS) as needed for the system.

The wireless communication unit 206a is capable of contactless communication based on protocols for data communication, such as NFC. This allows various data to be directly transmitted and received between devices via the wireless antenna 24a, which transmits and receives electromagnetic waves in a predetermined frequency band within a short range. This wireless communication unit 206a can receive image information from a user's smartphone or other device and transmit it to the wearable terminal 1 via the base-side connection terminal 21. Furthermore, this short-range wireless communication function may also include interfaces for infrared communication, UWB (Ultra Wide Band) communication, and low-power wireless communication.

In this embodiment, the wireless communication unit 206a can connect via Bluetooth (registered trademark) short-range communication, thereby enabling the base device 2 to connect to a terminal device capable of wireless communication, such as a personal computer, smartphone, or other electronic device. Furthermore, the wireless communication unit 206a has a tethering function that allows the terminal device connected via the communication network to be used as an external modem or router to connect to the communication network.

The vibration motor 204 is a device for generating vibration and notifying the user through vibration. It has, for example, an eccentric rotating weight portion. When current flows through the vibration motor, the rotating weight portion rotates, thereby generating vibration, which can be transmitted to the user's wrist via the wearable terminal 1, thereby notifying the user.

Furthermore, the information terminal device 100a, which includes the wearable terminal 1a and the base device 2a, is worn on the user's wrist for use, similar to the first embodiment. Furthermore, in this embodiment, the display unit 133 displays time information and travel information such as travel speed, travel distance, travel time, travel pace, distance (number of steps per minute), and number of steps, under the control of the control unit 170 of the wearable terminal 1. Furthermore, the current location can be displayed on a map based on the GPS signal obtained from the GPS receiving unit 119.

In this embodiment, the vibration motor of the base device 2 can be vibrated under the control of software executed by the control unit 170 of the wearable terminal 1. For example, when a lap time is measured, the vibration motor 204 can be driven to notify the user. Furthermore, in this embodiment, the wireless communication unit 206a of the base device 2a can wirelessly communicate with a user terminal or the like, allowing music data to be output from the speaker 25 of the base device 2a. Alternatively, an operation signal for playing music data can be transmitted from the wearable terminal 1a via the base-side connection terminal 21 and the terminal-side connection terminal 11, allowing remote control of an external music playback device and output through headphones or the like. Alternatively, browser software can be executed on the user terminal, and web pages processed by the browser software can be received from the user terminal via the wireless communication unit 206a using Bluetooth (registered trademark) or other means and displayed on the display unit 133.

Furthermore, the wireless communication unit 206a of the base device 2a can be used to connect to a communication network and receive location information from other users' wearable devices, thereby displaying the user's location information and the location information of other users on a map. Furthermore, applications such as social networking services can be executed to display other users who are close to the user's current location on the screen, allowing them to communicate with the user via audio or text.

(Action/Effect)

This second embodiment achieves the same operational advantages as the first embodiment described above. Furthermore, since the wireless communication unit 206a of the base device 2a includes Bluetooth (registered trademark) short-range wireless communication functionality, the base device 2a can be engaged with the wearable terminal 1 to perform short-range wireless communication with an external user terminal held by the user, enabling transmission and reception of required data between the base device 2a and the wearable terminal 1a. Furthermore, by executing browser software on the user terminal, web pages can be displayed on the display unit 133.

Thus, according to this embodiment, since devices with various functions can be combined, users can attach and detach the devices according to their intended use, thereby improving user convenience. In addition, in this embodiment, since the display unit 133 of the wearable terminal 1a has a curved screen, the curved portion and the displayed viewing angle become wide-angle, thereby displaying images with a sense of presence.

[Third embodiment]

Next, the third embodiment of the present invention will be described. This embodiment primarily utilizes the information terminal device 100 or 100a described in the first or second embodiment to access Internet services. Specifically, this embodiment utilizes short-range wireless communication via the wireless antenna 24 provided in the base device 2 to collaborate with an application program executed on an external user terminal to access Internet information or participate in various SNS (social networking) services.

FIG12 is a schematic diagram of an Internet service using the information terminal device 100 or 100a according to the third embodiment, and FIG13 and FIG14 are screen diagrams showing the content displayed on the display screens of the respective devices according to the third embodiment. In this embodiment, the information terminal device 100 or 100a is simply referred to as the information terminal device 100.

In this embodiment, the Internet service using the information terminal device 100 is shown in Figure 12. On the communication network 8 including wireless communication, the server device 5 is connected to the user terminal 6 held by user A and user B, and the information terminal device 100 mounted on user A and user B is connected to the user terminal 6 in a network sharing manner.

The communication network 8 is a distributed communication network that includes a wireless communication network and uses the communication protocol TCP/IP to interconnect various communication lines (public lines such as telephone lines or ISDN lines, ADSL lines, optical lines, 3G lines, 4G lines, dedicated lines, and wireless communication networks). The communication network 8 also includes LANs such as local area networks (enterprise networks) or home networks based on 10BASE-T or 100BASE-TX.

The server device 5 is a server computer or software having such functions that transmits information such as HTML (HyperText Markup Language) files, image files, and music files in a document system such as the WWW (World Wide Web). It accumulates information such as HTML files and images, distributes content (Web pages) in response to requests from applications such as a Web browser executed on the user terminal 6, obtains location information from the information terminal device 100 via the user terminal 6, and distributes content (display data) that displays the location information of each user A and B.

The information terminal device 100 is worn on the wrists of user A and user B. In this embodiment, at least the wearable terminal 1 or 1 a is equipped with a base device 2 or 2 a to enable a shared network connection with the user terminal 6 .

The user terminal 6 is a terminal carried by the user and is a mobile phone or smartphone equipped with a CPU-based computing function and wireless communication function. It can communicate with relay points such as general base stations via wireless, and receive communication services such as calls and data communications while moving. In addition, the user terminal 6 also has the function of wirelessly communicating with the wireless base station 7 and the function of executing applications. Examples of communication methods for this mobile phone include FDMA, TDMA, CDMA, and W-CDMA, as well as PHS (Personal Handyphone System) methods. Furthermore, the user terminal 6 is equipped with functions such as a digital camera, the function of executing application software, and GPS functions, thereby also realizing the function of a portable information terminal (PDA).

In particular, in this embodiment, the user terminal 6 has a short-range wireless communication function for establishing a tethering connection with the wireless antenna 24 and wireless communication unit 206 of the base device 2, and receives the GPS signal obtained by the GPS receiving unit 119a of the wearable terminal 1 through this wireless communication.

Furthermore, user terminal 6 includes wireless communication functionality for connecting to communication network 8 via wireless base station 7. This functionality allows the user to transmit GPS signals received by GPS receiver 119a to server device 5 on communication network 8, and to receive content from server device 5 that provides detailed service information, including location information of other users, and to display it on screen 6a. Furthermore, user terminal 6 also includes functionality for converting content received from server device 5 into content that can be displayed on display unit 131 of information terminal device 100, and transmitting the converted content to information terminal device 100 via a tethering connection. Here, "content that can be displayed on information terminal device 100" refers to information displayed on user terminal 6 that contains only a small amount of data and provides a summary of the service provided.

Next, the content displayed on user terminal 6 and information terminal device 100 will be explained in detail. This example illustrates a situation where user A and user B, while running, use information terminal device 100 and user terminal 6 to access the internet and participate in an SNS to communicate with other users. Figures 13(a) and 14(a) show the screen layout of the content displayed on the display screen of user terminal 6 held by user A, while Figures 13(b) and 14(b) show the screen layout of the content displayed on the display unit 131 of information terminal device 100.

(1) Display mode 1

First, let's describe a scenario where users A and B are running or cycling around the Imperial Palace or a track at a track and field stadium. In this scenario, user terminal 6 first accesses server device 5 and selects a running route, ultimately selecting the circling track 60 shown in FIG13(a). The communication function of user terminal 6 has previously established a tethering connection with information terminal device 100, acquiring a GPS signal from GPS receiver 119a, and transmitting this GPS signal upon accessing server device 5.

The server device 5 obtains GPS signals from each user's user terminal 6 at a predetermined time or in real time, generates content indicating each user's location on a rotation track 60, and transmits it to each user terminal 6. Upon receiving this content, the user terminal 6 executes a function via an application program, and as shown in FIG13(a), the rotation track 60 is displayed on a display screen 6a. Furthermore, an object 61 indicating the user's (user A's) location and objects 62 indicating the locations of other users B and C participating in the SNS service are displayed on the rotation track 60. Furthermore, an arrow icon 63 indicating each user's direction of travel may also be displayed on this screen.

In this embodiment, the server device 5 measures the distance to other users and transmits this information. Furthermore, the user terminal 6 displays information 64 indicating the distance from the user's position to other users B and C at the bottom of the screen.

Furthermore, text is input using the input device of the user terminal 6, and the text data is temporarily transmitted to the server device 5. Once the server device 5 receives the text data, it transmits the text data to the grouped user terminals 6. As a result, the text input by the user and the text input by other users are displayed in the comment field 65 on the screen of each user terminal 6.

Meanwhile, the content displayed on the display unit 131 of the information terminal device 100 is changed to display only the position of each user on the track, as shown in FIG13(b). Specifically, as shown in FIG13(b), the predetermined positions of the circling track 60 are set as the starting point and the ending point, and a straight track 66 connecting the starting point and the ending point is displayed. Objects 61 and 62 representing the positions of each user are displayed on this straight track 66.

This content is converted by the application function of the user terminal 6 based on the content obtained from the server device 5. The converted content is then transmitted to the base device 2 via a tethered connection between the user terminal 6 and the wireless antenna 24 (wireless communication unit 206) of the base device 2. The base device 2 then transmits the content to the wearable terminal 1 via a connection terminal, whereupon only a summary of the content is displayed on the display unit 131 of the information terminal device 100. While the user terminal 6 converts the content here, the server device 5 may also be configured to pre-generate content for the information terminal device 100 and distribute it.

(2) Display mode 2

Next, as another display method, a case where a user sets a highway as a route for a marathon will be described. First, the user terminal 6 accesses the server device 5 to select a route, thereby selecting the route map 67 shown in (a) in Figure 14. Here, even if the communication function of the user terminal 6 is previously connected to the information terminal device 100 network sharing and obtains the GPS signal, the GPS signal will still be sent when accessing the server device 5. The server device 5 obtains the GPS signals of user A and other users B and C at a predetermined time or in real time, and generates content representing the position of each user on the runway 67a of the route map, and sends it to each user terminal 6. If the user terminal 6 receives such content, it executes the function through the application to display the route map 67 shown in (a) in Figure 14, and displays the object 61 representing the user's own position and the object 62 of other users on the runway 67a.

In this example, the input text from the users in the group may be displayed in the comment field 68 in the lower area of the screen, and the text may be input using the input device of the user terminal 6 , thereby being sent to each user terminal 6 via the server device 5 .

Next, the content displayed on the display unit 131 of the information terminal device 100 at this time will be described. As in this embodiment, when a route on a road is selected, the display unit 131 of the information terminal device 100 may display, for example, an elevation map 69 showing the elevation difference of the optical path, as shown in FIG14(b). Furthermore, within this elevation map 69, an object 61 representing the user's position and objects 62 representing other users are displayed on the runway 69a. The content displayed on the display unit 131 may be converted by the user terminal 6 or generated by the server device 5.

According to this third embodiment, by utilizing the wireless communication function of the base unit 2 of the information terminal device 100, a high-intensity radio wave protocol can be used to connect to a user terminal 6 such as a smartphone or a handheld PC. Through this connection, and in conjunction with an application program executed on the user terminal 6, the user can access information on the Internet or participate in an SNS (social networking service) to receive various services. The displayed content shown in Figures 13 and 14 is merely an example, and various content can be displayed depending on the various Internet services being used.

[Fourth embodiment]

Next, a fourth embodiment of the present invention will be described. This embodiment focuses on providing a motion capture system that uses the information terminal device 100 or 100a described in the first or second embodiment and various sensors attached to the user's body to detect the wearer's body movements.

Figure 15 (a) is a schematic diagram of the motion capture system using the information terminal device 100 or 100a according to the fourth embodiment. Figure 15 (b) shows an example of body motion reproduction data obtained by the motion capture system according to this embodiment. Furthermore, Figure 16 is a block diagram showing the internal structure of each device according to the fourth embodiment. In the following description (both within this embodiment and its various variations), the information terminal device 100 or 100a will be referred to simply as the information terminal device 100.

As shown in (a) in Figure 15 and Figure 16, the motion capture system involved in this embodiment is composed of a server device 5a, an information terminal device 100 worn by a predetermined wearer, and various sensors 40 worn by the predetermined wearer and connected to the information terminal device 100 for network sharing on a communication network 8 including wireless communication.

The various sensors 40 are a set of sensors that are removably attached to the wearer. In this embodiment, they include body motion sensors 41 and shoe sole sensors 42. The body motion sensors 41 are attached to various parts of the wearer's body to detect three-dimensional displacement or acceleration. In this embodiment, they are attached to predetermined joints of the wearer. Specifically, they comprise a right knee body motion sensor 41a attached to the wearer's right knee, a left knee body motion sensor 41b attached to the wearer's left knee, a right foot body motion sensor 41c attached to the wearer's right instep, a left foot body motion sensor 41d attached to the wearer's left instep, and a waist body motion sensor 41e attached to the wearer's waist. These body motion sensors 41 are equipped with a three-axis accelerometer for measuring acceleration, a three-axis gyroscope for measuring angular velocity, and a three-axis magnetic sensor for measuring the magnitude and direction of magnetic fields, enabling detection of movement along nine axes.

Each body motion sensor 41 can be attached to or detached from the wearer's clothing, or can be attached to or detached from the wearer as a belt or piece of clothing. This allows the wearer to attach or detach each sensor and perform measurements by attaching a small accessory to the belt or piece of clothing, or by wearing the belt or piece of clothing in their daily life. This facilitates continuous measurement without burdening the wearer.

On the other hand, the sole sensor 42 is a sensor placed on the wearer's sole and detects the pressure acting on the sole. In this embodiment, it is composed of a right sole sensor 42a placed on the sole of the right foot and a left sole sensor 42b placed on the sole of the left foot. As long as the sole sensor 42 can sense the force acting when the wearer contacts a contact surface such as the floor, it can be a tactile sensor or a force sensor. For such sole sensors 42, a distributed tactile sensor that is soft, lightweight, and does not hinder contact motion can be used. It can be made of, for example, pressure-sensitive rubber or pressure-sensitive fabric. Examples of tactile sensor types include, but are not limited to, pressure-sensitive resistors, capacitors, imaging elements, light diffusion methods, inductors, EIT methods, strain gauges, and MEMS sensors. The EIT method involves attaching electrodes around a material whose resistance changes with pressure (pressure-sensitive rubber or pressure-sensitive fabric). When a voltage is applied between any two points, the voltage at the other electrodes is measured, and reverse analysis is performed to reconstruct the pressure distribution. This method allows for a highly flexible tactile sensor.

The sole sensor 42 is a footwear item that is removable from the wearer's body. Furthermore, it can be embedded in the sole of a footwear item such as a shoe or sandal and integrated therein, or it can be incorporated into the footwear item as a pad and configured separately from the footwear item itself. Furthermore, as a different embodiment, the sole sensor 42 can be configured to be worn on the foot in the form of a sock.

Furthermore, as shown in Figure 16 , each of these sensors 40 (body motion sensor 41, shoe sole sensor 42) includes a wireless communication unit. This wireless communication unit has an internal antenna and, by performing wireless communication based on a data communication protocol such as BTLE, can communicate with the wearable terminals 1 and 1a (hereinafter referred to as the wearable terminal 1 and the wearable terminal 1a). In this embodiment, the wireless communication unit of each sensor 40 uses BTLE as a low-power communication protocol, but ANT, ANT+, and other protocols may also be used. Conventional Bluetooth (registered trademark) can also be used.

In addition to the functions of the above embodiments, the information terminal device 100 also has a function of collecting detection results from the sensors 40 , and acquires the detection results by communicating with the sensors 40 via the wireless communication unit 119 b of the wearable terminal 1 .

The memory 114 of the information terminal device 100 functions as a body motion recording unit that accumulates the detection results of the body motion sensors 41 and the shoe sole sensors 42 as body motion data. Furthermore, sensor identification information identifying each sensor 40 is appended to the detection results transmitted from each sensor 40, and this identification information is stored in the memory 114 of the information terminal device 100. This identification information enables the control unit 170 to determine which sensor 40 the detection result was obtained from upon receiving it from the wireless communication unit 119b. Furthermore, this identification information includes attachment location information specifying the attachment location of each sensor. Based on this attachment location information, body motion reproduction data can be calculated. Furthermore, the body motion data also includes information about the time when the detection results were obtained from each sensor 40.

The information terminal device 100 also has a function for transmitting acquired body motion data to the server device 5a on the communication network 8. Specifically, the body motion data recorded by the wearable terminal 1 is transmitted to the base device 2 using the base-side connection terminal 21 and the terminal-side connection terminal 11. Furthermore, the wireless communication unit 206 of the base devices 2, 2a (hereinafter referred to as the base device 2 and the base device 2a) transmits the acquired body motion data to the server device 5a.

Furthermore, the display unit 131 of the information terminal device 100 functions as an output device for displaying or outputting the analysis results of the body motion reproduction data. When the analysis results are obtained from the server device 5a, they are displayed on the display unit 131 under the control of the control unit 170. In this embodiment, the other functional modules of the information terminal device 100 are the same as those in any of the first to third embodiments described above and are not shown in FIG. 16 , and their description will also be omitted.

Similar to the server device 5 described above, the server device 5a is a server computer or software having such functions that distributes information such as HTML (HyperText Markup Language) files, image files, and music files in a document system such as the WWW (World Wide Web). It stores information such as HTML files and images and distributes content (web pages) in response to requests from applications such as web browsers running on user terminals 6. Furthermore, in this embodiment, the server device 5a analyzes the wearer's body movements based on body movement data acquired from the information terminal device 100 and generates the body movement reproduction data shown in FIG15(b). Specifically, as shown in FIG16 , the server device 5a includes a communication interface 51, a body movement data acquisition unit 53, a body movement calculation unit 52, a correction unit 54, an analysis unit 55, and a storage unit 56.

The communication interface 51 is a module that controls the transmission and reception of various information via the communication network 8. It transmits and receives data with the base device 2 of the information terminal device 100 using various protocols. In this embodiment, the communication interface 51 obtains body motion data from the base device 2 and transmits the analysis results obtained by the analysis unit 55 to the information terminal device 100.

The body motion data acquisition unit 53 is a module that acquires body motion data from the information terminal device 100 via the communication network 8. In this embodiment, it wirelessly communicates with the wireless communication unit 206 of the base device 2 to acquire body motion data representing the detection results of each sensor 40. This body motion data is temporarily stored in the storage device. The detection results of the body motion sensor 41 are then sent to the body motion calculation unit 52, and the detection results of the shoe sole sensor 42 are sent to the correction unit 54.

The body motion calculation unit 52 is a module that calculates the wearer's body motion as body motion reproduction data based on the detection results of the body motion sensors 41 stored in the memory 114 (body motion recording unit) and the relative positional relationship between the body motion sensors 41 .

Here, the detection results of the body motion sensors 41 refer to the values measured by a so-called nine-axis sensor. In this embodiment, these are the direction and magnitude of the acceleration (including gravitational acceleration) acting on an object, the object's angular velocity (magnitude, direction, and center position), and the magnitude/direction (square angle) of the magnetic field. Furthermore, the relative positional relationship of the body motion sensors 41 refers to the relative distance or range of motion determined by the wearer's skeleton and the mounting position of each body motion sensor 41 when the wearer is wearing the body motion sensor 41. For example, as shown in Figure 15(b), the human lower body is connected to the pelvis B7 by a pair of femurs B1 and B2, which are respectively connected to the tibias B3 and B4, and further connected to the tarsal bones B5 and B6. These bones are connected by joints so that they can bend or rotate, but the length of each bone remains almost constant. Furthermore, the bending angles R13, R24, R35, and R46 at each joint are also limited to a range of motion. Therefore, based on the detection results of each body motion sensor determined by such bone length or joint movable range, and the relative positional relationship between each body motion sensor, body motion reproduction data that reproduces the wearer's movements or postures can be generated.

The correction unit 54 is a module that corrects the body motion reproduction data calculated by the body motion calculation unit 52 based on the detection result of the sole sensor 42. Here, the correction processing of the correction unit 54 means that the above-mentioned body motion sensor 41 calculates the overall displacement or rotation by continuously accumulating the values measured by each sensor. In addition, due to the noise or error generated by the accumulated sensor, it is possible that it deviates from the actual position, displacement or posture. Therefore, in this embodiment, when it is determined by the correction unit 54 that the body motion sensor 41c or 41d attached to the foot on the side indicating the maximum value is completely in contact with the ground at the moment when the detection result of the sole sensor 42 indicates the maximum value, the height position of the body motion sensor 41c or 41d is corrected to 0, and the tarsal bone B5 or B6 whose height position is 0 is used as a reference, and the position or rotation angle of the other bones B1 to B4 and B7 is corrected.

The analysis unit 55 is a module that analyzes the wearer's body motion based on the body motion reproduction data corrected by the correction unit 54. This analysis method can generate stereoscopic image data that displays the wearer in three dimensions based on the corrected body motion reproduction data. Alternatively, the analysis unit 55 can extract model body motion data from the storage unit 56, which stores model body motion data, and compare it with the wearer's model body motion reproduction data to generate improved data indicating deviations from normal body motion. Furthermore, analysis can be performed based on individual user information, such as gender, height, weight, and age, by preregistering user information. The analysis unit 55 then transmits the analysis results, such as the stereoscopic image data or improved data, to the information terminal device 100.

The storage unit 56 is a storage device for storing various data, including identification information for identifying each information terminal device 100, information on the location where each sensor 40 is installed, the relative positional relationship of the body motion sensors 41 installed at each location, and the above-mentioned user information or body motion data formed as a template.

(Motion Capture Method)

By operating the motion capture system having the above configuration, the motion capture method for detecting the wearer's body movements according to this embodiment can be implemented. Fig. 17 is a sequence diagram showing the motion capture method according to the fourth embodiment.

First, the wearer wears the body motion sensors 41 on both knees and both feet, and the shoe sole sensors 42. Furthermore, the wearer wears the information terminal device 100 on the wrist. The wearer then uses the information terminal device 100 to obtain detection results from the sensors 40 (S101).

Upon receiving the operation signal, the control unit 170 of the wearing terminal 1 connects to each sensor 40 (S102). After the connection process, each sensor 40 detects the wearer's movements. Specifically, the body motion sensors 41 attached to various parts of the wearer's body detect three-dimensional displacement or acceleration of each part, and the sole sensors 42 located on the wearer's shoes detect the pressure acting on the soles.

Next, the acquired detection results are transmitted via weak radio waves to the wireless communication unit 119b of the wearable terminal 1 via the wireless communication unit of each sensor 40 (S104). Once the wireless communication unit 119b of the wearable terminal 1 acquires the detection results (S105), the memory 114 of the wearable terminal 1, acting as a body motion recording unit, accumulates the detection results of the body motion sensors 41 and the shoe sole sensors 42 as body motion data (S106).

Then, the wearing terminal 1 transmits the body motion data recorded by the wearing terminal 1 to the base device 2 using the base connection terminal 21 and the terminal connection terminal 11. Furthermore, the wireless communication unit 206 of the base device 2 transmits the acquired body motion data to the server device 5a (S107).

When the body motion data acquisition unit 53 of the server device 5a acquires body motion data (S108), it sends the detection results of the body motion sensor 41 to the body motion calculation unit 52 and the detection results of the sole sensor 42 to the correction unit 54. The body motion calculation unit 52 calculates the wearer's body motion as body motion reproduction data based on the detection results of the body motion sensors 41 accumulated in the body motion recording unit and the relative positional relationship of the body motion sensors 41 (S109), and sends the body motion reproduction data to the correction unit. On the other hand, the correction unit 54 corrects the body motion reproduction data calculated by the body motion calculation unit 52 based on the detection results of the sole sensor 42 (S110). Then, the corrected body motion reproduction data is sent to the analysis unit 55.

The analyzing unit 55 analyzes the body motion of the wearer (S111) based on the body motion reproduction data corrected by the correcting unit 54. The analyzed analysis result data is transmitted to the information terminal device 100 via the communication interface 51 (S112).

When the base device 2 of the information terminal device 100 receives the analysis result data (S113), it transmits the data to the wearing terminal 1 using the base-side connection terminal 21 and the terminal-side connection terminal 11. Furthermore, the control unit 170 of the wearing terminal 1 displays or outputs the analysis result obtained by the analysis unit 55 via the display unit 131 (S114).

(Action/Effect)

According to this embodiment, a body motion sensor 41 and a shoe sole sensor 42 are mounted on the wearer's body, and based on the detection results of each sensor 40, the wearer's body performance is calculated as body motion reproduction data, and the body motion reproduction data is analyzed, and the analysis results are displayed on the display unit 131, thereby enabling the wearer to recognize the wearer's own body motion and providing suggestions on improvement points for the wearer's body motion.

At this time, the correction unit 54 corrects the body motion reproduction data calculated by the body motion calculation unit 52 based on the detection result of the sole sensor 42. Therefore, even if the noise or error generated in the body motion sensor 41 such as the 9-axis sensor causes an error in the relative position of the body motion reproduction data with respect to the ground, the value of each body motion sensor 41 is corrected (for example, corrected to 0) by using the moment of contact with the floor surface detected by the sole sensor 42, the body motion reproduction data can still be properly constructed and displayed/output.

In addition, in this embodiment, since the body motion recording unit that accumulates the detection results of the body motion sensor and the sole sensor as body motion data is the memory 114 of the information terminal device 100, the device for accumulating body motion data can be made into a highly portable wearable watch type, so that body motion data during exercise or sports activities can be easily collected.

Furthermore, in this embodiment, the wireless communication unit 119b of the wearable terminal 1 uses a wireless communication method such as Bluetooth (registered trademark), BTLE, or ANT. However, these wireless communication methods have limitations on the number of devices that can be connected simultaneously (Bluetooth (registered trademark) allows a maximum of six devices). Therefore, in order to calculate and analyze the wearer's body motion reproduction data with a minimum number of sensors, this embodiment uses four body motion sensors 41 attached to the wearer's knees and feet, and shoe sole sensors 42 attached to the soles of each shoe, for a total of six sensors 40 to calculate body motion reproduction data. As a result, this embodiment allows calculation and analysis of the wearer's body motion reproduction data without changing the structure of the information terminal device 100 described in the aforementioned embodiments.

(Variation 1)

Next, Variation 1 of the aforementioned fourth embodiment will be described. In the aforementioned fourth embodiment, body motion sensors 41 were attached to six locations, including the knees and feet. However, in this variation 1, a case where body motion sensors 41 are also attached to other locations will be described as an example. Figure 18 is a schematic diagram of the motion capture system involved in this variation 1, and Figure 19 is a block diagram showing the internal structure of each device involved in this variation 1. Furthermore, in the following variations, the same reference numerals are assigned to the same structural elements as in the aforementioned embodiments, and their functions, etc., are the same unless otherwise specified, and their descriptions are omitted.

In the motion capture system of this first modification, multiple body motion sensors 41 are also attached to the wearer's upper body, and a hub 70 is attached to the wearer for wireless communication with each body motion sensor 41. Specifically, in addition to the body motion sensor 41 attached in the fourth embodiment, as shown in FIG18 , the body motion sensors 41 are also attached to the wrists or elbows (left wrist body motion sensor 41e, right wrist body motion sensor 41f, and right elbow body motion sensor 41g). Furthermore, although FIG18 only shows the right elbow, a body motion sensor 41 is also attached to the left elbow.

The hub 70 is a router device that communicates with the sensors 40 and collects detection results from the sensors 40. The hub 70 can be attached to or detached from the wearer's clothing or belt, or can be attached to or detached from the wearer's clothing as a belt or clothing. Alternatively, the hub 70 can be configured separately from the clothing itself, such as a shoulder bag.

As shown in FIG19 , such a hub 70 includes a data collection unit 71 and a data forwarding unit 72. The data collection unit 71 is a module that acquires detection results from the body motion sensors 41 and shoe sole sensors 42. It has wireless communication capabilities based on data communication protocols such as BTLE and ANT. The data collection unit 71 identifies multiple sensors 40 as groups and acquires detection results from each sensor 40 within each group. Specifically, as shown in FIG19 , the body motion sensors 41a to 41d and shoe sole sensors 42a and 42b attached to the knees and feet are grouped as the first group 40. The first group collection unit 71a communicates with each sensor within the first group 40 to acquire detection results. Meanwhile, the body motion sensors 41e to 41g (including the body motion sensor attached to the left elbow) attached to the wrists and elbows are grouped as the second group 40a. The second group collection unit 71b communicates with each sensor 41 within the second group 40a to acquire detection results.

Furthermore, in this first variation, each group collection unit 71a or 71b can group up to six sensors and associate their data. Therefore, since four body motion sensors 41 are currently associated with data in the group collection unit 71b of this first variation, additional body motion sensors can be attached to other locations. Furthermore, if multiple body motion sensors 41 are attached to the body, these sensors can be grouped together as a third group and associated with data, with a corresponding data collection unit in the data collection unit 71. Furthermore, the number of connections within a group can be varied depending on the functionality of the group collection unit of the hub 70.

The data forwarding unit 72 converts the detection results obtained by the data collection unit 71 into a unified data format and transmits it to the information terminal device 100. In this first variation, the detection results collected by the group collection units 71a and 71b are unified and transmitted to the information terminal device 100. These transmitted detection results also include identification information for each sensor 40, information about the location of the sensor being worn, and time information. Furthermore, the data forwarding unit 72 communicates wirelessly with the wireless communication unit 119b of the wearing terminal 1 using a data communication protocol such as BTLE or ANT.

The information terminal device 100 obtains the grouped detection results from the hub 70 and, similar to the fourth embodiment, stores the detection results of the body motion sensors 41 and the shoe sole sensors 42 as body motion data in the memory 114 (body motion recording unit). The body motion data is then transmitted to the server device 5a via the base device 2. The server device 5a calculates body motion reproduction data using the obtained body motion data for each group, corrects the body motion reproduction data based on the detection results of the shoe sole sensors 42a and 42b, and analyzes the corrected body motion reproduction data. Furthermore, data is linked between each group, and the body motion calculation unit 52, correction unit 54, and analysis unit 55 perform various processes using the detection results obtained from all sensors 40 in the group.

The analysis results from the server device 5a are transmitted to the information terminal device 100, and the analysis results are displayed on the display unit 131, which is the output device of the wearable terminal 1. In this first modification, the other functional modules in the information terminal device 100 are the same as those in the first to third embodiments described above, and are not shown in FIG19 , and their description is omitted. Furthermore, as shown in FIG18 , by connecting the communication network 8 to the personal computer 9, the server device 5a can also transmit the analysis results to the personal computer 9, and display them on the display screen of the personal computer 9.

(Motion Capture Method)

By operating the motion capture system having the above configuration, it is possible to implement the motion capture method for detecting the body movement of the wearer according to Modification 1. FIG20 is a sequence diagram showing the motion capture method ...

First, the wearer wears body motion sensors 41 (41a to 41g) on both knees, both feet, both wrists, and both elbows, and also wears shoe sole sensors 42. The wearer also wears the information terminal device 100 and the hub 70 on specific parts of the body.

Next, using the information terminal device 100, a detection start operation is performed on each sensor 40 (S201). Once a detection start operation signal is received, an operation signal is sent from the wearing terminal 1 to the hub 70 under the control of the control unit 170 of the wearing terminal 1, causing the hub 70 to connect to each sensor 40 (S202). Alternatively, the detection start operation can be performed by directly operating the hub 70.

After the hub 70 is connected to the sensors 40, each sensor 40 detects the wearer's movements. Specifically, body motion sensors 41 attached to various parts of the wearer's body detect three-dimensional displacement or acceleration of each part, while sole sensors 42 located on the wearer's shoes detect pressure acting on the soles.

The acquired detection results are then transmitted from the wireless communication unit of each sensor 40 to the data collection unit 71 of the hub 70 (S204). At this time, the sensors 40 belonging to the first group 40 communicate with the first group collection unit 71a, and the sensors 40 belonging to the second group 40a communicate with the second group collection unit 71b.

When the collection units 71a and 71b of the hub 70 obtain the detection results of the body motion sensor 41 and the shoe sole sensor (S2105), they convert the obtained detection results into a unified data format (S206) and send them to the information terminal device 100 (S207).

After the wireless communication unit 119b of the wearing terminal 1 obtains the detection results in a unified data format for each group (S208), the memory 114 of the wearing terminal 1 stores the detection results of the body motion sensor 41 and the shoe sole sensor 42 as body motion data (S209). The wearing terminal 1 then transmits the recorded body motion data to the base device 2 using the base-side connection terminal 21 and the terminal-side connection terminal 11. Furthermore, the wireless communication unit 206 of the base device 2 transmits the obtained body motion data to the server device 5a (S210).

After acquiring body motion data (S211), the body motion data acquisition unit 53 of the server device 5a transmits the detection results of the body motion sensors 41 to the body motion calculation unit 52 and the detection results of the shoe sole sensors 42 to the correction unit 54. The body motion calculation unit 52 calculates the wearer's body motion as body motion reproduction data based on the detection results of the body motion sensors 41 stored in the memory 114 and the relative positional relationship between the body motion sensors 41 (S212), and transmits the body motion reproduction data to the correction unit 54. Meanwhile, the correction unit 54 corrects the body motion reproduction data calculated by the body motion calculation unit 52 based on the detection results of the shoe sole sensors 42 (S213). The corrected body motion reproduction data is then transmitted to the analysis unit 55.

The analysis unit 55 analyzes the wearer's body movements based on the body movement reproduction data corrected by the correction unit 54 (S214). The resulting analysis result data is transmitted to the information terminal device 100 via the communication interface 51 (S215). The base device 2 of the information terminal device 100 receives the analysis result data (S216) and transmits it to the wearing terminal 1 using the base-side connection terminal 21 and the terminal-side connection terminal 11. The control unit 170 of the wearing terminal 1 then displays or outputs the obtained analysis result of the analysis unit 55 to the display unit 131 (S217).

(Action/Effect)

According to this modification, by increasing the number of body motion sensors 41 or shoe sensors 42 attached to the wearer, it is possible to calculate more detailed body motion reproduction data and analyze the wearer's body motion. In particular, in this modification 1, multiple body motion sensors 41a to 41g are grouped, and data is collected by group. This data is then converted into a unified data format and forwarded to other terminals. Therefore, even when multiple body motion sensors 41 or shoe sensors 42 are worn, the data collection unit 71 and data forwarding unit 72 still function as a hub 70. Therefore, even when there are restrictions on the number of connections or data forwarding volume of communication devices, the data forwarding unit 72 temporarily aggregates and consolidates the data, making it possible to process multiple sensors or a large amount of data.

(Variation 2)

Next, a modification of the above-mentioned modification 1 will be described. In the above-mentioned modification 1, an information terminal device 100 worn on the wearer's wrist or the like is used to communicate with the server device 5a. However, in this modification 2, the case where a user terminal 6, such as a smartphone held by the wearer, is used to communicate with the server device 5a will be described as an example. Figure 21 is a schematic structural diagram of the recommendation service involved in this modification 2, and Figure 22 is a block diagram showing the internal structure of each device involved in this modification 2. In addition, in the following modification examples, the same figure marks are marked on the same structural elements as in the above-mentioned embodiments and modification examples, and their functions, etc. are the same unless otherwise specified, and their descriptions are omitted.

In the motion capture system of this second variation, a hub 70, worn by the wearer, and a user terminal 6, which wirelessly communicates with the hub 70, are provided on a communication network 8. As in the first variation described above, the data collection unit 71 of the hub 70 groups the multiple sensors 40 and obtains detection results from each sensor 40 within the group. Meanwhile, the data forwarding unit 72 of the hub 70 converts the detection results obtained by the data collection unit 71 into a unified data format and transmits it to the user terminal 6.

User terminal 6 is a terminal carried by the user and is a mobile phone or smartphone equipped with CPU-based computing and wireless communication capabilities. It can communicate wirelessly with relay points such as conventional base stations and receive communication services such as calls and data communications while on the move. Furthermore, user terminal 6 is equipped with functions such as a digital camera, application software execution, and GPS, thus also functioning as a portable information terminal (PDA). Furthermore, in this second variation, user terminal 6 still has short-range wireless communication capabilities for establishing a shared network connection with the data forwarding unit 72 of the hub 70 and can communicate with the communication network 8 via the wireless base station 7.

The internal structure of such a user terminal 6 is shown in FIG. 22 . The user terminal 6 includes a wireless interface 61 , a memory 65 , an application execution unit 64 , an output interface 63 , and an input interface 62 .

The wireless interface 61 has the function of performing wireless communications based on mobile communication protocols for making calls, as well as wireless communications based on data communication protocols such as wireless LAN. The wireless interface 61 also has wireless communications based on common data communication protocols such as Bluetooth (registered trademark), BTLE, ANT, and ANT+. It communicates with the hub 70 through short-range wireless communication to obtain body movement data converted from detection results into digital form. Furthermore, the wireless interface 61 receives analysis result data from the server device 5a. Communication between the user terminal 6 and the hub 70 can occur automatically in real time or at predetermined intervals, or can be initiated in response to user operation.

The input interface 62 is a device for inputting user operations, such as operation buttons or a touch panel. Furthermore, the output interface 63 is a device for outputting images or audio, such as a display or speaker. Specifically, the output interface 63 includes a display unit 13a, such as a liquid crystal display. The display unit 13a serves as an output device for displaying or outputting the analysis results of the analysis unit 55.

The memory 65 is a storage device that stores an OS (Operating System), various programs for application programs, other data, etc. Identification information for identifying the hub 70 is stored in the memory 65 as information for wireless communication with the hub 70 .

The application execution unit 64 is a module that executes applications such as a general operating system or browser software, and is typically implemented by a CPU, etc. The application execution unit 64 transmits the body motion data in a standardized data format obtained from the data forwarding unit 72 to the server device 5a, and receives analysis result data from the server device 5a.

(Motion Capture Method)

By operating the motion capture system having the above configuration, it is possible to implement a motion capture method for detecting body movements of the wearer according to Modification 2. FIG23 is a sequence diagram of the motion capture method ...

First, the wearer wears body motion sensors 41 (41a-41g) on their knees, feet, wrists, and elbows, as well as shoe sole sensors 42 and a hub 70. Next, the wearer uses the user terminal 6 to obtain detection results from each sensor 40 in the hub 70 (S301). This detection start operation can also be performed by the hub 70. Furthermore, in this second variation, the user terminal 6 can be stored in a pocket or waist bag, or can be stored in a bag or the like without being carried.

When the hub 70 sends an operation signal, it connects to each sensor 40 (S302). After the connection process, each sensor 40 detects the wearer's movements (S303). Specifically, the body motion sensors 41 attached to various parts of the wearer's body detect three-dimensional displacement or acceleration of each part, and the sole sensors 42 located on the wearer's shoes detect the pressure acting on the soles.

The acquired detection results are then transmitted from the wireless communication unit of each sensor 40 to the data collection unit 71 of the hub 70 (S304). At this time, the sensors 40 belonging to the first group 40 communicate with the first group collection unit 71a, and the sensors 40 belonging to the second group 40a communicate with the second group collection unit 71b.

When the collection units 71a and 71b of the hub 70 collect the detection results of the body motion sensor 41 and the shoe sole sensor 42 (S305), they convert the obtained detection results into a unified data format (S306) and send them to the user terminal 6 (S307).

When the wireless interface 61 of the user terminal 6 obtains the detection results in a grouped unified data format (S308), the memory 65 of the user terminal 6 functions as a body motion recording unit, storing the detection results of the body motion sensor 41 and the shoe sole sensor 42 as body motion data (S309). The user terminal 6 then transmits the recorded body motion data to the server device 5a (S310).

After acquiring body motion data (S311), the body motion data acquisition unit 53 of the server device 5a transmits the detection results of the body motion sensors 41 to the body motion calculation unit 52 and the detection results of the shoe sole sensors 42 to the correction unit 54. The body motion calculation unit 52 calculates the wearer's body motion as body motion reproduction data based on the detection results of the body motion sensors 41 stored in the memory 65 and the relative positional relationship between the body motion sensors 41 (S312), and transmits the body motion reproduction data to the correction unit 54. Meanwhile, the correction unit 54 corrects the body motion reproduction data calculated by the body motion calculation unit 52 based on the detection results of the shoe sole sensors 42 (S313). The corrected body motion reproduction data is then transmitted to the analysis unit 55.

The analysis unit 55 analyzes the wearer's body motion based on the body motion reproduction data corrected by the correction unit 54 (S314). The analyzed analysis result data is transmitted to the user terminal 6 via the communication interface 51 (S315). Upon receiving the analysis result data (S316), the application execution unit 64 displays or outputs the obtained analysis result of the analysis unit 55 on the display panel 63a (S317).

Furthermore, in this second modification, the hub 70 and the user terminal 6 are separate devices, and the detection results obtained from the sensors 40 are temporarily collected by the hub 70 and then stored in the memory 65 of the user terminal 6. However, the present invention is not limited to this. For example, the hub 70 can be implemented as a function of a portable information terminal, and a device integrating the hub 70 and the user terminal 6 can be used. Furthermore, the calculation, correction processing, and analysis processing of the body motion reproduction data of the server device 5a can be executed in the user terminal 6, and a stand-alone model can be achieved.

(Action/Effect)

According to this variant example 2, the device that obtains the detection results from the hub 70 and accumulates them as body motion data is made into a user terminal 6 held by the wearer, so that the smartphone currently carried by the user can be used as a motion capture device to detect the wearer's body motion, thereby reducing the initial introduction cost.

[Change Example]

Furthermore, the above-mentioned embodiments 1 to 4 and their modifications are merely examples of the present invention. Therefore, the present invention is not limited to the above-mentioned embodiments and modifications, and various modifications and combinations of the respective structures are possible according to design, etc., without departing from the scope of the technical concept of the present invention.

For example, the wearable terminal 1 of the first embodiment and the base device 2a of the second embodiment may be engaged via the base-side connection terminal 21, or the wearable terminal 1a of the second embodiment and the base device 2 of the first embodiment may be engaged via the base-side connection terminal 21. Furthermore, for example, a single device may have the functions of the wearable terminals 1 and 1a and the base devices 2 and 2a described in the first and second embodiments, and any combination thereof is possible. For example, the base device 2 of the first embodiment may include a wireless communication unit 206a such as Bluetooth (registered trademark), or the wearable terminal 1 may include a vibration motor 204 or the like. Furthermore, the wearable terminal 1 or the base device 2 may include a browser function, directly receiving web data via a communication network and displaying it on the display units 131 and 133.

Furthermore, the base device 2, 2a may also be equipped with, for example, a camera with a photographic function or a pulse meter for measuring the user's pulse. In the case of a camera, when the base device 2, 2a is worn on the user's wrist or engaged with the wearable terminal 1, the lens is positioned facing outward. Furthermore, in the case of a pulse meter, it is designed to be positioned on the bottom surface of the base device 2 in contact with the user's skin. Furthermore, by connecting the wearable terminal 1, 1a to the base device 2 via the connection terminals 11, 21, the display units 131, 133 can display images or videos captured by the camera, and the display units 131, 133 can also display the results of measurements taken by the pulse meter.

Furthermore, the communication functions of the wearable terminal 1 or base device 2 described in the above embodiments, the sensors included in these terminal devices, or sensors connected to them via wireless communication can also be used to prevent theft of these terminal devices, bicycles, motorcycles, cars, and the like equipped with these terminal devices. In this case, the wearable terminal 1 or base device 2 and other sensors are installed on the monitored object, such as a bicycle or car. The detection signals from each sensor are remotely monitored via the communication interface of the wearable terminal 1 or base device 2. This allows for the detection of vibrations or movement during theft, thereby detecting the occurrence of theft. Furthermore, based on the detection values from the sensors included in the installed wearable terminal 1 or base device 2, theft can be prevented by generating an audio output such as a buzzer, alarm, or warning sound, or by generating a sound such as light or vibration.

Furthermore, in the above-described embodiment and its variations, the analysis of the reproduced body motion data is performed by a server device installed on a communication network. However, the present invention is not limited to this. For example, the analysis may be performed or processed independently on the information terminal device 100, the user terminal 6, the hub 70, or the like. In this case, the information terminal device 100, the user terminal 6, or the hub 70 may be provided with functional modules having the same functions as the body motion data acquisition unit 53, the body motion calculation unit 52, the correction unit 54, and the analysis unit 55 described above. In addition, the data contained in the storage unit 56 may be stored in a memory or the like.

[Fifth embodiment]

Next, the fifth embodiment of the present invention will be described. This embodiment focuses on providing a motion capture system that uses the information terminal device 100b described in the first or second embodiment and various sensors attached to the user's body to detect the wearer's body movements. In particular, this embodiment provides a system that can measure and provide guidance for multiple sports, such as cycling and running, in triathlons using a single information terminal device 100b.

(Structure of Each Device)

The information terminal device 100b involved in this embodiment, as shown in (a) and (b) of Figure 24, is a watch-type wearable terminal that can be worn by a user via a strap 4. It is composed of a wearable terminal 1b that can be worn on the user's wrist, a base device 2b, and a power supply device 3b that is detachably engaged with the base device 2b. In addition, the wearable terminal 1b, the base device 2b, and the strap 4 can be detachably engaged with each other and can be separated or combined as needed. In addition, the wearable terminal 1b or the base device 2b has multiple types with different additional functions or designs depending on the intended use, and can be appropriately selected and freely changed according to the purpose. For example, as shown in (b) of Figure 24 and Figure 26, the base device 2b, to which the wearable terminal 1b is attached, can be equipped with an assembly device 101 for assembly to the handlebars of a bicycle, or a battery can be attached as an extension of the power supply device 3b.

To explain in detail, in this embodiment, the information terminal device 100b has the function of using the belt component 4 as a wearable terminal and wearing it as a wristband on the user's wrist, etc., or connecting the clamp of the assembly device 101 to the handlebar 102 part of the bicycle for wearing. In this way, one (one type) of information terminal device can be continuously used for both cycling and running, and sensors worn on the body can be continuously worn during both cycling and running, thereby allowing seamless use.

In addition, as shown in Figure 25, the wearable terminal 1b has an operating unit 104 with operating buttons or a touch panel, which can be separated from the display unit 103. Depending on the type of competition or the purpose of the measurement, the display can be replaced with a large one (large display 103b) or a small one (small display 103a). This allows for appropriate choices such as prioritizing information display capacity corresponding to the display area or prioritizing power saving due to device miniaturization. Furthermore, as shown in Figure 25(b), even if either the large display 103b or the small display 103a is selected, it can still be worn on the same strap member 4 while being connected to the operating unit 104.

The small display 103a and the large display 103b have liquid crystal displays on their top surfaces, and have side surfaces with an engaging structure and an electrical connector for connecting to the operating unit 104. The bottom surfaces of these small and large displays 103a, 103b, and the operating unit 104 have an engaging structure for engaging with the strap member 4. The strap member 4 is used to attach the wearable terminal 1b to the wrist, and various straps can be used depending on the user's application, including metal straps, rubber straps, leather straps, nylon straps, and other straps.

The small display 103a and the large display 103b are tilted and snapped together relative to the operating unit 104. After snapping together, the side profile of the wearable terminal 1b is bent as a whole into a "く" shape, forming a circular ring along the wearer's wrist. The small display 103a and the large display 103b are used to display messages or input text for the user, and a touch panel is integrally formed on their top surface. The touch panel detects the touched position on the display using a pressure-sensitive, optical, electrostatic, or electromagnetic induction detection method, for example, based on the points that constitute the display, and outputs a signal of the detected position (hereinafter referred to as the "touch position") as the touch position. The touch position is expressed as an XY coordinate system set as the coordinate system of the touch panel's detection surface. The user can perform various operations by touching the display using the included touch pen PN, a finger, or the like.

This waterproof touch panel detects the touched location on the display even when it's above water using a unique electrostatic capacitance detection method, outputting a detection signal as the touch location. The touch location is represented by an XY coordinate system set to the touch panel's detection surface. Users can perform various operations by touching the display, even under water. Furthermore, the clock itself can still be operated even with mechanical buttons attached.

The small display 103a is sized to fit within the width of the strap 4 and is formed in a generally trapezoidal shape. Meanwhile, the large display 103b is formed to expand laterally from the width of the strap 4, with the expanded portion protruding toward the wrist opposite the wearer's wrist.

In operating unit 104, a GPS antenna and a wireless antenna are housed within the exterior housing. The GPS antenna is an antenna (first antenna) used for wireless communication, acquiring satellite information such as satellite orbit information, GPS time information, or location information contained in navigation messages based on 1.5 GHz satellite signals extracted from a SAW file (not shown). This antenna is formed from a conductive component such as stainless steel. Furthermore, the wireless antenna built into operating unit 104 is an antenna for BTLE (Bluetooth (registered trademark) Low Energy), an extremely low-power, short-range wireless standard, used for communication with various sensors and other small portable devices. This wireless antenna is also formed from a conductive component such as stainless steel.

In this embodiment, the operating unit 104 is equipped with operation buttons on its side for manual operation by the user, and the surface of the operating unit 104 is provided with a touch panel or LEDs for status display. Furthermore, in this embodiment, the operating unit 104 is waterproof and has the function of processing radio waves (radio signals) from GPS satellites to obtain speed information or position information for display. Alternatively, the operating unit 104 may include an accelerometer or the like, allowing it to function as an actigraph based on acceleration measurements of body movements.

On the other hand, the base device 2b is an information terminal device that is detachably engaged with the wearable terminal 1b, and is a box having a recessed portion bent to match the outer shape of the wearable terminal 1b. In this embodiment, the base device 2b is formed of a synthetic resin such as hardened plastic, and has an information terminal device such as a CPU inside. In addition, in this embodiment, the base device 2b has a base-side connection terminal (first connection terminal) 21 formed on its upper surface, which is detachably engaged with the bottom of the outer casing of the wearable terminal 1b via the base-side connection terminal 21. Specifically, a terminal-side connection terminal is provided at the bottom of the wearable terminal 1b at a position corresponding to the base-side connection terminal 21. By bringing the base-side connection terminal 21 into contact with the terminal-side connection terminal, the base device 2b is electrically connected to the wearable terminal 1b. The mounting terminal 1b and the base device 2b transmit and receive data for display on the small display 103a and the large display 103b via the base-side connection terminal 21. The base device 2b supplies power to the mounting terminal 1b and transmits and receives data for display on the small display 103a and the large display 103b.

In addition, the base device 2b is equipped with a removable battery and has an RFID communication function that can read or write data in a contactless manner via radio waves. Using the wireless antenna for wireless communication provided in the base device 2b, wireless communication with an external reader/writer device can be performed. The wireless antenna is a contactless antenna for wireless communication (NFC (Near Field Communication)) that uses weak radio waves sent by an external reader/writer device to send and receive data. Furthermore, in this embodiment, the base device 2b is provided with a USB terminal for electrical connection to an external device such as a personal computer. The USB terminal is an external terminal provided on the outside of the base device 2b and connected to an external device via a USB cable, and is provided in a connector that protects the USB terminal 33 provided on the side of the base device 2b.

The power supply device 3b removably snaps onto the bottom of the base device 2b to supply power or charge the wearable terminal 1b and base device 2b. In this embodiment, the power supply device 3b can be installed indoors in a user's home, for example, or it can be portable, installed in a car, bicycle, or similar device. Indoor devices can be powered via an outlet and a power cable. Portable devices can include a battery to store power supplied by an external AC adapter. Alternatively, the battery can include a built-in transformer, rectifier, or stabilization circuit to convert AC to DC. The structure of the power supply device 3b can be modified depending on its intended use. For example, if installed on a table, it can have a mounting base on its lower surface. If installed on a bicycle, it can include accessories for storage or attachment to the handlebars.

(Order of motion capture methods)

27 and 28 are schematic explanatory diagrams of a motion capture system using the information terminal device 100b according to this embodiment. Fig. 29 is a block diagram showing the internal structure of each device according to this embodiment.

As shown in Figures 27 and 28, the motion capture system according to this embodiment comprises an information terminal device 100b worn by a wearer, and various sensors 40 attached to various parts of the wearer's body and wirelessly connected to the information terminal device 100b. Furthermore, in this embodiment, the system can be implemented primarily within the scope of short-range wireless communication between the information terminal device 100b and the various sensors 40. During actual measurement, the system can be operated as a so-called standalone, offline system, without being connected to servers on the communication network.

The various sensors 40 are a sensor group including a plurality of sensors that are detachably mounted by the wearer, and in this embodiment, include a body motion sensor 41. In addition, although the shoe sole sensor 42 of the above embodiment is not included here, it can be used as needed.

The body motion sensors 41a-e are a set of sensors attached to various parts of the wearer's body to detect three-dimensional displacement, angular velocity, or acceleration. In this embodiment, they are attached to predetermined joints of the wearer. Specifically, they consist of a right knee body motion sensor 41a attached to the wearer's right knee, a left knee body motion sensor 41b attached to the wearer's left knee, a right foot body motion sensor 41c attached to the wearer's right instep, a left foot body motion sensor 41d attached to the wearer's left instep, and a waist body motion sensor 41e attached to the wearer's waist. These body motion sensors 41 are equipped with a three-axis accelerometer for measuring acceleration, a three-axis gyroscope for detecting angular velocity, and a three-axis magnetic sensor for measuring the magnitude and direction of magnetic fields, enabling detection of movement along nine axes.

Each body motion sensor 41 can be attached and detached from the wearer's clothing using a clamp or other component, or can be attached and detached from the wearer's clothing as a belt or clothing. Thus, the wearer can attach and detach each sensor to perform measurements while attaching a small accessory to the belt or clothing or wearing the belt or clothing in their daily life. This reduces the burden on the wearer and facilitates continuous measurement.

Furthermore, as shown in FIG29 , each of these sensors 40 (body motion sensors 41a-e) includes a wireless communication unit. This wireless communication unit has an internal antenna and can communicate with the information terminal device 100b by executing a data communication protocol based on short-range wireless communication such as BTLE (Bluetooth (registered trademark) Low Energy, Bluetooth (registered trademark) 4.0). In this embodiment, the wireless communication unit of each sensor 40 uses BTLE as a low-power communication protocol, but ANT, ANT+, or other protocols may also be used. Conventional Bluetooth (registered trademark) may also be used.

The information terminal device 100b according to this embodiment, in addition to the functions described in the aforementioned embodiments, also has the function of collecting detection results from each sensor 40. It can communicate with each sensor 40 via the wireless communication unit 119b to obtain the detection results. The memory 114 of the information terminal device 100b functions as a body motion recording unit that accumulates the detection results of the body motion sensors 41 as body motion data. Furthermore, the detection results transmitted by each sensor 40 are appended with sensor identification information identifying each sensor 40. This identification information is stored in the memory 114 of the information terminal device 100. When the control unit 170 receives the detection results from the wireless communication unit 119b, it can determine whether the detection results were obtained from a specific sensor 40. Furthermore, this identification information includes attachment location information that specifies the attachment location of each sensor. Based on this attachment location information, body motion reproduction data can be calculated. Furthermore, the body motion data also includes information about the time when the detection results were obtained from each sensor 40.

The information terminal device 100 also has the function of transmitting the acquired body motion data to the server device 5a of the communication network 8 described in the above embodiment. Specifically, the body motion data recorded by the wearable terminal 1 is transmitted to the base device 2 using the base-side connection terminal 21 and the terminal-side connection terminal 11. Furthermore, the wireless communication unit 206 of the base device 2b transmits the acquired body motion data to the server device 5a.

The communication interface 119b is a module that controls the transmission and reception of various information via the communication network 8, as well as short-range wireless communications such as Wi-Fi and Bluetooth (registered trademark). It communicates with the base device 2 or various sensors of the information terminal device 100b using various protocols, and transmits and receives data with the aforementioned server device 5a and the like via 3G communications. In this embodiment, the communication interface 119b obtains body motion data from the base device 2 and transmits the analysis results obtained by the analysis unit 55 to the server device 5a and the like.

Furthermore, the display unit 131 of the information terminal device 100b functions as an output device for displaying or outputting the analysis results of the body motion reproduction data. When the analysis results are obtained from the server device 5a, they are displayed on the display unit 131 under the control of the control unit 170. In this embodiment, the other functional modules of the information terminal device 100b are the same as those in any of the first to fourth embodiments described above and are not shown in FIG. 26 and will be omitted for clarity.

Furthermore, in this embodiment, the information terminal device 100b has the function of analyzing the wearer's body movements based on the body movement data acquired from various sensors and generating body movement reproduction data. Specifically, as shown in Figure 29, the information terminal device 100b includes a control unit 170, which is a processing unit such as a CPU that performs the various calculations required to control the various components. Furthermore, the various functions of the information processing terminal 100b are virtually implemented in the control unit 170 by executing predetermined programs within the control unit 170. Specifically, the control unit 170 virtually includes a body movement data acquisition unit 170c, a body movement calculation unit 170b, a cycle extraction unit 170a, a correction unit 170d, and an analysis unit 170e.

The body motion data acquisition unit 53 is a module that acquires body motion data from each sensor 40 via the wireless interface 119b. In this embodiment, it wirelessly communicates with each body motion sensor 41a to 41e to acquire the detection results, i.e., body motion data. This body motion data is temporarily stored in the memory 114. The detection results of the body motion sensor 41 are then transmitted to the body motion calculation unit 52. Furthermore, the detection results of the waist body motion sensor 41e are transmitted to the correction unit 170d.

The body motion calculation unit 170b is a module that calculates the wearer's body motion as body motion reproduction data based on the detection results of the body motion sensors 41a-e and the relative positional relationships between the body motion sensors 41a-e stored in the memory 114 (body motion recording unit). The detection results of the body motion sensors 41 refer to values measured by a so-called nine-axis sensor. In this embodiment, these values include the direction and magnitude of acceleration (including gravitational acceleration) acting on an object, the object's angular velocity (magnitude, direction, and center position), and the magnitude and direction (square angle) of the magnetic field. Furthermore, the relative positional relationships between the body motion sensors 41a-e refer to the relative distances or ranges of motion between the wearer's skeleton and the mounting positions of the body motion sensors 41a-e when the wearer is wearing them. For example, as shown in (b) of Figure 15 , in the lower body of the human body, a pair of femurs B1 and B2 are connected to the pelvis B7, to which are connected the tibias B3 and B4, respectively, and further to which are connected the tarsal bones B5 and B6. Each bone is connected by joints so that it can be bent or rotated, but the length of each bone hardly changes. Furthermore, the bending angles R13, R24, R35, and R46 of each joint are also limited within their range of motion. Therefore, based on the detection results of each body motion sensor, which are determined by the length of such bones or the range of motion of the joints, and the relative positional relationships between the body motion sensors 41a-e, body motion reproduction data that reproduces the wearer's movements or postures can be generated.

Furthermore, in this embodiment, the body motion calculation unit includes a period extraction unit 170a. This period extraction unit 170a extracts periodic changes in body motion based on the body motion reproduction data stored in the memory 114. These periodic changes are not simply circular motions but also include complex rotational motions C1 to C3, such as three-dimensional, figure-8-shaped motions or complex wave-like motions, as shown in Figures 27 (a) and (b). In this embodiment, the rotational motion of right knee body motion sensor 41a attached to the wearer's right knee is extracted as C2a, the rotational motion of left knee body motion sensor 41b attached to the wearer's left knee is extracted as C2b, the rotational motion based on right foot body motion sensor 41c attached to the wearer's right instep is extracted as C1a, the rotational motion based on left foot body motion sensor 41d attached to the wearer's left instep is extracted as C1b, and the rotational motion (rocking motion) based on waist body motion sensor 41e attached to the wearer's waist is extracted as C3. Of these rotational motions, C1a, C1b, C1c, and C1d, during running and cycling, have a primary component along a plane xy that includes the wearer's running direction x and the perpendicular direction y. C3 tends to have a primary component along a plane intersecting plane xy. In addition, the analysis unit 170e also has the function of analyzing the pattern of the rotational motion. By extracting the characteristics of the rotational motion, it can automatically determine the type of the current competitive event and switch the processing settings suitable for the event type.

As a method for extracting this periodic change, a body part corresponding to a swing point defined on the wearer's body centerline, such as a body motion sensor located on the waist, is monitored, as with the waist body motion sensor 41e. The three-dimensional displacement or acceleration of the waist body motion sensor 41e (swing point) is detected, and the swing motion C3 of the swing point is measured. This swing motion C3 is a rotational motion whose main component is along a plane intersecting the xy plane. Even when a swing point defined on the body centerline, such as the waist, rotates with relatively consistent amplitude, even during sports like running or cycling, such as when a sensor is worn on the foot. Therefore, the timing of this swing can be used to correct errors in the detection results of other sensors. Furthermore, the body motion data for extracting periodic changes is not limited to the waist body motion sensor 41e; it can be any one of the body motion sensors 41a-e, or a combination of them. Furthermore, as in the above-mentioned embodiment, the period of pressure changes obtained by a shoe sole sensor or the like can also be used.

Furthermore, in this embodiment, the body motion calculation unit 170b calculates the wearer's body motion as body motion reproduction data based on the detection results of the body motion sensors 41a-e and the changes in the relative positional relationship of these body motion sensors 41a-e. In this case, as shown in FIG25 , for example, the body motion calculation unit 170b calculates reference rotation trajectories C1axy and C1bxy projected onto a vertical plane (the xy plane in FIG28 ) parallel to the direction of gravity (the y direction in FIG27(b)) and the wearer's direction of travel (the x direction in FIG27(b)), based on the detection results of the waist body motion sensor 41e. Furthermore, the body motion calculation unit 170b calculates the three-dimensional free rotation trajectory C1 for each body motion sensor 41a-e. The body motion calculation unit 170b then estimates the relative displacements of the wearer's left and right body motion sensors (right torso 41a, c and left torso 41b, d) and the waist body motion sensor 41e based on the calculated reference rotation trajectory C1xy (C1axy and C1bxy) and the deviation from the calculated free rotation trajectory C1 (C1a and C1b). The body motion calculation unit 170b then calculates body motion reproduction data based on the calculated reference rotation trajectory C1xy, the free rotation trajectory C1, and the estimated relative displacements. The calculated reference rotation trajectory C1xy and the deviation from the calculated free rotation trajectory C1 can be used as data to estimate the degree of deviation from the ideal form, thereby enabling guidance and other aspects.

The correction unit 170d is a module that corrects the body motion reproduction data calculated by the body motion calculation unit 170b based on the detection results of the period extraction unit 170a. Here, the correction processing of the correction unit 170d refers to calculating the overall displacement or rotation by continuously accumulating the values measured by each sensor in the above-mentioned body motion sensor 41. In addition, due to the accumulation of noise or errors generated by the sensors, there is a possibility of deviation from the actual position, displacement, or posture. Therefore, in this embodiment, the correction unit 170d uses the detection results of the period extraction unit 170a to return to a certain reference point determined based on periodicity (for example, the moment when the waist body motion sensor 41e passes through the body's central axis position, etc.) to determine the end of the repeated action and the starting point of the next action. Assuming that the rotational motion of the other body motion sensors has also reached the end point/start point, the position or rotation angle is corrected.

The analysis unit 170e is a module that analyzes the wearer's body motion based on the body motion reproduction data corrected by the correction unit 170d. This analysis method can generate stereoscopic image data that displays the wearer in three dimensions based on the corrected body motion reproduction data. Alternatively, for example, the analysis unit can extract model body motion data from the memory 114, which stores model body motion data, and compare it with the wearer's body motion reproduction data to generate improved data indicating deviations from normal body motion. Furthermore, analysis can be performed based on individual user information, such as gender, height, weight, and age, by preregistering user information. The analysis unit 170e then transmits the analysis results, such as the stereoscopic image data or improved data, to the information terminal device 100b.

The memory 114 is a storage device for storing various data, including identification information for identifying each information terminal device 100b, information on the location where each sensor 40 is installed, the relative position relationship of the body motion sensors 41 installed at each location, and the above-mentioned body motion data that becomes user information or a template.

(Motion Capture Method)

By operating the motion capture system having the above structure, the motion capture method for detecting the wearer's body movements according to this embodiment can be implemented. Figure 30 is a timing diagram illustrating the motion capture method according to this embodiment. Furthermore, this description uses the example of a continuous transition from cycling to running, such as in a triathlon.

First, the wearer attaches body motion sensors 41a-d to their knees and feet, and waist motion sensors 41e to their waist. Furthermore, the wearer attaches information terminal device 100b. During cycling competitions, the wearable terminal 1b is secured to the bicycle's handlebars using attachment hardware 102 and base device 2b. The base device 2 and power supply device 3b charge the wearable terminal 1b, and motion capture is performed. The wearable terminal 1b is then detached from the base device 2b and attached to the wearer's wrist via strap 4.

Once the information terminal device 100b has been secured or attached, the next step is to obtain detection results from each sensor 40 (S501). At this point, the user can select a sport category, extract the aforementioned rotational motion characteristics, and automatically determine the pre-set sport category based on the extracted pattern. Processing settings appropriate to the sport category can then be switched. This function allows seamless and continuous measurement, even when switching sport categories mid-process, without the need for special scanning.

Then, upon receiving the detection start operation, if the control unit 170 of the wearing terminal 1b receives the operation signal, it performs connection processing with each sensor 40 (S401). After the connection processing is performed, each sensor 40 detects the wearer's movements. Specifically, the body motion sensors 41 worn on various parts of the wearer's body detect the three-dimensional displacement or acceleration of each part (S402). Then, the obtained detection results are transmitted by the wireless communication unit 119b of the wearing terminal 100b via weak radio waves via the wireless communication unit of each sensor 40 (S403). If the wireless communication unit 119b of the wearing terminal 100b receives the detection results (S502), the memory 114 serving as the body motion recording unit stores the detection results of the body motion sensors 41a to 41e as body motion data (S503).

Then, once the body motion data acquisition unit 53 acquires body motion data, the body motion data acquisition unit 170c transmits the detection results of the body motion sensors 41 to the body motion calculation unit 52 and transmits the detection results of the period extraction unit 170a to the correction unit 54. The body motion calculation unit 52 calculates the wearer's body motion as body motion reproduction data based on the detection results of the body motion sensors 41 accumulated in the body motion recording unit and the relative positional relationship between the body motion sensors 41 (S504), and transmits the body motion reproduction data to the correction unit 170d. Meanwhile, based on the detection results of the period extraction unit 170a, when a predetermined period arrives ("Yes" in S506), the correction unit 54 corrects the body motion reproduction data calculated by the body motion calculation unit 52 (S507). The corrected body motion reproduction data is then transmitted to the analysis unit 55.

The analysis unit 55 analyzes the wearer's body motion based on the body motion reproduction data corrected by the correction unit 54 (S508). The analyzed analysis result data is displayed or output via the display unit 131 or audio from a speaker (S509). Furthermore, if a change is detected in the pattern of the extracted rotational motion or body motion reproduction data ("Yes" in S510), the type of the currently-performed athletic event can be automatically determined by comparing the pattern, and measurement settings appropriate for the athletic event can be switched (S512).

The above process is continuously executed during the competition (No in S511), the detection process ends (Yes in S511), and the communication with each sensor is cut off (S513 and S404).

(Action/Effect)

According to this embodiment, the wearer is fitted with body motion sensors 41a to 41e, and based on the detection results of each sensor 40, the wearer's body performance is calculated as body motion reproduction data, and the body motion reproduction data is analyzed, and the analysis results are displayed on the display unit 131, thereby enabling the wearer to recognize the wearer's own body motion, or providing suggestions on improvement points for the wearer's body motion, etc.

At this time, since the correction unit 54 corrects the body motion reproduction data calculated by the body motion calculation unit 52 based on the detection result of the period extraction unit 170a, even if the relative position of the body motion reproduction data with respect to the ground is erroneous due to noise or errors generated in the body motion sensor 41 such as the 9-axis sensor, the value of each body motion sensor 41 can be corrected (for example, corrected to 0) by using the pattern and time of the rotational motion detected by the period extraction unit 170a, and the body motion reproduction data can still be properly constructed and displayed/output.

In addition, in this embodiment, since the body motion recording unit that accumulates the detection results of the body motion sensors 41a~41e as body motion data is the memory 114 of the information terminal device 100b, the device for accumulating body motion data can be made into a highly portable wearable watch type, so that body motion data during exercise or sports activities can be easily collected.

Furthermore, in this embodiment, the wireless communication unit 119b of the wearable terminal 1b uses a wireless communication method such as Bluetooth (registered trademark), BTLE, or ANT. However, these wireless communication methods have limitations on the number of devices that can be connected simultaneously (a maximum of six for Bluetooth (registered trademark)). Therefore, in order to minimize the number of sensors required to calculate and analyze the wearer's body motion reproduction data, this embodiment uses a total of five body motion sensors 41a-e located at the wearer's knees, feet, and waist. As a result, this embodiment allows calculation and analysis of the wearer's body motion reproduction data without changing the structure of the information terminal device 100b described in the aforementioned embodiments.

Explanation of symbols

C1…free rotation trajectory

C1xy…reference rotation trajectory

C1～C2…free rotation trajectory

C3…Shaking motion

1 (1a, 1b) ... mounting terminal

2 (2a, 2b) ... base device

3.3b…Power supply device

4 (4a, 4b) ...with parts

5…Server device

6…User terminal

7…Wireless base station

8…Communication Network

9…Personal Computer

10…External casing

11…Terminal side connection terminal

11a…Through hole

12a~12c…operation buttons

14…Packing

15…Display support plate

16…antenna spring

17…Circuit board

18…GPS antenna

19…back cover

21…Base side connection terminal

22a, 22b…operation buttons

23…Microphone

24, 24a… Wireless antenna

25…speakers

31…Power supply side connection terminal

32…connector

33…USB terminal

34…cover

35…Cylindrical parts

40…Sensor

41 (41a～41g)…body motion sensor

42 (42a, 42b) ...shoe sole sensor

51…Communication interface

52, 170b…Body motion calculation unit

53, 170c…body movement data acquisition unit

54, 170d…Revision Department

55, 170e…Analysis Department

56…Storage

61…Wireless interface

62…Input interface

63…output interface

63a…Display panel

64…Application execution unit

65…Memory

70…hub

71…Data Collection Department

71a…Group 1 Collection Department

71b…Group 2 Collection Department

72…Data forwarding unit

100, 100a, 100b...information terminal device

101…Assembly tools

102…handlebars (bicycle)

103a…Small monitor

103b...large monitor

104…Operation Department

111…output interface

112…Input interface

114…Memory

115…Acceleration sensor

116…Wireless Antenna

117…Wireless Communications Department

119…GPS receiver

131, 133…Display unit

131a～131c…Display screen

132a, 132b…broken line

134…Protective cover

135…Touch sensor

136…Display panel

170…Control Department

170a…Cycle extraction unit

171…Connector for LCD panel

172…TPC connector

173…Protective components

174…area

175, 176, 177…Flexible printed circuit substrate

178…batteries

181…Ontology

184…Protrusion

200…Control Department

201…output interface

202…battery

203…Memory

204…Vibration motor

206, 206a…Wireless communication unit

207…Input interface.

Claims (12)

1. A motion capture system for detecting the body movements of a wearer, characterized in that the motion capture system comprises: A body motion sensor, which is installed on various parts of the wearer's body, detects the three-dimensional displacement or acceleration of each part; A sole sensor, disposed on the sole of the wearer's shoe, detects the pressure acting on the sole; The body motion recording unit accumulates the detection results of the body motion sensor and the shoe sole sensor into body motion data; The body motion calculation unit calculates the wearer's body motion as body motion reproduction data after reproducing the wearer's actions or postures, based on the detection results of the body motion sensors accumulated in the body motion recording unit and the relative positional relationship of each body motion sensor. The correction unit, based on the detection results of the sole sensor, when the sole sensor detects a maximum value and the foot is completely in contact with the ground, corrects the height position of the body motion sensor worn by the foot that represents the maximum value to 0, and uses the tarsal bone with a height position of 0 as a reference to correct the position or rotation angle of other bones, thereby correcting the body motion reproduction data calculated by the body motion calculation unit. The analysis unit analyzes the wearer's body movements based on the body movement reproduction data corrected by the correction unit; and An output device that displays or outputs the parsing results of the parsing unit. 2. The motion capture system according to claim 1, characterized in that, This motion capture system also features: The data collection unit acquires the detection results from the body motion sensor and the shoe sole sensor; and The data forwarding unit converts the detection results obtained by the data collection unit into a unified data format and sends it to the body motion recording unit. 3. A motion capture method for detecting the body movements of a wearer, characterized in that the motion capture method comprises the following steps: The detection steps involve detecting the three-dimensional displacement or acceleration of each part of the wearer's body using body motion sensors installed on various parts of the body, and detecting the pressure acting on the sole of the shoe using a sole sensor configured on the sole of the wearer's shoe. In the body motion recording step, the body motion recording unit accumulates the detection results of the body motion sensor and the sole sensor into body motion data; In the body motion reproduction data generation step, the body motion calculation unit calculates the wearer's body motion as body motion reproduction data after reproducing the wearer's actions or postures, based on the detection results of the body motion sensors accumulated in the body motion recording unit and the relative positional relationship of each body motion sensor. In the body motion reproduction data correction step, the correction unit, based on the detection results of the sole sensor, corrects the height position of the body motion sensor worn by the foot that represents the maximum value to 0 when the sole sensor is completely in contact with the ground at the moment when the detection result of the sole sensor is the maximum value. The correction unit also corrects the position or rotation angle of other bones based on the tarsal bone with a height position of 0, thereby correcting the body motion reproduction data calculated by the body motion calculation unit. The analysis step involves the analysis unit analyzing the wearer's body movements based on the body movement reproduction data corrected through the body movement reproduction data correction step; and The output step involves displaying or outputting the parsing results of the parsing unit through an output device. 4. The motion capture method according to claim 3, characterized in that, The body motion recording process also includes the following steps: The data collection step involves obtaining the detection results from the body motion sensor and the shoe sole sensor; and The data forwarding step converts the detection results obtained in the data collection step into a unified data format and sends it to the body motion recording unit. 5. A computer-readable medium storing a motion capture program for detecting the body movements of a wearer, characterized in that the motion capture program enables a computer to function as a component: A body motion sensor, which is worn on various parts of the wearer's body, detects the three-dimensional displacement or acceleration of each part; A sole sensor, disposed on the sole of the wearer's shoe, detects the pressure acting on the sole; The body motion recording unit accumulates the detection results of the body motion sensor and the shoe sole sensor into body motion data; The body motion calculation unit calculates the wearer's body motion as body motion reproduction data after reproducing the wearer's actions or postures, based on the detection results of the body motion sensors accumulated in the body motion recording unit and the relative positional relationship of each body motion sensor. The correction unit, based on the detection results of the sole sensor, when the sole sensor detects a maximum value and the foot is completely in contact with the ground, corrects the height position of the body motion sensor worn by the foot that represents the maximum value to 0, and uses the tarsal bone with a height position of 0 as a reference to correct the position or rotation angle of other bones, thereby correcting the body motion reproduction data calculated by the body motion calculation unit. The analysis unit analyzes the wearer's body movements based on the body movement reproduction data corrected by the correction unit; and An output device that displays or outputs the parsing results of the parsing unit. 6. The computer-readable medium according to claim 5, characterized in that it enables the computer to also function as a component: The data collection unit acquires the detection results from the body motion sensor and the shoe sole sensor; and The data forwarding unit converts the detection results obtained by the data collection unit into a unified data format and sends it to the body motion recording unit. 7. A motion capture system for detecting the body movements of a wearer, characterized in that the motion capture system comprises: Multiple body motion sensors, which are worn on the left and right sides of the wearer's body, are capable of measuring the three-dimensional displacement or acceleration of each part. The body motion recording unit accumulates the detection results of the body motion sensors into body motion data; The body motion calculation unit calculates the wearer's body motion as body motion reproduction data after reproducing the wearer's actions or postures, based on the detection results of the body motion sensors and the changes in the relative positional relationship between the body motion sensors. The periodic extraction unit extracts periodically changing rotational movements based on the body motion reproduction data accumulated in the body motion recording unit. The correction unit corrects the body motion reproduction data calculated by the body motion calculation unit based on the periodic changes extracted by the periodic extraction unit. The analysis unit analyzes the wearer's body movements based on the body movement reproduction data corrected by the correction unit; and An output device that displays or outputs the parsing results of the parsing unit. 8. The motion capture system according to claim 7, characterized in that, The motion capture system also includes a rocking point sensor, which is positioned on a body part corresponding to a rocking point defined on the center line of the wearer's body, to detect the three-dimensional displacement or acceleration of the rocking point, thereby determining the rocking motion of the rocking point. The body motion calculation unit calculates the wearer's body motion as body motion reproduction data based on the detection results of the body motion sensors and the shaking point sensors, as well as the changes in the relative positional relationship of these body motion sensors and shaking point sensors. 9. A motion capture method for detecting the body movements of a wearer, characterized in that the motion capture method comprises the following steps: The detection step involves using multiple body motion sensors installed on various parts of the wearer's body to detect the three-dimensional displacement or acceleration of each part. In the body motion recording step, the body motion recording unit accumulates the detection results of the body motion sensor into body motion data; In the body motion reproduction data generation step, the body motion calculation unit calculates the wearer's body motion as body motion reproduction data after reproducing the wearer's actions or postures based on the detection results of the body motion sensors accumulated in the body motion recording unit and the relative positional relationship of each body motion sensor; and the periodic extraction unit extracts periodically changing rotational movements based on the body motion reproduction data accumulated in the body motion recording unit. The body motion reproduction data correction step involves a correction unit that corrects the body motion reproduction data calculated by the body motion calculation unit based on the periodic changes extracted by the periodic extraction unit. The analysis step involves the analysis unit analyzing the wearer's body movements based on the body movement reproduction data corrected through the body movement reproduction data correction step; and The output step involves displaying or outputting the parsing results of the parsing unit through an output device. 10. The motion capture method according to claim 9, characterized in that, In the detection step, a sway point sensor, positioned on a body part corresponding to a sway point defined on the center line of the wearer's body, detects the three-dimensional displacement or acceleration of the sway point, thereby determining the swaying motion of the sway point. In the body motion reproduction data generation step, the wearer's body motion is calculated as body motion reproduction data based on the detection results of the body motion sensor and the shaking point sensor, as well as the changes in the relative positional relationship of these body motion sensors and shaking point sensors. 11. A computer-readable medium storing a motion capture program that detects the body movements of a wearer and causes a computer to perform processing comprising the following steps: The detection step involves using multiple body motion sensors installed on various parts of the wearer's body to detect the three-dimensional displacement or acceleration of each part. In the body motion recording step, the body motion recording unit accumulates the detection results of the body motion sensor into body motion data; In the body motion reproduction data generation step, the body motion calculation unit calculates the wearer's body motion as body motion reproduction data after reproducing the wearer's actions or postures based on the detection results of the body motion sensors accumulated in the body motion recording unit and the relative positional relationship of each body motion sensor; and the periodic extraction unit extracts periodically changing rotational movements based on the body motion reproduction data accumulated in the body motion recording unit. The body motion reproduction data correction step involves a correction unit that corrects the body motion reproduction data calculated by the body motion calculation unit based on the periodic changes extracted by the periodic extraction unit. The analysis step involves the analysis unit analyzing the wearer's body movements based on the body movement reproduction data corrected by the body movement reproduction data correction step; and The output step involves displaying or outputting the parsing results of the parsing unit through an output device. 12. The computer-readable medium according to claim 11, characterized in that, In the detection step, a sway point sensor, positioned on a body part corresponding to a sway point defined on the center line of the wearer's body, detects the three-dimensional displacement or acceleration of the sway point, thereby determining the swaying motion of the sway point. In the body motion reproduction data generation step, the wearer's body motion is calculated as body motion reproduction data based on the detection results of the body motion sensor and the shaking point sensor, as well as the changes in the relative positional relationship of these body motion sensors and shaking point sensors.