NL2004660C2

NL2004660C2 - Device and method for motion capture and analysis.

Info

Publication number: NL2004660C2
Application number: NL2004660A
Authority: NL
Inventors: Johan Andreas Versteegh; Markus Dijk
Original assignee: Technologies88 B V
Priority date: 2010-05-04
Filing date: 2010-05-04
Publication date: 2011-11-07
Also published as: WO2011139153A1

Abstract

The invention relates to a device and method for motion capture and analysis of motion of an object, in which an adaptive envelope derived from multiple motion measurements is used for determining the extent to which a further motion measurement conforms to an envelope or section thereof derived from the earlier multiple motion measurements. The invention further provides a method for adaptively converging the envelope towards a non- predetermined envelope in dependence on a number of consecutive motion measurements made with the object, thus allowing subjective or tailor made improvement and/or monitoring of further motions.

Description

No. NLP186859A

Device and method for motion capture and analysis BACKGROUND

The invention relates to a method and device for motion capture and analysis. In particular the present 5 invention relates to a method and device for motion capture and analysis of golf swing motions.

Systems for motion analysis have been known in the art, for example from International Application WO 02/35184, which describes a system for measuring the motion of a 10 sporting equipment, the system comprising: a motion sensing system in communications with said sporting equipment to measure motion parameters, wherein said motion sensing system comprises: at least one of at least one accelerometer and at least one gyroscope, 15 a command station comprising a data acquisition system to process said measured motion parameters and produce data, wherein said data acquisition system compares said produced data to previously stored data.

A disadvantage of such a system is that once an 20 athlete has trained a motion, e.g. a golf swing, to conform to the motion parameters described in the previously stored data, the system offers no hints for further improvement. Moreover, WO 02/35184 fails to disclose the manner in which the measured motion parameters are processed, or how these 25 parameters are compared to previously stored data.

2

It is an object of the present invention to provide an improved method and device for motion capture and analysis .

5

SUMMARY OF THE INVENTION

To this end, according to a first aspect, the present invention provides a method for capture and 10 analysis of a repeated motion of an object, comprising a learning phase comprising the steps of: - repeatedly performing a motion with or by said object, obtaining multiple corresponding motion 15 measurements, each motion measurement comprising N motion signals over time based on signals from motion sensors attached to said object, - determining, for each of the multiple motion measurements, a first anchor point representative of a first 20 characteristic point in the corresponding motion measurement, - centering the respective first anchor points of the multiple motion measurements at a first common anchor point, 25 - calculating, from the multiple centered motion measurements, one or more predetermined sections of N envelopes defining ranges for the corresponding N motion signals .

During the learning phase, N, being one or more, 30 envelopes or sections thereof are constructed representative of a range of motions. Each of these N envelopes is specifically tailored to the multiple motions that have been performed with the object, and may thus define asymmetrical upper- and lower- limits. As the signals measured over time 35 in a motion measurement may not all be relevant, the predetermined envelope sections are preferably chosen to cover only relevant portions of time of a motion signal.

3

Said relevant portions are typically application dependent. In golf for instance, only parts of the motion signals measured within about 2 seconds on either side of the time of impact will typically be interesting; motion signals of a 5 golf club measured during the time that said golf club is not being used in a swing may thus be ignored.

As an example, in the simplest case in which N equals 1 and only one envelope section is calculated, a single motion signal envelope having a narrow beginning and 10 a much wider end may be calculated from multiple motion signals, said motion signals starting out being substantially equal, e.g. having little variation, but varying wildly as time progresses. For constructing a motion signal envelope having an upper and a lower limit, motion 15 measurements of at least two similar but different motions must be available, though preferably eight to ten motion measurements are obtained for calculating the envelopes. A plurality of example motions can be performed, of which only the best are included in the multiple motions used in the 20 learning phase. Whether or not to include an example motion for use in the learning phase is preferably decided by an expert, e.g. a sports instructor or a physiotherapist.

In an embodiment the method further comprises a subsequent comparison phase comprising the steps of: 25 - obtaining a further motion measurement over time, said further motion measurement comprising N further motion signals over time, determining, for said further motion measurement, a first anchor point representative of the 30 first characteristic point in the corresponding further motion measurement, - centering the first anchor point of the further motion measurement at the first common anchor point, generating a comparison signal indicating 35 whether said further motion measurement falls outside one or more predetermined sections of the N envelopes or not.

During this phase, further motions, e.g. motions 4 made once the learning phase has completed, are performed and compared with the one or more envelope sections that were calculated during the learning phase. A comparison signal is generated indicating whether said further motion 5 falls within the envelopes, or predetermined sections thereof, or not. Thus the comparison signal indicates whether a further motion conforms to specifications learned in the learning phase. The first anchor point defines a first characteristic point or pattern in a motion 10 measurement, allowing the comparison between an envelope and motion measurement to be made starting from said characteristic point or pattern, i.e. allowing offset correction between motion measurements and/or envelope sections. During the learning phase, a first anchor point is 15 determined for each of said motion measurements for the purpose of calculating an envelope section from said multiple motion measurements. For instance, when an accelerometer attached to a golf club is used to provide a motion signal in the golf swing example, a first anchor 20 point, in this case the time of impact, can be determined by detecting a deceleration due to impact with the ball, followed by an erratic motion signal caused by oscillation of the golf club directly after impact. Though motion measurements will be made prior to that point of impact as 25 well, typically only measurements made within a limited predetermined time period prior to and/or after the moment of impact will be interesting to analyze. Such a predetermined time period is relative to the first anchor point and defines a predetermined section of an envelope. 30 During the comparison phase irrelevant or superfluous measurements can be ignored by only comparing said motion measurements and envelopes within these predetermined sections, reducing memory and computational capacity requirements. Preferably a first anchor point of a motion 35 measurement is determined based on a predetermined characteristic point or pattern of like motion measurements, i.e. the same characteristics may be used for determining 5 the first anchor points during both the learning and the comparison phase, independent of the results of the learning phase. In this case the method would be especially suitable for analyzing motions having a known characteristic part in 5 common, while requiring a relatively small number of motions to be repeated in the learning phase.

In an embodiment the method comprises a step of retrieving a predetermined characteristic point or pattern associated with a repeated motion from a database. The 10 database is preferably accessible through an internet connection and comprises a large number of predetermined characteristic points or patterns for repeated motions in a wide range of applications. Examples of such applications are golf swing practice, wherein the characteristic point 15 may be the point of impact of a club with a ball, revalidation therapy, wherein the motion sensors may be attached to for instance a knee brace and the characteristic point may be a point of impact of a foot on the floor, and industrial processes in which a motion is repeatedly 20 executed, wherein the characteristic point may for instance be defined by a motionless moment followed by an acceleration. Each individual motion is preferably non-cyclic allowing anchor points to be determined non-ambiguously from the corresponding motion measurement.

25 Alternatively, the learning phase may comprise an additional step of determining such a characteristic point or pattern, for example by using a statistical method as known in the art for finding characteristics in multiple signals, or by using input from an expert during the 30 learning phase. This would typically require a larger number of motions to be repeated during the learning phase.

In an embodiment the comparison phase comprises the additional steps of: counting a number C of consecutive of said 35 further motion measurements for which predetermined ones of the N motion signals fall within the one or more predetermined sections of their corresponding envelopes, and 6 storing said these motion measurements, updating one or more of said one or more sections of N envelopes based on the stored motion measurements when the number C exceeds a predetermined 5 value.

The method thus provides a way to update the envelope sections when a certain desired consistency in the last C motion measurements has been found. In the golf swing example, when the predetermined value C should exceed equals 10 ten, this means that the envelopes are updated when ten consecutive further motion measurements fall within the envelope sections. Obviously, the predetermined value is a parameter which can be set in advance dependent on the application of the method, by a person performing the 15 further motions, or by an expert. Entirely new envelopes may be calculated based on the last C motion measurements when these motion measurements were within the previous envelopes or sections thereof. In this manner the invention provides a method for adaptively converging individual envelopes 2 0 dependent on the motion measurements obtained during the comparison phase, wherein envelope mean lines of successively updated envelopes may vary. Especially in sports, the best way to perform a motion varies from person to person. The present method provides a way to converge 25 envelopes adaptively and subjectively, i.e. the envelopes will have different shapes and converge differently for different persons.

In an analogous embodiment, the envelope sections are updated when the last C motion measurements were outside 30 the envelopes. The envelope boundaries may thus also be adaptively relaxed.

In an embodiment, the method comprises a step of updating the envelopes in dependence on time. In this embodiment the envelopes are for example relaxed as time 35 progresses, to take into account gradual deterioration of sensors which provide the motion sensor signals, or of mechanical parts of a moving object to which such sensors 7 are attached. This embodiment is especially advantageous for monitoring (partial) movement of mechanical devices used in industrial processes, e.g. for monitoring metering devices, drilling and/or cutting devices, placement devices and the 5 like.

In an embodiment the method comprises the further steps of, during the learning phase: - determining, for each of the multiple motion measurements, a second anchor point representative of a 10 further characteristic point in the corresponding motion measurement different from the first characteristic point, normalizing the multiple motion measurements with respect to time, such that a common distance between the first anchor point and second anchor point is 15 substantially equal for all motion measurements, said method further comprising the steps of, during the comparison phase determining, for said further motion measurement, a second anchor point representative of the 20 second characteristic point in said further motion measurement, - normalizing the further motion measurement with respect to time, such that a distance between its first anchor point and second anchor point is substantially equal 25 to said common distance.

When two anchor points are thus obtained, the motion measurements are normalized with respect to time, making construction of the envelope less dependent on the tempo with which motions are performed. Likewise, fitting or 30 curve-fitting of motion measurements, may be performed more accurately when more characteristic points are known.

In an embodiment the one or more predetermined sections of the one or more envelopes are defined relative to the first common anchor point. Referring to the example 35 wherein the motion measurements are representative of a golf swing, such a golf swing can comprise several predetermined sections, such as for instance backswing, top of swing, 8 downswing, impact and upswing. When it is known in advance that the first anchor point is defined by the moment of impact, and the timeframe of the downswing ranges from 2 seconds before impact to 1 second before impact, a section 5 of a motion measurement comprising downswing motion signals can be identified as soon as the first anchor point has been determined.

In an embodiment each of the one or more sections of the N envelopes is a section of an envelope of overlain 10 multiple motion signals from the multiple motion measurements. Each envelope section is thus formed by corresponding sections of a corresponding motion signal in a motion measurement.

In an embodiment the N motion signals are based on 15 one or more motion sensor signals. For instance, a number of motion sensors, such as linear and/or rotational accelerometers, gyroscopes, and the like, can provide a corresponding number of motion sensor signals. When no further processing of the motion sensor signals is 20 performed, the motion signals comprised in a motion measurement are equal to the motion sensor signals.

In an embodiment the method further comprises a step of calibrating the one or more motion sensors at the beginning of the learning phase, for instance in the 25 following manner. First, the sensors are put at rest in a known position and orientation, such that the expected values of the corresponding motion sensor signal are known. Next the actual motion sensor signals are read out. The difference between the expected signals and the actual 30 signals is then used to calibrate the sensors.

In an embodiment the number of motion sensor signals is greater than N, and the method comprises a step of redimensioning the motion sensor signals to N motion signals. This method takes advantage of the fact that 35 multiple inaccurate motion sensor signals can be combined to form fewer but more accurate motion signals. For effecting this redimensioning a simple conversion matrix may be used, 9 as may other methods known in the art.

In an embodiment the motion sensor signals are averaged and/or smoothed prior to further processing. This helps to cancel out the effect of noise in the motion sensor 5 signals. The averaging and/or smoothing may also comprise reducing the number of samples in a motion sensor signal. For example, a motion sensor signal comprising 600 samples n± may be reduced to a motion sensor signal comprising 300 samples n±' using the formula: ni' = (n2i + n2i+i) / 2, with i 10 ranging from 0 to 300.

In an embodiment, for the purpose of determining a first or second anchor point of a motion measurement, only one motion signal of the N motion signals in a motion measurement is used. This one motion signal is preferably 15 the motion signal of the N motion signals in which characteristic point or pattern may be determined the most accurately and/or easily. Usually, the sensor or sensors contributing to this motion signal be will relatively accurate compared to the sensors which contribute to other 20 motion signals.

In an embodiment a section of an envelope is defined by a mean line and a function defining a variation along that line over time, and updating said section of an envelope comprises updating said function. This allows 25 updating of the envelopes without having to store the previous further motion measurements. For example, the envelope could be narrowed down when a number of motion measurements has been within the envelopes with a certain predetermined consistency, or conversely, the envelope could 30 be stretched when a number of motion measurements has fallen outside of the envelopes with a certain predetermined consistency. Moreover, this embodiment provides a fast and simple manner in which to calculate a distance measure of said further motion measurement to the mean line. Examples 35 of suitable distance measures are Euclidian distance and Mahalanobis distance. Preferably, narrowing an envelope alters the motion signal range, but does not alter the time 10 range of the envelope.

In an embodiment centering of the first anchor points comprises aligning said first anchor points in time. In other words, the time-offsets of the motion measurements 5 are reduced or substantially completely removed.

According to a second aspect, the present invention provides device for capture and analysis of a repeated motion of an object to which said device is attached, said device comprising: motion measurement 10 generating means adapted for generating motion measurements representative of motion of the object, each motion measurement comprising N synchronized motion signals over time, first anchor point determination means, adapted for determining a first anchor point in a motion measurement, a 15 first memory for storing motion measurements, an envelope generator adapted for centering multiple motion measurements at a first common anchor point and generating one or more predetermined sections of N envelopes from multiple stored motion measurements and their associated first anchor 20 points, a second memory for storing said one or more predetermined sections of said N envelopes as well as the first common anchor point, a comparison unit, adapted for generating a comparison signal dependent on a comparison of stored predetermined sections of said N envelopes with 25 corresponding predetermined sections of corresponding motion signals from a further motion measurement, said comparison comprising centering the further motion measurement at the first common anchor point stored in the second memory and subsequently determining whether said motion measurement 30 falls outside one or more stored predetermined sections of the envelopes.

Such a device allows learning a range of motions and providing feedback based on the comparison signal.

Many areas of application are conceivable, for 35 instance sports training such as golf swing practice, during which a trainer can demonstrate multiple movements for providing multiple motion measurements during the learning 11 phase, or have a pupil execute a plurality of motions, the trainer subsequently selecting which of those movements to include in the multiple motion measurements for the learning phase. Once the learning phase is complete, the pupil can 5 practice on his own. The same principle can be applied for revalidation purposes. For example a knee, ankle, wrist or elbow brace may be fitted with sensors for providing the motion signals, and a physiotherapist can supervise correct motions of a patient. Moreover, the present invention can 10 also be applied in a broad range of industrial processes in which movement or partial movement of machines must be monitored to ensure these stay within tolerances.

In an embodiment the device further comprises an update-unit adapted for updating the predetermined sections 15 of envelopes based on motion measurements stored in the first memory means and information about their associated first anchor points, and based on whether a predetermined number of consecutive comparison signals have indicated that a corresponding number of consecutive motion measurements 2 0 has either fallen within the predetermined sections of the envelopes or outside thereof. This allows automated updating of the envelopes during the comparison phase, at least when motion measurements made during the comparison phase are stored in the first memory means. Thus, when further motions 25 performed during the comparison phase are consistent yet not within the envelopes, updated envelopes may be calculated based on said motions. This will result in fewer motion measurements falling outside of the updated envelopes when the motion signals measured shortly after one another are 30 substantially similar yet slow variations occur over time. In a similar manner, the update unit may provide updated envelopes or sections thereof defining a narrower range of motions when a consecutive number of motion measurements fell within the previous envelopes or sections thereof.

35 In an embodiment the device further comprises one or more motion sensors for providing motion sensor signals on which the motion measurements are based. Examples of such 12 motion sensors are accelerometers, gyroscopes, position sensors and the like. Alternatively, other types of sensors may be used, such as humidity sensors, light sensors, pressure sensors, chemical concentration monitoring sensors, 5 and so on, without deviating from the principle behind the present invention.

In an embodiment the device further comprises a calibration unit for calibrating said motion sensor signals, increasing the accuracy of the sensor readings.

10 In an embodiment the device is an integrated device and the one or more motion sensors are in a fixed position with respect to each other and the integrated device. Thus the resulting motion sensor signals represent the motion of the entire device and may more easily and 15 accurately be combined or processed to describe the actual motion of the device.

In an embodiment the device is adapted to be detachably mounted on the object, such as a golf club. In this embodiment a game of golf may be played with a 2 0 conventional club to which the device is attached, and the same motion capture and analysis device may be used consecutively on different clubs.

In an embodiment the device further comprises feedback means for providing an audible, visual, and/or 25 tactile feedback based on the comparison signal. For instance, the device may be provided with a number of LEDs, each led indicating whether part of a motion was outside a corresponding section of one or more envelopes.

The various aspects and features described and 30 shown in the specification can be applied, individually, wherever possible. These individual aspects, in particular the aspects and features described in the attached dependent claims, can be made subject of divisional patent applications .

BRIEF DESCRIPTION OF THE DRAWINGS

35 13

The invention will be elucidated on the basis of an exemplary embodiment shown in the attached drawings, in which: 5 Figure 1A shows an envelope representing a range of motion signals over time together with a mean envelope line,

Figures IB and 1C show two motion measurements used in defining the upper- and lower limits of the envelope 10 of figure 1A,

Figure 2A, shows three envelopes each representing a range of motion signals, as well as three corresponding motion signals of a further motion measurement,

Figures 2B and 2C show two of the envelopes and 15 corresponding motion signals of figure 2A individually,

Figure 3A shows a schematic layout of components for obtaining motion measurements and generating a motion envelope, as used in a device for motion capture and analysis according to the present invention.

20 Figure 3B shows a schematic layout of components for obtaining motion measurements and comparing such motion measurements to a generated envelope.

Figure 3C shows a schematic layout of an embodiment of a device according to the present invention.

25 Figures 4A and 4B show schematic layouts of components for obtaining motion measurements and generation a corresponding envelope, and for obtaining motion measurements and comparing such motion measurements to a generated envelope, suitable for processing motion 30 measurements comprising multiple motion signals.

Figures 5A-5D show a golf club to which a detachable device according to the present invention is attached, as well as the device in different clamping positions .

35 Figure 6 shows an alternative application of the device, in which it is placed on a knee-brace,

Figures 7A and 7B show a flow chart describing the 14 method according to the present invention.

DETAILED DESCRIPTION OF THE INVENTION 5

Figure 1A shows an envelope E calculated from multiple motion signals using the method or device according to the present invention. Envelope E defines an upper limit 102, and a lower limit 103 for the magnitude of motion 10 signals along the vertical axis V. The magnitudes of upper and lower limits are measured by taking consecutive samples n, n in this case ranging from 0 to 750 as indicated on the horizontal axis. Motion signals may be obtained for instance using a linear accelerometer attached to a shaft of a golf 15 club, and arranged for measuring acceleration parallel to said shaft. Any motion signal falling between the upper- and lower limits is within specifications of envelope E. The envelope has a mean line 101 which is equidistanced from the upper- and lower limits 102,103, i.e. mean line 101 bisects 20 lines 104,105 along the vertical axis which connect the upper- and lower limits 102,103. A first anchor point tO is representative of a first characteristic point or pattern common to individual motion signals associated with repeated motions, in this case defined by a somewhat erratic change 2 5 in the signal just before a change in gradient of the signal. Typically, not all samples are relevant for evaluating the quality and/or consistency of a movement. For example, samples taken when a golf player is walking from one hole to the next will typically not be used in training 30 a golf player's swing. In this figure, only samples within the range defined by section 106, i.e. samples 250 to 750, of the envelope are considered relevant. The relevant envelope section or sections are typically predetermined and defined relative to the first anchor point; once the anchor 35 point tO is known the relevant envelope sections can be determined and samples from the remaining section(s) of the motion signal may be discarded or ignored. Though only one 15 envelope section is shown here, it is conceivable that an envelope comprises several of such predetermined envelope sections.

Figure IB shows a motion signal 102 which 5 contributed to defining said upper limit 102 of figure 1A. Though for reasons of clarity only one motion signal is shown, in general multiple motion signals will contribute to defining the upper- and lower limits. Consecutive samples n are plotted along the horizontal axis, and the vertical axis 10 represents the magnitude of the signal. The motion signal comprises a first anchor point at tO defined by the first characteristic point as described in figure 1A.

Figure 1C shows a motion signal which contributed to defining the lower limit 103 of the envelope E of figure 15 1A, said motion signal having its own anchor point at tO, in this case around sample no. 715. Again, for reasons of clarity only one motion signal is shown, though in general multiple motion signals will contribute to defining the upper- and lower limits. As sampling of the relevant section 20 106' of this motion signal started later, than of the signal in figure IB, i.e. about at sample 350 instead of a about sample 250, the signal, though similar, is shifted to the right with regard to the signal of figure IB. However, because the characteristic points for both motion signals 25 are the same, these characteristic points can be centered at a common first anchor point as shown in figure 1A. Once this common anchor point is known, it is also possible to define a time axis for the motion signals and for the envelope, said time axis being calculated from the sampling frequency 30 and number of samples and having its origin at common anchor point tO.

Figure 2A shows three envelopes El, E2, E3 with three corresponding further motion signals SI, S2, S3 forming a further motion measurement. The three further 35 motion signals SI, S2, S3 are synchronized and were obtained while the envelopes El, E2, E3 were already available. The samples of the further motion signals are derived from 16 signals from separate sensors, in this case from three orthogonally arranged linear accelerometers. The further motion signals comprised in the further motion measurement range over the same period of time and have been sampled 5 using the same number of samples. The horizontal axis has been converted to a time-axis having its origin at first anchor point tO. It can be seen that the relevant section of a motion or envelope starts about 1 second before the anchor point, i.e. before the time of impact of the golf club with 10 a ball. The entire motion measurement comprising the three motion signals has been centered at common anchor point tO which is derived from a motion signal from only one of the sensors, in this case from SI.

Figures 2B and 2C show motion signals S2, S3 from 15 the motion measurement respectively, each with its corresponding envelope section E2, E3, centered at the common anchor point tO. The motion signals S2 and S3 were measured after the envelopes E2, E3 were calculated. Both motion signals S2 and S3 fall within their corresponding 20 envelopes, meaning that the measured motion associated with the motion signals conform to the motion ranges defined earlier.

In figure 3A a schematic diagram is shown of a part of a device according to the present invention, said 25 part comprising motion measurement generating means 301 for obtaining motion measurements and a processing unit 302 for generating an envelope from multiple motion measurements, as is done during the learning phase of the method according to the present invention. Motion measurement generating means 30 301, comprise a motion sensor SO adapted for providing a motion sensor signal 310, in this case at a predetermined sampling rate of 200 Hz. The motion measurement generation means 301 further comprise a first memory MEM1 for storing motion measurements, each motion measurement comprising a 35 motion sensor signal from the motion sensor. Preferably, memory MEM1 has sufficient capacity for storing a plurality of motion measurements 311, each comprising a motion signal 17 ranging over a duration of time equal to the duration of a relevant part of the repeated motion. For instance, if the relevant part of a golf swing typically takes 1.4 seconds, a memory MEM1 having a capacity to store a plurality of motion 5 measurements all having a duration of at least 1.4 seconds would suffice, at least when only one section of the motion measurement is relevant. From said plurality of motion measurements, a multitude of motion measurements may be selected and subsequently used in generating the envelope. 10 Alternatively, memory MEM1 may have sufficient capacity for storing only one motion measurement.

The device further comprises a processing unit 302, comprising first anchor point determination means ANCH adapted for providing a signal 312 representative of a first 15 anchor point detected in a motion measurement 311 stored in the first memory MEM1. The motion measurement 311 and the signal 312 representative of the first anchor point are input to an envelope generator EnvG, which is adapted for centering the motion measurement on a first common anchor 20 point and for generating one or more predetermined sections of an envelope from the centered motion signal. A signal 313 comprising the predetermined sections of the envelope together with the first common anchor point is stored in a second memory MEM2.

25 Figure 3B shows a part of the device adapted for obtaining further motion measurements and comparing said further motion measurements to a predetermined envelope section generated by the part described in figure 3A. A further motion measurement 311 obtained from motion 30 measurement generating means 301 is input to first anchor point determination means ANCH, which is adapted for providing a signal representative of a first anchor point in the further motion measurement 311. The further motion measurement 311 and associated signal representative of its 35 anchor point 313, together with corresponding envelope and common anchor point 313 as stored in MEM2, are then input to comparison unit CMP0. The comparison unit CMP0 is adapted 18 for generating a comparison signal 314 based on a comparison of the further motion signal with an envelope stored in second memory MEM2. Comparison of the signals comprises centering the further motion measurement at the first common 5 anchor point and determining whether the centered motion measurement falls outside one or more predetermined sections of the envelopes or not. Thus the comparison signal is indicative of the extent in which the further motion measurement falls within the envelope. The device is 10 provided with feedback means FBD, adapted for providing an audible, visual or tactile feedback based on the comparison signal. Moreover, the device comprises an update unit UPD which is adapted for keeping track of a consecutive number of comparison signals which indicate that a further motion 15 measurement falls with predetermined sections of the envelope, and causes said consecutive further motion measurements to be stored in the first memory MEM1 (not shown). When a predetermined number of consecutive signals has fallen within the predetermined sections of the 20 envelope, new and/or updated envelope sections are calculated in the manner described above, based on the stored consecutive motion measurements.

Figure 3C shows a schematic diagram of a device for motion capture and analysis according to the invention, 25 comprising measurement generating means 301 arranged for providing motion measurements to processing unit 302 and/or to comparison unit 303, depending on whether the device has been switched to the learning phase or to the comparison phase. The device preferably comprises an integrated 30 package, with the sensors being fixedly arranged relative to one another.

Figure 4A shows part of a further embodiment of a device according to the present invention, said part being adapted for obtaining motion measurements comprising 35 multiple motion signals, and generating envelopes or envelope sections from multiple motion measurements.

Multiple sensors S1,...,S5 are adapted for providing 19 corresponding motion sensor signals 310a,..., 310b, for instance whenever the sensors are moved. In the figure shown, the multiple sensors comprise three orthogonally arranged linear acceleration sensors as well as two angular 5 acceleration sensors. The motion sensor signals are redimensioned by redimensioning unit REDIM, which is adapted for providing a motion measurement having a number of motion signals that is less than or equal to the number of sensor motion signals. Such redimensioning is typically implemented 10 by multiplying the motion sensor signals with a redimensioning matrix, and is useful, for instance, when noise in separate motion sensor signals is likely to cancel out. Moreover, redimensioning or combination of signals may be used to convert motion sensor signals to more useful 15 signals; for instance three signals from three separate linear accelerometers may be converted and/or redimensioned into two signals representing linear acceleration, and one signal representing angular acceleration. The redimensioned motion measurements are stored in first memory MEM1. First 20 anchor point determination unit ANCH is adapted providing a signal 312 representative of an anchor point of a motion measurement stored in first memory MEM1. This signal 312 is input to three different envelope generators Envl,..., Env3, which are adapted for centering motion signals 25 311a,311b,311c comprised in the motion measurements at a first common anchor point and for generating corresponding envelopes or predetermined sections thereof from said motion signals. The phrase "predetermined" is to be taken to mean that the range along the horizontal axis, e.g. the time 30 axis, is predetermined. The upper- and lower limits of an envelope section need not be predetermined. Second memory MEM2 is adapted for storing a common anchor point 315 of the envelopes together with the individual envelopes or sections thereof.

35 Figure 4B shows a part of the device adapted for obtaining motion measurements and comparing said motion measurements to predetermined envelope sections, as 20 generated for instance by processing unit 402. A motion measurement 311 obtained from motion measurement generating means 401 is input to first anchor point determination means ANCH. Said anchor point is preferably determined from a 5 single motion signal of the motion measurement. Analogous to comparison unit CMPO of figure 3B, comparison units CMP1, CMP2, CMP3 are adapted for generating a comparison signal based on a comparison of the centered motion signals with their corresponding one or more envelope sections stored in 10 second memory MEM2. Feedback means FDB are adapted to provide an audible, visual or tactile feedback based on the comparison signal. Update unit UPD keeps track of the consecutive number of comparison signals which indicate that a motion measurement falls with predetermined sections of 15 the envelopes, and stores said consecutive motion measurements in the first memory MEM1 (not shown). When a predetermined number of consecutive signals has fallen within the predetermined envelope sections, new and/or updated envelope sections are calculated in the manner 20 described above, based on the stored consecutive motion measurements .

Figure 5A shows a golf club 500, comprising a handle 501, a shaft 502 and a club head 503. A device 510 for motion capture and analysis according to the present 25 invention is attached to the shaft 502 just below the handle 501. The device 510 comprises three linear accelerometers, said accelerometers being adapted for measuring acceleration in orthogonal directions, and one of the accelerometers being oriented parallel to the shaft. The device comprises a 30 display 511 for indicating the extent to which a further motion of the golf club conforms to earlier calculated and stored envelopes.

Figures 5B to 5C show the device of figure 5A in different clamping positions as it is clamped around a shaft 35 of a golf club. The device may be easily attached to or detached from a golf club, allowing a golf player to use the same club during practice and competition play with and 21 without the device attached respectively. In figure 5B it can be seen that the device is provided with an interface 513, in this case a USB interface. The interface 513 is accessible when the device is not clamped around the shaft 5 of the golf club, and allows connection with a computer for exchange of motion measurement data. Additionally, the interface can be used to upload characteristic points or patterns for determining anchor point to the device. Such characteristic points or patterns are preferably stored in a 10 database which is accessible through the internet. Though a USB interface is shown, it will be appreciated that any interface may be provided anywhere on the device, either wired or wireless.

Figure 5D shows exemplary feedback means 512 of 15 the device. The feedback means comprises 8 LEDs, each LED adapted for indicating whether a further motion measurement was within a corresponding predetermined envelope section. This provides a golf player with information on different parts of his swing.

20 Figure 6 shows an alternative application of the device, in which it is placed on a knee-brace 610. The device comprises three accelerometers SI,S3, S4 for measuring acceleration of the device, and a potentiometer S2 for measuring an angle made at the joint. In this embodiment 25 the position of sensors SI,..., S4 is not completely fixed relative to one another, though the sensor signal of S2 can provide an estimate of the relative positions of the sensors. The signals from the sensors are input to logic section 620, where the signals are processed in accordance 30 to the present invention. Using such a brace, a physiotherapist can demonstrate a correct movement a couple of times to a patient. When at home the patient may practice and be provided with audible feedback through a miniature speaker in the device (not shown). Additionally, the device 35 may be provided with an interface to a computer, allowing further motion measurements to be transmitted to the physiotherapist for analysis, and allowing updated envelopes 22 or sections thereof to be transmitted back to the knee-brace after said analysis.

Figure 7A shows a flow chart describing an embodiment of the method according to the invention. The 5 learning phase of the method starts at 710, after which a motion is performed with an object in step 711. A motion measurement is obtained in step 712, said motion measurement comprising N motion signals over time based on signals from motion sensors attached to the object. A first anchor point 10 is determined in step 713, after which the motion measurement is centered at a first common anchor point. When previous motion measurements have been obtained the first common anchor point will already be known. In case no motion measurements had been obtained earlier during the learning 15 phase, the first anchor point of the motion signal is defined as the first common anchor point.

Steps 711 through 714 are repeated to obtain multiple motion measurement. Finally, in step 715 one or more predetermined sections of envelopes defining ranges for the corresponding 20 N motion signals are calculated from the multiple motion measurement.

In figure 7B the comparison phase of an embodiment of the method according to the invention is shown. After starting 720 the comparison phase, a further motion 25 measurement is obtained 721, and its first anchor point representative of a characteristic point or pattern of the further motion measurement is determined in step 722. In step 723 the first anchor point of the further motion measurement is centered at the first common anchor point.

30 Finally, a comparison signal is generated in step 724, indicating whether the further motion measurement falls outside one or more predetermined sections of the N envelopes or not.

In summary, the present invention relates to a 35 device and method for motion capture and analysis of motion of an object, in which an adaptive envelope derived from multiple motion measurements is used for determining the 23 extent to which a further motion measurement conforms to an envelope or section thereof derived from the earlier multiple motion measurements. The invention further provides a method for adaptively converging the envelope towards a 5 non-predetermined envelope in dependence on a number of consecutive motion measurements made with the object, thus allowing subjective or tailor made improvement and/or monitoring of further motions.

It is to be understood that the above description 10 is included to illustrate the operation of the preferred embodiments and is not meant to limit the scope of the invention. From the above discussion, many variations will be apparent to one skilled in the art that would yet be encompassed by the spirit and scope of the present 15 invention.

Claims

A method for recording and analyzing a repeated movement of an object, comprising a learning phase comprising the steps of: repeatedly performing a movement with the object, obtaining a plurality of corresponding movement measurements, wherein each movement measurement comprises N movement signals over time based on signals from motion sensors attached to the object, determining, for each of the plurality of motion measurements, a first anchor point representative of a first characteristic point in the corresponding motion measurement, centering the respective first anchor points of the plurality of motion measurements at a first common anchor point, calculating, from the plurality of centered motion measurements, one or more predetermined sections 20 of N envelopes defining ranges for the corresponding N motion signals.

The method of claim 1, further comprising a comparison phase comprising the steps of: obtaining a further motion measurement over time, the further motion measurement N comprising further motion signals over time, determining, for the further motion measurement, the first anchor point that is representative of the first characteristic point in the corresponding further motion measurement, centering the first anchor point of the further motion measurement on the first common anchor point, generating a comparison signal indicating whether the further motion measurement is outside one of the one or more predetermined sections of the N envelope falls or not.

The method of claim 2, wherein the comparison phase comprises the additional steps of: counting a number C of consecutive of 10 such further motion measurements for which predetermined N motion signals fall within one or more predetermined sections of their corresponding envelope, and storing these motion measurements, updating one or more of the one or more sections of N envelope based on the stored motion measurements when the number C exceeds a predetermined value.

A method according to claim 2 or claim 3, comprising the further step of, during the learning phase: 2. determining, for each of the plurality of motion measurements, a second anchor point representative of a further characteristic point in the corresponding motion measurement different from the first characteristic point, normalizing the multiple movement measurements with respect to time, such that a common distance between the first anchor point and the second anchor point is substantially the same for all movement measurements, the method further comprising the steps of, during the comparison phase: determining, for the further motion measurement, a second anchor point representative of the second characteristic point in the further motion measurement, normalizing the further motion measurement 35 with respect to time, such that a distance between its first anchor point and second anchor point is substantially equal at the common distance.

A method according to any one of the preceding claims, wherein the one or more predetermined sections of the one or more sheaths are defined relative to the first common anchor point.

A method according to any one of the preceding claims, wherein each of the one or more sections of the N envelope is a section of an envelope of superimposed multiple motion signals of the multiple motion measurements.

The method of any one of the preceding claims, wherein the N motion signals are based on one or more motion sensor signals.

8. Method according to claim 7, wherein the method further comprises a step of calibrating the one or more motion sensors at the start of the learning phase.

9. A method according to claim 7 or claim 8, wherein the number of motion sensor signals is greater than N, and wherein the method comprises a step of re-dimensioning the motion sensor signals to N motion signals.

10. Method as claimed in any of the foregoing claims, wherein, in order to determine a first or second anchor point of a motion measurement, only a motion signal of the N motion signals in a motion measurement is used.

The method of claim 10, wherein a section of an envelope is defined by an average line and a function that defines a variation along that line over time, and updating the section 30 of an envelope includes updating the function .

A method according to any one of the preceding claims, wherein centering the first anchor points comprises aligning the first anchor points in time.

13. Device for recording and analyzing repeated movement of an object to which the device is attached, the device comprising: motion measurement generation means adapted to generate motion measurements representative of a motion of the object, each motion measurement N synchronized motion signals includes over time, first anchor point determining means, adapted to determine a first anchor point in the motion measurement, a first memory for storing motion measurements, an envelope generator adapted to center multiple motion measurements on a first common anchor point and generating one or more predetermined sections of N envelope from a plurality of stored motion measurements and their associated first anchor points, a second memory for storing the one or more predetermined sections of the N envelope and the first common anchor point, a comparison unit d, arranged for generating a comparison signal dependent on a comparison of stored predetermined sections of the N 20 envelope with corresponding predetermined sections of corresponding motion signals of a further motion measurement, the comparison comprising centering the further motion measurement at the first common anchor point that is stored in the second memory and subsequently determining whether the motion measurement falls outside one or more stored predetermined sections of the envelope.

14. Device as claimed in claim 13, further comprising an updating unit adapted to update the predetermined sections of the envelopes on the basis of motion measurements stored in the first memory means and information about their associated first anchor points, and on the basis of or a predetermined number of successive comparison signals has indicated that a corresponding number of successive motion measurements fell either within or outside of the predetermined sections of the envelope.

The device of claim 14 or 15, further comprising one or more motion sensors for providing motion sensor signals on which the motion measurements are based.

The device of claim 15, further comprising a calibration unit for calibrating the motion sensor signals.

17. Device as claimed in any of the claims 1-15 or 16, wherein a device is an integrated device and the one or more motion sensors have a fixed position with respect to each other and the integrated device.

Device as claimed in any of the claims 13-17, wherein the device is adapted to be mounted on a golf club.

Device according to any of claims 13-18, further comprising feedback means for providing audible, visual, and / or tactile feedback of the comparison signal. -o-o-o-o-o-o-o-