[go: up one dir, main page]

TWI844438B - An intervention method for promoting cardiorespiratory fitness training and its system thereof - Google Patents

An intervention method for promoting cardiorespiratory fitness training and its system thereof Download PDF

Info

Publication number
TWI844438B
TWI844438B TW112128661A TW112128661A TWI844438B TW I844438 B TWI844438 B TW I844438B TW 112128661 A TW112128661 A TW 112128661A TW 112128661 A TW112128661 A TW 112128661A TW I844438 B TWI844438 B TW I844438B
Authority
TW
Taiwan
Prior art keywords
joint angle
angle values
image
preset
intervention
Prior art date
Application number
TW112128661A
Other languages
Chinese (zh)
Other versions
TW202506238A (en
Inventor
黃婉筠
成戎珠
杜翌群
Original Assignee
高雄榮民總醫院
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 高雄榮民總醫院 filed Critical 高雄榮民總醫院
Priority to TW112128661A priority Critical patent/TWI844438B/en
Application granted granted Critical
Publication of TWI844438B publication Critical patent/TWI844438B/en
Publication of TW202506238A publication Critical patent/TW202506238A/en

Links

Landscapes

  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

The invention provides an intervention method for promoting cardiorespiratory fitness training and its system thereof. The method involves the following steps: Inputting a cardiorespiratory fitness instructional video and the corresponding actual exercise video separately. Analyzing the cardiorespiratory fitness instructional video to generate default skeletal tracking results, obtaining multiple default joint angle values, and corresponding default weight scores. Analyzing the actual exercise video to generate skeletal tracking results and obtaining multiple joint angle values. Finally, computing the joint angle values from the actual exercise video, the default joint angle values, and the default weight scores to produce and display assessment information and corresponding intervention information. This system executes the method and designs appropriate intervention information for different users to enhance training effectiveness.

Description

應用於促進心肺適能訓練的介入方法及系統Intervention methods and systems for improving cardiorespiratory fitness training

本發明是有關訓練輔助方法,特別是指一種應用於促進心肺適能訓練的介入方法及系統。The present invention relates to a training assistance method, and more particularly to an intervention method and system for promoting cardiopulmonary fitness training.

衰弱的診斷可作為評估一個人是否面臨功能衰退、失去自主能力的臨床表現,如果對於社區居住年長者衰弱之前而給予適當的介入,就有機會預防失能,進而維護老人的健康,達到成功老化的目的,為此,有目的、計畫性、重複性的運動訓練也一直如此被認為是健康生活方式的必要條件,用於改進和維護身體和功能能力有正面的效果,同時,亦可提升認知狀態,一般而言,年長者在社區進行運動時,隨著不同的社區環境,受限於空間不確定因素太多,因此無法確保行走或運動時的安全性。The diagnosis of frailty can be used as a clinical manifestation to assess whether a person is facing functional decline and loss of autonomy. If appropriate intervention is given to elderly people living in the community before they become frail, there is a chance to prevent disability, thereby maintaining the health of the elderly and achieving the goal of successful aging. For this reason, purposeful, planned, and repetitive exercise training has always been considered a necessary condition for a healthy lifestyle. It has a positive effect on improving and maintaining physical and functional abilities, and at the same time, it can also improve cognitive status. Generally speaking, when the elderly exercise in the community, they are limited by too many spatial uncertainties in different community environments, so they cannot ensure the safety of walking or exercising.

中華民國發明專利證書號I220387揭示一種具體能教練輔助功能之虛擬實境健身設備,其以有氧運動的方式在適合個人體能的狀況下讓身體的大肌肉群持續做長時間有節奏的運動,可安全而有效地操作健身設備達到運動健身的目的,避免過度疲勞,達到強化心肺循環機能之目的,但此一設備無法針對不同的動作給予不同的加權,而可能忽略主要欲訓練的特定部位,使得訓練效果可能大幅下降。The Republic of China's invention patent certificate No. I220387 discloses a virtual reality fitness equipment with a specific physical coaching auxiliary function. It allows the body's large muscle groups to continuously exercise for a long time in a rhythmic manner in an aerobic exercise manner under conditions suitable for individual physical fitness. The fitness equipment can be safely and effectively operated to achieve the purpose of exercise and fitness, avoid excessive fatigue, and achieve the purpose of strengthening the cardiopulmonary circulation function. However, this equipment cannot give different weights to different movements, and may ignore the specific parts that are mainly intended to be trained, so that the training effect may be greatly reduced.

故,本發明提出一種應用於促進心肺適能訓練的介入方法及系統,其係基於神經科學原理與身體感知相關的原則,針對年長者設計其介入方法,使年長者經由本系統可以將欲練習的影音導入系統分析後,對應分析出每一個動作著重的部位,並根據重要性給予不同的權重值,使得使用者能夠更了解每一個動作著重的部位為何,進而加強訓練其特定部位,並且可以根據個人需求隨之增減或調整其訓練方案,提高訓練效果。Therefore, the present invention proposes an intervention method and system for promoting cardiopulmonary fitness training. The intervention method is designed for the elderly based on the principles of neuroscience and body perception. The elderly can use the system to import the video and audio they want to practice into the system for analysis. The system then analyzes the focus of each movement and gives different weights according to their importance. This allows users to better understand the focus of each movement and strengthen the training of their specific parts. In addition, the elderly can increase, decrease or adjust their training plans according to their personal needs to improve the training effect.

本發明之主要目的,係提供一種應用於促進心肺適能訓練的介入方法,根據不同的心肺適能教學影像所著重的關節點角度值運算出不同的預設權重分數,以對應給予適當的介入資訊,提升訓練輔助的精確程度。The main purpose of the present invention is to provide an intervention method for promoting cardiopulmonary fitness training. Different preset weight scores are calculated according to the angle values of the joints emphasized by different cardiopulmonary fitness teaching images, so as to provide appropriate intervention information accordingly and improve the accuracy of training assistance.

本發明之另一目的,係提供一種應用於促進心肺適能訓練的介入系統,以前述之介入方法,並以影像辨識模組將心肺適能教學影像及實際運動影像進行辨識,並由分析模組進行分析,以取得兩者對應的關節點角度值,並以評鑑模組針對不同動作給予不同權重分數,輸出對應的評分資訊,最後透過引導模組輸出介入資訊,讓使用者能夠更加身歷其境,同時,更能掌握具體的姿態正確程度。Another object of the present invention is to provide an intervention system for promoting cardiopulmonary fitness training. The aforementioned intervention method is used to identify cardiopulmonary fitness teaching images and actual sports images by an image recognition module, and the analysis module is used to analyze them to obtain the corresponding joint angle values of the two. The evaluation module gives different weight scores to different movements and outputs corresponding scoring information. Finally, the guidance module outputs the intervention information, so that the user can be more immersed in the situation and at the same time, better grasp the specific degree of posture correctness.

為了達到上述之目的,本發明之一實施例係揭示一種應用於促進心肺適能訓練的介入方法,步驟包含: 輸入一心肺適能教學影像;分析該心肺適能教學影像,產生一預設骨骼追蹤結果;運算該預設骨骼追蹤結果,取得對應之複數個預設關節點角度值;運算該些個預設關節點角度值,取得對應之一預設權重分數;輸入該心肺適能教學影像對應之一實際運動影像;分析該實際運動影像,產生一骨骼追蹤結果;運算該骨骼追蹤結果,取得對應之複數個關節點角度值;運算該些個關節點角度值、該些個預設關節點角度值與該預設權重分數,產生並顯示一評分資訊;及以該評分資訊產生並顯示一介入資訊。In order to achieve the above-mentioned purpose, one embodiment of the present invention discloses an intervention method for promoting cardiopulmonary fitness training, the steps comprising: Input a cardiopulmonary fitness teaching image; analyze the cardiopulmonary fitness teaching image to generate a default bone tracking result; calculate the default bone tracking result to obtain a corresponding plurality of default joint angle values; calculate the default joint angle values to obtain a corresponding default weight score; input an actual exercise image corresponding to the cardiopulmonary fitness teaching image; analyze the actual exercise image to generate a bone tracking result; calculate the bone tracking result to obtain a corresponding plurality of joint angle values; calculate the joint angle values, the default joint angle values and the default weight score to generate and display scoring information; and generate and display intervention information using the scoring information.

於較佳實施例中,該實際運動影像選自動態影像或靜態影像。In a preferred embodiment, the actual motion image is selected from dynamic images or static images.

於較佳實施例中,於運算該些個預設關節點角度值,取得對應之一預設權重分數之步驟中,該些個預設關節點角度值包含一第一時間之一預設動作資訊之該些個預設關節點角度值及一第二時間之該預設動作資訊之該些個預設關節點角度值,比對該第一時間之該些個預設關節角度值與該第二時間之該些個預設關節點角度值,取得對應之該預設權重分數。In a preferred embodiment, in the step of calculating the default joint angle values and obtaining a corresponding default weight score, the default joint angle values include the default joint angle values of a default action information at a first time and the default joint angle values of the default action information at a second time. The default joint angle values at the first time are compared with the default joint angle values at the second time to obtain the corresponding default weight score.

於較佳實施例中,於運算該些個關節點角度值、該些個預設關節點角度值與該預設權重分數,產生並顯示一評分資訊之步驟中,比對每一該預設動作資訊對應之該些個關節點角度值與該些個預設關節點角度,取得對應之一相符程度,運算該相符程度與對應之該預設權重分數,產生該評分資訊。In a preferred embodiment, in the step of calculating the joint angle values, the default joint angle values and the default weight scores to generate and display a scoring information, the joint angle values corresponding to each of the default action information are compared with the default joint angles to obtain a corresponding degree of matching, and the degree of matching and the corresponding default weight score are calculated to generate the scoring information.

於較佳實施例中,其中,該介入資訊為文字、語音、影像、影音或上述之組合。In a preferred embodiment, the intervening information is text, voice, image, audio and video, or a combination thereof.

為了達到上述之另一目的,本發明之一實施例係揭示一種應用於促進心肺適能訓練的介入系統,包含: 一輸入單元,輸入一心肺適能教學影像及對應之一實際運動影像;一影像辨識模組,與該輸入單元訊號連接,用以辨識該心肺適能教學影像及該實際運動影像,以取得對應該心肺適能教學影像之一預設骨骼追蹤結果,及對應該實際運動影像之一骨骼追蹤結果;一分析模組,與該影像辨識模組訊號連接,用以分析該預設骨骼追蹤結果及該骨骼追蹤結果,以取得對應該預設骨骼追蹤結果之複數個預設關節點角度值,及對應該骨骼追蹤結果之複數個關節點角度值;一評鑑模組,與該分析模組訊號連接,根據該些個預設關節點角度值運算,取得一預設權重分數,並該些個關節點角度值、該些個預設關節點角度值與該預設權重分數,產生並顯示一評分資訊;及一引導模組,與該評鑑模組訊號連接,用以根據該評分資訊產生並顯示一介入資訊。In order to achieve the above-mentioned another purpose, an embodiment of the present invention discloses an intervention system for promoting cardiopulmonary fitness training, comprising: an input unit, which inputs a cardiopulmonary fitness teaching image and a corresponding actual sports image; an image recognition module, which is connected to the input unit signal, and is used to recognize the cardiopulmonary fitness teaching image and the actual sports image to obtain a preset bone tracking result corresponding to the cardiopulmonary fitness teaching image, and a bone tracking result corresponding to the actual sports image; an analysis module, which is connected to the image recognition module signal, and is used to analyze the preset bone tracking result and the bone tracking result to obtain the preset bone tracking result. A plurality of preset joint angle values of the bone tracking results, and a plurality of joint angle values corresponding to the bone tracking results; an evaluation module, connected to the analysis module signal, for calculating according to the preset joint angle values to obtain a preset weight score, and generating and displaying scoring information based on the joint angle values, the preset joint angle values and the preset weight score; and a guidance module, connected to the evaluation module signal, for generating and displaying intervention information according to the scoring information.

於較佳實施例中,該實際運動影像選自動態影像或靜態影像。In a preferred embodiment, the actual motion image is selected from dynamic images or static images.

於較佳實施例中,包含一深度攝影模組,與該輸入單元訊號連接,擷取一人體之該實際運動影像。In a preferred embodiment, a depth photography module is included, which is connected to the input unit signal to capture the actual motion image of a human body.

於較佳實施例中,包含一三維影像顯示器,與該輸入單元及該引導模組訊號連接,用以顯示該心肺適能教學影像及該介入資訊。In a preferred embodiment, a three-dimensional image display is included, which is connected to the input unit and the guidance module signal to display the cardiopulmonary fitness teaching image and the intervention information.

於較佳實施例中,該介入資訊為文字、語音、影像、影音或上述之組合。In a preferred embodiment, the intervention information is text, voice, image, audio and video, or a combination thereof.

本發明之有益功效在於可以隨機根據欲進行學習的心肺適能教學影像進一步運算取得對應之權重分數,再根據使用者實際運動影像與權重分數運算,以根據不同動作所側重的部位進行加權,提供精準的介入資訊,以達到最佳的訓練效果。The beneficial effect of the present invention is that it can further calculate the corresponding weight score according to the cardiopulmonary fitness teaching image to be learned at random, and then calculate according to the user's actual sports image and weight score to weight the parts emphasized by different movements, providing accurate intervention information to achieve the best training effect.

有關本發明之相關申請專利特色與技術內容,在以下配合參考圖式之較佳實施例的詳細說明中,將可清楚的呈現。The related patent application features and technical contents of the present invention will be clearly presented in the following detailed description of the preferred embodiments with reference to the drawings.

請參閱第一圖、第二A圖及第二B圖,其為本發明之一實施例及另一實施例之方法流程圖。如圖所示,本方法包含下列步驟。Please refer to the first figure, the second figure A and the second figure B, which are the method flow charts of one embodiment and another embodiment of the present invention. As shown in the figure, the method includes the following steps.

步驟S1: 輸入一心肺適能教學影像;Step S1: input a cardiopulmonary fitness teaching image;

步驟S2: 分析該心肺適能教學影像,產生一預設骨骼追蹤結果;Step S2: analyzing the cardiopulmonary fitness teaching image to generate a preset bone tracking result;

步驟S3: 運算該預設骨骼追蹤結果,取得對應之複數個預設關節點角度值;Step S3: Calculate the default skeleton tracking result to obtain a plurality of corresponding default joint angle values;

步驟S4: 運算該些個預設關節點角度值,取得對應之一預設權重分數;Step S4: Calculate the preset joint angle values to obtain a corresponding preset weight score;

步驟S5: 輸入該心肺適能教學影像對應之一實際運動影像;Step S5: inputting an actual exercise image corresponding to the cardiopulmonary fitness teaching image;

步驟S6: 分析該實際運動影像,產生一骨骼追蹤結果;Step S6: analyzing the actual motion image to generate a bone tracking result;

步驟S7: 運算該骨骼追蹤結果,取得對應之複數個關節點角度值;Step S7: Calculate the skeleton tracking result to obtain the corresponding multiple joint angle values;

步驟S8: 運算該些個關節點角度值、該些個預設關節點角度值與該預設權重分數,產生並顯示一評分資訊;及Step S8: Calculate the joint angle values, the preset joint angle values and the preset weight score to generate and display a rating information; and

步驟S9: 以該評分資訊產生並顯示一介入資訊。Step S9: Generate and display intervention information based on the rating information.

於一實施例中,前述步驟S1-S9也可以是接續的流程,於另一實施例中,步驟S1-S4可以是獨立的流程,如第二A圖,且,步驟S5-S9也可以是獨立的流程,如第二B圖。In one embodiment, the aforementioned steps S1-S9 may also be a continuous process. In another embodiment, steps S1-S4 may be an independent process, such as the second FIG. A, and steps S5-S9 may also be an independent process, such as the second FIG. B.

並請一同參閱第三圖,為本發明之一實施例之系統示意圖。如圖所示,應用於促進心肺適能訓練的介入系統,包含:輸入單元1、影像辨識模組2、分析模組3、評鑑模組4、引導模組5、深度攝影模組6及三維影像顯示器7,其中,輸入單元1係分別與影像辨識模組2、深度攝影模組6及三維影像顯示器7訊號連接;分析模組3係分別與影像辨識模組2與評鑑模組4訊號連接;及評鑑模組4係與引導模組5及三維影像顯示器7訊號連接。Please also refer to the third figure, which is a schematic diagram of a system of an embodiment of the present invention. As shown in the figure, the intervention system for promoting cardiopulmonary fitness training includes: an input unit 1, an image recognition module 2, an analysis module 3, an evaluation module 4, a guidance module 5, a depth photography module 6 and a three-dimensional image display 7, wherein the input unit 1 is signal-connected to the image recognition module 2, the depth photography module 6 and the three-dimensional image display 7 respectively; the analysis module 3 is signal-connected to the image recognition module 2 and the evaluation module 4 respectively; and the evaluation module 4 is signal-connected to the guidance module 5 and the three-dimensional image display 7.

輸入單元1係用以輸入心肺適能教學影像,其中,心肺適能教學影像係針對年長者所設計的運動項目所對應的示範影像,此教學影像來源可以是由專業人員教學所拍攝的影像,也可以例如是YouTube上任何的教學影像,只要是有助於訓練的教學影像皆可,例如:肌力訓練、心肺訓練、平衡訓練及柔軟度訓練,並根據個人生理情形給予之訓練內容,於一實施例中,輸入單元1更包含設定單元,可以根據年齡、健康程度與運動習慣等生理情形,其中,健康程度例如是否有高血壓、高血脂、高血糖、代謝症候群或退化性關節炎等情形,運動習慣則為使用者是否原有運動習慣,以及每周幾次等,以設定更符合個人的運動處方,更進一步可以根據適合的心率目標,調整對應的訓練強度,例如: 使用者可能患有退化性關節炎,不宜有過大幅度的腳部動作,則可能產生第二次的權重分數,以根據實際使用者情形逐步進行分數校正,以此,讓使用者能夠更有信心對應完成動作。Input unit 1 is used to input cardiopulmonary fitness teaching images, wherein the cardiopulmonary fitness teaching images are demonstration images corresponding to sports items designed for the elderly. The source of the teaching images can be images shot by professional teachers, or any teaching images on YouTube, as long as they are helpful for training, such as: muscle strength training, cardiopulmonary training, balance training and flexibility training, and training given according to individual physiological conditions In one embodiment, the input unit 1 further includes a setting unit, which can be based on physiological conditions such as age, health level and exercise habits, wherein the health level is such as whether the user has high blood pressure, high blood lipids, high blood sugar, metabolic syndrome or degenerative arthritis, and the exercise habit is whether the user has an original exercise habit and how many times a week, so as to set a more personal exercise prescription. Furthermore, the corresponding training intensity can be adjusted according to the appropriate heart rate target. For example: the user may suffer from degenerative arthritis and should not have large-scale leg movements, then a second weight score may be generated to gradually correct the score according to the actual user situation, so that the user can be more confident in completing the corresponding action.

影像辨識模組2係接收心肺適能教學影像及對應之實際運動影像,並分別分析出每一個動作對應之預設骨骼資訊及骨骼資訊,以分別產生對應之預設骨骼追蹤結果及骨骼追蹤結果,其中,實際運動影像可以是動態影像或靜態影像,但不在此限。The image recognition module 2 receives the cardiopulmonary fitness teaching images and the corresponding actual sports images, and analyzes the preset bone information and bone information corresponding to each action to generate the corresponding preset bone tracking results and bone tracking results, respectively. The actual sports images can be dynamic images or static images, but are not limited to this.

於一實施例中,影像辨識模組2採用的人體姿態辨識方式可選自OpenPose Model、AlphaPose、Single-Stage Multi-Person Pose Machines(SPM)或Regional Multi-Person Pose Estimation(RMPE)等任一方式,其中,人體姿態辨識也可以分成Top-down與Bottom-up兩種方式,Top-down係先辨識出影像中的人體,再針對人體中的關鍵點進行辨識,相反的,Bottom-up則是先將影像中每個關鍵點都找出來,再根據關鍵點之間的關係,將離散的關鍵點組成人體肢段,本發明之實施例所採用之人體姿態辨識並不在此限,只要可以辨識出人體姿態即可。In one embodiment, the human posture recognition method adopted by the image recognition module 2 can be selected from any method such as OpenPose Model, AlphaPose, Single-Stage Multi-Person Pose Machines (SPM) or Regional Multi-Person Pose Estimation (RMPE), among which human posture recognition can also be divided into two methods: Top-down and Bottom-up. Top-down is to first identify the human body in the image, and then identify the key points in the human body. On the contrary, Bottom-up is to first find each key point in the image, and then combine the discrete key points into human limbs according to the relationship between the key points. The human posture recognition adopted by the embodiment of the present invention is not limited to this, as long as the human posture can be recognized.

並由影像辨識模組2將取得之使用者骨骼追蹤結果加以分析,以產生對應的多個關節點角度值,並以心肺適能教學影像中的教學人員之預設骨骼追蹤結果分析後的多個預設關節點角度值即時比對,當兩者不完全相符時,則根據動作大小衡量每項動作之預設權重分數,依序計算給分,以評鑑此次運動效果。The image recognition module 2 analyzes the obtained bone tracking results of the user to generate corresponding multiple joint angle values, and compares them in real time with the multiple preset joint angle values analyzed by the instructor's preset bone tracking results in the cardiopulmonary fitness teaching image. When the two are not completely consistent, the preset weight score of each action is measured according to the size of the action, and the scores are calculated in sequence to evaluate the effect of this exercise.

分析模組3則根據心肺適能教學影像之預設骨骼追蹤結果取得對應之複數個預設關節點角度值,以及實際運動影像之骨骼追蹤結果取得對應之複數個關節點角度值。The analysis module 3 obtains a plurality of corresponding preset joint angle values according to the preset bone tracking results of the cardiopulmonary fitness teaching image, and obtains a plurality of corresponding joint angle values according to the bone tracking results of the actual sports image.

於一實施例中,請參閱第四圖,其為本發明之一實施例之動作前後示意圖。如圖所示,骨骼追蹤結果包含各個關節點,例如: 鼻部J0、頸部J1、左肩部J2、右肩部J3、左肘部J4、右肘部J5、左腕部J6、右腕部J7、左手部J8、右手部J9、左髖部J10、右髖部J11、中央髖部J12、椎部J13、左膝部J14、右膝部J15、左踝部J16、右踝部J17、左腳部J18、右腳部J19,但不在此限。In one embodiment, please refer to the fourth figure, which is a schematic diagram of the action before and after of one embodiment of the present invention. As shown in the figure, the skeleton tracking result includes various joints, such as: nose J0, neck J1, left shoulder J2, right shoulder J3, left elbow J4, right elbow J5, left wrist J6, right wrist J7, left hand J8, right hand J9, left hip J10, right hip J11, central hip J12, vertebra J13, left knee J14, right knee J15, left ankle J16, right ankle J17, left foot J18, right foot J19, but not limited thereto.

於一實施例中,請參閱第五圖,其為本發明之一實施例之關節點角度值運算示意圖。如圖所示,關節點角度值例如手肘角度值θ,其計算方式係以肩膀座標值S至手肘座標值E的第一向量 ,以及以手肘座標值E至手腕座標值W的第二向量 ,並根據向量空間中的餘弦定理公式可以得到下列算式: In one embodiment, please refer to FIG. 5, which is a schematic diagram of the calculation of joint angle values of one embodiment of the present invention. As shown in the figure, the joint angle value, such as the elbow angle value θ, is calculated by using the first vector from the shoulder coordinate value S to the elbow coordinate value E , and a second vector from the elbow coordinate value E to the wrist coordinate value W , and according to the cosine theorem formula in vector space, the following formula can be obtained:

以此,即可以算出每一個動作下,對應的每一個關節點角度值,以供後續判斷。In this way, the angle value of each joint point corresponding to each action can be calculated for subsequent judgment.

評鑑模組4係用以根據該些個預設關節點角度值運算出預設權重分數,並以該些個關節點角度值、該些個預設關節點角度值及對應之預設權重分數進行運算,而產生評分資訊,以此,可以根據動作大小衡量每項動作分數權重,作為不同預設權重分數的關節點可以是肩關節、肘關節、腕關節、髖關節、膝關節及踝關節,如第三圖,左側動作與右側動作相比可知,肩關節角度變化最大,故此處的預設權重分數相對較高,舉例而言,可以在每100毫秒的速度紀錄前述之關節點角度值,並於前次數值比較後,將關節點角度值變化量作為加權依據,若變化越高則加權越重,反之亦然,以此,可以讓使用者學習到如何更精確掌握動作的重點,但不在此限。The evaluation module 4 is used to calculate the preset weight scores according to the preset joint angle values, and to generate scoring information by calculating the joint angle values, the preset joint angle values and the corresponding preset weight scores. In this way, the weight of each action score can be measured according to the size of the action. The joints with different preset weight scores can be the shoulder joint, elbow joint, wrist joint, hip joint, knee joint and ankle joint. As shown in the figure, the shoulder joint angle changes the most when the left side movement is compared with the right side movement, so the default weight score here is relatively high. For example, the aforementioned joint angle value can be recorded at a speed of every 100 milliseconds, and after comparing the previous values, the change in the joint angle value is used as the weighting basis. If the change is higher, the weighting is heavier, and vice versa. In this way, users can learn how to grasp the key points of the movement more accurately, but not limited to this.

於一實施例中,評鑑模組4可以將每一個預設動作資訊之該些個預設關節點角度值與對應作出的該些個關節點角度值進行比對,當兩者完全符合時,則可以直接產生評分資訊,例如:顯示100分或顯示完全符合,相反的,當兩者不完全符合時,則可以如前述所載,根據該些個關節點角度值與對應之預設權重分數進行運算,而產生評分資訊,但不在此限。In one embodiment, the evaluation module 4 can compare the preset joint angle values of each preset action information with the corresponding joint angle values. When the two are completely consistent, the scoring information can be directly generated, for example: displaying 100 points or displaying complete compliance. On the contrary, when the two are not completely consistent, the scoring information can be generated as described above by performing calculations based on the joint angle values and the corresponding preset weight scores, but is not limited to this.

較佳的,引導模組5可以根據評分資訊產生對應之介入資訊,介入資訊可以是文字、語音、影像、影音或上述的組合,例如:於顯示的骨骼追蹤結果上,當膝蓋部位未抬至指定位置時,則於膝蓋位置上顯示往上的箭頭,並以動態影像及語音方式提醒使用者調整動作,但不在此限。Preferably, the guidance module 5 can generate corresponding intervention information based on the scoring information. The intervention information can be text, voice, image, audio or video, or a combination of the above. For example, in the displayed bone tracking results, when the knee is not lifted to the specified position, an upward arrow is displayed at the knee position, and the user is reminded to adjust the movement by dynamic images and voice, but not limited to this.

深度攝影模組6係偵測人體之姿態影像,即當使用者根據其所適合的心肺適能教學影像對應執行相同的動作後,可以是由深度攝影模組6偵測此時的姿態影像,較佳的,心肺適能教學影像也可以是經由深度攝影模組6攝影取得,於一實施例中,深度攝影模組6包含至少一台深度攝影機,且,深度攝影模組6可以採用Kinect之體感設備,並可以根據需求設置深度攝影機之數量,但不在此限。The depth camera module 6 detects the posture image of the human body, that is, when the user performs the same action according to the cardiopulmonary fitness teaching image that is suitable for him, the posture image at this time can be detected by the depth camera module 6. Preferably, the cardiopulmonary fitness teaching image can also be obtained by photographing the depth camera module 6. In one embodiment, the depth camera module 6 includes at least one depth camera, and the depth camera module 6 can adopt the Kinect somatosensory device, and the number of depth cameras can be set according to needs, but it is not limited to this.

三維影像顯示器7係用於顯示各項資訊,例如心肺適能教學影像及介入資訊,也可以顯示評分資訊等,其中,三維影像顯示器7包含螢幕裝置、頭戴顯示裝置、投影裝置或上述之組合,於一實施例中,為更真實呈現各項資訊,可採用下列3D技術作為呈現,例如: 擴增實境(Augmented Reality, AR)、虛擬實境(Virtual Reality, VR)、混合實境(Mixed Reality, MR)或延展實境(X-Reality, XR),如此一來,可提供使用者最佳的視覺化的訓練輔助系統,但不在此限。The three-dimensional image display 7 is used to display various information, such as cardiopulmonary fitness teaching images and intervention information, and can also display scoring information, etc., wherein the three-dimensional image display 7 includes a screen device, a head-mounted display device, a projection device or a combination of the above. In one embodiment, in order to present various information more realistically, the following 3D technologies can be used for presentation, such as: augmented reality (AR), virtual reality (VR), mixed reality (MR) or extended reality (X-Reality, XR). In this way, the user can be provided with the best visual training assistance system, but not limited to this.

隨著科技的進步,目前虛擬實境也開始廣泛的應用於醫療相關領域,同時,使用虛擬實境對於年長者的益處,有許多實證研究指出其具有相當正面的效益,並說明如下:With the advancement of technology, virtual reality has also begun to be widely used in medical fields. At the same time, there are many empirical studies showing the benefits of using virtual reality for the elderly, which are as follows:

首先,虛擬實境應用於老年人的認知方面的研究中,學者隨機分配65-85歲的年長者分別是以虛擬實境的方式進行練習的組別,以及僅實施一般身體運動的組別,兩組皆分別接受八週的訓練,並採用蒙特利爾認知評估認知能力,研究結果顯示採用虛擬實境練習的組別相較於實施一般身體運動的組別明顯改善認知能力及身體能力,即藉由虛擬實境環境刺激,以輸入活化神經網絡機制的操作,明顯增強海馬迴(hippocampal)與內嗅皮質(entorhinal cortex)的體積,改善空間認知的表現。First, in the study of the application of virtual reality in the cognition of the elderly, scholars randomly assigned elderly people aged 65-85 to a group that practiced in virtual reality and a group that only performed general physical exercises. Both groups received eight weeks of training and used the Montreal Cognitive Assessment to assess cognitive ability. The results showed that the group that used virtual reality training significantly improved cognitive and physical abilities compared to the group that performed general physical exercises. That is, through the stimulation of the virtual reality environment, the operation of input activation of the neural network mechanism was significantly enhanced, the volume of the hippocampus and entorhinal cortex was significantly increased, and the performance of spatial cognition was improved.

此外,虛擬實境應用於老年人的平衡方面的研究,對於平衡障礙的患者,對於社區居住的平衡不佳的年長者,使用虛擬實境系統訓練課程,一週2次,持續六週後,明顯增加穩定性及壓力中心明顯降低,而可以改善平衡能力,防止老年人跌倒。In addition, virtual reality is used in research on the balance of the elderly. For patients with balance disorders and elderly people with poor balance living in the community, virtual reality system training courses are used twice a week for six weeks. Stability is significantly increased and the center of pressure is significantly reduced, which can improve balance ability and prevent falls in the elderly.

同時,虛擬實境應用於老年人的預防跌倒方面的研究也顯示老年人因平衡能力的退化、動作變慢和協調能力變差而容易跌倒,人體的姿勢控制需要多系統的協調與合作,才能維持良好的動作控制,減少跌倒的次數,因此學者針對易跌倒的女性老年人,比較有無使用影音遊戲的虛擬實境活動,其訓練時間是30分鐘,一週2次,研究結果亦顯示出使用虛擬實境進行訓練的使用者明顯增加走路速度,同時,3公尺計時走的時間降低,也代表著跌倒的風險下降。At the same time, research on the application of virtual reality in preventing falls in the elderly also shows that the elderly are prone to falls due to the deterioration of balance, slower movements and poorer coordination. The human body's posture control requires the coordination and cooperation of multiple systems to maintain good movement control and reduce the number of falls. Therefore, scholars compared virtual reality activities with and without the use of video games for female elderly people who are prone to falls. The training time is 30 minutes, twice a week. The research results also show that users who use virtual reality for training significantly increase their walking speed. At the same time, the time for walking 3 meters is reduced, which also means that the risk of falling is reduced.

最後在虛擬實境應用於衰弱老年人方面的研究中,指出給予年長者互動影音遊戲結合虛擬實境雙重任務,有效改善年長者的活動能力,其可以結合運動與認知,重現日常生活情況,使用者的接受率較高。Finally, in the study on the application of virtual reality to frail elderly people, it was pointed out that giving elderly people interactive video games combined with virtual reality dual tasks can effectively improve their mobility. It can combine movement and cognition to reproduce daily life situations, and the user acceptance rate is high.

因此可以理解的,當年長者身體功能開始退化而導致衰弱的症狀,極易影響各種活動,包含體能與社交,進而也可能影響認知功能,產生失智現象、降低日常生活能力影響生活的品質,為此,本發明之一實施例係採用三維影像顯示器7具體地將虛擬實境結合運動訓練,以鼓勵社區老年人積極介入心肺體適能的活動,減緩老化。Therefore, it is understandable that when the body functions of the elderly begin to deteriorate and lead to symptoms of weakness, it is very easy to affect various activities, including physical and social, and may also affect cognitive functions, resulting in dementia, reducing daily living ability and affecting the quality of life. For this reason, one embodiment of the present invention uses a three-dimensional image display 7 to specifically combine virtual reality with sports training to encourage the elderly in the community to actively participate in cardiopulmonary fitness activities and slow down aging.

如步驟S1所述,輸入心肺適能教學影像,於一實施例中,心肺適能教學影像可以是根據個人不同的生理狀態所產生的建議運動項目示範動作,但不在此限,亦可以由使用者輸入想學習的影像。As described in step S1, a cardiopulmonary fitness teaching image is input. In one embodiment, the cardiopulmonary fitness teaching image can be a demonstration of recommended exercise items generated according to different physiological conditions of an individual, but it is not limited to this. The user can also input the image he wants to learn.

如步驟S2所述,透過影像辨識模組2辨識出心肺適能教學影像中的每一個預設動作資訊的預設骨骼追蹤結果,再接續如步驟S3,以預設骨骼追蹤結果運算出對應的複數個預設關節點角度值,較佳的,可以用三維影像顯示器7顯示出心肺適能教學影像的所有預設骨骼追蹤結果,且,可旋轉360度觀看動作的細節,以供使用者參照後對應作出。As described in step S2, the image recognition module 2 recognizes the default skeletal tracking results of each default action information in the cardiopulmonary fitness teaching image, and then proceeds to step S3 to calculate the corresponding multiple default joint angle values with the default skeletal tracking results. Preferably, the three-dimensional image display 7 can be used to display all the default skeletal tracking results of the cardiopulmonary fitness teaching image, and the details of the action can be rotated 360 degrees for the user to refer to and respond accordingly.

如步驟S4所述,將該些個預設關節點角度值進行運算,進而取得每一個預設動作資訊中的預設權重分數,其中,該些個預設關節點角度值包含第一時間之預設動作資訊之該些個預設關節點角度值及第二時間之預設動作資訊之該些個預設關節點角度值,比對第一時間之該些個預設關節角度值與第二時間之該些個預設關節點角度值,取得對應之預設權重分數,換句話說,以前後不同時間的動作相互比對關節點角度值,當兩者差異越大時,則表示此部位的動作越重要,則預設權重分數則越高。As described in step S4, the preset joint angle values are calculated to obtain the preset weight score in each preset action information, wherein the preset joint angle values include the preset joint angle values of the default action information at the first time and the preset joint angle values of the default action information at the second time. The preset joint angle values at the first time are compared with the preset joint angle values at the second time to obtain the corresponding preset weight score. In other words, the joint angle values of actions at different times are compared with each other. The greater the difference between the two, the more important the action of this part is, and the higher the preset weight score is.

如步驟S5所述,輸入心肺適能教學影像對應之實際運動影像,其中,此一實際運動影像可以是由深度攝影模組6取得,或僅僅是一拍攝後的動態影像或靜態影像,接續如步驟S6所述,以影像辨識模組2辨識出實際運動影像中的骨骼追蹤結果,較佳的,可以透過三維影像顯示器7顯示此一骨骼追蹤結果,即可以同步的輸出使用者自身的三維虛擬影像,而可以更具體地看清楚自己的動作。As described in step S5, an actual motion image corresponding to the cardiopulmonary fitness teaching image is input, wherein the actual motion image can be obtained by the depth photography module 6, or is just a dynamic image or a static image after shooting. Then, as described in step S6, the image recognition module 2 recognizes the bone tracking result in the actual motion image. Preferably, the bone tracking result can be displayed through the three-dimensional image display 7, that is, the user's own three-dimensional virtual image can be output synchronously, so that the user can see his own movements more specifically.

如步驟S7所述,並請參閱第六圖,其為本發明之一實施例之部分流程示意圖。如圖所示,分析模組3更進一步的,運算實際運動影像的骨骼追蹤結果,以取得對應的複數個關節點角度值,並接續如步驟S8所述,以評鑑模組4運算該些個關節點角度值、該些個預設關節點角度值及對應之預設權重分數,產生並顯示評分資訊。As described in step S7, please refer to FIG6, which is a partial flow diagram of an embodiment of the present invention. As shown in the figure, the analysis module 3 further calculates the skeletal tracking result of the actual motion image to obtain a plurality of corresponding joint angle values, and then as described in step S8, the evaluation module 4 calculates the joint angle values, the preset joint angle values and the corresponding preset weight scores to generate and display the scoring information.

較佳的,並請參閱第七圖,其為本發明之一實施例之部分流程示意圖。如圖所示,首先,將該些個關節點角度值與該些個預設關節點角度值比對後,取得對應的相符程度,當該些個關節點角度值與該些個預設關節點角度值不完全相符時,則根據該些個關節點角度值與預設權重分數計算後,產生評分資訊,此一評分資訊可以根據動作比重有對應的預設權重分數,即根據不同動作之評分權重,使評分資訊能夠更加貼近實際情形。Preferably, please refer to FIG. 7, which is a partial flow diagram of an embodiment of the present invention. As shown in the figure, first, the joint angle values are compared with the preset joint angle values to obtain the corresponding matching degree. When the joint angle values are not completely consistent with the preset joint angle values, the scoring information is generated after the calculation based on the joint angle values and the preset weight score. This scoring information can have a corresponding preset weight score according to the action proportion, that is, according to the scoring weight of different actions, so that the scoring information can be closer to the actual situation.

於一實施例中,可以透過三維影像顯示器7顯示出評分資訊,提供使用者參考,也可以是透過使用者的行動裝置P中的應用程式APP顯示評分資訊,當然也可以透過任何可以安裝應用程式APP之電子產品顯示評分資訊,但不在此限。In one embodiment, the rating information can be displayed through a three-dimensional image display 7 for user reference, or through an application APP in the user's mobile device P. Of course, the rating information can also be displayed through any electronic product that can install the application APP, but it is not limited to this.

如步驟S9所述,引導模組5根據前述所取得之評分資訊,產生對應之介入資訊,介入資訊可以是以文字、圖形、語音、影像或影音呈現,其用以提醒使用者須調整部分動作或施力點錯誤等資訊,其中,介入資訊可以透過三維影像顯示器7顯示出來,或由應用程式APP之介面顯示。As described in step S9, the guidance module 5 generates corresponding intervention information based on the aforementioned scoring information obtained. The intervention information can be presented in the form of text, graphics, voice, image or video to remind the user that some movements or force application points must be adjusted, etc. The intervention information can be displayed through the three-dimensional image display 7 or by the interface of the application APP.

為更清楚說明實際作動方式,請參閱第八圖、第九圖、第十A圖及第十B圖,其為本發明之一實施例之作動流程示意圖。如圖所示, 首先,可以是由使用者於電子裝置C中尋找教學影片,當然也可以是由其他方式產出的多筆教學影片,並上傳至伺服器Server中,其中,伺服器Server係為提供影像辨識模組2、分析模組3、評鑑模組4及引導模組5運作的地方,當上傳至伺服器Server後,即會產生對應於教學影片之預設權重分數,此即為步驟S1-S4,於一實施例中,步驟S1至步驟S4可以是獨立的流程,即可以是先將多個教學影片上傳至伺服器Server,每一個教學影片都會對應有預設權重分數,當使用者User透過行動裝置P開啟應用程式APP即可與伺服器Server連接,並開始後續評分等流程,如第八圖所示。To more clearly illustrate the actual operation method, please refer to FIG. 8, FIG. 9, FIG. 10A and FIG. 10B, which are schematic diagrams of the operation process of one embodiment of the present invention. As shown in the figure, first, the user can search for teaching videos in the electronic device C, and of course, multiple teaching videos can be generated by other methods and uploaded to the server Server, where the server Server provides the image recognition module 2, the analysis module 3, the evaluation module 4 and the guidance module 5 for operation. After uploading to the server Server, a default weight score corresponding to the teaching video will be generated, which is steps S1-S4. In one embodiment, steps S1 to S4 can be independent processes, that is, multiple teaching videos can be uploaded to the server Server first, and each teaching video will correspond to a default weight score. When the user User opens the application APP through the mobile device P, it can connect to the server Server and start the subsequent scoring process, as shown in the eighth figure.

接續,當使用者User欲進行訓練時,則可以透過深度攝影模組6擷取使用者進行促進心肺適能訓練的實際運動影像,並將實際運動影像上傳至伺服器Server進行評分,於一實施例中,使用者User更可以配戴智慧穿戴裝置SW,同時監測使用者User的心跳狀態及血氧狀態,如第九圖所示,但不在此限,也可以搭配其他有線或無線的生理監測裝置,進一步掌握使用者User的其他生理狀態,例如:呼吸的頻率及次數,於一實施例中,智慧穿戴裝置SW可以是智慧手錶,智慧手錶可選自Garmin或其他品牌之智慧手錶。Next, when the user User wants to perform training, the depth camera module 6 can capture the actual sports images of the user performing cardiopulmonary fitness training, and upload the actual sports images to the server Server for scoring. In one embodiment, the user User can also wear a smart wearable device SW to monitor the heartbeat status and blood oxygen status of the user User at the same time, as shown in Figure 9, but not limited to this, and can also be used with other wired or wireless physiological monitoring devices to further grasp other physiological states of the user User, such as: breathing frequency and number. In one embodiment, the smart wearable device SW can be a smart watch, and the smart watch can be selected from Garmin or other brands of smart watches.

最終可以透過使用者User的行動裝置P開啟應用程式APP,並於應用程式APP的介面可以顯示出使用者User實際運動影像的所有過程,並且於介面上可以對應出一個虛擬骨架V,此一虛擬骨架V係對應於使用者User實際運動影像,並且以不同顏色標示正確或錯誤,例如:正確為藍色線段標示,以及錯誤為橘色線段標示,顏色可以根據需求置換,如此一來,則可以提供使用者User了解自身的運動狀態是否為正確。Finally, the application APP can be opened through the mobile device P of the user User, and all the processes of the user User's actual motion image can be displayed on the interface of the application APP, and a virtual skeleton V can be corresponding to the interface. This virtual skeleton V corresponds to the user User's actual motion image, and is marked with different colors to indicate correctness or error, for example: correct is marked with a blue line segment, and error is marked with an orange line segment. The color can be replaced according to needs, so that the user User can understand whether his or her own motion status is correct.

於一實施例中,如第十A圖所示,上半部分為應用程式APP所顯示的介面的一實施例之示例,即虛擬骨架V與實際運動影像重疊;下半部分則為顯示的介面的另一實施例之示例,即虛擬骨架V可縮小顯示於實際運動影像的一側,而不與之重疊,當然也可以有其他顯示方式,且,當使用者User有配戴智慧穿戴裝置SW時,在應用程式APP介面的左側框中,由上至下可以依序顯示出評分資訊、心跳資訊及血氧資訊。In one embodiment, as shown in FIG. 10A , the upper portion is an example of an embodiment of an interface displayed by the application APP, that is, the virtual skeleton V overlaps the actual motion image; the lower portion is an example of another embodiment of the displayed interface, that is, the virtual skeleton V can be shrunk and displayed on one side of the actual motion image without overlapping it. Of course, there can also be other display methods, and when the user User wears the smart wearable device SW, in the left frame of the application APP interface, the rating information, heart rate information and blood oxygen information can be displayed in sequence from top to bottom.

於另一實施例中,如第十B圖所示,上半部分為應用程式APP所顯示的介面的一實施例之示例,顯示的介面中被分為兩個畫面,即左側的畫面A與右側的畫面B,其中,畫面A為使用者User之實際運動影像,並且其虛擬骨架V與實際運動影像重疊,同時,畫面B則為同步的教學影像;下半部分則為顯示的介面的另一實施例之示例,同樣的,畫面A為使用者User之實際運動影像,並且其虛擬骨架V可縮小顯示於實際運動影像的一側,而不與之重疊,同時,畫面B同樣為同步的教學影像,而置於介面中間的分別是顯示評分資訊、心跳資訊及血氧資訊。In another embodiment, as shown in FIG. 10B, the upper portion is an example of an embodiment of an interface displayed by the application APP, and the displayed interface is divided into two screens, namely screen A on the left and screen B on the right, wherein screen A is the actual motion image of the user User, and its virtual skeleton V overlaps with the actual motion image, and at the same time, screen B is a synchronized teaching image; the lower portion is an example of another embodiment of the displayed interface, similarly, screen A is the actual motion image of the user User, and its virtual skeleton V can be reduced and displayed on one side of the actual motion image without overlapping with it, and at the same time, screen B is also a synchronized teaching image, and the rating information, heart rate information and blood oxygen information are displayed in the middle of the interface respectively.

第十A圖與第十B圖差異僅在於應用程式APP所顯示的介面排版以及顯示的資訊有所不同,當然應用程式APP介面的同樣可以根據需求設置功能選項,介面的排版方式可以根據需求設置,並不在此限。The difference between Figure 10A and Figure 10B is that the interface layout and information displayed by the application APP are different. Of course, the function options of the application APP interface can also be set according to needs, and the interface layout can be set according to needs, which is not limited to this.

第九圖、第十A圖及第十B圖係為步驟S5-S9之之作動流程示意圖,步驟S5-S9可以是獨立於步驟S1-S4的流程,即可以是伺服器Server原本已經存有許多教學影片及其預設權重分數,而使用者User可以隨時執行步驟S5-S9,於一實施例中,其最終的評分及實際運動影像可以儲存至伺服器Server,且,使用者User可以於伺服器Server中有個人的獨立儲存空間,儲存個人的評分及實際運動影像,並可以讓使用者User重複觀看個人的評分及實際運動影像。Figure 9, Figure 10A and Figure 10B are schematic diagrams of the operation process of steps S5-S9. Steps S5-S9 can be a process independent of steps S1-S4, that is, the server Server may already store many teaching videos and their default weight scores, and the user User can execute steps S5-S9 at any time. In one embodiment, the final score and actual motion image can be stored in the server Server, and the user User can have a personal independent storage space in the server Server to store personal scores and actual motion images, and can allow the user User to repeatedly view personal scores and actual motion images.

綜上所述,本發明之一實施例之應用於促進心肺適能訓練的介入方法及系統,可針對年長者本身情形,包含平衡能力、協調能力等進行訓練內容提供相對應的心肺適能教學影像,並進一步以三維影像提供使用者觀看參照,並且可實時回饋其對應之訓練結果,以增加使用者學習動機及成就感,而滿足使用者需求,亦改善習知受限於場地及安全性的缺失,故確實可以達成本發明之目的。In summary, an embodiment of the present invention is an intervention method and system for promoting cardiopulmonary fitness training, which can provide corresponding cardiopulmonary fitness teaching images for training content based on the elderly's own conditions, including balance ability, coordination ability, etc., and further provide users with three-dimensional images for viewing reference, and can provide real-time feedback on the corresponding training results to increase the user's learning motivation and sense of accomplishment, thereby meeting the needs of users and improving the lack of learning due to venue and safety. Therefore, the purpose of the present invention can be achieved.

惟以上所述者,僅為本發明之較佳實施例而已,當不能以此限定本發明實施之範圍,即凡依本發明申請專利範圍及發1明說明內容所作之簡單的等效變化與修飾,皆仍屬本發明專利涵蓋之範圍內。However, the above is only a preferred embodiment of the present invention, and should not be used to limit the scope of implementation of the present invention. That is, all simple equivalent changes and modifications made according to the scope of the patent application of the present invention and the content of the invention description are still within the scope of the present patent.

1:輸入單元 2:影像辨識模組 3:分析模組 4:評鑑模組 5:引導模組 6:深度攝影模組 7:三維影像顯示器 A:畫面 APP:應用程式 B:畫面 C:電子裝置 E:手肘座標值 J0:鼻部 J1:頸部 J2:左肩部 J3:右肩部 J4:左肘部 J5:右肘部 J6:左腕部 J7:右腕部 J8:左手部 J9:右手部 J10:左髖部 J11:右髖部 J12:中央髖部 J13:椎部 J14:左膝部 J15:右膝部 J16:左踝部 J17:右踝部 J18:左腳部 J19:右腳部 S:肩膀座標值 S1:步驟 S2:步驟 S3:步驟 S4:步驟 S5:步驟 S6:步驟 S7:步驟 S8:步驟 S9:步驟 Server:伺服器 SW:智慧穿戴裝置 P:行動裝置 User:使用者 V:虛擬骨架 W:手腕座標值 1: Input unit 2: Image recognition module 3: Analysis module 4: Evaluation module 5: Guidance module 6: Depth photography module 7: 3D image display A: Screen APP: Application B: Screen C: Electronic device E: Elbow coordinate value J0: Nose J1: Neck J2: Left shoulder J3: Right shoulder J4: Left elbow J5: Right elbow J6: Left wrist J7: Right wrist J8: Left hand J9: Right hand J10: Left hip J11: Right hip J12: Central hip J13: Vertebrae J14: Left knee J15: Right knee J16: Left ankle J17: Right ankle J18: Left foot J19: right foot S: shoulder coordinate value S1: step S2: step S3: step S4: step S5: step S6: step S7: step S8: step S9: step Server: server SW: smart wearable device P: mobile device User: user V: virtual skeleton W: wrist coordinate value

第一圖: 其為本發明之一實施例之方法流程圖; 第二A圖: 其為本發明之另一實施例之方法流程圖; 第二B圖: 其為本發明之另一實施例之方法流程圖; 第三圖: 其為本發明之一實施例之系統示意圖; 第四圖: 其為本發明之一實施例之動作前後示意圖; 第五圖: 其為本發明之一實施例之關節點角度值運算示意圖; 第六圖: 其為本發明之一實施例之部分流程示意圖; 第七圖: 其為本發明之一實施例之部分流程示意圖; 第八圖: 其為本發明之一實施例之作動流程示意圖; 第九圖: 其為本發明之一實施例之作動流程示意圖; 第十A圖: 其為本發明之一實施例之作動流程示意圖;及 第十B圖: 其為本發明之另一實施例之作動流程示意圖。 Figure 1: It is a method flow chart of one embodiment of the present invention; Figure 2A: It is a method flow chart of another embodiment of the present invention; Figure 2B: It is a method flow chart of another embodiment of the present invention; Figure 3: It is a system schematic diagram of one embodiment of the present invention; Figure 4: It is a schematic diagram of the action before and after of one embodiment of the present invention; Figure 5: It is a schematic diagram of the joint angle value calculation of one embodiment of the present invention; Figure 6: It is a partial process schematic diagram of one embodiment of the present invention; Figure 7: It is a partial process schematic diagram of one embodiment of the present invention; Figure 8: It is a schematic diagram of the action process of one embodiment of the present invention; Figure 9: It is a schematic diagram of the action process of one embodiment of the present invention; Figure 10A: It is a schematic diagram of the action process of one embodiment of the present invention; and Figure 10B: This is a schematic diagram of the operation process of another embodiment of the present invention.

S1-S9:步驟 S1-S9: Steps

Claims (10)

一種應用於促進心肺適能訓練的介入方法,步驟包含: 輸入一心肺適能教學影像; 分析該心肺適能教學影像,產生一預設骨骼追蹤結果; 運算該預設骨骼追蹤結果,取得對應之複數個預設關節點角度值; 運算該些個預設關節點角度值,取得對應之一預設權重分數; 輸入該心肺適能教學影像對應之一實際運動影像; 分析該實際運動影像,產生一骨骼追蹤結果; 運算該骨骼追蹤結果,取得對應之複數個關節點角度值; 運算該些個關節點角度值、該些個預設關節點角度值與該預設權重分數,產生並顯示一評分資訊;及 以該評分資訊產生並顯示一介入資訊。 An intervention method for promoting cardiopulmonary fitness training, comprising the following steps: Inputting a cardiopulmonary fitness teaching image; Analyzing the cardiopulmonary fitness teaching image to generate a preset bone tracking result; Calculating the preset bone tracking result to obtain a plurality of corresponding preset joint angle values; Calculating the preset joint angle values to obtain a corresponding preset weight score; Inputting an actual sports image corresponding to the cardiopulmonary fitness teaching image; Analyzing the actual sports image to generate a bone tracking result; Calculating the bone tracking result to obtain a plurality of corresponding joint angle values; Calculating the joint angle values, the preset joint angle values and the preset weight score to generate and display a rating information; and Generate and display intervention information based on the rating information. 依據請求項1所述之應用於促進心肺適能訓練的介入方法,該實際運動影像選自動態影像或靜態影像。According to the intervention method for promoting cardiopulmonary fitness training described in claim 1, the actual motion image is selected from dynamic images or static images. 依據請求項1所述之應用於促進心肺適能訓練的介入方法,於運算該些個預設關節點角度值,取得對應之一預設權重分數之步驟中,該些個預設關節點角度值包含一第一時間之一預設動作資訊對應之該些個預設關節點角度值及一第二時間之該預設動作資訊對應之該些個預設關節點角度值,比對該第一時間之該些個預設關節角度值與該第二時間之該些個預設關節點角度值,取得對應之該預設權重分數。According to the intervention method for promoting cardiopulmonary fitness training described in claim 1, in the step of calculating the preset joint angle values and obtaining a corresponding preset weight score, the preset joint angle values include the preset joint angle values corresponding to a preset action information at a first time and the preset joint angle values corresponding to the default action information at a second time. The preset joint angle values at the first time are compared with the preset joint angle values at the second time to obtain the corresponding preset weight score. 依據請求項3所述之應用於促進心肺適能訓練的介入方法,於運算該些個關節點角度值、該些個預設關節點角度值與該預設權重分數,產生並顯示一評分資訊之步驟中,比對每一該預設動作資訊對應之該些個關節點角度值與該些個預設關節點角度,取得對應之一相符程度,運算該相符程度與對應之該預設權重分數,產生該評分資訊。According to the intervention method for promoting cardiopulmonary fitness training described in claim 3, in the step of calculating the joint angle values, the default joint angle values and the default weight scores to generate and display a scoring information, the joint angle values corresponding to each of the default action information are compared with the default joint angles to obtain a corresponding degree of matching, and the degree of matching and the corresponding default weight score are calculated to generate the scoring information. 依據請求項1所述之應用於促進心肺適能訓練的介入方法,其中,該介入資訊為文字、語音、影像、影音或上述之組合。An intervention method for promoting cardiopulmonary fitness training according to claim 1, wherein the intervention information is text, voice, image, video or a combination thereof. 一種應用於促進心肺適能訓練的介入系統,包含: 一輸入單元,輸入一心肺適能教學影像及對應之一實際運動影像; 一影像辨識模組,與該輸入單元訊號連接,用以辨識該心肺適能教學影像及該實際運動影像,以取得對應該心肺適能教學影像之一預設骨骼追蹤結果,及對應該實際運動影像之一骨骼追蹤結果; 一分析模組,與該影像辨識模組訊號連接,用以分析該預設骨骼追蹤結果及該骨骼追蹤結果,以取得對應該預設骨骼追蹤結果之複數個預設關節點角度值,及對應該骨骼追蹤結果之複數個關節點角度值; 一評鑑模組,與該分析模組訊號連接,根據該些個預設關節點角度值運算,取得一預設權重分數,並該些個關節點角度值、該些個預設關節點角度值與該預設權重分數,產生並顯示一評分資訊;及 一引導模組,與該評鑑模組訊號連接,用以根據該評分資訊產生並顯示一介入資訊。 An intervention system for promoting cardiopulmonary fitness training comprises: An input unit for inputting a cardiopulmonary fitness teaching image and a corresponding actual sports image; An image recognition module connected to the input unit signal for recognizing the cardiopulmonary fitness teaching image and the actual sports image to obtain a preset bone tracking result corresponding to the cardiopulmonary fitness teaching image and a bone tracking result corresponding to the actual sports image; An analysis module connected to the image recognition module signal for analyzing the preset bone tracking result and the bone tracking result to obtain a plurality of preset joint angle values corresponding to the preset bone tracking result and a plurality of joint angle values corresponding to the bone tracking result; An evaluation module, connected to the analysis module signal, calculates according to the preset joint angle values, obtains a preset weight score, and generates and displays a rating information based on the joint angle values, the preset joint angle values and the preset weight score; and A guidance module, connected to the evaluation module signal, generates and displays an intervention information based on the rating information. 依據請求項6所述之應用於促進心肺適能訓練的介入系統,其中,該實際運動影像選自動態影像或靜態影像。An interventional system for promoting cardiopulmonary fitness training according to claim 6, wherein the actual motion image is selected from a dynamic image or a static image. 依據請求項6所述之應用於促進心肺適能訓練的介入系統,包含一深度攝影模組,與該輸入單元訊號連接,擷取一人體之該實際運動影像。The intervention system for promoting cardiopulmonary fitness training according to claim 6 includes a depth photography module connected to the input unit signal to capture the actual movement image of a human body. 依據請求項6所述之應用於促進心肺適能訓練的介入系統,包含一三維影像顯示器,與該輸入單元及該引導模組訊號連接,用以顯示該心肺適能教學影像及該介入資訊。The intervention system for promoting cardiopulmonary fitness training according to claim 6 includes a three-dimensional image display connected to the input unit and the guidance module signal to display the cardiopulmonary fitness teaching image and the intervention information. 依據請求項6所述之應用於促進心肺適能訓練的介入系統,其中,該介入資訊為文字、語音、影像、影音或上述之組合。An intervention system for promoting cardiopulmonary fitness training according to claim 6, wherein the intervention information is text, voice, image, video or a combination of the above.
TW112128661A 2023-07-31 2023-07-31 An intervention method for promoting cardiorespiratory fitness training and its system thereof TWI844438B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW112128661A TWI844438B (en) 2023-07-31 2023-07-31 An intervention method for promoting cardiorespiratory fitness training and its system thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW112128661A TWI844438B (en) 2023-07-31 2023-07-31 An intervention method for promoting cardiorespiratory fitness training and its system thereof

Publications (2)

Publication Number Publication Date
TWI844438B true TWI844438B (en) 2024-06-01
TW202506238A TW202506238A (en) 2025-02-16

Family

ID=92541508

Family Applications (1)

Application Number Title Priority Date Filing Date
TW112128661A TWI844438B (en) 2023-07-31 2023-07-31 An intervention method for promoting cardiorespiratory fitness training and its system thereof

Country Status (1)

Country Link
TW (1) TWI844438B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI875608B (en) * 2024-06-18 2025-03-01 國立陽明交通大學 Method and system of hand movement analysis

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI220387B (en) * 2003-08-05 2004-08-21 Taiwan Bicycle Ind R&D Center Exercise device with virtual-reality and physical agility training functions
US20170000386A1 (en) * 2015-07-01 2017-01-05 BaziFIT, Inc. Method and system for monitoring and analyzing position, motion, and equilibrium of body parts
US20170368413A1 (en) * 2016-03-12 2017-12-28 Arie Shavit Training system and methods for designing, monitoring and providing feedback of training
CN107798682A (en) * 2017-08-31 2018-03-13 深圳联影医疗科技有限公司 Image segmentation system, method, device and computer readable storage medium
CN115188074A (en) * 2022-07-08 2022-10-14 乐跑体育互联网(武汉)有限公司 Interactive physical training evaluation method, device and system and computer equipment
US20230230418A1 (en) * 2021-05-28 2023-07-20 Sportsbox.ai Inc. Practice drill-related features using quantitative, biomechanical-based analysis

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI220387B (en) * 2003-08-05 2004-08-21 Taiwan Bicycle Ind R&D Center Exercise device with virtual-reality and physical agility training functions
US20170000386A1 (en) * 2015-07-01 2017-01-05 BaziFIT, Inc. Method and system for monitoring and analyzing position, motion, and equilibrium of body parts
US20170368413A1 (en) * 2016-03-12 2017-12-28 Arie Shavit Training system and methods for designing, monitoring and providing feedback of training
CN107798682A (en) * 2017-08-31 2018-03-13 深圳联影医疗科技有限公司 Image segmentation system, method, device and computer readable storage medium
US20230230418A1 (en) * 2021-05-28 2023-07-20 Sportsbox.ai Inc. Practice drill-related features using quantitative, biomechanical-based analysis
CN115188074A (en) * 2022-07-08 2022-10-14 乐跑体育互联网(武汉)有限公司 Interactive physical training evaluation method, device and system and computer equipment

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI875608B (en) * 2024-06-18 2025-03-01 國立陽明交通大學 Method and system of hand movement analysis

Also Published As

Publication number Publication date
TW202506238A (en) 2025-02-16

Similar Documents

Publication Publication Date Title
Colombo et al. Virtual reality for COPD rehabilitation: a technological perspective
Holden et al. Use of virtual environments in motor learning and rehabilitation
Sigrist et al. Sonification and haptic feedback in addition to visual feedback enhances complex motor task learning
US11712162B1 (en) System for testing and/or training the vision of a user
US9878206B2 (en) Method for interactive training and analysis
Jaume-i-Capó et al. Interactive rehabilitation system for improvement of balance therapies in people with cerebral palsy
US20150004581A1 (en) Interactive physical therapy
Davids et al. Artificial intelligence for physiotherapy and rehabilitation
Shao et al. You are doing great! only one rep left: an affect-aware social robot for exercising
Sramka et al. Combined methods of rehabilitation of patients after stroke: virtual reality and traditional approach
Elor et al. Project butterfly: Synergizing immersive virtual reality with actuated soft exosuit for upper-extremity rehabilitation
Yan Construction and Application of Virtual Reality‐Based Sports Rehabilitation Training Program
Casas et al. Human-robot interaction for rehabilitation scenarios
Sommer et al. Synchronized metronome training induces changes in the kinematic properties of the golf swing
TWI844438B (en) An intervention method for promoting cardiorespiratory fitness training and its system thereof
Yeh et al. Virtual reality for post-stroke shoulder-arm motor rehabilitation: Training system & assessment method
Rizzo et al. Design and development of virtual reality based perceptual-motor rehabilitation scenarios
Takhashi et al. Development of an upper limb patient simulator for physical therapy exercise
WO2022075377A1 (en) Sightline-position determination device, sightline-position determination method, and training method
Calderita et al. Rehabilitation for Children while Playing with a Robotic Assistant in a Serious Game.
Bogliolo et al. A robot instructor for the prevention and treatment of sarcopenia in the aging population: A pilot study
Chung et al. Qigong master: A Qigong-based attention training game using action recognition and balance analysis
Simon et al. TOYBOT: An Interactive exercise companion for rehabilitation of sedentary geriatric and obese children
Cao et al. Design and evaluation of a double rope rehabilitation robot for sit-to-stand training
Sobota et al. Therapy of Upper Limbs By Means of Virtual Reality Technologies