TWI778900B - Marking and teaching of surgical procedure system and method thereof - Google Patents
Marking and teaching of surgical procedure system and method thereof Download PDFInfo
- Publication number
- TWI778900B TWI778900B TW110149132A TW110149132A TWI778900B TW I778900 B TWI778900 B TW I778900B TW 110149132 A TW110149132 A TW 110149132A TW 110149132 A TW110149132 A TW 110149132A TW I778900 B TWI778900 B TW I778900B
- Authority
- TW
- Taiwan
- Prior art keywords
- surgical
- area
- marked
- marking
- image
- Prior art date
Links
- 238000001356 surgical procedure Methods 0.000 title claims abstract description 65
- 238000000034 method Methods 0.000 title claims abstract description 31
- 239000003550 marker Substances 0.000 claims description 40
- 230000000694 effects Effects 0.000 claims description 10
- 238000009877 rendering Methods 0.000 claims 2
- 238000013507 mapping Methods 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 21
- 210000000232 gallbladder Anatomy 0.000 description 5
- 210000000056 organ Anatomy 0.000 description 2
- 210000001519 tissue Anatomy 0.000 description 2
- 239000003086 colorant Substances 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 210000003563 lymphoid tissue Anatomy 0.000 description 1
- 239000000463 material Substances 0.000 description 1
Images
Landscapes
- Surgical Instruments (AREA)
- Image Processing (AREA)
Abstract
Description
一種圈選與標記系統及其方法,尤其是指一種於使用者介面提供標記參考手術圖像以輔助待標記手術圖像進行標記圈選的手術術式標記與教學系統及其方法。A circle selection and marking system and method thereof, in particular to a surgical method marking and teaching system and method for providing marking reference surgical images on a user interface to assist in marking and encircling the surgical images to be marked.
醫學的知識傳播多半是需要配合影片或是圖式以便於醫學上的教學,基於醫學器材的發展,在手術術式過程中更進一步可提供影片的錄製,透過錄製好的影片可以提供醫學上的教學,在進行到手術術式關鍵的步驟時,雖然可以暫時停止影片的播放以提供教師對於暫停的影像內容進行說明,但影片播放應用程式並不具備對於暫停的影片內容提供輔助工具,使其在暫停的影片內容中進行輔助標記以便於醫學的教學。Most of the dissemination of medical knowledge needs to be combined with videos or schemas to facilitate medical teaching. Based on the development of medical equipment, video recording can be provided in the process of surgical procedures, and medical information can be provided through recorded videos. Teaching, when the key step of the operation is performed, although the playback of the video can be temporarily stopped to provide the teacher with an explanation of the content of the paused video, the video playback application does not provide auxiliary tools for the content of the paused video, so that it can be Make auxiliary markup in the paused video content to facilitate the teaching of medicine.
綜上所述,可知先前技術中長期以來一直存在透過手術術式影片進行醫學教學未能提供輔助工具以進行標記輔助教學的問題,因此有必要提出改進的技術手段,來解決此一問題。To sum up, it can be seen that there has been a long-standing problem in the prior art that medical teaching through surgical videos fails to provide auxiliary tools for marking-assisted teaching. Therefore, it is necessary to propose improved technical means to solve this problem.
有鑒於先前技術存在現有圖像編輯不具備在工作中視窗提供被編輯圖像與標記參考手術圖像同時顯示造成編輯作業需頻繁切換視窗的問題,本發明遂揭露一種手術術式標記與教學系統及其方法,其中:In view of the problem in the prior art that the existing image editor does not have the ability to provide the edited image and the marked reference surgical image simultaneously in the work window, resulting in frequent switching of windows for editing operations, the present invention discloses a surgical technique marking and teaching system. and its method, where:
本發明所揭露的手術術式標記與教學系統,執行於電子裝置,其包含:使用者介面模組、影片播放模組、顯示模組、標記模組、標記建立模組、儲存模組以及教學模組。The surgical technique marking and teaching system disclosed in the present invention is implemented in an electronic device, and includes: a user interface module, a video playback module, a display module, a marking module, a marking creation module, a storage module, and a teaching module module.
使用者介面模組是顯示使用者介面,使用者介面包含有手術圖像選取區、手術圖像標記區、標記記錄區、手術影片播放區、圖像標記參考區以及手術標記選取區;影片播放模組是將手術影片於手術影片播放區中進行播放;顯示模組是於手術圖像選取區中顯示的多個待標記手術圖像名稱其中之一被選取時,與被選取的待標記手術圖像名稱對應的待標記手術圖像於手術圖像標記區進行顯示,以及與被選取的待標記手術圖像名稱對應的標記參考手術圖像於圖像標記參考區進行顯示;標記模組是於手術標記選取區中顯示的手術標記區塊其中之一被選取時,於手術圖像標記區進行手術標記區域的圈選,並於手術圖像標記區中以被選取手術標記區塊對應的色彩填滿手術標記區域;及標記建立模組是於標記記錄區建立並顯示背景標記,以及於手術圖像標記區進行手術標記區域圈選後,於標記記錄區依據被選取手術標記區塊對應的名稱建立名稱標記;儲存模組是將被標記完成的待標記手術圖像儲存為已標記手術圖像,已標記手術圖像包含有多個已填滿色彩的手術標記區域;及教學模組是顯示教學介面,教學介面包含有待標記手術圖像區、已標記手術圖像區以及手術標記顯示區,將待標記手術圖像於待標記手術圖像區顯示,將已標記手術圖像於已標記手術圖像區顯示,藉由已標記手術圖像中的多個已填滿色彩的手術標記區域與待標記手術圖像相互映射,且手術標記顯示區中提供對應手術標記區域的輔助內容,以提供與待標記手術圖像對應的手術術式教學。The user interface module is to display the user interface, and the user interface includes a surgical image selection area, a surgical image marking area, a marking recording area, a surgical video playing area, an image marking reference area and a surgical marking selection area; the video playing The module is to play the surgical video in the surgical video playing area; the display module is to display the operation video in the surgical image selection area when one of the names of the surgical images to be marked is selected, and the selected surgical image to be marked is displayed. The surgical image to be marked corresponding to the image name is displayed in the surgical image marking area, and the marked reference surgical image corresponding to the name of the selected surgical image to be marked is displayed in the image marking reference area; the marking module is When one of the surgical marker blocks displayed in the surgical marker selection area is selected, circle selection of the surgical marker area is performed in the surgical image marker area, and the selected surgical marker block corresponding to the selected surgical marker area is selected in the surgical image marker area. The color fills the surgical mark area; and the mark creation module creates and displays a background mark in the mark record area, and after the surgical mark area is circled in the surgical image mark area, the mark record area corresponds to the selected surgical mark block in the mark record area The name of the name tag is established; the storage module is to store the marked surgical image to be marked as a marked surgical image, and the marked surgical image includes a plurality of color-filled surgical marking areas; and the teaching module It is to display the teaching interface. The teaching interface includes the operation image area to be marked, the marked operation image area and the operation mark display area. The operation image to be marked is displayed in the operation image area to be marked, and the marked operation image is displayed in the operation image area. The marked surgical image area is displayed, by mapping a plurality of colored surgical marked areas in the marked surgical image with the to-be-marked surgical image, and the surgical mark display area provides auxiliary content corresponding to the surgical marked area, In order to provide the surgical technique teaching corresponding to the surgical image to be marked.
本發明所揭露的手術術式標記與教學方法,其包含下列步驟:The surgical marking and teaching method disclosed by the present invention comprises the following steps:
首先,電子裝置顯示使用者介面,使用者介面包含有手術圖像選取區、手術圖像標記區、標記記錄區、手術影片播放區、圖像標記參考區以及手術標記選取區;接著,電子裝置對手術影片於手術影片播放區中被播放;接著,電子裝置於手術圖像選取區中顯示的多個待標記手術圖像名稱其中之一被選取時,手術圖像標記區顯示與被選取的待標記手術圖像名稱對應的待標記手術圖像;接著,電子裝置於手術圖像選取區中顯示的多個待標記手術圖像名稱其中之一被選取時,圖像標記參考區顯示與被選取的待標記手術圖像名稱對應的標記參考手術圖像;接著,電子裝置於標記記錄區建立並顯示背景標記;接著,電子裝置於手術標記選取區中顯示的手術標記區塊其中之一被選取時,於手術圖像標記區進行手術標記區域的圈選;接著,電子裝置於手術圖像標記區中以被選取手術標記區塊對應的色彩填滿手術標記區域,並於標記記錄區依據被選取手術標記區塊對應的名稱建立名稱標記;接著,電子裝置將被標記完成的待標記手術圖像儲存為已標記手術圖像,已標記手術圖像包含有多個已填滿色彩的手術標記區域;接著,電子裝置顯示教學介面,教學介面包含有待標記手術圖像區、已標記手術圖像區以及手術標記顯示區;接著,電子裝置將待標記手術圖像於待標記手術圖像區顯示,將已標記手術圖像於已標記手術圖像區顯示;最後,已標記手術圖像中的多個已填滿色彩的手術標記區域與待標記手術圖像相互映射,且手術標記顯示區中提供對應手術標記區域的輔助內容,以提供與待標記手術圖像對應的手術術式教學。First, the electronic device displays a user interface, which includes a surgical image selection area, a surgical image marking area, a marking recording area, a surgical video playback area, an image marking reference area, and a surgical marking selection area; then, the electronic device The surgical video is played in the surgical video playing area; then, when one of the names of the multiple surgical images to be marked displayed in the surgical image selection area is selected by the electronic device, the surgical image marking area displays and the selected one is displayed. The surgical image to be marked corresponding to the name of the surgical image to be marked; then, when one of the names of the multiple surgical images to be marked displayed in the surgical image selection area is selected by the electronic device, the image marking reference area displays and is displayed. The marked reference surgical image corresponding to the selected surgical image name to be marked; then, the electronic device establishes and displays a background mark in the mark recording area; then, one of the surgical mark blocks displayed by the electronic device in the surgical mark selection area is selected. When selecting, the surgical marking area is circled in the surgical image marking area; then, the electronic device fills the surgical marking area in the surgical image marking area with the color corresponding to the selected surgical marking area, and records in the marking recording area according to the color Create a name tag for the name corresponding to the selected surgical marking block; then, the electronic device stores the marked surgical image to be marked as a marked surgical image, and the marked surgical image includes a plurality of operations that have been filled with colors marking area; then, the electronic device displays a teaching interface, the teaching interface includes a surgical image area to be marked, a marked surgical image area, and a surgical marking display area; then, the electronic device displays the surgical image to be marked in the surgical image area to be marked Display, the marked surgical image is displayed in the marked surgical image area; finally, a plurality of color-filled surgical marked areas in the marked surgical image are mapped with the to-be-marked surgical image, and the surgical marked display area The auxiliary content corresponding to the surgical marking area is provided in the image to provide the surgical technique teaching corresponding to the surgical image to be marked.
本發明所揭露的系統及方法如上,與先前技術之間的差異在於當使用者介面的手術圖像選取區中待標記手術圖像名稱被選取時,使用者介面的手術圖像標記區顯示對應的待標記手術圖像,使用者介面的手術標記選取區中手術標記區塊被選取時,於手術圖像標記區進行手術標記區域的圈選以建立手術特徵標記,由教學介面對已標記的手術圖像與待標記手術圖像相互映射,以提供與待標記手術圖像對應的手術術式教學。The system and method disclosed in the present invention are as above, and the difference between the system and the prior art is that when the name of the surgical image to be marked is selected in the surgical image selection area of the user interface, the surgical image marking area of the user interface displays the corresponding The surgical image to be marked, when the surgical mark block is selected in the surgical mark selection area of the user interface, the surgical mark area is circled in the surgical image mark area to create a surgical feature mark, and the marked The surgical image and the to-be-marked surgical image are mapped to each other, so as to provide surgical technique teaching corresponding to the to-be-marked surgical image.
透過上述的技術手段,本發明可以達成透過標記參考手術圖像以輔助待標記手術圖像進行標記圈選進而提供手術術式教學的技術功效。Through the above-mentioned technical means, the present invention can achieve the technical effect of providing surgical technique teaching by marking the reference surgical image to assist the marking and circle selection of the surgical image to be marked.
以下將配合圖式及實施例來詳細說明本發明的實施方式,藉此對本發明如何應用技術手段來解決技術問題並達成技術功效的實現過程能充分理解並據以實施。The embodiments of the present invention will be described in detail below with the drawings and examples, so as to fully understand and implement the implementation process of how the present invention applies technical means to solve technical problems and achieve technical effects.
以下首先要說明本發明所揭露的手術術式標記與教學系統,並請參考「第1圖」所示,「第1圖」繪示為本發明手術術式標記與教學系統的系統方塊圖。The following first describes the surgical method marking and teaching system disclosed in the present invention, and please refer to FIG. 1, which is a system block diagram of the surgical method marking and teaching system of the present invention.
本發明所揭露的手術術式標記與教學系統,執行於電子裝置10,其包含:使用者介面模組11、影片播放模組12、顯示模組13、標記模組14、標記建立模組15、儲存模組16以及教學模組17。The surgical technique marking and teaching system disclosed in the present invention is executed in the
使用者介面模組11是顯示使用者介面20,使用者介面20包含有手術圖像選取區21、手術圖像標記區22、標記記錄區23、手術影片播放區24、圖像標記參考區25以及手術標記選取區26,使用者介面20的示意請參考「第2圖」所示,「第2圖」繪示為本發明手術術式標記與教學的初始使用者介面示意圖。The
手術圖像選取區21被設定自指定的資料夾中取得儲存於該指定的資料夾中多個待標記手術圖像的待標記手術圖像名稱,該指定的資料夾中所儲存的多個待標記手術圖像皆對應一個手術術式,手術圖像選取區21可以是由使用者拖曳指定的資料夾至手術圖像選取區21以設定指定的資料夾,手術圖像選取區21也可以是預先將指定的資料夾設定於手術術式標記與教學系統中,在此僅為舉例說明之,並不以此侷限本發明的應用範疇,手術圖像選取區21即可透過顯示模組13對多個待標記手術圖像名稱進行顯示,如「第3圖」所示,「第3圖」繪示為本發明手術術式標記與教學的使用者介面區域設定示意圖,待標記手術圖像名稱例如是:LC-00258802_1238824.png、LC-00258802_1240826.png、LC-00258802_1242828.png…等,在此僅為舉例說明之,並不以此侷限本發明的應用範疇。The surgical
手術影片播放區24被設定自指定的資料夾中取得儲存於該指定的資料夾中手術影片,手術影片亦是對應相同的手術術式,手術影片播放區24可以是由使用者拖曳指定的資料夾至手術影片播放區24以設定指定的資料夾,手術影片播放區24也可以是預先將指定的資料夾設定於手術術式標記與教學系統中,在此僅為舉例說明之,並不以此侷限本發明的應用範疇,手術影片播放區24即可透過影片播放模組12對手術影片進行播放,如「第3圖」所示。The surgical
圖像標記參考區25被設定自指定的資料夾中取得儲存於該指定的資料夾中多個標記參考手術圖像其中之一以進行顯示,標記參考手術圖像是基於待標記手術圖像中進行註解說明、簡單標記…等的輔助參考圖象,圖像標記參考區25可以是由使用者拖曳指定的資料夾至圖像標記參考區25以設定指定的資料夾,圖像標記參考區25也可以是預先將指定的資料夾設定於手術術式標記與教學系統中,在此僅為舉例說明之,並不以此侷限本發明的應用範疇,圖像標記參考區25即可透過顯示模組13對對應的標記參考手術圖像進行顯示,值得注意的是,前述的手術圖像選取區21、手術影片播放區24以及圖像標記參考區25被設定的指定的資料夾是不相同的資料夾。The image
手術標記選取區26中提供多個手術標記區塊261的顯示,如「第2圖」以及「第3圖」所示,手術標記選取區26中顯示的多個手術標記區塊261將於後續說明對應的用途,手術標記區塊261可以是中的名稱可以是人體組織名稱(例如:Lymphoid tissue)、臟器名稱(例如:Gallbladder)、手術用具名稱(例如:scalpel)…等,在此僅為舉例說明之,並不以此侷限本發明的應用範疇,在圖式中。The surgical
請參考「第4圖」所示,「第4圖」繪示為本發明手術術式標記與教學的待標記手術圖像名稱選取使用者介面變化示意圖。Please refer to "Fig. 4". "Fig. 4" is a schematic diagram showing the change of the user interface for selecting the name of the surgical image to be marked for marking and teaching the surgical technique of the present invention.
當手術圖像選取區21中多個待標記手術圖像名稱其中之一(在實施例中待標記手術圖像名稱為“LC-00258802_1238824.png”被選取)被選取時,與被選取的待標記手術圖像名稱對應為“LC-00258802_1238824.png”的待標記手術圖像於手術圖像標記區22透過顯示模組13進行顯示,在此同時,與被選取的待標記手術圖像名稱對應為“LC-00258802_1238824.png”的標記參考手術圖像於圖像標記參考區25透過顯示模組13進行顯示,在手術圖像選取區21中多個待標記手術圖像名稱其中之一被選取時,標記建立模組15即可於標記記錄區23建立並顯示背景標記。When one of the names of a plurality of surgical images to be marked in the surgical image selection area 21 (in the embodiment, the name of the surgical image to be marked is “LC-00258802_1238824.png” is selected), the selected The surgical image to be marked whose name corresponds to "LC-00258802_1238824.png" is displayed in the surgical
請參考「第5圖」所示,「第5圖」繪示為本發明手術術式標記與教學的標記過程使用者介面變化示意圖。Please refer to "Fig. 5". "Fig. 5" is a schematic diagram of the user interface change during the marking process of the surgical technique marking and teaching of the present invention.
當要對手術圖像標記區22顯示的待標記手術圖像進行標記時,藉由標記模組14於手術標記選取區26中選取手術標記區塊261,以於手術圖像標記區22進行手術標記區域221的圈選,手術標記區域221的圈選即是在手術圖像標記區22中對對應的人體組織、臟器、手術用具…等進行標記,手術圖像標記區22中圈選過程如「第5圖」中的虛線所示,在完成手術標記區域221的圈選時,手術圖像標記區22中以被選取手術標記區塊261對應的色彩填滿手術標記區域221,如「第6圖」所示,「第6圖」繪示為本發明手術術式標記與教學的標記結果使用者介面變化示意圖,在「第6圖」中是以填滿效果代表手術標記區域221的色彩填滿效果,在此僅為示意並不以此侷限本發明的應用範疇。When the surgical image to be marked displayed in the surgical
值得注意的是,標記模組14於手術標記選取區26中選取手術標記區塊261時,此時,手術標記選取區26中的所有手術標記區塊將不再提供選取,並將所有的手術標記區塊變更為相同的呈現效果,在「第5圖」中則是以相同的灰階填滿效果進行呈現,在此僅為示意說明,並不以此侷限本發明的應用範疇。It is worth noting that when the
在此同時,標記建立模組15會於手術圖像標記區22進行手術標記區域221圈選後,於標記記錄區23依據被選取手術標記區塊261對應的名稱(在實施例中即是“S_VI”)建立名稱標記。At the same time, after the
在不斷由標記模組14於手術標記選取區26中選取對應的手術標記區塊,以於手術圖像標記區22進行對應的手術標記區域圈選,最後完成待標記手術圖像所有應進行手術標記區域圈選的結果請參考「第7圖」所示,「第7圖」繪示為本發明手術術式標記與教學的待標記手術圖像的標記結果示意圖。The
值得注意的是,手術標記選取區26中顯示的手術標記區塊對應有不同的顯示優先權,手術圖像標記區22會以高顯示優先權的手術標記區塊填滿的手術標記區域總是顯示於低顯示優先權的手術標記區塊填滿的手術標記區域上方,在「第7圖」中即可得到手術標記區塊為“scalpel”的顯示優先權會高於手術標記區塊為“S_VI”、“Gallbladder”以及“S_IV”的顯示優先權,手術標記區塊為“foreign_material”的顯示優先權會高於手術標記區塊為 “S_VI”以及“Gallbladder”的顯示優先權,手術標記區塊為“S_VI”的顯示優先權會高於手術標記區塊為“Gallbladder”以及“S_IV”的顯示優先權,以及手術標記區塊為“Gallbladder”的顯示優先權會高於手術標記區塊為“S_IV”的顯示優先權。It is worth noting that the surgical mark blocks displayed in the surgical
在完成待標記手術圖像所有應進行手術標記區域圈選後,即可透過儲存模組16將被標記完成的待標記手術圖像儲存為已標記手術圖像,已標記手術圖像包含有多個已填滿色彩的手術標記區域,已標記手術圖像即可提供後續對於該手術術式的教學。After completing the circle selection of all areas to be marked in the surgical image to be marked, the marked surgical image to be marked can be stored as a marked surgical image through the
在需要進行手術術式的教學時,藉由教學模組17顯示包含有待標記手術圖像區31、已標記手術圖像區32以及手術標記顯示區33的教學介面30,教學介面30的示意,請參考「第8圖」所示,「第8圖」繪示為本發明手術術式標記與教學的教學介面示意圖,將待標記手術圖像於待標記手術圖像區31顯示,將已標記手術圖像於已標記手術圖像區32顯示,藉由已標記手術圖像中的多個已填滿色彩的手術標記區域與待標記手術圖像相互映射,且手術標記顯示區中提供對應手術標記區域33的輔助內容,以提供與待標記手術圖像對應的手術術式教學。When it is necessary to teach the surgical technique, the
請參考「第9圖」所示,「第9圖」繪示為本發明手術術式標記與教學的手術圖像選取區的呈現效果示意圖。Please refer to "Fig. 9". "Fig. 9" is a schematic diagram showing the presentation effect of the surgical image selection area for marking and teaching the surgical procedure of the present invention.
當手術圖像選取區21中多個待標記手術圖像名稱其中之一(在實施例中待標記手術圖像名稱為“LC-00258802_1240826.png”被選取)被選取時,與被選取的待標記手術圖像名稱對應為“LC-00258802_1240826.png”的待標記手術圖像於手術圖像標記區22透過顯示模組13進行顯示,在此同時,與被選取的待標記手術圖像名稱對應為“LC-00258802_1240826.png”的標記參考手術圖像於圖像標記參考區25透過顯示模組13進行顯示,在手術圖像選取區21中多個待標記手術圖像名稱其中之一被選取時,標記建立模組15即可於標記記錄區23建立並顯示背景標記。When one of the names of a plurality of surgical images to be marked in the surgical image selection area 21 (in the embodiment, the name of the surgical image to be marked is “LC-00258802_1240826.png” is selected), the selected The surgical image to be marked whose name corresponds to "LC-00258802_1240826.png" is displayed in the surgical
值得注意的是,於手術圖像選取區21以不同的背景樣式分別對待標記手術圖像名稱已進行標記、正在進行標記以及尚未進行標記進行對應的顯示呈現,在「第9圖」中,背景樣式為較深灰階背景的標記圖像名稱為“LC-00258802_1238824.png”即是已進行標記的待標記手術圖像,背景樣式為較淺灰階背景的標記圖像名稱為“LC-00258802_1240826.png”即是正在進行標記的待標記手術圖像,而無背景樣式的標記圖像名稱為“LC-00258802_1242828.png”以及“LC-00258802_1244830.png”即是尚未進行標記的待標記手術圖像,在此僅為舉例說明之,並不以此侷限本發明的應用範疇。It is worth noting that in the surgical
影片播放模組12更進一步會於手術圖像選取區21中顯示的多個待標記手術圖像名稱其中之一被選取時,依據被選取的待標記手術圖像名稱的影片時間點自手術影片中擷取出影片時間點前後預設時間點為擷取手術影片,以進行擷取手術影片的播放。The
具體而言,假設被選取的待標記手術圖像名稱的影片時間點為“00:30”,並且預設時間點為“10秒”,當該待標記手術圖像名稱於手術圖像選取區21中被選取時,影片播放模組12即會依影片時間點為“00:30”向前以及向後各“10秒”(即“00:20”至“00:40”的時間範圍)對手術影片進行影片的擷取為擷取手術影片以進行擷取手術影片的播放。Specifically, assuming that the movie time point of the selected surgical image name to be marked is "00:30" and the preset time point is "10 seconds", when the name of the surgical image to be marked is in the surgical image selection area When 21 is selected, the
接著,以下將說明本發明的運作方法,並請參考「第10A圖」以及「第10B圖」所示,「第10A圖」以及「第10B圖」繪示為本發明手術術式標記與教學方法的方法流程圖。Next, the operation method of the present invention will be described below, and please refer to "Fig. 10A" and "Fig. 10B". "Fig. 10A" and "Fig. 10B" are shown as the marking and teaching of the present invention. The method flow chart of the method.
本發明所揭露的手術術式標記與教學方法,其包含下列步驟:The surgical marking and teaching method disclosed by the present invention comprises the following steps:
首先,電子裝置顯示使用者介面,使用者介面包含有手術圖像選取區、手術圖像標記區、標記記錄區、手術影片播放區、圖像標記參考區以及手術標記選取區(步驟301);接著,電子裝置對手術影片於手術影片播放區中被播放(步驟302);接著,電子裝置於手術圖像選取區中顯示的多個待標記手術圖像名稱其中之一被選取時,手術圖像標記區顯示與被選取的待標記手術圖像名稱對應的待標記手術圖像(步驟303);接著,電子裝置於手術圖像選取區中顯示的多個待標記手術圖像名稱其中之一被選取時,圖像標記參考區顯示與被選取的待標記手術圖像名稱對應的標記參考手術圖像(步驟304);接著,電子裝置於手術圖像選取區中顯示的多個待標記手術圖像名稱其中之一被選取時,於標記記錄區建立並顯示背景標記(步驟305);接著,電子裝置於手術標記選取區中顯示的手術標記區塊其中之一被選取時,於手術圖像標記區進行手術標記區域的圈選(步驟306);接著,,電子裝置於手術圖像標記區中以被選取手術標記區塊對應的色彩填滿手術標記區域,並於標記記錄區依據被選取手術標記區塊對應的名稱建立名稱標記(步驟307);接著,電子裝置將被標記完成的待標記手術圖像儲存為已標記手術圖像,已標記手術圖像包含有多個已填滿色彩的手術標記區域(步驟308);接著,電子裝置顯示教學介面,教學介面包含有待標記手術圖像區、已標記手術圖像區以及手術標記顯示區(步驟309);接著,電子裝置將待標記手術圖像於待標記手術圖像區顯示,將已標記手術圖像於已標記手術圖像區顯示(步驟310);最後,已標記手術圖像中的多個已填滿色彩的手術標記區域與待標記手術圖像相互映射,且手術標記顯示區中提供對應手術標記區域的輔助內容,以提供與待標記手術圖像對應的手術術式教學(步驟311)。First, the electronic device displays a user interface, which includes a surgical image selection area, a surgical image marking area, a marking recording area, a surgical video playback area, an image marking reference area, and a surgical marking selection area (step 301 ); Next, the electronic device plays the surgical video in the surgical video playing area (step 302 ); then, when one of the names of the surgical images to be marked displayed in the surgical image selection area is selected by the electronic device, the surgical image is selected. The image marking area displays the surgical image to be marked corresponding to the name of the selected surgical image to be marked (step 303 ); then, the electronic device displays one of the names of the surgical image to be marked in the surgical image selection area When selected, the marked reference surgical image corresponding to the name of the selected surgical image to be marked is displayed in the image marking reference area (step 304 ); then, the electronic device displays a plurality of surgical images to be marked in the surgical image selection area When one of the image names is selected, a background mark is created and displayed in the mark recording area (step 305 ); then, when one of the surgical mark blocks displayed in the surgical mark selection area is selected by the electronic device, the operation diagram is Then, the electronic device fills the surgical marking area in the surgical image marking area with the color corresponding to the selected surgical marking area, and records the surgical marking area in the marking recording area according to the selected operation marking area. Select the name corresponding to the surgical mark block to create a name mark (step 307 ); then, the electronic device stores the marked surgical image to be marked as a marked surgical image, and the marked surgical image includes a plurality of filled surgical images. Colored surgical marking area (step 308 ); then, the electronic device displays a teaching interface, which includes the surgical image area to be marked, the marked surgical image area, and the surgical marking display area (step 309 ); The marked surgical image is displayed in the to-be-marked surgical image area, and the marked surgical image is displayed in the marked surgical image area (step 310 ); finally, a plurality of color-filled surgical marks in the marked surgical image are marked The area and the surgical image to be marked are mapped to each other, and auxiliary content corresponding to the surgically marked area is provided in the surgical mark display area, so as to provide surgical technique teaching corresponding to the surgical image to be marked (step 311 ).
綜上所述,可知本發明與先前技術之間的差異在於當使用者介面的手術圖像選取區中待標記手術圖像名稱被選取時,使用者介面的手術圖像標記區顯示對應的待標記手術圖像,使用者介面的手術標記選取區中手術標記區塊被選取時,於手術圖像標記區進行手術標記區域的圈選以建立手術特徵標記,由教學介面對已標記的手術圖像與待標記手術圖像相互映射,以提供與待標記手術圖像對應的手術術式教學。To sum up, it can be seen that the difference between the present invention and the prior art is that when the name of the surgical image to be marked is selected in the surgical image selection area of the user interface, the surgical image marking area of the user interface displays the corresponding to-be-marked surgical image. Mark the surgical image. When the surgical mark block is selected in the surgical mark selection area of the user interface, circle the surgical mark area in the surgical image mark area to create a surgical feature mark, and use the teaching interface for the marked surgical map The image and the surgical image to be marked are mapped to each other, so as to provide surgical technique teaching corresponding to the surgical image to be marked.
藉由此一技術手段可以來解決先前技術所存在透過手術術式影片進行醫學教學未能提供輔助工具以進行標記輔助教學的問題,進而達成透過標記參考手術圖像以輔助待標記手術圖像進行標記圈選進而提供手術術式教學的技術功效。This technical means can solve the problem in the prior art that medical teaching through surgical video cannot provide auxiliary tools for marking auxiliary teaching, so as to assist in marking the reference surgical image to assist the marking of the surgical image to be marked. Mark the circle selection and then provide the technical effect of surgical operation teaching.
雖然本發明所揭露的實施方式如上,惟所述的內容並非用以直接限定本發明的專利保護範圍。任何本發明所屬技術領域中具有通常知識者,在不脫離本發明所揭露的精神和範圍的前提下,可以在實施的形式上及細節上作些許的更動。本發明的專利保護範圍,仍須以所附的申請專利範圍所界定者為準。Although the embodiments disclosed in the present invention are as above, the above-mentioned contents are not used to directly limit the scope of the patent protection of the present invention. Anyone with ordinary knowledge in the technical field to which the present invention pertains can make some changes in the form and details of the implementation without departing from the spirit and scope of the present invention. The scope of patent protection of the present invention shall still be defined by the scope of the appended patent application.
10:電子裝置 11:使用者介面模組 12:影片播放模組 13:顯示模組 14:標記模組 15:標記建立模組 16:儲存模組 17:教學模組 20:使用者介面 21:手術圖像選取區 22:手術圖像標記區 221:手術標記區域 23:標記記錄區 24:手術影片播放區 25:圖像標記參考區 26:手術標記選取區 261:手術標記區塊 30:教學介面 31:待標記手術圖像區 32:已標記手術圖像區 33:手術標記顯示區 步驟 301:電子裝置顯示使用者介面,使用者介面包含有手術圖像選取區、手術圖像標記區、標記記錄區、手術影片播放區、圖像標記參考區以及手術標記選取區 步驟 302:電子裝置對手術影片於手術影片播放區中被播放 步驟 303:電子裝置於手術圖像選取區中顯示的多個待標記手術圖像名稱其中之一被選取時,手術圖像標記區顯示與被選取的待標記手術圖像名稱對應的待標記手術圖像 步驟 304:電子裝置於手術圖像選取區中顯示的多個待標記手術圖像名稱其中之一被選取時,圖像標記參考區顯示與被選取的待標記手術圖像名稱對應的標記參考手術圖像 步驟 305:電子裝置於手術圖像選取區中顯示的多個待標記手術圖像名稱其中之一被選取時,於標記記錄區建立並顯示背景標記 步驟 306:電子裝置於手術標記選取區中顯示的手術標記區塊其中之一被選取時,於手術圖像標記區進行手術標記區域的圈選 步驟 307:電子裝置於手術圖像標記區中以被選取手術標記區塊對應的色彩填滿手術標記區域,並於標記記錄區依據被選取手術標記區塊對應的名稱建立名稱標記 步驟 308:電子裝置將被標記完成的待標記手術圖像儲存為已標記手術圖像,已標記手術圖像包含有多個已填滿色彩的手術標記區域 步驟 309:電子裝置顯示教學介面,教學介面包含有待標記手術圖像區、已標記手術圖像區以及手術標記顯示區 步驟 310:電子裝置將待標記手術圖像於待標記手術圖像區顯示,將已標記手術圖像於已標記手術圖像區顯示 步驟 311:已標記手術圖像中的多個已填滿色彩的手術標記區域與待標記手術圖像相互映射,且手術標記顯示區中提供對應手術標記區域的輔助內容,以提供與待標記手術圖像對應的手術術式教學10: Electronics 11: User Interface Modules 12: Video playback module 13: Display module 14: Tag Module 15: Tag Build Module 16: Storage Module 17: Teaching Module 20: User Interface 21: Surgical image selection area 22: Surgical image marking area 221: Surgical marked area 23: Mark record area 24: Surgery video playback area 25: Image marker reference area 26: Surgical marker selection area 261: Surgical Marker Block 30: Teaching interface 31: The surgical image area to be marked 32: Marked surgical image area 33: Surgery marker display area Step 301: The electronic device displays a user interface, the user interface includes a surgical image selection area, a surgical image marking area, a marking recording area, a surgical video playback area, an image marking reference area, and a surgical marking selection area Step 302: The electronic device plays the operation video in the operation video playback area Step 303: When one of the names of the multiple surgical images to be marked displayed in the surgical image selection area is selected by the electronic device, the surgical image marking area displays the operation to be marked corresponding to the name of the selected surgical image to be marked. image Step 304: When one of the names of the multiple surgical images to be marked displayed in the surgical image selection area is selected by the electronic device, the image marking reference area displays the marked reference operation corresponding to the name of the selected surgical image to be marked. image Step 305: When one of the names of a plurality of surgical images to be marked displayed in the surgical image selection area is selected, the electronic device creates and displays a background mark in the mark recording area Step 306: When one of the surgical marking blocks displayed in the surgical marking selection area is selected, the electronic device performs a circle selection of the surgical marking area in the surgical image marking area Step 307: The electronic device fills the surgical marking area with the color corresponding to the selected surgical marking block in the surgical image marking area, and creates a name mark in the marking recording area according to the name corresponding to the selected surgical marking block Step 308: The electronic device stores the marked surgical image to be marked as a marked surgical image, and the marked surgical image includes a plurality of color-filled surgical marked areas Step 309: The electronic device displays a teaching interface, which includes a surgical image area to be marked, a marked surgical image area, and a surgical mark display area Step 310: The electronic device displays the surgical image to be marked in the surgical image area to be marked, and displays the marked surgical image in the marked surgical image area Step 311: A plurality of color-filled surgical marking areas in the marked surgical image are mapped to the to-be-marked surgical image, and auxiliary contents corresponding to the surgically marked areas are provided in the surgical marking display area, so as to provide the corresponding surgical marking area. Teaching of surgical techniques corresponding to images
第1圖繪示為本發明手術術式標記與教學系統的系統方塊圖。 第2圖繪示為本發明手術術式標記與教學的初始使用者介面示意圖。 第3圖繪示為本發明手術術式標記與教學的使用者介面區域設定示意圖。 第4圖繪示為本發明手術術式標記與教學的待標記手術圖像名稱選取使用者介面變化示意圖。 第5圖繪示為本發明手術術式標記與教學的標記過程使用者介面變化示意圖。 第6圖繪示為本發明手術術式標記與教學的標記結果使用者介面變化示意圖。 第7圖繪示為本發明手術術式標記與教學的待標記手術圖像的標記結果示意圖。 第8圖繪示為本發明手術術式標記與教學的教學介面示意圖。 第9圖繪示為本發明手術術式標記與教學的手術圖像選取區的呈現效果示意圖。 第10A圖以及第10B圖繪示為本發明手術術式標記與教學方法的方法流程圖。 FIG. 1 is a system block diagram of the surgical technique marking and teaching system of the present invention. FIG. 2 is a schematic diagram of an initial user interface for marking and teaching surgical procedures according to the present invention. FIG. 3 is a schematic diagram showing the setting of the user interface area for the marking and teaching of surgical procedures according to the present invention. FIG. 4 is a schematic diagram showing the change of the user interface for selecting the name of the surgical image to be marked for marking and teaching the surgical technique according to the present invention. FIG. 5 is a schematic diagram showing the change of the user interface during the marking process of the surgical technique marking and teaching of the present invention. FIG. 6 is a schematic diagram showing the change of the user interface of the marking result of the marking and teaching of the surgical technique according to the present invention. FIG. 7 is a schematic diagram illustrating the marking result of the surgical image to be marked for marking and teaching the surgical technique according to the present invention. FIG. 8 is a schematic diagram of a teaching interface for marking and teaching a surgical procedure according to the present invention. FIG. 9 is a schematic diagram showing the presentation effect of the surgical image selection area for marking and teaching the surgical procedure according to the present invention. FIG. 10A and FIG. 10B are flowcharts of the method of marking and teaching the surgical procedure according to the present invention.
10:電子裝置 10: Electronics
11:使用者介面模組 11: User Interface Modules
12:影片播放模組 12: Video playback module
13:顯示模組 13: Display module
14:標記模組 14: Tag Module
15:標記建立模組 15: Tag Build Module
16:儲存模組 16: Storage Module
17:教學模組 17: Teaching Module
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW110149132A TWI778900B (en) | 2021-12-28 | 2021-12-28 | Marking and teaching of surgical procedure system and method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW110149132A TWI778900B (en) | 2021-12-28 | 2021-12-28 | Marking and teaching of surgical procedure system and method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| TWI778900B true TWI778900B (en) | 2022-09-21 |
| TW202326643A TW202326643A (en) | 2023-07-01 |
Family
ID=84958363
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW110149132A TWI778900B (en) | 2021-12-28 | 2021-12-28 | Marking and teaching of surgical procedure system and method thereof |
Country Status (1)
| Country | Link |
|---|---|
| TW (1) | TWI778900B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI838198B (en) * | 2023-03-31 | 2024-04-01 | 慧術科技股份有限公司 | Medical dynamic video contrast teaching system and method thereof |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106456148A (en) * | 2014-03-19 | 2017-02-22 | 直观外科手术操作公司 | Medical devices, systems, and methods using eye gaze tracking |
| CN110996748A (en) * | 2018-05-23 | 2020-04-10 | 威博外科公司 | Surgical video analysis system for machine learning |
| CN111050683A (en) * | 2017-09-06 | 2020-04-21 | 威里利生命科学有限责任公司 | Surgical identification system |
| TW202042738A (en) * | 2019-05-21 | 2020-12-01 | 臺北醫學大學 | Smart marking system for surgical video and method thereof |
| CN212570078U (en) * | 2020-02-11 | 2021-02-19 | 中国医学科学院北京协和医院 | A teaching system for bone tumor surgery based on mixed reality technology |
| CN112618026A (en) * | 2020-12-15 | 2021-04-09 | 清华大学 | Remote operation data fusion interactive display system and method |
| US20210251570A1 (en) * | 2018-12-26 | 2021-08-19 | 3D Medivision Inc. | Surgical video creation system |
| US20210282892A1 (en) * | 2018-12-05 | 2021-09-16 | 3D Medivision Inc. | Surgical video production system and surgical video production method |
| CN113742527A (en) * | 2021-11-08 | 2021-12-03 | 成都与睿创新科技有限公司 | Method and system for retrieving and extracting operation video clips based on artificial intelligence |
-
2021
- 2021-12-28 TW TW110149132A patent/TWI778900B/en active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106456148A (en) * | 2014-03-19 | 2017-02-22 | 直观外科手术操作公司 | Medical devices, systems, and methods using eye gaze tracking |
| CN111050683A (en) * | 2017-09-06 | 2020-04-21 | 威里利生命科学有限责任公司 | Surgical identification system |
| CN110996748A (en) * | 2018-05-23 | 2020-04-10 | 威博外科公司 | Surgical video analysis system for machine learning |
| US20210282892A1 (en) * | 2018-12-05 | 2021-09-16 | 3D Medivision Inc. | Surgical video production system and surgical video production method |
| US20210251570A1 (en) * | 2018-12-26 | 2021-08-19 | 3D Medivision Inc. | Surgical video creation system |
| TW202042738A (en) * | 2019-05-21 | 2020-12-01 | 臺北醫學大學 | Smart marking system for surgical video and method thereof |
| CN212570078U (en) * | 2020-02-11 | 2021-02-19 | 中国医学科学院北京协和医院 | A teaching system for bone tumor surgery based on mixed reality technology |
| CN112618026A (en) * | 2020-12-15 | 2021-04-09 | 清华大学 | Remote operation data fusion interactive display system and method |
| CN113742527A (en) * | 2021-11-08 | 2021-12-03 | 成都与睿创新科技有限公司 | Method and system for retrieving and extracting operation video clips based on artificial intelligence |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI838198B (en) * | 2023-03-31 | 2024-04-01 | 慧術科技股份有限公司 | Medical dynamic video contrast teaching system and method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| TW202326643A (en) | 2023-07-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20230260413A1 (en) | Surgical procedure labeling and teaching system and method thereof | |
| US7231135B2 (en) | Computer-based video recording and management system for medical diagnostic equipment | |
| CN111832274B (en) | Rich media editing method, generation method, device and system in intelligent teaching materials | |
| CN1680963B (en) | Medical report making device, medical report reference device, and medical report making method | |
| CN114128304B (en) | Method and system for synchronizing surgical videos for comparative learning | |
| US6675352B1 (en) | Method of and apparatus for editing annotation command data | |
| JP2007313362A (en) | Apparatus for teaching body motions | |
| CN1662934A (en) | Job guiding system | |
| TWI778900B (en) | Marking and teaching of surgical procedure system and method thereof | |
| WO2020202527A1 (en) | Image recorder | |
| RU2347285C1 (en) | Device of record/playback and method of guidance concerning to it data mapped on display | |
| CN112434652A (en) | Intelligent visual operation record editing method and system | |
| KR20150081750A (en) | System and method for analyzing a golf swing | |
| Wijayanti et al. | Upgrading videography knowledge and skills in making Canva-based learning videos for elementary school teachers | |
| DE10106394C2 (en) | Process for generating documented medical image information | |
| Balogh et al. | Multilayer image grid reconstruction technology: four-dimensional interactive image reconstruction of microsurgical neuroanatomic dissections | |
| Vannaprathip et al. | Desitra: A simulator for teaching situated decision making in dental surgery | |
| JP6426867B1 (en) | Video viewing apparatus, control method for video viewing apparatus, and program | |
| JP2019185726A (en) | Video browsing device, control method of video browsing device, and program | |
| JP2014059452A (en) | Learning device, control method of the same, learning program, and learning system | |
| JP2006208784A (en) | Education system, device control method | |
| JP2024175148A (en) | Digital Twin Conference Holding Device and 3D Data Manufacturing Method | |
| Vejnović et al. | Newly developed three-dimensional animation of uterine closure according to the modified technique of cesarean section by Vejnović | |
| JP2016058112A (en) | Data management program and data management device | |
| JP3865146B2 (en) | Special effect device and special effect system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GD4A | Issue of patent certificate for granted invention patent |