[go: up one dir, main page]

TWI778900B - Marking and teaching of surgical procedure system and method thereof - Google Patents

Marking and teaching of surgical procedure system and method thereof Download PDF

Info

Publication number
TWI778900B
TWI778900B TW110149132A TW110149132A TWI778900B TW I778900 B TWI778900 B TW I778900B TW 110149132 A TW110149132 A TW 110149132A TW 110149132 A TW110149132 A TW 110149132A TW I778900 B TWI778900 B TW I778900B
Authority
TW
Taiwan
Prior art keywords
surgical
area
marked
marking
image
Prior art date
Application number
TW110149132A
Other languages
Chinese (zh)
Other versions
TW202326643A (en
Inventor
李宇倢
沈易達
蔣新曼
Original Assignee
慧術科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 慧術科技股份有限公司 filed Critical 慧術科技股份有限公司
Priority to TW110149132A priority Critical patent/TWI778900B/en
Application granted granted Critical
Publication of TWI778900B publication Critical patent/TWI778900B/en
Publication of TW202326643A publication Critical patent/TW202326643A/en

Links

Images

Landscapes

  • Surgical Instruments (AREA)
  • Image Processing (AREA)

Abstract

A marking and teaching of surgical procedure system and a method thereof are provided. Marked surgical image is displayed in surgical image marking area of user interface when name of marked surgical image is displayed in surgical image selection area of user interface. Surgical characteristic mark is established through selected surgery mark area in surgical image mark area when surgical mark block is selected in surgical mark selection area in user interface. Mutual mapping of marked surgical image is mapped by teaching interface to provide surgical procedure teaching for marked surgical image. Therefore, the efficiency of refer to the surgical image by marking to assist the marking and selection of the surgical image to be marked to provide surgical teaching may be achieved.

Description

手術術式標記與教學系統及其方法Surgical technique marking and teaching system and method

一種圈選與標記系統及其方法,尤其是指一種於使用者介面提供標記參考手術圖像以輔助待標記手術圖像進行標記圈選的手術術式標記與教學系統及其方法。A circle selection and marking system and method thereof, in particular to a surgical method marking and teaching system and method for providing marking reference surgical images on a user interface to assist in marking and encircling the surgical images to be marked.

醫學的知識傳播多半是需要配合影片或是圖式以便於醫學上的教學,基於醫學器材的發展,在手術術式過程中更進一步可提供影片的錄製,透過錄製好的影片可以提供醫學上的教學,在進行到手術術式關鍵的步驟時,雖然可以暫時停止影片的播放以提供教師對於暫停的影像內容進行說明,但影片播放應用程式並不具備對於暫停的影片內容提供輔助工具,使其在暫停的影片內容中進行輔助標記以便於醫學的教學。Most of the dissemination of medical knowledge needs to be combined with videos or schemas to facilitate medical teaching. Based on the development of medical equipment, video recording can be provided in the process of surgical procedures, and medical information can be provided through recorded videos. Teaching, when the key step of the operation is performed, although the playback of the video can be temporarily stopped to provide the teacher with an explanation of the content of the paused video, the video playback application does not provide auxiliary tools for the content of the paused video, so that it can be Make auxiliary markup in the paused video content to facilitate the teaching of medicine.

綜上所述,可知先前技術中長期以來一直存在透過手術術式影片進行醫學教學未能提供輔助工具以進行標記輔助教學的問題,因此有必要提出改進的技術手段,來解決此一問題。To sum up, it can be seen that there has been a long-standing problem in the prior art that medical teaching through surgical videos fails to provide auxiliary tools for marking-assisted teaching. Therefore, it is necessary to propose improved technical means to solve this problem.

有鑒於先前技術存在現有圖像編輯不具備在工作中視窗提供被編輯圖像與標記參考手術圖像同時顯示造成編輯作業需頻繁切換視窗的問題,本發明遂揭露一種手術術式標記與教學系統及其方法,其中:In view of the problem in the prior art that the existing image editor does not have the ability to provide the edited image and the marked reference surgical image simultaneously in the work window, resulting in frequent switching of windows for editing operations, the present invention discloses a surgical technique marking and teaching system. and its method, where:

本發明所揭露的手術術式標記與教學系統,執行於電子裝置,其包含:使用者介面模組、影片播放模組、顯示模組、標記模組、標記建立模組、儲存模組以及教學模組。The surgical technique marking and teaching system disclosed in the present invention is implemented in an electronic device, and includes: a user interface module, a video playback module, a display module, a marking module, a marking creation module, a storage module, and a teaching module module.

使用者介面模組是顯示使用者介面,使用者介面包含有手術圖像選取區、手術圖像標記區、標記記錄區、手術影片播放區、圖像標記參考區以及手術標記選取區;影片播放模組是將手術影片於手術影片播放區中進行播放;顯示模組是於手術圖像選取區中顯示的多個待標記手術圖像名稱其中之一被選取時,與被選取的待標記手術圖像名稱對應的待標記手術圖像於手術圖像標記區進行顯示,以及與被選取的待標記手術圖像名稱對應的標記參考手術圖像於圖像標記參考區進行顯示;標記模組是於手術標記選取區中顯示的手術標記區塊其中之一被選取時,於手術圖像標記區進行手術標記區域的圈選,並於手術圖像標記區中以被選取手術標記區塊對應的色彩填滿手術標記區域;及標記建立模組是於標記記錄區建立並顯示背景標記,以及於手術圖像標記區進行手術標記區域圈選後,於標記記錄區依據被選取手術標記區塊對應的名稱建立名稱標記;儲存模組是將被標記完成的待標記手術圖像儲存為已標記手術圖像,已標記手術圖像包含有多個已填滿色彩的手術標記區域;及教學模組是顯示教學介面,教學介面包含有待標記手術圖像區、已標記手術圖像區以及手術標記顯示區,將待標記手術圖像於待標記手術圖像區顯示,將已標記手術圖像於已標記手術圖像區顯示,藉由已標記手術圖像中的多個已填滿色彩的手術標記區域與待標記手術圖像相互映射,且手術標記顯示區中提供對應手術標記區域的輔助內容,以提供與待標記手術圖像對應的手術術式教學。The user interface module is to display the user interface, and the user interface includes a surgical image selection area, a surgical image marking area, a marking recording area, a surgical video playing area, an image marking reference area and a surgical marking selection area; the video playing The module is to play the surgical video in the surgical video playing area; the display module is to display the operation video in the surgical image selection area when one of the names of the surgical images to be marked is selected, and the selected surgical image to be marked is displayed. The surgical image to be marked corresponding to the image name is displayed in the surgical image marking area, and the marked reference surgical image corresponding to the name of the selected surgical image to be marked is displayed in the image marking reference area; the marking module is When one of the surgical marker blocks displayed in the surgical marker selection area is selected, circle selection of the surgical marker area is performed in the surgical image marker area, and the selected surgical marker block corresponding to the selected surgical marker area is selected in the surgical image marker area. The color fills the surgical mark area; and the mark creation module creates and displays a background mark in the mark record area, and after the surgical mark area is circled in the surgical image mark area, the mark record area corresponds to the selected surgical mark block in the mark record area The name of the name tag is established; the storage module is to store the marked surgical image to be marked as a marked surgical image, and the marked surgical image includes a plurality of color-filled surgical marking areas; and the teaching module It is to display the teaching interface. The teaching interface includes the operation image area to be marked, the marked operation image area and the operation mark display area. The operation image to be marked is displayed in the operation image area to be marked, and the marked operation image is displayed in the operation image area. The marked surgical image area is displayed, by mapping a plurality of colored surgical marked areas in the marked surgical image with the to-be-marked surgical image, and the surgical mark display area provides auxiliary content corresponding to the surgical marked area, In order to provide the surgical technique teaching corresponding to the surgical image to be marked.

本發明所揭露的手術術式標記與教學方法,其包含下列步驟:The surgical marking and teaching method disclosed by the present invention comprises the following steps:

首先,電子裝置顯示使用者介面,使用者介面包含有手術圖像選取區、手術圖像標記區、標記記錄區、手術影片播放區、圖像標記參考區以及手術標記選取區;接著,電子裝置對手術影片於手術影片播放區中被播放;接著,電子裝置於手術圖像選取區中顯示的多個待標記手術圖像名稱其中之一被選取時,手術圖像標記區顯示與被選取的待標記手術圖像名稱對應的待標記手術圖像;接著,電子裝置於手術圖像選取區中顯示的多個待標記手術圖像名稱其中之一被選取時,圖像標記參考區顯示與被選取的待標記手術圖像名稱對應的標記參考手術圖像;接著,電子裝置於標記記錄區建立並顯示背景標記;接著,電子裝置於手術標記選取區中顯示的手術標記區塊其中之一被選取時,於手術圖像標記區進行手術標記區域的圈選;接著,電子裝置於手術圖像標記區中以被選取手術標記區塊對應的色彩填滿手術標記區域,並於標記記錄區依據被選取手術標記區塊對應的名稱建立名稱標記;接著,電子裝置將被標記完成的待標記手術圖像儲存為已標記手術圖像,已標記手術圖像包含有多個已填滿色彩的手術標記區域;接著,電子裝置顯示教學介面,教學介面包含有待標記手術圖像區、已標記手術圖像區以及手術標記顯示區;接著,電子裝置將待標記手術圖像於待標記手術圖像區顯示,將已標記手術圖像於已標記手術圖像區顯示;最後,已標記手術圖像中的多個已填滿色彩的手術標記區域與待標記手術圖像相互映射,且手術標記顯示區中提供對應手術標記區域的輔助內容,以提供與待標記手術圖像對應的手術術式教學。First, the electronic device displays a user interface, which includes a surgical image selection area, a surgical image marking area, a marking recording area, a surgical video playback area, an image marking reference area, and a surgical marking selection area; then, the electronic device The surgical video is played in the surgical video playing area; then, when one of the names of the multiple surgical images to be marked displayed in the surgical image selection area is selected by the electronic device, the surgical image marking area displays and the selected one is displayed. The surgical image to be marked corresponding to the name of the surgical image to be marked; then, when one of the names of the multiple surgical images to be marked displayed in the surgical image selection area is selected by the electronic device, the image marking reference area displays and is displayed. The marked reference surgical image corresponding to the selected surgical image name to be marked; then, the electronic device establishes and displays a background mark in the mark recording area; then, one of the surgical mark blocks displayed by the electronic device in the surgical mark selection area is selected. When selecting, the surgical marking area is circled in the surgical image marking area; then, the electronic device fills the surgical marking area in the surgical image marking area with the color corresponding to the selected surgical marking area, and records in the marking recording area according to the color Create a name tag for the name corresponding to the selected surgical marking block; then, the electronic device stores the marked surgical image to be marked as a marked surgical image, and the marked surgical image includes a plurality of operations that have been filled with colors marking area; then, the electronic device displays a teaching interface, the teaching interface includes a surgical image area to be marked, a marked surgical image area, and a surgical marking display area; then, the electronic device displays the surgical image to be marked in the surgical image area to be marked Display, the marked surgical image is displayed in the marked surgical image area; finally, a plurality of color-filled surgical marked areas in the marked surgical image are mapped with the to-be-marked surgical image, and the surgical marked display area The auxiliary content corresponding to the surgical marking area is provided in the image to provide the surgical technique teaching corresponding to the surgical image to be marked.

本發明所揭露的系統及方法如上,與先前技術之間的差異在於當使用者介面的手術圖像選取區中待標記手術圖像名稱被選取時,使用者介面的手術圖像標記區顯示對應的待標記手術圖像,使用者介面的手術標記選取區中手術標記區塊被選取時,於手術圖像標記區進行手術標記區域的圈選以建立手術特徵標記,由教學介面對已標記的手術圖像與待標記手術圖像相互映射,以提供與待標記手術圖像對應的手術術式教學。The system and method disclosed in the present invention are as above, and the difference between the system and the prior art is that when the name of the surgical image to be marked is selected in the surgical image selection area of the user interface, the surgical image marking area of the user interface displays the corresponding The surgical image to be marked, when the surgical mark block is selected in the surgical mark selection area of the user interface, the surgical mark area is circled in the surgical image mark area to create a surgical feature mark, and the marked The surgical image and the to-be-marked surgical image are mapped to each other, so as to provide surgical technique teaching corresponding to the to-be-marked surgical image.

透過上述的技術手段,本發明可以達成透過標記參考手術圖像以輔助待標記手術圖像進行標記圈選進而提供手術術式教學的技術功效。Through the above-mentioned technical means, the present invention can achieve the technical effect of providing surgical technique teaching by marking the reference surgical image to assist the marking and circle selection of the surgical image to be marked.

以下將配合圖式及實施例來詳細說明本發明的實施方式,藉此對本發明如何應用技術手段來解決技術問題並達成技術功效的實現過程能充分理解並據以實施。The embodiments of the present invention will be described in detail below with the drawings and examples, so as to fully understand and implement the implementation process of how the present invention applies technical means to solve technical problems and achieve technical effects.

以下首先要說明本發明所揭露的手術術式標記與教學系統,並請參考「第1圖」所示,「第1圖」繪示為本發明手術術式標記與教學系統的系統方塊圖。The following first describes the surgical method marking and teaching system disclosed in the present invention, and please refer to FIG. 1, which is a system block diagram of the surgical method marking and teaching system of the present invention.

本發明所揭露的手術術式標記與教學系統,執行於電子裝置10,其包含:使用者介面模組11、影片播放模組12、顯示模組13、標記模組14、標記建立模組15、儲存模組16以及教學模組17。The surgical technique marking and teaching system disclosed in the present invention is executed in the electronic device 10 , and includes: a user interface module 11 , a video playing module 12 , a display module 13 , a marking module 14 , and a marking creation module 15 , storage module 16 and teaching module 17 .

使用者介面模組11是顯示使用者介面20,使用者介面20包含有手術圖像選取區21、手術圖像標記區22、標記記錄區23、手術影片播放區24、圖像標記參考區25以及手術標記選取區26,使用者介面20的示意請參考「第2圖」所示,「第2圖」繪示為本發明手術術式標記與教學的初始使用者介面示意圖。The user interface module 11 is to display the user interface 20 , and the user interface 20 includes a surgical image selection area 21 , a surgical image marking area 22 , a marking recording area 23 , a surgical video playing area 24 , and an image marking reference area 25 . As well as the operation marking selection area 26, please refer to "Fig. 2" for the schematic diagram of the user interface 20. "Fig. 2" is a schematic diagram of the initial user interface for marking and teaching the surgical procedure of the present invention.

手術圖像選取區21被設定自指定的資料夾中取得儲存於該指定的資料夾中多個待標記手術圖像的待標記手術圖像名稱,該指定的資料夾中所儲存的多個待標記手術圖像皆對應一個手術術式,手術圖像選取區21可以是由使用者拖曳指定的資料夾至手術圖像選取區21以設定指定的資料夾,手術圖像選取區21也可以是預先將指定的資料夾設定於手術術式標記與教學系統中,在此僅為舉例說明之,並不以此侷限本發明的應用範疇,手術圖像選取區21即可透過顯示模組13對多個待標記手術圖像名稱進行顯示,如「第3圖」所示,「第3圖」繪示為本發明手術術式標記與教學的使用者介面區域設定示意圖,待標記手術圖像名稱例如是:LC-00258802_1238824.png、LC-00258802_1240826.png、LC-00258802_1242828.png…等,在此僅為舉例說明之,並不以此侷限本發明的應用範疇。The surgical image selection area 21 is set to obtain the names of the to-be-marked surgical images of the plurality of to-be-marked surgical images stored in the designated folder, and the plurality of to-be-marked surgical images stored in the designated folder. The marked surgical images all correspond to a surgical procedure. The surgical image selection area 21 can be a specified folder by dragging the user to the surgical image selection area 21 to set the specified folder. The surgical image selection area 21 can also be The designated folder is pre-set in the surgical marking and teaching system, which is only for illustration, and does not limit the scope of application of the present invention. The surgical image selection area 21 can be paired with The names of a plurality of surgical images to be marked are displayed, as shown in "Figure 3", which is a schematic diagram of the user interface area setting for the marking and teaching of surgical procedures of the present invention, and the names of the surgical images to be marked For example: LC-00258802_1238824.png, LC-00258802_1240826.png, LC-00258802_1242828.png, etc., which are only illustrative, and do not limit the scope of application of the present invention.

手術影片播放區24被設定自指定的資料夾中取得儲存於該指定的資料夾中手術影片,手術影片亦是對應相同的手術術式,手術影片播放區24可以是由使用者拖曳指定的資料夾至手術影片播放區24以設定指定的資料夾,手術影片播放區24也可以是預先將指定的資料夾設定於手術術式標記與教學系統中,在此僅為舉例說明之,並不以此侷限本發明的應用範疇,手術影片播放區24即可透過影片播放模組12對手術影片進行播放,如「第3圖」所示。The surgical video playback area 24 is set to obtain the surgical video stored in the specified folder from a specified folder. The surgical video also corresponds to the same surgical procedure. The surgical video playback area 24 can be dragged by the user to specify the data. Folder to the surgical video playback area 24 to set the specified folder, the surgical video playback area 24 can also pre-set the specified folder in the surgical marking and teaching system, this is only for illustration, and does not use This limits the scope of application of the present invention, and the surgical video playing area 24 can play the surgical video through the video playing module 12 , as shown in FIG. 3 .

圖像標記參考區25被設定自指定的資料夾中取得儲存於該指定的資料夾中多個標記參考手術圖像其中之一以進行顯示,標記參考手術圖像是基於待標記手術圖像中進行註解說明、簡單標記…等的輔助參考圖象,圖像標記參考區25可以是由使用者拖曳指定的資料夾至圖像標記參考區25以設定指定的資料夾,圖像標記參考區25也可以是預先將指定的資料夾設定於手術術式標記與教學系統中,在此僅為舉例說明之,並不以此侷限本發明的應用範疇,圖像標記參考區25即可透過顯示模組13對對應的標記參考手術圖像進行顯示,值得注意的是,前述的手術圖像選取區21、手術影片播放區24以及圖像標記參考區25被設定的指定的資料夾是不相同的資料夾。The image marker reference area 25 is set to obtain one of a plurality of marked reference surgical images stored in the specified folder from a specified folder for display. The marked reference surgical image is based on the surgical image to be marked. Auxiliary reference images for annotations, simple marks, etc. The image mark reference area 25 can be a specified folder dragged by the user to the image mark reference area 25 to set the specified folder, and the image mark reference area 25 It is also possible to pre-set a designated folder in the surgical marking and teaching system. This is only an example, and does not limit the scope of application of the present invention. The image marking reference area 25 can be displayed through the display model. Group 13 displays the corresponding marked reference surgical images. It is worth noting that the specified folders set in the aforementioned surgical image selection area 21 , the surgical movie playback area 24 and the image mark reference area 25 are not the same Folder.

手術標記選取區26中提供多個手術標記區塊261的顯示,如「第2圖」以及「第3圖」所示,手術標記選取區26中顯示的多個手術標記區塊261將於後續說明對應的用途,手術標記區塊261可以是中的名稱可以是人體組織名稱(例如:Lymphoid tissue)、臟器名稱(例如:Gallbladder)、手術用具名稱(例如:scalpel)…等,在此僅為舉例說明之,並不以此侷限本發明的應用範疇,在圖式中。The surgical marker selection area 26 provides the display of a plurality of surgical marker blocks 261. As shown in "Fig. 2" and "Fig. 3", the plurality of surgical marker blocks 261 displayed in the surgical marker selection area 26 will be displayed in the following To describe the corresponding use, the name of the surgical marker block 261 can be the name of human tissue (for example: Lymphoid tissue), the name of an organ (for example: Gallbladder), the name of surgical tools (for example: scalpel)...etc. For the purpose of illustration and not to limit the scope of application of the present invention, the drawings are shown in the drawings.

請參考「第4圖」所示,「第4圖」繪示為本發明手術術式標記與教學的待標記手術圖像名稱選取使用者介面變化示意圖。Please refer to "Fig. 4". "Fig. 4" is a schematic diagram showing the change of the user interface for selecting the name of the surgical image to be marked for marking and teaching the surgical technique of the present invention.

當手術圖像選取區21中多個待標記手術圖像名稱其中之一(在實施例中待標記手術圖像名稱為“LC-00258802_1238824.png”被選取)被選取時,與被選取的待標記手術圖像名稱對應為“LC-00258802_1238824.png”的待標記手術圖像於手術圖像標記區22透過顯示模組13進行顯示,在此同時,與被選取的待標記手術圖像名稱對應為“LC-00258802_1238824.png”的標記參考手術圖像於圖像標記參考區25透過顯示模組13進行顯示,在手術圖像選取區21中多個待標記手術圖像名稱其中之一被選取時,標記建立模組15即可於標記記錄區23建立並顯示背景標記。When one of the names of a plurality of surgical images to be marked in the surgical image selection area 21 (in the embodiment, the name of the surgical image to be marked is “LC-00258802_1238824.png” is selected), the selected The surgical image to be marked whose name corresponds to "LC-00258802_1238824.png" is displayed in the surgical image marking area 22 through the display module 13. At the same time, it corresponds to the name of the selected surgical image to be marked. The marked reference surgical image "LC-00258802_1238824.png" is displayed in the image marking reference area 25 through the display module 13, and one of the names of the multiple surgical images to be marked is selected in the surgical image selection area 21 , the marker creation module 15 can create and display the background marker in the marker recording area 23 .

請參考「第5圖」所示,「第5圖」繪示為本發明手術術式標記與教學的標記過程使用者介面變化示意圖。Please refer to "Fig. 5". "Fig. 5" is a schematic diagram of the user interface change during the marking process of the surgical technique marking and teaching of the present invention.

當要對手術圖像標記區22顯示的待標記手術圖像進行標記時,藉由標記模組14於手術標記選取區26中選取手術標記區塊261,以於手術圖像標記區22進行手術標記區域221的圈選,手術標記區域221的圈選即是在手術圖像標記區22中對對應的人體組織、臟器、手術用具…等進行標記,手術圖像標記區22中圈選過程如「第5圖」中的虛線所示,在完成手術標記區域221的圈選時,手術圖像標記區22中以被選取手術標記區塊261對應的色彩填滿手術標記區域221,如「第6圖」所示,「第6圖」繪示為本發明手術術式標記與教學的標記結果使用者介面變化示意圖,在「第6圖」中是以填滿效果代表手術標記區域221的色彩填滿效果,在此僅為示意並不以此侷限本發明的應用範疇。When the surgical image to be marked displayed in the surgical image marking area 22 is to be marked, the marking module 14 selects the surgical marking area 261 in the surgical marking selection area 26 to perform surgery in the surgical image marking area 22 The circle selection of the marking area 221, the circle selection of the surgical marking area 221 is to mark the corresponding human tissues, organs, surgical tools, etc. in the surgical image marking area 22, and the encircling process in the surgical image marking area 22 As shown by the dotted line in "Fig. 5", when the selection of the surgical marking area 221 is completed, the surgical marking area 22 is filled with the color corresponding to the selected surgical marking area 261 in the surgical marking area 221, as shown in " As shown in Fig. 6, "Fig. 6" is a schematic diagram showing the change of the user interface of the marking result of the marking and teaching of surgical procedures of the present invention. In "Fig. 6", the filling effect is used to represent the surgical marking area 221. The color-filling effect is merely illustrative and does not limit the scope of application of the present invention.

值得注意的是,標記模組14於手術標記選取區26中選取手術標記區塊261時,此時,手術標記選取區26中的所有手術標記區塊將不再提供選取,並將所有的手術標記區塊變更為相同的呈現效果,在「第5圖」中則是以相同的灰階填滿效果進行呈現,在此僅為示意說明,並不以此侷限本發明的應用範疇。It is worth noting that when the marking module 14 selects the surgical marking block 261 in the surgical marking selection area 26, at this time, all the surgical marking blocks in the surgical marking selection area 26 will no longer be available for selection, and all surgical The marked blocks are changed to have the same presentation effect, and are presented with the same gray-scale filling effect in "FIG. 5", which is only for illustration and does not limit the scope of application of the present invention.

在此同時,標記建立模組15會於手術圖像標記區22進行手術標記區域221圈選後,於標記記錄區23依據被選取手術標記區塊261對應的名稱(在實施例中即是“S_VI”)建立名稱標記。At the same time, after the marking creation module 15 circles the surgical marking area 221 in the surgical image marking area 22, in the marking recording area 23 according to the name corresponding to the selected surgical marking area 261 (in the embodiment, it is "" S_VI") to create a name tag.

在不斷由標記模組14於手術標記選取區26中選取對應的手術標記區塊,以於手術圖像標記區22進行對應的手術標記區域圈選,最後完成待標記手術圖像所有應進行手術標記區域圈選的結果請參考「第7圖」所示,「第7圖」繪示為本發明手術術式標記與教學的待標記手術圖像的標記結果示意圖。The marking module 14 continuously selects the corresponding surgical marking area in the surgical marking selection area 26 to circle the corresponding surgical marking area in the surgical image marking area 22, and finally completes all surgical images to be marked that should be operated on. Please refer to "Fig. 7" for the result of the circle selection of the marked area. "Fig. 7" is a schematic diagram of the marking result of the surgical image to be marked for marking and teaching the surgical technique of the present invention.

值得注意的是,手術標記選取區26中顯示的手術標記區塊對應有不同的顯示優先權,手術圖像標記區22會以高顯示優先權的手術標記區塊填滿的手術標記區域總是顯示於低顯示優先權的手術標記區塊填滿的手術標記區域上方,在「第7圖」中即可得到手術標記區塊為“scalpel”的顯示優先權會高於手術標記區塊為“S_VI”、“Gallbladder”以及“S_IV”的顯示優先權,手術標記區塊為“foreign_material”的顯示優先權會高於手術標記區塊為 “S_VI”以及“Gallbladder”的顯示優先權,手術標記區塊為“S_VI”的顯示優先權會高於手術標記區塊為“Gallbladder”以及“S_IV”的顯示優先權,以及手術標記區塊為“Gallbladder”的顯示優先權會高於手術標記區塊為“S_IV”的顯示優先權。It is worth noting that the surgical mark blocks displayed in the surgical mark selection area 26 correspond to different display priorities, and the surgical mark area 22 will always be filled with the surgical mark blocks with high display priority. Displayed above the surgical marker area filled by the surgery marker block with low display priority, it can be seen in "Picture 7" that the display priority of the surgery marker block "scalpel" will be higher than that of the surgery marker block "Scalpel". The display priority of "S_VI", "Gallbladder" and "S_IV", the display priority of the surgery marker block "foreign_material" will be higher than the display priority of the surgery marker block "S_VI" and "Gallbladder", the surgery marker area The display priority of the block "S_VI" will be higher than the display priority of the surgery marker block "Gallbladder" and "S_IV", and the display priority of the surgery marker block "Gallbladder" will be higher than that of the surgery marker block. Display priority of "S_IV".

在完成待標記手術圖像所有應進行手術標記區域圈選後,即可透過儲存模組16將被標記完成的待標記手術圖像儲存為已標記手術圖像,已標記手術圖像包含有多個已填滿色彩的手術標記區域,已標記手術圖像即可提供後續對於該手術術式的教學。After completing the circle selection of all areas to be marked in the surgical image to be marked, the marked surgical image to be marked can be stored as a marked surgical image through the storage module 16 , and the marked surgical image contains multiple A color-filled surgical marking area, and the marked surgical image can provide subsequent teaching of the surgical procedure.

在需要進行手術術式的教學時,藉由教學模組17顯示包含有待標記手術圖像區31、已標記手術圖像區32以及手術標記顯示區33的教學介面30,教學介面30的示意,請參考「第8圖」所示,「第8圖」繪示為本發明手術術式標記與教學的教學介面示意圖,將待標記手術圖像於待標記手術圖像區31顯示,將已標記手術圖像於已標記手術圖像區32顯示,藉由已標記手術圖像中的多個已填滿色彩的手術標記區域與待標記手術圖像相互映射,且手術標記顯示區中提供對應手術標記區域33的輔助內容,以提供與待標記手術圖像對應的手術術式教學。When it is necessary to teach the surgical technique, the teaching module 17 displays the teaching interface 30 including the surgical image area 31 to be marked, the marked surgical image area 32 and the surgical mark display area 33 , and the schematic diagram of the teaching interface 30 , Please refer to "Fig. 8". "Fig. 8" is a schematic diagram of a teaching interface for marking and teaching surgical techniques according to the present invention. The surgical image to be marked is displayed in the surgical image area 31 to be marked, and The surgical image is displayed in the marked surgical image area 32, and a plurality of color-filled surgical marked areas in the marked surgical image are mapped to each other with the surgical image to be marked, and the corresponding surgical operation is provided in the surgical marked display area The auxiliary content of the marked area 33 is provided to provide the teaching of the surgical technique corresponding to the surgical image to be marked.

請參考「第9圖」所示,「第9圖」繪示為本發明手術術式標記與教學的手術圖像選取區的呈現效果示意圖。Please refer to "Fig. 9". "Fig. 9" is a schematic diagram showing the presentation effect of the surgical image selection area for marking and teaching the surgical procedure of the present invention.

當手術圖像選取區21中多個待標記手術圖像名稱其中之一(在實施例中待標記手術圖像名稱為“LC-00258802_1240826.png”被選取)被選取時,與被選取的待標記手術圖像名稱對應為“LC-00258802_1240826.png”的待標記手術圖像於手術圖像標記區22透過顯示模組13進行顯示,在此同時,與被選取的待標記手術圖像名稱對應為“LC-00258802_1240826.png”的標記參考手術圖像於圖像標記參考區25透過顯示模組13進行顯示,在手術圖像選取區21中多個待標記手術圖像名稱其中之一被選取時,標記建立模組15即可於標記記錄區23建立並顯示背景標記。When one of the names of a plurality of surgical images to be marked in the surgical image selection area 21 (in the embodiment, the name of the surgical image to be marked is “LC-00258802_1240826.png” is selected), the selected The surgical image to be marked whose name corresponds to "LC-00258802_1240826.png" is displayed in the surgical image marking area 22 through the display module 13. At the same time, it corresponds to the name of the selected surgical image to be marked. The marked reference surgical image "LC-00258802_1240826.png" is displayed in the image marking reference area 25 through the display module 13, and one of the names of the multiple surgical images to be marked is selected in the surgical image selection area 21 , the marker creation module 15 can create and display the background marker in the marker recording area 23 .

值得注意的是,於手術圖像選取區21以不同的背景樣式分別對待標記手術圖像名稱已進行標記、正在進行標記以及尚未進行標記進行對應的顯示呈現,在「第9圖」中,背景樣式為較深灰階背景的標記圖像名稱為“LC-00258802_1238824.png”即是已進行標記的待標記手術圖像,背景樣式為較淺灰階背景的標記圖像名稱為“LC-00258802_1240826.png”即是正在進行標記的待標記手術圖像,而無背景樣式的標記圖像名稱為“LC-00258802_1242828.png”以及“LC-00258802_1244830.png”即是尚未進行標記的待標記手術圖像,在此僅為舉例說明之,並不以此侷限本發明的應用範疇。It is worth noting that in the surgical image selection area 21, the names of the surgical images to be marked have been marked, are being marked, and have not been marked are displayed and presented in different background styles. In "Fig. 9", the background The name of the marked image with a darker grayscale background is "LC-00258802_1238824.png", which is the marked surgical image to be marked, and the name of the marked image with a lighter grayscale background is "LC-00258802_1240826 .png” is the surgical image to be marked that is being marked, and the marked image name without background style is “LC-00258802_1242828.png” and “LC-00258802_1244830.png” are the surgical images to be marked that have not been marked yet. Like, this is only for illustration, and does not limit the scope of application of the present invention.

影片播放模組12更進一步會於手術圖像選取區21中顯示的多個待標記手術圖像名稱其中之一被選取時,依據被選取的待標記手術圖像名稱的影片時間點自手術影片中擷取出影片時間點前後預設時間點為擷取手術影片,以進行擷取手術影片的播放。The video playback module 12 further will, when one of a plurality of surgical image names to be marked displayed in the surgical image selection area 21 is selected, select the selected surgical image name to be marked from the surgical video according to the video time point of the selected surgical image name to be marked. The preset time points before and after the time point when the video is captured in the middle are the captured surgery video, so as to play the captured surgery video.

具體而言,假設被選取的待標記手術圖像名稱的影片時間點為“00:30”,並且預設時間點為“10秒”,當該待標記手術圖像名稱於手術圖像選取區21中被選取時,影片播放模組12即會依影片時間點為“00:30”向前以及向後各“10秒”(即“00:20”至“00:40”的時間範圍)對手術影片進行影片的擷取為擷取手術影片以進行擷取手術影片的播放。Specifically, assuming that the movie time point of the selected surgical image name to be marked is "00:30" and the preset time point is "10 seconds", when the name of the surgical image to be marked is in the surgical image selection area When 21 is selected, the video playback module 12 will forward and backward each “10 seconds” (that is, the time range from “00:20” to “00:40”) according to the video time point “00:30”. The retrieving of the surgical video is the retrieving of the surgical video for playback of the retrieving surgical video.

接著,以下將說明本發明的運作方法,並請參考「第10A圖」以及「第10B圖」所示,「第10A圖」以及「第10B圖」繪示為本發明手術術式標記與教學方法的方法流程圖。Next, the operation method of the present invention will be described below, and please refer to "Fig. 10A" and "Fig. 10B". "Fig. 10A" and "Fig. 10B" are shown as the marking and teaching of the present invention. The method flow chart of the method.

本發明所揭露的手術術式標記與教學方法,其包含下列步驟:The surgical marking and teaching method disclosed by the present invention comprises the following steps:

首先,電子裝置顯示使用者介面,使用者介面包含有手術圖像選取區、手術圖像標記區、標記記錄區、手術影片播放區、圖像標記參考區以及手術標記選取區(步驟301);接著,電子裝置對手術影片於手術影片播放區中被播放(步驟302);接著,電子裝置於手術圖像選取區中顯示的多個待標記手術圖像名稱其中之一被選取時,手術圖像標記區顯示與被選取的待標記手術圖像名稱對應的待標記手術圖像(步驟303);接著,電子裝置於手術圖像選取區中顯示的多個待標記手術圖像名稱其中之一被選取時,圖像標記參考區顯示與被選取的待標記手術圖像名稱對應的標記參考手術圖像(步驟304);接著,電子裝置於手術圖像選取區中顯示的多個待標記手術圖像名稱其中之一被選取時,於標記記錄區建立並顯示背景標記(步驟305);接著,電子裝置於手術標記選取區中顯示的手術標記區塊其中之一被選取時,於手術圖像標記區進行手術標記區域的圈選(步驟306);接著,,電子裝置於手術圖像標記區中以被選取手術標記區塊對應的色彩填滿手術標記區域,並於標記記錄區依據被選取手術標記區塊對應的名稱建立名稱標記(步驟307);接著,電子裝置將被標記完成的待標記手術圖像儲存為已標記手術圖像,已標記手術圖像包含有多個已填滿色彩的手術標記區域(步驟308);接著,電子裝置顯示教學介面,教學介面包含有待標記手術圖像區、已標記手術圖像區以及手術標記顯示區(步驟309);接著,電子裝置將待標記手術圖像於待標記手術圖像區顯示,將已標記手術圖像於已標記手術圖像區顯示(步驟310);最後,已標記手術圖像中的多個已填滿色彩的手術標記區域與待標記手術圖像相互映射,且手術標記顯示區中提供對應手術標記區域的輔助內容,以提供與待標記手術圖像對應的手術術式教學(步驟311)。First, the electronic device displays a user interface, which includes a surgical image selection area, a surgical image marking area, a marking recording area, a surgical video playback area, an image marking reference area, and a surgical marking selection area (step 301 ); Next, the electronic device plays the surgical video in the surgical video playing area (step 302 ); then, when one of the names of the surgical images to be marked displayed in the surgical image selection area is selected by the electronic device, the surgical image is selected. The image marking area displays the surgical image to be marked corresponding to the name of the selected surgical image to be marked (step 303 ); then, the electronic device displays one of the names of the surgical image to be marked in the surgical image selection area When selected, the marked reference surgical image corresponding to the name of the selected surgical image to be marked is displayed in the image marking reference area (step 304 ); then, the electronic device displays a plurality of surgical images to be marked in the surgical image selection area When one of the image names is selected, a background mark is created and displayed in the mark recording area (step 305 ); then, when one of the surgical mark blocks displayed in the surgical mark selection area is selected by the electronic device, the operation diagram is Then, the electronic device fills the surgical marking area in the surgical image marking area with the color corresponding to the selected surgical marking area, and records the surgical marking area in the marking recording area according to the selected operation marking area. Select the name corresponding to the surgical mark block to create a name mark (step 307 ); then, the electronic device stores the marked surgical image to be marked as a marked surgical image, and the marked surgical image includes a plurality of filled surgical images. Colored surgical marking area (step 308 ); then, the electronic device displays a teaching interface, which includes the surgical image area to be marked, the marked surgical image area, and the surgical marking display area (step 309 ); The marked surgical image is displayed in the to-be-marked surgical image area, and the marked surgical image is displayed in the marked surgical image area (step 310 ); finally, a plurality of color-filled surgical marks in the marked surgical image are marked The area and the surgical image to be marked are mapped to each other, and auxiliary content corresponding to the surgically marked area is provided in the surgical mark display area, so as to provide surgical technique teaching corresponding to the surgical image to be marked (step 311 ).

綜上所述,可知本發明與先前技術之間的差異在於當使用者介面的手術圖像選取區中待標記手術圖像名稱被選取時,使用者介面的手術圖像標記區顯示對應的待標記手術圖像,使用者介面的手術標記選取區中手術標記區塊被選取時,於手術圖像標記區進行手術標記區域的圈選以建立手術特徵標記,由教學介面對已標記的手術圖像與待標記手術圖像相互映射,以提供與待標記手術圖像對應的手術術式教學。To sum up, it can be seen that the difference between the present invention and the prior art is that when the name of the surgical image to be marked is selected in the surgical image selection area of the user interface, the surgical image marking area of the user interface displays the corresponding to-be-marked surgical image. Mark the surgical image. When the surgical mark block is selected in the surgical mark selection area of the user interface, circle the surgical mark area in the surgical image mark area to create a surgical feature mark, and use the teaching interface for the marked surgical map The image and the surgical image to be marked are mapped to each other, so as to provide surgical technique teaching corresponding to the surgical image to be marked.

藉由此一技術手段可以來解決先前技術所存在透過手術術式影片進行醫學教學未能提供輔助工具以進行標記輔助教學的問題,進而達成透過標記參考手術圖像以輔助待標記手術圖像進行標記圈選進而提供手術術式教學的技術功效。This technical means can solve the problem in the prior art that medical teaching through surgical video cannot provide auxiliary tools for marking auxiliary teaching, so as to assist in marking the reference surgical image to assist the marking of the surgical image to be marked. Mark the circle selection and then provide the technical effect of surgical operation teaching.

雖然本發明所揭露的實施方式如上,惟所述的內容並非用以直接限定本發明的專利保護範圍。任何本發明所屬技術領域中具有通常知識者,在不脫離本發明所揭露的精神和範圍的前提下,可以在實施的形式上及細節上作些許的更動。本發明的專利保護範圍,仍須以所附的申請專利範圍所界定者為準。Although the embodiments disclosed in the present invention are as above, the above-mentioned contents are not used to directly limit the scope of the patent protection of the present invention. Anyone with ordinary knowledge in the technical field to which the present invention pertains can make some changes in the form and details of the implementation without departing from the spirit and scope of the present invention. The scope of patent protection of the present invention shall still be defined by the scope of the appended patent application.

10:電子裝置 11:使用者介面模組 12:影片播放模組 13:顯示模組 14:標記模組 15:標記建立模組 16:儲存模組 17:教學模組 20:使用者介面 21:手術圖像選取區 22:手術圖像標記區 221:手術標記區域 23:標記記錄區 24:手術影片播放區 25:圖像標記參考區 26:手術標記選取區 261:手術標記區塊 30:教學介面 31:待標記手術圖像區 32:已標記手術圖像區 33:手術標記顯示區 步驟 301:電子裝置顯示使用者介面,使用者介面包含有手術圖像選取區、手術圖像標記區、標記記錄區、手術影片播放區、圖像標記參考區以及手術標記選取區 步驟 302:電子裝置對手術影片於手術影片播放區中被播放 步驟 303:電子裝置於手術圖像選取區中顯示的多個待標記手術圖像名稱其中之一被選取時,手術圖像標記區顯示與被選取的待標記手術圖像名稱對應的待標記手術圖像 步驟 304:電子裝置於手術圖像選取區中顯示的多個待標記手術圖像名稱其中之一被選取時,圖像標記參考區顯示與被選取的待標記手術圖像名稱對應的標記參考手術圖像 步驟 305:電子裝置於手術圖像選取區中顯示的多個待標記手術圖像名稱其中之一被選取時,於標記記錄區建立並顯示背景標記 步驟 306:電子裝置於手術標記選取區中顯示的手術標記區塊其中之一被選取時,於手術圖像標記區進行手術標記區域的圈選 步驟 307:電子裝置於手術圖像標記區中以被選取手術標記區塊對應的色彩填滿手術標記區域,並於標記記錄區依據被選取手術標記區塊對應的名稱建立名稱標記 步驟 308:電子裝置將被標記完成的待標記手術圖像儲存為已標記手術圖像,已標記手術圖像包含有多個已填滿色彩的手術標記區域 步驟 309:電子裝置顯示教學介面,教學介面包含有待標記手術圖像區、已標記手術圖像區以及手術標記顯示區 步驟 310:電子裝置將待標記手術圖像於待標記手術圖像區顯示,將已標記手術圖像於已標記手術圖像區顯示 步驟 311:已標記手術圖像中的多個已填滿色彩的手術標記區域與待標記手術圖像相互映射,且手術標記顯示區中提供對應手術標記區域的輔助內容,以提供與待標記手術圖像對應的手術術式教學10: Electronics 11: User Interface Modules 12: Video playback module 13: Display module 14: Tag Module 15: Tag Build Module 16: Storage Module 17: Teaching Module 20: User Interface 21: Surgical image selection area 22: Surgical image marking area 221: Surgical marked area 23: Mark record area 24: Surgery video playback area 25: Image marker reference area 26: Surgical marker selection area 261: Surgical Marker Block 30: Teaching interface 31: The surgical image area to be marked 32: Marked surgical image area 33: Surgery marker display area Step 301: The electronic device displays a user interface, the user interface includes a surgical image selection area, a surgical image marking area, a marking recording area, a surgical video playback area, an image marking reference area, and a surgical marking selection area Step 302: The electronic device plays the operation video in the operation video playback area Step 303: When one of the names of the multiple surgical images to be marked displayed in the surgical image selection area is selected by the electronic device, the surgical image marking area displays the operation to be marked corresponding to the name of the selected surgical image to be marked. image Step 304: When one of the names of the multiple surgical images to be marked displayed in the surgical image selection area is selected by the electronic device, the image marking reference area displays the marked reference operation corresponding to the name of the selected surgical image to be marked. image Step 305: When one of the names of a plurality of surgical images to be marked displayed in the surgical image selection area is selected, the electronic device creates and displays a background mark in the mark recording area Step 306: When one of the surgical marking blocks displayed in the surgical marking selection area is selected, the electronic device performs a circle selection of the surgical marking area in the surgical image marking area Step 307: The electronic device fills the surgical marking area with the color corresponding to the selected surgical marking block in the surgical image marking area, and creates a name mark in the marking recording area according to the name corresponding to the selected surgical marking block Step 308: The electronic device stores the marked surgical image to be marked as a marked surgical image, and the marked surgical image includes a plurality of color-filled surgical marked areas Step 309: The electronic device displays a teaching interface, which includes a surgical image area to be marked, a marked surgical image area, and a surgical mark display area Step 310: The electronic device displays the surgical image to be marked in the surgical image area to be marked, and displays the marked surgical image in the marked surgical image area Step 311: A plurality of color-filled surgical marking areas in the marked surgical image are mapped to the to-be-marked surgical image, and auxiliary contents corresponding to the surgically marked areas are provided in the surgical marking display area, so as to provide the corresponding surgical marking area. Teaching of surgical techniques corresponding to images

第1圖繪示為本發明手術術式標記與教學系統的系統方塊圖。 第2圖繪示為本發明手術術式標記與教學的初始使用者介面示意圖。 第3圖繪示為本發明手術術式標記與教學的使用者介面區域設定示意圖。 第4圖繪示為本發明手術術式標記與教學的待標記手術圖像名稱選取使用者介面變化示意圖。 第5圖繪示為本發明手術術式標記與教學的標記過程使用者介面變化示意圖。 第6圖繪示為本發明手術術式標記與教學的標記結果使用者介面變化示意圖。 第7圖繪示為本發明手術術式標記與教學的待標記手術圖像的標記結果示意圖。 第8圖繪示為本發明手術術式標記與教學的教學介面示意圖。 第9圖繪示為本發明手術術式標記與教學的手術圖像選取區的呈現效果示意圖。 第10A圖以及第10B圖繪示為本發明手術術式標記與教學方法的方法流程圖。 FIG. 1 is a system block diagram of the surgical technique marking and teaching system of the present invention. FIG. 2 is a schematic diagram of an initial user interface for marking and teaching surgical procedures according to the present invention. FIG. 3 is a schematic diagram showing the setting of the user interface area for the marking and teaching of surgical procedures according to the present invention. FIG. 4 is a schematic diagram showing the change of the user interface for selecting the name of the surgical image to be marked for marking and teaching the surgical technique according to the present invention. FIG. 5 is a schematic diagram showing the change of the user interface during the marking process of the surgical technique marking and teaching of the present invention. FIG. 6 is a schematic diagram showing the change of the user interface of the marking result of the marking and teaching of the surgical technique according to the present invention. FIG. 7 is a schematic diagram illustrating the marking result of the surgical image to be marked for marking and teaching the surgical technique according to the present invention. FIG. 8 is a schematic diagram of a teaching interface for marking and teaching a surgical procedure according to the present invention. FIG. 9 is a schematic diagram showing the presentation effect of the surgical image selection area for marking and teaching the surgical procedure according to the present invention. FIG. 10A and FIG. 10B are flowcharts of the method of marking and teaching the surgical procedure according to the present invention.

10:電子裝置 10: Electronics

11:使用者介面模組 11: User Interface Modules

12:影片播放模組 12: Video playback module

13:顯示模組 13: Display module

14:標記模組 14: Tag Module

15:標記建立模組 15: Tag Build Module

16:儲存模組 16: Storage Module

17:教學模組 17: Teaching Module

Claims (10)

一種手術術式標記與教學系統,執行於一電子裝置,其包含: 一使用者介面模組,顯示一使用者介面,所述使用者介面包含有一手術圖像選取區、一手術圖像標記區、一標記記錄區、一手術影片播放區、一圖像標記參考區以及一手術標記選取區; 一影片播放模組,將一手術影片於所述手術影片播放區中進行播放; 一顯示模組,於所述手術圖像選取區中顯示的多個待標記手術圖像名稱其中之一被選取時,與被選取的所述待標記手術圖像名稱對應的待標記手術圖像於所述手術圖像標記區進行顯示,以及與被選取的所述待標記手術圖像名稱對應的標記參考手術圖像於所述圖像標記參考區進行顯示; 一標記模組,於所述手術標記選取區中顯示的手術標記區塊其中之一被選取時,於所述手術圖像標記區進行一手術標記區域的圈選,並於手術圖像標記區中以被選取所述手術標記區塊對應的色彩填滿所述手術標記區域; 一標記建立模組,於所述標記記錄區建立並顯示一背景標記,以及於所述手術圖像標記區進行所述手術標記區域圈選後,於所述標記記錄區依據被選取所述手術標記區塊對應的名稱建立一名稱標記; 一儲存模組,將被標記完成的所述待標記手術圖像儲存為一已標記手術圖像,所述已標記手術圖像包含有多個已填滿色彩的手術標記區域;及 一教學模組,顯示一教學介面,所述教學介面包含有一待標記手術圖像區、一已標記手術圖像區以及一手術標記顯示區,將所述待標記手術圖像於所述待標記手術圖像區顯示,將所述已標記手術圖像於所述已標記手術圖像區顯示,藉由所述已標記手術圖像中的多個已填滿色彩的手術標記區域與所述待標記手術圖像相互映射,且所述手術標記顯示區中提供對應手術標記區域的輔助內容,以提供與待標記手術圖像對應的手術術式教學。 A surgical procedure marking and teaching system implemented in an electronic device, comprising: A user interface module displays a user interface, the user interface includes a surgical image selection area, a surgical image marking area, a marking recording area, a surgical video playing area, and an image marking reference area and a surgical marker selection area; a video playing module, which plays a surgical video in the surgical video playing area; a display module, when one of the names of a plurality of surgical images to be marked displayed in the surgical image selection area is selected, the surgical image to be marked corresponding to the name of the selected surgical image to be marked is selected Displaying in the surgical image marking area, and displaying the marked reference surgical image corresponding to the name of the selected surgical image to be marked in the image marking reference area; A marking module, when one of the surgical marking blocks displayed in the surgical marking selection area is selected, performing a circle selection of a surgical marking area in the surgical image marking area, and selecting a surgical marking area in the surgical image marking area Filling the surgical marking area with the color corresponding to the selected surgical marking block; a mark establishing module, for establishing and displaying a background mark in the mark recording area, and after the operation mark area is circled in the operation image mark area, the operation is selected in the mark record area according to the selected operation Create a name tag for the name corresponding to the tag block; a storage module for storing the marked surgical image to be marked as a marked surgical image, wherein the marked surgical image includes a plurality of color-filled surgical marking areas; and a teaching module, displaying a teaching interface, the teaching interface includes an operation image area to be marked, a marked operation image area and an operation mark display area, the operation image to be marked is displayed in the operation image area to be marked The operation image area is displayed, and the marked operation image is displayed in the marked operation image area. The marked surgical images are mapped to each other, and auxiliary content corresponding to the surgical marked area is provided in the surgical marked display area, so as to provide surgical technique teaching corresponding to the surgical image to be marked. 如請求項1所述的手術術式標記與教學系統,其中所述影片播放模組更包含於所述手術圖像選取區中顯示的多個待標記手術圖像名稱其中之一被選取時,依據被選取的所述待標記手術圖像名稱的一影片時間點自所述手術影片中擷取出所述影片時間點前後預設時間點為一擷取手術影片,以進行所述擷取手術影片的播放。The surgical technique marking and teaching system as claimed in claim 1, wherein the video playback module further comprises that when one of the names of a plurality of surgical images to be marked displayed in the surgical image selection area is selected, According to a video time point of the selected name of the surgical image to be marked, a preset time point before and after the video time point is extracted from the surgical video as a captured surgical video, so as to perform the capture of the surgical video 's playback. 如請求項1所述的手術術式標記與教學系統,其中所述顯示模組更包含於所述手術圖像選取區以不同的背景樣式分別對所述待標記手術圖像名稱已進行標記、正在進行標記以及尚未進行標記進行對應的顯示呈現。The surgical method marking and teaching system according to claim 1, wherein the display module further comprises: in the surgical image selection area, the names of the surgical images to be marked have been marked with different background styles, Marking is in progress and has not been marked for corresponding display rendering. 如請求項1所述的手術術式標記與教學系統,其中所述標記模組於所述手術標記選取區中顯示的手術標記區塊其中之一被選取時,所述手術標記選取區中的所有手術標記區塊將不再提供選取,並將所有的手術標記區塊變更為相同的呈現效果。The surgical method marking and teaching system according to claim 1, wherein when one of the surgical marking blocks displayed in the surgical marking selection area is selected by the marking module, the All surgical marker blocks will no longer be available for selection, and all surgical marker blocks will be changed to the same rendering. 如請求項1所述的手術術式標記與教學系統,其中所述手術標記區塊對應有不同的顯示優先權,以高顯示優先權的所述手術標記區塊填滿的所述手術標記區域總是顯示於低顯示優先權的所述手術標記區塊填滿的所述手術標記區域上方。The surgical marking and teaching system according to claim 1, wherein the surgical marking blocks correspond to different display priorities, and the surgical marking area filled with the surgical marking block with a high display priority is used Always display above the surgical marking area filled with the surgical marking block of low display priority. 一種手術術式標記與教學方法,其包含下列步驟: 一電子裝置顯示一使用者介面,所述使用者介面包含有一手術圖像選取區、一手術圖像標記區、一標記記錄區、一手術影片播放區、一圖像標記參考區以及一手術標記選取區; 所述電子裝置對一手術影片於所述手術影片播放區中被播放; 所述電子裝置於所述手術圖像選取區中顯示的多個待標記手術圖像名稱其中之一被選取時,所述手術圖像標記區顯示與被選取的所述待標記手術圖像名稱對應的待標記手術圖像; 所述電子裝置於所述手術圖像選取區中顯示的多個待標記手術圖像名稱其中之一被選取時,所述圖像標記參考區顯示與被選取的所述待標記手術圖像名稱對應的標記參考手術圖像; 所述電子裝置於所述標記記錄區建立並顯示一背景標記; 所述電子裝置於所述手術標記選取區中顯示的手術標記區塊其中之一被選取時,於所述手術圖像標記區進行一手術標記區域的圈選; 所述電子裝置於手術圖像標記區中以被選取所述手術標記區塊對應的色彩填滿所述手術標記區域,並於所述標記記錄區依據被選取所述手術標記區塊對應的名稱建立一名稱標記; 所述電子裝置將被標記完成的所述待標記手術圖像儲存為一已標記手術圖像,所述已標記手術圖像包含有多個已填滿色彩的手術標記區域; 所述電子裝置顯示一教學介面,所述教學介面包含有一待標記手術圖像區、一已標記手術圖像區以及一手術標記顯示區; 所述電子裝置將所述待標記手術圖像於所述待標記手術圖像區顯示,將所述已標記手術圖像於所述已標記手術圖像區顯示;及 所述已標記手術圖像中的多個已填滿色彩的手術標記區域與所述待標記手術圖像相互映射,且所述手術標記顯示區中提供對應手術標記區域的輔助內容,以提供與待標記手術圖像對應的手術術式教學。 A surgical procedure marking and teaching method, comprising the following steps: An electronic device displays a user interface, the user interface includes a surgical image selection area, a surgical image marking area, a marking recording area, a surgical video playback area, an image marking reference area, and a surgical mark selection area; The electronic device plays a surgical video in the surgical video playing area; When one of the names of a plurality of surgical images to be marked displayed in the surgical image selection area is selected by the electronic device, the surgical image marking area displays the name of the selected surgical image to be marked. The corresponding surgical image to be marked; When one of the names of a plurality of surgical images to be marked displayed in the surgical image selection area is selected by the electronic device, the image marking reference area displays the name of the selected surgical image to be marked. The corresponding marked reference surgical image; The electronic device creates and displays a background mark in the mark recording area; When one of the surgical mark blocks displayed in the surgical mark selection area is selected, the electronic device performs a circle selection of a surgical mark area in the surgical image mark area; The electronic device fills the surgical marking area with the color corresponding to the selected surgical marking block in the surgical image marking area, and in the marking recording area according to the name corresponding to the selected surgical marking block create a name tag; The electronic device stores the marked surgical image to be marked as a marked surgical image, and the marked surgical image includes a plurality of color-filled surgical marked areas; The electronic device displays a teaching interface, the teaching interface includes an operation image area to be marked, a marked operation image area, and an operation mark display area; The electronic device displays the surgical image to be marked in the surgical image area to be marked, and displays the marked surgical image in the marked surgical image area; and A plurality of color-filled surgical marking areas in the marked surgical image are mapped to each other with the to-be-marked surgical image, and auxiliary content corresponding to the surgical marking area is provided in the surgical marking display area, so as to provide an auxiliary content corresponding to the surgical marking area. The surgical technique teaching corresponding to the surgical image to be marked. 如請求項6所述的手術術式標記與教學方法,其中所述手術術式標記與教學方法更包含所述電子裝置於所述手術圖像選取區中顯示的多個待標記手術圖像名稱其中之一被選取時,依據被選取的所述待標記手術圖像名稱的一影片時間點自所述手術影片中擷取出所述影片時間點前後預設時間點為一擷取手術影片,以進行所述擷取手術影片的播放的步驟。The surgical procedure marking and teaching method according to claim 6, wherein the surgical procedure marking and teaching method further comprise a plurality of surgical image names to be marked displayed by the electronic device in the surgical image selection area When one of them is selected, according to a video time point of the selected surgical image name to be marked, a preset time point before and after the video time point is extracted from the surgical video as a captured surgical video, so as to The step of playing the captured surgical video is performed. 如請求項6所述的手術術式標記與教學方法,其中所述手術術式標記與教學方法更包含所述電子裝置於所述手術圖像選取區以不同的背景樣式分別對所述待標記手術圖像名稱已進行標記、正在進行標記以及尚未進行標記進行對應的顯示呈現的步驟。The surgical procedure marking and teaching method according to claim 6, wherein the surgical procedure marking and teaching method further comprise the electronic device marking the to-be-marked with different background styles in the surgical image selection area. The surgical image name has been marked, is marked, and has not been marked for corresponding display presentation steps. 如請求項6所述的手術術式標記與教學方法,其中所述手術術式標記與教學方法更包含所述電子裝置於所述手術標記選取區中顯示的手術標記區塊其中之一被選取時,所述手術標記選取區中的所有手術標記區塊將不再提供選取,並將所有的手術標記區塊變更為相同的呈現效果。The surgical procedure marking and teaching method according to claim 6, wherein the surgical procedure marking and teaching method further comprise that one of the surgical mark blocks displayed by the electronic device in the surgical mark selection area is selected , all surgical mark blocks in the surgical mark selection area will no longer be available for selection, and all surgical mark blocks will be changed to the same presentation effect. 如請求項6所述的手術術式標記與教學方法,其中所述手術術式標記與教學方法更包含所述手術標記區塊對應有不同的顯示優先權,所述電子裝置以高顯示優先權的所述手術標記區塊填滿的所述手術標記區域總是顯示於低顯示優先權的所述手術標記區塊填滿的所述手術標記區域上方的步驟。The surgical procedure marking and teaching method according to claim 6, wherein the surgical procedure marking and teaching method further include that the surgical marking blocks have different display priorities, and the electronic device has a higher display priority. The surgical marker area filled by the surgical marker block is always displayed in a step above the surgical marker area filled by the surgical marker block of lower display priority.
TW110149132A 2021-12-28 2021-12-28 Marking and teaching of surgical procedure system and method thereof TWI778900B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW110149132A TWI778900B (en) 2021-12-28 2021-12-28 Marking and teaching of surgical procedure system and method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW110149132A TWI778900B (en) 2021-12-28 2021-12-28 Marking and teaching of surgical procedure system and method thereof

Publications (2)

Publication Number Publication Date
TWI778900B true TWI778900B (en) 2022-09-21
TW202326643A TW202326643A (en) 2023-07-01

Family

ID=84958363

Family Applications (1)

Application Number Title Priority Date Filing Date
TW110149132A TWI778900B (en) 2021-12-28 2021-12-28 Marking and teaching of surgical procedure system and method thereof

Country Status (1)

Country Link
TW (1) TWI778900B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI838198B (en) * 2023-03-31 2024-04-01 慧術科技股份有限公司 Medical dynamic video contrast teaching system and method thereof

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106456148A (en) * 2014-03-19 2017-02-22 直观外科手术操作公司 Medical devices, systems, and methods using eye gaze tracking
CN110996748A (en) * 2018-05-23 2020-04-10 威博外科公司 Surgical video analysis system for machine learning
CN111050683A (en) * 2017-09-06 2020-04-21 威里利生命科学有限责任公司 Surgical identification system
TW202042738A (en) * 2019-05-21 2020-12-01 臺北醫學大學 Smart marking system for surgical video and method thereof
CN212570078U (en) * 2020-02-11 2021-02-19 中国医学科学院北京协和医院 A teaching system for bone tumor surgery based on mixed reality technology
CN112618026A (en) * 2020-12-15 2021-04-09 清华大学 Remote operation data fusion interactive display system and method
US20210251570A1 (en) * 2018-12-26 2021-08-19 3D Medivision Inc. Surgical video creation system
US20210282892A1 (en) * 2018-12-05 2021-09-16 3D Medivision Inc. Surgical video production system and surgical video production method
CN113742527A (en) * 2021-11-08 2021-12-03 成都与睿创新科技有限公司 Method and system for retrieving and extracting operation video clips based on artificial intelligence

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106456148A (en) * 2014-03-19 2017-02-22 直观外科手术操作公司 Medical devices, systems, and methods using eye gaze tracking
CN111050683A (en) * 2017-09-06 2020-04-21 威里利生命科学有限责任公司 Surgical identification system
CN110996748A (en) * 2018-05-23 2020-04-10 威博外科公司 Surgical video analysis system for machine learning
US20210282892A1 (en) * 2018-12-05 2021-09-16 3D Medivision Inc. Surgical video production system and surgical video production method
US20210251570A1 (en) * 2018-12-26 2021-08-19 3D Medivision Inc. Surgical video creation system
TW202042738A (en) * 2019-05-21 2020-12-01 臺北醫學大學 Smart marking system for surgical video and method thereof
CN212570078U (en) * 2020-02-11 2021-02-19 中国医学科学院北京协和医院 A teaching system for bone tumor surgery based on mixed reality technology
CN112618026A (en) * 2020-12-15 2021-04-09 清华大学 Remote operation data fusion interactive display system and method
CN113742527A (en) * 2021-11-08 2021-12-03 成都与睿创新科技有限公司 Method and system for retrieving and extracting operation video clips based on artificial intelligence

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI838198B (en) * 2023-03-31 2024-04-01 慧術科技股份有限公司 Medical dynamic video contrast teaching system and method thereof

Also Published As

Publication number Publication date
TW202326643A (en) 2023-07-01

Similar Documents

Publication Publication Date Title
US20230260413A1 (en) Surgical procedure labeling and teaching system and method thereof
US7231135B2 (en) Computer-based video recording and management system for medical diagnostic equipment
CN111832274B (en) Rich media editing method, generation method, device and system in intelligent teaching materials
CN1680963B (en) Medical report making device, medical report reference device, and medical report making method
CN114128304B (en) Method and system for synchronizing surgical videos for comparative learning
US6675352B1 (en) Method of and apparatus for editing annotation command data
JP2007313362A (en) Apparatus for teaching body motions
CN1662934A (en) Job guiding system
TWI778900B (en) Marking and teaching of surgical procedure system and method thereof
WO2020202527A1 (en) Image recorder
RU2347285C1 (en) Device of record/playback and method of guidance concerning to it data mapped on display
CN112434652A (en) Intelligent visual operation record editing method and system
KR20150081750A (en) System and method for analyzing a golf swing
Wijayanti et al. Upgrading videography knowledge and skills in making Canva-based learning videos for elementary school teachers
DE10106394C2 (en) Process for generating documented medical image information
Balogh et al. Multilayer image grid reconstruction technology: four-dimensional interactive image reconstruction of microsurgical neuroanatomic dissections
Vannaprathip et al. Desitra: A simulator for teaching situated decision making in dental surgery
JP6426867B1 (en) Video viewing apparatus, control method for video viewing apparatus, and program
JP2019185726A (en) Video browsing device, control method of video browsing device, and program
JP2014059452A (en) Learning device, control method of the same, learning program, and learning system
JP2006208784A (en) Education system, device control method
JP2024175148A (en) Digital Twin Conference Holding Device and 3D Data Manufacturing Method
Vejnović et al. Newly developed three-dimensional animation of uterine closure according to the modified technique of cesarean section by Vejnović
JP2016058112A (en) Data management program and data management device
JP3865146B2 (en) Special effect device and special effect system

Legal Events

Date Code Title Description
GD4A Issue of patent certificate for granted invention patent