TWI838198B - Medical dynamic video contrast teaching system and method thereof - Google Patents
Medical dynamic video contrast teaching system and method thereof Download PDFInfo
- Publication number
- TWI838198B TWI838198B TW112112568A TW112112568A TWI838198B TW I838198 B TWI838198 B TW I838198B TW 112112568 A TW112112568 A TW 112112568A TW 112112568 A TW112112568 A TW 112112568A TW I838198 B TWI838198 B TW I838198B
- Authority
- TW
- Taiwan
- Prior art keywords
- marked
- area
- video
- surgical
- original
- Prior art date
Links
Images
Landscapes
- Magnetic Resonance Imaging Apparatus (AREA)
- Apparatus For Radiation Diagnosis (AREA)
Abstract
Description
一種教學系統及其方法,尤其是指一種提供醫學原始手術影片與標記手術影片相互對照的標記教學系統及其方法。A teaching system and method thereof, in particular, a marking teaching system and method thereof for providing a comparison between original medical surgical videos and marked surgical videos.
有鑒於影片技術的發展,透過影片進行教學也逐漸的被實現,醫學的教學上可透過影片進一步得到提升,即在醫學的手術過程中,可以透過拍攝方式對手術術式進行影片的紀錄,在後續的醫學教學中,即可透過影片的播放並配合教師的說明以實現該手術術式的教學。With the development of video technology, teaching through video has gradually been realized. Medical teaching can be further improved through video. That is, during the medical operation, the surgical procedure can be recorded by filming. In subsequent medical teaching, the surgical procedure can be taught through video playback and the teacher's explanation.
然而,若是沒有配合教師的說明,僅單純的提供影片來進行手術術式的學習,無疑是非常困難的事情,亦即影片的播放缺少部位的標記說明來輔助學習,使沒有配合教師的說明的情況下,仍可以透過影片進行手術術式的學習將是本發明所期待的目標。However, if there is no teacher's explanation, it is undoubtedly very difficult to learn the surgical procedure by simply providing a video. That is, the video playback lacks the marking of the parts to assist learning. The goal of the present invention is to enable learning of the surgical procedure through the video without the teacher's explanation.
綜上所述,可知先前技術中長期以來一直存在醫學影片播放時缺乏標記對照以輔助學習的問題,因此有必要提出改進的技術手段,來解決此一問題。In summary, it can be seen that the prior art has long had the problem of lack of markings to assist learning when playing medical videos, so it is necessary to propose improved technical means to solve this problem.
有鑒於先前技術存在醫學影片播放時缺乏標記對照以輔助學習的問題,本發明遂揭露一種醫學動態影片對照教學系統及其方法,其中:In view of the problem that the prior art lacks marked comparison to assist learning when playing medical videos, the present invention discloses a medical dynamic video comparison teaching system and method, wherein:
本發明所揭露的醫學動態影片對照教學系統,該系統包含:影像資料庫以及電腦設備,電腦設備連接影像資料庫,電腦設備包含:非暫態電腦可讀儲存媒體以及硬體處理器。The medical dynamic video comparison teaching system disclosed by the present invention comprises: an image database and a computer device, the computer device is connected to the image database, and the computer device comprises: a non-transient computer-readable storage medium and a hardware processor.
影像資料庫儲存有多筆影像資料,每一筆影像資料包含原始手術影片、標記手術影片以及標記手術影片的多個影格(frame)顯示資訊,每一個影格資訊包含至少一標記區域、與所述至少一標記區域對應的唯一色碼以及與至少一標記區域對應的區域說明。The image database stores a plurality of image data, each of which includes an original surgical video, a marked surgical video, and a plurality of frame display information of the marked surgical video, and each frame information includes at least one marked area, a unique color code corresponding to the at least one marked area, and an area description corresponding to the at least one marked area.
非暫態電腦可讀儲存媒體用以儲存多個電腦可讀程式指令;硬體處理器電性連接非暫態電腦可讀儲存媒體,硬體處理器被配置為執行所述電腦可讀程式指令以執行:The non-transitory computer-readable storage medium is used to store a plurality of computer-readable program instructions; the hardware processor is electrically connected to the non-transitory computer-readable storage medium, and the hardware processor is configured to execute the computer-readable program instructions to execute:
使用者介面顯示模組顯示包含有原始影片播放區、標記影片播放區以及手術特徵標記說明區的使用者介面。The user interface display module displays a user interface including an original video playback area, a marked video playback area, and a surgical feature mark description area.
影片播放模組於原始影片播放區中播放原始手術影片或是於標記影片播放區播放標記手術影片時,自影像資料庫查詢出對應的標記手術影片或是原始手術影片,以於標記影片播放區播放被查詢出的標記手術影片或是於原始影片播放區中播放原始手術影片。When the video playback module plays the original surgical video in the original video playback area or plays the marked surgical video in the marked video playback area, it searches for the corresponding marked surgical video or original surgical video from the image database to play the searched marked surgical video in the marked video playback area or the original surgical video in the original video playback area.
標記區域模組於標記影片播放區播放標記手術影片時,依據標記手術影片的每一個影格資訊對標記手術影片的每一個影格中至少一標記區域以對應的色碼填滿區域並顯示對應的區域說明,當區域說明為手術工具對應的該標記區域被選定時,將與被選定的該標記區域重疊的標記區域以被指定呈現方式進行重疊的標記區域呈現。When the marking area module plays the marking surgery video in the marking video playback area, it fills at least one marking area in each frame of the marking surgery video with the corresponding color code according to the information of each frame of the marking surgery video and displays the corresponding area description. When the marking area corresponding to the surgical tool described in the area is selected, the marking area overlapping with the selected marking area is presented in the specified presentation method.
標記說明模組於標記說明區中顯示有至少一手術特徵標記,至少一手術特徵標記與至少一標記區域相互對應,每一個手術特徵標記依據標記手術影片播放對應影格的至少一標記區域進行顯示,當區域說明為手術工具對應的該標記區域被選定時,將與被選定的該標記區域重疊的標記區域對應的至少一手術特徵標記以被指定呈現方式進行重疊的標記區域對應的至少一手術特徵標記呈現。The marking description module displays at least one surgical feature mark in the marking description area, and at least one surgical feature mark corresponds to at least one marking area. Each surgical feature mark is displayed according to at least one marking area of the corresponding frame of the marked surgery video playback. When the marking area corresponding to the surgical tool in the area description is selected, at least one surgical feature mark corresponding to the marking area overlapping with the selected marking area is presented in a specified presentation manner.
本發明所揭露的醫學動態影片對照教學方法,由連接影像資料庫的電腦設備執行,其包含下列步驟:The medical dynamic video comparison teaching method disclosed in the present invention is executed by a computer device connected to an image database, and comprises the following steps:
首先,影像資料庫儲存有多筆影像資料,每一筆影像資料包含原始手術影片、標記手術影片以及標記手術影片的多個影格資訊,每一個影格資訊包含至少一標記區域、與至少一標記區域對應的唯一色碼以及與至少一標記區域對應的一區域說明;接著,電腦設備顯示包含有原始影片播放區、標記影片播放區以及手術特徵標記說明區使用者介面;接著,電腦設備於原始影片播放區中播放原始手術影片或是於標記影片播放區播放標記手術影片時,自影像資料庫查詢出對應的標記手術影片或是原始手術影片,以於標記影片播放區播放被查詢出的標記手術影片或是於原始影片播放區中播放原始手術影片;接著,電腦設備於標記影片播放區播放標記手術影片時,依據標記手術影片的每一個影格資訊對標記手術影片的每一個影格中至少一標記區域以對應的色碼填滿區域並顯示對應的區域說明;接著,電腦設備於標記說明區中顯示有至少一手術特徵標記,至少一手術特徵標記與至少一標記區域相互對應,每一個手術特徵標記依據標記手術影片播放對應影格的至少一標記區域進行顯示;接著,當區域說明為手術工具對應的該標記區域被選定時,電腦設備將與被選定的該標記區域重疊的標記區域以被指定呈現方式進行重疊的標記區域呈現;最後,當區域說明為手術工具對應的該標記區域被選定時,電腦設備將與被選定的該標記區域重疊的標記區域對應的至少一手術特徵標記以被指定呈現方式進行重疊的標記區域對應的至少一手術特徵標記呈現。First, an image database stores a plurality of image data, each of which includes an original surgical video, a marked surgical video, and a plurality of frame information of the marked surgical video, and each frame information includes at least one marked area, a unique color code corresponding to the at least one marked area, and an area description corresponding to the at least one marked area; then, a computer device displays a user interface including an original video playback area, a marked video playback area, and a surgical feature mark description area; then, when the computer device plays the original surgical video in the original video playback area or plays the marked surgical video in the marked video playback area, the corresponding marked surgical video or the original surgical video is retrieved from the image database to play the retrieved marked surgical video in the marked video playback area or to play the original surgical video in the original video playback area; then, when the computer device plays the marked surgical video in the marked video playback area, the marked surgical video is retrieved according to the marked surgical video. The computer device then displays at least one surgical feature mark in the mark description area, wherein at least one surgical feature mark corresponds to at least one marked area, and each surgical feature mark is displayed according to at least one marked area of the corresponding frame of the marked surgical video. Then, when the area description is a surgical procedure, the computer device displays at least one surgical feature mark in the mark description area, wherein at least one surgical feature mark corresponds to at least one marked area. When the marked area corresponding to the surgical tool is selected, the computer device will present the marked area overlapping with the selected marked area in a specified presentation manner; finally, when the marked area corresponding to the area description as a surgical tool is selected, the computer device will present at least one surgical feature mark corresponding to the marked area overlapping with the selected marked area in a specified presentation manner.
本發明所揭露的系統及方法如上,與先前技術之間的差異在於原始影片播放區以及標記影片播放區同步播放原始手術影片以及每一個影格具有至少一標記區域的標記手術影片,手術特徵標記說明區中依據標記手術影片播放對應影格的至少一標記區域進行顯示,當區域說明為手術工具對應的該標記區域被選定時,將與被選定的該標記區域重疊的標記區域及其對應的手術特徵標記以被指定呈現方式進行呈現。The system and method disclosed in the present invention are as described above, and the difference between them and the prior art is that the original video playback area and the marked video playback area synchronously play the original surgical video and the marked surgical video with at least one marked area in each frame, and the surgical feature mark description area displays at least one marked area of the corresponding frame according to the marked surgical video playback. When the marked area corresponding to the surgical tool described in the area is selected, the marked area overlapping with the selected marked area and its corresponding surgical feature mark are presented in a specified presentation manner.
透過上述的技術手段,本發明可以達成由手術特徵標記與對應的說明輔助示意標記手術影片中標記區域且與原始手術影片相互對照以實現醫學教學的技術功效。Through the above-mentioned technical means, the present invention can achieve the technical effect of medical teaching by marking the marked area in the surgical video with surgical feature marks and corresponding explanations, and comparing it with the original surgical video.
以下將配合圖式及實施例來詳細說明本發明的實施方式,藉此對本發明如何應用技術手段來解決技術問題並達成技術功效的實現過程能充分理解並據以實施。The following will be used in conjunction with drawings and embodiments to explain the implementation of the present invention in detail, so that the implementation process of how the present invention applies technical means to solve technical problems and achieve technical effects can be fully understood and implemented accordingly.
以下首先要說明本發明所揭露的醫學動態影片對照教學系統,並請參考「第1圖」所示,「第1圖」繪示為本發明醫學動態影片對照教學系統的系統方塊圖。The following first describes the medical dynamic video comparison teaching system disclosed in the present invention, and please refer to "Figure 1", which is a system block diagram of the medical dynamic video comparison teaching system of the present invention.
本發明所揭露的醫學動態影片對照教學系統,該系統100包含:影像資料庫10以及電腦設備20,電腦設備20連接影像資料庫10,電腦設備20包含:非暫態電腦可讀儲存媒體21以及硬體處理器22,非暫態電腦可讀儲存媒體21用以儲存多個電腦可讀程式指令;硬體處理器22電性連接非暫態電腦可讀儲存媒體21,硬體處理器22被配置為執行所述電腦可讀程式指令以執行:使用者介面顯示模組31、影片播放模組32、標記區域模組33以及標記說明模組34。The medical dynamic video comparison teaching system disclosed in the present invention comprises: an
影像資料庫10儲存有多筆影像資料,每一筆影像資料包含原始手術影片、標記手術影片以及標記手術影片的多個影格(frame)顯示資訊,每一個影格資訊包含至少一標記區域、與所述至少一標記區域對應的唯一色碼以及與至少一標記區域對應的區域說明。The
具體而言,影格資訊可以分別為多個座標點圍成的第一區域 / #51328f / Fallopian Tube(標記區域 / 色碼 / 區域說明);多個座標點圍成的第二區域 / #64bb7e / Round ligament;多個座標點圍成的第三區域 / #767bb8 / IP ligament;多個座標點圍成的第四區域 / #55c1dd / Peritoneum;多個座標點圍成的第五區域 / #2eac37 / Scalpel;多個座標點圍成的第六區域 / #a75a1b / Injury wound,在此僅為舉例說明之,並不以此侷限本發明的應用範疇。Specifically, the frame information can be respectively a first area surrounded by multiple coordinate points / #51328f / Fallopian Tube (marked area / color code / area description); a second area surrounded by multiple coordinate points / #64bb7e / Round ligament; a third area surrounded by multiple coordinate points / #767bb8 / IP ligament; a fourth area surrounded by multiple coordinate points / #55c1dd / Peritoneum; a fifth area surrounded by multiple coordinate points / #2eac37 / Scalpel; and a sixth area surrounded by multiple coordinate points / #a75a1b / Injury wound. These are merely examples for illustration, and the scope of application of the present invention is not limited thereto.
上述的色碼是以16進制表示進行色彩的對應,色碼亦可以是以RGB表示、HSB表示、CMYK表示…等的表示方式進行色彩的對應,在此僅為舉例說明之,並不以此侷限本發明的應用範疇,色碼是提供標記區域填滿色彩的依據以及手術特徵標記以對應的色彩顯示的依據,區域說明即是該標記區域對應的說明。The color code described above is a hexadecimal representation for color correspondence. The color code may also be a RGB representation, HSB representation, CMYK representation, etc. representation for color correspondence. This is only an example for illustration and does not limit the scope of application of the present invention. The color code is a basis for filling the marked area with color and for displaying the surgical feature mark with the corresponding color. The area description is the description of the corresponding marked area.
請參考「第2A圖」所示,「第2A圖」繪示為本發明醫學動態影片對照教學的使用者介面示意圖。Please refer to FIG. 2A , which is a schematic diagram of the user interface of the medical dynamic video comparison teaching of the present invention.
使用者介面顯示模組31顯示包含有原始影片播放區41、標記影片播放區42以及手術特徵標記說明區43的使用者介面40。The user
請參考「第2B圖」所示,「第2B圖」繪示為本發明醫學動態影片對照教學的第一顯示態樣示意圖。Please refer to "FIG. 2B", which is a schematic diagram of the first display state of the medical dynamic video comparative teaching of the present invention.
影片播放模組32則是於原始影片播放區41中播放原始手術影片時,自影像資料庫10查詢出對應的標記手術影片以於標記影片播放區42播放被查詢出的標記手術影片,或是影片播放模組32於標記影片播放區42中播放標記手術影片時,自影像資料庫10查詢出對應的原始手術影片以於原始影片播放區41播放被查詢出的原始手術影片,值得注意的是,當原始手術影片或是標記手術影片暫停播放時,影片播放模組32則會同時暫停標記手術影片或是原始手術影片的播放,原始手術影片的每一個影格與標記手術影片的每一個影格一一對應,即原始手術影片的每一個影格與標記手術影片對應的影格同時播放顯示。When the
標記區域模組33將於標記影片播放區42播放標記手術影片時,依據標記手術影片的每一個影格資訊對標記手術影片的每一個影格中至少一標記區域以對應的色碼填滿標記區域並顯示對應的區域說明。When playing the marked surgery video in the marked
在「第2B圖」中,標記手術影片的該格影格資訊分別為第一標記區域51 / #51328f / Fallopian Tube(標記區域 / 色碼 / 區域說明);第二標記區域52 / #64bb7e / Round ligament;第三標記區域53 / #767bb8 / IP ligament;第四標記區域54 / #55c1dd / Peritoneum;第五標記區域55 / #2eac37 / Scalpel;以及第六標記區域56 / #a75a1b / Injury wound。In "Figure 2B", the frame information of the marked surgical video is the first marked
標記區域模組33即可於標記影片播放區42所播放的標記手術影片以#51328f的色碼填滿與顯示第一標記區域51以及Fallopian Tube;以#64bb7e的色碼填滿與顯示第二標記區域52以及Round ligament;以#767bb8的色碼填滿與顯示第三標記區域53以及IP ligament;以#55c1dd的色碼填滿與顯示第四標記區域54以及Peritoneum;以#2eac37的色碼填滿與顯示第五標記區域55以及Scalpel;以及以#a75a1b的色碼填滿與顯示第六標記區域56以及Injury wound,在「第2B圖」是以不同的填滿效果作為不同色碼填滿對應標記區域的示意,不同標記區域所呈現的形狀亦為示意說明,區域說明的內容亦為舉例說明之,本發明並不以此為限制。The
標記說明模組34即可於手術特徵標記說明區43中以#51328f的色碼顯示第一手術特徵標記61以及Fallopian Tube;以#64bb7e的色碼顯示第二手術特徵標記62以及Round ligament;以#767bb8的色碼顯示第三手術特徵標記63以及IP ligament;以#55c1dd的色碼顯示第四手術特徵標記64以及Peritoneum;以#2eac37的色碼顯示第五手術特徵標記65以及Scalpel;以及以#a75a1b的色碼顯示第六手術特徵標記66以及Injury wound,在「第2B圖」是以不同的填滿效果作為不同色碼呈現不同手術特徵標記的示意,且不同手術特徵標記對應的文字內容亦為舉例說明之,本發明並不以此為限制。The
值得注意的是,第一手術特徵標記61、第二手術特徵標記62、第三手術特徵標記63、第四手術特徵標記64、第五手術特徵標記65以及第六手術特徵標記66分別與第一標記區域51、第二標記區域52、第三標記區域53、第四標記區域54、第五標記區域55以及第六標記區域56相互對應。It is worth noting that the first
當區域說明為“Scalpel”(手術工具)對應的第五標記區域55被選定時,標記區域模組33將與被選定的第五標記區域55重疊的標記區域(即第六標記區域56)以被指定呈現方式進行重疊的第六標記區域56呈現,前述的被指定呈現方式例如是:閃爍呈現方式或是漸進淡出與漸進淡出往復交替呈現方式,在此僅為舉例說明之,並不以此侷限本發明的應用範疇。When the fifth marking area 55 corresponding to the area description "Scalpel" (surgical tool) is selected, the
當區域說明為“Scalpel”(手術工具)對應的第五標記區域55被選定時,標記說明模組34亦會將與被選定的第五標記區域55重疊的標記區域(即第六標記區域56)對應的第六手術特徵標記66以被指定呈現方式進行重疊的第六標記區域56對應的第六手術特徵標記66呈現,前述的被指定呈現方式例如是:閃爍呈現方式或是漸進淡出與漸進淡出往復交替呈現方式,在此僅為舉例說明之,並不以此侷限本發明的應用範疇。When the fifth marking area 55 corresponding to the area description "Scalpel" (surgical tool) is selected, the
請參考「第2C圖」所示,「第2C圖」繪示為本發明醫學動態影片對照教學的第二顯示態樣示意圖。Please refer to "FIG. 2C", which is a schematic diagram of the second display state of the medical dynamic video comparative teaching of the present invention.
影像資料庫10中儲存的每一筆影像資料更包含手術術式引導資訊,手術術式引導資訊包含每一個影格資訊的引導目標以及與引導目標對應的術式說明,前述的引導目標則是對應手術術式下一步驟或是下一操作的目標位置,前述的術式說明則是手術術式下一步驟或是下一操作的輔助說明,在此僅為舉例說明之,並不以此侷限本發明的應用範疇。Each image data stored in the
醫學動態影片對照教學系統更包含術式引導模組35,術式引導模組35是於標記影片播放區42播放標記手術影片時,依據標記手術影片的每一個影格資訊對標記手術影片的每一個影格中引導目標71加以顯示與顯示對應的術式說明72,再將與引導目標71重疊的標記區域以被指定呈現方式進行重疊的標記區域呈現。The medical dynamic video comparison teaching system further includes a surgical
特別要說明的是,在實際實施上,本發明所述的模組皆可利用各種方式來實現,包含軟體、硬體或其任意組合,例如,在某些實施方式中,各模組可利用軟體及硬體或其中之一來實現,除此之外,本發明亦可部分地或完全地基於硬體來實現,例如,系統中的一個或多個模組可以透過積體電路晶片、系統單晶片(System on Chip,SoC)、複雜可程式邏輯裝置(Complex Programmable Logic Device,CPLD)、現場可程式邏輯閘陣列(Field Programmable Gate Array,FPGA)等來實現。本發明可以是系統、方法及/或電腦程式。電腦程式可以包括非暫態的電腦可讀儲存媒體,其上載有用於使處理器實現本發明的各個方面的電腦可讀程式指令,電腦可讀儲存媒體可以是可以保持和儲存由指令執行設備使用的指令的有形設備。電腦可讀儲存媒體可以是但不限於電儲存設備、磁儲存設備、光儲存設備、電磁儲存設備、半導體儲存設備或上述的任意合適的組合。電腦可讀儲存媒體的更具體的例子(非窮舉的列表)包括:硬碟、隨機存取記憶體、唯讀記憶體、快閃記憶體、光碟、軟碟以及上述的任意合適的組合。此處所使用的電腦可讀儲存媒體不被解釋爲瞬時信號本身,諸如無線電波或者其它自由傳播的電磁波、通過波導或其它傳輸媒介傳播的電磁波(例如,通過光纖電纜的光信號)、或者通過電線傳輸的電信號。另外,此處所描述的電腦可讀程式指令可以從電腦可讀儲存媒體下載到各個計算/處理設備,或者通過網路,例如:網際網路、區域網路、廣域網路及/或無線網路下載到外部電腦設備或外部儲存設備。網路可以包括銅傳輸電纜、光纖傳輸、無線傳輸、路由器、防火牆、交換器、集線器及/或閘道器。每一個計算/處理設備中的網路卡或者網路介面從網路接收電腦可讀程式指令,並轉發此電腦可讀程式指令,以供儲存在各個計算/處理設備中的電腦可讀儲存媒體中。執行本發明操作的電腦可讀程式指令可以是組合語言指令、指令集架構指令、機器指令、機器相關指令、微指令、韌體指令、或者以一種或多種程式語言的任意組合編寫的原始碼或目的碼(Object Code),所述程式語言包括物件導向的程式語言,如:Common Lisp、Python、C++、Objective-C、Smalltalk、Delphi、Java、Swift、C#、Perl、Ruby與PHP等,以及常規的程序式(Procedural)程式語言,如:C語言或類似的程式語言。所述電腦可讀程式指令可以完全地在電腦上執行、部分地在電腦上執行、作爲一個獨立的軟體執行、部分在客戶端電腦上部分在遠端電腦上執行、或者完全在遠端電腦或伺服器上執行。It should be particularly noted that in actual implementation, the modules described in the present invention can be implemented in various ways, including software, hardware or any combination thereof. For example, in some embodiments, each module can be implemented using software and hardware or one of them. In addition, the present invention can also be implemented partially or completely based on hardware. For example, one or more modules in the system can be implemented through integrated circuit chips, system on chip (SoC), complex programmable logic device (CPLD), field programmable gate array (FPGA), etc. The present invention can be a system, method and/or computer program. The computer program may include a non-transitory computer-readable storage medium that carries computer-readable program instructions useful for causing a processor to implement aspects of the present invention. The computer-readable storage medium may be a tangible device that can hold and store instructions used by an instruction execution device. The computer-readable storage medium may be, but is not limited to, an electric storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the above. More specific examples (a non-exhaustive list) of computer-readable storage media include: a hard drive, a random access memory, a read-only memory, a flash memory, an optical disk, a floppy disk, and any suitable combination of the above. As used herein, computer-readable storage media is not to be interpreted as a transient signal itself, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., optical signals through optical fiber cables), or electrical signals transmitted through wires. In addition, the computer-readable program instructions described herein can be downloaded from the computer-readable storage media to various computing/processing devices, or downloaded to external computer devices or external storage devices through a network, such as the Internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, optical fiber transmission, wireless transmission, routers, firewalls, switches, hubs, and/or gateways. The network card or network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing/processing device. The computer-readable program instructions for executing the operation of the present invention can be assembly language instructions, instruction set architecture instructions, machine instructions, machine-related instructions, microinstructions, firmware instructions, or source code or object code (Object Code) written in any combination of one or more programming languages, wherein the programming language includes object-oriented programming languages, such as Common Lisp, Python, C++, Objective-C, Smalltalk, Delphi, Java, Swift, C#, Perl, Ruby and PHP, as well as conventional procedural programming languages, such as C language or similar programming languages. The computer-readable program instructions may be executed entirely on the computer, partially on the computer, as a separate piece of software, partially on the client computer and partially on the remote computer, or entirely on the remote computer or server.
接著,以下將說明本發明的運作方法,並請參考「第3圖」所示,「第3圖」繪示為本發明醫學動態影片對照教學方法的方法流程圖。Next, the operation method of the present invention will be described below, and please refer to "Figure 3", which is a method flow chart of the medical dynamic video comparison teaching method of the present invention.
本發明所揭露的醫學動態影片對照教學方法,其包含下列步驟:The medical dynamic video comparison teaching method disclosed in the present invention comprises the following steps:
首先,影像資料庫儲存有多筆影像資料,每一筆影像資料包含原始手術影片、標記手術影片以及標記手術影片的多個影格資訊,每一個影格資訊包含至少一標記區域、與至少一標記區域對應的唯一色碼以及與至少一標記區域對應的一區域說明(步驟801);接著,電腦設備顯示包含有原始影片播放區、標記影片播放區以及手術特徵標記說明區使用者介面(步驟802);接著,電腦設備於原始影片播放區中播放原始手術影片或是於標記影片播放區播放標記手術影片時,自影像資料庫查詢出對應的標記手術影片或是原始手術影片,以於標記影片播放區播放被查詢出的標記手術影片或是於原始影片播放區中播放原始手術影片(步驟803);接著,電腦設備於標記影片播放區播放標記手術影片時,依據標記手術影片的每一個影格資訊對標記手術影片的每一個影格中至少一標記區域以對應的色碼填滿區域並顯示對應的區域說明(步驟804);接著,電腦設備於標記說明區中顯示有至少一手術特徵標記,至少一手術特徵標記與至少一標記區域相互對應,每一個手術特徵標記依據標記手術影片播放對應影格的至少一標記區域進行顯示(步驟805);接著,當區域說明為手術工具對應的該標記區域被選定時,電腦設備將與被選定的該標記區域重疊的標記區域以被指定呈現方式進行重疊的標記區域呈現(步驟806);最後,當區域說明為手術工具對應的該標記區域被選定時,電腦設備將與被選定的該標記區域重疊的標記區域對應的至少一手術特徵標記以被指定呈現方式進行重疊的標記區域對應的至少一手術特徵標記呈現(步驟807)。First, the image database stores a plurality of image data, each of which includes an original surgical video, a marked surgical video, and a plurality of frame information of the marked surgical video, each of which includes at least one marked area, a unique color code corresponding to the at least one marked area, and an area description corresponding to the at least one marked area (step 801); then, the computer device displays a user interface including an original video playback area, a marked video playback area, and a surgical feature mark description area (step 802); Then, when the computer device plays the original surgical video in the original video playback area or plays the marked surgical video in the marked video playback area, it searches for the corresponding marked surgical video or the original surgical video from the image database, and plays the searched marked surgical video in the marked video playback area or plays the original surgical video in the original video playback area (step 803); Then, when the computer device plays the marked surgical video in the marked video playback area, according to each of the marked surgical videos A frame information fills at least one marked area in each frame of the marked surgery video with a corresponding color code and displays the corresponding area description (step 804); then, the computer device displays at least one surgical feature mark in the mark description area, at least one surgical feature mark corresponds to at least one marked area, and each surgical feature mark is displayed according to at least one marked area of the corresponding frame of the marked surgery video (step 805); then, when the area description is a surgical tool When the corresponding marked area is selected, the computer device will present the marked area overlapping with the selected marked area in a specified presentation manner (step 806); finally, when the marked area corresponding to the area description as a surgical tool is selected, the computer device will present at least one surgical feature mark corresponding to the marked area overlapping with the selected marked area in a specified presentation manner (step 807).
綜上所述,可知本發明與先前技術之間的差異在於原始影片播放區以及標記影片播放區同步播放原始手術影片以及每一個影格具有至少一標記區域的標記手術影片,手術特徵標記說明區中依據標記手術影片播放對應影格的至少一標記區域進行顯示,當區域說明為手術工具對應的該標記區域被選定時,將與被選定的該標記區域重疊的標記區域及其對應的手術特徵標記以被指定呈現方式進行呈現。In summary, it can be seen that the difference between the present invention and the prior art lies in that the original video playback area and the marked video playback area synchronously play the original surgical video and the marked surgical video with at least one marked area in each frame, and the surgical feature mark description area displays at least one marked area of the corresponding frame according to the marked surgical video playback, and when the marked area corresponding to the surgical tool described in the area is selected, the marked area overlapping with the selected marked area and its corresponding surgical feature mark are presented in a specified presentation manner.
藉由此一技術手段可以來解決先前技術所存在醫學影片播放時缺乏標記對照以輔助學習的問題,進而達成由手術特徵標記與對應的說明輔助示意標記手術影片中標記區域且與原始手術影片相互對照以實現醫學教學的技術功效。This technical means can be used to solve the problem of lack of marking comparison to assist learning when playing medical videos in the previous technology, and then achieve the technical effect of medical teaching by marking the marked area in the surgical video with surgical feature markings and corresponding explanations, and comparing it with the original surgical video.
雖然本發明所揭露的實施方式如上,惟所述的內容並非用以直接限定本發明的專利保護範圍。任何本發明所屬技術領域中具有通常知識者,在不脫離本發明所揭露的精神和範圍的前提下,可以在實施的形式上及細節上作些許的更動。本發明的專利保護範圍,仍須以所附的申請專利範圍所界定者為準。Although the implementation methods disclosed in the present invention are as above, the above contents are not used to directly limit the scope of patent protection of the present invention. Any person with ordinary knowledge in the technical field to which the present invention belongs can make slight changes in the form and details of implementation without departing from the spirit and scope disclosed in the present invention. The scope of patent protection of the present invention shall still be defined by the scope of the attached patent application.
100:系統 10:影像資料庫 20:電腦設備 21非暫態電腦可讀儲存媒體 22:硬體處理器 31:使用者介面顯示模組 32:影片播放模組 33:標記區域模組 34:標記說明模組 35:術式引導模組 40:使用者介面 41:原始影片播放區 42:標記影片播放區 43:手術特徵標記說明區 51:第一標記區域 72:第二標記區域 53:第三標記區域 54:第四標記區域 55:第五標記區域 56:第六標記區域 61:第一手術特徵標記 62:第二手術特徵標記 63:第三手術特徵標記 64:第四手術特徵標記 65:第五手術特徵標記 66:第六手術特徵標記 71:引導目標 72:術式說明 步驟 801:影像資料庫儲存有多筆影像資料,每一筆影像資料包含原始手術影片、標記手術影片以及標記手術影片的多個影格資訊,每一個影格資訊包含至少一標記區域、與至少一標記區域對應的唯一色碼以及與至少一標記區域對應的一區域說明 步驟 802:電腦設備顯示包含有原始影片播放區、標記影片播放區以及手術特徵標記說明區使用者介面 步驟 803:電腦設備於原始影片播放區中播放原始手術影片或是於標記影片播放區播放標記手術影片時,自影像資料庫查詢出對應的標記手術影片或是原始手術影片,以於標記影片播放區播放被查詢出的標記手術影片或是於原始影片播放區中播放原始手術影片 步驟 804:電腦設備於標記影片播放區播放標記手術影片時,依據標記手術影片的每一個影格資訊對標記手術影片的每一個影格中至少一標記區域以對應的色碼填滿區域並顯示對應的區域說明 步驟 805:電腦設備於標記說明區中顯示有至少一手術特徵標記,至少一手術特徵標記與至少一標記區域相互對應,每一個手術特徵標記依據標記手術影片播放對應影格的至少一標記區域顯示 步驟 806:當區域說明為手術工具對應的該標記區域被選定時,電腦設備將與被選定的該標記區域重疊的標記區域以被指定呈現方式進行重疊的標記區域呈現 步驟 807:當區域說明為手術工具對應的該標記區域被選定時,電腦設備將與被選定的該標記區域重疊的標記區域對應的至少一手術特徵標記以被指定呈現方式進行重疊的標記區域對應的至少一手術特徵標記呈現100: System 10: Image database 20: Computer equipment 21 Non-transient computer-readable storage media 22: Hardware processor 31: User interface display module 32: Video playback module 33: Marking area module 34: Marking description module 35: Procedure guidance module 40: User interface 41: Original video playback area 42: Marking video playback area 43: Surgical feature marking description area 51: First marking area 72: Second marking area 53: Third marking area 54: Fourth marking area 55: Fifth marking area 56: Sixth marking area 61: First surgical feature mark 62: Second surgical feature mark 63: Third surgical feature mark 64: fourth surgical feature mark 65: fifth surgical feature mark 66: sixth surgical feature mark 71: guidance target 72: surgical procedure description Step 801: the image database stores multiple image data, each image data includes an original surgical video, a marked surgical video and multiple frame information of the marked surgical video, each frame information includes at least one marked area, a unique color code corresponding to at least one marked area and an area description corresponding to at least one marked area Step 802: the computer device displays a user interface including an original video playback area, a marked video playback area and a surgical feature mark description area Step 803: When the computer device plays the original surgical video in the original video playback area or plays the marked surgical video in the marked video playback area, the corresponding marked surgical video or original surgical video is retrieved from the image database to play the retrieved marked surgical video in the marked video playback area or the original surgical video in the original video playback area. Step 804: When the computer device plays the marked surgical video in the marked video playback area, at least one marked area in each frame of the marked surgical video is filled with a corresponding color code according to each frame information of the marked surgical video and the corresponding area description is displayed. Step 805: The computer device displays at least one surgical feature mark in the mark description area, and the at least one surgical feature mark corresponds to at least one marked area. Each surgical feature mark is displayed according to at least one marked area of the corresponding frame of the marked surgical video playback. Step 806: When the marked area corresponding to the surgical tool in the area description is selected, the computer device presents the marked area overlapping with the selected marked area in a designated presentation mode. Step 807: When the marked area corresponding to the surgical tool in the area description is selected, the computer device presents at least one surgical feature mark corresponding to the marked area overlapping with the selected marked area in a designated presentation mode.
第1圖繪示為本發明醫學動態影片對照教學系統的系統方塊圖。 第2A圖繪示為本發明醫學動態影片對照教學的使用者介面示意圖。 第2B圖繪示為本發明醫學動態影片對照教學的第一顯示態樣示意圖。 第2C圖繪示為本發明醫學動態影片對照教學的第二顯示態樣示意圖 第3圖繪示為本發明醫學動態影片對照教學方法的方法流程圖。 FIG. 1 is a system block diagram of the medical dynamic video comparison teaching system of the present invention. FIG. 2A is a user interface schematic diagram of the medical dynamic video comparison teaching of the present invention. FIG. 2B is a first display state schematic diagram of the medical dynamic video comparison teaching of the present invention. FIG. 2C is a second display state schematic diagram of the medical dynamic video comparison teaching of the present invention. FIG. 3 is a method flow chart of the medical dynamic video comparison teaching method of the present invention.
100:系統 100:System
10:影像資料庫 10: Image database
20:電腦設備 20: Computer equipment
21:非暫態電腦可讀儲存媒體 21: Non-transient computer-readable storage media
22:硬體處理器 22:Hardware processor
31:使用者介面顯示模組 31: User interface display module
32:影片播放模組 32: Video playback module
33:標記區域模組 33: Marking area module
34:標記說明模組 34: Marking description module
35:術式引導模組 35: Procedure guidance module
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW112112568A TWI838198B (en) | 2023-03-31 | 2023-03-31 | Medical dynamic video contrast teaching system and method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW112112568A TWI838198B (en) | 2023-03-31 | 2023-03-31 | Medical dynamic video contrast teaching system and method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| TWI838198B true TWI838198B (en) | 2024-04-01 |
| TW202441525A TW202441525A (en) | 2024-10-16 |
Family
ID=91618998
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW112112568A TWI838198B (en) | 2023-03-31 | 2023-03-31 | Medical dynamic video contrast teaching system and method thereof |
Country Status (1)
| Country | Link |
|---|---|
| TW (1) | TWI838198B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW200621009A (en) * | 2004-08-23 | 2006-06-16 | Gamecaster Inc | Apparatus, methods, and systems for viewing and manipulating a virtual environment |
| US8953909B2 (en) * | 2006-01-21 | 2015-02-10 | Elizabeth T. Guckenberger | System, method, and computer software code for mimic training |
| TW202108774A (en) * | 2019-05-13 | 2021-03-01 | 美商格瑞爾公司 | Model-based featurization and classification |
| TWI778900B (en) * | 2021-12-28 | 2022-09-21 | 慧術科技股份有限公司 | Marking and teaching of surgical procedure system and method thereof |
-
2023
- 2023-03-31 TW TW112112568A patent/TWI838198B/en active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW200621009A (en) * | 2004-08-23 | 2006-06-16 | Gamecaster Inc | Apparatus, methods, and systems for viewing and manipulating a virtual environment |
| US8953909B2 (en) * | 2006-01-21 | 2015-02-10 | Elizabeth T. Guckenberger | System, method, and computer software code for mimic training |
| TW202108774A (en) * | 2019-05-13 | 2021-03-01 | 美商格瑞爾公司 | Model-based featurization and classification |
| TWI778900B (en) * | 2021-12-28 | 2022-09-21 | 慧術科技股份有限公司 | Marking and teaching of surgical procedure system and method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| TW202441525A (en) | 2024-10-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10134296B2 (en) | Enhancing movement training with an augmented reality mirror | |
| US11528535B2 (en) | Video file playing method and apparatus, and storage medium | |
| CN108665742B (en) | Method and device for reading through reading device | |
| WO2021042933A1 (en) | Processing method, processing device, electronic device, and storage medium | |
| JP2023510635A (en) | INTERACTION METHOD, DEVICE, ELECTRONIC DEVICE AND COMPUTER-READABLE RECORDING MEDIUM | |
| US10831799B2 (en) | External action execution with conversational agent | |
| JP2022505118A (en) | Image processing method, equipment, hardware equipment | |
| US10720187B2 (en) | Method and apparatus to extract key video frames from online education | |
| US11776272B2 (en) | Method for comparing videos of surgical techniques | |
| WO2020166278A1 (en) | System, training device, training method, and prediction device | |
| WO2021197020A1 (en) | Audio processing method and apparatus, readable medium, and electronic device | |
| TWI838198B (en) | Medical dynamic video contrast teaching system and method thereof | |
| TWI838199B (en) | Medical static picture contrast teaching system and method thereof | |
| CN111866548A (en) | Marking method applied to medical video | |
| US20230412891A1 (en) | Video processing method, electronic device and medium | |
| CN110070869B (en) | Voice teaching interaction generation method, device, equipment and medium | |
| TW201526633A (en) | Method and system for playing video | |
| CN109559313B (en) | Image processing method, medium, device and computing equipment | |
| CN111833847B (en) | Speech processing model training method and device | |
| CN114520040A (en) | Surgical teaching assistant system and method using virtual reality | |
| US20210081727A1 (en) | Image object anomaly detection | |
| TWI895305B (en) | Remapping for mixed dynamic range content | |
| TWI778900B (en) | Marking and teaching of surgical procedure system and method thereof | |
| CN115641795A (en) | Image display method, image display device, electronic device, and storage medium | |
| US11145129B2 (en) | Automatic generation of content for autonomic augmented reality applications |