TWI901271B - System and method for generating tooth treatment plan and providing treatment simulation video - Google Patents
System and method for generating tooth treatment plan and providing treatment simulation videoInfo
- Publication number
- TWI901271B TWI901271B TW113126760A TW113126760A TWI901271B TW I901271 B TWI901271 B TW I901271B TW 113126760 A TW113126760 A TW 113126760A TW 113126760 A TW113126760 A TW 113126760A TW I901271 B TWI901271 B TW I901271B
- Authority
- TW
- Taiwan
- Prior art keywords
- dental
- treatment
- full
- mouth
- treatment plan
- Prior art date
Links
Landscapes
- Dental Tools And Instruments Or Auxiliary Dental Instruments (AREA)
Abstract
Description
一種牙齒治療模擬影像產生系統及其方法,特別係指一種產生牙齒治療計畫並提供對應治療模擬影像之系統及方法。A system and method for generating a dental treatment simulation image, particularly a system and method for generating a dental treatment plan and providing a corresponding treatment simulation image.
美國牙醫學會 (ADA) 建議民眾一天至少刷兩次牙,至於牙縫間的清潔至少一天一次。然而,刷牙只能刷除附著在牙齦上的牙菌斑和食物殘渣,但結石中的細菌和牙齦下的污垢卻無法有效移除。因此,牙醫仍然建議大家定期洗牙,藉以徹底清潔平日刷牙時的死角和牙齦下的結石,避免牙齒受到牙周病菌的破壞。而洗牙頻率則因人而異,如果是牙周健康的民眾則會建議定期半年洗牙及口腔檢查,藉以在牙齒被破壞的初期及早發現並進行治療,避免因為牙齒被嚴重破壞而產生的高額治療費用。The American Dental Association (ADA) recommends brushing your teeth at least twice a day, and cleaning between teeth at least once a day. However, brushing only removes plaque and food debris from the gums, but it cannot effectively remove bacteria in the tartar and dirt beneath the gums. Therefore, dentists still recommend regular teeth cleanings to thoroughly clean the blind spots and tartar beneath the gums that are often missed during brushing, thus protecting teeth from damage caused by periodontal disease bacteria. The frequency of teeth cleanings varies from person to person. For those with healthy periodontal health, regular teeth cleanings and oral examinations are recommended every six months to detect and treat tooth damage in its early stages, thus avoiding the high cost of treatment associated with severe tooth damage.
然而,目前的牙齒治療方案大多是牙醫在觀看病患的牙齒與牙齦後依照其自身經驗判斷並選擇的,若是牙醫的經驗不夠多,則牙醫所選擇的牙齒治療方案可能並不是最適合病患的方案,或者,在牙醫的技術不夠熟練時,牙醫可能也無法徹底的依照所選擇的牙齒治療方案完成牙齒治療。也就是說,若牙醫的經驗或技術不足時,病患的牙齒可能無法獲得真正的治療,導致病患還可能要再次進行牙齒治療,甚至可能造成牙周病或牙齦炎等病變。However, current dental treatment plans are mostly selected by dentists based on their own experience after observing the patient's teeth and gums. If the dentist is inexperienced, the selected dental treatment plan may not be the most suitable for the patient. Alternatively, if the dentist's skills are insufficient, the dentist may not be able to fully follow the selected dental treatment plan. In other words, if the dentist's experience or skills are insufficient, the patient's teeth may not receive true treatment, resulting in the patient needing further dental treatment, or even developing periodontal disease or gingivitis.
綜上所述,可知先前技術中長期以來一直存在牙齒治療方案是由牙醫依照經驗選擇並不一定真正適合病患的問題,因此有必要提出改進的技術手段,來解決此一問題。In summary, it can be seen that the problem in previous technologies has long been that dental treatment plans are selected by dentists based on their experience and are not necessarily suitable for patients. Therefore, it is necessary to propose improved technical means to solve this problem.
有鑒於先前技術存在牙齒治療方案是由牙醫依照經驗選擇的問題,本發明遂揭露一種產生牙齒治療計畫並提供治療模擬影像之系統及方法,其中:In view of the problem in the prior art that dental treatment plans are selected by dentists based on their experience, the present invention discloses a system and method for generating a dental treatment plan and providing treatment simulation images, wherein:
本發明所揭露之產生牙齒治療計畫並提供治療模擬影像之系統,至少包含:影像取得模組,用以取得全口牙齒影像;影像分析模組,用以分析全口牙齒影像以產生全口牙齒狀況資料;計畫產生模組,用以依據全口牙齒狀況資料選擇牙齒治療計畫,並決定牙齒治療計畫所包含之牙齒治療方案之執行順序;模型建立模組,用以依據全口牙齒狀況資料建立全口牙齒模型;影像生成模組,用以依據牙齒治療方案、執行順序與全口牙齒模型建立與全口牙齒模型對應之治療模擬影像;顯示模組,用以顯示治療模擬影像。The system disclosed in the present invention for generating a dental treatment plan and providing a treatment simulation image comprises at least: an image acquisition module for acquiring full-mouth dental images; an image analysis module for analyzing full-mouth dental images to generate full-mouth dental condition data; a plan generation module for selecting a dental treatment plan based on the full-mouth dental condition data and determining the dental treatment plan. The dental treatment plan includes the execution sequence of the dental treatment plan; the model creation module is used to create a full-mouth dental model based on the full-mouth dental condition data; the image generation module is used to create a treatment simulation image corresponding to the full-mouth dental model based on the dental treatment plan, execution sequence, and the full-mouth dental model; and the display module is used to display the treatment simulation image.
本發明所揭露之產生牙齒治療計畫並提供治療模擬影像之方法,其步驟至少包括:取得全口牙齒影像;分析全口牙齒影像以產生全口牙齒狀況資料;依據全口牙齒狀況資料選擇牙齒治療計畫;決定牙齒治療計畫所包含之牙齒治療方案之執行順序;依據全口牙齒狀況資料建立全口牙齒模型;依據牙齒治療方案、執行順序與全口牙齒模型建立與全口牙齒模型對應之治療模擬影像;顯示治療模擬影像。The method disclosed herein for generating a dental treatment plan and providing a treatment simulation image comprises at least the following steps: obtaining a full-mouth dental image; analyzing the full-mouth dental image to generate full-mouth dental condition data; selecting a dental treatment plan based on the full-mouth dental condition data; determining the execution sequence of the dental treatment plans included in the dental treatment plan; creating a full-mouth dental model based on the full-mouth dental condition data; creating a treatment simulation image corresponding to the full-mouth dental model based on the dental treatment plan, the execution sequence, and the full-mouth dental model; and displaying the treatment simulation image.
本發明所揭露之系統及方法如上,與先前技術之間的差異在於本發明透過分析全口牙齒影像以產生全口牙齒狀況資料並依據全口牙齒狀況資料選擇牙齒治療計畫後,決定牙齒治療計畫所包含之牙齒治療方案的執行順序,同時依據全口牙齒狀況資料建立全口牙齒模型,並依據牙齒治療方案、執行順序與全口牙齒模型建立與全口牙齒模型對應之治療模擬影像且顯示治療模擬影像,藉以解決先前技術所存在的問題,並可以達成輔助牙醫進行牙齒治療的技術功效。The system and method disclosed above differ from prior art in that the present invention analyzes full-mouth dental images to generate full-mouth dental condition data. After selecting a dental treatment plan based on the full-mouth dental condition data, the present invention determines the execution sequence of the dental treatment plans included in the dental treatment plan. Furthermore, a full-mouth dental model is created based on the full-mouth dental condition data. Based on the dental treatment plan, execution sequence, and full-mouth dental model, a treatment simulation image corresponding to the full-mouth dental model is created and displayed. This solves the problems of prior art and achieves the technical efficacy of assisting dentists in performing dental treatment.
以下將配合圖式及實施例來詳細說明本發明之特徵與實施方式,內容足以使任何熟習相關技藝者能夠輕易地充分理解本發明解決技術問題所應用的技術手段並據以實施,藉此實現本發明可達成的功效。The following will be used in conjunction with drawings and embodiments to describe in detail the features and implementation methods of the present invention. The content is sufficient to enable anyone familiar with the relevant technology to easily and fully understand the technical means used by the present invention to solve the technical problems and implement them accordingly, thereby achieving the effects that can be achieved by the present invention.
本發明可以依據病患的全口牙齒狀況決定牙齒治療計畫,並依據所決定之牙齒治療計畫所包含的牙齒治療方案建立相對應的治療模擬影像,藉以透過治療模擬影像給予牙齒治療的輔助。The present invention can determine a dental treatment plan based on the patient's full dental condition and create a corresponding treatment simulation image based on the dental treatment plan included in the determined dental treatment plan, thereby providing auxiliary dental treatment through the treatment simulation image.
本發明所提之牙齒治療計畫可以包含相關聯之口腔衛教、在日常生活中進行之日常清潔方案、在診所內進行之牙齒治療方案、治療後之觀察追蹤項目等;本發明所提之牙齒治療方案包含但不限於洗牙、深層洗牙、根面平整等,日常清潔方案包含刷牙、使用牙線等,但本發明並不以此為限;本發明所提之治療模擬影像包含牙齒治療計畫所包含之各個牙齒治療方案的模擬影像。The dental treatment plan provided herein may include related oral hygiene education, daily hygiene regimens, in-clinic dental treatment regimens, and post-treatment observation and follow-up items. The dental treatment regimen provided herein includes, but is not limited to, scaling, deep scaling, and root planing. Daily hygiene regimens include, but are not limited to, brushing and flossing. The treatment simulation images provided herein include simulation images of each dental treatment regimen included in the dental treatment plan.
實現本發明之裝置可以是計算設備,本發明所提之計算設備包含但不限於一個或多個處理器、一條或多條記憶體、以及連接不同硬體元件(包括記憶體和處理器)的匯流排等硬體元件。透過所包含之多個硬體元件,計算設備可以載入並執行作業系統,使作業系統在計算設備上運行,也可以執行軟體或程式。計算設備也包含一個外殼,上述之各個硬體元件設置於外殼內。The apparatus implementing the present invention may be a computing device. The computing device mentioned herein includes, but is not limited to, one or more processors, one or more memory banks, and hardware components such as a bus that connects the various hardware components (including the memory banks and processors). Through these hardware components, the computing device can load and execute an operating system, allowing the operating system to run on the computing device, and can also execute software or programs. The computing device also includes a housing, within which the aforementioned hardware components are housed.
本發明所提之計算設備的匯流排可以包含一種或多個類型,例如包含資料匯流排(data bus)、位址匯流排(address bus)、控制匯流排(control bus)、擴充功能匯流排(expansion bus)、及/或局域匯流排(local bus)等類型的匯流排。計算設備的匯流排包括但不限於的工業標準架構(Industry Standard Architecture, ISA)匯流排、周邊元件互連(Peripheral Component Interconnect, PCI)匯流排、視頻電子標準協會(Video Electronics Standards Association, VESA)局域匯流排、以及串列的通用序列匯流排(Universal Serial Bus, USB)、快速周邊元件互連(PCI Express, PCI-E/PCIe)匯流排等。The bus of the computing device provided in the present invention may include one or more types of buses, such as a data bus, an address bus, a control bus, an expansion bus, and/or a local bus. Buses used in computing devices include, but are not limited to, the Industry Standard Architecture (ISA) bus, the Peripheral Component Interconnect (PCI) bus, the Video Electronics Standards Association (VESA) local bus, the Universal Serial Bus (USB) bus, and the PCI Express (PCI-E/PCIe) bus.
本發明所提之計算設備的處理器與匯流排耦接。處理器包含暫存器(Register)組或暫存器空間,暫存器組或暫存器空間可以完全的被設置在處理器之處理晶片上,或全部或部分被設置在處理晶片外並經由專用電氣連接及/或經由匯流排耦接至處理晶片。處理器可為中央處理器、微處理器或任何合適的處理元件。若計算設備為多處理器設備,也就是計算設備包含多個處理器,則計算設備所包含的處理器都相同或類似,且透過匯流排耦接與通訊。在部分的實施例中,處理器可以解釋一個計算機指令或一連串的多個計算機指令以進行特定的運算或操作,例如,數學運算、邏輯運算、資料比對、複製/移動資料等,藉以驅動計算設備中的其他硬體元件或運行作業系統或執行各種程式及/或模組。計算機指令可以是組合語言指令、指令集架構指令、機器指令、機器相關指令、微指令、韌體指令、或者以一種或多種程式語言的任意組合編寫的原始碼或目的碼(Object Code),且計算機指令可以完全地在單一個計算設備上被執行、部分地在單一個計算設備上被執行、部分在一個計算設備上被執行且部分在相連接之另一計算設備上被執行。其中,上述之程式語言包括物件導向(Object-oriented)的程式語言,如Common Lisp、Python、C++、Objective-C、Smalltalk、Delphi、Java、Swift、C#、Perl、Ruby等,及常規的程序式(Procedural)程式語言,如C語言或其他類似的程式語言。The processor of the computing device of the present invention is coupled to a bus. The processor includes a register group or register space, which can be completely set on the processing chip of the processor, or completely or partially set outside the processing chip and coupled to the processing chip via dedicated electrical connections and/or via a bus. The processor can be a central processing unit, a microprocessor, or any suitable processing element. If the computing device is a multi-processor device, that is, the computing device includes multiple processors, then the processors included in the computing device are the same or similar, and are coupled and communicated through a bus. In some embodiments, a processor may interpret a computer instruction or a sequence of multiple computer instructions to perform specific calculations or operations, such as mathematical operations, logical operations, data comparison, copying/moving data, etc., to drive other hardware components in the computing device, run an operating system, or execute various programs and/or modules. Computer instructions may be assembly language instructions, instruction set architecture instructions, machine instructions, machine-related instructions, microinstructions, firmware instructions, or source code or object code written in any combination of one or more programming languages, and computer instructions may be executed entirely on a single computing device, partially on a single computing device, or partially on one computing device and partially on another connected computing device. The above-mentioned programming languages include object-oriented programming languages such as Common Lisp, Python, C++, Objective-C, Smalltalk, Delphi, Java, Swift, C#, Perl, Ruby, etc., and conventional procedural programming languages such as C or other similar programming languages.
計算設備中通常也包含一個或多個晶片組(Chipset)。計算設備的處理器可以與晶片組耦接或透過匯流排與晶片組電性連接。晶片組是由一個或多個積體電路(Integrated Circuit, IC)組成,包含記憶體控制器以及周邊輸出入(I/O)控制器等,也就是說,記憶體控制器以及周邊輸出入控制器可以包含在一個積體電路內,也可以使用兩個或更多的積體電路實現。晶片組通常提供了輸出入和記憶體管理功能、以及提供多個通用及/或專用暫存器、計時器等,其中,上述之通用及/或專用暫存器與計時器可以讓耦接或電性連接至晶片組的一個或多個處理器存取或使用。在部分的實施例中,晶片組也可能屬於處理器的一部份。Computing devices usually also include one or more chipsets. The processor of the computing device can be coupled to the chipset or electrically connected to the chipset through a bus. The chipset is composed of one or more integrated circuits (ICs), including a memory controller and a peripheral input/output (I/O) controller, etc. In other words, the memory controller and the peripheral input/output (I/O) controller can be included in one IC, or can be implemented using two or more ICs. The chipset usually provides input/output and memory management functions, as well as multiple general-purpose and/or dedicated registers, timers, etc., wherein the above-mentioned general-purpose and/or dedicated registers and timers can be accessed or used by one or more processors coupled or electrically connected to the chipset. In some embodiments, the chipset may also be part of the processor.
計算設備的處理器也可以透過記憶體控制器存取安裝於計算設備上的記憶體和大容量儲存區中的資料。上述之記憶體包含任何類型的揮發性記憶體(volatile memory)及/或非揮發性(non-volatile memory, NVRAM)記憶體,例如靜態隨機存取記憶體(Static Random Access Memory, SRAM)、動態隨機存取記憶體(Dynamic Random Access Memory, DRAM)、唯讀記憶體(Read-Only Memory, ROM)、快閃記憶體(Flash memory)等。上述之大容量儲存區可以包含任何類型的儲存裝置或儲存媒體,例如,硬碟機、光碟(optical disc)、隨身碟(flash drive)、記憶卡(memory card)、固態硬碟(Solid State Disk, SSD)、或任何其他儲存裝置等。也就是說,記憶體控制器可以存取靜態隨機存取記憶體、動態隨機存取記憶體、快閃記憶體、硬碟機、固態硬碟中的資料。The computing device's processor can also access data in the memory and mass storage installed on the computing device through the memory controller. This memory includes any type of volatile memory and/or non-volatile memory (NVRAM), such as static random access memory (SRAM), dynamic random access memory (DRAM), read-only memory (ROM), and flash memory. The aforementioned mass storage area can include any type of storage device or storage media, such as a hard drive, optical disc, flash drive, memory card, solid-state drive (SSD), or any other storage device. In other words, the memory controller can access data in static random access memory (SRAM), dynamic random access memory (DRAM), flash memory, hard drives, and SSDs.
計算設備的處理器也可以透過周邊輸出入控制器經由周邊輸出入匯流排與周邊輸出裝置、周邊輸入裝置、通訊介面、各種資料或訊號接收裝置等周邊裝置或介面連接並通訊。周邊輸入裝置可以是任何類型的輸入裝置,例如鍵盤、滑鼠、軌跡球、觸控板、搖桿等,周邊輸出裝置可以是任何類型的輸出裝置,例如顯示器、印表機等,周邊輸入裝置與周邊輸出裝置也可以是同一裝置,例如觸控螢幕等。通訊介面可以包含無線通訊介面及/或有線通訊介面,無線通訊介面可以包含支援無線區域網路(如Wi-Fi、Zigbee等)、藍牙、紅外線、近場通訊(Near-field communication, NFC)、3G/4G/5G等行動通訊網路(蜂巢式網路)或其他無線資料傳輸協定的介面,有線通訊介面可為乙太網路裝置、DSL數據機、纜線(Cable)數據機、非同步傳輸模式(Asynchronous Transfer Mode, ATM)裝置、或光纖通訊介面及/或元件等。資料或訊號接收裝置可以包含GPS接收器或生理訊號接收器,生理訊號接收器所接收的生理訊號包含但不限於心跳、血氧等。處理器可以週期性地輪詢(polling)各種周邊裝置與介面,使得計算設備能夠透過各種周邊裝置與介面進行資料的輸入與輸出,也能夠與具有上面描述之硬體元件的另一個計算設備進行通訊。The processor of a computing device can also connect to and communicate with peripheral devices or interfaces, such as peripheral output devices, peripheral input devices, communication interfaces, and various data or signal receiving devices, through a peripheral input/output controller via a peripheral input/output bus. A peripheral input device can be any type of input device, such as a keyboard, mouse, trackball, touchpad, or joystick. A peripheral output device can be any type of output device, such as a monitor or printer. The peripheral input device and peripheral output device can also be the same device, such as a touchscreen. The communication interface may include a wireless communication interface and/or a wired communication interface. The wireless communication interface may include an interface supporting wireless local area networks (such as Wi-Fi, Zigbee, etc.), Bluetooth, infrared, near-field communication (NFC), 3G/4G/5G mobile communication networks (cellular networks), or other wireless data transmission protocols. The wired communication interface may be an Ethernet device, a DSL modem, a cable modem, an asynchronous transfer mode (ATM) device, or an optical fiber communication interface and/or component. The data or signal receiving device may include a GPS receiver or a physiological signal receiver. The physiological signals received by the physiological signal receiver include, but are not limited to, heart rate and blood oxygen levels. The processor can periodically poll various peripheral devices and interfaces, allowing the computing device to input and output data through various peripheral devices and interfaces, and also to communicate with another computing device having the hardware components described above.
以下先以「第1圖」本發明所提之產生牙齒治療計畫並提供治療模擬影像之裝置之元件示意圖來說明實現本發明的裝置。如「第1圖」所示,本發明之裝置100含有記憶體110、通訊介面130、儲存媒體140、顯示模組150、處理器170、匯流排190。其中,記憶體110、通訊介面130、儲存媒體140、顯示模組150、處理器170透過匯流排190相互連接。The following will first illustrate the device for implementing the present invention, using Figure 1, a schematic diagram of the components of the device for generating a dental treatment plan and providing treatment simulation images. As shown in Figure 1, the device 100 of the present invention includes a memory 110, a communication interface 130, a storage medium 140, a display module 150, a processor 170, and a bus 190. The memory 110, communication interface 130, storage medium 140, display module 150, and processor 170 are interconnected via bus 190.
記憶體110可以儲存一組或多組計算機指令。Memory 110 can store one or more sets of computer instructions.
通訊介面130可以連線到外部的網路儲存裝置或伺服器等網路裝置,並可以向所連接的網路裝置請求並下載資料。通訊介面130也可以連線到外部的顯示裝置(圖中未示),並可以將處理器170所產生的資料(如治療模擬影像、預約就診時間等)傳送給所連接的顯示裝置顯示。Communication interface 130 can connect to an external network device, such as a network storage device or server, and can request and download data from the connected network device. Communication interface 130 can also connect to an external display device (not shown) and transmit data generated by processor 170 (such as treatment simulation images, appointment schedules, etc.) to the connected display device for display.
儲存媒體140可以儲存通訊介面130所接收到的資料,也可以儲存提供給處理器170使用的資料及處理器170所產生的資料。The storage medium 140 can store data received by the communication interface 130 , and can also store data provided to the processor 170 and data generated by the processor 170 .
顯示模組150可以顯示處理器170所產生的資料,如完整或部分的治療模擬影像、預約的就診時間等,但本發明並不以此為限。The display module 150 can display data generated by the processor 170, such as complete or partial treatment simulation images, scheduled appointment times, etc., but the present invention is not limited thereto.
處理器170可以如「第2圖」本發明所提之產生牙齒治療計畫並提供治療模擬影像之模組示意圖所示,包含影像取得模組210、影像分析模組220、計畫產生模組230、模型建立模組250、影像生成模組260、影像輸出模組280、及可附加的行為判斷模組270、時間預約模組290等模組。在部分的實施例中,處理器170可以執行記憶體110所儲存的計算機指令,並可以在執行計算機指令後產生「第2圖」中的各模組;在另一部份的實施例中,「第2圖」中的各模組可以是由一個或多個電路及/或完整或部分的晶片等硬體元件產生,即處理器170包含組成「第2圖」中之各模組的硬體元件,也就是說,處理器170所包含的各模組可以是軟體模組,也可以是硬體模組,本發明沒有特別的限制。The processor 170 can be as shown in "Figure 2" which is a schematic diagram of the module for generating a dental treatment plan and providing a treatment simulation image as proposed in the present invention, including an image acquisition module 210, an image analysis module 220, a plan generation module 230, a model building module 250, an image generation module 260, an image output module 280, and additional modules such as a behavior judgment module 270 and a time reservation module 290. In some embodiments, the processor 170 can execute computer instructions stored in the memory 110 and can generate the modules in "Figure 2" after executing the computer instructions; in other embodiments, the modules in "Figure 2" can be generated by one or more circuits and/or hardware components such as complete or partial chips, that is, the processor 170 includes hardware components that constitute the modules in "Figure 2", that is, the modules included in the processor 170 can be software modules or hardware modules, and the present invention has no special limitations.
影像取得模組210負責取得全口牙齒影像。本發明所提之全口牙齒影像為使用全口掃描X光攝影(Panoramic x-ray)所產生之環形掃描的全景X光影像。影像取得模組210可以透過通訊介面130由拍攝全景X光影像之攝影裝置所提供的應用程式介面(Application Programming Interface, API)取得全口牙齒影像,也可以透過通訊介面130由儲存全口牙齒影像的儲存裝置(圖中未示)取得全口牙齒影像,本發明沒有特別的限制。Image acquisition module 210 is responsible for acquiring full-mouth dental images. The full-mouth dental images referred to in the present invention are panoramic X-ray images generated using panoramic scanning X-rays. Image acquisition module 210 can acquire full-mouth dental images via the application programming interface (API) provided by the device that captures the panoramic X-ray images, or from a storage device (not shown) that stores full-mouth dental images, via communication interface 130. The present invention is not particularly limited to these methods.
影像分析模組220負責分析影像取得模組210所取得的全口牙齒影像,並可以在分析後產生全口牙齒狀況資料。更詳細的,影像分析模組220可以在全口牙齒影像中對各個牙齒的牙齒狀態產生標記以產生牙齒標記資料、可以分析全口牙齒影像的牙周狀態以產生牙周分析結果、及/或可以分析全口牙齒影像中的空間縫隙以產生縫隙分析結果,影像分析模組220並可以產生包含所產生之牙齒標記資料、牙周分析結果、及/或縫隙分析結果的全口牙齒狀況資料。The image analysis module 220 is responsible for analyzing the full-mouth dental images acquired by the image acquisition module 210 and generating full-mouth dental condition data after analysis. Specifically, the image analysis module 220 may mark the dental condition of each tooth in the full-mouth dental image to generate dental marking data, analyze the periodontal condition of the full-mouth dental image to generate periodontal analysis results, and/or analyze the spaces and crevices in the full-mouth dental image to generate crevices analysis results. The image analysis module 220 may then generate full-mouth dental condition data that includes the generated dental marking data, periodontal analysis results, and/or crevices analysis results.
舉例來說,影像分析模組220可以對全口牙齒影像進行影像分析,藉以判斷全口牙齒影像中之各牙齒的形狀、顏色、位置、生長角度及牙床骨頭的形狀與位置等資料(如依據全口牙齒影像中之顏色分布取得各牙齒與牙床骨頭的輪廓等),並可以依據全口牙齒影像中牙齒的形狀與顏色判斷牙齒的當前狀態(如正常或發育不良或蛀牙或假牙或經過根管治療等),也可以依據全口牙齒影像中牙齒與牙床骨骼在前後方向與左右方向的角度判斷牙齒的歪斜程度,並可以產生表示病患口腔內各牙齒之當前狀態與歪斜程度的牙齒標記資料;影像分析模組220也可以依據全口牙齒影像中牙齒的相對位置判斷牙齒的排列狀況以產生排列分析結果;影像分析模組220也可以依據全口牙齒影像中之牙床骨頭(如齒槽骨)的形狀判斷被破壞的狀況或缺損程度進而產生牙周分析結果;影像分析模組220也可以依據各牙齒的輪廓產生縫隙分析結果等,但本發明並不以此為限。For example, the image analysis module 220 can perform image analysis on the full-mouth dental image to determine the shape, color, position, growth angle of each tooth in the full-mouth dental image and the shape and position of the gum bone (such as obtaining the outline of each tooth and the gum bone based on the color distribution in the full-mouth dental image, etc.), and can also determine the current state of the tooth (such as normal or dysplasia or tooth decay or denture or after root canal treatment, etc.) based on the shape and color of the tooth in the full-mouth dental image, and can also determine the angle between the tooth and the gum bone in the front-back direction and the left-right direction in the full-mouth dental image. The image analysis module 220 can determine the degree of tooth crookedness and generate tooth marking data indicating the current state and degree of crookedness of each tooth in the patient's mouth. The image analysis module 220 can also determine the arrangement of the teeth based on the relative positions of the teeth in the full-mouth dental image to generate an arrangement analysis result. The image analysis module 220 can also determine the state of damage or the degree of defect based on the shape of the gum bone (such as the alveolar bone) in the full-mouth dental image to generate a periodontal analysis result. The image analysis module 220 can also generate a gap analysis result based on the outline of each tooth, etc., but the present invention is not limited to this.
計畫產生模組230負責依據影像分析模組220所產生的全口牙齒狀況資料產生牙齒治療計畫。在部分的實施例中,計畫產生模組230可以將全口牙齒狀況資料提供給已訓練完成的深度學習模型,藉以透過人工智慧(Artificial Intelligence, AI)產生牙齒治療計畫。其中,深度學習模型包含但不限於三維卷積網路(3D Convolutional Neural Network)模型、模式匹配與概率樹(Pattern Matching and Probability Tree, PMPT)模型、各種特徵選擇(Feature Selections)模型等。計畫產生模組230可以透過通訊介面130取得被治療之病患表示滿意的牙齒治療計畫與相對應的全口牙齒狀況資料,並將所取得之全口牙齒狀況資料與對應的牙齒治療計畫提供給深度學習模型,藉以訓練深度學習模型。The plan generation module 230 is responsible for generating a dental treatment plan based on the full-mouth dental data generated by the image analysis module 220. In some embodiments, the plan generation module 230 can provide the full-mouth dental data to a trained deep learning model to generate a dental treatment plan using artificial intelligence (AI). Deep learning models include, but are not limited to, 3D convolutional neural network models, pattern matching and probability tree (PMPT) models, and various feature selection models. The plan generation module 230 can obtain the dental treatment plan that the treated patient is satisfied with and the corresponding full-mouth dental condition data through the communication interface 130, and provide the obtained full-mouth dental condition data and the corresponding dental treatment plan to the deep learning model to train the deep learning model.
在另一部分的實施例中,計畫產生模組230也可以依據全口牙齒狀態資料判斷病患口中的每一顆牙齒是否經過治療,並依據每一顆牙齒是否經過治療選擇與各牙齒相對應的牙齒治療方案,及產生包含所選出之所有牙齒治療方案的牙齒治療計畫。舉例來說,當牙齒經過根管治療、植牙等治療時,被選擇的牙齒治療方案與牙齒沒有經過治療的牙齒治療方案可能不同,例如,計畫產生模組230可以依據全口牙齒狀態資料中的每一顆牙齒的牙齒標記資料判斷每一顆牙齒的治療狀況,當牙齒沒有經過治療時,計畫產生模組230未沒有經過治療之牙齒選擇的牙齒治療方案可以是洗牙,當牙齒經過根管治療時,計畫產生模組230未經過根管治療之牙齒選擇的牙齒治療方案除了洗牙之外還可能增加使用工具治療牙齒表面、牙根與牙齦線下區域的牙結石、牙菌斑等汙垢與殘留物的過程,而當牙齒經過植牙時,計畫產生模組230未經過植牙之牙齒選擇的牙齒治療方案則可能不會是直接使用洗牙工具沖洗,而是使用特殊工具對植牙的牙齒及周圍區域輕柔地進行治療。其中,上述之特殊工具如植牙刷或特製牙線,但本發明並不以此為限;上述之周圍區域包含但不限於植牙之牙齒的牙齦與周圍軟組織、植牙與鄰近牙齒間的隙縫等。另外,當牙齒的排列位置導致有部分的牙齒或牙齦無法輕易讓病患自行治療時,還可以增加選擇的牙齒治療方案,例如,計畫產生模組230可以依據全口牙齒狀態資料中各牙齒的排列分析結果判斷存在有一顆或多顆牙齒被其他牙齒遮擋,且可以依據牙齒標記資料判斷遮擋其他牙齒的牙齒向口腔外側歪斜達到一定程度時,表示歪斜的牙齒與被遮擋的牙齒間將存在一個空間,因此,計畫產生模組230可以進一步判定上述兩種牙齒間的空間(即牙齒被遮擋的部分)無法輕易被病患自行治療,如此,計畫產生模組230可以為被遮擋的牙齒選擇額外的牙齒治療方案,但本發明並不以此為限。In another embodiment, the plan generation module 230 can also determine whether each tooth in the patient's mouth has been treated based on the full-mouth dental status data, select a dental treatment plan corresponding to each tooth based on whether each tooth has been treated, and generate a dental treatment plan that includes all selected dental treatment plans. For example, when a tooth has undergone root canal treatment, dental implants, etc., the selected tooth treatment plan may be different from the tooth treatment plan for a tooth that has not undergone treatment. For example, the plan generation module 230 can judge the treatment status of each tooth based on the tooth marking data of each tooth in the full mouth tooth status data. When the tooth has not undergone treatment, the tooth treatment plan selected by the plan generation module 230 for the tooth that has not undergone treatment may be teeth cleaning. When the tooth has undergone root canal treatment, the tooth treatment plan selected by the plan generation module 230 for the tooth that has not undergone treatment may be teeth cleaning. In addition to teeth cleaning, the tooth treatment plan selected by the plan generation module 230 for teeth that have not undergone root canal treatment may also include the use of tools to treat dental calculus, plaque, and other dirt and residues on the tooth surface, tooth root, and subgingival area. When a tooth has been implanted, the tooth treatment plan selected by the plan generation module 230 for teeth that have not undergone implantation may not be to directly use teeth cleaning tools for rinsing, but to use special tools to gently treat the implanted tooth and surrounding areas. Among them, the above-mentioned special tools are such as implant brushes or special dental floss, but the present invention is not limited to them; the above-mentioned surrounding areas include but are not limited to the gums of the implanted teeth and the surrounding soft tissues, the gaps between the implanted teeth and the adjacent teeth, etc. In addition, when the arrangement of the teeth causes some teeth or gums to be difficult for the patient to treat by themselves, additional tooth treatment options can be added. For example, the plan generation module 230 can determine whether one or more teeth are blocked by other teeth based on the arrangement analysis results of each tooth in the full-mouth tooth status data, and can determine the direction of the teeth blocking other teeth to the oral cavity based on the tooth marking data. When the lateral deflection reaches a certain degree, it indicates that a space will exist between the deflected tooth and the obstructed tooth. Therefore, the plan generation module 230 can further determine that the space between the two teeth (i.e., the obstructed portion of the tooth) cannot be easily treated by the patient himself. In this way, the plan generation module 230 can select an additional dental treatment plan for the obstructed tooth, but the present invention is not limited to this.
計畫產生模組230也負責決定所產生之牙齒治療計畫中所包含之各種牙齒治療方案的執行順序。舉例來說,計畫產生模組230可以針對各種牙齒治療方案定義優先權值,並依據所選出之各個牙齒治療方案的優先權值排列所選出的牙齒治療方案以決定執行順序,但計畫產生模組230決定牙齒治療方案之執行順序的方式並不以上述為限。其中,計畫產生模組230可以提供設定各種牙齒治療方案的優先權值,在部分的實施例中,計畫產生模組230也可以依據各種牙齒治療方案過去實際的執行順序自動建立或調整各種牙齒治療方案的優先權值。The plan generation module 230 is also responsible for determining the execution order of the various dental treatment plans included in the generated dental treatment plan. For example, the plan generation module 230 may define priorities for the various dental treatment plans and rank the selected dental treatment plans according to their priorities to determine the execution order. However, the method by which the plan generation module 230 determines the execution order of the dental treatment plans is not limited to the above. The plan generation module 230 may provide a setting for the priority of various dental treatment plans. In some embodiments, the plan generation module 230 may also automatically establish or adjust the priority of various dental treatment plans based on the actual execution order of the various dental treatment plans in the past.
計畫產生模組230也可以取得被產生之牙齒治療計畫所包含之各種牙齒治療方案的執行間隔。本發明所提之執行間隔為進行不同牙齒治療方案需要等待的間隔時間,可以是零(也就是無需等待可以立刻進行下一種牙齒治療方案),也可以是五分鐘、一小時、七天、兩周等。一般而言,每一種牙齒治療方案的執行間隔是固定的,但在部分的實施例中,也可能因為後續執行的牙齒治療方案不同而有不同的執行間隔。每一種牙齒治療方案的執行間隔可以使用檔案或資料庫的形式被儲存在儲存媒體140或外部的儲存裝置(圖中未示)中,計畫產生模組230可以直接由儲存媒體140讀出或透過通訊介面130連線到儲存裝置下載所選出之牙齒治療方案的執行間隔,但本發明並不以此為限。The plan generation module 230 can also obtain the execution intervals of the various dental treatment plans included in the generated dental treatment plan. The execution interval mentioned in the present invention refers to the waiting time between different dental treatment plans. It can be zero (i.e., no waiting time required to proceed to the next dental treatment plan), or it can be five minutes, one hour, seven days, two weeks, etc. Generally speaking, the execution interval of each dental treatment plan is fixed, but in some embodiments, the execution interval may vary depending on the subsequent dental treatment plan. The execution interval of each dental treatment plan can be stored in the form of a file or database in the storage medium 140 or an external storage device (not shown). The plan generation module 230 can directly read the execution interval of the selected dental treatment plan from the storage medium 140 or connect to the storage device through the communication interface 130 to download the execution interval of the selected dental treatment plan, but the present invention is not limited to this.
模型建立模組250負責依據影像分析模組220所產生的全口牙齒狀況資料建立病患的全口牙齒模型。舉例來說,模型建立模組250可以依據全口牙齒狀況資料中所包含之各個牙齒表面與牙根的形狀資料建立各個牙齒的三維模型,也可以依據全口牙齒狀況資料中所包含之牙齦、牙齦韌帶與齒槽骨的特徵建立牙齦與齒槽的三維模型,並可以組合各牙齒、牙齦與齒槽的三維模型以產生全口牙齒模型。但模型建立模組250建立全口牙齒模型的方式並不以上述為限。The model building module 250 is responsible for creating a full-mouth dental model of the patient based on the full-mouth dental data generated by the image analysis module 220. For example, the model building module 250 can create a three-dimensional model of each tooth based on the shape data of each tooth surface and root included in the full-mouth dental data. Alternatively, the model building module 250 can create a three-dimensional model of the gum and alveolar bone based on the characteristics of the gum, gingival ligament, and alveolar bone included in the full-mouth dental data. Furthermore, the model building module 250 can combine three-dimensional models of each tooth, gum, and alveolar bone to generate a full-mouth dental model. However, the methods used by the model building module 250 to create a full-mouth dental model are not limited to the above.
影像生成模組260負責依據計畫產生模組230所產生之牙齒治療計畫所包含的牙齒治療方案與執行順序及模型建立模組250所建立的全口牙齒模型建立與全口牙齒模型對應的治療模擬影像。舉例來說,影像生成模組260可以取得計畫產生模組230所產生之牙齒治療計畫所包含之每一個牙齒治療方案的物件顯示訊息,並依據所取得之各物件顯示訊息產生模擬物件及模擬物件被使用時的移動及/或轉動過程,如牙齒治療方案所使用到之器械及器械的操作過程等;影像生成模組260也可以依據模擬物件之使用過程產生在模型建立模組250所產生之全口牙齒模型中使用所產生之模擬物件的模擬影像,如模擬沖牙機(物件)對全口牙齒模型上的特定牙齒噴水、模擬清潔工具(物件)清潔全口牙齒模型上的特定牙齒與牙根上的牙結石與牙菌斑等,藉以使用全口牙齒模型及依據物件顯示訊息產生之模擬物件產生與各牙齒治療方案對應的治療方案模擬影像;影像生成模組260還可以依據各牙齒治療方案的執行順序合併排列各牙齒治療方案對應的治療方案模擬影像以產生治療模擬影像。其中,物件顯示訊息可以使用檔案或資料庫的形式被儲存在儲存媒體140或外部的儲存裝置(圖中未示)中,影像生成模組260可以由儲存媒體140讀出物件顯示訊息或透過通訊介面130連線到儲存裝置下載物件顯示訊息。但影像生成模組260產生治療模擬影像的方式並不以上述為限。The image generation module 260 is responsible for creating a treatment simulation image corresponding to the full-mouth dental model based on the dental treatment plan and execution sequence included in the dental treatment plan generated by the plan generation module 230 and the full-mouth dental model created by the model creation module 250. For example, the image generation module 260 can obtain the object display information of each dental treatment plan included in the dental treatment plan generated by the plan generation module 230, and generate simulation objects and the movement and/or rotation process of the simulation objects when they are used according to the obtained object display information, such as the instruments used in the dental treatment plan and the operation process of the instruments; the image generation module 260 can also generate simulation objects used in the full-mouth dental model generated by the model building module 250 according to the use process of the simulation objects. The image generation module 260 can generate a treatment plan simulation image corresponding to each dental treatment plan by using the full-mouth dental model and the simulation objects generated based on the object display information. The image generation module 260 can also merge and arrange the treatment plan simulation images corresponding to each dental treatment plan according to the execution order of each dental treatment plan to generate a treatment simulation image. The object display information can be stored in the form of a file or database in the storage medium 140 or an external storage device (not shown). The image generation module 260 can read the object display information from the storage medium 140 or download the object display information from the storage device via the communication interface 130. However, the method for the image generation module 260 to generate the treatment simulation image is not limited to the above.
影像生成模組260也可以依據影像分析模組220所產生之全口牙齒狀況資料在模型建立模組250所建立之全口牙齒模型中為一個或多個牙齒標上顏色。舉例來說,影像生成模組260可以設定與正常牙齒、發育不良的牙齒、蛀牙、假牙、經過根管治療的牙齒對應的不同顏色,並可以依據全口牙齒狀況資料中之各種牙齒標記資料所對應的顏色在全口牙齒模型中標記出各個牙齒,藉以在產生治療方案模擬影像時,所產生之治療方案模擬影像中全口牙齒模型中的牙齒存在各種對應的顏色;影像生成模組260也可以依據全口牙齒狀況資料中之牙周分析結果在所產生的治療方案模擬影像中標記出可能發生牙齦萎縮的區域等。The image generation module 260 can also color one or more teeth in the full-mouth dental model created by the model creation module 250 based on the full-mouth dental condition data generated by the image analysis module 220. For example, the image generation module 260 can set different colors corresponding to normal teeth, dysplastic teeth, cavities, dentures, and teeth that have undergone root canal treatment. It can also mark each tooth in the full-mouth dental model based on the colors corresponding to various tooth marking data in the full-mouth dental condition data. When a treatment plan simulation image is generated, the teeth in the full-mouth dental model in the generated treatment plan simulation image have various corresponding colors. The image generation module 260 can also mark areas where gum atrophy may occur in the generated treatment plan simulation image based on the periodontal analysis results in the full-mouth dental condition data.
影像生成模組260也可以依據模型建立模組250建立全口牙齒模型時產生各牙齒或牙齦的資料進行計算以建立有問題的牙齒或牙齦的三維模型,並依據所建立的三維模型對有問題的牙齒或牙齦生成額外的影像,例如,產生有問題之牙齒的不同視角的影像、放大有問題的牙齦部位的影像等。其中,上述之問題包含但不限於牙齒或牙齦的顏色與預設顏色的色差高於一定值、牙齒或牙齦的形狀與預設形狀的相似度低於一定值、牙齒歪斜達到一定程度等。The image generation module 260 can also perform calculations based on the data of each tooth or gum generated when the model building module 250 builds the full-mouth dental model to create a three-dimensional model of the problematic tooth or gum. Based on the created three-dimensional model, the module can generate additional images of the problematic tooth or gum, for example, by generating images of the problematic tooth or gum from different angles or magnifying the problematic gum area. Such problems include, but are not limited to, a color difference between the tooth or gum and the preset color exceeding a certain value, a shape similar to the preset shape falling below a certain value, or a tooth crooked to a certain degree.
行為判斷模組270可以依據治療器械的使用狀況判斷當前之治療行為。舉例來說,行為判斷模組270可以依據對病患進行牙齒治療之即時影像進行影像分析,藉以判斷牙齒治療之即時影像中被使用的治療器械與器械被使用的動作,並可以使用已訓練的人工智慧模型對所判斷出之器械與動作進一步判斷當前的治療行為,也就是判斷當前正在進行洗牙、深層洗牙、根面平整、根管治療等牙齒治療方案,但本發明並不以此為限,例如,行為判斷模組270也可以透過通訊介面130取得治療器械被使用的使用訊號,並依據所取得的使用訊號判斷當前的治療行為。其中,行為判斷模組270可以使用經過標記或標註之包含器械與使用器械之動作的影像訓練人工智慧模型。The behavior judgment module 270 can judge the current treatment behavior based on the usage status of the treatment device. For example, the behavior judgment module 270 can perform image analysis based on real-time images of dental treatment of patients to determine the treatment instruments used and the actions of the instruments used in the real-time images of dental treatment, and can use the trained artificial intelligence model to further determine the current treatment behavior based on the determined instruments and actions, that is, to determine whether the current dental treatment plan is scaling, deep scaling, root planing, root canal treatment, etc., but the present invention is not limited to this. For example, the behavior judgment module 270 can also obtain a usage signal of the treatment instrument being used through the communication interface 130, and determine the current treatment behavior based on the obtained usage signal. The behavior judgment module 270 may use labeled or annotated images containing instruments and actions of using the instruments to train an artificial intelligence model.
影像輸出模組280可以輸出影像生成模組260所產生的治療模擬影像。影像輸出模組280可以輸出完整的治療模擬影像,也可以輸出部分的治療模擬影像,例如,影像輸出模組280可以由影像生成模組260所產生的治療模擬影像中選擇與行為判斷模組270所判斷出之治療行為對應之部分影像並輸出所選擇之部分的治療模擬影像,也就是輸出與當前進行之牙齒治療方案對應的治療方案模擬影像,但本發明並不以此為限。要說明的是,影像輸出模組280可以將輸出的治療模擬影像提供給顯示模組150,使得顯示模組150顯示治療模擬影像;或影像輸出模組280也可以將治療模擬影像輸出到通訊介面130,使得通訊介面130將治療模擬影像提供給外部的顯示裝置(圖中未示)顯示。The image output module 280 can output the treatment simulation image generated by the image generation module 260. The image output module 280 can output a complete treatment simulation image or a partial treatment simulation image. For example, the image output module 280 can select a portion of the treatment simulation image generated by the image generation module 260 that corresponds to the treatment behavior determined by the behavior determination module 270 and output the selected portion of the treatment simulation image. In other words, the image output module 280 can output a treatment plan simulation image corresponding to the currently ongoing dental treatment plan, but the present invention is not limited to this. It should be noted that the image output module 280 can provide the output treatment simulation image to the display module 150, so that the display module 150 displays the treatment simulation image; or the image output module 280 can also output the treatment simulation image to the communication interface 130, so that the communication interface 130 provides the treatment simulation image to an external display device (not shown) for display.
時間預約模組290可以依據計畫產生模組230所產生之牙齒治療計畫所包含之各個牙齒治療方案的執行順序與所取得之各個牙齒治療方案的執行間隔預約一個或多個就診時間。舉例來說,時間預約模組290可以依據各個牙齒治療方案的執行順序與執行間隔計算各個牙齒治療方案的預定就診日期,並透過通訊介面130連線到外部的預約系統查詢各個預定就診日期是否還有可看診的時間,若有,則時間預約模組290可以產生並傳送預約訊息給預約系統以預約就診時間,若沒有,則時間預約模組290可以延後預定就診日期,並對應調整順序在後之其他牙齒治療方案的預定就診日期,直到所有的牙齒治療方案都完成預約為止。但時間預約模組290預約就診時間的方式並不以上述為限。The time reservation module 290 can reserve one or more consultation times according to the execution sequence of each dental treatment plan included in the dental treatment plan generated by the plan generation module 230 and the execution interval of each dental treatment plan. For example, the time reservation module 290 can calculate the scheduled appointment date of each dental treatment plan based on the execution sequence and execution interval of each dental treatment plan, and connect to the external appointment system through the communication interface 130 to query whether there is a time available for each scheduled appointment date. If so, the time reservation module 290 can generate and transmit an appointment message to the appointment system to schedule the appointment time. If not, the time reservation module 290 can postpone the scheduled appointment date and adjust the scheduled appointment dates of other dental treatment plans in the subsequent sequence accordingly until all dental treatment plans have completed the appointment. However, the method for booking a consultation time by the appointment module 290 is not limited to the above.
接著以一個實施例來解說本發明的運作系統與方法,並請參照「第3A圖」本發明所提之產生牙齒治療計畫並提供治療模擬影像之方法流程圖。在本實施例中假設實現本發明的裝置100為設置於牙醫診所內提供治療輔助的電腦,但本發明並不以此為限。Next, the operating system and method of the present invention will be explained using an embodiment. Please refer to Figure 3A for a flow chart illustrating the method for generating a dental treatment plan and providing treatment simulation images. In this embodiment, the device 100 implementing the present invention is assumed to be a computer located in a dental clinic to provide treatment assistance, but the present invention is not limited to this.
當牙醫診所的病患希望進行全口牙齒的治療時,裝置100的影像取得模組210可以病患的全口牙齒影像(步驟310)。在本實施例中,假設影像取得模組210可以透過裝置100的通訊介面130連線到存放全口牙齒影像之儲存裝置,並依據病患的病歷號碼取得病患的全口牙齒影像。When a patient at a dental clinic wishes to undergo full-mouth dental treatment, the image acquisition module 210 of the device 100 can obtain a full-mouth dental image of the patient (step 310). In this embodiment, it is assumed that the image acquisition module 210 can connect to a storage device storing full-mouth dental images via the communication interface 130 of the device 100 and obtain the full-mouth dental image of the patient based on the patient's medical record number.
在裝置100的影像取得模組210取得全口牙齒影像(步驟310)後,裝置100的影像分析模組220可以分析被取得的全口牙齒影像以產生全口牙齒狀況資料(步驟320)。在本實施例中,假設影像分析模組220可以對全口牙齒影像進行牙齒狀態標記以產生牙齒標記資料、牙周狀態分析以產生牙周分析結果、及全口空間縫隙分析以產生縫隙分析結果,並可以產生包含牙齒標記資料、牙周分析結果、與縫隙分析結果的全口牙齒狀況資料。After the image acquisition module 210 of the apparatus 100 acquires a full-mouth dental image (step 310), the image analysis module 220 of the apparatus 100 may analyze the acquired full-mouth dental image to generate full-mouth dental condition data (step 320). In this embodiment, it is assumed that the image analysis module 220 can perform tooth state marking on the full-mouth dental image to generate tooth marking data, periodontal state analysis to generate periodontal analysis results, and full-mouth space and septal analysis to generate septal analysis results. The generated full-mouth dental condition data includes the tooth marking data, periodontal analysis results, and septal analysis results.
在裝置100的影像分析模組220產生全口牙齒狀況資料後,裝置100的計畫產生模組230可以依據被產生的全口牙齒狀況資料產生牙齒治療計畫(步驟330)。在本實施例中,假設計畫產生模組230可以透過人工智慧產生牙齒治療計畫或依據全口牙齒狀況資料中之牙齒標記資料、牙周分析結果與排列分析結果選擇一種或多種牙齒治療方案以產生牙齒治療計畫,例如,在全口牙齒狀況資料中之牙周分析結果表示病患存在較嚴重的牙周病時,計畫產生模組230可以選擇常規洗牙、深層洗牙、根面平整等牙齒治療方案。其中,計畫產生模組230也可以如「第3B圖」之流程所示,先依據全口牙齒狀況資料中之牙齒標記資料判斷牙齒是否經過治療(步驟331),並依據牙齒經過治療與否選擇相對應的牙齒治療方案(步驟333),例如,計畫產生模組230可以先為未經治療的牙齒選擇常規洗牙的牙齒治療方案並可以在牙齒標記資料標記出存在經過根管治療或假牙等治療的牙齒時,選擇增加與根管治療之牙齒對應的殘留物治療或與假牙對應之輕柔治療等牙齒治療方案,同時,計畫產生模組230也可以在全口牙齒狀況資料中之牙齒標記資料與牙齒排列資料判斷有牙齒被遮擋而不易由病患自行治療時,選擇增加專門治療被遮擋部位之牙結石與牙菌斑的牙齒治療方案(步驟335),最後,計畫產生模組230可以產生包含所選擇之所有牙齒治療方案的牙齒治療計畫(步驟337)。After the image analysis module 220 of the device 100 generates the full-mouth dental condition data, the plan generation module 230 of the device 100 can generate a dental treatment plan based on the generated full-mouth dental condition data (step 330). In this embodiment, it is assumed that the plan generation module 230 can generate a dental treatment plan through artificial intelligence or select one or more dental treatment plans based on the tooth marking data, periodontal analysis results, and arrangement analysis results in the full-mouth dental condition data to generate a dental treatment plan. For example, when the periodontal analysis results in the full-mouth dental condition data indicate that the patient has more severe periodontal disease, the plan generation module 230 can select dental treatment plans such as conventional teeth cleaning, deep teeth cleaning, and root planing. Among them, the plan generation module 230 can also be as shown in the process of "Figure 3B", first based on the tooth marking data in the full mouth tooth condition data to determine whether the tooth has been treated (step 331), and according to whether the tooth has been treated or not, select the corresponding tooth treatment plan (step 333). For example, the plan generation module 230 can first select the conventional teeth cleaning tooth treatment plan for the untreated teeth and can select to add the root canal treatment plan when the tooth marking data indicates that there are teeth that have been treated with root canal treatment or dentures. The plan generation module 230 may select a dental treatment plan such as residual treatment corresponding to the treated tooth or gentle treatment corresponding to the denture. At the same time, when the tooth marking data and tooth arrangement data in the full-mouth dental condition data determine that a tooth is obstructed and difficult for the patient to treat by himself, the plan generation module 230 may choose to add a dental treatment plan specifically for treating calculus and plaque in the obstructed area (step 335). Finally, the plan generation module 230 may generate a dental treatment plan including all the selected dental treatment plans (step 337).
在裝置100的計畫產生模組230產生出牙齒治療計畫後,計畫產生模組230可以進一步的決定牙齒治療計畫中所包含之牙齒治療方案的執行順序(步驟350)。在本實施例中,假設計畫產生模組230可以依據對各個牙齒治療方案預先定義的優先權值排列所選出的牙齒治療方案,例如,決定執行順序依序為常規洗牙、遮擋部位治療、深層洗牙、殘留物治療、輕柔治療、根面平整等。After the plan generation module 230 of the apparatus 100 generates the dental treatment plan, the plan generation module 230 may further determine the execution order of the dental treatment plans included in the dental treatment plan (step 350). In this embodiment, it is assumed that the plan generation module 230 may rank the selected dental treatment plans according to a predefined priority value for each dental treatment plan, for example, determining the execution order to be conventional scaling, occlusal treatment, deep scaling, residual treatment, gentle treatment, root planing, etc.
同樣在裝置100的影像分析模組220產生全口牙齒狀況資料(步驟320)後,裝置100的模型建立模組250可以依據被產生的全口牙齒狀況資料建立全口牙齒模型(步驟360)。在本實施例中,也就是建立病患的全口三維牙齒模型。Similarly, after the image analysis module 220 of the device 100 generates full-mouth dental condition data (step 320), the model building module 250 of the device 100 can create a full-mouth dental model based on the generated full-mouth dental condition data (step 360). In this embodiment, a full-mouth three-dimensional dental model of the patient is created.
要說明的是,在實務上,裝置100的計畫產生模組230依據全口牙齒狀況資料產生牙齒治療計畫並決定牙齒治療計畫所包含之牙齒治療方案的執行順序(步驟330、350)與裝置100的模型建立模組250依據全口牙齒狀況資料建立全口牙齒模型(步驟360)並沒有先後次序的關係,也就是說,計畫產生模組230可以在模型建立模組250完成全口牙齒模型的建立後才選擇牙齒治療方案並決定執行順序。It should be noted that, in practice, there is no order between the plan generation module 230 of the device 100 generating a dental treatment plan based on the full-mouth dental condition data and determining the execution sequence of the dental treatment plans included in the dental treatment plan (steps 330, 350) and the model building module 250 of the device 100 establishing a full-mouth dental model based on the full-mouth dental condition data (step 360). In other words, the plan generation module 230 can select a dental treatment plan and determine the execution sequence after the model building module 250 completes the establishment of the full-mouth dental model.
在裝置100的計畫產生模組230決定所產生之牙齒治療計畫包含的牙齒治療方案的執行順序(步驟350)且裝置100的模型建立模組250依據全口牙齒狀況資料建立全口牙齒模型(步驟360)後,裝置100的影像生成模組260可以依據計畫產生模組230所選出之牙齒治療方案、計畫產生模組230所決定之各牙齒治療方案的執行順序與模型建立模組250所產生之全口牙齒模型建立與全口牙齒模型對應的治療模擬影像(步驟370)。在本實施例中,假設牙齒治療方案的執行順序依序為常規洗牙、遮擋部位治療、深層洗牙、殘留物治療、輕柔治療、根面平整,影像生成模組260可以先取得常規洗牙的物件顯示訊息,並可以依據所取得之物件顯示訊息中的物件基本訊息產生常規洗牙之各種器械的模擬影像,及可以依據物件顯示訊息中的物件操作訊息在全口牙齒模型中移動及/或轉動所產生之器械的模擬影像以產生常規洗牙的模擬影像,相似的,影像生成模組260也可以依序取得遮擋部位治療、深層洗牙、殘留物治療、輕柔治療、根面平整等牙齒治療方案的物件顯示訊息並依據物件顯示訊息在全口牙齒模型中顯示對應器械以產生治療模擬影像。After the plan generation module 230 of the device 100 determines the execution order of the dental treatment plans included in the generated dental treatment plan (step 350) and the model building module 250 of the device 100 establishes a full-mouth dental model based on the full-mouth dental condition data (step 360), the image generation module 260 of the device 100 can establish a treatment simulation image corresponding to the full-mouth dental model based on the dental treatment plans selected by the plan generation module 230, the execution order of each dental treatment plan determined by the plan generation module 230, and the full-mouth dental model generated by the model building module 250 (step 370). In this embodiment, assuming that the execution order of the dental treatment plan is conventional teeth cleaning, occluder treatment, deep teeth cleaning, residual treatment, gentle treatment, and root planing, the image generation module 260 can first obtain the object display information of conventional teeth cleaning, and can generate simulated images of various instruments of conventional teeth cleaning according to the basic information of the objects in the obtained object display information, and can generate simulated images of various instruments of conventional teeth cleaning according to the basic information of the objects in the object display information. The operation information generates a simulated image of the instrument when it is moved and/or rotated in the full-mouth dental model to produce a simulated image of conventional teeth cleaning. Similarly, the image generation module 260 can also sequentially obtain object display information of dental treatment plans such as occluded area treatment, deep teeth cleaning, residual treatment, gentle treatment, and root planing, and display the corresponding instrument in the full-mouth dental model according to the object display information to generate a treatment simulation image.
在裝置100的影像生成模組260產生治療模擬影像後,裝置100的影像輸出模組280可以輸出被產生的治療模擬影像(步驟380)。在本實施例中,假設影像輸出模組280可以將治療模擬影像輸出到裝置100的顯示模組150,使得顯示模組150可以顯示所取得的治療模擬影像,或者,影像輸出模組280可以透過裝置100的通訊介面130將治療模擬影像輸出到外部的顯示裝置,使得外部的顯示裝置顯示所接收到的治療模擬影像。After the image generation module 260 of the device 100 generates the treatment simulation image, the image output module 280 of the device 100 may output the generated treatment simulation image (step 380). In this embodiment, it is assumed that the image output module 280 may output the treatment simulation image to the display module 150 of the device 100, so that the display module 150 can display the obtained treatment simulation image. Alternatively, the image output module 280 may output the treatment simulation image to an external display device via the communication interface 130 of the device 100, so that the external display device can display the received treatment simulation image.
如此,透過本發明可以輔助牙醫選擇病患的牙齒治療計畫,同時也可以顯示治療模擬影像以輔助牙醫治療病患牙齒。In this way, the present invention can assist dentists in selecting a patient's dental treatment plan and can also display treatment simulation images to assist dentists in treating the patient's teeth.
上述實施例中,若裝置100還包含行為判斷模組270,則裝置100的影像輸出模組280在輸出被產生的治療模擬影像(步驟380)時,可以如「第3C圖」之流程所示,先透過行為判斷模組270判斷當前的治療行為(步驟381),並由裝置100的影像生成模組260產生的治療模擬影像中選出與被判斷出之治療行為對應的治療方案模擬影像(步驟383),並將治療模擬影像輸出到裝置100的顯示模組150或通訊介面130,使得顯示模組150可以顯示所取得的治療模擬影像或由通訊介面130將治療模擬影像輸出到外部的顯示裝置顯示(步驟385)。In the above embodiment, if the device 100 further includes a behavior judgment module 270, when the image output module 280 of the device 100 outputs the generated treatment simulation image (step 380), as shown in the process of "Figure 3C", the behavior judgment module 270 first judges the current treatment behavior (step 381), and the treatment behavior generated by the image generation module 260 of the device 100 is output. A treatment plan simulation image corresponding to the determined treatment behavior is selected from the treatment simulation images (step 383), and the treatment simulation image is output to the display module 150 or the communication interface 130 of the device 100, so that the display module 150 can display the obtained treatment simulation image or the communication interface 130 outputs the treatment simulation image to an external display device for display (step 385).
另外,上述實施例中,若裝置100還包含時間預約模組290,則如「第3D圖」之流程所示,在裝置100的計畫產生模組230決定牙齒治療計畫中所包含之牙齒治療方案的執行順序(步驟350)後,時間預約模組290可以依據計畫產生模組230所決定的執行順序與各個牙齒治療方案的執行間隔預約各個牙齒治療方案的就診時間(步驟393),並可以透過裝置100的顯示模組150顯示所預約的就診時間(步驟397)。In addition, in the above embodiment, if the device 100 further includes a time reservation module 290, then as shown in the process of "Figure 3D", after the plan generation module 230 of the device 100 determines the execution order of the dental treatment plans included in the dental treatment plan (step 350), the time reservation module 290 can reserve the consultation time of each dental treatment plan based on the execution order and the execution interval of each dental treatment plan determined by the plan generation module 230 (step 393), and can display the reserved consultation time through the display module 150 of the device 100 (step 397).
綜上所述,可知本發明與先前技術之間的差異在於具有分析全口牙齒影像以產生全口牙齒狀況資料並依據全口牙齒狀況資料產生牙齒治療計畫後,決定牙齒治療計畫所包含之牙齒治療方案的執行順序,同時依據全口牙齒狀況資料建立全口牙齒模型,並依據牙齒治療方案、執行順序與全口牙齒模型建立與全口牙齒模型對應之治療模擬影像且顯示治療模擬影像之技術手段,藉由此一技術手段可以來解決先前技術所存在牙齒治療方案是由牙醫依照經驗選擇並不一定真正適合病患的問題,進而達成輔助牙醫進行牙齒治療的技術功效。In summary, the difference between the present invention and the prior art is that the present invention has the ability to analyze full-mouth dental images to generate full-mouth dental condition data and generate a dental treatment plan based on the full-mouth dental condition data, and then determine the execution order of the dental treatment plans included in the dental treatment plan. At the same time, a full-mouth dental model is established based on the full-mouth dental condition data, and the dental treatment plan is generated based on the full-mouth dental condition data. The technology uses a plan, execution sequence, and full-mouth dental model to create and display a corresponding treatment simulation image. This technology can solve the problem of previous technologies where dental treatment plans are selected by dentists based on experience and may not be truly suitable for patients, thereby achieving the technical effect of assisting dentists in dental treatment.
再者,本發明之產生牙齒治療計畫並提供治療模擬影像之方法,可實現於硬體、軟體或硬體與軟體之組合中,亦可在電腦系統中以集中方式實現或以不同元件散佈於若干互連之電腦系統的分散方式實現。Furthermore, the method of generating a dental treatment plan and providing treatment simulation images of the present invention can be implemented in hardware, software, or a combination of hardware and software. It can also be implemented in a centralized manner in a computer system or in a distributed manner in which different components are distributed across several interconnected computer systems.
雖然本發明所揭露之實施方式如上,惟所述之內容並非用以直接限定本發明之專利保護範圍。任何本發明所屬技術領域中具有通常知識者,在不脫離本發明所揭露之精神和範圍的前提下,對本發明之實施的形式上及細節上作些許之更動潤飾,均屬於本發明之專利保護範圍。本發明之專利保護範圍,仍須以所附之申請專利範圍所界定者為準。While the embodiments disclosed above are limited to the present invention, these descriptions are not intended to directly limit the scope of patent protection for this invention. Any modifications or alterations in the form and details of the present invention made by a person skilled in the art without departing from the spirit and scope of this invention are within the scope of patent protection for this invention. The scope of patent protection for this invention shall remain subject to the scope of the attached patent application.
100:裝置110:記憶體130:通訊介面140:儲存媒體150:顯示模組170:處理器190:匯流排210:影像取得模組220:影像分析模組230:計畫產生模組250:模型建立模組260:影像生成模組270:行為判斷模組280:影像輸出模組290:時間預約模組步驟310:取得全口牙齒影像步驟320:分析全口牙齒影像以產生全口牙齒狀況資料步驟330:依據全口牙齒狀況資料產生牙齒治療計畫步驟331:依據全口牙齒狀態資料中之牙齒標記資料判斷牙齒經過治療或未經過治療步驟333:依據牙齒未經治療或經過治療之治療行為選擇與牙齒相對應之牙齒治療方案步驟335:依據全口牙齒狀態資料中之牙齒標記資料與排列分析結果判斷牙齒存在被遮擋之部分時,選擇與被遮擋之部分對應之牙齒治療方案步驟337:產生包含牙齒治療方案之牙齒治療計畫步驟350:決定牙齒治療計畫所包含之牙齒治療方案之執行順序步驟360:依據全口牙齒狀況資料建立全口牙齒模型步驟370:依據牙齒治療方案、執行順序與全口牙齒模型建立與全口牙齒模型對應之治療模擬影像步驟380:顯示治療模擬影像步驟381:判斷當前之治療行為步驟383:由治療模擬影像中選擇與治療行為對應之治療方案模擬影像步驟385:顯示治療方案模擬影像步驟393:依據牙齒治療方案的執行順序與執行間隔預約牙齒治療方案的就診時間步驟397:顯示就診時間100: Device 110: Memory 130: Communication Interface 140: Storage Medium 150: Display Module 170: Processor 190: Bus 210: Image Acquisition Module 220: Image Analysis Module 230: Plan Generation Module 250: Model Building Module 260: Image Generation Module 270: Behavior Judgment Module 280: Image Output Module 290: Time Reservation Module Step 310: Acquire Full-mouth Dental Images Step 320: Analyze the full-mouth dental image to generate full-mouth dental condition data. Step 330: Generate a dental treatment plan based on the full-mouth dental condition data. Step 331: Determine whether the tooth has been treated or not based on the tooth marker data in the full-mouth dental condition data. Step 333: Select a dental treatment plan corresponding to the tooth based on the treatment behavior of the tooth being treated or not. Step 335: Determine whether the tooth has been treated or not based on the tooth marker data in the full-mouth dental condition data. When the tooth marking data and the result of the arrangement analysis determine that there is an obstructed part of the tooth, the tooth treatment plan corresponding to the obstructed part is selected. Step 337: Generate a tooth treatment plan including the tooth treatment plan. Step 350: Determine the execution sequence of the tooth treatment plan included in the tooth treatment plan. Step 360: Create a full-mouth tooth model based on the full-mouth tooth condition data. Step 370: Based on the tooth treatment plan, execution sequence and full-mouth tooth model, Create a treatment simulation image corresponding to the full-mouth dental model. Step 380: Display the treatment simulation image. Step 381: Determine the current treatment behavior. Step 383: Select the treatment plan simulation image corresponding to the treatment behavior from the treatment simulation image. Step 385: Display the treatment plan simulation image. Step 393: Schedule the dental treatment plan consultation time based on the execution sequence and execution interval of the dental treatment plan. Step 397: Display the consultation time.
第1圖為本發明所提之產生牙齒治療計畫並提供治療模擬影像之裝置之元件示意圖。第2圖為本發明所提之產生牙齒治療計畫並提供治療模擬影像之模組示意圖。第3A圖為本發明所提之產生牙齒治療計畫並提供治療模擬影像之方法流程圖。第3B圖為本發明所提之產生牙齒治療計畫之方法流程圖。第3C圖為本發明所提之顯示治療方案模擬影像之方法流程圖。第3D圖為本發明所提之預約就診之附加方法流程圖。Figure 1 is a schematic diagram of the components of the device for generating a dental treatment plan and providing a treatment simulation image according to the present invention. Figure 2 is a schematic diagram of the module for generating a dental treatment plan and providing a treatment simulation image according to the present invention. Figure 3A is a flow chart of the method for generating a dental treatment plan and providing a treatment simulation image according to the present invention. Figure 3B is a flow chart of the method for generating a dental treatment plan according to the present invention. Figure 3C is a flow chart of the method for displaying a treatment plan simulation image according to the present invention. Figure 3D is a flow chart of the additional method for making an appointment for a medical consultation according to the present invention.
步驟310:取得全口牙齒影像 Step 310: Obtain full-mouth dental images
步驟320:分析全口牙齒影像以產生全口牙齒狀況資料 Step 320: Analyze the full-mouth dental image to generate full-mouth dental condition data.
步驟330:依據全口牙齒狀況資料選擇牙齒治療計畫 Step 330: Select a dental treatment plan based on the full dental condition data.
步驟350:決定牙齒治療計畫所包含之牙齒治療方案之執行順序 Step 350: Determine the order in which to implement the dental treatment options included in the dental treatment plan.
步驟360:依據全口牙齒狀況資料建立全口牙齒模型 Step 360: Create a full-mouth dental model based on full-mouth dental condition data.
步驟370:依據牙齒治療方案、執行順序與全口牙齒模型建立與全口牙齒模型對應之治療模擬影像 Step 370: Create a treatment simulation image corresponding to the full-mouth dental model based on the dental treatment plan, execution sequence, and full-mouth dental model.
步驟380:顯示治療模擬影像 Step 380: Display treatment simulation images
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW113126760A TWI901271B (en) | 2024-07-17 | 2024-07-17 | System and method for generating tooth treatment plan and providing treatment simulation video |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW113126760A TWI901271B (en) | 2024-07-17 | 2024-07-17 | System and method for generating tooth treatment plan and providing treatment simulation video |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| TWI901271B true TWI901271B (en) | 2025-10-11 |
| TW202604429A TW202604429A (en) | 2026-02-01 |
Family
ID=98263739
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW113126760A TWI901271B (en) | 2024-07-17 | 2024-07-17 | System and method for generating tooth treatment plan and providing treatment simulation video |
Country Status (1)
| Country | Link |
|---|---|
| TW (1) | TWI901271B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2016066637A1 (en) * | 2014-10-27 | 2016-05-06 | H43 Development | Method for monitoring an orthodontic treatment |
| US11576631B1 (en) * | 2020-02-15 | 2023-02-14 | Medlab Media Group SL | System and method for generating a virtual mathematical model of the dental (stomatognathic) system |
| CN116196128A (en) * | 2022-12-09 | 2023-06-02 | 中国人民解放军总医院第一医学中心 | Accurate navigation repair system for oral cavity autologous tooth transplantation |
-
2024
- 2024-07-17 TW TW113126760A patent/TWI901271B/en active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2016066637A1 (en) * | 2014-10-27 | 2016-05-06 | H43 Development | Method for monitoring an orthodontic treatment |
| US11576631B1 (en) * | 2020-02-15 | 2023-02-14 | Medlab Media Group SL | System and method for generating a virtual mathematical model of the dental (stomatognathic) system |
| CN116196128A (en) * | 2022-12-09 | 2023-06-02 | 中国人民解放军总医院第一医学中心 | Accurate navigation repair system for oral cavity autologous tooth transplantation |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105832291B (en) | Tracking and prediction of tooth changes | |
| JP7525690B2 (en) | Identification device, scanner system, identification method, and identification program | |
| JP7267974B2 (en) | IDENTIFICATION DEVICE, SCANNER SYSTEM, IDENTIFICATION METHOD, AND IDENTIFICATION PROGRAM | |
| JP2021524789A (en) | Tooth virtual editing method, system, computer equipment and storage medium | |
| Revilla‐León et al. | An overview of artificial intelligence based applications for assisting digital data acquisition and implant planning procedures | |
| US20230026220A1 (en) | Oral health assessment for generating a dental treatment plan | |
| Elsonbaty et al. | Novel AI‐based tool for primary tooth segmentation on CBCT using convolutional neural networks: A validation study | |
| Costin et al. | The integration of artificial intelligence in dental practice | |
| Elgarba et al. | Artificial Intelligence Versus Human Intelligence in Presurgical Implant Planning: A Preclinical Validation | |
| US6944262B2 (en) | Dental and orthopedic densitometry modeling system and method | |
| Palkovics et al. | Automatic deep learning segmentation of mandibular periodontal bone topography on cone-beam computed tomography images | |
| TWI901271B (en) | System and method for generating tooth treatment plan and providing treatment simulation video | |
| CN114343906A (en) | Method, device, medium and electronic device for obtaining occlusal vertical distance | |
| LT6296B (en) | Method and system of treatment plan and administration of dental prosthesis of a patient | |
| Mukhopadhyay et al. | Evaluation of large language models in pediatric dentistry: A Bloom’s taxonomy-based analysis | |
| Rao | “Smarter smiles”–How artificial intelligence is revolutionizing dentistry | |
| WO2024056719A1 (en) | 3d digital visualization, annotation and communication of dental oral health | |
| Erkul et al. | The Use of Artificial Intelligence in Different Dental Applications | |
| Aldusari et al. | The Role of Artificial Intelligence (AI) In Dentistry: Enhancing Diagnosis Accuracy and Treatment | |
| EP4621794A1 (en) | Data processing apparatus, data processing method, and data processing program | |
| Gokul et al. | Artificial Intelligence in Dentistry-A Review. | |
| Faiq et al. | Artificial Intelligence (AI) Trends in Dentistry: A Literature Review | |
| Alhakimi et al. | Applications of Artificial Intelligence in Dentistry: A Narrative Review | |
| Borker | Digitalization in Periodontics: Unlocking Potential and Possibilities | |
| EP4094722A1 (en) | Generating recommended mouth cleaning and/or treatment characteristics |