KR102815086B1 - Server for providing chart based on image and method thereof - Google Patents

Abstract

According to an embodiment of the present invention, a method for providing an image-based chart by a server may include the steps of: receiving image data of a subject from an image device; extracting status information of the subject based on the image data; converting the status information into chart information corresponding to a preset template; and providing the converted chart information to a user terminal according to the template.

Description

{SERVER FOR PROVIDING CHART BASED ON IMAGE AND METHOD THEREOF}

The present invention relates to a server providing an image-based chart and an operating method thereof.

In general, dental clinics manage various dental tasks, such as patient visits and admissions, current symptoms, treatment, payment, insurance claims, and hospital management. For this purpose, dental clinics also provide electronic charts to patients using separate dental work programs.

However, if such an electronic chart is provided, there is a problem in that the input process is complicated because the user must manually input the treatment performed on the day, information about the next treatment, reservation information, the subject's disease, the subject's dental information, etc. This can cause inconvenience in using the electronic chart and reduce work efficiency.

Republic of Korea Patent Publication No. 10-2023-0097247 (2023.07.03.)

The purpose of the present invention is to provide an image-based chart providing server and method therefor, which extracts characteristic points, such as dental disease and loss status, based on various images taken of a subject's teeth and automatically provides the extracted characteristic points in an electronic chart.

In addition, the present invention aims to provide a server and method therefor that provides an image-based chart that enables systematic treatment and customer management while allowing a practitioner to intuitively check the characteristics of a subject's teeth, such as disease and missing information, when using a dental work program, thereby increasing convenience of use.

According to an operation method of a server providing an image-based chart according to one embodiment of the present invention, a method for a server providing an image-based chart may include the steps of: receiving image data of a subject from an image device; extracting status information of the subject based on the image data; converting the status information into chart information corresponding to a preset template; and providing the converted chart information to a user terminal according to the template.

In one embodiment, the step of extracting the condition information of the subject may extract the condition information of the subject based on feature points included in the image data.

In one embodiment, the template may include an electronic chart for displaying information about the dental condition of the subject.

In one embodiment, the electronic chart may include a drawing representing the condition of the teeth of the subject, and may be configured to display the chart information in the form of at least one of a shape, a color, and text corresponding to the condition of the subject.

In one embodiment, the image data may include at least one of panoramic image data of the subject and oral scan image data of the subject.

In one embodiment, the chart information includes treatment information corresponding to the condition information of the subject, and the treatment information may be provided in a preset medical record format.

In one embodiment, the method may further include generating next appointment information for the subject based on the treatment information.

A server providing an image-based chart according to one embodiment of the present invention comprises: a memory; and a processor connected to the memory and configured to execute commands included in the memory, wherein the processor may be configured to perform the steps of: receiving image data of a subject from an image device; extracting status information of the subject based on the image data; converting the status information into chart information corresponding to a preset template; and providing the converted chart information to a user terminal according to the template.

According to the image-based chart providing server of the present invention and its operating method, it is possible to extract characteristic points such as dental disease, loss status, etc. based on various images taken of the teeth of a subject, and automatically provide the extracted characteristic points in an electronic chart.

In addition, according to the image-based chart providing server of the present invention and its operating method, when using a dental work program, the practitioner can intuitively check the characteristics of the teeth of the subject, such as diseases and missing information, thereby increasing the convenience of use and enabling systematic treatment and customer management.

In order to more fully understand the drawings cited in the detailed description of the present invention, a brief description of each drawing is provided.
FIG. 1 is a diagram showing a network environment in which an image-based chart providing server according to one embodiment of the present invention communicates.
FIG. 2 is a block diagram showing the configuration of a server providing an image-based chart according to one embodiment of the present invention.
FIG. 3 is a diagram for exemplarily explaining how a server providing an image-based chart according to one embodiment of the present invention analyzes image data.
FIG. 4 is a diagram for exemplarily explaining how a server providing an image-based chart according to one embodiment of the present invention analyzes image data.
FIG. 5 is a diagram for exemplarily explaining that a server providing an image-based chart according to one embodiment of the present invention provides chart information.
FIG. 6 is a drawing for exemplarily explaining that a server providing an image-based chart according to one embodiment of the present invention provides chart information.
FIG. 7 is a flowchart illustrating a method for providing an image-based chart according to one embodiment of the present invention.
FIG. 8 is a block diagram showing the hardware configuration of a server providing an image-based chart according to one embodiment of the present invention.

Hereinafter, various embodiments of the present invention will be described with reference to the attached drawings. It should be understood that the present invention is not limited to specific embodiments, but includes various modifications, equivalents, and/or alternatives of the embodiments of the present invention. In connection with the description of the drawings, similar reference numerals may be used for similar components.

In this document, the expressions "have", "can have", "include", or "may include" indicate the presence of a feature (e.g., a numerical value, function, operation, or component such as a part), but do not exclude the presence of additional features.

In this document, the expressions "A or B", "at least one of A and/or B", or "one or more of A or/and B" can include all possible combinations of the items listed together. For example, "A or B", "at least one of A and B", or "at least one of A or B" can all refer to cases where (1) at least one A is included, (2) at least one B is included, or (3) both at least one A and at least one B are included.

The expressions "first," "second," "first," or "second" used in this document can describe various components, regardless of order and/or importance, and are only used to distinguish one component from another, but do not limit the components. For example, without departing from the scope of the rights set forth in this document, the first component can be named the second component, and similarly, the second component can also be renamed as the first component.

The expression "configured to" as used herein can be used interchangeably with, for example, "suitable for", "having the capacity to", "designed to", "adapted to", "made to", or "capable of". The term "configured to" does not necessarily mean "specifically designed to".

In this document, terms such as "command", "instruction", "control information", "message", "information", "data", "packet", "data packet", "intent" and/or "signal" transmitted and received between the first electronic device(s) and the second electronic device(s) may include or refer to human-perceivable ideas or specific electrical representations (e.g., digital codes/analog physical quantities) regardless of their expressions. It will be apparent to those skilled in the art to which the invention disclosed in this document belongs that the exemplary expressions listed above may be interpreted in various ways depending on the context in which they are used. In this document, "is greater than B" not only simply means "is greater than B" but also includes "is equal to or greater than B."

The terms used in this document are only used to describe specific embodiments and may not be intended to limit the scope of other embodiments. The singular expression may include the plural expression unless the context clearly indicates otherwise. The terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by a person of ordinary skill in the art described in this document. Among the terms used in this document, terms defined in general dictionaries may be interpreted as having the same or similar meaning in the context of the related technology, and shall not be interpreted in an ideal or excessively formal meaning unless explicitly defined in this document. In some cases, even if a term is defined in this document, it cannot be interpreted to exclude the embodiments of this document.

FIG. 1 is a diagram showing a network environment in which an image-based chart providing server (150) communicates according to one embodiment of the present invention.

Referring to FIG. 1, a server (server of FIG. 1) (150) providing an image-based chart according to one embodiment of the present invention can communicate with an image device (110) and a user terminal (130) through a network.

In Fig. 1, the imaging device (110) may be a photographing device used by a dental professional (e.g., a dentist, a dental hygienist, etc.). At this time, the imaging device (110) may be configured as a terminal used by the dental professional or as a separate device. For example, the imaging device (110) may include a panoramic imaging device, a scanner imaging device, etc. In addition, the user terminal (130) may be a terminal used by the dental professional.

Meanwhile, in FIG. 1, only a video device (110) and a user terminal (130) are shown, but the present invention is not limited thereto, and the number of video devices or user terminals may be configured in various ways.

For reference, the first electronic device (110) and the second electronic device (130) may be implemented as a computer that can access a remote server or terminal via a network. For example, the computer may include a notebook, desktop, laptop, etc. equipped with a web browser. In addition, the first electronic device (110) and the second electronic device (130) may be implemented as a terminal that can access a remote server or terminal via a network. For example, the first electronic device (110) and the second electronic device (130) are wireless communication devices that ensure portability and mobility, and may include all types of handheld-based wireless communication devices, such as navigation, PCS (Personal Communication System), GSM (Global System for Mobile communication), PDC (Personal Digital Cellular), PHS (Personal Handphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), Wibro (Wireless Broadband Internet) terminals, smartphones, smartpads, tablet PCs, etc.

The server (150) can be communicatively coupled with at least one first electronic device (110). The server (150) can be communicatively coupled with at least one second electronic device (130). In addition, communication can be made between the first electronic device (110) and the second electronic device (130) through a network. For example, the first electronic device (110) and the second electronic device (130) can exchange data within an app or web service-based program in which the server (150) is implemented.

A server (150) according to an embodiment of the present invention may be implemented as a computer device or multiple computer devices that provide commands, code files, contents, services, etc. The server (150) may be implemented in the form of a self-web page or application (APP) produced and operated by an individual or a company, and in this case, data exchange between the server (150) and the first electronic device (110) may be performed when a user accesses the web page or application through the first electronic device (110).

The server (150) is a server that provides a chart based on an image and can receive image data of the subject from the image device (110). At this time, the image data can include an image or image data of the subject's teeth captured by the image device (110).

The server (150) can extract the condition information of the subject based on the image data. For example, the condition information of the subject can include recognition of the condition of the teeth (e.g., normal, restorative treatment, root canal treatment, implant, missing, etc.), diagnosis of dental diseases, diagnosis of periodontal diseases, information on TMJ and other special findings. In this case, the server (150) can analyze the image data of the subject to extract feature points.

The server (150) can convert the condition information of the subject into chart information corresponding to a preset template. Here, the preset template may include an electronic chart format used in dentistry. That is, the server (150) can obtain condition information based on the extracted feature points of the subject and convert this condition information into an electronic chart format.

The server (150) can provide the converted chart information to the user terminal (130) according to the template. That is, the server (150) can extract feature points from the subject's image data and provide status information corresponding to the subject in the form of an electronic chart based on the feature points.

Figure 2 is a block diagram schematically showing the detailed configuration of the server illustrated in Figure 1.

As illustrated in FIG. 2, the server (150) may include a bus (210), a display (220), a communication circuit (230), a database (240), a memory (250), an I/O interface (260), and a processor (270). In other embodiments, the server (150) may omit at least one of the above components or additionally include other components.

For reference, the components (210, 220, 230, 240, 250, 260, 270) of the server (150) illustrated in FIG. 2 are merely exemplary components for explaining a document creation support method according to one embodiment of the present invention. That is, it is clear that the server (150) according to one embodiment of the present invention may additionally include other components in addition to the illustrated components.

The bus (210) can electrically connect the components (220 to 270) to each other. The bus (210) can include circuitry for communication (e.g., control messages and/or data) between the components (220 to 270).

The display (220) can display text, images, videos, icons, or symbols that constitute various contents. The display (220) can include a touch screen and can receive touch, gesture, proximity, or hovering input using an electronic pen or a part of the user's body.

For example, the display (220) may include a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, a microelectromechanical systems (MEMS) display, or an electronic paper display. The display (220) may be implemented as included in the server (150), or may be implemented separately from the server (150) but operatively connected to the server (150).

The communication circuit (230) can establish a communication channel with the server (150) and external devices. The communication circuit (230) can access the network (280) through wireless communication or wired communication to communicate with the external devices. For example, the communication circuit (230) can transmit and receive necessary data with the first electronic device (110) and the second electronic device (130). The communication circuit (230) can perform wired or wireless communication with the aforementioned imaging device (110) and the user terminal (130) through the network. That is, the communication circuit (230) can transmit and receive various data related to the condition information of the subject or the electronic chart with the imaging device (110) and the user terminal (130).

The database (240) may be implemented on the memory (250) or may be implemented on a separate storage medium. The database (240) may store all of the contents, details, etc. of data transmitted and received with the first electronic device (110) and the second electronic device (130). The database (240) may store various data related to providing an image-based electronic chart. For example, the database (240) may store data such as the subject's image data, status information, chart information, treatment information, and reservation information. For example, the database (240) may operate in a cloud manner.

Meanwhile, a server (150) according to one embodiment of the present invention may include a database (240) internally or be connected to a database (240) provided externally via a network.

According to various embodiments, since the data stored in the database (240) is sensitive information of the user, it may be distributed and stored in a blockchain network to enhance the security of the use of the information. If the database (240) is distributed and stored in a blockchain network, the history of transmission, modification, deletion, addition, etc. of the information contained in the database (240) can be managed more safely in the blockchain network.

The memory (250) may include volatile and/or nonvolatile memory. The memory (250) may store commands or data related to at least one other component in the server (150). For example, the memory (250) may store an application for providing electronic chart information based on image data.

The I/O interface (260) can perform a role of transmitting commands or data input from a user or another external device to other components of the server (150). The I/O interface (260) can be implemented as hardware or software, and can be used as a concept encompassing a user interface (UI) and a terminal for communication with other external devices.

The processor (270) may include at least one of a central processing unit (CPU), an application processor (AP), or a communication processor (CP). The processor (270) is electrically connected to the memory (250), the display (220), and the communication circuit (230) via the bus (210), and during operation, may execute operations or data processing related to control and/or communication of other components according to commands, programs, or software stored in the memory (250). Therefore, execution of the commands, application programs, or software may be understood as an operation of the processor (270).

The processor (270) is connected to the memory (250) and can execute commands included in the memory (250). The processor (270) can control the overall operation of the memory (250) and the communication circuit (230) to execute various applications related to providing image-based charts.

The processor (270) may receive image data of the subject from the image device (110). At this time, the image data may include an image or image data of the subject's teeth captured by the image device (110). For example, the image data may include at least one of panoramic image data and oral scan image data of the subject.

The processor (270) can extract the subject's condition information based on the image data. For example, the subject's condition information can include recognition of the condition of the teeth (e.g., normal, restorative treatment, root canal treatment, implant, missing, etc.), diagnosis of dental diseases, diagnosis of periodontal diseases, information on TMJ and other special findings. In addition, the subject's condition information can include information for confirming the tooth position and confirming the front, back, left, and right sides, and confirming the tooth color, range, etc.

In addition, when extracting the condition information of the subject, the processor (270) can extract the condition information of the subject based on the characteristic points included in the image data. In this case, the processor (270) can analyze the image data of the subject to extract the characteristic points and obtain information such as the tooth condition, disease, location, color, and size corresponding to the characteristic points.

The processor (270) can convert the condition information of the subject into chart information corresponding to a preset template. Here, the preset template can include an electronic chart format used in dentistry to display information about the condition of the subject's teeth. That is, the processor (270) can obtain condition information based on the extracted feature points of the subject and convert the condition information into an electronic chart format.

In addition, the format of the electronic chart converted by the processor (270) may include a drawing showing the condition of the subject's teeth, and may be configured to display chart information in the form of at least one of a shape, color, and text corresponding to the condition of the subject. This will be described with examples in FIGS. 5 and 6.

The processor (270) can provide the converted chart information to the user terminal (130) according to the template. That is, the processor (270) can extract feature points from the image data of the subject and, based on this, provide status information corresponding to the subject in the form of an electronic chart.

In addition, the chart information provided by the processor (270) may include treatment information corresponding to the condition information of the subject. For example, the treatment information corresponding to the condition information of the subject may include information on treatment methods, treatment schedules, processes, etc. that can be performed according to the condition of the subject's teeth. In this case, the treatment information may be provided in a preset medical record format. Accordingly, the step of a dental professional manually entering the treatment information may be omitted, thereby providing convenience of use and providing accurate information.

The processor (270) can automatically generate the subject's next appointment information based on the treatment information. At this time, the subject's next appointment information can be generated based on the next treatment order according to the treatment process (plan) according to the subject's dental condition.

In addition, the reservation information can be generated to automatically designate a reservation schedule based on the treatment information, taking into account the treatment schedule. For example, the reservation information can be provided to be automatically registered based on the treatment content, treatment period, required time, etc. corresponding to the next treatment order based on the treatment information. In this case, the reservation information can also be automatically provided in the form of an electronic chart, or provided as a separate reservation registration screen.

The network (280) may include at least one of a telecommunications network, a computer network, the Internet, or a telephone network. A wireless communication protocol for accessing the network (280) may use at least one of, for example, Long-Term Evolution (LTE), LTE-A (LTE Advanced), CDMA (Code Division Multiple Access), WCDMA (Wideband CDMA), UMTS (Universal Mobile Telecommunications System), WiBro (Wireless Broadband), GSM (Global System for Mobile communications), or 5G standard communication protocols. However, this is exemplary, and various wired and wireless communication technologies applicable in the relevant technical field may be used depending on the embodiment to which the present invention is applied.

In this way, according to the image-based chart providing server (150) of the present invention, it is possible to extract characteristic points such as dental disease, loss status, etc. based on various images taken of the subject's teeth, and automatically provide the extracted characteristic points in an electronic chart.

In addition, according to the server (150) that provides the image-based chart of the present invention, when using a dental work program, the practitioner can intuitively check the characteristics of the teeth, such as the subject's disease and missing information, thereby increasing the convenience of use and enabling systematic treatment and customer management.

FIG. 3 is a diagram for exemplarily explaining how a server providing an image-based chart according to one embodiment of the present invention analyzes image data.

Referring to FIG. 3, a server (150) providing an image-based chart according to one embodiment of the present invention may receive image data from an image device (110). At this time, as illustrated in FIG. 3, the image data may include image data captured by a panoramic image device.

Referring to (a) of Fig. 3, it is shown that a server (150) providing an image-based chart according to one embodiment of the present invention analyzes panoramic image data based on AI. In this case, as shown in (a) of Fig. 3, feature points of the subject's teeth are extracted using an object detection technique.

For example, a server (150) providing an image-based chart according to one embodiment of the present invention can identify a tooth number based on the characteristic points of image data, extract abnormalities in the temporomandibular joint (TMJ), maxilla, mandible, etc., and obtain information on the condition of the subject. In this case, each characteristic point can be represented by a different shape, color, size, etc.

Referring to (b) of Fig. 3, it is shown that a server (150) providing an image-based chart according to one embodiment of the present invention analyzes panoramic image data based on AI. In this case, as shown in (b) of Fig. 3, feature points for the subject's teeth are extracted using a segmentation technique.

For example, the server (150) providing an image-based chart according to one embodiment of the present invention can recognize the state of teeth based on the characteristic points of image data and indicate whether the teeth are normal, undergoing restorative treatment, undergoing nerve treatment, undergoing implants, or undergoing a defect, or can diagnose a dental disease or periodontal disease. In addition, the server (150) providing an image-based chart can diagnose TMJ and other special findings and display them on an electronic chart picture. In this case, the server (150) providing an image-based chart can display each part, such as the maxilla, mandible, temporomandibular joint, and teeth, in different shapes or colors, and can display abnormal parts in separate colors or shapes.

FIG. 4 is a diagram for exemplarily explaining how a server providing an image-based chart according to one embodiment of the present invention analyzes image data.

Referring to FIG. 4, a server (150) providing an image-based chart according to one embodiment of the present invention may receive image data from an image device (110). At this time, as illustrated in FIG. 4, the image data may include image data captured by an oral scan image device.

As shown in Fig. 4, the server (150) providing an image-based chart according to one embodiment of the present invention can analyze oral scan image data based on AI. In this case, the server (150) providing an image-based chart can check the tooth location and front, back, left side, right side, etc. based on the image data, and check the tooth color, range, etc.

In addition, the server (150) providing an image-based chart can display feature points according to the condition of the teeth in separate shades, as shown in Fig. 4. In addition, the server (150) providing an image-based chart can display information on the condition of the teeth (e.g., disease, etc.) corresponding to the feature points in a separate pop-up.

FIG. 5 is a diagram for exemplarily explaining that a server providing an image-based chart according to one embodiment of the present invention provides chart information.

Referring to FIG. 5, a server (150) providing an image-based chart according to one embodiment of the present invention can convert status information on a subject's teeth extracted based on image data and display it on an electronic chart.

As illustrated in FIG. 5, the server (150) providing an image-based chart according to one embodiment of the present invention can display a drawing of the oral structure of a subject. In this case, information on the condition of the teeth can be provided in an electronic chart based on the condition information of the subject automatically extracted based on the image data.

For example, in Fig. 5, the server (150) providing an image-based chart may display status information extracted based on image data in a separate color (e.g., yellow, green, blue, etc.) and provide information on the corresponding disease as text. In addition, the server (150) providing an image-based chart may also display the shape of the teeth differently depending on the condition of the teeth.

FIG. 6 is a drawing for exemplarily explaining that a server providing an image-based chart according to one embodiment of the present invention provides chart information.

Referring to FIG. 6, a server (150) providing an image-based chart according to one embodiment of the present invention can convert status information on a subject's teeth extracted based on image data and display it on an electronic chart.

As illustrated in FIG. 6, the server (150) providing an image-based chart according to one embodiment of the present invention can display a dental drawing together with an X-ray image of the subject's oral structure and teeth. In this case, information about the condition of the teeth can be provided in an electronic chart based on the condition information of the subject automatically extracted based on the image data.

For example, in Fig. 6, the server (150) providing an image-based chart displays status information extracted based on image data in a graphical format on a drawing. In this case, the server (150) providing an image-based chart can automatically display oral condition information such as the zygomatic arch or hyoid bone in a graphical format based on the current condition of the subject on an electronic chart.

FIG. 7 is a flowchart illustrating a method for providing an image-based chart according to one embodiment of the present invention.

Referring to FIG. 7, a method for providing an image-based chart according to one embodiment of the present invention may include a step of receiving image data of a subject from an image device (S110), a step of extracting status information of the subject based on the image data (S120), a step of converting the status information into chart information corresponding to a preset template (S130), and a step of providing the converted chart information to a user terminal according to the template (S140).

In step S110, image data of the subject may be received from the image device (110). At this time, the image data may include an image or image data of the subject's teeth captured by the image device (110). For example, the image data may include at least one of panoramic image data and oral scan image data of the subject.

In step S120, the condition information of the subject can be extracted based on the image data. For example, the condition information of the subject can include recognition of the condition of the teeth (e.g., normal, restorative treatment, root canal treatment, implant, missing, etc.), diagnosis of dental diseases, diagnosis of periodontal diseases, information on TMJ and other special findings. In addition, the condition information of the subject can include information for confirming the position of the teeth and confirming the front, back, left, and right sides, and confirming the color and range of the teeth.

In addition, in step S120, when extracting the condition information of the subject, the condition information of the subject can be extracted based on the feature points included in the image data. In this case, the image data of the subject can be analyzed to extract the feature points, and information such as the tooth condition, disease, location, color, and size corresponding to the feature points can be obtained.

In step S130, the condition information of the subject can be converted into chart information corresponding to a preset template. Here, the preset template may include an electronic chart format used in dentistry to display information on the condition of the subject's teeth. That is, condition information can be acquired based on the extracted feature points of the subject, and the condition information can be converted into an electronic chart format.

Additionally, the format of the electronic chart converted in step S130 may include a drawing representing the condition of the subject's teeth, and may be configured to display chart information in the form of at least one of a shape, color, and text corresponding to the condition of the subject.

In step S140, the converted chart information can be provided to the user terminal (130) according to the template. That is, in step S140, feature points can be extracted from the subject's image data, and based on this, status information corresponding to the subject can be provided in the form of an electronic chart.

In addition, the chart information provided in step S140 may include treatment information corresponding to the condition information of the subject. For example, the treatment information corresponding to the condition information of the subject may include information on treatment methods, treatment schedules, processes, etc. that can be performed according to the condition of the subject's teeth. In this case, the treatment information may be provided in a preset medical record format. Accordingly, the step of a dental professional manually entering the treatment information may be omitted, thereby providing convenience of use and providing accurate information.

In addition, according to the image-based chart providing method according to one embodiment of the present invention, the next appointment information of the subject can be automatically generated based on the treatment information. At this time, the next appointment information of the subject can be generated based on the next treatment order according to the treatment process (plan) according to the dental condition of the subject.

In addition, the reservation information can be generated to automatically designate a reservation schedule based on the treatment information, taking into account the treatment schedule. For example, the reservation information can be provided to be automatically registered based on the treatment content, treatment period, required time, etc. corresponding to the next treatment order based on the treatment information. In this case, the reservation information can also be automatically provided in the form of an electronic chart, or provided as a separate reservation registration screen.

In this way, according to the image-based chart providing method of the present invention, it is possible to extract characteristic points such as dental disease, loss status, etc. based on various images taken of the teeth of a subject, and automatically provide the extracted characteristic points in an electronic chart.

In addition, according to the image-based chart providing method of the present invention, when using a dental work program, the practitioner can intuitively check the characteristics of the teeth, such as the subject's disease and missing information, thereby increasing the convenience of use and enabling systematic treatment and customer management.

FIG. 8 is a block diagram showing the hardware configuration of a server providing an image-based chart according to one embodiment of the present invention.

Referring to FIG. 8, a computing system (1000) according to one embodiment disclosed in the present document may include an MCU (1010), a memory (1020), an input/output I/F (1030), and a communication I/F (1040).

The MCU (1010) may be a processor that executes various programs (e.g., an image data collection program, a status information extraction program, a chart information conversion program, etc.) for providing an image-based chart provision service stored in a memory (1020), processes various data such as the user's image data, status information, chart information, treatment information, and reservation information through these programs, and performs the functions of the server (150) shown in the aforementioned FIG. 2.

The memory (1020) can store various programs related to providing image-based charts. In addition, the memory (1020) can store various data such as user image data, status information, chart information, treatment information, and reservation information received from a client (e.g., an image device (110), a user terminal (130), etc.).

These memories (1020) may be provided in multiple numbers as needed. The memories (1020) may be volatile memories or nonvolatile memories. As the volatile memories (1020), RAM, DRAM, SRAM, etc. may be used. As the nonvolatile memories (1020), ROM, PROM, EAROM, EPROM, EEPROM, flash memories, etc. may be used. The examples of the memories (1020) listed above are only examples and are not limited to these examples.

The input/output I/F (1030) can provide an interface that enables data to be transmitted and received between an input device (not shown) such as a keyboard, mouse, or touch panel, and an output device (not shown) such as a display and the MCU (1010).

The communication I/F (1040) is a configuration that can transmit and receive various data with the server, and may be various devices that can support wired or wireless communication. For example, through the communication I/F (1040), various data or programs for managing various data related to image-based chart provision services can be transmitted and received from a separately provided external server.

In this way, a computer program according to one embodiment disclosed in this document may be implemented as a module that performs each function illustrated in FIG. 2, for example, by being recorded in a memory (1020) and processed by an MCU (1010).

In the above, although all the components constituting the embodiments of the present invention have been described as being combined as one or operating in combination, the present invention is not necessarily limited to such embodiments. That is, within the scope of the purpose of the present invention, all of the components may be selectively combined as one or more and operating.

Meanwhile, various embodiments described in this specification may be implemented by hardware, middleware, microcode, software, and/or a combination thereof. For example, various embodiments may be implemented in one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, other electronic units designed to perform the functions described herein, or a combination thereof.

Also, for example, various embodiments may be embodied in or encoded on a computer-readable medium containing instructions. The instructions embodied in or encoded on the computer-readable medium may cause a programmable processor or other processor to perform a method when the instructions are executed, for example. The computer-readable medium includes a computer storage medium, and the computer storage medium may be any available medium that can be accessed by a computer. For example, such a computer-readable medium may include RAM, ROM, EEPROM, CD-ROM or other optical disk storage media, magnetic disk storage media, or other magnetic storage devices.

Such hardware, software, firmware, etc. may be implemented within the same device or within separate devices to support the various operations and functions described herein. Additionally, components, units, modules, components, etc. described as “~units” in the present invention may be implemented together or individually as separate but interoperable logic devices. The depiction of different features for modules, units, etc. is intended to emphasize different functional embodiments and does not necessarily imply that they must be realized by separate hardware or software components. Rather, the functionality associated with one or more modules or units may be performed by separate hardware or software components, or integrated into common or separate hardware or software components.

Although the operations are depicted in the drawings in a particular order, it should not be understood that these operations need to be performed in the particular order depicted, or in any sequential order, or that all of the depicted operations need to be performed to achieve a desired result. In some circumstances, multitasking and parallel processing may be advantageous. Furthermore, the separation of the various components in the embodiments described above should not be understood to require such separation in all embodiments, and it should be understood that the components depicted may generally be integrated together in a single software product or packaged into multiple software products.

The electronic device, server, or external device according to various embodiments of the present document described above may include, for example, at least one of a smartphone, a tablet PC, a mobile phone, a video phone, a desktop PC, a laptop PC, a personal digital assistant (PDA), a portable multimedia player (PMP), an MP3 player, a mobile medical device, a camera, or a wearable device.

According to various embodiments, a wearable device may include at least one of an accessory type (e.g., a watch, a ring, a bracelet, an anklet, a necklace, glasses, contact lenses, or a head-mounted device (HMD)), an integrated type of fabric or clothing (e.g., an electronic garment), a body-attached type (e.g., a skin pad or tattoo), or an implantable type (e.g., an implantable circuit).

In some embodiments, the electronic device or external device may be a home appliance. The home appliance may include, for example, at least one of a television, a digital video disk player (DVD player), an audio, a refrigerator, an air conditioner, a vacuum cleaner, an oven, a microwave oven, a washing machine, an air purifier, a set-top box, a home automation control panel, a security control panel, a TV box, a game console, an electronic dictionary, an electronic key, a camcorder, or an electronic picture frame.

In another embodiment, the electronic device, the external device, the wearable device may include at least one of various medical devices (e.g., various portable medical measuring devices (such as a blood sugar meter, a heart rate meter, a blood pressure meter, or a thermometer), magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), computed tomography (CT), a camera, or an ultrasound machine), a navigation device, a satellite navigation system (a Global Navigation Satellite System (GNSS)), an event data recorder (EDR), a flight data recorder (FDR), an automobile infotainment device, a home robot, or an internet of things device (e.g., a light bulb, various sensors, an electric or gas meter, a sprinkler device, a fire alarm, a thermostat, a streetlight, an exercise machine, a hot water tank, a heater, a boiler, or the like).

As described above, the best embodiment has been disclosed in the drawings and the specification. Although specific terms have been used herein, they have been used only for the purpose of describing the present invention and have not been used to limit the meaning or the scope of the present invention described in the claims. Therefore, those skilled in the art will understand that various modifications and equivalent other embodiments are possible from this. Therefore, the true technical protection scope of the present invention should be determined by the technical idea of the appended claims.

Claims (5)

In the method of providing charts based on images by the server,
A step of receiving image data of a subject from an image device;
A step of extracting feature points included in the image data, and extracting status information including information on the subject's dental condition, dental disease information, periodontal disease information, temporomandibular joint information, tooth location information, front side, back side, left side, right side, and tooth color based on the feature points;
A step of converting the above status information into chart information corresponding to a preset template; and
A step of providing the converted chart information to a user terminal according to the template is included.
The above video data is,
At least one of panoramic image data for the subject and oral scan image data for the subject is included,
The above chart information is,
Contains treatment information corresponding to the condition information of the above subject,
The above treatment information is provided in a preset medical record format.
A step of generating the next appointment information of the subject based on the above treatment information and indicating the appointment information in the template;
A step of displaying each of the subject's teeth area, maxillary area, mandibular area, and temporomandibular joint area in different colors on the template based on the image data;
A step of displaying information about at least one of the subject's zygomatic arch and hyoid bone on the template; and
Further comprising a step of distributing and storing the image data, the status information, the chart information, the treatment information, and the reservation information in a blockchain network.
How to provide image-based charts. delete In claim 1,
The above template is,
Including an electronic chart for displaying information about the dental condition of the subject;
How to provide image-based charts. In claim 3,
The above electronic chart,
Including a drawing showing the condition of the subject's teeth,
configured to display the chart information in the form of at least one of shape, color and text corresponding to the condition of the subject;
How to provide image-based charts. memory; and
A processor connected to said memory and configured to execute instructions contained in said memory,
The above processor,
Receives image data of a subject from an image device, extracts feature points included in the image data, and extracts status information including information on the subject's dental condition, dental disease information, periodontal disease information, temporomandibular joint information, and tooth location information, front, back, left, right sides of the teeth, and information on tooth color based on the feature points, converts the status information into chart information corresponding to a preset template, and provides the converted chart information to a user terminal according to the template.
The above image data includes at least one of panoramic image data of the subject and oral scan image data of the subject,
The above chart information includes treatment information corresponding to the condition information of the subject,
The above treatment information is provided in a preset medical record format.
The above processor
Based on the treatment information, the next appointment information of the subject is generated, the appointment information is indicated in the template, and based on the image data, each of the teeth area, the maxillary area, the mandibular area and the temporomandibular joint area of the subject is indicated in the template with different colors, and information on at least one of the zygomatic arch and hyoid bone of the subject is indicated in the template, and the image data, the status information, the chart information, the treatment information and the appointment information are distributed and stored in a blockchain network.
A server that provides image-based charts.

Images