Detailed Description
In order to make the objects, features and advantages of the present disclosure more comprehensible, the technical solutions in the embodiments of the present disclosure will be clearly described in conjunction with the accompanying drawings in the embodiments of the present disclosure, and it is apparent that the described embodiments are only some embodiments of the present disclosure, but not all embodiments. Based on the embodiments in this disclosure, all other embodiments that a person skilled in the art would obtain without making any inventive effort are within the scope of protection of this disclosure.
Fig. 1 illustrates an operation schematic of orthodontic ligation in the related art.
As shown in fig. 1, the conventional manner based on a plaster model and a two-dimensional image is still the dominant manner of practicing orthodontic ligation in the related art.
FIG. 2 is a schematic diagram showing a model of orthodontic ligation in the related art
As shown in fig. 2, the operations of orthodontic bonding bracket, ligation, etc. are performed on the plaster model in the conventional mode, the actual orthodontic clinical operation scene cannot be restored, the clinical position cannot be correctly trained, and it is difficult for the learner to have an immersive experience.
Fig. 3 illustrates a schematic operation of an orthodontic method based on virtual reality according to an embodiment of the present disclosure.
Referring to fig. 3, an orthodontic method based on virtual reality is provided in the embodiments of the present disclosure, an orthodontic clinical operation scene is truly restored, students who just walk into the orthodontic field and students who have not contacted with clinic feel experience of a patient to be diagnosed in advance through virtual reality, technical details of basic orthodontic operation are mastered, self-confidence is improved, and a foundation is laid for winning trust of patients.
First, the following description is made of virtual reality and augmented reality:
virtual Reality (VR) is a comprehensive technology integrating computer technology, sensor technology, human psychology and physiology, and by using a computer simulation system to simulate an external environment, mainly simulate objects such as environment, skill, sensing equipment and perception, and the like, a multi-information, three-dimensional dynamic and interactive simulation experience is provided for users.
Augmented reality (Augmented Reality, AR) is a technology that allows virtual world on a screen to combine and interact with real world scenes by means of image analysis techniques in addition to position and angle refinement of images.
Fig. 4 shows a schematic process flow diagram of an orthodontic method based on virtual reality according to an embodiment of the disclosure.
Referring to fig. 4, a process flow of an orthodontic method based on virtual reality according to an embodiment of the disclosure at least includes the following steps:
Step S101, generating a virtual model corresponding to the head model.
In some embodiments, a virtual reality head mounted display device renders a hardware environment such as a simulated head model, and a Three-dimensional (3D) virtual model corresponding to the simulated head model and related hardware is generated.
The three-dimensional virtual craniofacial model can be established in advance, and is presented through the virtual reality head-mounted display device, so that the real-time registration of the virtual craniofacial model and the imitated head model is ensured, and the accuracy of the tooth position and the oral cavity area is ensured.
In some embodiments, different ligature exercise modes may be selected by an orthodontic virtual reality system. At present, orthodontic ligature technology can be divided into two main types, namely ligature wire and ligature ring, so that ligature training modes can be divided into ligature wire training modes and ligature ring training modes.
The ligature wire training mode can be further divided into conventional ligature, suspension ligature, single-wing ligature, oblique ligature, splayed ligature and ligature in special cases.
Step S102, determining a ligating dental segment in the virtual model based on the virtual reality head mounted display device.
In some embodiments, before determining the ligating dental segment in the virtual model based on the virtual reality head mounted display device, further may include:
and adjusting the azimuth of the imitation head model based on the received voice signal.
In some embodiments, the internal control system receives the voice signal and controls the rotation of the head-imitating mold, such as controlling the head-imitating mold to perform left head deflection, right head deflection, head lifting, head lowering, large mouth opening, small mouth closing, and the like.
In order to provide a clearer view, if the left rear teeth are ligated, the voice signal is required to be received to control the head imitation mould to deflect to the right, and if the right rear teeth are ligated, the voice signal is required to be received to control the head imitation mould to deflect to the left.
In some embodiments, the functional implementation of the internal control system relies on an orthodontic virtual reality system, which is part of an orthodontic virtual reality system.
In some embodiments, a specific implementation of determining ligating tooth segments in a virtual model based on a virtual reality head mounted display device may include at least:
in step S1021a, a movement track of the needle holder is acquired by using the virtual reality head mounted display device.
In some embodiments, the needle holder, also called needle holder, is a common instrument in clinical medicine as well as surgical procedures. The device is mainly used for clamping, stitching and suturing various tissues, and is sometimes used for knotting of instruments.
Step S1021b, determining the ligature tooth position section based on the moving track of the needle holder.
In some embodiments, the movement track of the needle holder can be acquired through an image capturing technology, so that the ligature dental site section can be determined, that is, the appearance of the needle holder is acquired through an internal control system, the movement track of the needle holder is captured by the virtual reality head-mounted display device according to the appearance of the needle holder, when the needle holder stops moving, the movement track of the needle holder correspondingly stops, the internal control system identifies the needle holder according to the position where the movement track stops, and if the needle mouth of the needle holder is positioned at the right rear tooth at this time, namely, the position of the right rear tooth is the ligature dental site section.
The internal control system may acquire the shape of the needle holder by inputting the shape of the needle holder to the internal control system through an algorithm.
In some embodiments, the specific implementation of determining the ligating dental segment in the virtual model based on the virtual reality head mounted display device may further comprise at least:
in step S1022a, the position of the needle mouth of the needle holder is determined.
Step S1022b, determining the ligating dental segment based on the position of the needle mouth of the needle holder.
In some embodiments, a sensor may be mounted at the position of the needle mouth of the needle holder, and the position of the needle mouth of the needle holder is sensed by the internal control system, if the internal control system senses that the needle mouth of the needle holder is located on the left rear tooth, that is, the left rear tooth is the ligature tooth position section.
Step S103, the buckle device is moved to the ligature tooth section along the sliding rail.
In some embodiments, the slide rail may be rotated 360 degrees in a plane, and the snap device moves along the slide rail.
Step S104, the buckle device is controlled to be in a locking state, and tensile stress is applied to the needle holder.
In some embodiments, controlling the catch means to be in a locked state, the specific implementation of applying a tensile stress to the needle holder may comprise at least:
Step S104a, locking the latch device when the needle holder is in the latch state.
In step S104b, the clamping device clamps the wire and applies a tensile stress to the needle holder.
When the buckling device moves to the ligature tooth section along the sliding rail, the needle holder is fastened, at the moment, the needle holder is in a buckling state, the internal control system sends a locking signal to the buckling device, and the buckling device receives the locking signal sent by the internal control system and is in the buckling state. When the buckle device is in a buckling state, the buckle device can clamp the internal silk thread, and tensile stress is applied to the needle holder.
In some embodiments, the latch of the needle holder is provided with a control switch of the internal control system, when the needle holder is in the latch state, the latch is clamped, the control switch is closed, the internal control system sends a locking signal to the buckle device, when the needle holder is in the release state, the latch is opened, the control switch is opened, and the buckle device cannot receive the locking signal sent by the internal control system and is in the open state.
In some embodiments, the needle holder is in a released state prior to ligation, and correspondingly, the catch means is in an open state when the needle holder is in a released state.
In some embodiments, the silk thread that ligature silk exercise mode used adopts the material that has certain elasticity, and needle mouth of needle holder is connected to the one end of silk thread, and the other end of silk thread passes through buckle device to be connected in imitative first mould inboard, and when orthodontic ligature, the picture that is adopting ligature silk to carry out orthodontic ligature that shows in the virtual reality head display device, ligature silk carry out ligature's number of turns and needle holder pivoted number of turns unanimous, ligature direction and needle holder pivoted direction unanimous, and when needle holder and buckle device were in the pine and take off the state, the silk thread can be automatic to rebound to needle mouth department of needle holder.
In some embodiments, if the ligature ring is selected to be used for orthodontic ligation, the thread can be replaced by the elastic thread, at this time, the virtual reality head-mounted display device displays a picture for orthodontic ligation by using the ligature ring, the stretched length of the elastic thread is consistent with the stretched length of the ligature ring, the needle holder moves along with the stretching of the elastic thread, after the ligature ring is displayed on the teeth in the virtual reality head-mounted display device, the needle holder is loosened, and the elastic thread automatically rebounds to the mouth of the needle holder, so that orthodontic ligation of the next tooth can be continued.
Step S105, orthodontic ligation is performed on the teeth in the ligature site section based on the virtual reality head mounted display device and the tensile stress.
In some embodiments, a specific implementation of orthodontic ligation of teeth within a ligating dentition section based on a virtual reality head mounted display device and tensile stress may include at least:
step S105a, simulating the clinical operation environment of hooking the ligature wire on the bracket based on the tensile stress, and sleeving the bracket on the ligature tooth position section.
Step S105b, orthodontic ligation is performed on the teeth in the ligature site section in a clinical operating environment.
The orthodontic traditional metal fixing appliance consists of a bracket, a band ring, an arch wire and a ligature wire or ligature ring. The archwire is secured to the brackets or bands by ligatures or ligature rings to apply an orthodontic force to the teeth. According to the embodiment of the disclosure, the silk thread is used for replacing the ligature wire, the tensile stress provided for the needle holder when the silk thread is clamped based on the clamping device is simulated, and the tensile stress provided for the needle holder when the ligature wire is hooked on the bracket is achieved, namely, the rotation of the needle holder can be controlled by fingers to conduct orthodontic ligation without the need of the bracket and the ligature wire, such as the orthodontic ligation conducted by the single-finger rotary needle holder or the orthodontic ligation conducted by the three-finger rotary needle holder, and the complex process of separating the bracket and the ligature wire during repeated exercise is avoided. Meanwhile, the virtual reality head-mounted display device shows that ligature wires are hooked in the clinical operation environment of the bracket, and the bracket is sleeved on the ligature tooth position section, so that an orthodontic clinical immersive experience exercise mode is provided, a learner can feel an orthodontic ligation process in the clinical operation environment, and is familiar with the operation details of orthodontic ligation, so that the learning efficiency is improved.
It should be appreciated that if the ligature ring is selected for orthodontic ligature, the replacement of the ligature ring with a stretch wire also has the above technical effects and will not be described in detail herein.
Fig. 5 illustrates an alternative flow diagram of an orthodontic method based on virtual reality according to an embodiment of the present disclosure.
Referring to fig. 5, taking a ligature training mode as an example, an optional flow of an orthodontic method based on virtual reality according to an embodiment of the disclosure is described, and at least the following steps are included:
step S201, generating a virtual model corresponding to the head model.
Optionally, the simulated head model and the dentition model in the simulated head model are subjected to three-dimensional rendering by adopting augmented reality, the simulated head model is supplemented to be the real appearance of a patient, and the simulated head model is more real and is closer to the clinical oral environment through the virtual reality head-mounted display equipment.
Step S202, selecting ligature wire exercise mode through an orthodontic virtual reality system.
Alternatively, ligature practice patterns can be further divided into conventional ligatures, suspension ligatures, single wing ligatures, oblique ligatures, splayed ligatures, and special case ligatures.
Step S203, the orientation of the imitation head model is adjusted based on the received voice signal.
Specifically, the internal control reality system receives a voice signal and controls the head-imitating die to rotate, such as controlling the head-imitating die to perform left head deviation, right head deviation, head lifting, head lowering, large mouth opening, small mouth closing and the like.
Step S204, determining a ligating dental segment in the virtual model based on the virtual reality head mounted display device.
Optionally, the movement track of the needle holder is acquired by using the virtual reality head mounted display device, and the ligature dental segment is determined based on the movement track of the needle holder.
Optionally, the position of the needle mouth of the needle holder is determined, and the ligating tooth segment is determined based on the position of the needle mouth of the needle holder.
In step S205, the buckle device is moved to the ligating tooth segment along the slide rail.
Step S206, locking the buckle device when the needle holder is in the buckling state.
Step S207, the clamping device clamps the silk thread and applies tensile stress to the needle holder.
Step S208, simulating the clinical operation environment of hooking the ligature wire on the bracket based on the tensile stress, and sleeving the bracket on the ligature tooth position section.
Step S209, orthodontic ligation is performed on teeth in the ligature dental zone under the clinical operation environment.
It should be understood that the embodiments of the present disclosure are only used to illustrate an application scenario of an orthodontic method based on virtual reality by taking a ligature wire exercise mode as an example, and the related specific implementation manner and corresponding technical effects have been described in detail in the above embodiments, which are not repeated here.
Fig. 6 to 9 are schematic views showing the constitution of an apparatus for simulating orthodontic ligation according to an embodiment.
Referring to fig. 6 to 9, the device for simulating orthodontic ligation provided by the embodiment of the disclosure comprises a buckle device 1, a wire 2, a buckle device 3, a needle holder 4, a control switch 5, a maxillary model 6, a mandibular model 7 and a sliding rail 8.
The fastening device 1 and the fastening device 3 are connected with a sliding rail 8, the sliding rail 8 is used for adjusting the positions of the fastening device 1 and the fastening device 3 based on the upper jaw model 6 and the lower jaw model 7, the sliding rail 8 is positioned behind the upper jaw model 6 and the lower jaw model 7, and a control switch 5 is arranged at the tooth buckle position of the needle holder 4.
Fig. 10 illustrates a schematic composition of an orthodontic device based on virtual reality according to an embodiment.
Referring to fig. 10, an orthodontic device 60 based on virtual reality includes a generating module 601 for generating a virtual model corresponding to a simulated head model, a determining module 602 for determining a ligature dental section in the virtual model based on a virtual reality head-mounted display device, a processing module 603 for moving a buckle device to the ligature dental section along a slide rail, controlling the buckle device to be in a locked state, applying a tensile stress to a needle holder, and orthodontic ligation of teeth in the ligature dental section based on the virtual reality head-mounted display device and the tensile stress.
In some embodiments, the apparatus 60 further comprises an adjustment module 604 for adjusting the orientation of the simulated head phantom based on the received speech signal.
In some embodiments, the determining module 602 is specifically configured to acquire a movement track of a needle holder by using a virtual reality head mounted display device, and determine a ligature dental segment based on the movement track of the needle holder.
In some embodiments, the determining module 602 is specifically configured to determine a position of a needle mouth of the needle holder, and determine the ligating tooth segment based on the position of the needle mouth of the needle holder.
In some embodiments, the processing module 603 is specifically configured to lock the snap-fit device when the needle holder is in the locked state, the snap-fit device being configured to grip the thread and apply a tensile stress to the needle holder.
In some embodiments, the processing module 603 is specifically configured to simulate a clinical operating environment in which ligature wires are hooked to brackets that fit over ligature site segments based on tensile stress, and to orthodontic ligature teeth within the ligature site segments in the clinical operating environment
According to embodiments of the present disclosure, the present disclosure also provides an electronic device and a readable storage medium.
Fig. 11 illustrates a schematic block diagram of an example electronic device 700 that may be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable electronic devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the disclosure described and/or claimed herein.
As shown in fig. 11, the electronic device 700 includes a computing unit 701 that can perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM) 702 or a computer program loaded from a storage unit 708 into a Random Access Memory (RAM) 703. In the RAM 703, various programs and data required for the operation of the electronic device 700 may also be stored. The computing unit 701, the ROM 702, and the RAM 703 are connected to each other through a bus 704. An input/output (I/O) interface 705 is also connected to bus 704.
Various components in the electronic device 700 are connected to the I/O interface 705, including an input unit 706 such as a keyboard, mouse, etc., an output unit 707 such as various types of displays, speakers, etc., a storage unit 708 such as a magnetic disk, optical disk, etc., and a communication unit 709 such as a network card, modem, wireless communication transceiver, etc. The communication unit 709 allows the electronic device 700 to exchange information/data with other electronic devices through a computer network, such as the internet, and/or various telecommunication networks.
The computing unit 701 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of computing unit 701 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 701 performs the various methods and processes described above, such as a virtual reality-based orthodontic method. For example, in some embodiments, the virtual reality-based orthodontic method may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as the storage unit 708. In some embodiments, part or all of the computer program may be loaded and/or installed onto the electronic device 700 via the ROM702 and/or the communication unit 709. When the computer program is loaded into the RAM 703 and executed by the computing unit 701, one or more steps of the virtual reality-based orthodontic method described above may be performed. Alternatively, in other embodiments, the computing unit 701 may be configured to perform the virtual reality-based orthodontic method by any other suitable means (e.g., by means of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems On Chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include being implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be a special or general purpose programmable processor, operable to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.
Program code for carrying out methods of the present disclosure may be written in any combination of one or more programming languages. These program code may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus such that the program code, when executed by the processor or controller, causes the functions/operations specified in the flowchart and/or block diagram to be implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user, for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback), and input from the user may be received in any form, including acoustic input, speech input, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a Local Area Network (LAN), a Wide Area Network (WAN), and the Internet.
The computer system may include a client and a server. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server may be a cloud server, a server of a distributed system, or a server incorporating a blockchain.
It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps recited in the present disclosure may be performed in parallel or sequentially or in a different order, provided that the desired results of the technical solutions of the present disclosure are achieved, and are not limited herein.
Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include at least one such feature. In the description of the present disclosure, the meaning of "a plurality" is two or more, unless explicitly defined otherwise.
The foregoing is merely specific embodiments of the disclosure, but the protection scope of the disclosure is not limited thereto, and any person skilled in the art can easily think about changes or substitutions within the technical scope of the disclosure, and it is intended to cover the scope of the disclosure. Therefore, the protection scope of the present disclosure shall be subject to the protection scope of the claims.