Dental treatment education, treatment assistance, and evaluation system using smart glasses

Abstract

According to embodiments, provided is a dental treatment education, treatment assistance, and evaluation system using smart glasses, comprising: a service support system that receives image data or scan data of a patient and generates an overlapping image or treatment guide information on the basis of the received image data or scan data; and a smart glasses device that displays the overlapping image or treatment guide information transmitted from the service support system, detects user motion or treatment environment information by using a camera and a sensor, and transmits the detected user motion or treatment environment information to the service support system.

Description

Dental treatment education, clinical assistance, and evaluation system using smart glasses

[0001] The present disclosure relates to dental treatment education, clinical assistance, and evaluation technology using smart glasses.

[0002] Although dental treatment education and clinical procedure support technologies are essential elements in educational and clinical settings where actual procedural skills must be accurately and objectively measured—such as in dental school practice, the national dental licensing examination, and specialist proficiency evaluations—conventional technologies have limitations in that they rely primarily on lecture-based education or model practice, making it difficult to accurately reflect the actual patient environment. Existing dental procedure education methods lack consistency and objectivity in evaluation because quantitative data such as the operator's hand movements, angles, and depths are not collected, or because the evaluation must be conducted subjectively by the supervising professor, and the ability to provide real-time feedback is also very limited.

[0003] Furthermore, in the case of high-difficulty procedures such as implant surgery, practitioners must separately check cone-beam computed tomography (CBCT) images, oral scans, and information on anatomical risk structures, which can cause visual distraction during the actual procedure. Additionally, due to the lack of systems capable of integrating and guiding this information in real time, it is difficult to prevent procedural errors by trainees or beginners in advance. Moreover, most current dental evaluation methods involve post-procedure evaluation based on visual inspection of practice results, resulting in a complete lack of real-time error detection, warning, and correction functions during the procedure, which poses a problem in ensuring sufficient safety and educational effectiveness.

[0004] Therefore, there is a rapidly increasing demand for technology that can provide superimposed images overlaid on the real-time field of view via smart glasses during dental procedures, automatically collect and objectively evaluate procedural data such as the position, angle, depth, and hand movements of surgical tools, provide immediate warnings when approaching hazardous structures, and integrally support education, clinical assistance, and evaluation functions on a single platform. To meet these demands, a new dental procedure support system is required that combines augmented reality-based visual guidance functions, sensor-based procedural motion analysis technology, and real-time education and evaluation algorithms.

[0005] The present disclosure can provide dental treatment education, treatment assistance, and evaluation technology using smart glasses.

[0006] In one aspect, the present embodiments may provide a dental treatment education, treatment assistance, and evaluation system using smart glasses, comprising a service support system that receives patient image data or scan data and generates superimposed images or procedure guide information based thereon, and a smart glasses device that displays superimposed images or procedure guide information transmitted from the service support system and detects user motion or procedure environment information through a camera and a sensor and transmits it to the service support system.

[0007] According to embodiments of the present disclosure, dental treatment education, treatment assistance, and evaluation technology using smart glasses can be provided.

[0008] FIG. 1 is a configuration diagram of a dental treatment education, treatment assistance, and evaluation system using smart glasses according to one embodiment of the present disclosure.

[0009] Figure 2 is a block diagram of the service support system of Figure 1.

[0010] Figure 3 is a block diagram of the smart glasses device of Figure 1.

[0011] FIG. 4 is a block diagram of an exemplary computing system according to one embodiment of the present disclosure.

[0012] Hereinafter, some embodiments of the present disclosure will be described in detail with reference to the exemplary drawings. In assigning reference numerals to the components of each drawing, the same components may have the same reference numeral as much as possible, even if they are shown in different drawings. Furthermore, in describing the embodiments, if it is determined that a detailed description of related known components or functions may obscure the essence of the technical concept, such detailed description may be omitted. Where terms such as "comprising," "having," or "consisting of" are used in this specification, other parts may be added unless "only" is used. Where a component is expressed in the singular, it may include a plural unless otherwise specified.

[0013] Additionally, terms such as first, second, A, B, (a), (b), etc., may be used to describe the components of the present disclosure. These terms are used merely to distinguish the components from other components, and the nature, order, sequence, or number of the components are not limited by such terms.

[0014] In describing the positional relationship of components, where it is stated that two or more components are "connected," "combined," or "joined," it should be understood that while the two or more components may be directly "connected," "combined," or "joined," they may also be "connected," "combined," or "joined" with other components "intervened." Here, the other components may be included in one or more of the two or more components that are "connected," "combined," or "joined" with one another.

[0015] In describing the temporal flow relationship regarding components, methods of operation, or methods of production, for example, when the temporal or sequential relationship is described using "after," "following," "next," or "before," it may include cases where the relationship is not continuous unless "immediately" or "directly" is used.

[0016] Meanwhile, where numerical values ​​or corresponding information regarding a component (e.g., levels, etc.) are mentioned, even without separate explicit notation, the numerical values ​​or corresponding information may be interpreted as including a range of error that may occur due to various factors (e.g., process factors, internal or external shocks, noise, etc.).

[0017] FIG. 1 is a configuration diagram of a dental treatment education, treatment assistance, and evaluation system using smart glasses according to one embodiment of the present disclosure.

[0018] As illustrated in FIG. 1, the entire system according to the present embodiment may include a communication network (100), a service support system (200), and a smart glass device (300).

[0019] First, a communication network (100) according to one embodiment of the present invention can be configured regardless of the mode of communication, such as wired communication or wireless communication, and can be configured as various communication networks such as a Local Area Network (LAN), a Metropolitan Area Network (MAN), or a Wide Area Network (WAN). Preferably, the communication network (100) referred to in this specification may be the known Internet or the World Wide Web (WWW). However, the communication network (100) may include at least a part of a known wired / wireless data communication network, a known telephone network, or a known wired / wireless television communication network, without being limited thereto.

[0020] For example, the communication network (100) may be a wireless data communication network and may implement conventional communication methods such as WiFi communication, WiFi-Direct communication, Long Term Evolution (LTE) communication, 5G communication, Bluetooth communication (including Bluetooth Low Energy (BLE) communication), infrared communication, ultrasonic communication, etc., in at least a part thereof.

[0021] Next, a service support system (200) according to one embodiment of the present invention can communicate with a smart glass device (300) through a communication network and can receive patient image data or scan data and generate superimposed images or procedure guide information based thereon. Specifically, the service support system (200) can align or preprocess patient cone-beam computed tomography data or 3D scan data to produce basic data for generating superimposed images, and use the produced basic data to produce procedure guide information regarding implant procedure paths, insertion depths, angles, or risk structures, and based on the procedure guide information, construct a virtual patient model or generate a practice scenario to perform education or simulation, and analyze user motion information, practice history information, or procedure result information to generate education evaluation results or feedback information. This service support system (200) may be a system that runs on a server equipped with memory means and equipped with a microprocessor to have computational capabilities.

[0022] The service support system (200) can update real-time superimposed images by matching user motion information received from the smart glass device (300) with the patient's image data.

[0023] The service support system (200) can select at least one operation mode among an education mode, a medical assistance mode, or an evaluation mode, and provide an overlapping image or procedure guide corresponding to the mode to a smart glass device (300).

[0024] The configuration and functions of the service support system (200) according to the present invention will be examined in detail through the following detailed description.

[0025] Next, a smart glass device (300) according to one embodiment of the present invention is a digital device that includes a function to communicate after connecting to a service support system (200), and may be a digital device equipped with memory means and equipped with a microprocessor to have computational capabilities. Here, the smart glass device (300) according to one embodiment of the present disclosure may include an input means for inputting information necessary for dental treatment education, medical assistance, and evaluation services using smart glasses, and a display means (e.g., an augmented reality display) for displaying information such as dental treatment education, medical assistance, and evaluation information using smart glasses.

[0026] Meanwhile, the smart glass device (300) may further include an application program for performing functions according to the present disclosure. Such an application may exist in the form of a program module within the smart glass device (300). The nature of such a program module may be generally similar to the components of the service support system (200) as described below (i.e., the data processing unit (210), the procedure guide unit (220), the education and simulation unit (230), and the education evaluation unit (240)). Here, at least a part of the application may be replaced with a hardware device or firmware device capable of performing substantially the same or equivalent functions as needed.

[0027] Additionally, the smart glass device (300) may be a terminal used by healthcare professionals, such as dentists and dental hygienists, during a procedure, or a terminal used by trainees performing dental procedure training. The smart glass device (300) may have an interface provided by the service support system (200) configured differently depending on the user type, and accordingly, customized augmented reality (AR) content such as procedure guides, training guidance, and evaluation information may be provided.

[0028] Additionally, the smart glass device (300) can locally store user motion data or visual data during the procedure or stream it in real time to the service support system (200).

[0029] Additionally, the smart glass device (300) can determine at least one of approach to a surgical tool, proximity to a dangerous structure, and excessive angle change based on user motion information or surgical environment information detected by the camera and sensor unit, and transmit the determination result to the service support system (200).

[0030] In addition, the smart glass device (300) can generate step-by-step guidance information by comparing the procedure guide information provided from the service support system (200) with the user's actual procedure progress status.

[0031] The service support system (200) can perform alignment between the patient's actual oral environment and digital treatment plan information based on image data and sensor data of the smart glass device (300) acquired in real time during treatment. Here, alignment can be performed by including coordinate system correction and parallax correction so that the digital treatment plan information corresponds precisely to the actual anatomical structure within the oral cavity.

[0032] The smart glass device (300) can provide superimposed images or procedure guide information based on the alignment results in real time during treatment.

[0033] Figure 2 is a block diagram of the service support system of Figure 1.

[0034] As illustrated in FIG. 2, the service support system (200) according to the present embodiment may include a data processing unit (210), a procedure guide unit (220), an education and simulation unit (230), and an education evaluation unit (240).

[0035] The data processing unit (210) can align or preprocess the patient's cone-beam computed tomography data or 3D scan data to produce basic data for generating superimposed images. Here, the superimposed image is an image in which guide information such as the implant path, insertion angle, and risk structure is superimposed on the actual procedure screen, and the basic data may refer to preprocessed analysis data such as separation of teeth and jawbone structures, alignment of 3D coordinate systems, and surface mesh information required to generate such superimposed images.

[0036] The data processing unit (210) can improve the alignment accuracy by performing noise removal, metal artifact reduction, or tooth and jawbone segmentation processing of the cone beam computed tomography data.

[0037] Additionally, the data processing unit (210) can ensure the visual quality and anatomical accuracy of the final superimposed image by correcting coordinate system inconsistencies between data obtained from different equipment, surface interpolation processing to compensate for missing scan areas, and applying a super-resolution restoration algorithm to improve resolution. Through this, the reliability of the drilling path and risk structure analysis calculated by the procedure guide unit (220) can be increased, and the precision of the AR-based procedure guidance displayed on the smart glass device (300) can also be improved.

[0038] The procedure guide unit (220) can calculate procedure guide information regarding the implant procedure path, insertion depth, angle, or risk structure using the basic data calculated by the data processing unit (210).

[0039] The procedure guide section (220) can automatically detect the implantable bone thickness, nerve canal location, or lower border of the maxillary sinus from patient data and calculate the implantation depth or angle.

[0040] For example, the procedure guide section (220) can analyze the patient's jawbone shape and tooth arrangement to calculate a three-dimensional procedure path including a drilling entry point, a drilling direction, and a step-by-step drill diameter change sequence, and calculate the final implant position linked thereto.

[0041] Additionally, the procedure guide section (220) can automatically detect the implantable bone thickness, the location of the nerve canal, or the lower border of the maxillary sinus from patient data to calculate the implantation depth or angle, define the minimum safe distance from the nerve canal or maxillary sinus and the danger area to be avoided, and then set the information as a procedure warning area and provide it to the smart glass device.

[0042] Additionally, the procedure guide section (220) can generate and provide different forms of procedure guide information based on the same patient data, such as step-by-step explanations, simplified path displays, and standard path displays for evaluation, depending on the selected operation mode, such as education mode, medical assistance mode, or evaluation mode.

[0043] Additionally, the procedure guide section (220) may display a 3D guideline that guides the surgical procedure or the step-by-step path of the procedure in augmented reality. Additionally, the procedure guide section (220) may include a function for linking with medical devices that provides real-time data exchange and visualization with ultrasound equipment, endoscopes, or robotic surgical devices. Additionally, the procedure guide section (220) may include an algorithm-based feedback provision function that detects the accuracy of the medical device and deviations in the procedure process in real time and provides feedback to the user.

[0044] The education and simulation unit (230) can perform education or simulation by configuring a virtual patient model or creating a practice scenario based on procedure guide information.

[0045] The education and simulation unit (230) can reproduce the procedure process based on a virtual patient model, track the location of the procedure tool, or adjust the difficulty of the practice.

[0046] For example, the education and simulation unit (230) can create a digital virtual patient using the patient's three-dimensional jawbone data, configure a step-by-step scenario that simulates the actual implant surgery procedure, and then set practice goals including the drilling depth, angle, and position tolerance required at each step.

[0047] Additionally, the education and simulation unit (230) can reproduce the procedure process based on a virtual patient model, track the position of the procedure tool, or adjust the difficulty of the practice, and can provide educational content with different difficulty levels at each stage by changing the allowable error range, clinical situation (insufficient bone mass, proximity of nerve canals, etc.) or the procedure time limit according to, for example, beginner, intermediate, and advanced difficulty levels.

[0048] In addition, the education and simulation unit (230) can provide a simulation environment that reflects virtual procedure results in real time based on user motion data received from the smart glass device (300), allowing the user to train the same case (actual patient case) from various angles and paths through repeated practice.

[0049] Additionally, the education and simulation unit (230) can provide a virtual patient simulation function that allows practicing procedures through interaction with a virtual patient in an augmented reality (AR) / virtual reality (VR) environment. Additionally, the education and simulation unit (230) can provide a data analysis and evaluation function that analyzes the user's procedure data to provide learning progress evaluation and feedback. Furthermore, the education and simulation unit (230) can provide a remote education function in which an expert provides remote guidance in real time through a smart glass device (300).

[0050] Image processing and visualization are required to provide these functions. For example, a configuration that analyzes medical images in real time and integrates them into an augmented reality interface may be included. In addition, precise location recognition and tracking functions may be provided. For example, the position of the operator's hand, the position of the instrument, and the procedure site can be precisely tracked through the sensors of the smart glasses device (300), and Simultaneous Localization and Mapping (SLAM) technology may be utilized.

[0051] The education evaluation department (240) can generate education evaluation results or feedback information by analyzing user action information, practice history information or procedure result information.

[0052] The education evaluation department (240) can calculate an evaluation score or grade by analyzing the user's practice time, accuracy of movements, compliance with procedure steps, or collision with dangerous structures.

[0053] The education evaluation department (240) can store user-specific learning history or instructor feedback data based on evaluation scores or analysis results.

[0054] For example, the education evaluation department (240) can calculate an evaluation score or grade by comparing data such as the movement path, angle change, drilling depth, and time required for the procedure of the procedure tool collected from the smart glass device (300) with a reference path or reference time, and analyzing the user's practice time, motion accuracy, compliance with procedure steps, or collision with a dangerous structure.

[0055] Additionally, the education evaluation department (240) can record the reasons for deductions at each stage (e.g., failure to maintain safety distance, deviation from the designated path, omission of specific steps, etc.) and generate improvement directions for each item in the form of text or visual feedback to provide to the service support system (200) or smart glass device (300).

[0056] Additionally, the education evaluation unit (240) can store user-specific learning history or instructor feedback data based on evaluation scores or analysis results, and can identify proficiency improvement trends and weak stages (e.g., drilling angle adjustment, final implantation depth adjustment, etc.) by comparing and analyzing the results of repeated practice for the same user in chronological order, and can be used to adjust practice scenarios provided by the education and simulation unit (230) in a customized manner for each user.

[0057] Figure 3 is a block diagram of the smart glasses device of Figure 1.

[0058] As illustrated in FIG. 2, the smart glasses device (300) according to the present embodiment may include a camera and sensor unit (310), a user interface unit (320), an augmented reality display unit (330), and a notification providing unit (340).

[0059] The camera and sensor unit (310) can detect the surgical environment, user hand movements, viewing direction, or surgical tool position.

[0060] For example, the camera and sensor unit (310) includes at least one of an RGB camera, a depth sensor, a gyroscope, an accelerometer, or an inertial measurement unit (IMU), and can precisely track the user's hand tremors, posture changes, tool approach paths, etc. during the procedure.

[0061] Additionally, the information obtained from the camera and sensor unit (310) may include the degree of hand tremor of the user, the movement trajectory of the hand and arm, the direction of the head and gaze, the tilt and rotation values ​​of the smart glasses, the approach speed and distance of the surgical tool, and the relative position information with the oral cavity structure, and such information may be transmitted in real time to the service support system (200) and used for superimposed image updates, risk structure warnings, and surgical progress analysis.

[0062] The user interface unit (320) can recognize user input based on gaze, gesture, voice input, or movement, or process operation information.

[0063] The user interface unit (320) can perform eye-tracking-based cursor movement, gesture recognition-based menu operation, or voice command-based function selection.

[0064] The user interface unit (320) can recognize gaze, gestures, voice input, head movements, etc., so that a user wearing smart glasses can naturally operate it even in a procedure situation where both hands are busy.

[0065] For example, the user interface section (320) can support eye-tracking-based cursor movement, gesture recognition-based menu operation, voice command-based function execution, etc., allowing access to necessary information without interfering with the procedure flow.

[0066] That is, the user interface unit (320) can perform the function of analyzing raw data such as gaze direction, hand gestures, head movements, or voice signals collected by the camera and sensor unit (310) and converting the data into user operation inputs such as cursor movement on the screen, menu selection, and function execution.

[0067] In other words, the user interface section (320) may include natural control functions through hand gestures, voice commands, or eye tracking, and may include an intuitive user interface (UI) / user experience (UX) optimized for a medical environment.

[0068] The augmented reality display unit (330) can display superimposed images, procedure guide information, or training simulation information received from the service support system (200) in an augmented reality (AR) manner.

[0069] The augmented reality display unit (330) can intuitively overlay information such as implant placement paths, drilling depths, angle guide lines, and warnings for dangerous nerve canals on an actual intraoral structure image, thereby providing real-time decision support to the operator. This provision of augmented reality-based information can contribute to improving surgical accuracy and enhancing the effectiveness of training for practitioners.

[0070] The notification provider (340) can provide visual, voice, tactile, or vibrational notifications in response to the user's risk approach, procedure step guidance, or educational feedback.

[0071] The notification providing unit (340) can provide visual flashing, acoustic warning, or vibration feedback when approaching a dangerous structure to provide an immediate procedure warning.

[0072] For example, the notification providing unit (340) can provide visual flashing and vibration together when the operator is excessively close to a dangerous structure, or provide sound guidance when the procedure step is incorrect, thereby reducing the operator's judgment error.

[0073] In addition, the notification provider (340) can provide step-by-step feedback in training mode depending on the accuracy of the practitioner's movements or whether the steps are performed.

[0074] For example, the notification providing unit (340) can output an immediate warning signal if the practitioner does not approach at the correct angle or depth, or guide the time to proceed to the next step, and if there are any missed procedures or insufficient movements during the practice process, provide supplementary guidance using at least one of visual, sound, or vibration, thereby supporting the user to correct the movements themselves.

[0075] Additionally, the smart glass device (300) can be connected to an oral scanner via a wired or wireless connection to receive oral scan data generated by the oral scanner and use it as basic information for transmitting to a service support system (200) or displaying on an augmented reality display unit (330). Accordingly, oral scan data and oral structure information acquired before or during a procedure can be naturally linked as real-time guidance information through the smart glass device (300).

[0076] As described above, the present disclosure can provide a system capable of performing implant procedure guidance, dental education, and skill evaluation in an integrated manner using an augmented reality (AR), virtual reality (VR), and extended reality (XR) based smart glasses device (300).

[0077] In other words, it can provide the anatomical structure of a pre-entered artificial bone model when practicing procedures such as implants. Furthermore, it can provide real-time information regarding implant guides, insertion depth, and position, and offer an educational system capable of providing appropriate feedback to dental students and others.

[0078] The guide and real-time information can be provided through the wearer's smart glasses device (300), and can provide real-time location of equipment such as drills and adjacent anatomical information. Through this, the lack of actual patient practice experience can be supplemented, and specific anatomical structures and drill locations can be checked by wearing lightweight smart glasses.

[0079] In addition, educational opportunities can be provided by processing prior information about actual patients to provide anatomical structures and drill locations.

[0080] The present disclosure can provide real-time information regarding the guide, implantation depth, and position during surgery on a smart glass device (300) using three-dimensionally input data based on the patient's cone-beam computed tomography (CBCT) and model information. Through this, a medical assistance system that can assist in safe medical treatment can be provided.

[0081] For example, when cone-beam computed tomography (CBCT) information and oral information are input, the information can be processed three-dimensionally by a server and / or computing device. In addition, real-time procedure information can be provided by superimposing human anatomical structures, etc., with three-dimensional image information.

[0082] In addition, a warning signal for warning departure may be emitted when a drill or similar equipment approaches a nerve tube or a zone designated as a hazardous structure.

[0083] In addition, the present disclosure can provide a fast and accurate evaluation system that enables objective and rapid evaluation as a tool for scoring practical examinations in dental college practice, such as tooth preparation or tooth alignment, or in the national examination for dental specialists. That is, digital evaluation of dental treatment using smart glasses or a 3D scanner (3D camera) is possible.

[0084] For example, evaluation is possible immediately through methods such as taking photos based on entered disease information, such as dental caries, and correct answers. Additionally, scores for each zone can be displayed as overlaid images, allowing for immediate score evaluation.

[0085] For the aforementioned operation, the smart glasses device (300) can visualize medical data in real time using augmented reality (AR) functions to display the treatment site, procedure, or anatomical structure. Additionally, the smart glasses device (300) can provide necessary information within the field of view while freeing the user's hands as a head-mounted display (HMD). Furthermore, the smart glasses device (300) can collect environmental information, capture medical images, and track user movements through cameras and sensors.

[0086] In the present disclosure, the smart glasses device (300) may be connected to an oral scanner via a wired or wireless connection. The oral scanner may scan information about the oral cavity and generate an image or video to create an input as digital information. The generated digital information may be transmitted to the smart glasses device (300) for processing. Alternatively, the generated digital information may be transmitted to the smart glasses device (300) through a server or computing device.

[0087] Meanwhile, data security and connectivity functions may also be required in the present disclosure. To this end, the establishment of a network infrastructure for the real-time transmission of medical data and augmented reality display may be presupposed, and encryption and authentication configurations for protecting patient data may be included.

[0088] Additionally, the smart glass device (300) can provide notifications in various ways. For example, the smart glass device (300) can provide notifications regarding necessary matters or specific situations using methods such as visual, auditory, tactile, haptic, or vibration. Through this, trainees, users, evaluators, etc., can immediately recognize specific situations. In addition, two or more of the aforementioned notification methods may be provided in combination. Here, the combination may be any combination.

[0089] The following section will specifically explain how to precisely overlay digital treatment plans onto the actual oral environment.

[0090] First, regarding data sources and processing, the service support system (200) can construct a digital patient model by aligning the patient's Cone Beam CT (CBCT) data or Intraoral Scan data.

[0091] The service support system (200) can generate or analyze digital treatment planning data based on acquired data, and the data can be transmitted to a smart glass device (300) and provided as an AR-based guidance video.

[0092] The service support system (200) can correct the coordinate system of images acquired from different equipment or reconstruct depth information to generate a three-dimensional superimposed image that corresponds precisely to the actual oral structure.

[0093] Meanwhile, regarding AR overlay information, the smart glasses device (300) can display treatment plan information overlaid on an actual patient oral image through augmented reality (AR).

[0094] The smart glass device (300) can provide real-time guidance on the planned incision location, tooth removal range, implantation path, or prosthetic boundary while verifying the patient's unique anatomical structure.

[0095] The smart glass device (300) can provide precise procedure guidance by correcting the time difference and position error between the actual screen and the digital plan data.

[0096] For example, in preservation (cavity) / prosthetic treatment, the service support system (200) can analyze the extent of caries, the boundary of the lesion, or the pulp adjacent part of the tooth to be treated and transmit it to a smart glass device (300) for superimposed display.

[0097] The service support system (200) can determine the minimum amount of removal required during the process of removing a prosthesis or removing a tooth, the removal slope, or the margin location, and generate procedure path or location guidance information.

[0098] The smart glass device (300) can visualize the deletion progress in real time and warn of areas that are excessively deleted or not deleted.

[0099] As another example, in periodontal / oral surgery, the service support system (200) can present a flap line or planned incision line for periodontal incision by overlaying it on a three-dimensional image.

[0100] The service support system (200) can analyze the location, depth, and removable path of an impaction and provide it as overlapping guide information to the smart glass device (300).

[0101] The smart glass device (300) can improve the safety of the procedure by displaying the centerline, the length of the incision, or the distance to the hazardous structure in real time during the actual incision process.

[0102] As another example, in implant surgery, the service support system (200) can generate procedure guide information by analyzing the planned implant placement location, angle, depth, and the location and distance of surrounding risk structures (nerve canals, maxillary sinuses).

[0103] The smart glass device (300) can provide real-time guidance on the drill entry position, drill diameter exchange step, and parallel depth of the implantation step, and can provide visual, voice, or vibration feedback when approaching a dangerous structure.

[0104] The service support system (200) can generate feedback data by analyzing the deviation between the digital plan before the procedure and the actual implantation location.

[0105] As such, the service support system (200) and smart glass device (300) of the present disclosure can provide a digital treatment plan by precisely overlaying it on an actual patient oral image in real time, thereby going beyond the level of simple procedure path guidance, and can simultaneously provide various clinical and educational functions such as risk avoidance, improved procedure accuracy, increased education efficiency, and automated practice evaluation.

[0106] The smart glass device (300) can ensure a natural user experience by providing eye-tracking, voice, or gesture-based operation functions, taking into account that it is difficult to use hands in a dental procedure environment.

[0107] Additionally, the service support system (200) can analyze the position data of the surgical instrument collected from the camera and sensor unit (310) to determine the relative position with respect to the planned surgical path or safety area, and generate warning information if it deviates from the reference path.

[0108] The smart glass device (300) can track the position, angle, and direction of movement of surgical instruments such as a dental handpiece, surgical knife, or implant drill in real time and provide distance information to dangerous structures or prohibited areas within the surgical space superimposed on the user's field of vision.

[0109] Additionally, the service support system (200) can generate and transmit to the smart glass device (300) notifications such as visual, voice, and vibration when the surgical instrument deviates from the planned path or approaches a dangerous structure excessively.

[0110] The smart glass device (300) can minimize the possibility of the operator deviating from the path, excessive cutting, or damage to dangerous structures by providing such warning information in the form of warning displays, flashing, acoustic signals, or vibration feedback within the augmented reality screen.

[0111] Meanwhile, the present disclosure may include a dental treatment education, treatment assistance, and evaluation system using a smart glass device (300). For example, the dental treatment education, treatment assistance, and evaluation system using a smart glass device (300) may be implemented as a computing system.

[0112] FIG. 4 is a block diagram of an exemplary computing system according to one embodiment of the present disclosure.

[0113] Referring to FIG. 4, the dental treatment education, treatment assistance, and evaluation operations described in the present disclosure may be implemented in an environment comprising one or more computing systems, a smart glass device, and, if necessary, an external device such as an oral scanner. The service support system of the present disclosure may be implemented as a computing system (400) comprising a processor, memory, and a storage device, and the computing system (400) may process patient image data or scan data to generate superimposed images and procedure guide information. For example, the computing system (400) may load commands from the storage device (430) to perform image processing and analysis tasks, such as cone-beam computed tomography (CBCT) data registration, three-dimensional reconstruction, calculation of procedure paths, and generation of training simulations, and execute them in the processor (450). The computing system (400) may also perform wired or wireless communication with the smart glass device to transmit the generated superimposed images or procedure guides to the smart glass device in real time. Conversely, the smart glass device transmits user motion information or procedure environment information measured through cameras and sensors to a computing system (400) to enable real-time analysis and feedback. Additionally, the computing system (400) may be linked with an oral scanner or an external computing device as needed, and oral scan data obtained from the oral scanner may be transmitted to the smart glass device via the computing system (400). With this configuration, the present disclosure can provide real-time interaction based on a continuous data flow between the smart glass device and the computing system during education, guidance, and evaluation processes before, during, and after the procedure.

[0114] A computing system or computing device may be used to include or implement components such as a system or a data processing system. A computing system (400) includes a bus or other communication component for transmitting information, and a processor (450) or processing circuit connected to the bus (440) to process information. A computing system (400) may also include one or more processors (450) or processing circuits connected to the bus (440) to process information. A computing system (400) may also include a main memory (410), such as random access memory (RAM) or other dynamic storage device connected to the bus to store information, and instructions (instructions) to be executed by the processor (450). The main memory (410) may be a data storage or may include such a data storage. The main memory (410) may also be used to store location information, temporary variables, or other intermediate information during the execution of instructions by the processor (450). The computing system (400) may further include a ROM (420) or other static storage device connected to a bus to store static information and instructions for the processor (450). Storage devices such as solid-state devices, magnetic disks, or optical disks may be coupled to the bus to continuously store information and instructions. The storage device may include or be part of a data storage.

[0115] The computing system (400) may be connected to a display (460), such as a liquid crystal display or an active matrix display, to display information to a user via a bus (440). An input device (470), such as a keyboard including alphanumeric and other keys, may be connected to the bus (440) to transmit information and command selections to the processor. The input device (470) may include a touch screen display. The input device (470) may also include cursor controls, such as a mouse, trackball, or cursor direction keys, to transmit direction information and command selections to the processor (450) and to control cursor movement on the display. The display (460) may be part of a data processing system, a client computing device, or other components.

[0116] The process, system, and method described in this embodiment may be implemented by a computing system (400) in response to a processor (450) executing an array of instructions contained in main memory (410). These instructions may be read into main memory from other computer-readable media, such as a storage device. The execution of the array of instructions contained in main memory (410) causes the computing system (400) to perform the exemplary process described herein. In a multiprocessing array, one or more processors may also be used to execute instructions contained in main memory. Hard-wired circuits may be used in place of software instructions or in place of hardware instructions with the systems and methods described herein. The systems and methods described herein are not limited to any specific combination of hardware circuits and software.

[0117] Although exemplary computing systems have been described above, the essence including the operations described in this embodiment may be implemented in other types of digital electronic circuits, or in computer software, firmware, or hardware including structures disclosed herein and structural equivalents thereof or combinations of one or more of these.

[0118] "Data processing system," "computing device," "module," "engine," "component," or "computing device" includes various devices, devices, and machines for processing data, including, for example, a programmable processor, a computer, a system on a chip, or a number of such items or combinations thereof. The device may include special-purpose logic circuits, for example, a field programmable gate array (FPGA) or an application-specific integrated circuit (ASIC). In addition to hardware, the device may also include code that creates an execution environment for the corresponding computer program, for example, processor firmware, a protocol stack, a database management system, an operating system, a cross-platform runtime environment, a virtual machine, or a combination of one or more of these. The device and execution environment may realize various different computing model infrastructures, such as web services, distributed computing, and grid computing infrastructures. A content request module, a content rendering module, or a rendered content delivery module may include or share one or more data processing devices, systems, computing devices, or processors. Components of the system may include or share one or more data processing devices, systems, computing devices, or processors.

[0119] A computer program (also known as a program, software, software application, app, script, or code) may be written in any form of programming language, including compiled or interpreted languages, declarative or procedural languages, and may be distributed as a standalone program or in any form including modules, components, subroutines, objects, or other units suitable for use in a computing environment. A computer program may or may not correspond to a file in a file system. A computer program may be stored in a file containing other programs or data (e.g., one or more scripts stored in a markup language document), a single file dedicated to that program, or a portion of a file containing multiple coordinated files (e.g., files storing one or more modules, subprograms, or parts of code). A computer program may be distributed to be executed on a single computer or a single site, or on multiple computers distributed across multiple sites and interconnected by a communication network.

[0120] The processes and logic flows described in the present embodiment may be performed by one or more programmable processors that execute one or more computer programs (e.g., components of a data processing system) to perform actions by operating input data and generating outputs. The processes and logic flows may also be performed by special-purpose logic circuits, e.g., a field programmable gate array (FPGA) or an application-specific integrated circuit (ASIC), and the devices may also be implemented by special-purpose logic circuits. Devices suitable for storing computer program instructions and data include all forms of non-volatile memory, media, and memory devices, such as semiconductor memory devices like EPROM, EEPROM, and flash memory devices; magnetic disks, e.g., internal hard disks or removable disks; optomagnetic disks; and CD-ROM and DVD-ROM disks. The processor and memory may be complemented or integrated by special-purpose logic circuits.

[0121] The devices, configurations, glyphs, and operations described in the embodiments herein may be implemented as digital electronic circuits, or computer software, firmware, or hardware comprising structures disclosed in this specification and structural equivalents, or combinations of one or more of these. The glyphs described in the embodiments herein may be implemented as one or more computer programs, for example, as one or more modules of computer program instructions encoded on a computer storage medium to control execution by a data processing device or operation by a data processing device. Program instructions may be encoded in artificially generated propagated signals, for example, mechanically generated electrical, optical, or electromagnetic signals generated to encode information for transmission to a suitable receiver device for execution by a data processing device. The computer storage medium may be or may include a computer-readable storage device, a computer-readable storage substrate, a random or serial access memory array or device, or a combination of one or more of these. Although the computer storage medium is not a propagated signal, the computer storage medium may be a source or destination of computer program instructions encoded in an artificially generated propagated signal. Additionally, the computer storage medium may be or may include one or more individual physical components or media (e.g., multiple CDs, disks, or other storage devices). The operation described in this embodiment may be implemented as an operation performed by a data processing device on data stored in one or more computer-readable storage devices or data received from other sources.

[0122] The foregoing description is merely an illustrative explanation of the technical concept of the present disclosure, and those skilled in the art to which the present disclosure pertains may make various modifications and variations within the scope of the essential characteristics of the technical concept. Furthermore, since these embodiments are intended to explain, not limit, the scope of the technical concept is not limited by these embodiments. The scope of protection of the present disclosure shall be interpreted by the claims below, and all technical concepts within an equivalent scope shall be interpreted as being included within the scope of rights of the present disclosure.

[0123]

[0124] CROSS-REFERENCE TO RELATED APPLICATION

[0125] This patent application claims priority pursuant to Section 119(a) of the U.S. Patent Act (35 USC §119(a)) to Patent Application No. 10-2025-0001059 filed in Korea on January 3, 2025 and Patent Application No. 10-2025-0198999 filed in Korea on December 15, 2025, all of which are incorporated by reference into this patent application. Additionally, this patent application claims priority in countries other than the United States for the same reasons as above, all of which are incorporated by reference into this patent application.

Claims

1. As a dental treatment education, clinical assistance, and evaluation system using smart glasses, A service support system that receives patient image data or scan data and generates superimposed images or procedure guide information based thereon; and A dental treatment education, treatment assistance, and evaluation system using smart glasses, comprising a smart glasses device that displays superimposed images or procedure guide information transmitted from a service support system, and detects user movements or procedure environment information through a camera and sensors and transmits it to the service support system.

2. In Paragraph 1, The above service support system is, A dental treatment education, clinical assistance, and evaluation system using smart glasses that updates real-time superimposed images by matching user motion information received from a smart glasses device with patient image data.

3. In Paragraph 1, The above service support system is, A dental treatment education, clinical assistance, and evaluation system using smart glasses that selects at least one operation mode among an education mode, a clinical assistance mode, or an evaluation mode, and provides an overlapping image or procedure guide corresponding to the mode to a smart glasses device.

4. In Paragraph 1, The smart glasses device mentioned above is, A dental treatment education, clinical assistance, and evaluation system using smart glasses that locally stores user motion data or visual field data during a procedure or streams it in real-time to a service support system.

5. In Paragraph 1, The smart glasses device mentioned above is, A dental treatment education, treatment assistance, and evaluation system using smart glasses that determines at least one of approach to a surgical tool, proximity to a dangerous structure, and excessive angle change based on user motion information or surgical environment information detected by a camera and sensor unit, and transmits the determination result to a service support system.

6. In Paragraph 1, The smart glasses device mentioned above is, A dental treatment education, treatment assistance, and evaluation system using smart glasses that generates step-by-step guidance information by comparing procedure guide information provided from a service support system with the user's actual procedure progress status.

7. In Paragraph 1, The above service support system generates digital treatment planning information based on the patient's cone-beam computed tomography data and 3D oral scan data, including at least one of the extent of dental caries, pulp morphology, location of impacted teeth, periodontal surgery flap line, incision line, and implant placement location, and The smart glasses device is a dental treatment education, treatment assistance, and evaluation system using smart glasses that displays the digital treatment plan information superimposed in an augmented reality manner onto the actual patient's oral cavity field of view.

8. In Paragraph 1, The above service support system is, A data processing unit that aligns or preprocesses a patient's cone-beam computed tomography data or 3D scan data to produce basic data for generating superimposed images; A procedure guide unit that calculates procedure guide information regarding the implant procedure path, insertion depth, angle, or risk structure using basic data calculated by the data processing unit; An education and simulation unit that performs education or simulation by configuring a virtual patient model or generating practice scenarios based on procedure guide information; and A dental treatment education, clinical assistance, and evaluation system using smart glasses, comprising an education evaluation unit that analyzes user action information, practice history information, or procedure result information to generate education evaluation results or feedback information.

9. In Paragraph 8, The above data processing unit is, A dental treatment education, clinical assistance, and evaluation system using smart glasses that improves alignment accuracy by performing noise removal, metal artifact reduction, or tooth and jawbone segmentation processing on cone-beam computed tomography data.

10. In Paragraph 8, The above procedure guide part is, A dental treatment education, clinical assistance, and evaluation system using smart glasses that automatically detects implantable bone thickness, nerve canal location, or the lower border of the maxillary sinus from patient data to calculate implantation depth or angle.

11. In Paragraph 8, The above education and simulation department is, Dental treatment education, clinical assistance, and evaluation system using smart glasses that reproduce the procedure process based on a virtual patient model, track the position of surgical tools, or adjust the difficulty of the practice.

12. In Paragraph 8, The aforementioned education evaluation department, A dental treatment education, clinical assistance, and evaluation system using smart glasses that calculates an evaluation score or grade by analyzing at least one of the user's practice time, motion accuracy, compliance with procedure steps, and collision with dangerous structures.

13. In Paragraph 12, The aforementioned education evaluation department, A dental treatment education, clinical assistance, and evaluation system using smart glasses that stores user-specific learning history or instructor feedback data based on evaluation scores or grade results.

14. In Paragraph 1, The smart glasses device mentioned above is, A camera and sensor unit including a camera and a sensor for detecting the procedure environment, user hand movements, viewing direction, or the position of the procedure tool; A user interface unit that recognizes user input based on gaze, gesture, voice input, or movement, or processes operation information; An augmented reality display unit that displays superimposed images, procedure guide information, or training simulation information received from a service support system in an augmented reality manner; and A dental treatment education, treatment assistance, and evaluation system using smart glasses, comprising a notification providing unit that provides visual, voice, tactile, or vibrational notifications in response to user risk approach, procedure step guidance, or educational feedback.

15. In Paragraph 14, The above camera and sensor unit, A dental treatment education, treatment assistance, and evaluation system using smart glasses comprising at least one of an RGB camera, a depth sensor, a gyroscope, an accelerometer, and an inertial measurement unit.

16. In Paragraph 14, The above user interface unit is, Dental treatment education, clinical assistance, and evaluation system using smart glasses that perform eye-tracking-based cursor movement, gesture recognition-based menu operation, or voice command-based functions.

17. In Paragraph 14, The above-mentioned augmented reality display unit is, Dental treatment education, clinical assistance, and evaluation system using smart glasses that superimposes implant placement paths, angle guidelines, or danger warning indicators onto actual intraoral structural images to provide them within the field of view.

18. In Paragraph 14, The above notification providing unit is, A dental treatment education, clinical assistance, and evaluation system using smart glasses that provides an immediate procedure warning by providing at least one of visual flashing, acoustic warning, and vibration feedback when approaching a dangerous structure.

19. In Paragraph 14, The smart glasses device mentioned above is, A dental treatment education, clinical assistance, and evaluation system using smart glasses that are connected to an oral scanner via wired or wireless connection to receive oral scan data generated by the oral scanner and transmit it to a service support system or utilize it as information for display on an augmented reality display unit.

20. In Paragraph 1, The above service support system performs alignment between the patient's actual oral environment and digital treatment plan information based on image data and sensor data from a smart glass device acquired in real time during treatment, and The above alignment is performed including coordinate system correction and parallax correction so that digital treatment planning information corresponds precisely to the actual anatomical structures within the oral cavity, and The smart glass device is a dental treatment education, treatment assistance, and evaluation system using smart glasses that provides superimposed images or procedure guide information based on the alignment results in real time during treatment.

Images