A dental microscope system

By combining a microscopic observation module, a 3D imaging module, and an AR display module, the problems of narrow field of view and difficult positioning of traditional surgical microscopes are solved, enabling multi-field observation and real-time navigation, thus improving the efficiency and accuracy of dental diagnosis and treatment.

CN114903635BActive Publication Date: 2025-11-25ZUMAX MEDICAL
View PDF 10 Cites 0 Cited by

Patent Information

Application Number
CN202110185547.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-02-10
Publication Date
2025-11-25
Estimated Expiration
2041-02-10

AI Technical Summary

Technical Problem

Traditional surgical microscopes in dental treatment have problems such as fatigue from keeping the head fixed for long periods, narrow field of view, difficulty in instrument positioning, and inability to observe the patient's facial expressions and internal tissue structures in real time, which affect the efficiency and accuracy of diagnosis and treatment.

Method used

Employing a microscopic observation module, a 3D imaging module, and an AR display module, combined with image split-screen display, positioning and navigation detection, and AI-assisted analysis, it achieves the fusion display of three-dimensional digital images and optical images, providing multi-view observation and real-time navigation guidance.

Benefits of technology

The operator can move their head freely to observe the field of view under and outside the microscope, improving diagnostic and treatment efficiency, ensuring accurate positioning of surgical instruments, and observing the patient's condition in real time, thereby improving the accuracy and efficiency of diagnosis and treatment.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114903635B_ABST
    Figure CN114903635B_ABST
Patent Text Reader

Abstract

The application discloses a dental micro-diagnosis and treatment system, which comprises a microscopic observation module, a 3D imaging module and an AR display module, wherein the microscopic observation module is used for observing a target object to be observed; the 3D imaging module is used for collecting a microscopic optical image in a field of view of the microscopic observation module in real time and converting the microscopic optical image into a three-dimensional digital image; and the AR display module is worn on the head of an operator and used for receiving the three-dimensional digital image output by the 3D imaging module and converting the three-dimensional digital image into an optical image to be displayed in the field of view of the operator. The dental micro-diagnosis and treatment system can display the microscopic optical image in a microscope through an AR device, can superimpose an additional information image on the image displayed by the AR device, and can facilitate the operator to flexibly observe the target object and quickly check various data information related to the operation.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of dental diagnostic and treatment technology, and in particular to a dental microscopic diagnostic and treatment system. Background Technology

[0002] Surgical microscopes can be used for the examination and treatment of dental pulp and root canals. They allow for clear observation of the location of the root canal orifice, the morphology of the root canal wall, and the removal of pulp within the root canal. This enables procedures such as root canal preparation and filling, removal of broken instruments, and periapical surgery. With ample lighting and clear magnified observation, the widespread use of dental surgical microscopes has transformed traditional, experience-based, and manual techniques, significantly improving the success rate of root canal treatment, removal of metal blockages from root canals, treatment of root canal ledges, apical deviation, and pulp chamber perforation.

[0003] On the other hand, because doctors must accommodate the patient's posture, they cannot maintain a normal, comfortable posture. Continuous delicate operations can lead to fatigue and soreness in the shoulder, neck, and back muscles, which can accumulate over time and cause serious joint problems, even affecting the doctor's professional lifespan. The advent of the surgical microscope has solved these problems. It allows doctors to maintain an ergonomically correct posture during examinations and treatments, eliminating shoulder, neck, and back fatigue, and effectively improving diagnostic and treatment efficiency and quality.

[0004] However, traditional surgical microscopes have the following drawbacks:

[0005] 1. Maintaining a fixed head position for extended periods can lead to fatigue. Due to the limited size of the optical exit pupil, the doctor's eyes must remain at the exit pupil position of the eyepiece, which can easily cause fatigue during prolonged operation. In special examination positions, doctors may find it difficult to maintain a comfortable posture. Even with a monitor, the fixed orientation still requires maintaining a fixed posture for extended periods.

[0006] 2. The narrow field of view and difficulty in positioning instruments under the microscope hinder external communication with patients and nurses. Surgical microscopes have a relatively small field of view, especially at high magnification. When surgical instruments are moved from the external field of view into the internal field of view, positioning is difficult, requiring the surgeon to try and find the right spot, or to move their head away for direct observation.

[0007] Furthermore, doctors can only observe localized details under the microscope and cannot monitor the patient's facial expressions in real time when necessary. This is especially important for dental patients who may have difficulty communicating verbally. Real-time observation of the patient's facial expressions or other movements would help doctors confirm the appropriateness of the procedure. It is also necessary to observe the nurse's operational status for guidance and confirmation. Currently, all of the above procedures require the doctor to move the patient's head, interrupting the surgery.

[0008] 3. Surgical microscopes can only observe the outer layer of tissue structure and cannot observe the internal tissue structure. Some procedures require repeated attempts, which is time-consuming and can easily lead to missed root canals or excessive removal of healthy tooth tissue. Teeth are three-dimensional structures with multiple layers of tissue. Surgical microscopes can only observe the detailed features of the outer layer of tissue and cannot determine the inner tissue structure.

[0009] The hollow part in the middle of a tooth contains soft tissue called the dental pulp. The upper part of the cavity is wide, called the pulp chamber, and the lower part contains tubular root canals from which the dental nerve and its blood vessels supplying it emerge. Infection of the dental pulp causes pain, jawbone infection, and ultimately, the tooth becomes brittle due to the death of the dental nerve.

[0010] Taking root canal treatment as an example, the dentist needs to completely open the pulp chamber, locate all the root canals, and treat them. Humans generally have 1-4 root canals per tooth, with the posterior teeth having the most. In cases of multi-rooted teeth, due to age-related changes, the deposition of reparative dentin, pulp stones, pulp chamber calcification, or variations in root canal morphology, making it difficult to locate the root canal orifices, it is necessary to utilize the three-dimensional anatomy of the tooth to understand and view the anatomical morphology of the pulp chamber from various directions and positions. X-rays taken using various projection methods are used to understand and indicate the number, shape, location, direction, and curvature of the roots and root canals; the relationship between the roots and the crown; and various possible variations in the anatomical morphology of the roots and root canals. Since some teeth can have up to four root canals, and there may be complex situations such as lateral root canals, accessory root canals, apical bifurcation, and apical furcation, these can be missed even under magnified observation. It is necessary to estimate the possible location of the root canal. If necessary, a small ball bur can be used to remove a small amount of dentin at the possible or expected location of the root canal in the developmental groove. Then, a sharp probe can be used to try to pierce any calcified areas to point out the root canal orifice. The dentin collar at the neck of the tooth is removed to expose the location of the root canal orifice. In other words, if there is calcification of the root canal orifice, the dentist needs to repeatedly probe each possible location, which inevitably leads to the removal of too much healthy tooth tissue.

[0011] Currently, preoperative dental X-rays are frequently used to help dentists determine the number and shape of root canals. Firstly, dentists need to dedicate some time to memorizing the root canal morphology, and may even pause surgery to re-examine the X-rays. Furthermore, because dental X-rays are only two-dimensional images, they cannot accurately represent the three-dimensional shape of root canals. In reality, many root canals have multiple bends in their path, making accurate location impossible using only X-rays.

[0012] CBCT and other three-dimensional images are complex and difficult to memorize. Doctors need to memorize the three-dimensional shape of the tooth structure in their minds and compare, superimpose, and fuse it with the actual object under the microscope during the operation. This requires a lot of effort and it is difficult to guarantee accuracy and precision.

[0013] Therefore, considering the aforementioned technical problems, it is necessary to propose a new technical solution. Summary of the Invention

[0014] To address the technical problems existing in the prior art, this application proposes a dental microsurgical diagnostic and treatment system, the specific solution of which is as follows:

[0015] A dental microscopic diagnostic system includes a microscopic observation module, a 3D imaging module, and an AR display module. The microscopic observation module is used to observe the target object. The 3D imaging module is used to acquire microscopic optical images in the field of view of the microscopic observation module in real time and convert the microscopic optical images into three-dimensional digital images. The AR display module is worn on the operator's head and is used to receive the three-dimensional digital images output by the 3D imaging module and convert the three-dimensional digital images into optical images to be displayed in the operator's field of view.

[0016] Furthermore, it also includes a storage module and an image split-screen display module. The storage module stores a digital image of the target object's radiometric three-dimensional structure, and the image split-screen display module is used to display the digital image of the target object's radiometric three-dimensional structure in the form of an optical image at a set position within the display area of ​​the AR display module.

[0017] Furthermore, the digital image switch for the three-dimensional structure of the radiation imaging is controllable, allowing the operator to select whether to view a layered two-dimensional image or a 3D image of the target object as needed.

[0018] Furthermore, it also includes an image recognition processing module, which is used to identify biometric features in the three-dimensional digital image and, through biometric feature comparison, display a radiometric three-dimensional structural digital image that matches the three-dimensional digital image at a set position within the display area of ​​the AR display module.

[0019] Furthermore, it also includes a detection module. The microscopic observation module is equipped with a large zoom objective and a zoom system. The detection module is used to detect the focus position of the large zoom objective and the magnification of the zoom system, respectively. The image recognition and processing module determines the depth position of the three-dimensional structure digital image of the radiation imaging based on the focus position of the large zoom objective detected by the detection module. The image recognition and processing module determines the depth range of the current layer region displayed in the three-dimensional structure digital image of the radiation imaging based on the magnification of the zoom system detected by the detection module.

[0020] Furthermore, the radiation imaging three-dimensional structure digital image is displayed at the edge of the display area of ​​the AR display module, or the radiation imaging three-dimensional structure digital image is displayed overlapping with the three-dimensional digital image, and the transparency of the radiation imaging three-dimensional structure digital image is adjustable.

[0021] Furthermore, it also includes a positioning and navigation detection module, which is installed on the surgical instrument. The positioning and navigation detection module is used to detect the depth and spatial position data of the surgical instrument in real time. The image recognition and processing module compares the depth and spatial position data collected by the positioning and navigation detection module with the biometric features in the three-dimensional digital image to obtain the real-time relative position data between the surgical instrument and the target object, and displays it at a set position within the display area of ​​the AR display module.

[0022] Furthermore, the depth and spatial position data of the surgical instrument, as well as the status data of the surgical instrument, are stored in the storage module in real time, and the status data of the surgical instrument can be displayed at a set position within the display area of ​​the AR display module.

[0023] Furthermore, the storage module also stores patient information data, root canal measurement data, oral scanner data, electronic periodontal probe data, and pulp vitality data. Each data is individually controllable, and the operator can display the required data at a set position within the display area of ​​the AR display module as needed.

[0024] Furthermore, each data point is displayed in the AR display module's display area at a designated location using text symbols, data tables, two-dimensional curves, or three-dimensional topographic maps. Each data point is displayed in a split-screen format within the AR display module's display area, or can be switched within the same window. The display transparency of each data point, as well as the size and position of the display window for each data point, are adjustable.

[0025] Furthermore, it also includes an AI-assisted analysis module. The AI-assisted analysis module is switchable, and the operator can choose to turn the AI-assisted function on or off as needed. The AI-assisted analysis module is used to analyze the three-dimensional digital images acquired by the 3D imaging module, identify the lesions of the target object, and mark or remind the target object according to the lesions. At the same time, it summarizes and analyzes the data stored in the storage module to form additional AI-assisted information, which is displayed at a set position in the display area of ​​the AR display module.

[0026] Furthermore, it also includes a camera module for collecting facial expression image data of the patient. The AI-assisted analysis module analyzes the facial expression image data collected by the camera module, determines the patient's comfort level, and displays it in real time at a set position within the display area of ​​the AR display module.

[0027] Compared with existing technologies, the dental microsurgical system of this application has one or more of the following advantages:

[0028] (1) The dental microscopic diagnosis and treatment system of this application displays the optical images under the operating microscope in the form of AR optical images in the operator's field of vision through the VR display module. The operator (such as a doctor) can move his head freely and is no longer restricted by the position of the operating microscope. He can simultaneously observe the magnified field of vision under the microscope and the normal field of vision outside the microscope. The position of the surgical instruments is continuously visible and can be accurately moved from outside the microscope to the designated position under the microscope. At the same time, the patient's condition outside the microscope can be observed or the nurse can be instructed to confirm that the instruments or materials are correct.

[0029] (2) The dental microscopic diagnostic system of this application is equipped with an image split-screen display module. The operator can call up and view the 3D structure of the target object at any time as needed, and can choose to view specific layered images to determine the internal structure of the tissue under the microscope.

[0030] (3) The dental microscopic diagnostic system of this application is equipped with an image recognition and processing module, which can automatically compare and register the three-dimensional digital image of the radiation imaging structure with the three-dimensional digital image of the microscopic optical image through biometric judgment.

[0031] (4) The dental microscopic diagnostic and treatment system of this application can display the three-dimensional structure digital image of radiation imaging and the three-dimensional digital image of optical image under the microscope, and a positioning and navigation detection device is set in the surgical instrument to guide the surgical operation to be accurate and in place, so that the operator can confirm the operation in time and improve efficiency.

[0032] (5) The dental microscopic diagnostic and treatment system of this application can display patient information, root probe data, oral scanner data, electronic periodontal probe data, pulp vitality data and other data at a set position in the display area of ​​the AR display module, so as to provide reference for the operator.

[0033] (6) The dental microscopic diagnostic system of this application is equipped with an AI-assisted module to realize AI-assisted diagnosis and display. Attached Figure Description

[0034] Figure 1 This is a schematic diagram of the installation position of the surgical microscope provided in Embodiment 1 of this application;

[0035] Figure 2 This is a schematic diagram illustrating the connection between the surgical microscope and the AR device provided in Embodiment 1 of this application;

[0036] Figure 3 A flowchart of the dental microsurgical treatment system provided in Embodiment 1 of this application;

[0037] Figure 4 A schematic diagram of the area observable by the operator in an AR device, provided in Embodiment 1 of this application;

[0038] Figure 5 This is a schematic diagram showing the location of the additional information display area provided in Embodiment 1 of this application;

[0039] Figure 6 A flowchart of the dental microsurgical system provided in Embodiment 2 of this application;

[0040] Figure 7 A flowchart of the dental microsurgical system provided in Embodiment 3 of this application;

[0041] Figure 8 A flowchart of the dental microsurgical treatment system provided in Embodiment 4 of this application;

[0042] Figure 9 A flowchart of the dental microsurgical system provided in Embodiment 5 of this application;

[0043] Figure 10 A flowchart of the dental microsurgical system provided in Embodiment Six of this application.

[0044] 1-Surgical microscope, 11-Photosensitive element, 12-Imaging lens group, 13-Zoom lens group, 14-Large objective lens with zoom range, 2-AR device, 3-AR display module display area, 4-Real image display area, 5-Surgical instruments, 6-Additional information display area. Detailed Implementation

[0045] To further illustrate the technical means and effects adopted by the present invention to achieve the intended purpose, the following detailed description of the specific implementation methods, structure, features and effects of the present invention, in conjunction with the accompanying drawings and preferred embodiments, is provided.

[0046] Example 1

[0047] This embodiment provides a dental microsurgical diagnostic and treatment system, which includes a microscopic observation module, a 3D imaging module, and an AR display module. The microscopic observation module is a surgical microscope 1, as described above... Figure 1As shown, the surgical microscope 1 can be mounted on a bracket, allowing the operator to quickly move it as needed. The surgical microscope 1 features a dual-light-path design for observing the target object. The 3D imaging module is used to acquire real-time optical images within the observation field of the surgical microscope 1 and convert these images into three-dimensional digital images. The 3D imaging module includes left and right photosensitive elements 11, a zoom system, and a large zoom objective lens 14. The left and right photosensitive elements 11 are CCD or CMOS sensors, integrated and packaged on the same circuit board. The zoom system includes a zoom lens group 13. Parallel double beams are incident from different apertures on the large zoom objective lens 14, pass through the zoom lens group 13, and are then split into two paths by a beam splitter. One parallel double beam passes through the left and right imaging lens groups 12 and is imaged onto the left and right photosensitive elements 11, respectively. The other parallel double beam is directly observed through the binoculars. The left and right photosensitive elements 11 acquire the optical images within the observation field of the surgical microscope 1, convert them into three-dimensional digital images, and transmit them to the AR display module. The 3D imaging module can be integrated with the optical path within the surgical microscope 1, either built-in or as an accessory. For details, please refer to patents CN107132648A and CN107132649A, which will not be elaborated upon here. The AR display module is worn on the operator's head and is used to receive the three-dimensional digital image output by the 3D imaging module and convert the three-dimensional digital image into an optical image displayed in the operator's field of vision. The AR display module can be an AR device 2, such as a protective mask, helmet, or glasses with augmented reality functionality; AR glasses are preferred. Figure 2 As shown. In summary, the dental microsurgical treatment system of this embodiment mainly acquires three-dimensional digital images by adding a 3D imaging module to obtain the optical images under the surgical microscope 1's field of view, and displays them as optical images in the operator's field of view through a head-mounted AR display device. The system flow is as follows: Figure 3 As shown. Operators, such as doctors, wearing AR glasses or other head-mounted AR display devices, can move their heads freely, no longer restricted by the position of the surgical microscope 1. They can simultaneously observe both the magnified field of view under the microscope and the normal field of view outside the microscope. The positions of surgical instruments 5 are continuously visible, and they can be accurately moved from outside the microscope to designated positions under the microscope, such as... Figure 4 As shown, the magnified field of view under the scope is the display area 3 of the AR display module, while the normal field of view outside the scope is the display area 4 of the real image not displayed by the AR display module. The patient's condition outside the scope can be observed simultaneously, or instructions can be given to the nurse to confirm the correctness of the instruments or materials.

[0048] Example 2

[0049] This embodiment of the dental microscopy diagnostic system, based on Embodiment 1, adds an image split-screen display module to attach corresponding radiation imaging three-dimensional structural digital images to the edge positions of the display area of ​​AR glasses and other head-mounted AR display devices, i.e., as shown below. Figure 5 The additional information display area 6 shown below illustrates the system flow as follows: Figure 6 As shown. The preferred three-dimensional structural digital image of the radiation imaging is a CBCT digital image. The following embodiments use CBCT digital images as an example to illustrate the technical solution. The dental microsurgical system includes a storage module, which can import CBCT digital image data of the target object into the storage module through external input or retrieval. The image split-screen display module is used to display the CBCT digital image of the target object as an optical image at the edge of the display area 3 of the AR display module, providing real-time reference for the operator. The CBCT digital image switch is controllable, and the operator can manually select to view the layered two-dimensional image or 3D image of the target object as needed. The operator can determine the internal structure of the tissue under the microscope by selecting to view a specific layered two-dimensional image. In this embodiment, the operator needs to manually compare and register the CBCT digital image with the three-dimensional digital image of the surgical microscope 1.

[0050] Example 3

[0051] This embodiment of the dental microscopy diagnostic system, based on Embodiment 2, adds an image recognition processing module to identify biometric features in the three-dimensional digital image. Through biometric feature comparison, it automatically compares and registers the CBCT digital image with the three-dimensional digital image. Then, the CBCT digital image matching the three-dimensional digital image is displayed at the edge of the display area 3 of the AR display module. The system flow is as follows: Figure 7 As shown.

[0052] The dental microsurgical system of this embodiment also includes a detection module. The detection module is used to detect the focusing position of the large zoom objective 14 and the magnification of the zoom system, respectively. Preferably, the detection module uses position sensors, i.e., position sensors are added to the large zoom objective 14 and the zoom lens group 13 of the surgical microscope 1. The image recognition and processing module determines the depth position of the CBCT digital image based on the focusing position of the large zoom objective 14 detected by the position sensors, and determines the depth range of the current layer region displayed in the CBCT digital image based on the magnification of the zoom system detected by the detection module. The focal depth position of the surgical microscope 1 is automatically registered with the layer depth of the CBCT digital image; that is, when observing a planar structure under the microscope, the CBCT digital image automatically displays the CT digital image of the current layer (or the current layer region).

[0053] Example 4

[0054] The dental microsurgical system in this embodiment is based on Embodiment 3, where the CBCT digital image and the three-dimensional digital image are displayed overlapping. The transparency of the CBCT digital image is adjustable.

[0055] The dental microsurgical system of this embodiment also includes a positioning and navigation detection module, which is mounted on a surgical instrument 5, such as a dental handpiece. The positioning and navigation detection module is used to detect the depth and spatial position data of the surgical instrument 5 in real time. The image recognition processing module automatically compares the depth and spatial position data collected by the positioning and navigation detection module with biometric features in a three-dimensional digital image, such as the location, shape, depth, and orientation of the root canal orifice, to obtain real-time relative position data between the surgical instrument 5 and the target object. This data is then displayed at a set position within the display area 3 of the AR display module, for example... Figure 5 The additional information display area 6 shown below illustrates the system flow as follows: Figure 8 As shown. Simultaneously, the status data of surgical instrument 5 can also be imported, such as the handpiece's rotation speed and torque value, and can also be displayed synchronously on, for example... Figure 5 The additional information display area 6 is shown. When the position sensors located at the positions of the zoom objective lens 14 and the zoom lens group 13 detect a change, the real-time data of the surgical instrument 5 is automatically displayed at a set position within the display area 3 of the AR display module, facilitating timely confirmation of the operation by the doctor and improving efficiency. The depth and spatial position data of the surgical instrument 5, as well as the status data of the surgical instrument 5, can be stored in the storage module in real time.

[0056] Example 5

[0057] The dental microsurgical system of this embodiment is based on any of the embodiments one to four, but incorporates more relevant data, such as patient information data, root canal measurement data, oral scanner data, electronic periodontal probe data, and pulp vitality data. All of this data can be stored in the storage module through external input or retrieval. Each data point is equipped with a display switch, allowing for independent on / off control. The operator can display the desired data at a designated location within the AR display module's display area 3 as needed. The system flow is as follows: Figure 9 As shown.

[0058] Each data point can be displayed in various ways, such as text symbols, data tables, two-dimensional curves, or three-dimensional topographic maps, at a set location within the display area 3 of the AR display module. Each data point can be displayed in a split-screen format within the display area 3 of the AR display module, or switched within the same window. The display transparency of each data point, as well as the size and position of the display window for each data point, are adjustable.

[0059] Patient information data includes basic patient information, contraindications, and monitoring information such as blood pressure and blood oxygen saturation.

[0060] Root canal measurement data: Accurate measurement of the working length of the root canal is a basic condition for successful root canal treatment. Depending on the diagnosis, the endpoint of root canal preparation and filling varies for teeth with different conditions, and an error range of ±0.5mm needs to be ensured. Therefore, a root canal measuring instrument is used for measurement, and its data can be selectively displayed for reference.

[0061] Oral scanner data: high-resolution three-dimensional morphology of oral cavity structure.

[0062] Electronic periodontal probe data: The fundamental importance of periodontal health in oral medicine is an indisputable fact in the international dental community. Periodontal probing is a crucial method for basic oral diagnosis. Measuring periodontal pocket depth and attachment level with a periodontal probe is currently the primary method for clinically evaluating the extent of periodontal damage and serves as clinical evidence for assessing changes in periodontal condition. The Florida probe system can automatically measure a patient's periodontal pocket depth, attachment level, and attached gingival width under the operation of a single healthcare professional. It also records the overall dentition condition, tooth mobility, gingival bleeding and suppuration, furcation pathology, plaque distribution, and other indicators reflecting the severity of periodontal disease and prognosis. The system's built-in risk factor assessment function effectively evaluates the patient's condition risk, helping dentists objectively develop targeted treatment plans.

[0063] Pulp vitality data: The dental pulp is located within the pulp chamber surrounded by dentin, connected to the periapical tissues by a narrow apical foramen. It cannot be directly visualized, making it impossible to visually assess its condition clinically. The pulp is richly supplied with nerves that can sense external stimuli. Clinically, temperature and electrical stimulation of the pulp's nerve fibers are used to assess its vitality, helping dentists choose between completely removing necrotic pulp or performing a transection to preserve the healthy portion.

[0064] Example 6

[0065] The dental microscopic diagnostic system of this embodiment adds an AI-assisted analysis module to any of the embodiments one through five to achieve AI-assisted diagnosis and display. The AI-assisted analysis module is switchable; this switch can be a master switch or a separate function switch, allowing the operator to choose to turn the corresponding AI-assisted function on or off as needed. The AI-assisted analysis module analyzes the three-dimensional digital images acquired by the 3D imaging module, identifies the lesions of the target object, and marks or alerts the target object based on the lesions. Simultaneously, it summarizes and analyzes the data stored in the storage module to generate additional AI-assisted information. The operator can display this additional AI-assisted information at a designated location within the display area 3 of the AR display module as needed. The system flow is as follows: Figure 10 As shown.

[0066] For example, analyzing only the three-dimensional digital images acquired by the 3D imaging module:

[0067] The system analyzes digital images from microscopes under normal white light illumination to identify oral and dental lesions such as caries, microcracks, plaque, discoloration, and oral cancer, and marks or provides warnings. Marking methods can include different colored text, frames, borders, arrows, staining, etc., individually or in combination, accompanied by audio prompts. Suspected lesions requiring further examination are automatically marked, and the operator is prompted to switch to the appropriate operating mode, such as different wavelength fluorescence detection modes, polarization modes, or different filter modes. For lesions requiring switching to different operating modes for further examination, the AI ​​module can also automatically control the microscope to switch modes and obtain images in the corresponding mode for further analysis. For details on the specific mode switching implementation, please refer to patent CN211741708U, which will not be elaborated here.

[0068] Simultaneously, other imported data are summarized and analyzed: comprehensive analysis of patient information (age, gender, blood pressure, blood oxygen saturation, past medical history, etc.), CBCT, root canal measurement, electronic periodontal probe, pulp vitality data, etc., to evaluate the tooth condition based on the expert system, and suggest feasible treatment plans and treatment steps; combined with the spatial position and depth information of surgical instrument 5, instructions or reminders are given on tooth preparation size, depth, rotation speed, etc., to improve the standardization of operation;

[0069] The dental microscopic diagnostic system of this embodiment can also be equipped with a camera module, such as a video camera, to obtain the patient's facial expression image data in real time. The AI-assisted analysis module analyzes the facial expression image data collected by the camera module to determine the patient's comfort level and displays it in real time at a set position within the display area 3 of the AR display module, so that the operator can understand the patient's condition at any time.

[0070] In this document, the terms “comprising,” “including,” or any other variations thereof are intended to cover non-exclusive inclusion, which includes not only the elements listed but also other elements not expressly listed.

[0071] In this document, the directional terms such as front, back, top, and bottom are defined based on the location of the components in the accompanying drawings and their relative positions to each other, solely for the purpose of clarity and convenience in expressing the technical solution. It should be understood that the use of these directional terms should not limit the scope of protection claimed in this application.

[0072] Where there is no conflict, the above embodiments and features described herein can be combined with each other.

[0073] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the protection scope of the present invention.

Claims

1. A dental microsurgical diagnostic system, characterized in that, It includes a microscopic observation module, a 3D imaging module, and an AR display module. The microscopic observation module is used to observe the target object to be observed; The 3D imaging module is used to acquire the optical images under the microscope in the field of view of the microscopic observation module in real time, and convert the optical images under the microscope into three-dimensional digital images; the 3D imaging module includes left and right photosensitive elements (11), which acquire the optical images under the microscope in the field of view of the surgical microscope (1), convert them into three-dimensional digital images and transmit them to the AR display module; The AR display module is worn on the operator's head and is used to receive the three-dimensional digital image output by the 3D imaging module and convert the three-dimensional digital image into an optical image to be displayed in the operator's field of vision; It also includes an image recognition processing module, which is used to identify biometric features in the three-dimensional digital image and, through biometric feature comparison, display a radiometric three-dimensional structural digital image that matches the three-dimensional digital image at a set position within the display area of ​​the AR display module; It also includes a detection module, which contains a large zoom objective and a zoom system. The detection module is used to detect the focus position of the large zoom objective and the magnification of the zoom system. The image recognition and processing module determines the depth position of the three-dimensional structure digital image of the radiation imaging based on the focus position of the large zoom objective detected by the detection module. The image recognition and processing module determines the depth range of the current layer region displayed in the three-dimensional structure digital image of the radiation imaging based on the magnification of the zoom system detected by the detection module. The radiation imaging three-dimensional structure digital image is displayed at the edge of the display area of ​​the AR display module, or the radiation imaging three-dimensional structure digital image is displayed overlapping with the three-dimensional digital image, and the transparency of the radiation imaging three-dimensional structure digital image is adjustable.

2. The dental microsurgical system according to claim 1, characterized in that, It also includes a storage module and an image split-screen display module. The storage module stores a digital image of the target object's three-dimensional structure based on radiometric imaging. The image split-screen display module is used to display the digital image of the target object's three-dimensional structure based on radiometric imaging at a set position within the display area of ​​the AR display module in the form of an optical image.

3. The dental microsurgical system according to claim 2, characterized in that, The digital image switch for the three-dimensional structure of the radiation imaging is controllable, and the operator can choose to view the layered two-dimensional image or the 3D image of the target object as needed.

4. The dental microsurgical system according to claim 3, characterized in that, It also includes a positioning and navigation detection module, which is installed on the surgical instrument. The positioning and navigation detection module is used to detect the depth and spatial position data of the surgical instrument in real time. The image recognition and processing module compares the depth and spatial position data collected by the positioning and navigation detection module with the biometric features in the three-dimensional digital image to obtain the real-time relative position data between the surgical instrument and the target object, and displays it at a set position within the display area of ​​the AR display module.

5. The dental microsurgical system according to claim 4, characterized in that, The depth and spatial position data of the surgical instrument, as well as the status data of the surgical instrument, are stored in the storage module in real time. The status data of the surgical instrument can be displayed at a set position within the display area of ​​the AR display module.

6. The dental microsurgical system according to claim 5, characterized in that, The storage module also stores patient information data, root canal measurement data, oral scanner data, electronic periodontal probe data, and pulp vitality data. Each data is individually controllable, and the operator can display the required data at a set position within the display area of ​​the AR display module as needed.

7. The dental microsurgical system according to claim 6, characterized in that, Each data point is displayed in the AR display module's display area at a designated location using text symbols, data tables, two-dimensional curves, or three-dimensional topographic maps. The data points are displayed in a split-screen format within the AR display module's display area, or can be switched within the same window. The display transparency of each data point, as well as the size and position of the display window for each data point, are adjustable.

8. The dental microsurgical system according to claim 7, characterized in that, It also includes an AI-assisted analysis module, which is switchable, allowing the operator to choose to turn the AI-assisted function on or off as needed. The AI-assisted analysis module is used to analyze the three-dimensional digital images acquired by the 3D imaging module, identify the lesions of the target object, and mark or remind the target object according to the lesions. At the same time, it summarizes and analyzes the data stored in the storage module to generate additional AI-assisted information and displays it at a set position within the display area of ​​the AR display module.

9. The dental microsurgical system according to claim 8, characterized in that, It also includes a camera module for collecting facial expression image data of the patient. The AI-assisted analysis module analyzes the facial expression image data collected by the camera module, determines the patient's comfort level, and displays it in real time at a set position within the display area of ​​the AR display module.

Citation Information

Patent Citations

  • Surgical microscope with built-in 3D imaging device

    CN107132648A

  • 3D imaging device for surgical microscopes

    CN107132649A

  • Microscopic surgical operation navigation system based on augmented reality and navigation method

    CN105266897A

  • Surgery microscope AR display device

    CN110208940A

  • Surgical microimaging system based on optical coherence tomography augmented reality

    CN110638527A