Enhanced imaging system and method for realizing the same
The enhanced imaging system for surgical microscopes addresses the complexity of CBCT by superimposing 3D models and CBCT images onto the microscope's optical path, enhancing surgical precision and efficiency by adapting to user preferences and reducing the need for additional operators.
Patent Information
- Application Number
- JP2023577455
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2021-06-18
- Filing Date
- 2022-06-17
- Publication Date
- 2025-07-31
- Estimated Expiration
- 2042-06-17
AI Technical Summary
Current medical imaging technologies, such as stereoscopic images like CBCT, are complex and difficult to remember, leading to inaccuracies in surgical procedures due to the inability to accurately represent the three-dimensional shape of root canals, which can result in the risk of removing healthy tooth tissue during surgeries like root canal treatments.
An enhanced imaging system for surgical microscopes that integrates a media signal processing device, display device, superimposing lens, and binocular eyepiece barrel, allowing for the superimposition of 3D models and CBCT images onto the microscope's optical path, enabling precise surgical navigation and real-time data processing.
The system improves surgical accuracy by providing high-quality, superimposed 3D images that adapt to user preferences, reducing surgical difficulty and time by allowing one-handed operation without the need for additional assistants, and ensuring all relevant information is visible within the field of view.
Smart Images

Figure 0007716507000001 
Figure 0007716507000002 
Figure 0007716507000003
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field related to dental diagnosis, and particularly relates to an enhanced imaging system used in a surgical microscope and a method for realizing the same.
Background Art
[0002] Due to the rapid development of current diagnostic methods in fields such as in vitro diagnosis, Microtherapy, Medical imaging, and minimally invasive treatment, many interdisciplinary and multidisciplinary comprehensive treatment methods have been proposed. With the development of medical imaging devices, medical imaging technology has also developed a lot. Subdisciplines such as CT, MR, interventional radiology, ultrasound, and nuclear medicine in medical imaging have been gradually established, and medical imaging technology has gradually become concrete.
[0003] Medical imaging information has the characteristics of sensitivity, intuitiveness, specificity, and early detection. The image analysis method has developed from qualitative to quantitative, and from diagnostic information display to surgical route guidance. The shooting and display of images have developed from 2D analog signals to 3D digital signals. The storage of images has developed from Film hard copy to soft copy and filmless, and to the networking of image transmission. Also, it has developed from single imaging technology to Integrated imaging technology.
[0004] In order to realize the digitization, networking, and integration of medical images, it is necessary to integrate three specialized technologies related to diagnosis, technology, and process. The functions of current medical imaging means cannot be realized by only one specialized technology.
[0005] For example, when treating the root canal, the doctor needs to search for and process all the root canals by expanding the dental pulp cavity. One tooth contains 1 to 4 root canals, and the number of root canals in the posterior teeth is the largest. When age-related changes, deposition of reparative dentin, denticles, calcification of the dental pulp cavity, changes in the root canal shape, etc. occur in teeth with multiple root canals, it is impossible to easily find the root canal orifice. In that case, by adopting the 3D anatomical form of the tooth, the anatomical form of the dental pulp cavity can be observed in various directions and positions. Through X-ray photographs taken at various angles, the number, shape, position, direction, and curvature of the tooth root and root canal, the relationship between the tooth root and the dental crown, and various variation conditions of the tooth root and root canal can be grasped. Some teeth can contain not only 4 root canals but also lateral canals, accessory root canals, apical ramifications, and apical furcations. Therefore, even if the tooth is enlarged and observed, there is a risk of missing them. When predicting the position of the root canal, it is necessary to remove a small amount of dentin near the predicted position of the root canal or the developmental groove of the predicted position of the root canal with a small spherical drill. Next, by puncturing a predetermined calcified area with a file, the dentin collar of the root canal orifice from which the tooth cervix has been removed is predicted, and the position of the root canal orifice is exposed. When there is calcification, etc. of the root canal orifice, it is necessary to search for various possible positions. Thereby, there is a risk of removing healthy tooth tissue.
[0006] Before surgery, the doctor can determine the quantity and shape of the root canals by taking pictures of the teeth. However, the doctor needs to remember the shape of the root canals and, when unable to recall the shape of the root canals, needs to temporarily stop the surgery and observe the tooth pictures again. Since the tooth pictures are 2D planar images, they cannot accurately represent the three-dimensional shape of the root canals. Since the actual root canals are curved, the position of the root canals cannot be accurately determined by the 2D pictures of the teeth.
[0007] Stereoscopic images such as CBCT have the drawbacks of being complex and difficult to remember. When the doctor performs surgery, it is necessary to remember the three-dimensional structure of the tooth in the mind and compare, superimpose, and fuse the three-dimensional structure of the tooth observed under the microscope with the three-dimensional structure of the tooth remembered in the mind, which is time-consuming and cannot ensure the accuracy and precision of the surgery.
[0008] To solve the technical drawbacks of the prior art, it is necessary to provide new technical matters.
Summary of the Invention
Problems to be Solved by the Invention
[0009] To solve the drawbacks of the prior art, the present invention provides an enhanced imaging system for a surgical microscope and a method for realizing the same. The specific matters are as follows.
Means for Solving the Problems
[0010] An enhanced imaging system is provided in an embodiment of the present invention. The enhanced imaging system includes a media signal processing device, an enhanced imaging device, a microscope body, and a binocular eyepiece barrel. The enhanced imaging device includes a case, a display device, and a superimposing lens set. Both the display device and the superimposing lens set are mounted in the case. The display device is communicably connected to the media signal processing device. The superimposing lens set is mounted on the main optical path of the microscope body. The binocular eyepiece barrel is mounted on the microscope body. The display device is arranged to receive information data transmitted by the media signal processing device and convert the received information data into an optical image. The optical image output by the display device is superimposed on the main optical path of the microscope body by the superimposing lens set to form a superimposed image, and the superimposed image is observed through the binocular eyepiece barrel.
[0011] The enhanced imaging system of the present invention includes a plurality of information input devices. The information input devices are communicably connected to the media signal processing device. The media signal processing device converts information data input by the plurality of information input devices into one integrated information data and transmits the integrated information data to the display device.
[0012] In the enhanced imaging system of the present invention, the display device includes an information display area. When the information display area coincides with the observation field of the binocular eyepiece barrel, an optical image corresponding to the integrated information data converted by the media signal processing device is displayed in the information display area. The display device is an OLED display device, an LCD display device, or a DLP display device.
[0013] In the enhanced imaging system of the present invention, an area other than the optical image corresponding to the integrated information data in the optical image emitted by the display device is made black.
[0014] The enhanced imaging system of the present invention further includes an adjustment device, the adjustment device is communicably connected to the media signal processing device, the adjustment device is arranged to input adjustment information to the media signal processing device, and the media signal processing device controls the switching, size, position and angle of the image displayed in the information display area according to the information data input by the information input device according to the adjustment information.
[0015] The enhanced imaging system of the present invention further includes a collection device, the collection device is communicably connected to the media signal processing device, the collection device is arranged to collect the user's biometric information at any time, and the media signal processing device controls the switching, size, position, angle, etc. of the image displayed in the information display area according to the information data input by the biometric information control information input device.
[0016] The enhanced imaging system of the present invention further includes an image collection device, the image collection device is communicably connected to the media signal processing device, and the image collection device acquires the image information of the main optical path of the microscope body at any time and then transmits it to the media signal processing device.
[0017] In the enhanced imaging system of the present invention, the information input device includes a positioning and navigation device, the positioning and navigation device is attached to the surgical instrument, the positioning and navigation device is communicably connected to the media signal processing device, and the positioning and navigation device is attached to the surgical instrument to collect the position information of the surgical instrument at any time and transmit it to the media signal processing device 4.
[0018] In the enhanced imaging system of the present invention, the information input device includes an endometer, the endometer is communicably connected to the media signal processing device, and the endometer measures the length information of the root canal of the target tooth and then transmits the length information to the media signal processing device.
[0019] In the enhanced imaging system of the present invention, the media signal processing device is a portable terminal.
[0020] In the enhanced imaging system of the present invention, the media signal processing device is a portable terminal with a touch screen attached thereto, and by touching the touch screen, the switch, size, position or angle of a predetermined image corresponding to each information data and displayed on the display device can be controlled.
[0021] The enhanced imaging system of the present invention further includes a terminal support frame, and the media signal processing device is attached to one side of the enhanced imaging device or one side of the microscope body by the terminal support frame.
[0022] In the enhanced imaging system of the present invention, a wireless charging module responsible for charging the portable terminal is attached on the terminal support frame.
[0023] In the enhanced imaging system of the present invention, the enhanced imaging device further includes a spectroscopic lens assembly, the spectroscopic lens assembly is attached in the case, a dichroic interface is provided on one side of the case, and part of the light of the main optical path of the microscope body or part of the light of the superimposed image exits to the outside from the dichroic interface.
[0024] In the enhanced imaging system of the present invention, the media signal processing device is arranged to collect the light emitted from the dichroic interface.
[0025] In the enhanced imaging system of the present invention, the media signal processing device is arranged to display a 3D model, and the angle, size or transparency of the 3D model can be adjusted.
[0026] In the enhanced imaging system of the present invention, the media signal processing device is arranged to display a CBCT image, and can adjust the angle of the CBCT image, or adjust the size of the CBCT image, or adjust the transparency of the CBCT image.
[0027] The present invention further provides a method for realizing an enhanced imaging system. The method includes the steps of inputting information data of a target object into a media signal processing device, the media signal processing device analyzing and processing the input information data, and transmitting the processed information data to a display device of the enhanced imaging device, the display device converting the information data into an optical image and displaying it after receiving the information data, the optical image displayed on the display device entering a superimposing lens set of the main optical path of the microscope body through a lens optical path, the optical image displayed on the display device superimposing with the main optical path of the microscope body to form a superimposed image, and the superimposed image entering a binocular eyepiece lens barrel.
[0028] In the method for realizing the enhanced imaging system of the present invention, the information data includes CBCT image data. When inputting the CBCT image data into the media signal processing device, the media signal processing device obtains a 3D image of the target oral cavity by analyzing the CBCT image data, forms four orthographic views by displaying important information in the 3D image of the target oral cavity in high brightness, and displays it in the information display area of the selected display device. When selecting a target tooth on any one of the four orthographic views, the media signal processing device forms a 3D image and a transverse slice of the selected target tooth, and displays it in the information display area of the selected display device.
[0029] In the method for realizing the enhanced imaging system of the present invention, the information data includes the 3D model data information of the target tooth. When inputting the 3D model data information of the target tooth into the media signal processing device, after processing the 3D model data information, the media signal processing device displays it in the information display area of the selected display device.
[0030] In the method for realizing the enhanced imaging system of the present invention, the information data further includes additional information data. When inputting the additional information data into the media signal processing device, after processing the additional information data, the media signal processing device displays the processed additional information data in the information display area of the display device.
[0031] In the method for realizing the enhanced imaging system of the present invention, when the media signal processing device transmits information data to the display device, all the information data is integrated into one integrated information data by the media signal, and the integrated information data is transmitted to the display device for display, and the switch, size, position, and angle of a predetermined image displayed on the display device are adjusted by each information data.
[0032] In the method for realizing the enhanced imaging system of the present invention, the method by which the media signal processing device analyzes the CBCT image data is the step of obtaining the folder path where the CBCT image data is stored, the step of obtaining the DICOM sequence and sequence information, where the sequence information includes the sequence path, the number of slices, and each image, the step of selecting a sequence according to the sequence information, adding the sequence to the database, and then outputting the sequence path, the step of analyzing the basic information of the sequence, storing the analyzed basic information in a sequential volume data structure, and outputting the sequence body data information, and the data control thread receives the sequence body data information and controls the display and interactivity of the image. When displaying and interacting with images of four orthographic views, select a target tooth by interacting with the interface, divide the tooth by inputting the selected selection information into the tooth segmentation module, output the 3D image of the divided tooth to the data control thread, and the data control thread includes the step of continuously ensuring the display and interaction of the image.
[0033] In the method for realizing the enhanced imaging system of the present invention, after outputting the sequence path, analyze the sequence basic information, store and output the analyzed basic information based on the sequence slice information, and after the example management module receives the analyzed basic information, further include the step of adding the analyzed basic information to the database.
[0034] In the method for realizing the enhanced imaging system of the present invention, when displaying and interacting with images of four orthographic views, select an export path by interacting with the interface, input the selection information into the path control module for storage and path management, and the data control thread continuously ensures the display and interaction of the image.
[0035] In the method for realizing the enhanced imaging system of the present invention, by installing the image acquisition device, obtain the image information of the main optical path of the microscope body at any time, and transmit the image information to the media signal processing device. The media signal processing device selects a horizontal slice corresponding to the target tooth in the image information of the main optical path according to the image information obtained by the image acquisition device, and superimposes the horizontal slice on the image of the target tooth.
[0036] In the method for realizing an enhanced imaging system of the present invention, a positioning and navigation device is attached to a surgical instrument to collect the position information of the surgical instrument at any time and transmit it to the media signal processing device. The media signal processing device processes the image data of the target tooth to obtain an optimal route for processing the target tooth, and displays the position information of the surgical instrument and the relative position information between the surgical instrument and the optimal route in the information display area of the selected display device.
Advantages of the Invention
[0037] Compared with the prior art, the enhanced imaging system of the present invention and its realization method can achieve at least one or more of the following advantages of the invention. The enhanced imaging system of the present invention and its implementation method can superimpose the image information displayed on a display device, such as an LCD, OLED, DLP, etc., onto the observation field of a microscope by adopting a dichroic prism. Thereby, the user can observe the target object and process various data information related to the surgery while observing it. Compared with a projector, display devices such as LCD, OLED, DLP, etc. have the characteristics of small volume, high quality of the displayed image, and low energy consumption. When the input signal is an HDMI (registered trademark) signal, the connection between devices can be simplified, the miniaturization of the input device can be realized, and the space occupied by the input device can be reduced. The media signal processing device can be a computer that operates separately from the microscope, or a part of the microscope, or a portable terminal such as a touch-screen mobile phone or a tablet computer with a touch screen attached. The media signal processing device can preprocess multi-channel signals, such as a patient's medical history information, oral holographic scan images, CT, CBCT images or 3D modeling information, endometers, etc. to form a single-channel signal, and output and display it on the display device of the enhanced imaging device. By installing software in the media signal processing device, the input CBCT image data can be processed, the 3D model of the target tooth can be re-formed, and section processing can be performed on the 3D model. Also, by displaying important parts such as the root canal orifice and edge contour of the tooth in high brightness, when the slice image is superimposed on the eyepiece field area, high-quality superimposed information can be observed. By using other portable terminals such as a touch-screen mobile phone or a tablet computer with a touch screen attached as the media signal processing device, the user can easily adjust information data such as CBCT images and the 3D model of the target tooth.Compared with the conventional methods of controlling images with a computer, the present invention does not require arranging an assistant to operate the computer and can be operated with one hand by a person, thus avoiding the inconvenience of remote operation and greatly improving the efficiency of the operation. In addition, arranging a computer can increase the number of wires, and the large display panel of the computer can prevent occupying a large amount of space. Thereby, space can be saved, the movement of the cross arm of the microscope and the microscope support frame can be ensured, preventing the occupation of the user's operation space, and the microscope can be moved to an appropriate observation position. By further attaching a wireless charging module to the terminal support frame, the portable terminal can be wirelessly charged. Thereby, the portable terminal can be used for a long time and the problem of insufficient power of the portable terminal can be prevented. When the information display area of a display device such as LCD, OLED, DLP, etc. matches the eyepiece field of view area, by displaying the information data processed by the media signal processing device in the information display area, a complete image without being cut is superimposed on the eyepiece field of view area, preventing the problem that the superimposed information displayed at the edge of the field of view cannot be perfectly observed. By appropriately adjusting the quantity, size, position, direction, angle, etc. of the superimposed information superimposed on the eyepiece field of view area, it can adapt to various habits of the user. When adjusting the superimposed information superimposed on the eyepiece field of view area, the superimposed information can be directly adjusted by a handle, a mouse, a keyboard, etc. In other embodiments, the superimposed information can also be adjusted by biometric information such as the user's voice, hand gestures, facial expressions, eye movements, brain nerve electrical waves, lip shapes, etc. In that case, the convenience of operation can be improved by the user adjusting the superimposed information by non-contact operation. The area other than the area that needs to be displayed and superimposed with information on the display device is displayed in black. Thereby, when observing the binocular eyepiece lens barrel, not only the image of the main optical path of the microscope body but also the image displayed on the display device can be observed. In the example of treating the root canal, after calibrating the slice image of the dental CBCT and the image of the main optical path of the microscope body, they can be superimposed and displayed.By superimposing a dental pulp formation image with increased brightness on the actual tooth image, the doctor can determine the surgical position, significantly reduce the surgical difficulty, and improve the surgical accuracy. By attaching a positioning and navigation device, the position of the surgical instrument can be determined at any time, further improving the surgical accuracy.
Brief Description of the Drawings
[0038]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Figure 16
Figure 17
Figure 18
Figure 19
Figure 20
Figure 21
Figure 22a
Figure 22b
Figure 22c
Figure 22d
Figure 22e
Figure 22f
Figure 22g
Figure 23
Figure 24a
Figure 24b
Figure 24c
Figure 25a
Figure 25b
Figure 25c
Figure 25d
Figure 26a
Figure 26b
Figure 26c
Figure 27
Modes for Carrying Out the Invention
[0039] In order to more specifically explain the technical means and the effects of the invention for achieving the preset object of the present invention, the specific embodiments, structures, features, and effects of the present invention will be described in detail below with reference to the drawings and preferred embodiments.
[0040] <Example 1> An embodiment of the present invention provides an Enhanced imaging system. As shown in FIGS. 1 and 2, the enhanced imaging system includes a Media signal processing device 4, an enhanced imaging device 2, a microscope body 1, and a binocular eyepiece tube 3. The enhanced imaging device 2 includes a display device 21 and a superimposing lens assembly. The display device 21 is communicably connected to the media signal processing device 4. The superimposing lens assembly is attached to the main optical path of the microscope body 1. The binocular eyepiece tube 3 is attached to the microscope body 1. The display device 21 is arranged to receive information data transmitted by the media signal processing device 4 and convert the received information data into an optical image 61. The optical image 61 output by the display device 21 is superimposed on the main optical path of the microscope body 1 by the superimposing lens assembly to form a superimposed image, and the superimposed image can be observed through the binocular eyepiece tube 3. As shown in FIG. 3, a user, for example, a doctor, can observe the binocular eyepiece tube 3 to view an image of an examination surface located in the main optical path of the microscope body 1 and additional media information of the display device 21 superimposed on the main optical path. Thereby, the doctor can obtain more information, improve the efficiency of diagnosis or surgery, and reduce the surgery time.
[0041] The media signal processing device 4 can process various media signals. The media signals include, for example, the medical history information of a patient, a holographic scanning image of the oral cavity, CT, CBCT images or 3D modeling information, and multimedia signals that require input from devices such as an endometer. The multimedia signals can be input by a plurality of information input devices. The information input devices are communicably connected to the media signal processing device 4. The media signal processing device 4 can convert the information data input by the plurality of information input devices into one integrated information data and transmit and display the integrated information data on the display device 21. When the superimposed media signal is not a single channel signal, the media signal processing device 4 can preprocess a multi-channel signal. By processing the multi-channel signal, the media signal processing device can convert the media signal input from multiple channels into a single-channel video output signal. Also, by inputting a video signal to the display device 21 of the enhanced imaging device 2, real-time input of a multi-channel signal can be realized.
[0042] As shown in FIGS. 4 to 7, the enhanced imaging device 2 specifically includes a display device 21, a first lens group 22, a reflecting prism 23, an aperture 24, a second lens group 25, a blue light filter 26, and a first dichroic prism 27. The first dichroic prism 27 is the superimposed lens group. The display device 21, the first lens group 22, the reflecting prism 23, the aperture 24, the second lens group 25, the blue light filter 26, and the first dichroic prism 27 are all mounted in the case 20. The first lens group 22, the reflecting prism 23, and the second lens group 25 are mounted in the case 20 by a lens support portion 29. The display device 21, the first lens group 22, and the reflecting prism 23 are sequentially arranged on one optical path. Specifically, they are arranged on the horizontal optical path shown in FIG. 7. The reflecting prism 23 is preferably a right-angle prism. The reflecting prism 23, the second lens group 25, the blue light filter 26, and the first dichroic prism 27 are sequentially arranged on one optical path. Specifically, they are arranged on the vertical optical path shown in FIG. 7. The light emitted from the display device 21 passes through the first lens group 22 and then rotates 90 degrees by total reflection of the right-angle prism and enters the second lens group 25. The light passing through the second lens group 25 enters the first dichroic prism 27. In a specific embodiment, the first dichroic prism 27 is mounted in the main optical path of the microscope. The light emitted from the display device 21 enters the first dichroic prism 27 and forms an integrated optical image by overlapping with the main optical path of the microscope. The user can observe the superimposed image in which the display screen of the display device 21 is superimposed through the eyepiece of the microscope. A blue light filter 26 is mounted between the second lens group 25 and the first dichroic prism 27. The blue light filter 26 can reduce the damage to the user's eyes caused by blue light by filtering blue light with a wavelength of 420 to 480 nm.An aperture 24 is attached between the reflection prism 23 and the second lens group 25, so that the opening and closing of the optical path can be controlled. Thereby, the opening and closing of the display of the superimposed image can be controlled. Specifically, an aperture adjusting device 241 is attached in the case 20, and the aperture adjusting device 241 drives the aperture 24 to move between an off position and an open position. When the aperture 24 is located at the off position, the aperture 24, the reflection prism 23, and the second lens group 25 are located on one optical path, and the aperture 24 prevents the light passing through the reflection prism 23 from entering the second lens group 25. The adjusting method of the aperture 24 can be a horizontal movement adjusting method or a rotational movement adjusting method. Any adjusting method for moving the aperture 24 to the off position and the open position of the optical path belongs to the scope of the claims of the present invention.
[0043] The display device 21 can be an OLED display device, an LCD display device, a DLP display device, or other display devices or display panels. Display devices such as LCD, OLED, and DLP are smaller in volume than conventional small projectors, have high-quality display images, and are characterized by low energy consumption and less heat generation. When the input signal is an HDMI signal, it is possible to simplify the connection between devices, realize miniaturization of the input device, and reduce the space occupied by the input device. The shape of the eyepiece field region 5 observed through the binocular eyepiece lens barrel 3 is circular. The shapes of most of the display devices 21, for example, LCD display devices, are rectangular, and the aspect ratio of the display area of the LCD display device is 16:9 or 4:3. Thereby, as shown in FIG. 8, when the image region 6 that has passed through the optical lens is superimposed on the eyepiece field region 5, the image region 6 is cut by the eyepiece field region 5. To solve that problem, an information display area can be provided in the image region 6 of the display device 21. When the optical image 61 emitted by the display device 21 is superimposed on the main optical path, when the information display area matches the observation field of the binocular eyepiece lens barrel 3, the optical image 61 corresponding to the integrated information data converted by the media signal processing device 4 can be displayed in the information display area. Thereby, as shown in FIG. 9, the optical image 61 that is not cut can be superimposed on the eyepiece field region 5. When it is displayed at the edge portion, it cannot be observed with the eyepiece. In the optical image 61 emitted by the display device 21, the area other than the optical image 61 corresponding to the integrated information data is made black. When it is necessary to superimpose the main optical path of the surgical microscope body 1 and the optical path of the display device 21, the image that needs to be superimposed is displayed in the information display area, and the surrounding blank area is made black. When observing the optical path of the binocular eyepiece lens barrel 3, not only the image of the main optical path of the microscope body 1 but also the image displayed on the display device 21 can be observed. In the example of treating a root canal, after calibrating the slice image of the dental CBCT and the image of the main optical path of the microscope body 1, they can be superimposed and displayed.As shown in Fig. 10, by superimposing the dental pulp foramen image 63 with increased brightness on the actual tooth image 62, a doctor can easily determine the surgical position, reduce the surgical difficulty, and improve the surgical accuracy. Referring to Fig. 11, the drawing shows a superimposed screen of the actual dental pulp. What the arrow in the drawing points to is the dental pulp.
[0044] Each information data, that is, the media signal input from multiple channels, can be image, operable and marked 2D or 3D data, intuitive measurement data, for example, the dynamic information of the endometer, and can be displayed in the Windows (registered trademark) within the information display area. By easily editing the quantity, size, position, angle, etc. of the Windows, it can adapt to various habits of doctors. Specifically, they can be appropriately adjusted by the adjustment device. The adjustment device is communicably connected to the media signal processing device 4. As shown in FIG. 12, the adjustment device is arranged to input adjustment information to the media signal processing device 4, and the media signal processing device 4 controls the switch, size, position, angle, etc. of the image displayed in the information display area according to the information data input by each information input device based on the adjustment information input by the adjustment device, and displays each information data after control in the effective information display area. As shown in FIG. 1, the media signal processing device 4 can be a computer that operates with the microscope respectively. The media signal processing device 4 can also be a processing device integrally formed with the microscope. When controlling the size, position, etc. of the image displayed by each information data, by using the mouse and keyboard of an external computer as the adjustment device, the parameters such as the size and position of the image displayed by each information data can be controlled. When adopting a processing device integrally formed with the microscope, the switch, size, position, angle, etc. of the image displayed by each information data can be controlled by the microscope handle 7. As shown in FIG. 13, when the Function keys 76 are pressed for 3 seconds, the Windows editing state is displayed. After selecting the Windows that need to be edited by operating the Multi directional switch 73, the predetermined Windows can be selected by pressing the OK button 71. Next, by pressing the Function key 76, the size, position, angle, switch function, etc. of the Windows can be selected.For example, when the size of the window is selected, the size of the window can be increased by pressing the "+ key 74", and the size of the window can be decreased by pressing the "― key 75". Finally, the editing of the window size can be completed by pressing the OK button 71. When editing, the editing can be cancelled by pressing the escape key 72 or by recognizing the user's biometric information. A collection device is attached to collect the user's biometric information, and the collection device is communicably connected to the media signal processing device 4. The collection device is arranged to collect the user's biometric information at any time, and the media signal processing device 4 controls the switching, size, position, angle, etc. of the image displayed in the information display area according to the information data input by the biometric information control information input device. The biometric information can also be the user's voice, gesture, facial expression, eye movements, cranial nerve electric waves, lip shape, etc. In that case, the convenience of the operation can be improved by the user performing the operation by non-contact operation. As shown in FIG. 14, the specific process is as follows. First, the biometric information is collected. Next, it is determined whether the biometric information is valid biometric information. If the biometric information is valid biometric information, a predetermined implementation instruction is read and implemented based on the biometric information. If the biometric information is not valid biometric information, the process returns to the step of collecting the biometric information.
[0045] In an embodiment of the present invention, when superimposing the slice image of the target tooth CBCT and the actual target tooth image, the image information of the main optical path of the microscope body 1 can be obtained at any time by the attached image acquisition device. The image acquisition device is communicably connected to the media signal processing device 4. After the image acquisition device obtains the image information of the main optical path of the microscope body 1 at any time, it transmits the image information to the media signal processing device 4. The media signal processing device 4 selects a horizontal slice corresponding to the target tooth from the image information of the main optical path according to the image information collected by the image acquisition device, and superimposes the horizontal slice on the image of the target tooth. Thereby, the doctor can easily determine the surgical position and improve the accuracy of the surgery.
[0046] In an embodiment of the present invention, the information input device may include a positioning and navigation device (Positioning navigation device). The positioning and navigation device is attached to the surgical instrument (surgical instruments), and the surgical instrument may be, for example, a mobile phone (dental drill). The positioning and navigation device is communicably connected to the media signal processing device 4. By attaching the positioning and navigation device on the surgical instrument, the position information of the surgical instrument can be collected at any time and transmitted to the media signal processing device 4. The media signal processing device 4 obtains an optimal route for processing the target tooth by processing the image data of the target tooth, and can display the position information of the surgical instrument and the relative position information between the surgical instrument and the optimal route in the selected information display area of the display device 21. For example, the position information of the mobile phone (dental drill) can be displayed in the window in the information display area, or the position image information between the Path Point and the mobile phone (dental drill) can be displayed in the window in the information display area, so that the user can be informed that the mobile phone (dental drill) deviates from the Path Point.
[0047] In an embodiment of the present invention, the information input device includes an endometer 11, and the endometer 11 is communicably connected to the media signal processing device 4. After measuring the length information of the root canal of the target tooth, the endometer 11 transmits the length information to the media signal processing device 4. After processing the length information of the root canal of the target tooth, the media signal processing device 4 displays the length information of the root canal obtained by the endometer 11 in the information display area of the selected display device 21.
[0048] The case 20 includes a case body 202 and a back cover 203, and a power switch 205, a power outlet 204, etc. are attached to the back cover 203. The power outlet 204 and the power switch 205 are electrically connected to the display device 21 to supply power to the display device 21 and control the opening and closing of the display device 21.
[0049] In an embodiment of the present invention, a dichroic interface 201 is provided on one side of the case 20, and a second dichroic prism 28, that is, a spectroscopic lens group, is attached to one side of the case 20 close to the dichroic interface 201. As shown in FIG. 7, part of the light in the main optical path of the microscope or part of the light of the superimposed image in the microscope can be emitted from the dichroic interface 201 to the outside. By connecting a digital camera or a digital video camera, etc. to the dichroic interface 201, the image in the microscope can be recorded. Preferably, the spectroscopic ratio of the first dichroic prism 27 and the second dichroic prism 28 is 1:9.
[0050] As shown in FIG. 15, the method for realizing an enhanced imaging system includes the following steps. When inputting information data of a target object into the media signal processing device 4, the media signal processing device 4 analyzes and processes the input information data, and transmits the processed information data to the display device 21 of the enhanced imaging device 2. After receiving the information data, the display device 21 converts the information data into an optical image 61 and displays it. The optical image 61 displayed on the display device 21 enters the superimposing lens group of the main optical path of the microscope body 1 through the lens optical path, and the optical image 61 displayed on the display device 21 superimposes with the main optical path of the microscope body 1 to form a superimposed image, and the superimposed image enters the binocular eyepiece lens barrel 3.
[0051] The information data can be, for example, the CBCT image data (DICOM) of a patient. When inputting the CBCT image data into the media signal processing device 4, the media signal processing device 4 obtains a 3D image of the target oral cavity by analyzing the CBCT image data. Four orthographic views are formed by displaying important information in the 3D image of the target oral cavity in high brightness, and it can be displayed in the information display area of the selected display device 21. When selecting a target tooth on any one of the four orthographic views, the media signal processing device 4 forms a 3D image and a horizontal slice of the selected target tooth, and forms and manages a display sequence (View sequence) of the horizontal slice. In that case, by interacting with the management interface, the display sequence of the horizontal slice can be displayed in the information display area of the selected display device 21.
[0052] The information data further includes additional information data, such as endometer data, etc. When inputting the additional information data into the media signal processing device 4, the media signal processing device 4 processes the additional information data and then displays the processed additional information data in the information display area of the display device 21.
[0053] When the media signal processing device 4 transmits information data to the display device 21, all the information data is integrated into one integrated information data by the media signal, and the integrated information data is transmitted to the display device 21 for display. The switch, size, position, and angle of a predetermined image displayed on the display device 21 can be adjusted by each information data. Finally, a superimposed image is output.
[0054] As shown in FIG. 16, the method by which the media signal processing device 4 analyzes the CBCT image data includes the following steps. Obtain the folder path in which the CBCT image data is stored, and obtain the DICOM sequence and sequence information. The sequence information includes a sequence path, the number of slices, and each image. After selecting a sequence based on the sequence information and adding the sequence to the database, output the sequence path. Analyze the basic sequence information, store the analyzed basic information in a sequential volume data structure, and output the sequence body data information. The data control thread receives the sequence body data information and controls the display and interactivity of the images. When displaying and interacting with the images of the four orthographic views, the target tooth can be selected by interacting with the interface. By inputting the selected selection information into the tooth segmentation module, the tooth is segmented, and the 3D image of the segmented tooth is output to the data control thread, and the data control thread continuously ensures the display and interactivity of the images.
[0055] After outputting the sequence path, further include the step of analyzing the basic sequence information, storing and outputting the analyzed basic information based on the sequence slice information, and after the example management module receives the analyzed basic information, adding the analyzed basic information to the database.
[0056] When displaying and interacting with the images of the four orthographic views, an export path is selected interactively with the interface, and the selection information is input to and stored in the path control module to manage the path. The data control thread continuously ensures the display and interaction of the images.
[0057] By attaching an image acquisition device, the image information of the main optical path of the microscope body 1 can be obtained at any time and transmitted to the media signal processing device 4. The media signal processing device 4 selects a horizontal slice corresponding to the target tooth in the image information of the main optical path based on the image information acquired by the image acquisition device, and superimposes the horizontal slice on the image of the target tooth.
[0058] By attaching a positioning and navigation device on the surgical instrument, the position information of the surgical instrument can be collected at any time and transmitted to the media signal processing device 4. The media signal processing device 4 obtains an optimal path for processing the target tooth by processing the image data of the target tooth, and can display the position information of the surgical instrument and the relative position information between the surgical instrument and the optimal path in the information display area of the selected display device 21.
[0059] <Example 2> The difference between Example 1 and Example 2 lies in that the media signal processing device 4 in Example 2 is a portable terminal. The media signal processing device 4 is preferably a touch screen mobile phone or a tablet computer with a touch screen attached. By touching the button displayed on the touch screen, it is possible to control the switch, size, position, angle, etc. of a predetermined image corresponding to each information data and displayed on the display device 21. As shown in FIGS. 17 and 18, one example of the arrangement method of the media signal processing device 4 is shown in the drawings. That is, an example is shown in which one optical adapter 8 is connected to the dichroic interface 201. The media signal processing device 4 is mounted on the optical adapter 8 so as to be located on one side of the enhanced imaging device 2 by the terminal support frame 9. For the specific structure and operating principle of the optical adapter 8 and the connection method between the terminal support frame 9 and the optical adapter 8, reference can be made to the Chinese utility model with the application number filed earlier by the applicant and the publication number CN207253386U or the Chinese patent with the publication number CN110651214B, so it will not be described again here. As shown in FIGS. 19 to 21, the media signal processing device 4 can be arranged at a position close to the user or a position away from the user according to the above structure. FIGS. 19 and 20 show the user operating the surgical microscope of the microscope support frame 10. By adopting the media signal processing device 4 as a portable terminal, the user can easily operate the media signal processing device 4. In addition, there is no need to arrange an assistant to operate the computer, and one person can operate it with one hand, so the inconvenience caused by remote operation can be avoided, and the efficiency of the operation can be greatly improved. FIG. 21 is a schematic diagram showing the user measuring the root canal of a patient's tooth. When the media signal processing device 4 is adopted as a portable terminal and the user measures the root canal of a patient's tooth with the endometer 11, the data parameter information of the endometer 11 can be easily observed by the media signal processing device 4.Specifically, Endometer software is installed in the media signal processing device 4. As shown in FIGS. 22a to 22g, when the media signal processing device 4 and the Endometer 11 are wirelessly connected by Bluetooth (registered trademark) or the like, by operating the Endometer software in the media signal processing device 4, information such as the torque, rotation speed, and treatment record of the Endometer 11 can be read and displayed, and the torque and rotation speed of the Endometer 11 can be adjusted.
[0060] The media signal processing device 4 can be disposed at a position close to or away from the user by the terminal support frame 9. For example, the terminal support frame 9 can be directly fixed on the microscope body 1 or the like.
[0061] The media signal processing device 4 and the display device 21 can be connected by wired connection means or can be connected by wireless connection means, for example, Bluetooth. By being connected by wired connection means or wireless connection means and adopting the media signal processing device 4 as a portable terminal, it is possible to prevent the number of computer wires from increasing and the large computer display panel from occupying a large amount of space. Thereby, space can be saved and the movement of the cross arm of the microscope main body 1 and the microscope support frame 10 can be ensured. The media signal processing device 4 can also be used as a collecting device. Since other portable terminals such as touch screen mobile phones and tablet computers are usually equipped with a normal camera, the image taken by the microscope can be obtained by collecting the light emitted by the dichroic interface 201 with the camera of the portable terminal. As shown in FIG. 23, before the user performs the operation, the image observed with the microscope main body 1 can be photographed and stored, and the image photographed previously can be read out by the media signal processing device 4 during or after the operation. Next, since software is installed in the media signal processing device 4, image information data can be transmitted to the display device 21 for display and a superimposed image can be formed. Finally, by observing through the eyepiece, the user can easily compare and analyze the images before, during, and after the operation.
[0062] As shown in FIGS. 24a to 24c and FIGS. 25a to 25d, since 3D model software is installed in the media signal processing device 4, when inputting 3D model data information of a target tooth into the media signal processing device 4, the 3D model data information of the target tooth can be processed, and a 3D model of the target tooth can be displayed on the touch screen of the media signal processing device 4. By touching the touch screen, the angle, size, transparency, etc. of the 3D model can be easily controlled. Since the selected item is displayed in the information display area of the display device 21, the user can easily adjust the 3D model image superimposed on the main optical path of the microscope body 1 and can easily observe the dental pulp cavity.
[0063] When CBCT image software is further installed in the media signal processing device 4, the CBCT image data can be processed when the CBCT image data is input into the media signal processing device 4. As shown in FIGS. 26a to 26c, a CBCT image can be displayed on the touch screen of the media signal processing device 4, and information regarding position, time, image size, scale, etc. can be further displayed on the display interface. The user can control the angle, size, transparency, etc. of the CBCT image by touching the touch screen. Thereby, the user can easily adjust the CBCT image superimposed on the main optical path of the microscope body 1.
[0064] In other embodiments, a wireless charging module responsible for charging a portable terminal can be further attached to the terminal support frame 9. The wireless charging module can supply power to the microscope by being connected to the power source of the microscope. When selecting the media signal processing device 4, a wireless charging type terminal such as a touch screen mobile phone or a tablet computer capable of wireless charging can be selected. By charging the portable terminal with the wireless charging module, it is possible to prevent the power of the portable terminal from being insufficient when the portable terminal is used for a long time.
[0065] As shown in FIG. 27, the method for realizing the enhanced imaging system of this embodiment includes the following steps. Input information data of the target object into the media signal processing device 4. The media signal processing device 4 can be a touch screen mobile phone (iPhone (registered trademark) or Android mobile phone) or other portable terminals such as a tablet computer. The information data can be CBCT image data, position information data of the surgical instrument collected by the navigation device, real-time data of the endometer 11 or the surgical instrument, 3D model data of the target tooth, and other media signals. The media signal processing device 4 analyzes and processes the input information data, and transmits the processed information data to the display device 21 of the enhanced imaging device 2. After receiving the information data, the display device 21 converts the information data into an optical image 61 and displays it. The optical image 61 displayed on the display device 21 enters the superimposing lens group of the main optical path of the microscope body 1 through the lens optical path, and the optical image 61 displayed on the display device 21 enters the binocular eyepiece lens barrel 3 after overlapping with the main optical path of the microscope body 1.
[0066] Compared with the prior art, the enhanced imaging system and its realization method of the present invention can achieve at least one or more of the following inventive effects. The enhanced imaging system of the present invention and its implementation method can superimpose the image information displayed on a display device, such as an LCD, OLED, DLP, etc., onto the observation field of view of a microscope by adopting a dichroic prism. Thereby, the user can observe the target object and observe and process various data information related to the surgery. Compared with a projector, display devices such as LCD, OLED, DLP, etc. have the characteristics of small volume, high quality of the displayed image, and low energy consumption. When the input signal is an HDMI (registered trademark) signal, the connection between devices can be simplified, the miniaturization of the input device can be realized, and the space occupied by the input device can be reduced. The media signal processing device can be a computer that operates separately from the microscope, or a part of the microscope, or a portable terminal such as a touch-screen mobile phone or a tablet computer with a touch screen attached. The media signal processing device can preprocess multi-channel signals, such as the patient's medical history information, oral holographic scan images, CT, CBCT images or 3D modeling information, endometers, etc. to form a single-channel signal, and output and display it on the display device of the enhanced imaging device 2. By installing software in the media signal processing device, the input CBCT image data can be processed, the 3D model of the target tooth can be re-formed, and section processing can be performed on the 3D model. In addition, by displaying important parts such as the root canal orifice and edge contour of the tooth in high brightness, when the slice image is superimposed on the eyepiece field of view area, high-quality superimposed information can be observed. By using other portable terminals such as a touch-screen mobile phone or a tablet computer with a touch screen attached as the media signal processing device, the user can easily adjust information data such as CBCT images and the 3D model of the target tooth.Compared with the conventional methods of controlling images with a computer, the present invention does not require arranging an assistant to operate the computer and can be operated with one hand by a person, thus avoiding the inconvenience of remote operation and significantly improving the efficiency of surgery. In addition, by arranging a computer, the number of electric wires can be increased, and since the display panel of the computer is large, it is possible to prevent occupying a large amount of space. Thereby, space can be saved, the movement of the cross arm of the microscope and the microscope support frame can be ensured, preventing the occupation of the user's operation space, and the microscope can be moved to an appropriate observation position. By further attaching a wireless charging module to the terminal support frame, the wireless charging type terminal can be charged. Thereby, the portable terminal can be used for a long time, and it is possible to prevent the power of the portable terminal from being insufficient. When the information display area of a display device such as LCD, OLED, DLP, etc. matches the eyepiece field area, by displaying the information data processed by the media signal processing device in the information display area, a complete image that is not cut can be superimposed on the eyepiece field area, preventing the problem that the superimposed information displayed at the edge of the field of view cannot be perfectly observed. By appropriately adjusting the quantity, size, position, direction, angle, etc. of the superimposed information superimposed on the eyepiece field area, it is possible to adapt to various habits of the user. When adjusting the superimposed information superimposed on the eyepiece field area, the superimposed information can be directly adjusted by a handle, a mouse, a keyboard, etc. In other embodiments, the superimposed information can also be adjusted by biometric information such as the user's voice, hand gestures, facial expressions, eye movements, brain nerve electrical waves, lip shapes, etc. In that case, the convenience of operation can be improved by the user adjusting the superimposed information by a contactless operation. The area other than the area that needs to be displayed on the display device and superimposed with information is displayed in black. Thereby, when observing the binocular eyepiece lens barrel, not only the image of the main optical path of the microscope body but also the image displayed on the display device can be observed. In the example of treating a root canal, after calibrating the slice image of the dental CBCT and the image of the main optical path of the microscope body, they can be superimposed and displayed.By superimposing the pulp formation image with increased brightness on the actual tooth image, the doctor can determine the surgical position, significantly reduce the difficulty of the surgery, and improve the accuracy of the surgery. By attaching the positioning and navigation device, the position of the surgical instrument can be determined at any time, further improving the accuracy of the surgery.
[0067] It should be noted that terms such as "including" and "comprising" in this specification are open-ended terms. That is, an item including a series of elements can further include not only the explicitly described elements but also other elements not described.
[0068] In this specification, directional terms such as front, rear, top, and bottom define the position of the parts in the drawing and the position of the parts relative to other parts, and are used to explain the technical matters of the present invention in detail. It should be noted that there is no intention to limit the present invention by using directional terms in this specification.
[0069] If there is no contradiction, the embodiments of the present invention or the features in the embodiments can be easily combined.
[0070] As described above, the preferred embodiments of the present invention have been described. However, since the above embodiments are only examples of the present invention, the present invention is not limited only to the above embodiments. Any changes, substitutions, and improvements can be made without departing from the gist of the present invention, and of course, these are also included in the present invention.
Description of Reference Numerals
[0071] 1 Microscope body 2 Enhanced imaging device 20 Case 201 Dichroic interface 202 Case body 203 Back cover 204 Power outlet 205 Power switch 21 Display device 22 First lens group 23 Reflective prism 24 Aperture 241 Aperture adjustment device 25 Second lens group 26 Blue light filter 27 First dichroic prism 28 Second dichroic prism 29 Lens support part 3 Binocular eyepiece lens barrel 4 Media signal processing device 5 Eyepiece lens field of view area 6 Image area 61 Optical image 62 Tooth image 63 Pulp foramen image 7 Microscope handle 71 Confirm button 72 Escape key 73 Multi-directional switch 74 + key 75 - key 76 Function key 8 Optical adapter 9 Terminal support frame 10 Microscope support frame 11 Endometer
Claims
1. A media signal processing device (4), an enhanced imaging device (2), a microscope body (1) and a binocular eyepiece lens barrel (3), wherein the enhanced imaging device (2) includes a case (20), a display device (21) and a superimposing lens group (27), both the display device (21) and the superimposing lens group (27) are mounted in the case (20), the display device (21) is communicably connected to the media signal processing device (4), the superimposing lens group (27) is mounted on the main optical path of the microscope body (1), the binocular eyepiece lens barrel (3) is mounted on the microscope body (1), the display device (21) is arranged to receive information data transmitted by the media signal processing device (4) and convert the received information data into an optical image, and the optical image output by the display device (21) is superimposed on the main optical path of the microscope body (1) by the superimposing lens group (27) to form a superimposed image, and the superimposed image can be observed through the binocular eyepiece lens barrel (3). The enhanced imaging device (2) further includes a spectroscopic lens group (28), the spectroscopic lens group (28) is mounted in the case (20), a dichroic interface (201) is provided on one side of the case (20), and the spectroscopic lens group (28) is characterized in that part of the light of the main optical path of the microscope body (1) or part of the light of the superimposed image exits to the outside from the dichroic interface (201). An enhanced imaging system.
2. The enhanced imaging system includes a plurality of information input devices, the information input devices are communicably connected to the media signal processing device (4), and the media signal processing device (4) converts information data input by the plurality of information input devices into one integrated information data and transmits the integrated information data to the display device (21). The enhanced imaging system according to claim 1.
3. The display device (21) includes an information display area, and when the information display area coincides with the observation field of the binocular eyepiece lens barrel (3), an optical image corresponding to the integrated information data converted by the media signal processing device (4) is displayed in the information display area. The enhanced imaging system according to claim 2, wherein the display device (21) is an OLED display device, an LCD display device, or a DLP display device.
4. The enhanced imaging system according to claim 3, wherein an area other than the optical image corresponding to the integrated information data in the optical image emitted by the display device (21) is made black.
5. The enhanced imaging system further includes an adjustment device, the adjustment device is communicably connected to the media signal processing device (4), the adjustment device is arranged to input adjustment information to the media signal processing device (4), and the media signal processing device (4) controls the switch, size, position, and angle of the image displayed in the information display area according to the information data input by the information input device according to the adjustment information. The enhanced imaging system according to claim 3.
6. The enhanced imaging system further includes a collection device, the collection device is communicably connected to the media signal processing device (4), the collection device is arranged to collect the user's biometric information at any time, and the media signal processing device (4) controls the switch, size, position, and angle of the image displayed in the information display area according to the information data input by the biometric information control information input device. The enhanced imaging system according to claim 3.
7. The enhanced imaging system according to claim 1, further including an image collection device, the image collection device is communicably connected to the media signal processing device (4), and the image collection device acquires the image information of the main optical path of the microscope body (1) at any time and then transmits it to the media signal processing device (4).
8. The information input device includes a positioning and navigation device, the positioning and navigation device is attached to the surgical instrument, the positioning and navigation device is communicably connected to the media signal processing device (4), and the positioning and navigation device attached to the surgical instrument collects the position information of the surgical instrument at any time and transmits it to the media signal processing device (4). The enhanced imaging system according to claim 2.
9. The information input device includes an endometer (11), the endometer (11) is communicably connected to the media signal processing device (4), and after measuring the length information of the root canal of the target tooth, the endometer (11) transmits the length information to the media signal processing device (4). The enhanced imaging system according to claim 2, characterized in that.
10. The enhanced imaging system according to claim 1, characterized in that the media signal processing device (4) is a portable terminal.
11. The media signal processing device (4) is a portable terminal with a touch screen attached thereto, and by touching the touch screen, the switch, size, position or angle of a predetermined image corresponding to each information data and displayed on the display device (21) is controlled. The enhanced imaging system according to claim 10, characterized in that.
12. The enhanced imaging system further includes a terminal support frame (9), and the media signal processing device (4) is attached to one side of the enhanced imaging device (2) or one side of the microscope body (1) by the terminal support frame (9). The enhanced imaging system according to claim 10, characterized in that.
13. The enhanced imaging system according to claim 12, characterized in that a wireless charging module responsible for charging the portable terminal is attached on the terminal support frame (9).
14. The enhanced imaging system according to claim 1, characterized in that the media signal processing device (4) is arranged to collect the light emitted by the dichroic interface (201).
15. The media signal processing device (4) is arranged to display a 3D model, and the angle of the 3D model can be adjusted, or the size of the 3D model can be adjusted, or the transparency of the 3D model can be adjusted. The enhanced imaging system according to claim 11, characterized in that.
16. The media signal processing device (4) is arranged to display a CBCT image, and the angle of the CBCT image can be adjusted, or the size of the CBCT image can be adjusted, or the transparency of the CBCT image can be adjusted. The enhanced imaging system according to claim 11, characterized in that. A method for implementing an enhanced imaging system using the enhanced imaging system according to claim 1, comprising: inputting information data of a target object into a media signal processing device (4); the media signal processing device (4) analyzes and processes the input information data, and transmits the processed information data to a display device (21) of the enhanced imaging device (2); after receiving the information data, the display device (21) converts the information data into an optical image and displays it; the optical image displayed on the display device (21) enters a superimposing lens unit (27) of the main optical path of the microscope body (1) through a lens optical path, and the optical image displayed on the display device (21) superimposes with the main optical path of the microscope body (1) to form a superimposed image, and the superimposed image enters a binocular eyepiece lens barrel (3). A method for implementing an enhanced imaging system, characterized by including the steps.
18. The information data includes CBCT image data. When inputting the CBCT image data into the media signal processing device (4), the media signal processing device (4) obtains a 3D image of the target oral cavity by analyzing the CBCT image data, and forms four orthographic views by displaying important information in the 3D image of the target oral cavity in high brightness, and displays it in the information display area of the selected display device (21). When selecting a target tooth on any one of the four orthographic views, the media signal processing device (4) forms a 3D image and a lateral slice of the selected target tooth, and displays it in the information display area of the selected display device (21). A method for implementing an enhanced imaging system according to claim 17, characterized in that.
19. The information data includes 3D model data information of a target tooth. When inputting the 3D model data information of the target tooth into the media signal processing device (4), the media signal processing device (4) processes the 3D model data information and then displays it in the information display area of the selected display device (21). A method for implementing an enhanced imaging system according to claim 17, characterized in that.
20. The information data further includes additional information data. When the additional information data is input into the media signal processing device (4), after processing the additional information data, the media signal processing device (4) displays it in the information display area of the display device (21). A method for realizing an enhanced imaging system according to claim 17, characterized in that.
21. When the media signal processing device (4) transmits information data to the display device (21), the media signal processing device (4) integrates all the information data into one integrated information data, and transmits and displays the integrated information data to the display device (21), and adjusts the switch, size, position, and angle of a predetermined image displayed on the display device (21) according to each information data. A method for realizing an enhanced imaging system according to any one of claims 18 to 20, characterized in that.
22. The media signal processing device (4) analyzing the CBCT image data includes: Obtaining the folder path where the CBCT image data is stored; Obtaining DICOM sequences and sequence information, where the sequence information includes a sequence path, the number of slices, and each image; Selecting a sequence according to the sequence information, adding the sequence to a database, and then outputting the sequence path; Analyzing the basic information of the sequence, storing the analyzed basic information in a sequential volume data structure, and outputting the sequence body data information. The data control thread receives the sequence body data information and controls the display and interactivity of the image; When displaying and interacting with the images of the four orthographic views, selecting a target tooth by interacting with the interface, inputting the selected selection information into the tooth segmentation module to segment the tooth, and outputting the 3D image of the segmented tooth to the data control thread. The data control thread continuously ensures the display and interactivity of the image. A method for realizing an enhanced imaging system according to claim 18, characterized by including.
23. After outputting the sequence path, analyzing the sequence basic information, and storing and outputting the analyzed basic information based on the sequence slice information, the example management module further includes the step of adding the analyzed basic information to the database after receiving the analyzed basic information. A method for realizing an enhanced imaging system according to claim 22, characterized in that.
24. When displaying and interacting with the images of the four orthographic views, select an export path through interaction with the interface, input the selection information into the path control module for storage and path management, and the data control thread continuously ensures the display and interaction of the images. A method for realizing an enhanced imaging system according to claim 22, characterized in that.
25. By attaching the image acquisition device, the image information of the main optical path of the microscope body (1) is acquired at any time, and the image information is transmitted to the media signal processing device (4). The media signal processing device (4) selects a horizontal slice corresponding to the target tooth in the image information of the main optical path according to the image information acquired by the image acquisition device, and superimposes the horizontal slice on the image of the target tooth. A method for realizing an enhanced imaging system according to claim 18, characterized in that.
26. By attaching a positioning and navigation device on the surgical instrument, the position information of the surgical instrument is collected at any time and transmitted to the media signal processing device (4). The media signal processing device (4) obtains an optimal route for processing the target tooth by processing the image data of the target tooth, and displays the position information of the surgical instrument and the relative position information between the surgical instrument and the optimal route in the information display area of the selected display device (21). A method for realizing an enhanced imaging system according to claim 18, characterized in that.
Citation Information
Patent Citations
Medical treatment device
JP2013190766A
Medical treatment device
JP2013231772A
Operation microscope
US20010055062A1