Oral cavity three-dimensional imaging system

Abstract

The invention provides an oral cavity three-dimensional imaging system. The oral cavity three-dimensional imaging system comprises a base station, scanning equipment, an upper computer and intelligent glasses, wherein the scanning device, the upper computer and the intelligent glasses are connected to the base station, and the base station performs data transmission with the scanning device, the upper computer and the intelligent glasses based on a millimeter wave communication channel; the scanning equipment is used for collecting oral cavity data of a first object and transmitting the oral cavity data to the upper computer; the upper computer performs three-dimensional image reconstruction based on the oral cavity data to obtain an oral cavity three-dimensional image, and transmits the oral cavity three-dimensional image to the intelligent glasses based on the base station; the intelligent glasses are worn by the second object and display the oral cavity three-dimensional image to the second object, so that the speed and stability of data transmission are improved, the detection time is shortened, and the detection efficiency and the user experience are improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of oral cavity, and in particular to an oral cavity three-dimensional imaging system. BACKGROUND

[0002] In the field of oral cavity repair, the application of oral cavity three-dimensional imaging has important scientific significance and clinical value.

[0003] In the prior art, a traditional oral cavity three-dimensional imaging instrument includes a scanning handle, smart glasses and a host computer. The scanning handle is used to acquire images of the inside of a patient's oral cavity and transmit the images to the host computer. The host computer receives the images sent by the scanning handle, processes the images and generates three-dimensional image information, and transmits the three-dimensional image information to a display device, which can be a display screen, a computer or other electronic device with display function. The operator's operation is not convenient, and the operator needs to observe the three-dimensional image information displayed on the display device in real time while operating the scanning device, which causes the problem of not being able to look and operate at the same time, resulting in the need to constantly adjust the position and angle of the scanning device, and the processing time is prolonged

[0004] The scanning handle, the host computer and the display device can be connected by wire or wirelessly. When the scanning handle, the host computer and the display device are connected by wire, the operation is not convenient. When the scanning handle, the host computer and the display device are connected wirelessly, the long transmission delay and poor communication stability of the wireless connection method cause the problem of stuttering and frame loss of the oral cavity three-dimensional image, which requires multiple repeated scanning, increases the detection time and reduces the detection efficiency. SUMMARY

[0005] The present application provides an oral cavity three-dimensional imaging system to solve the problem of slow data transmission speed and poor stability in the prior art.

[0006] According to one aspect of the present application, an oral cavity three-dimensional imaging system is provided, which includes a base station, a scanning device, a host computer and smart glasses. The scanning device, the host computer and the smart glasses are connected to the base station, and the base station transmits data to the scanning device, the host computer and the smart glasses based on a millimeter wave communication channel.

[0007] The scanning device is used to collect oral cavity data of a first object and transmit the oral cavity data to the host computer.

[0008] The host computer reconstructs a three-dimensional image based on the oral cavity data and transmits the three-dimensional image to the smart glasses based on the base station.

[0009] The smart glasses are worn by a second object and display the three-dimensional image of the oral cavity to the second object.

[0010] The technical solution of the embodiment of the present invention provides an oral three-dimensional imaging system, which is provided by setting up a base station, a scanning device, a host computer and smart glasses; wherein the scanning device, the host computer and the smart glasses are connected to the base station, and the base station transmits data with the scanning device, the host computer and the smart glasses based on a millimeter wave communication channel; the scanning device is used to collect oral data of a first object, transmit the oral data to the host computer, and perform subsequent analysis and processing based on the oral data; the host computer reconstructs a three-dimensional image based on the oral data to obtain a three-dimensional image of the oral cavity, and transmits the three-dimensional image of the oral cavity to the smart glasses based on the base station, thereby realizing accurate reconstruction of the three-dimensional image of the oral cavity; the smart glasses are worn by a second object to display the three-dimensional image of the oral cavity to the second object, thereby solving the problems of slow data transmission speed and poor stability in the prior art, improving the speed and stability of data transmission, shortening the detection time, and improving the detection efficiency and user experience.

[0011] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present invention, nor is it intended to limit the scope of the present invention. Other features of the present invention will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0013] Figure 1 It is a structural schematic diagram of a traditional oral three-dimensional imaging system provided by the present invention;

[0014] Figure 2 1 is a schematic structural diagram of an oral three-dimensional imaging system provided in Example 1 of the present invention;

[0015] Figure 3 This is a schematic diagram of an installation of a base station and a terminal device using a ceiling installation method provided by an embodiment of the present invention;

[0016] Figure 4 This is a schematic diagram of the installation of a base station and a terminal device in a wall-mounted manner provided by an embodiment of the present invention;

[0017] Figure 6 1 is a schematic structural diagram of smart glasses provided by an embodiment of the present invention;

[0018] Figure 5 Schematic diagram of light path propagation of smart glasses provided by an embodiment of the present invention;

[0019] Figure 7Schematic diagram of the structure of an oral three-dimensional imaging system provided by the second embodiment of the present invention;

[0020] Figure 8 This is a schematic structural diagram of an oral three-dimensional imaging system provided by Embodiment 3 of the present invention;

[0021] Figure 9 This is a schematic diagram of the principle of an oral three-dimensional imaging system provided by an embodiment of the present invention;

[0022] Figure 10 It is a schematic diagram of an oral three-dimensional imaging method corresponding to an oral three-dimensional imaging system provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0023] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the embodiments described are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of the present invention.

[0024] It should be noted that the terms "first", "second", etc. in the description and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that the numbers used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0025] In the prior art, a traditional oral 3D imaging system uses a scanner or other scanning device to scan the oral cavity to obtain oral data, and transmits the scanned oral data to a host computer. The host computer receives the oral data and has a 3D image reconstruction algorithm pre-stored in the host computer. The host computer reconstructs the received oral data in 3D according to the 3D image reconstruction algorithm to obtain an oral 3D image. The host computer transmits the oral 3D image to a display device, which may include a server, a computer, and a mobile terminal. The display device receives the oral 3D image and converts the oral 3D image into an optical signal for display, thereby realizing the reconstruction of the oral 3D image. For example, see Figure 1 , Figure 1The figure is a schematic structural diagram of a conventional oral 3D imaging system provided by the present invention, wherein the scanning device is a scanning handle.

[0026] In the process of constructing oral three-dimensional images using a traditional oral three-dimensional imaging system, when the scanning device and the host computer, and the host computer and the display device are connected by wired connections, there is a problem of inconvenient operation. When the scanning device and the host computer, and the host computer and the display device are connected by wireless, due to the long transmission delay and poor communication stability of the wireless connection method, the oral three-dimensional image has problems of freezing and frame loss, and multiple repeated scans are required, which increases the detection time and reduces the detection efficiency. In order to solve the above problems, the present invention adds a base station on the basis of the existing oral three-dimensional imaging system. The base station realizes communication between the scanning device and the host computer, and between the host computer and the smart glasses through millimeter wave communication, thereby realizing the reconstruction of the oral three-dimensional image.

[0027] Example 1

[0028] Figure 2 This is a schematic diagram of the structure of an oral three-dimensional imaging system provided by the first embodiment of the present invention. This embodiment is applicable to the case of three-dimensional reconstruction of oral data. Figure 2 As shown, the oral 3D imaging system includes: a base station 110, a scanning device 120, a host computer 130 and smart glasses 140; wherein the scanning device 120, the host computer 130 and the smart glasses 140 are connected to the base station 110, and the base station 110 transmits data with the scanning device 120, the host computer 130 and the smart glasses 140 respectively based on the millimeter wave communication channel; the scanning device 120 is used to collect oral data of a first subject and transmit the oral data to the host computer 130; the host computer 130 performs 3D image reconstruction based on the oral data to obtain a 3D oral image, and transmits the 3D oral image to the smart glasses 140 based on the base station 110; the smart glasses 140 are worn by the second subject to display the 3D oral image to the second subject.

[0029] Among them, the base station 110 and the scanning device 120 are connected via millimeter wave communication, which can realize data transmission between the base station 110 and the scanning device 120. In the oral three-dimensional imaging system, the base station 110 is used for the access and management of terminal devices, and the terminal devices include but are not limited to the scanning device 120, the host computer 130 and the smart glasses 140. Optionally, the base station 110 can be installed in a ceiling-mounted installation method or a wall-mounted installation method, which can be selected according to needs and is not limited here. In order to ensure the occupied space of the base station 110, as well as the stability and speed of data transmission between the base station 110 and the terminal device, the installation height of the base station 110 can be set.

[0030] Optionally, the installation height of the base station 110 is greater than or equal to 2 meters and less than or equal to 3 meters. For example, when the base station 110 is installed in a ceiling-mounted installation manner, the installation height of the base station 110 is greater than or equal to 2 meters and less than or equal to 3 meters, and the coverage range of the base station 110 is a circle with the base station 110 as the center and a radius of a preset distance, and the preset distance can be set according to the parameters of the base station 110. For another example, when the base station 110 is installed in a wall-mounted installation manner, the installation height of the base station 110 is greater than or equal to 2 meters and less than or equal to 3 meters, and the coverage range of the base station 110 can be a rectangular area, and the length and width of the rectangular area can be set according to the parameters of the base station 110. The base station 110 is connected to the terminal device through millimeter wave communication, which improves the speed and stability of data transmission.

[0031] For example, see Figure 3 and Figure 4 . Figure 3 This diagram illustrates the installation of a ceiling-mounted base station and terminal devices, as provided in an embodiment of the present invention. The AP side represents the base station, and the STA side represents the terminal devices, which include but are not limited to scanners, host computers, and smart glasses. The base station is installed at a height of 2.5 meters. The base station's coverage area is a circle with a radius of 10 meters centered on the base station. All terminal devices are within the base station's coverage area. Figure 4 This diagram illustrates the installation of a wall-mounted base station and terminal devices, as provided in an embodiment of the present invention. The AP side represents the base station, and the STA side represents the terminal device side. Terminal devices include but are not limited to scanners, host computers, and smart glasses. The base station is set at a height of 2 meters. The base station's coverage area is a rectangular area 20 meters long and 10 meters wide. All terminal devices are within the base station's coverage area.

[0032] In some embodiments of the present invention, the process of a terminal device accessing the base station 110 includes a device discovery phase, an access authentication phase, a beam alignment phase, and a data communication phase. In the device discovery phase, the base station 110 sends periodically broadcast beacon frames, which include information such as frequency band, power, and beam direction; the terminal device scans different channels, detects the direction of the strongest millimeter wave signal through beam scanning, and establishes an initial link. In the access authentication phase, the terminal device sends an association request to the base station 110, which includes the device identity information of the terminal device. The base station 110 verifies the device identity information of the terminal device according to the association request. When the base station 110 successfully verifies the device identity information, the base station 110 allocates and transmits a unique identifier to the terminal device. In the beam alignment phase, in order to ensure the stability of data transmission between the base station 110 and the terminal device, the base station 110 and the terminal device use a hierarchical beam search method to achieve beam alignment. Base station 110 transmits a wide-beam signal and periodically scans different directions. The terminal device receives the wide-beam signal, detects signal strength in each direction, and records the direction of the strongest signal. This allows for coarse alignment of the beams between base station 110 and the terminal device. A wide beam can quickly narrow the range of directions and reduce scanning time. The terminal device then feeds back the coarse alignment results to base station 110. Based on the coarse alignment results, base station 110 transmits a narrow-beam signal in the direction of the strongest signal. The terminal device receives the narrow-beam signal and calculates the optimal beam angle based on reciprocity measurements, achieving fine alignment of the beams between base station 110 and the terminal device. Fine scanning with a narrow beam improves alignment accuracy. The data communication phase includes both an uplink and a downlink communication link. The uplink involves the scanning device 120 transmitting oral data to base station 110, which then transmits the received oral data to the host computer 130. The downlink involves the host computer transmitting a three-dimensional oral image to base station 110, which then transmits the received 3D oral image to smart glasses 140. During the data communication stage, dynamic beam tracking is also included. When the terminal device moves, the base station 110 and the terminal device detect channel changes and adjust the antenna weights in real time to maintain the stability of the communication link.

[0033] The scanning device 120 is a terminal device for scanning the oral cavity, and the scanning device 120 includes but is not limited to a scanning handle and a scanner. The scanning device 120 obtains oral data of the first object by scanning the first object, wherein the first object is an object that requires oral scanning, and the oral data is information reflecting the inside of the oral cavity of the first object collected by the scanning device 120. Optionally, the oral data can be a two-dimensional image. The scanning device 120 collects the oral data of the first object and transmits the oral data to the base station 110 through a millimeter wave communication channel. Optionally, the setting height of the scanning device 120 is greater than or equal to 1 meter and less than or equal to 2 meters, and the scanning device 120 is located within the coverage range of the base station 110. The scanning device 120 obtains the oral data of the first object by scanning the first object, providing data support for subsequent analysis and processing.

[0034] The host computer 130 and the base station 110 are connected via millimeter wave communication, enabling data transmission between the host computer 130 and the base station 110. The host computer 130 is the analysis and processing unit of the oral 3D imaging system, and includes but is not limited to a computer and an embedded system. The host computer 110 includes but is not limited to data processing and algorithm execution functions. The host computer 110 pre-stores a 3D image reconstruction method. The host computer 110 receives oral data transmitted by the base station 110 via a millimeter wave communication channel and performs 3D image reconstruction on the oral data according to the pre-stored 3D image reconstruction algorithm to obtain a 3D oral image. The 3D image reconstruction method may include triangulation and a deep learning model, such as a 3D-R2N2 model. The 3D oral image is the 3D data obtained by 3D reconstruction of the oral data, i.e., the 3D oral image. Optionally, the host computer 130 is set at a height greater than or equal to 1 meter and less than or equal to 2 meters, and the host computer 130 is located within the coverage area of ​​the base station 110. The host computer 110 pre-stores a three-dimensional image reconstruction method. The host computer 110 receives oral data transmitted by the base station 110 through the millimeter wave communication channel, performs three-dimensional image reconstruction on the oral data according to the pre-stored three-dimensional image reconstruction algorithm, obtains an oral three-dimensional image, and transmits the oral three-dimensional image to the smart glasses 140 through the base station 110, thereby realizing accurate reconstruction of the oral three-dimensional image.

[0035] The smart glasses 140 and the base station 110 are connected via millimeter wave communication, which enables data transmission between the smart glasses 140 and the base station 110. The smart glasses 140 are worn by a second subject, who is the subject operating the scanning device 120. For example, the second subject may be a medical staff member. The smart glasses 140 are a terminal device for observing the oral cavity and the three-dimensional image of the oral cavity of the first subject. Optionally, the setting height of the smart glasses 140 is greater than or equal to 1 meter and less than or equal to 2 meters, and the smart glasses 140 are located within the coverage range of the base station 110. The second subject observes the oral cavity of the first subject by wearing the smart glasses 140, and can adjust the position of the scanning device 120 according to the observation to ensure the accuracy of the oral cavity data collected by the scanning device 120. The smart glasses 140 receive the three-dimensional image of the oral cavity transmitted by the base station via millimeter wave communication, and display the received three-dimensional image of the oral cavity to the second subject, reducing the frequency of the second subject switching perspectives, which is conducive to shortening the detection time and improving the detection efficiency.

[0036] Optionally, the smart glasses 140 include a processor, a micro-projector and a lens, and the lens includes a waveguide lens; the processor receives the oral three-dimensional image, converts the oral three-dimensional image into an oral three-dimensional image signal, and transmits the oral three-dimensional image signal to the micro-projector; the micro-projector converts the oral three-dimensional image signal into a light signal and projects it onto the waveguide lens; the waveguide lens projects the light signal onto the retina of the second object through total reflection, so that the retina of the second object perceives the visual effect of the oral three-dimensional image.

[0037] The processor is a component within smart glasses 140 that processes 3D oral cavity images. The processor receives 3D oral cavity images transmitted from a base station via millimeter wave communication, converts the received 3D oral cavity images into 3D oral cavity image signals, and transmits the 3D oral cavity image signals to the micro-projector. The 3D oral cavity image signals are information representing the 3D characteristics of the oral cavity and can be, for example, electrical signals.

[0038] The processor and the micro-projector are electrically connected to enable transmission of a three-dimensional oral image signal. The three-dimensional oral image signal processed by the processor is transmitted to the micro-projector. The micro-projector is a component in the smart glasses 140 used to process the three-dimensional oral image signal. The micro-projector can convert the received three-dimensional oral image signal into an optical signal and project the optical signal onto a waveguide lens. For example, the micro-projector can be a micro organic light-emitting diode (OLED). The second subject observes the oral cavity of the first subject through the lenses in the smart glasses 140. The waveguide lens is an optical component in the smart glasses 140 that projects the optical signal onto the retina of the second subject. The waveguide lens receives the optical signal through communication and, based on total internal reflection transmission and beam coupling technology, projects the received optical signal onto the retina of the second subject. The retina of the second subject can perceive the visual effect of the three-dimensional oral image, making it easier for the second subject to adjust the position of the scanning device 120, reducing the frequency of the second subject switching viewing angles, and thus shortening detection time and improving detection efficiency.

[0039] For example, see Figure 5 . Figure 5 The figure is a schematic diagram of optical path propagation in a pair of smart glasses provided by an embodiment of the present invention. The host computer software represents the host computer, and a second subject observes the oral cavity of a first subject through a pair of lenses. The host computer software transmits a three-dimensional image of the oral cavity to a processor of the smart glasses via communication. The processor converts the received three-dimensional image of the oral cavity into a three-dimensional image signal, which is then transmitted to a micro-projector. The micro-projector converts the three-dimensional image signal into a light signal and projects it onto a waveguide lens. The waveguide lens projects the light signal onto the retina of the second subject through total internal reflection, and the retina of the second subject perceives the visual effect of the three-dimensional image of the oral cavity.

[0040] In some embodiments of the present invention, smart glasses 140 include a processor, a micro-projector, and lenses. The lenses include an eyepiece module, which includes an optical lens assembly. The smart glasses 140 operate as follows: the processor receives a 3D oral cavity image transmitted by the base station 110, converts the 3D oral cavity image into a 3D oral cavity image signal, and transmits the 3D oral cavity image signal to the micro-projector. The micro-projector converts the 3D oral cavity image signal into an optical signal and projects it onto the eyepiece module. The eyepiece module magnifies and focuses the optical lens assembly to form a clear image for viewing by a second subject.

[0041] For example, see Figure 6 . Figure 6: This is a schematic diagram of the structure of smart glasses provided by an embodiment of the present invention. The micro-OLED represents a micro-projector, and the host computer software represents a host computer. The smart glasses include a processor, a micro-OLED, and a lens. The lens includes an eyepiece module, and the second subject observes the oral cavity of the first subject through the lens. The host computer software transmits a three-dimensional image of the oral cavity to the processor of the smart glasses via communication. The processor converts the received three-dimensional image of the oral cavity into a three-dimensional image signal of the oral cavity, transmits the three-dimensional image signal of the oral cavity to the micro-OLED, and the micro-OLED converts the three-dimensional image signal of the oral cavity into a light signal that is projected onto the waveguide lens of the eyepiece module. The waveguide lens projects the light signal onto the retina of the second subject through total internal reflection, and the retina of the second subject perceives the visual effect of the three-dimensional image of the oral cavity.

[0042] The technical solution of this embodiment provides an oral three-dimensional imaging system, which is provided by setting up a base station, a scanning device, a host computer and smart glasses; wherein the scanning device, the host computer and the smart glasses are connected to the base station, and the base station transmits data with the scanning device, the host computer and the smart glasses respectively based on the millimeter wave communication channel. The base station is connected to the terminal device through millimeter wave communication, thereby improving the speed and stability of data transmission; the scanning device is used to collect oral data of a first subject, transmit the oral data to the host computer, and perform subsequent analysis and processing based on the oral data; the host computer performs three-dimensional image reconstruction based on the oral data to obtain a three-dimensional image of the oral cavity, and transmits the three-dimensional image of the oral cavity to the smart glasses based on the base station, thereby realizing accurate reconstruction of the three-dimensional image of the oral cavity; the smart glasses are worn by the second subject to display the three-dimensional image of the oral cavity to the second subject, thereby solving the problems of slow data transmission speed and poor stability in the prior art, improving the speed and stability of data transmission, shortening the detection time, and improving the detection efficiency and user experience.

[0043] Example 2

[0044] Figure 7 This is a schematic diagram of the structure of an oral 3D imaging system provided by the second embodiment of the present invention. This embodiment is a refinement of the above embodiment. On the basis of the above embodiment, the number of base stations, scanning devices, host computers and smart glasses is refined. Figure 7As shown, the oral 3D imaging system includes: a base station 210, a scanning device 220, a host computer 230, and smart glasses 240. There is one base station 210 and one host computer 230. The scanning device 220 and the smart glasses 240 are paired, and there is at least one scanning device 220 and at least one smart glasses 240. The scanning device 220, host computer 230, and smart glasses 240 are connected to the base station 210. The base station 210 and the scanning device 220, host computer 230, and smart glasses 240 respectively communicate data using a millimeter wave communication channel. The scanning device 220 is used to collect oral data of a first subject and transmit the oral data to the host computer 230. The host computer 230 performs 3D image reconstruction based on the oral data to obtain a 3D oral image, which is then transmitted to the smart glasses 240 via the base station 210. The smart glasses 240 are worn by a second subject and display the 3D oral image to the second subject.

[0045] To ensure a one-to-one correspondence between the scanning devices 220 and the smart glasses 240, the scanning devices 220 and the smart glasses 240 are paired, with each smart pair of glasses 240 corresponding to one scanning device 220. If there are three scanning devices 220, there are also three corresponding smart pairs of glasses 240; if there are five scanning devices 220, there are also five corresponding smart pairs of glasses 240. The number of scanning devices 220 and smart glasses 240 can be set as needed and is not limited here. By setting up multiple scanning devices 220 and smart glasses 240, different oral data can be processed simultaneously, which helps improve detection efficiency.

[0046] Optionally, the scanning device 220 corresponds to a first tag, the smart glasses 240 corresponds to a second tag, and the first tag of the paired scanning device 220 and the second tag of the smart glasses 240 have a corresponding relationship; the oral data carries the first tag.

[0047] The first tag is a unique identifier corresponding to the scanning device 220, and the first tag includes, but is not limited to, numbers, letters, and combinations of numbers and letters. The second tag is a unique identifier corresponding to the smart glasses 240, and the second tag includes, but is not limited to, numbers, letters, and combinations of numbers and letters. The first tag of the paired scanning device 220 and the second tag of the smart glasses 240 have a corresponding relationship. Based on the corresponding relationship between the first and second tags, the base station 210 can transmit the three-dimensional oral cavity image corresponding to the scanning device 220 to the corresponding smart glasses 240, which helps improve the efficiency and accuracy of data transmission.

[0048] Optionally, the host computer 230 stores the label correspondence between the scanning device 220 and the smart glasses 240; identifies the first label carried in the oral data, performs three-dimensional image reconstruction based on the oral data to obtain an oral three-dimensional image, and determines the second label based on the label correspondence and the first label, sets the second label for the oral three-dimensional image, and transmits the oral three-dimensional image to the smart glasses 240 corresponding to the second label through the base station 210.

[0049] The tag correspondence relationship represents the relationship between the first tag of the scanning device 220 and the second tag of the smart glasses 240 that are set in pair.

[0050] Specifically, scanning device 220 corresponds to a first tag, and oral data collected by the scanning device carries the first tag. Host computer 230 identifies the first tag carried in the oral data, matches it in the tag correspondence, determines the second tag corresponding to the first tag, uses the second tag as the second tag of the three-dimensional oral image, and transmits the three-dimensional oral image with the second tag via base station 210 to smart glasses 240 corresponding to the second tag. Using the first and second tags, the correspondence between the oral data and the three-dimensional oral image can be determined, which helps improve the accuracy of data transmission between scanning device 220, host computer 230, and smart glasses 240.

[0051] Optionally, the number of base stations 210 is one, the number of host computers 230 is the first number, the scanning devices 220 and the smart glasses 240 are arranged in pairs, and the number of scanning devices 220 and the smart glasses 240 are respectively the second number, and the first number is less than or equal to the second number.

[0052] Among them, the first number represents the number of host computers 230, the second number can represent the number of scanning devices 220, and the second number can also represent the number of smart glasses 240, and the scanning devices 220 and smart glasses 240 have the same number. The first number can be equal to the first number, and the first number can also be less than the second number. It is set according to needs and is not limited here. When the first number can be equal to the first number, each scanning device 220 corresponds to a host computer 230, and different host computers 230 process the oral data of different scanning devices 220, and transmit the oral three-dimensional image to the paired smart glasses 240 based on the base station 210 for display, thereby improving the processing speed of the oral data. When the first number is less than the second number, there is at least one host computer 230 that processes the oral data of multiple scanning devices 220 to obtain multiple oral three-dimensional images, and transmits the oral three-dimensional images corresponding to different scanning devices 220 to the paired smart glasses 240 through the base station 210 for display.

[0053] Optionally, the base station 310 also includes a scheduling module to receive the working status information of the host computer 330; when the oral data is received, the target host computer corresponding to the oral data is determined based on the working status information of each host computer 330, and the oral data is transmitted to the target host computer; the oral data of the target host computer is reconstructed into a three-dimensional image to obtain a three-dimensional oral image, and the three-dimensional oral image is transmitted to the smart glasses 340 set in pairs in the scanning device 320 based on the base station 310.

[0054] The scheduling module is a component in the base station 310 for scheduling the host computer 330. The working status information is data indicating whether the host computer 330 is in a working state. For example, the working status information may include a working state and an idle state.

[0055] Specifically, the host computer 330 transmits the working status information to the base station 310 via millimeter wave communication. The scheduling module determines the target host computer corresponding to the oral data based on the working status information received from each host computer 330. The target host computer is the host computer that processes the received oral data. The target host computer pre-stores a three-dimensional image reconstruction method. The target host computer performs three-dimensional image reconstruction on the received oral data according to the pre-stored three-dimensional image reconstruction method to obtain a three-dimensional oral image. The three-dimensional oral image is transmitted via the base station 310 to the paired smart glasses 340 of the scanning device 320 for display. This realizes the scheduling of the host computer 330, which is conducive to improving the processing speed and efficiency of the oral data, and thus helps to improve the detection efficiency.

[0056] In order to improve the processing efficiency and detection efficiency of the host computer 230, the host computer 230 may process different oral data by creating multiple threads.

[0057] Optionally, the host computer 230 creates a corresponding number of threads according to the amount of received oral data, and processes the oral data transmitted by different scanning devices 220 in parallel based on the threads.

[0058] Specifically, the host computer 230 can simultaneously receive oral data corresponding to different scanning devices 220. The host computer 230 creates a corresponding number of threads based on the amount of oral data received. Different threads process the oral data corresponding to different scanning devices 220, realizing multi-threaded parallel processing of oral data, which is conducive to improving the processing efficiency of oral data.

[0059] Exemplarily, the number of oral data received by the host computer 230 is N. The host computer 230 creates N threads according to the N oral data, and different threads are used to process the oral data transmitted by different scanning devices 220 .

[0060] The technical solution of this embodiment provides an oral 3D imaging system. The system comprises a base station, a scanning device, a host computer, and smart glasses. The system comprises one base station, one host computer, and a pair of scanning devices and smart glasses. There is at least one scanning device and at least one smart glasses. Oral data processing can be achieved by deploying a single host computer, thereby reducing the deployment cost of the oral 3D imaging system. The scanning device, host computer, and smart glasses are connected to the base station. The base station transmits data to the scanning device, host computer, and smart glasses respectively using a millimeter wave communication channel. The base station is connected to a terminal device via millimeter wave communication, thereby improving the speed and stability of data transmission. The scanning device is used to collect oral data of a first subject and transmit the oral data to the host computer for subsequent analysis and processing based on the oral data. The host computer performs 3D image reconstruction based on the oral data to obtain a 3D oral image, and transmits the 3D oral image to the smart glasses via the base station, thereby achieving accurate reconstruction of the 3D oral image. The smart glasses are worn by a second subject and display the 3D oral image to the second subject. The system solves the problems of slow data transmission speed and poor stability in the prior art, improves the speed and stability of data transmission, shortens detection time, and improves detection efficiency and user experience.

[0061] Example 3

[0062] Figure 8 This is a structural diagram of an oral 3D imaging system provided by the third embodiment of the present invention. This embodiment is a refinement of the above embodiment. On the basis of the above embodiment, the communication connection between the scanning device and the host computer, and between the host computer and the smart glasses is refined. Figure 8As shown, the oral 3D imaging system includes: a base station 310, a scanning device 320, a host computer 330 and smart glasses 340. The scanning device 320, the host computer 330 and the smart glasses 340 are connected to the base station 310, and the base station 310 respectively transmits data with the scanning device 320, the host computer 330 and the smart glasses 340 based on the millimeter wave communication channel; the scanning device 320 is used to collect oral data of the first subject and transmit the oral data to the host computer 330; the host computer 330 performs 3D image reconstruction based on the oral data to obtain an oral 3D image, and transmits the oral 3D image to the smart glasses 340 based on the base station 310; the smart glasses 340 are worn by the second subject to display the oral 3D image to the second subject; The scanning device 320 is wirelessly connected to the host computer 330, and the host computer 330 is wirelessly connected to the smart glasses 340; the scanning device 320 transmits oral data to the host computer 330 through the base station 310, and transmits oral data to the host computer 330 based on the wireless communication connection; the host computer 330 reconstructs a three-dimensional image based on the oral data that arrives first; the host computer 330 transmits the three-dimensional image of the oral cavity to the smart glasses 340 through the base station 310, and transmits the three-dimensional image of the oral cavity to the smart glasses 340 through the wireless communication connection; the smart glasses 340 display the three-dimensional image of the oral cavity that arrives first.

[0063] Wireless communication includes, but is not limited to, wireless fidelity (WIFI) and 5G communication, which can be configured as needed and is not limited here. Scanning device 320 can transmit oral data to host computer 330 via wireless communication, and host computer 330 can transmit oral 3D images to smart glasses 340 for display via wireless communication.

[0064] Optionally, the oral data carries a first tag and a first timestamp; the host computer 330 determines whether the oral data is the first oral data to arrive based on the first tag and the first timestamp carried in the oral data.

[0065] The first timestamp is a time mark representing the time when the oral data is sent. The first timestamp of the oral data can be recorded in a digital format. For example, the first timestamp can be in the format of "year, month, day, hour, minute, second".

[0066] Specifically, the scanning device 320 simultaneously transmits oral data carrying a first tag and a first timestamp to the host computer 330 through the base station 310 and wireless communication. When the host computer 330 receives the oral data carrying the first tag and the first timestamp, the host computer 330 matches it in the host computer 330 according to the first tag and the first timestamp of the oral data. When the host computer 330 matches the same first tag and first timestamp, it means that the host computer 330 is processing the oral data carrying the first tag and the first timestamp. The host computer 330 removes the received oral data to avoid repeated processing of the same oral data, which is conducive to shortening the detection time and improving the detection efficiency.

[0067] Optionally, the oral three-dimensional image carries a second tag and a second timestamp, and the smart glasses 340 determine whether the oral three-dimensional image is the first oral three-dimensional image to arrive based on the second tag and second timestamp carried in the oral three-dimensional image.

[0068] The second timestamp is a time mark of the time when the oral 3D image is sent. The second timestamp of the oral 3D image can be recorded in a digital format. For example, the second timestamp can be in the format of "year, month, day, hour, minute, second".

[0069] Specifically, the host computer 330 simultaneously transmits the oral three-dimensional image carrying the second tag and the second timestamp to the smart glasses 340 through the base station 310 and wireless communication. When the smart glasses 340 receive the oral three-dimensional image carrying the second tag and the second timestamp, the smart glasses 340 match it according to the second tag and the second timestamp of the oral three-dimensional image. When the smart glasses 340 match the same second tag and second timestamp, it means that the smart glasses 340 are processing the corresponding oral three-dimensional image. At this time, the smart glasses 340 can remove the received oral three-dimensional image to avoid repeated processing of the oral three-dimensional image, which is conducive to shortening the detection time and improving the detection efficiency.

[0070] For example, see Figure 9 , Figure 9 The figure is a schematic diagram of the principle of an oral 3D imaging system provided by an embodiment of the present invention. The oral 3D imaging system includes a base station, a scanning handle, a host computer, and smart glasses. The host computer includes PC software that can perform 3D image reconstruction of oral data. The principle of the oral 3D imaging system is as follows: the oral cavity is scanned by the scanning handle to obtain oral data, and the oral data is transmitted to the host computer via the base station. The PC software in the host computer pre-stores a 3D image reconstruction algorithm. The host computer reconstructs the oral data in 3D according to the 3D image reconstruction algorithm to obtain an oral 3D image. The oral 3D image is transmitted to the smart glasses via the base station for display. The position and angle of the scanning handle are adjusted according to the visual effect of the oral 3D image to ensure the accuracy of the oral 3D image.

[0071] For example, see Figure 10 , Figure 10 is a schematic diagram of a three-dimensional oral imaging method corresponding to a three-dimensional oral imaging system provided by an embodiment of the application. The three-dimensional oral imaging system comprises a base station, a scanning handle, a host computer and smart glasses. The scanning handle is a kind of scanning device. The host computer comprises software, and the software pre-stores a three-dimensional image reconstruction algorithm. A two-dimensional image represents oral data, and a dynamic three-dimensional image represents a three-dimensional oral image. Optionally, the display process of the three-dimensional oral image can be as follows: the scanning device is used to obtain oral data corresponding to the whole mouth, the oral data corresponding to the whole mouth is sent to the host computer through the base station or a communication connection, the host computer performs three-dimensional image reconstruction on the oral data corresponding to the whole mouth to obtain a three-dimensional oral image corresponding to the whole mouth, the three-dimensional oral image corresponding to the whole mouth is transmitted to the smart glasses through the base station or the communication connection, and the three-dimensional oral image corresponding to the whole mouth is displayed to a second object through the glasses. The second object wears the smart glasses, the second object observes the oral cavity of a first object through the lens of the smart glasses, determines a region of interest in the oral cavity, scans the region of interest in the oral cavity by operating the scanning handle, and obtains oral data of the region of interest. The oral data of the region of interest is transmitted to the host computer through the base station or the communication connection, the software in the host computer performs three-dimensional image reconstruction on the oral data of the region of interest by using the pre-stored three-dimensional image reconstruction algorithm to generate a dynamic three-dimensional image, the host computer transmits the dynamic three-dimensional image to the smart glasses through the base station or the communication connection, the smart glasses project and display the received dynamic three-dimensional image, and the dynamic three-dimensional image of the region of interest can be superimposed and displayed on the three-dimensional oral image corresponding to the whole mouth. The region of interest here can be a lesion region in the oral cavity, and the position and angle of the scanning handle are adjusted according to the imaging effect of the dynamic three-dimensional image to improve the accuracy of the dynamic three-dimensional image. Optionally, the display process of the three-dimensional oral image can be as follows: the scanning device is used to obtain oral data corresponding to the whole mouth, the oral data corresponding to the whole mouth is sent to the host computer through the base station or a communication connection, the host computer performs three-dimensional image reconstruction on the oral data corresponding to the whole mouth by using region of interest recognition, and a three-dimensional oral image is obtained. The three-dimensional oral image includes a region of interest, the rendering properties of the region of interest and a non-region of interest in the three-dimensional oral image can be different, the three-dimensional oral image is transmitted to the smart glasses through the base station or the communication connection, and the three-dimensional oral image is displayed to a second object through the glasses. The second object can observe the oral cavity and the region of interest in the oral cavity through the smart glasses.

[0072] The technical solution of this embodiment provides an oral 3D imaging system, which is provided by setting a base station, a scanning device, a host computer and smart glasses, wherein the scanning device, the host computer and the smart glasses are connected to the base station, and the base station transmits data with the scanning device, the host computer and the smart glasses based on the millimeter wave communication channel. The base station is connected to the terminal device through millimeter wave communication, which improves the speed and stability of data transmission; the scanning device is used to collect oral data of the first object, transmit the oral data to the host computer, and perform subsequent analysis and processing based on the oral data; the host computer reconstructs the 3D image based on the oral data to obtain the oral 3D image, and transmits the oral 3D image to the smart glasses based on the base station, realizing accurate reconstruction of the oral 3D image; the smart glasses are worn by the second object to display the oral 3D image to the second object, which solves the problem of slow data transmission speed in the prior art. and poor stability, which improves the speed and stability of data transmission, shortens the detection time, and improves the detection efficiency and user experience; the wireless communication connection between the scanning device and the host computer, and the wireless communication connection between the host computer and the smart glasses are conducive to improving the convenience of operation; the scanning device transmits oral data to the host computer through the base station, and transmits oral data to the host computer based on the wireless communication connection; the host computer reconstructs the three-dimensional image based on the oral data that arrives first to avoid repeated processing of the same oral data, which is conducive to shortening the detection time and improving the detection efficiency; the host computer transmits the oral three-dimensional image to the smart glasses through the base station, and transmits the oral three-dimensional image to the smart glasses through the wireless communication connection; the smart glasses display the oral three-dimensional image that arrives first to avoid repeated processing of the oral three-dimensional image, which is conducive to shortening the detection time and improving the detection efficiency.

[0073] It should be understood that the various forms of the processes shown above can be used to reorder, add, or delete steps. For example, the steps described in the present invention can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solution of the present invention can be achieved. This is not limited herein.

[0074] The above specific embodiments do not limit the scope of protection of the present invention. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions may be made based on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention are intended to be included within the scope of protection of the present invention.

Claims

1. An oral three-dimensional imaging system, characterized in that: include: A base station, a scanning device, a host computer, and smart glasses; wherein the scanning device, the host computer, and the smart glasses are connected to the base station, and the base station transmits data with the scanning device, the host computer, and the smart glasses respectively based on a millimeter wave communication channel; The scanning device is used to collect oral data of the first subject and transmit the oral data to the host computer; The host computer performs three-dimensional image reconstruction based on the oral data to obtain a three-dimensional image of the oral cavity, and transmits the three-dimensional image of the oral cavity to the smart glasses based on the base station; The smart glasses are worn by a second subject and display the three-dimensional image of the oral cavity to the second subject.

2. The oral 3D imaging system according to claim 1, characterized in that: The number of the base station is one, the number of the host computer is one, the scanning device and the smart glasses are arranged in pairs, and the number of the scanning device and the number of the smart glasses are at least one respectively.

3. The oral 3D imaging system according to claim 2, characterized in that: The scanning device corresponds to a first tag, and the smart glasses correspond to a second tag. The first tag of the scanning device and the second tag of the smart glasses, which are arranged in pairs, have a corresponding relationship; the oral data carries the first tag; The host computer stores the label correspondence between the scanning device and the smart glasses; identifies the first label carried in the oral data, performs three-dimensional image reconstruction based on the oral data to obtain the oral three-dimensional image, and determines the second label based on the label correspondence and the first label, sets the second label for the oral three-dimensional image, and transmits the oral three-dimensional image to the smart glasses corresponding to the second label through the base station.

4. The oral 3D imaging system according to claim 3, characterized in that: The host computer creates a corresponding number of threads according to the amount of received oral data, and processes the oral data transmitted by different scanning devices in parallel based on the threads.

5. The oral 3D imaging system according to claim 1, characterized in that: The number of the base stations is one, the number of the host computers is a first number, the scanning device and the smart glasses are arranged in pairs, and the number of the scanning devices and the number of the smart glasses are respectively a second number, and the first number is less than or equal to the second number; The base station also includes a scheduling module that receives the working status information of the host computer; when the oral data is received, determines the target host computer corresponding to the oral data based on the working status information of each host computer, and transmits the oral data to the target host computer; The target host computer performs three-dimensional image reconstruction on the oral data to obtain a three-dimensional image of the oral cavity, and transmits the three-dimensional image of the oral cavity to the smart glasses set in pairs with the scanning device based on the base station.

6. The oral 3D imaging system according to claim 1, characterized in that: The scanning device is wirelessly connected to the host computer, and the host computer is wirelessly connected to the smart glasses; The scanning device transmits the oral data to the host computer via the base station, and transmits the oral data to the host computer based on the wireless communication connection; the host computer reconstructs a three-dimensional image based on the oral data that arrives first; The host computer transmits the three-dimensional image of the oral cavity to the smart glasses through the base station, and transmits the three-dimensional image of the oral cavity to the smart glasses through the wireless communication connection; the smart glasses display the three-dimensional image of the oral cavity that arrives first.

7. The oral three-dimensional imaging system according to claim 6, characterized in that: The oral data carries a first tag and a first timestamp; the host computer determines whether the oral data is the first oral data to arrive based on the first tag and the first timestamp carried in the oral data; The oral three-dimensional image carries a second tag and a second timestamp, and the smart glasses determine whether the oral three-dimensional image is the first oral three-dimensional image to arrive based on the second tag and the second timestamp carried in the oral three-dimensional image.

8. The oral three-dimensional imaging system according to claim 1, characterized in that: The smart glasses include a processor, a micro projector and lenses, and the lenses include waveguide lenses; The processor receives the oral 3D image, converts the oral 3D image into an oral 3D image signal, and transmits the oral 3D image signal to the micro projector; The micro-projector converts the oral three-dimensional image signal into a light signal and projects the light signal onto the waveguide lens; The waveguide lens projects the light signal onto the retina of the second subject through total internal reflection, so that the retina of the second subject perceives the visual effect of the three-dimensional image of the oral cavity.

9. The oral 3D imaging system according to claim 1, characterized in that: The installation height of the base station is greater than or equal to 2 meters and less than or equal to 3 meters.

10. The oral three-dimensional imaging system according to claim 1, characterized in that: The setting height of at least one of the scanning device, the host computer and the smart glasses is greater than or equal to 1 meter and less than or equal to 2 meters.

Images