Oral scanning system

Abstract

The present invention provides an oral scanning system comprising a scanning management terminal which receives a plurality of scanning images from an oral scanner to generate a three-dimensional image model of the oral cavity of a patient, divides a first region and a second region in an image captured by a camera module, and generates and controls a glass image to be displayed in the second region, so that the glass image is displayed on a transparent display unit of a smart glass.

Description

Oral scanning system

[0001] The present invention relates to an oral scanning system, and more particularly, to an oral scanning system using augmented reality technology.

[0002] Normally, human teeth help us chew food, facilitate digestion, and play a crucial role in pronunciation. When these teeth become abnormal, their condition is diagnosed and treated, and if necessary, artificial teeth are implanted to replace them.

[0003] When teeth are lost, artificial teeth are replaced through dental implants. When using an abutment for implant prosthesis, the final prosthesis, the rounded crown, is placed on a custom abutment, requiring precise three-dimensional measurement of the abutment's shape.

[0004] Recently, there have been active attempts to directly measure the abutment in the patient's mouth using an oral scanner, that is, to use 3D scanning to design prosthetics.

[0005] For example, Korean Patent Publication No. 2021-0101936 discloses "Method, Apparatus, and Recording Medium for Obtaining Oral Scanner Images." The technology disclosed in the Korean Patent Publication encrypts only the original images and oral scanner information acquired through an oral scanner at a user terminal and transmits them to a server, and the server then uses the received original images and oral scanner information to generate an oral scanner image.

[0006] The device disclosed in the above Korean patent publication includes an oral scanner and an information processing device, such as a computer-based terminal, for processing an image scanned by the oral scanner.

[0007] The above terminal is typically installed with a program for managing the oral scanner, such as processing the image scanned by the oral scanner through communication with the server and transmitting the scanned image to the server.

[0008] Therefore, manufacturers of oral scanners usually sell a terminal with a program installed to manage the oral scanner together with the scanner, or install the program on a PC provided in the dental clinic.

[0009] When scanning a patient's oral cavity using the above-described oral scanner, the scanned information or images are displayed on the monitor of the terminal with the program installed. Therefore, during the scanning process, the dentist or nurse must look at the patient's oral cavity, where the oral scanner is inserted, as illustrated in Figure 1, while scanning and then look at the monitor to confirm the scanned image. This means that the dentist or nurse must alternately look at the patient's oral cavity and the monitor, which is inconvenient.

[0010] In addition, oral scanners are usually manufactured in a size that can be held by hand, so instead of implementing various operation buttons on the oral scanner, input signals are generated during the scanning process using the oral scanner through a program installed on the terminal.

[0011] Even in this configuration, since the input device of the terminal, such as a keyboard, mouse, or touch screen, must be operated to generate an input signal during the scanning process, it causes inconvenience in a non-free usage environment where the oral scanner is held.

[0012] Accordingly, the present invention has been devised to solve the above problems, and its purpose is to provide an oral scanning system that provides an environment in which scanned images or various information can be easily visually recognized.

[0013] In addition, another purpose of the present invention is to provide an oral scanning system that can provide a user-friendly environment in which an input signal is generated during the oral scanning process.

[0014] The above object is achieved by an oral scanning system according to the present invention, comprising: an oral scanner for scanning a patient's oral cavity to generate a plurality of scanned images; a camera module; smart glasses having a transparent display unit on which an image is displayed; and a scanning management terminal linked to the oral scanner and the smart glasses; wherein the scanning management terminal receives a plurality of the scanned images from the oral scanner to generate a three-dimensional image model of the patient's oral cavity, generates a glass image to be displayed on the transparent display unit of the smart glasses, divides a camera image captured by the camera module into a first region and a second region, and controls the smart glasses so that the glass image is displayed on the second region on the transparent display unit; and wherein the first region includes an oral region of the patient within the camera image.

[0015] Here, the scanning management terminal operates in one of a first mode and a second mode to divide the camera image into the first region and the second region; the first mode may operate in a state where the patient's face is covered with a blepharon, and the second mode may operate in a state where the patient's face is not covered with the blepharon.

[0016] Additionally, the scanning management terminal can operate in either the first mode or the second mode based on a user's input.

[0017] And, the scanning management terminal can detect whether a small pore area corresponding to the small pore area is included in the camera image, and operate in the first mode when the small pore area is detected, and operate in the second mode when the small pore area is not detected.

[0018] And, when the scanning management terminal operates in the first mode, it can extract a perforation area among the perforation areas corresponding to the perforation area in the camera image; and classify the perforation area as the first area, and classify an area other than the perforation area as the second area.

[0019] And, when the scanning management terminal operates in the second mode, it can extract a facial area of ​​the patient's face within the camera image; divide the facial area into the first area, and divide an area other than the facial area into the second area.

[0020] In addition, the glass image may include at least one of a 2D oral image viewed from a specific viewing direction of the 3D image model, and an input menu for control input of at least one of the oral scanner and the scanning management terminal.

[0021] And, the scanning management terminal can receive a camera image captured by the camera module while the input menu is displayed as the glass image, extract a hand area from the camera image, and recognize the hand area as an operation signal for the input menu through gesture recognition.

[0022] According to the above configuration, according to the present invention, an oral scanning system is provided that provides an environment in which a scanned image or various information can be easily visually recognized by displaying it on smart glasses worn by a user.

[0023] In addition, an oral scanning system is provided that can provide a user-friendly environment in which input signals are generated during the oral scanning process.

[0024] Figure 1 is a drawing showing an example of an oral scanning environment in a typical dental clinic.

[0025] FIG. 2 is a drawing showing an example of the configuration of an oral scanning system according to an embodiment of the present invention;

[0026] FIG. 3 is a drawing showing an example of the configuration of a smart glass according to an embodiment of the present invention.

[0027] FIG. 4 is a drawing showing an example of the configuration of a scanning management terminal according to an embodiment of the present invention.

[0028] Figure 5 is a drawing to explain the usage environment depending on whether or not a small air gap is applied.

[0029] FIGS. 6 to 9 are drawings showing examples of glass images displayed on smart glasses according to embodiments of the present invention.

[0030] FIG. 10 is a drawing showing an example of a gesture applied to a smart glass system according to an embodiment of the present invention.

[0031] The present invention relates to an oral scanning system, comprising: an oral scanner for scanning a patient's oral cavity to generate a plurality of scanned images; a smart glass having a camera module and a transparent display unit on which an image is displayed; and a scanning management terminal linked to the oral scanner and the smart glass; wherein the scanning management terminal receives a plurality of the scanned images from the oral scanner to generate a three-dimensional image model of the patient's oral cavity, generates a glass image to be displayed on the transparent display unit of the smart glass, divides a camera image captured by the camera module into a first region and a second region, and controls the smart glass so that the glass image is displayed on the second region on the transparent display unit; wherein the first region includes a patient's oral cavity region within the camera image.

[0032] The advantages and features of the present invention, and the methods for achieving them, will become clearer with reference to the embodiments described in detail below together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below and may be implemented in various different forms. These embodiments are provided solely to ensure that the disclosure of the present invention is complete and to fully inform those skilled in the art of the scope of the present invention, and the present invention is defined solely by the scope of the claims.

[0033] The terminology used herein is for the purpose of describing embodiments only and is not intended to limit the present invention. In this specification, the singular also includes the plural unless specifically stated otherwise. As used herein, the terms "comprises" and / or "comprising" do not exclude the presence or addition of one or more other components in addition to the mentioned components. Like reference numerals refer to like components throughout the specification, and "and / or" includes each and any combination of one or more of the mentioned components. Although "first", "second", etc. are used to describe various components, these components are not limited by these terms. These terms are only used to distinguish one component from another. Therefore, it should be understood that a first component mentioned below may also be a second component within the technical spirit of the present invention.

[0034] Unless otherwise defined, all terms (including technical and scientific terms) used herein may be used in their common sense to those of ordinary skill in the art to which the present invention pertains. Furthermore, terms defined in commonly used dictionaries are not to be interpreted ideally or excessively unless explicitly and specifically defined otherwise.

[0035] Hereinafter, embodiments according to the present invention will be described in detail with reference to the attached drawings.

[0036] FIG. 2 is a drawing showing an example of the configuration of an oral scanning system (100) according to an embodiment of the present invention.

[0037] Referring to FIG. 2, an oral scanning system (100) according to an embodiment of the present invention may be configured to include an oral scanner (110), smart glasses (150), and a scanning management terminal (130). In one embodiment, the oral scanning system (100) may be provided by a manufacturer of the oral scanner (110) along with a scanning management terminal (130) for managing the oral scanner (110).

[0038] An oral scanner (110) according to an embodiment of the present invention can scan a patient's oral cavity to generate multiple scanned images. In one embodiment, the oral scanner (110) can be applied to various methods capable of capturing scanned images of teeth constituting the patient's oral cavity, such as a confocal microscope method, triangulation, an optical coherence tomography system method, and fringe interferometry, and the technical idea of ​​the present invention is not limited to these methods.

[0039] The scanning management terminal (130) according to an embodiment of the present invention can manage scanned images scanned by the oral scanner (110). Here, the scanning management terminal (130) can be connected to a dental management terminal (not shown) through a communication network within the dental clinic and communicate with the dental management terminal. In one embodiment, the scanning management terminal (130) and the dental management terminal can communicate with each other through a wireless communication network such as wireless WI-FI, Bluetooth, or WiBro. In addition, the scanning management terminal (130) and the dental management terminal can also be connected to each other through a wired communication network such as a LAN.

[0040] Meanwhile, the smart glasses (150) may be provided in the form of glasses that can be worn by a user, for example, a dentist or a nurse, as illustrated in FIG. 2. For example, the smart glasses (150) may include a glass frame (151) forming a skeleton, and a lens (151a) to which the glass frame (151) is fixed so that it is positioned in front of the wearer's eyes when the glass frame (151) is worn.

[0041] FIG. 3 is a drawing showing an example of the configuration of a smart glass (150) according to an embodiment of the present invention.

[0042] Referring to FIG. 3, a smart glass (150) according to an embodiment of the present invention may be configured to include a camera module (153) and a transparent display unit (152). In addition, the smart glass (150) may be configured to include a glass interface unit (154) and a glass processor (155).

[0043] The transparent display unit according to an embodiment of the present invention is made of a transparent material and displays an image on its surface. In the embodiment of the present invention, the transparent display unit (152) is configured as an entire lens (151a) constituting the smart glass (150), but it is of course possible for the transparent display unit (152) to be provided in only a portion of the lens (151a).

[0044] In this way, depending on the configuration of the transparent display unit (152), even when the user is wearing smart glasses (150) or when a glass image (GI) to be described later is displayed on the transparent display unit (152), the actual image that passes through the transparent display unit (152), i.e., the actual image seen by the user's eyes, can be viewed together with the glass image (GI) displayed on the transparent display unit (152).

[0045] A camera module (153) according to an embodiment of the present invention is installed in a smart glass (150) to capture images of the front of the smart glass (150). In an embodiment of the present invention, as illustrated in FIG. 2, the camera module (153) is installed in a glass frame (151) of the smart glass (150), and is installed to capture images in a viewing direction corresponding to the direction in which the user's eyes view when wearing the smart glass (150).

[0046] The glass interface unit (154) according to an embodiment of the present invention can be connected to a scanning management terminal (130) via a communication network. Here, communication between the scanning management terminal (130) and the glass interface unit (154) can be applied via wireless communication or wired communication. In one embodiment, the glass interface unit (154) can communicate with the scanning management terminal (130) via TCP / IP-based Wi-Fi communication or Bluetooth communication, and of course, other types of wired or wireless communication can also be applied.

[0047] The glass processor (155) according to an embodiment of the present invention can control the entire functions of the smart glass (150). In one embodiment, the glass processor (155) can control communication with the scanning management terminal (130) through the glass interface unit (154) and transmit a camera image captured by the camera module (153) to the scanning management terminal (130) through the glass interface unit (154).

[0048] In addition, the glass processor (155) can display a glass image (GI) to be described later, which is transmitted from the scanning management terminal (130) and received through the glass interface unit (154), on the transparent display unit (152), and a detailed description thereof will be described later.

[0049] Meanwhile, the scanning management terminal (130) according to the embodiment of the present invention can receive a plurality of scanning images from the oral scanner (110) and create a three-dimensional image model of the patient's oral cavity.

[0050] In addition, the scanning management terminal (130) can generate a glass image (GI) to be displayed on the transparent display unit (152) of the smart glass (150) and transmit the generated image to the smart glass (150) through a communication network.

[0051] FIG. 4 is a drawing showing an example of the configuration of a scanning management terminal (130) according to an embodiment of the present invention.

[0052] Referring to FIG. 4, a scanning management terminal (130) according to an embodiment of the present invention may be configured to include a scanning interface unit (131), a scanning management program (132), and a scanning terminal processor (133). In addition, the scanning management terminal (130) may be configured to include a data storage unit (136) and a scanning terminal monitor (134).

[0053] The scanning interface unit (131) according to an embodiment of the present invention is connected to an oral scanner (110) via a communication network and can receive a scanning image captured by the oral scanner (110). In one embodiment, the scanning interface unit (131) can be connected to the oral scanner (110) via a wired or wireless communication method. Here, the technical idea of ​​the present invention is not limited to the connection method between the scanning interface unit (131) and the oral scanner (110).

[0054] In addition, the scanning interface unit (131) can communicate with the smart glass (150) via a communication network. Here, the communication method between the smart glass (150) and the scanning management terminal (130) can be applied in a wired or wireless manner as described above.

[0055] In FIG. 2, one communication network is illustrated, and a smart glass (150) and a scanning management terminal (130), and an oral scanner (110) and a scanning management terminal (130) are described as communicating, but it is to be understood that the communication method between the smart glass (150) and the scanning management terminal (130) and the communication method between the oral scanner (110) and the scanning management terminal (130) may be the same or different from each other.

[0056] The scanning terminal processor (133) according to an embodiment of the present invention may include hardware and software configurations for controlling the entire functions of the scanning management terminal (130). In one embodiment, when the scanning management terminal (130) is implemented in the form of a PC, the hardware configuration may include a CPU, RAM, a main board, etc., and the software configuration may include an operating system.

[0057] The scanning management program (132) can be installed in the scanning management terminal (130). In addition, the scanning management program (132) can manage scanning images captured and received by the oral scanner (110) through the scanning interface unit (131) in conjunction with the scanning terminal processor (133).

[0058] In one embodiment, the scanning management program (132) may be configured to include a 3D model generation unit (132a). The 3D model generation unit (132a) may generate a 3D image model of a patient's oral cavity using a plurality of scanned images transmitted from an oral scanner (110).

[0059] In an embodiment of the present invention, it is assumed that the scanning image transmitted from the oral scanner (110) has an RGB-D data format. That is, it may be a three-dimensional image format in which depth information is included in each pixel within the RGB image. Here, the 3D model generation unit (132a) generates a three-dimensional image model of the oral cavity by aligning the scanning image with depth information through an image processing process.

[0060] Here, the 3D model generation unit (132a) according to the embodiment of the present invention can store at least a portion of the plurality of scanning images transmitted from the oral scanner (110) and the generated 3D image model in the data storage unit (136).

[0061] A scanning management program (132) according to an embodiment of the present invention may be configured to include a glass image (GI) generation unit (132d). In one embodiment, the glass image (GI) generation unit (132d) may generate a glass image (GI) to be displayed on a transparent display unit (152) of a smart glass (150), which will be described in detail later.

[0062] In addition, the scanning management program (132) according to an embodiment of the present invention can divide the camera image captured by the camera module (153) of the smart glass (150) and displayed through the scanning interface unit (131) into a first area and a second area. In addition, the scanning management program (132) can control the smart glass (150) so that the glass image (GI) generated by the glass image (GI) generation unit (132d) is displayed on the transparent display unit (152) of the smart glass (150) at a location corresponding to the second area.

[0063] Here, the first region includes the patient's oral region within the camera image, and the second region corresponds to an area within the camera image that does not include the patient's oral region.

[0064] Through this, when displaying a glass image (GI) on the transparent display unit (152) of smart glasses (150) worn by a user during the process of scanning or treating a patient's oral cavity, by displaying it in a second area other than the oral area that is the target of treatment or scanning, the scanning image displayed on the transparent display unit (152) does not obstruct the view of the user, i.e., the dentist or nurse, during the scanning or treatment process.

[0065] In an embodiment of the present invention, the scanning management program (132) of the scanning management terminal (130) operates in either the first mode or the second mode to divide the camera image into a first area and a second area.

[0066] Referring to FIG. 5, as shown in (b) of FIG. 5, the first mode operates in a state where the patient's face is covered with a small pore (200), and the second mode operates in a state where the patient's face is not covered with a small pore (200), i.e., the patient's face is exposed, as shown in (a) of FIG. 5.

[0067] To be more specific, dental treatment is generally performed with the patient's face covered with a sclerotherapy mask (200), but oral scanning may be performed without the patient's face being covered with the sclerotherapy mask (200). In other words, oral scanning may involve situations where the patient's face is covered with the sclerotherapy mask (200) or not.

[0068] As explained above, the first region includes the patient's oral region, and the second region does not include the patient's oral region, and it is not desirable to display the glass image (GI) on the patient's face region excluding the oral region.

[0069] Referring to FIGS. 6 to 8, it is preferable to display a glass image (GI) in an area excluding the patient's face area not covered by the uvula (200) within the visual field (VA) of a user wearing smart glasses (150), as shown in FIG. 6.

[0070] On the other hand, as shown in Fig. 7, in the case of a patient covering a pore (200), the pore (200) covers the facial area excluding the oral area, so it may be okay for a glass image (GI) to be displayed in the facial area.

[0071] Accordingly, in the embodiment of the present invention, the scanning management program (132) of the scanning management terminal (130) operates in the first mode or the second mode depending on whether the small air pocket (200) is covered, thereby reflecting the situation as shown in FIGS. 6 and 7.

[0072] In one embodiment, the scanning management program (132) operates in either the first mode or the second mode based on a user input through the user input unit (135).

[0073] Referring to FIG. 4, the scanning management terminal (130) may be configured to include a user input unit (135). In one embodiment, a user may input various input signals into the scanning management terminal (130) through the user input unit (135). The user input unit (135) may be configured as at least one input device among a touch pad, a foot switch, a keyboard / mouse, or a microphone for voice recognition.

[0074] The user can select the first mode when the patient's face is covered with a pore mask (200) through the user input unit (135), and select the second mode when the patient's face is not covered with a pore mask (200).

[0075] In another embodiment, the scanning management program (132) of the scanning management terminal (130) can detect whether a vacuole area corresponding to a vacuole (200) is included in a camera image captured by the camera module (153) of the smart glass (150). For example, the scanning management terminal (130) can detect an area with a specific color as a vacuole area by using the color of the vacuole (200), or can detect the presence of a vacuole area by detecting the boundary of a specific color.

[0076] In addition, the scanning management program (132) can operate in the first mode when a small pore area is detected, and can operate in the second mode when a small pore area is not detected.

[0077] Again, referring to FIG. 4, the scanning management program (132) according to the embodiment of the present invention may be configured to include a first detection model (132b) and a second detection model (132c), as shown in FIG. 4.

[0078] The first detection model (132b) according to an embodiment of the present invention, when operating in the first mode, can divide the camera image into a first region and a second region. Furthermore, the second detection model (132c), when operating in the second mode, can divide the camera image into a first region and a second region.

[0079] In one embodiment, the first detection model (132b) may operate in the first mode and extract a perforation area (210) from among the pore areas corresponding to the pores (200) within the camera image. That is, the perforation area (210) formed by cutting out an area inside the pore (200) to allow viewing of the oral cavity may be extracted. In addition, the first detection model (132b) may distinguish the perforation area (210) as a first area and an area other than the perforation area (210) as a second area.

[0080] Through this, as illustrated in FIG. 7, even areas other than the first area, the perforation area (210), for example, the small pore area, are included in the area where the glass image (GI) is displayed, even if they correspond to the patient's face area, so that the glass image (GI) can be displayed.

[0081] Meanwhile, the second detection model (132c) operates in the second mode, and the first detection model (132b) according to the embodiment of the present invention, when operating in the first mode, can divide the camera image into a first region and a second region. In addition, when the second detection model (132c) operates in the second mode, the camera image can be divided into a first region and a second region.

[0082] In one embodiment, the second detection model (132c) may operate in the second mode and extract a facial region of a patient's face within a camera image. Furthermore, the second detection model (132c) may distinguish the facial region as a first region and a region other than the facial region as a second region.

[0083] Through this, as illustrated in FIG. 6, the glass image (GI) is displayed in an area other than the first area, the face area, so that the glass image (GI) is not displayed in the entire face area, including the oral area, which is the treatment target or scanning target of the patient, so as not to interfere with the user's scanning action or treatment.

[0084] Here, the first detection model (132b) and the second detection model (132c) can be implemented as learning models trained based on artificial intelligence. For example, the first detection model (132b) can be created by learning to detect a perforation area (210) within a pore area using images of a patient's face covered with various types of pores (200) as learning data.

[0085] In addition, the second detection model (132c) may be provided as an artificial intelligence model capable of detecting a human face region within an image. Here, the model for detecting a human face region within an image may take various forms, such as detecting the boundary region of a human face, detecting eyes, nose, mouth, etc., and detecting the face region based on these.

[0086] Meanwhile, the glass image (GI) generation unit (132d) can generate a 2D oral image viewed from a specific viewing direction of a 3D image model as a glass image (GI), as shown in FIGS. 6 and 7, and transmit the same to the smart glasses (150) via the scanning interface unit (131).

[0087] In addition, the glass processor (155) can display the 2D oral image received through the glass interface unit (154) as a glass image (GI) on the transparent display unit (152). At this time, the scanning management program (132) can control the smart glasses (150) so that the 2D oral image to be displayed as a glass image (GI) is displayed in the second area.

[0088] The above configuration is reflected in real time during treatment or oral scanning using smart glasses (150). That is, a camera image captured in real time by the camera module (153) of the smart glasses (150) is transmitted to the scanning management terminal (130), and the scanning management program (132) distinguishes a first area and a second area from the camera image transmitted in real time, so that the second area, where the glass image (GI) is to be displayed, changes position in real time according to the movement of the user wearing the smart glasses (150).

[0089] As illustrated in FIGS. 7 and 8, when the user's visual field area (VA) changes according to the movement of the user wearing the smart glasses (150), a second area is distinguished in real time within the changing visual field area (VA), so that the position at which the glass image (GI) is displayed on the transparent display unit (152) can be changed.

[0090] Meanwhile, the glass image (GI) generation unit (132d) according to an embodiment of the present invention can generate an input menu for control input of an oral scanner (110) or a scanning management terminal (130) as a glass image (GI) to be displayed on a smart glass (150).

[0091] Fig. 9 is a drawing showing an example of an input menu displayed on smart glasses (150) according to an embodiment of the present invention. As shown in Fig. 9, the input menu is displayed in the second area as described above.

[0092] In one embodiment, selection of an input menu can be made using a glass input unit (156) of a smart glass (150). The glass input unit (156) can be applied in a touch manner to the outside of the glass frame (151) of the smart glass (150).

[0093] As another example, the input menu can be selected through gesture recognition of a user wearing smart glasses (150). More specifically, the scanning management terminal (130) can be configured to include a gesture recognition unit (132e).

[0094] The gesture recognition unit (132e) can receive a camera image captured by the camera module (153) while displaying an input menu as a glass image (GI), and extract a hand area from the received camera image.

[0095] In one embodiment, a user wearing smart glasses (150) may use his or her hand to perform a preset gesture in front of the smart glasses (150) while an input menu is displayed on the transparent display unit (152) of the smart glasses (150) he or she is wearing. For example, the user may perform a gesture such as moving the hand up and down as shown in (a) of FIG. 10 or moving the hand left and right as shown in (b) of FIG. 10.

[0096] Here, a gesture of moving a hand in an up-and-down direction can be recognized as an operation signal for changing an input menu to be selected from among multiple input menus, and a gesture of moving a hand in a left-and-right direction can be recognized as an operation signal for selecting the corresponding input menu.

[0097] The gesture illustrated in Fig. 10 is one embodiment, and various inputs and selections can be made through the setting of various gestures.

[0098] Through the above configuration, it is possible to provide a user-friendly environment by enabling the manipulation and selection of input menus through gestures without having to manipulate the user input unit (135) of the scanning management terminal (130) or the glass input unit (156) of the smart glasses (150).

[0099] Although certain embodiments of the present invention have been illustrated and described, it will be apparent to those skilled in the art that modifications may be made to the embodiments without departing from the spirit or scope of the invention. The scope of the invention is defined by the appended claims and their equivalents.

[0100] [Explanation of symbols]

[0101] 100: Intraoral scanning system 110: Intraoral scanner

[0102] 130: Scanning management terminal 131: Scanning interface unit

[0103] 132: Scanning Management Program 132a: 3D Model Creation Unit

[0104] 132b: First detection model 132c: Second detection model

[0105] 132d: Glass image generation unit 132e: Gesture recognition unit

[0106] 133: Scanning terminal processor 134: Scanning terminal monitor

[0107] 135: User input section 136: Data storage section

[0108] 150: Smart Glass 151: Glass Frame

[0109] 151a: Lens 152: Transparent display unit

[0110] 153: Camera module 154: Glass interface

[0111] 155: Glass processor 156: Glass input unit

[0112] 200: Small pore 210: Punching area

[0113] The present invention can be applied to the field of oral scanning used in dentistry.

Claims

1. In the oral scanning system, An oral scanner that scans the patient's oral cavity to create multiple scanned images, Smart glasses having a camera module and a transparent display section on which images are displayed, A scanning management terminal linked to the oral scanner and the smart glasses is included; The above scanning management terminal A plurality of scanning images are transmitted from the oral scanner to create a three-dimensional image model of the patient's oral cavity, Generate a glass image to be displayed on the transparent display portion of the smart glass, Controlling the smart glass so that the camera image captured by the camera module is divided into a first area and a second area, and the glass image is displayed in the second area on the transparent display unit; An oral scanning system, wherein the first region includes an oral region of a patient within the camera image.

2. In paragraph 1, The above scanning management terminal operates in either the first mode or the second mode to divide the camera image into the first area and the second area; An oral scanning system characterized in that the first mode operates in a state where the patient's face is covered with a sacrum, and the second mode operates in a state where the patient's face is not covered with the sacrum.

3. In paragraph 2, An oral scanning system characterized in that the scanning management terminal operates in either the first mode or the second mode based on a user's input.

4. In paragraph 2, An oral scanning system characterized in that the scanning management terminal detects whether a pore area corresponding to the pore area is included in the camera image, operates in the first mode when the pore area is detected, and operates in the second mode when the pore area is not detected.

5. In paragraph 2, When the above scanning management terminal operates in the first mode, Extracting a perforation area among the pore areas corresponding to the pores in the above camera image; An oral scanning system characterized in that the perforation area is divided into the first area and an area other than the perforation area is divided into the second area.

6. In paragraph 5, When the above scanning management terminal operates in the second mode, Extracting a facial region for a patient's face within the above camera image; An oral scanning system characterized in that the facial area is divided into the first area and an area other than the facial area is divided into the second area.

7. In paragraph 1, The above glass image is A 2D oral image of the above 3D image model viewed from a specific viewing direction, An oral scanning system characterized by comprising at least one input menu for control input of at least one of the oral scanner and the scanning management terminal.

8. In paragraph 7, The above scanning management terminal In a state where the input menu is displayed with the above glass image, a camera image captured by the camera module is received, An oral scanning system characterized in that a hand region is extracted from the camera image and a gesture of the hand region is recognized to be an operation signal for the input menu.

Images