System and method for automatically controlling dental instrument with integrated light source

By integrating optical sensors and machine learning models to automatically control the light source of dental instruments, and switching between forward and backward light sources according to position, the problems of insufficient dental lighting and inconvenient switching are solved, and better oral lighting effect is achieved.

CN120936285APending Publication Date: 2025-11-11HALO DENTAL TECH INC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202480025443.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-02-14
Filing Date
2024-02-14
Publication Date
2025-11-11

Smart Images

  • Figure CN120936285A_ABST
    Figure CN120936285A_ABST
Patent Text Reader

Abstract

A system and method for automatically controlling a dental instrument is provided. The system comprises a dental instrument having: an optical sensor adapted to acquire an optical signal according to at least one mode of operation; and a light source operable to adjust the light output. The system also includes a processor in operative communication with the optical sensor and the light source. And a processor for receiving and processing the optical signal to determine a position of the dental instrument relative to the oral cavity of the patient. The processor is further configured to send a control signal to the light source and / or the optical sensor based on the determined position to control a light output of the optical sensor and / or an operating mode of the optical sensor.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] Cross-references This application claims the benefit and priority of U.S. Provisional Patent Application 63 / 484,808, filed February 14, 2023, entitled “System and Method for Automatically Controlling a Dental Instrument Having Integrated Light Sources,” the entire contents of which are incorporated herein by reference. Technical Field

[0002] This technical field generally relates to lighting systems, and more specifically, to systems for automatically controlling dental instruments (e.g., dental mouth mirrors) having an integrated light source for illuminating the patient's oral cavity. Background Technology

[0003] For dental professionals (such as dentists or dental hygienists), it can be difficult to directly see inside a patient's mouth to perform dental examinations or other dental procedures. Such professionals often use an endoscope (also known as a dental mouth mirror) to facilitate observation of the patient's oral cavity, including the teeth and gums, by allowing observation of areas of interest inside the mouth through the reflective surface of the dental mouth mirror.

[0004] However, a patient's oral cavity is often an environment lacking sufficient lighting for proper examination of areas of interest. Therefore, to improve visibility within a patient's oral cavity, an external light source can typically be directed towards the cavity. For example, a bright external light source (e.g., a light source focused by one or more reflective and / or lens elements) can be mounted on a multi-position armature, allowing healthcare providers to selectively position the external light source at a desired angle to illuminate a given area within the patient's oral cavity.

[0005] However, such external light sources may have various drawbacks, such as insufficient illumination of specific areas within the patient's oral cavity or the inability to be easily switched. Therefore, improvements are needed. Summary of the Invention

[0006] According to one aspect, a method is provided for automatically controlling a dental instrument having an integrated light source and an integrated optical sensor. The method includes: capturing optical signals via the integrated optical sensor; processing the optical signals to determine the position of the dental instrument relative to a patient's oral cavity; and controlling the light output of the integrated light source based on the determined position.

[0007] According to one embodiment, the determined position of the dental instrument includes one of an intraoral position, a cheek traction position, and an extraoral position.

[0008] According to one embodiment, the optical signal includes an image captured by an integrated optical sensor.

[0009] According to one embodiment, processing optical signals to determine the position of a dental instrument relative to a patient's mouth includes detecting objects within an image.

[0010] According to one embodiment, determining the position of a dental instrument in the mouth includes detecting one of the objects corresponding to teeth, tongue, and / or saliva.

[0011] According to one embodiment, determining that a dental instrument is in a cheek traction position includes detecting an image in which no object is present.

[0012] According to one embodiment, determining that a dental instrument is in an extraoral position includes detecting objects other than teeth, tongue, and / or saliva.

[0013] According to one embodiment, processing optical signals to determine the position of a dental instrument relative to a patient's mouth also includes using a machine learning prediction model to predict the position of the dental instrument relative to the patient's mouth.

[0014] According to one embodiment, the machine learning prediction model is initially trained by a computer-implemented classification module of a computer using multiple training images to determine the position of a dental instrument relative to a patient's mouth, wherein the computer is hosted in an external device separate from the dental instrument.

[0015] According to one embodiment, a trained machine learning prediction model is downloaded from a computer to the processor of a dental instrument.

[0016] According to one embodiment, processing optical signals to determine the position of a dental instrument relative to a patient's oral cavity further includes: receiving a number (M) of consecutive optical signals; for each of the received number (M) of optical signals, using a machine learning prediction model to predict the position of the dental instrument relative to the patient's oral cavity; comparing the predicted positions of the dental instrument with respect to the received number (M) of optical signals; and adjusting the predicted position of the dental instrument if at least a predetermined percentage of the predicted positions in the number (M) of optical signals are similar.

[0017] According to one embodiment, controlling the light output of the integrated light source further includes turning on at least one of the integrated light sources when the dental instrument is in the intraoral position or the cheek traction position.

[0018] According to one embodiment, the dental instrument includes a forward light source and a backward light source opposite to the forward light source, the method comprising: turning on the forward light source and turning off the backward light source when the dental instrument is in an intraoral position; and turning on the backward light source and turning off the forward light source when the dental instrument is in a cheek traction position.

[0019] According to one embodiment, controlling the light output of the integrated light source includes turning off the integrated light source when the dental instrument is in an extraoral position.

[0020] According to one embodiment, the dental instrument further includes a motion sensor, and the method includes: activating an integrated optical sensor to capture optical signals when the motion sensor detects motion of the dental instrument.

[0021] According to one embodiment, the dental instrument is a dental mirror.

[0022] According to another aspect, a dental instrument is provided. The dental instrument includes: an optical sensor adapted to acquire optical signals; a light source operable to adjust light output; and a processor operatively communicating with the optical sensor and the light source, the processor being configured to receive and process the optical signals to determine the position of the dental instrument relative to a patient's oral cavity, and to send control signals to the light source to control the light output of the optical sensor based on the determined position.

[0023] According to one embodiment, the processor also includes a machine learning prediction model for processing optical signals to determine the position of dental instruments relative to the patient's mouth.

[0024] According to one embodiment, the processor further includes a transceiver communicating with a computer for downloading a machine learning prediction model from the computer, wherein, prior to downloading, the machine learning prediction model is initially trained by a computer-implemented classification module of the computer using machine learning to determine the position of dental instruments relative to a patient's mouth using multiple training images.

[0025] According to one embodiment, the dental instrument further includes a motion sensor, wherein when the motion sensor detects movement of the dental instrument, an optical sensor is activated to acquire optical signals.

[0026] According to one aspect, a method is provided for automatically controlling a dental instrument having an integrated light source and an integrated optical sensor. The method includes: capturing optical signals via the optical sensor; processing the optical signals to determine the position of the dental instrument relative to a patient's oral cavity; and controlling the light output of the light source and / or the operating mode of the optical sensor based on the determined position.

[0027] According to one aspect, a system is provided. The system includes: a dental instrument comprising: an optical sensor adapted to acquire optical signals according to at least one operating mode; a light source operable to adjust light output; and a processor operably communicating with the optical sensor and the light source, the processor being configured to receive and process the optical signals to determine the position of the dental instrument relative to a patient's oral cavity, and to send control signals to the light source and / or the optical sensor to control the light output of the optical sensor and / or the operating mode of the optical sensor based on the determined position. Attached Figure Description

[0028] The accompanying figures illustrate various features, aspects, and implementations of the technology described herein.

[0029] Figure 1 is a perspective view of a dental instrument including a head portion and a handle according to one embodiment.

[0030] Figure 2 is a top view of the head portion of the dental instrument shown in Figure 1.

[0031] Figure 3 is a top view of the head portion of the dental instrument shown in Figure 1.

[0032] Figure 4 is a top view of a printed circuit board that can be housed within the open-top housing of the head portion of the dental instrument shown in Figure 1.

[0033] Figure 5 is a bottom view of the printed circuit board shown in Figure 4.

[0034] Figure 6 is a partially exploded, cross-sectional perspective view of the head portion of the dental instrument shown in Figure 1, in which the outer diffuse layer and reflective layer are shown separately from the head portion.

[0035] Figure 7 is a block diagram illustrating a dental instrument control system according to one embodiment.

[0036] Figures 8 and 9 are flowcharts illustrating a method for automatically controlling a dental instrument having an integrated light source and an integrated optical sensor, according to one embodiment.

[0037] Figure 10 is a block diagram illustrating a dental instrument control system according to another embodiment.

[0038] Figure 11 is a flowchart illustrating a method for automatically controlling a dental instrument having an integrated light source and an integrated optical sensor according to another embodiment.

[0039] Figure 12 is a flowchart illustrating the generation of a machine learning prediction model according to one embodiment.

[0040] Figure 13 is a flowchart illustrating the processing of images received from a camera of a dental instrument and the control of the dental instrument according to one embodiment. Detailed Implementation

[0041] In the following description, various embodiments will be described with reference to the accompanying drawings. In each drawing, the same reference numerals denote similar elements. It should also be noted that, for the sake of brevity and to avoid overloading the drawings with multiple reference numerals, not all drawings contain references to all parts and features. Some parts and features may be referenced only in one drawing, but can be readily inferred in other drawings. Aspects or advantages described in connection with a particular embodiment are not necessarily limited to that embodiment and may be practiced in any other embodiment even without such description.

[0042] The terms “a”, “an” and “one” are defined herein as meaning “at least one”, that is, unless otherwise stated, these terms do not exclude a plural term.

[0043] Terms such as “basically,” “roughly,” and “about” used to modify the values, conditions, or characteristics of features of an exemplary embodiment are to be understood as indicating that the values, conditions, or characteristics are defined within tolerances acceptable for proper operation of the exemplary embodiment in its intended application.

[0044] Expressions such as “match,” “matching,” and “matched,” including their variations and derivatives, are intended in this document to refer to the state in which two or more elements are identical or within a predetermined tolerance of each other. That is, these terms are intended not only to cover a “complete” or “consistent” match between two elements, but also a “basic,” “roughly,” or “subjectively” match between two or more elements, as well as a higher or better match among multiple matching possibilities.

[0045] In this specification, the term "based on" is intended to mean "at least partially based on," that is, it can mean "based on only" or "partially based on," and therefore should not be interpreted in a restrictive manner. More specifically, the term "based on" can also be understood as "depending on," "representing," "instructing," "related to," or similar expressions.

[0046] This invention relates to a system for automatically controlling a dental instrument having an integrated light source and an integrated optical sensor, and a corresponding method for controlling the dental instrument. The term "dental instrument" as used herein refers to any tool that can be manipulated by a dental professional to provide dental treatment to a patient. A dental instrument can be inserted into a patient's oral cavity to examine, manipulate, treat, repair, and / or remove the patient's teeth and / or other biological elements within the patient's oral cavity, such as gums, saliva, palate, etc. The term "patient" as used herein refers to a subject undergoing dental treatment. In the embodiments described herein, "patient" refers to a human being; however, it is understood that the term "patient" can also be applied in the veterinary field, where the patient is an animal.

[0047] Referring to Figures 1 through 3, an embodiment of a dental instrument 10 is illustrated. In the illustrated embodiment, the dental instrument 10 is a dental mouth mirror and includes a handle 200 and a head portion 100 located at or near a longitudinal end 204 of the handle 200. The head portion 100 of the dental instrument 10 includes a reflective layer 120 having a reflective surface 122. In some embodiments, the reflective layer 120 may be, for example, a mirror or other type of wave reflector. When the dental instrument 10 includes the reflective layer 120, a dental professional can hold the handle 200 to manipulate the position of the head portion 100 to indirectly observe a given area within the patient's oral cavity reflected by the reflective surface 122 of the reflective layer 120. In some embodiments, the reflective layer 120 may be omitted and replaced with a non-reflective layer to achieve a configuration similar to the head portion 100 described herein, but without the reflective surface.

[0048] The head portion 100 may also include an open-top housing 110. The open-top housing 110 may include housing sidewalls 102 and housing bottom wall 104. The housing sidewalls 102 and housing bottom wall 104 may together define a cavity configured to accommodate internal components, such as a printed circuit board (PCB) including a light source and / or other electronic components.

[0049] In this embodiment, the housing sidewall 102 may be substantially cylindrical, and the housing bottom wall 104 has a substantially circular surface area. This combination of the housing sidewall 102 and housing bottom wall 104 can result in an open-top housing 110 that is cup-shaped, wherein the housing sidewall 102 is curved inward such that the diameter of the housing bottom wall 104 is smaller than the diameter at the top of the open-top housing 110. In some embodiments, the housing sidewall 102 may be substantially straight such that the diameter of the housing bottom wall 104 is substantially similar to the diameter at the top of the open-top housing 110. It is understood that the shapes of the housing sidewall 102 and housing bottom wall 104 may differ from those shown in the figures, depending on, for example, the configuration of the rest of the dental instrument 10 and its intended use. In some embodiments, such as when the dental instrument 10 is intended for illuminating a patient's oral cavity, the open-top housing 110 may be provided with edgeless or curved housing sidewalls 102 to improve patient comfort after the head portion 100 is introduced into the patient's oral cavity.

[0050] Referring to Figures 3 through 6, the head portion 100 includes light sources 133 and 135 that can be configured to emit light. More specifically, the head portion 100 may include forward light sources 133 positioned upward and away from the bottom wall 104 of the housing, for example, positioned towards the underside of the reflective layer 120 when it is present. In the illustrated embodiment, the forward light sources 133 are provided as components of a PCB 130 adapted to be housed within a cavity of the open-top housing 110. The forward light sources may be disposed on the upper surface 132 of the PCB 130. The PCB 130 may also include a rearward light source 135 disposed on the lower surface 134 of the PCB 130. In some embodiments, light sources 133 and 135 may include light-emitting diodes (LEDs). It will be understood that other types of light sources configured to emit light may also be used. In some embodiments, although not shown in Figures 4 and 5, light sources 133 and 135 may be contained in the central region of the PCB 130.

[0051] The head portion 100 may include an optical diffuser assembly 118. The optical diffuser assembly 118 is disposed between the PCB 130 and the reflective layer 120 and may be partially housed within the cavity of the open-top housing 110. In the illustrated embodiment, the optical diffuser assembly 118 may include an outer diffuser layer 140 and an intermediate diffuser layer 150. The intermediate diffuser layer 150 may be disposed closest to the forward light source 133 and may be "sandwiched" between the outer diffuser layer 140 and the forward light source 133. Therefore, when the optical diffuser assembly 118 includes the outer diffuser layer 140 and the intermediate diffuser layer 150, light emitted from the forward light source 133 can sequentially travel through the intermediate diffuser layer 150 and the outer diffuser layer 140.

[0052] As shown in Figure 3, the bottom wall 104 of the housing can be configured to accommodate a corresponding optical diffuser layer 160 therein. In the illustrated embodiment, the bottom wall 104 of the housing includes two optical diffuser layers 160, and can therefore be partially defined by the optical diffuser layers 160. The optical diffuser layers 160 can be configured to diffuse light emitted by the rearward light source 135. In some embodiments, the optical diffuser layers 160 can be made of a translucent or transparent material.

[0053] Forward light source 133 and backward light source 135 may be spaced apart from each other and positioned according to the light source distribution. The term "light source distribution" as used herein refers to the distribution of the light sources on PCB 130. Examples of light source distributions may be circumferential or peripheral light source distributions, as described below. It is understood that other forms of distribution are conceivable, such as random distributions where light sources 133 and 135 are randomly distributed, or distributions based on a given pattern of light sources 133 and 135.

[0054] Light sources 133 and 135 can be distributed according to a circumferential light source distribution, wherein at least some of light sources 133 and 135 are arranged along a circular profile concentric with a generally circular surface area of ​​the housing bottom wall 104 of the open-top housing 110. In the illustrated embodiment, light sources 133 and 135 are spaced apart from each other, and adjacent light sources among light sources 133 and 135 are arranged at regular intervals. In some embodiments, the circumferential light source distribution includes twenty-four (24) forward light sources 133 and sixteen (16) backward light sources 135 (as shown in Figures 4 and 5). It will be understood that more or fewer light sources 133, 135 may be included, depending on factors such as the selection of light sources, their illumination performance, other constraints within the open-top housing 110 and on the light diffuser assembly 118, and the intended use of the dental instrument. Other distribution configurations may also be considered depending on the shape and configuration of the open-top housing 110.

[0055] Referring to Figures 4 and 6, PCB 130 can operatively communicate with optical sensor 184. Reflective layer 120 can be a one-way mirror, wherein the upper surface of the mirror is reflective, and the lower surface of the one-way mirror is translucent or transparent. At least a portion 121 of reflective layer 120 can be superimposed on optical sensor 184, which in turn can be positioned on PCB 130. In some embodiments, a controller (e.g., microprocessor 139) can be mounted on PCB 130 and configured to control the light output of light source 133 and / or operate optical sensor 184. In some embodiments, PCB 130 can also mount a transceiver suitable for communicating with external devices. In some embodiments, the transceiver can include an antenna disposed in the handle 200 of a dental instrument for wireless communication with external devices. This antenna can communicate with components of PCB 130 via a wired connection.

[0056] Heating assembly 141 can be configured to generate heat to maintain reflective layer 120 and / or head portion 100 at a controllable temperature, for example, to prevent fogging when head portion 100 is inserted into a patient's mouth. In this embodiment, heating assembly 141 is mounted on PCB 130 and operatively communicates with microprocessor 139. Heating assembly 141 is located behind reflective layer 120 and is operable by microprocessor 139. Heating assembly 141 may include, for example, an electronically controllable heating element (e.g., a resistance heating element) and one or more temperature sensors for measuring the temperature of the heating element, the temperature at different locations in head portion 100, and / or measuring ambient temperature. However, it is understood that other configurations are also possible.

[0057] It is understood that the PCB and its related components (i.e., light sources 133, 135, optical sensor 184, microprocessor 139, transceiver, etc.) may be battery powered. In this embodiment, the battery is housed in the handle 200, but it is understood that other configurations are possible. In some embodiments, the battery may be rechargeable or disposable, depending on the configuration of the dental instrument.

[0058] Referring now to FIG7, an embodiment of a dental instrument control system 300 is shown. System 300 includes one or more processors 339 operatively communicating with a light source 333, an optical sensor 384, and one or more motion sensors 386 integrated into a dental instrument 310 (e.g., dental instrument 10 described above). However, it is understood that other configurations are also possible. For example, in some embodiments, system 300 may be configured to control other dental instruments having integrated light sources and / or optical sensors, such as saliva jets, air-water injectors, periodontal probes, etc. System 300 may also include an external device 330 having a display 340. In this embodiment, external device 330 is a tablet computer containing at least one of the one or more processors 339 and having a display 340 including a touchscreen. However, it is understood that other configurations are also possible. For example, in other embodiments, external device 330 may correspond to other computing devices, such as smartphones, personal computers, etc. In some embodiments, at least one of the one or more processors 339 may be included in the dental instrument 310.

[0059] Light source 333 can be operated to selectively adjust it. Selective adjustment can be understood as the ability to operate individual light sources to be turned on to emit light and to be turned off to stop emitting light. It is understood that selectively adjusting individual light sources can also include operating individual light sources at different power levels between 0% (fully off) and 100% (fully on). In some embodiments, light source 333 can correspond to the aforementioned light sources 133, 135 integrated into the dental instrument 10, such as forward light source 133 and backward light source 135. It is understood that selectively adjusting the light source can include individually adjusting a set of LEDs corresponding to the forward light source 133 and a set of LEDs corresponding to the backward light source 135. In some embodiments, selectively adjusting the light source can include adjusting a subset and / or individual LEDs in the forward and / or backward light sources 133, 135. It is understood that other configurations are also possible. For example, light source 333 can also include a light source on the handle 200 of the aforementioned dental instrument 10.

[0060] Optical sensor 384 is configured to capture optical signals corresponding to analog or digital signals generated by light conversion detected by the optical sensor. For example, in this embodiment, optical sensor 384 is provided as part of a digital camera, and the optical signals consist of images captured by the camera. The optical sensor can be operated between various operating modes. For example, operating modes may include an image acquisition mode and a sleep mode. An image acquisition mode may include operating the optical sensor to capture one or more images of the patient's mouth and / or surrounding environment. A sleep mode may include operating the optical sensor to stop capturing images or acquiring images. For example, in some embodiments, a sleep mode may correspond to the optical sensor being off, disabled, and / or operating in a low-power mode. It is understood that in some embodiments, the optical sensor may operate in sleep mode to remain on but not capture images.

[0061] In some embodiments, the operating modes may include a video streaming mode and a non-streaming mode. In video streaming mode, an optical sensor may be operated to stream acquired images to an external device 330, allowing the external device 330 (e.g., a tablet computer) to display the images. Streaming the acquired images may include the optical sensor acquiring images and transmitting the acquired images to the external device substantially in real time. The captured images correspond to a continuous sequence, such as a series of consecutive frames captured at a stable rate. For example, in video streaming mode, the optical sensor may be operated to transmit a real-time video feed to the external device 330. Thus, the real-time video feed may be displayed on a display 340 disposed on the external device 330. In non-streaming mode, the optical sensor may be configured to acquire images without streaming the acquired images to the external device 330. In some embodiments, non-streaming the acquired images may include capturing images but retaining them for local processing rather than transmitting them to the external device 330. In some embodiments, non-streaming the acquired images may include transmitting the acquired images to the external device 330 for processing by one or more processors 339, but not displaying them on the display 340 as a real-time video feed. For example, in flow-free mode, the optical sensor can be configured to capture individual images instead of a continuous sequence of images, and / or capture images at a lower resolution for subsequent processing by the processor in the dental instrument 310 and / or the processor on the external device 330, without displaying these images on the display 340.

[0062] In some embodiments, the operating modes may also include a high frame rate (FPS) mode and a low frame rate (FPS) mode. FPS (also known as frame rate) refers herein to the number of images (or frames) captured and / or streamed per second by the optical sensor. For example, a high FPS mode may correspond to a frame rate of 30 Hz (i.e., 30 frames per second) or higher, such as up to 60 Hz. A low FPS mode may correspond to a frame rate below 30 Hz. However, it is understood that other configurations are also possible. The expressions “high” and “low” frames per second can be defined relative to the capabilities of the optical sensor. For example, “high” frames per second can be used to refer to the maximum or near-maximum frame rate of the optical sensor, and / or a frame rate suitable for smooth video streaming. “Low” frames per second can be used to refer to a frame rate below the maximum frame rate. In one embodiment, an optical sensor with a maximum frame rate of 60 Hz may be provided. A high FPS mode may correspond to images captured at a frequency / rate of 60 Hz, 30 Hz, or even 24 Hz, while a low FPS mode may correspond to images captured at a lower frequency / rate (e.g., between 2 Hz and 5 Hz). The optical sensor can operate between high FPS and low FPS modes depending on power requirements and / or the temporal resolution level of the captured video needed for subsequent processing and / or display. For example, when displaying live video on an external device, the optical sensor can operate in high FPS mode to provide clear and smooth video. When the video captured by the optical sensor is not being displayed, it can operate in low FPS mode to save power.

[0063] In some embodiments, the operating modes may further include a high pixel resolution mode and a low pixel resolution mode. Pixel resolution, as used herein, refers to the number of pixels contained in an image captured and / or streamed by the optical sensor. A high pixel resolution mode may, for example, correspond to an image / frame suitable for high-definition (HD) resolution video, such as 720p, 1080p, or higher. A low pixel resolution mode may, for example, correspond to an image / frame suitable for standard-definition (SD) resolution video, such as 480p, 360p, or lower. It is understood that the terms "high" resolution and "low" resolution can be defined relative to the capabilities of the optical sensor. For example, "high" resolution may be used to refer to the maximum or near-maximum resolution of the optical sensor, while "low" resolution may be used to refer to a resolution below the maximum resolution. In one embodiment, an optical sensor with a maximum resolution of 800x800 pixels may be provided. High resolution may correspond to an image captured at 800x800 pixels, while low resolution may correspond to an image captured at a lower resolution, such as an image captured at 400x400 pixels, 200x200 pixels, etc.

[0064] Optical sensors can operate between high-pixel resolution and low-pixel resolution modes depending on power requirements and / or the pixel resolution level of the captured images / videos needed for subsequent processing and / or display. For example, when displaying live video on an external device, the optical sensor can operate in high-pixel resolution mode to provide a sharp image that allows for better discernment of visual details in the image. When the video captured by the optical sensor is not being displayed, it can operate in low-pixel resolution mode to conserve power.

[0065] It is understood that the optical sensor can operate according to different combinations of each of the streaming mode, FPS mode, and pixel resolution mode described above. For example, the optical sensor can operate simultaneously in low FPS mode, low pixel resolution mode, and no streaming mode. In such a configuration, the captured image has a lower resolution and is not streamed to the external device 330. As another example, the optical sensor can operate simultaneously in high FPS mode, high pixel resolution mode, and video streaming mode. In such a configuration, the captured image has a higher resolution and is streamed to the external device 330. It is understood that other combinations of configurations and / or modes are also feasible.

[0066] It is understood that the optical sensor 384 may be provided as part of a dental instrument, thereby allowing the capture of optical signals within the patient's oral cavity. For example, in some embodiments, the optical sensor 384 may correspond to the aforementioned optical sensor 184 integrated into the head portion of the dental instrument 10. In this configuration, the optical sensor 384 can capture optical signals when the head portion of the dental instrument is inserted into the patient's oral cavity. It is understood that the optical sensor 384 may be provided as part of an integrated camera having a lens with a working distance and / or maximum focal length suitable for capturing clear images of structures close to the camera when located within the patient's oral cavity. For example, the focal length of the camera may be 10 cm or less. In some embodiments, the camera may have an adjustable focal length, for example, a maximum focal length of 10 cm or less.

[0067] One or more processors 339 are configured to operationally communicate with an optical sensor. Operational communication with the optical sensor can be understood as the processors 339 being configured to communicate with the optical sensor 384 via wired or wireless communication to receive optical signals captured by the optical sensor 384 and / or transmit control signals to the optical sensor 384. It is understood that the optical signals may be received in different forms. For example, depending on the operating mode of the optical sensor, the processors 339 may receive individual images or real-time video streams.

[0068] One or more processors 339 are also configured to process the received optical signals. As will be described in more detail below, processing the optical signals may involve processing an image contained in the optical signals to determine the position of a dental instrument relative to the patient's mouth. The processor may also be configured to control the light source 333 and the optical sensor 384 based on the determined position. It is understood that the processor is also configured to operatively communicate with the light source 333 via a wired or wireless connection. For example, one or more processors 339 may send signals to control the light source 333 and / or operate the optical sensor 384. Sending signals to control the light source can be understood as the processors 339 being configured to provide commands to selectively turn the light source 333 on and / or off. Similarly, the so-called sending signals to operate the optical sensor 384 can be understood as the processor (one or more) 339 being configured to provide commands to cause the optical sensor 384 to operate between different operating modes, such as, as described above, between an image acquisition mode and a sleep mode, between a video streaming mode and a non-streaming mode, between a high FPS mode and a low FPS mode, and / or between a high pixel resolution mode and a low pixel resolution mode.

[0069] One or more processors 339 may be configured to perform logical operations to process optical signals captured by optical sensor 384 and / or control light source 333 and optical sensor 384. The processor may include any circuitry suitable for performing logical operations, including microprocessors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), multiprocessors, etc. For example, in embodiments where processor 339 includes a microprocessor, processor 339 may be configured to execute instructions stored in non-transitory memory. Processors 339 may be mounted on a circuit board along with the non-transitory memory.

[0070] The processor(s) 339 described herein may refer to one or more physical or logical processors. In this embodiment, the processor(s) 339 is provided as part of an external device 330 (e.g., a tablet computer). It is understood that other configurations are also possible. For example, in some embodiments, the processor(s) 339 may include circuitry disposed within a dental instrument 310. For example, at least a portion of the processor(s) 339 may be disposed on a PCB integrated as part of the dental instrument 310. In some embodiments, the processor(s) 339 may be disposed on both the external device 330 and the dental instrument 310, such that the functions performed by the processor(s) 339 (e.g., the functions described below) are distributed between the external device 330 and the dental instrument 310. It is understood that distributing the processor(s) 339 on the external device 330 may allow at least some processing to be offloaded from the dental instrument, thereby reducing the processing burden and corresponding power consumption of the dental instrument 310, and thus allowing for increased battery life.

[0071] One or more processors 339 may also be configured to display a video stream. Displaying a video stream may include providing an image received from an optical sensor in a user-observable format to a display 340. Thus, a display 340 may be configured to receive and display the video stream provided by one or more processors 339. In some embodiments, the processor may cause individual images to be displayed, for example, by providing individual images to the display 340.

[0072] In some embodiments, the display 340 may be disposed on the external device 330 and may be mounted on a circuit board together with one or more processors 339. For example, the display 340 may correspond to the screen of a tablet computer. It is understood that other embodiments are also possible, for example, the display may be separate from the external device 330, or it may be disposed on the external device and a separate device, such as on a tablet computer and a separate computer screen.

[0073] In this embodiment, the dental instrument 310 includes a wireless transceiver adapted to communicate with a transceiver in a tablet computer. The wireless transceiver in the dental instrument 310 can be adapted to transmit optical signals captured by the optical sensor 384 and receive control signals transmitted by one or more processors 339. It is understood that the transceiver in the tablet computer and the dental instrument can be configured to communicate via any suitable wireless communication method, such as Wi-Fi or Bluetooth. ® wait.

[0074] One or more motion sensors 386 are configured to detect the movement of the dental instrument 310 in three-dimensional space. For example, the motion sensors 386 may detect the form of translational and / or orientational changes of the dental instrument 310 and generate signals indicating such movement. Such signals may then be processed to determine whether the instrument is in motion (e.g., indicating that the instrument is being held or otherwise manipulated by a dental professional) or whether the instrument is stationary (e.g., indicating that the instrument is placed on a table or in a dental handheld retainer).

[0075] It is understood that the motion sensor 386 may include one or more accelerometers and / or one or more gyroscopes. The one or more accelerometers may be adapted to measure the rate of change of velocity of the dental instrument 310. The one or more accelerometers may include triaxial accelerometers adapted to detect the motion of the dental instrument 310 along three orthogonal axes. The one or more gyroscopes may be adapted to detect the orientation and / or angular velocity of the dental instrument 310 about the three orthogonal axes, such as pitch, roll, and yaw.

[0076] In some embodiments, one or more motion sensors 386 may include accelerometers and / or gyroscopes integrated into the handle of a dental instrument, for example, for detecting the position and / or orientation of the handle 200 of the dental instrument. In some embodiments, one or more motion sensors 386 may include accelerometers and / or gyroscopes integrated into the head of a dental instrument, for example, for detecting the position and / or orientation of the head portion 100 of the dental instrument.

[0077] Referring to Figure 8, a method 400 for automatically controlling a dental instrument using the system 300 described above is illustrated according to one embodiment. In summary, the method involves processing optical signals from optical sensors in the dental instrument to determine the position of the dental instrument relative to the patient's oral cavity, and controlling a light source and optical sensors based on the determined position.

[0078] The first step 410 of method 400 may include capturing an optical signal via an optical sensor. Capturing the optical signal may involve capturing one or more images using an optical sensor. For example, the optical sensor of a dental instrument may operate in an image acquisition mode to capture one or more images. In some embodiments, images may be captured continuously. For example, the optical sensor may be configured to function as a camera and capture multiple images per second. The optical signal may be sent to one or more processors for processing and / or display. In some embodiments, the optical signal may be transmitted in real time immediately after being captured by the optical sensor. In some embodiments, the optical signal may be transmitted after a predetermined amount of video and / or frames have been captured. For example, captured images may be temporarily stored in a buffer in the dental instrument's memory before being transmitted to one or more processors of an external device. After being transmitted to one or more processors, the buffer may be cleared and newly captured images stored therein.

[0079] The second step 420 of method 400 may include determining the position of a dental instrument relative to the patient's oral cavity. Determining the position of the dental instrument may include detecting whether the dental instrument is inside or outside the patient's oral cavity, and / or determining the position of the dental instrument inside or outside the patient's oral cavity. For example, in some embodiments, determining step 420 may include detecting whether the dental instrument is in an intraoral position, a cheek traction position, or an extraoral position (or a suspended position).

[0080] Intraoral position can correspond to a dental instrument being at least partially located within the patient's oral cavity. Being at least partially located within the patient's oral cavity can include the head portion of the dental instrument (e.g., the head portion 100 of the dental instrument 10 described above) being at least partially inserted into the patient's oral cavity. For example, in some embodiments, the dental instrument may be in an intraoral position if at least the optical sensor of the dental instrument is located within the boundaries of the patient's oral cavity and / or at a position that captures optical signals corresponding to the internal structures of the patient's oral cavity.

[0081] The cheek-retracting position can correspond to a dental instrument used to retract a patient's cheek from inside the patient's mouth. Cheek retraction means that at least a portion of the dental instrument is in contact with the cheek. For example, cheek retraction may include the head portion of the dental instrument 10 described above contacting the cheek. In some embodiments, when the cheek is retracted, a forward-facing light source and / or reflective surface disposed on the head portion of the dental instrument may face the cheek and / or be at least partially covered or obscured by the cheek. It is understood that the cheek-retracting position can correspond to when a dental professional manipulates the dental instrument, using the front of the head portion of the dental instrument (i.e., the surface where the forward-facing elements of the head portion (e.g., reflective surfaces, forward-facing light sources, optical sensors, etc.)) to contact or pull the patient's cheek.

[0082] Extraoral position can correspond to dental instruments being located outside the patient's oral cavity. For example, extraoral position can include dental instruments placed on a table or in a dental handheld retainer, or even held by a dental professional, in which case the head portion of the dental instrument is outside the boundary of the patient's oral cavity.

[0083] In this embodiment, in step 420, the position of the dental instrument is determined by processing optical signals received from the optical sensor using one or more processors. For example, the processors may process images captured by the optical sensor to determine the current position of the dental instrument. It is understood that the position of the dental instrument can be determined by processing individual images and / or a series of images. While the position of the dental instrument is determined by image processing in this embodiment, it is understood that in other embodiments, data from additional sensors may be used to assist in determining the position of the dental instrument. For example, signals from a motion sensor may also be processed to assist in determining the position of the dental instrument.

[0084] Now, in more detail, processing the image in step 420 to determine the position of the dental instrument may include detecting changes in one or more color parameters of the image. For example, detecting changes in one or more color parameters may include processing the image to detect changes in parameters such as hue, tint, shadow, saturation, and brightness. For example, the processor may determine that the dental instrument is in a cheek traction position and / or intraoral position by detecting that the hue of the image captured by the optical sensor is similar to a expected hue corresponding to the inside of the patient's mouth. For example, an image hue within different pink ranges may indicate that the dental instrument is in the patient's mouth. For example, the processor may determine that the dental instrument is in a cheek traction position by detecting that the image hue is in a range from deep pink to black. For example, when the dental instrument is used to traction the patient's cheek, and the camera is in contact with the cheek and / or the optical sensor is at least partially obscured by the cheek, the resulting image will be black or darker compared to when the dental instrument is in the patient's mouth and not in contact with the cheek. As another example, the processor may determine that the dental instrument is in an extraoral position by detecting that the hue of the image, or at least a portion of the image, is not within the range corresponding to a expected hue in the patient's mouth. For example, by detecting colors other than pinks within the image. For example, a processor can determine the position of a dental instrument in the mouth by detecting the color profile of the reflective environment caused by saliva in the patient's oral cavity.

[0085] In some embodiments, image processing may include processing a series of images to detect transitions in color parameters, such as transitions toward or away from pink or black, and / or transitions toward or away from a reflective environment. It is understood that any suitable technique can be used to detect hue and / or other color parameters and compare them to expected values. For example, statistical techniques may be applied. Such statistical techniques may include processing the image to generate a histogram, such as a color histogram representing one or more color channels in the image, and comparing the generated histogram with a reference histogram.

[0086] In some embodiments, processing the image in step 420 to determine the location of a dental instrument may include detecting one or more objects within the image. For example, one or more processors may determine whether a dental instrument is in an intraoral position by detecting one or more objects corresponding to structures within the patient's oral cavity. Such objects may include teeth, tongue, and / or saliva, etc. Similarly, in some embodiments, one or more processors may determine whether a dental instrument is in an extraoral position by detecting objects other than those corresponding to structures within the patient's oral cavity (i.e., any object other than teeth, tongue, and saliva). Object detection may be performed in various forms. In some embodiments, image recognition techniques may be applied to detect salient elements in the image. For example, detecting objects may include detecting the shape of teeth in the image.

[0087] It is understood that detecting changes in color parameters and / or object recognition can be performed using artificial intelligence (AI). In some embodiments, a machine learning (ML) model can be trained to determine whether one or more color parameters of an image correspond to expected color parameters of a human oral cavity. For example, an ML model can be trained on one or more datasets containing images of a patient's oral cavity. In some embodiments, the training dataset can include images labeled as corresponding to images of the interior of a human oral cavity, and images labeled as corresponding to images of the exterior of a human oral cavity and / or a dental clinic environment. Similarly, a machine learning model can be trained to detect objects corresponding to expected structures (e.g., tooth shapes) in a patient's oral cavity using one or more training datasets containing such object images with corresponding labels. In some embodiments, two separate machine learning models can be trained to perform detection techniques independently. In some embodiments, the machine learning model can be provided on an external device 330 and can be executed by one or more processors 339. For example, in some embodiments, the machine learning model can be integrated as part of a tablet computer and communicate with one or more processors 339 to perform the detection of objects and / or color parameters in an image. Other examples of machine learning implementations will be further detailed below.

[0088] In some embodiments, in step 420, the position of the dental instrument relative to the patient's mouth can be determined based on the maximum focal length of the camera used to capture images from the dental instrument. The maximum focal length may correspond to the maximum distance between the camera lens and the subject being photographed, within which the camera can capture a clear and / or focused image of the subject. The camera can capture an image of the subject up to the maximum focal length before the image becomes out of focus and blurry. It is understood that the maximum focal length can be a fixed property of the camera, based on the camera's lens properties. For example, a camera mounted on a dental instrument may have a fixed or adjustable lens with a known maximum focal length of approximately 10 cm. Therefore, it is understood that a focused image corresponds to a subject within 10 cm, while an out-of-focus image corresponds to a subject farther than 10 cm and therefore outside the patient's mouth. Therefore, in step 420, it can be determined whether the camera is focused on the subject. If the camera is determined to be focused, the position of the dental instrument can be determined to be intraoral. If the camera is determined to be out of focus, the position of the dental instrument can be determined to be extraoral.

[0089] In some embodiments, determining camera focus may involve one or more processors determining whether an image captured by an optical sensor is blurry. For example, a sharp or clear image (i.e., an image without blur) may be identified as focused by one or more processors. Similarly, a blurry image may be identified as out of focus by one or more processors 339. It is understood that one or more processors 339 may use any suitable image processing technique to determine the blur and / or sharpness of an image.

[0090] In some embodiments, determining the camera's focus can be based on other signals received from the camera. For example, the camera can be configured to generate a focus status indicator that indicates whether the camera is in focus or out of focus. The camera can then transmit the focus status to one or more processors via a corresponding signal. In some embodiments, the focus status can be transmitted to one or more processors whenever the optical sensor captures a new optical signal (e.g., each time the optical sensor captures a new image). In some embodiments, the focus status can be transmitted to one or more processors whenever the camera refocuses (e.g., as part of the camera's autofocus function). For example, when a change in the position of a dental instrument causes the camera to refocus, the focus status can be transmitted to one or more processors. It is understood that other configurations are also possible, such as the camera periodically or continuously transmitting the focus status to one or more processors regardless of whether a new image is captured or the focus is adjusted.

[0091] Once the position of the dental instrument relative to the patient's mouth is determined, the electronic components of the dental instrument can be operated based on the determined position. In this embodiment, subsequent steps 430a, 430b, and 430c of method 400 include controlling the light output of a light source based on the determined position. It is understood that controlling the light output may include adjusting the light output of at least one of the light sources, for example, by turning at least one of the light sources on and / or off. For example, when it is determined that the dental instrument has changed from one position to another, one or more processors may send signals (e.g., control signals) to control the output of at least one of the light sources. In some embodiments, sending control signals may involve one or more processors providing instructions each time the state of the light source is to be changed. For example, one or more processors may transmit instructions to switch the light source on / off according to the current state of the light source. For example, when the light source is initially turned on, the instructions sent by one or more processors may turn it off. Similarly, when the light source is initially turned off, the instructions sent by one or more processors may turn it on. In some embodiments, transmitting signals may include one or more processors continuously providing signals to the light source to keep it on and stopping the signal when the light source is to be turned off. In such an embodiment, the control signal may correspond to the control voltage provided to each light source.

[0092] As described above, dental instruments may include forward-facing light sources and backward-facing light sources. In some embodiments, the forward-facing light sources may operate together as a first group, and the backward-facing light sources may operate together as a second group. In such embodiments, one or more processors may be configured to transmit signals based on the determined position of the dental instrument to turn either the first or second group of light sources on or off. It is understood that control of the light output of the light sources can be performed in various forms.

[0093] In this embodiment, after determining that the dental instrument is in the intraoral position, the forward light source is turned on, while the backward light source is turned off 430a. In some embodiments, when the dental instrument is moved from an extraoral position to an intraoral position, one or more processors may be configured to send a signal to turn on only the forward light source. In this case, since the dental instrument was initially in the extraoral position and the backward light source has already been turned off, the processors do not need to send a signal to turn off the backward light source. In some embodiments, when the dental instrument is moved from a buccal traction position to an intraoral position, one or more processors may be configured to send a signal to turn on the forward light source and turn off the backward light source.

[0094] After determining that the dental instrument is in the buccal traction position, the rearward light source is turned on, while the forward light source is turned off 430b. In some embodiments, when the dental instrument is transitioned from the intraoral position to the buccal traction position, one or more processors may be configured to send a signal to turn on the rearward light source and turn off the forward light source. It is understood that in some embodiments, one or more processors may also be configured to maintain a certain stabilization period before turning on the rearward light source during the transition from the intraoral position to the buccal traction position. For example, the stabilization period may include the processor waiting for at least two seconds after detecting that the dental instrument is in the buccal traction position and after turning off the forward light source before turning on the rearward light source. More specifically, the stabilization period may include the processor waiting for the detected image to stabilize for at least two seconds before continuing to turn on the rearward light source. It is understood that the stabilization period can allow for the avoidance of rapid switching or flickering between light sources during the transition to the buccal traction position. It is also understood that other configurations with a stabilization period greater than or less than 2 seconds may also be considered. For example, in some embodiments, the stabilization period may be 1 second. In some embodiments, the stabilization period may be implemented by a microprocessor disposed in the dental instrument. For example, a microprocessor can receive instructions from a tablet computer processor to change the state of a light source and hold the change for two seconds before executing it.

[0095] After determining that the dental instrument is in the extraoral position (also known as the suspended position), both the rear and front light sources are turned off 430c. In some embodiments, when the dental instrument is switched from the intraoral position to the extraoral position, one or more processors may be configured to send a signal to turn off only the front light source. In the intraoral position, the rear light source is already turned off. Therefore, when switching from the intraoral position to the extraoral position, one or more processors do not need to send a signal to turn off the rear light source. In some embodiments, the extraoral position may be the default position when the dental instrument is initially turned on. Therefore, during device initialization, one or more processors may not transmit an instruction to turn on at least one of the light sources.

[0096] In this embodiment, after determining the position of the dental instrument, another subsequent step 440 of method 400 includes controlling the operating mode of the optical sensor. Controlling the operating mode may include one or more processors sending instructions to the optical sensor regarding how images should be captured and / or how the captured images should be transmitted to an external device. For example, one or more processors may instruct the optical sensor on what streaming mode and / or what FPS mode it should operate in.

[0097] Controlling the operating mode may include operating the optical sensor in a no-flow mode and a low-FPS mode 440a. In this embodiment, after determining that the dental instrument is in an extraoral position or a buccal traction position, the optical sensor operates in a no-flow mode and a low-FPS mode. It is understood that operating the optical sensor in low-FPS mode may include transmitting instructions to adjust the frame rate of the images captured by the optical sensor to a predetermined low frame rate. For example, the low frame rate may be below 30 FPS. Reducing the frame rate of the optical sensor in this way can allow for a reduction in the power consumption of the optical sensor. It is also understood that operating the optical sensor in no-flow mode may include causing the optical sensor to transmit the captured images for processing by one or more processors, but not for real-time display or streaming on an external device. For example, the optical sensor may continue to transmit the captured images to one or more processors on a tablet computer, solely for determining the current position of the dental instrument.

[0098] The control operation mode may also include operating the optical sensor in both video streaming mode and high FPS mode 440b. In this embodiment, the optical sensor operates in both video streaming mode and high FPS mode when the dental instrument is in the intraoral position. It is understood that operating the optical sensor in high FPS mode may include transmitting instructions to adjust the frame rate of the images captured by the optical sensor to a predetermined high frame rate. For example, the high frame rate may be equal to or greater than 30 FPS, or other frame rates suitable for real-time streaming video. It is also understood that operating the optical sensor in video streaming mode may include transmitting the images captured by the optical sensor to an external device so that they can be displayed. For example, the images captured by the optical sensor may be transmitted to a tablet computer and displayed on the tablet computer's screen. In some embodiments, continuously captured images by the optical sensor may be displayed as a real-time stream on the tablet computer. It is understood that this operation mode allows dental professionals to directly observe the inside of a patient's mouth on a tablet computer and to observe areas within the mouth that may be difficult to see with the naked eye. It may also allow multiple people to observe the inside of the mouth. For example, a dental professional can show the inside of the mouth to a patient or other professionals via a display.

[0099] It is understandable that when a dental instrument is in the intraoral position, a dental professional may only want to activate the light source without streaming video for display. In this embodiment, this can be achieved by operating the dental instrument in free mode. Free mode can be triggered by an external command performed by the dental professional. The external command can be performed in various forms. For example, in some embodiments, a button can be provided on the dental instrument, which can be operated to switch between different operating modes. In some embodiments, free mode can be accessed via a software application on an external device and displayed on a display. For example, free mode can be toggled on or off via a button through a graphical user interface accessible via a tablet computer display. In this embodiment, after determining that the dental instrument is in the intraoral position, subsequent step 441 involves determining whether the dental instrument is currently operating in free mode. If it is determined that the dental instrument is operating in free mode, optical sensor 440a is operated in a no-stream and low-FPS mode. If it is determined that the dental instrument is not operating in free mode, optical sensor 440b is operated in a video streaming and high-FPS mode, for example to allow the use of the optical sensor to capture images and / or stream video.

[0100] Although the operation of the light source and optical sensors has been described above, it is understood that other electronic components of the dental instrument can also be operated based on the determined position of the dental instrument relative to the patient's mouth. For example, in embodiments where the dental instrument includes a heating component (such as heating component 141 described above), the heating component can be operated to maintain a defined temperature after determining that the dental instrument is at an intraoral temperature. For example, the defined temperature may correspond to approximately 37°C and / or a temperature adjusted according to a measured ambient temperature. After determining that the dental instrument is in an extraoral position, the heating component can be deactivated and / or kept in a low-power mode. The heating component can be controlled by a microprocessor by providing corresponding control signals and / or voltages.

[0101] Understandably, once a dental procedure is complete, dental professionals may wish to turn off dental instruments and disconnect the power to their electronic components. In this embodiment, this can be achieved by operating the dental instrument into an exit state. The exit state can be triggered by an external command performed by the dental professional. External commands can be executed in various forms. For example, in some embodiments, a button can be provided on the dental instrument, and this button can be operated to enter the exit state. In some embodiments, the exit state can be triggered via a software application on an external device. For example, the exit state can be triggered via a button provided on a graphical user interface provided by a tablet computer display. In some embodiments, the exit state can be triggered automatically, for example, after determining that the dental instrument has been placed on a table, in a dental handheld retainer, and / or otherwise stationary for a predetermined amount of time.

[0102] In this embodiment, the subsequent step 443 of method 400 involves determining whether an exit state has been triggered. If it is determined that the exit state has been triggered, the power to the LED and / or other electronic components can be turned off and / or placed in standby or low-power mode 445. Method 400 can then reach and end 447, at which point the dental instrument is turned off, for example, requiring reinitialization of the dental instrument before restarting method 400. If it is determined that the exit state has not been triggered, the steps of method 400 can be repeated, for example, continuing to receive and process input from the optical sensor in step 410.

[0103] The method 400 described above typically involves interpreting and / or processing optical signals to determine the position of a dental instrument. Therefore, method 400 can be performed when the dental instrument is in an image acquisition mode, in which the optical sensor is actively capturing optical signals and / or images. However, it is understood that the dental instrument can operate in other modes where the optical sensor is not actively capturing images, such as a power-off mode and / or a sleep mode. Therefore, referring to FIG9, a preliminary initialization process 500 can be performed to place the dental instrument (e.g., a component of the control system 300) in a state capable of detecting and processing optical signals and initiating a process for capturing optical signals 410 to perform subsequent steps of method 400.

[0104] Roughly described, the initialization process 500 may involve initializing the aforementioned system component 300 to allow the capture of optical signals and / or images by the optical sensor for subsequent processing. Initialization may primarily involve preparing the system components to function and perform the steps of method 400. For example, a first initialization step 510 may be performed when the system is powered on. The expression "powered on" here means the transition of a system component from a previously inactive state to an active state, i.e., from a power-off state or a sleep state. In some embodiments, initialization step 510 may include initializing the optical sensor 512 and initializing the external device 514. Initializing the optical sensor 512 may include powering the optical sensor 512 and / or applying initial parameters to the optical sensor. For example, applying initial parameters may include applying a low FPS mode and a no-current mode as the default operating mode for the optical sensor. In some embodiments, when the optical sensor 512 is initialized, it may be placed in a standby mode, for example, to wait for subsequent commands before capturing and / or transmitting optical signals and / or images. Initializing the external device 514 may include initializing one or more processors to a state where they begin receiving optical signals and / or images from the optical sensor. Initialization step 514 may include initializing an image and / or video server on an external device, causing the server to begin listening for communications from dental instruments. In some embodiments, the initialization step may also include verifying and / or testing communication with optical sensors to verify that the processor(s) can receive optical signals.

[0105] Following system component initialization 510, subsequent steps 520 may include detecting movement of the dental instrument via motion sensors (such as the motion sensors 386 described above). For example, signals generated by the motion sensors may be processed by a microprocessor located on the dental instrument or external device to identify patterns representing movement of the dental instrument. For instance, the motion sensors may detect changes in the position and / or orientation of the dental instrument, indicating that a dental professional is manipulating the instrument.

[0106] In this embodiment, if motion is detected after step 520, the optical sensor can be operated to begin capturing and transmitting optical signals and / or images. For example, after detecting a signal indicating motion, the optical sensor can operate in image acquisition mode, allowing it to begin transmitting images to one or more processors, and enabling the execution of method 400 described above. After initialization 512 and before motion detection, the optical sensor can remain active and capture images, but does not store and / or transmit such images. Therefore, after the motion sensor detects motion, the optical sensor can be operated to begin transmitting images to one or more processors.

[0107] If the motion sensor does not detect motion after step 520, the optical sensor can enter sleep mode 525. Sleep mode 525 can be triggered after a specific period of inactivity. For example, if the motion sensor does not detect motion for a certain number of seconds or minutes, the optical sensor and / or other components of the dental instrument can be placed in sleep mode. In some embodiments, sleep mode may involve the optical sensor continuing to capture images but no longer transmitting data to one or more processors. In some embodiments, the optical sensor may simply be turned off and / or placed in a low-power or standby state, in which it does not capture images. It is understood that placing components of the dental instrument in sleep mode when the dental instrument is not in use can reduce power consumption and increase battery life.

[0108] In this embodiment, even when the dental instrument is in sleep mode, one or more motion sensors can remain active and ready to detect new movements. Therefore, in step 530, if movement is detected while the dental instrument is in sleep mode, an action can be taken based on the detected movement. Specifically, a component of the dental instrument can be awakened from its sleep mode, for example, by sending a signal to activate an optical sensor. Once the component of the dental instrument is awakened, the signal from the motion sensor can be processed again in step 520 to detect movement and perform a corresponding action, such as starting image acquisition and processing 400, or re-entering sleep mode 525.

[0109] In some embodiments, subsequent step 540 may involve shutting down or turning off the dental instrument. Shutting down the dental instrument may include turning off all components of the dental instrument (i.e., light source, optical sensor, motion sensor). The dental instrument 540 can be turned off by pressing a button provided on the dental instrument. In some embodiments, the dental instrument can be turned off remotely using controls available on an external device. Specifically, a command to turn off the dental instrument can be executed via a button provided by a software application available on a tablet computer. Thus, one or more tablet computer processors can send instructions to the microprocessor of the dental instrument to shut down its components.

[0110] Referring now to FIG. 10, another embodiment of a dental instrument control system 300' is shown. System 300' includes a dental instrument 310' and an external device 330'. In this embodiment, dental instrument 310' includes one or more processors 390 that operatively communicate with a light source 333, an optical sensor 384, and one or more motion sensors 386, all of which are integrated within dental instrument 310', such as in dental instrument 10 described above. Dental instrument 310' also includes a memory 338 (e.g., non-volatile memory, such as electrically erasable programmable read-only memory or other programmable memory) operatively connected to the processor 390 of dental instrument 310'. In some embodiments, memory 338 may be embedded within one or more processors 390 of dental instrument 310' (e.g., as part of a system-on-a-chip SOC), while in other embodiments, memory 338 may be provided separately and communicate with processor 390 via a PCB. In some embodiments, the processor(s) 390 of the dental instrument(s) may include a dedicated microprocessor, for example, such as a T31 video processor or other suitable processor of other types.

[0111] System 300' may also include an external device 330'. In this embodiment, external device 330' includes at least one processor 339, which is separate from and distinct from the processor(s) 390 of dental instrument 310'. The processor(s) 339 of external device 330' may be operatively connected to the processor(s) 390 of dental instrument 310' and may also be operatively connected to the memory 338 of dental instrument 310', for example, via a wired or wireless connection. In some embodiments, external device 330' may also include a display 340.

[0112] However, it is understood that other configurations are also possible. For example, in other embodiments, external device 330' may correspond to other computing devices, such as smartphones, personal computers, etc.

[0113] The light source 333 can be selectively adjusted. Selective adjustment can be understood as the ability of a single light source to be operated to turn on to emit light and to turn off to stop emitting light. In some embodiments, the light source 333 may correspond to the light sources 133 and 135 integrated into the dental instrument 10 as described above, such as a forward light source 133 or a front LED and a rear light source 135 or a rear LED, wherein the front LED and / or the rear LED can be selectively turned on and off.

[0114] The optical sensor 384 is configured to capture optical signals corresponding to analog or digital signals generated by the conversion of light detected by the optical sensor. For example, in this embodiment, the optical sensor 384 is provided as part of a digital camera, and the optical signals consist of images captured by the camera. The optical sensor can operate between an image acquisition mode and a video streaming mode. In image acquisition mode, the optical sensor can be operated to capture one or more images of the patient's mouth and / or surrounding environment.

[0115] In video streaming mode, an optical sensor can be operated to stream acquired images to an external device 330', allowing the external device 330' (e.g., a tablet computer) to display the images. The streamed acquired images may include the optical sensor acquiring images via one or more processors 390 of the dental instrument 310' and transmitting the acquired images substantially in real time to one or more processors 339 of the external device 330'. The captured images correspond to a continuous sequence, such as a series of consecutive frames captured at a stable rate. For example, in video streaming mode, the optical sensor can be operated to transmit a real-time video feed to the external device 330'. Therefore, the real-time video feed can be displayed on a display 340 located on the external device 330'.

[0116] In both image acquisition mode and video streaming mode, the optical sensor 384 operates at a uniform frame rate, such as 30Hz (i.e., 30 frames per second) or lower.

[0117] It is understood that the optical sensor 384 may be provided as part of a dental instrument, thereby allowing the capture of optical signals within the patient's oral cavity. For example, in some embodiments, the optical sensor 384 may correspond to the aforementioned optical sensor 184 integrated into the head portion of the dental instrument 10. In this configuration, the optical sensor 384 can capture optical signals when the head portion of the dental instrument is inserted into the patient's oral cavity. It is understood that the optical sensor 384 may be provided as part of an integrated camera having a lens with a working distance and / or maximum focal length suitable for capturing clear images of structures close to the camera when located within the patient's oral cavity. For example, the focal length of the camera may be 10 cm or less. In some embodiments, the optical sensor 384 operates not in an autofocus mode, but rather with a constant focal length.

[0118] One or more processors 390 of the dental instrument 310' are configured to perform operational communication with one or more processors 339 of the external device 330'. Operational communication can be understood as the dental instrument 310's processors 390 being configured to communicate with the external device 330's processors 339 via wired or wireless communication to receive optical signals captured by the optical sensor 384 and / or transmit control signals to the optical sensor 384. It is understood that the optical signals can be received in different forms. For example, depending on the operating mode of the optical sensor, the dental instrument 310's processors 390 can receive individual images or real-time video streams.

[0119] The dental instrument 310's processor(s) 390 are also configured to process the received optical signals. As will be described in more detail below, processing the optical signals may involve processing an image contained in the optical signals to determine the position of the dental instrument relative to the patient's oral cavity. The processor(s) 390 may also be configured to control the light source 333 and the optical sensor 384 based on the determined position.

[0120] Understandably, the processor 390 of the dental instrument 310' is configured to operatively communicate with the motion sensor 386, optical sensor 384, and light source 333 to receive and process images from the optical sensor 384, control the light source 333, and / or operate the optical sensor 384 in a fully autonomous mode without any connection and / or communication with external device 330'.

[0121] Artificial intelligence implementation: Referring to Figures 11 to 13, another embodiment of a method 600 for automatically controlling dental instruments is described. This method 600 can be performed on a control system 300' as described above.

[0122] In summary, the method includes a first step: detecting movement of a dental instrument via a motion sensor 610. The signal generated by the motion sensor can be processed by a processor 390 disposed on the dental instrument 310' to identify patterns representing movement of the dental instrument. For example, the motion sensor can detect changes in the position and / or orientation of the dental instrument, indicating that a dental professional is manipulating the instrument.

[0123] In this embodiment, if the motion sensor does not detect motion after step 612, the dental instrument 310' can enter sleep mode 615. Sleep mode 615 can be triggered after a specific period of inactivity. For example, if the motion sensor does not detect motion for a certain number of seconds or minutes, the dental instrument 310' can be placed in sleep mode. In some embodiments, the dental instrument 310' can simply be turned off and / or placed in a low-power or standby state. It is understood that placing the components of the dental instrument in sleep mode when the dental instrument is not in use can reduce power consumption and increase battery life.

[0124] In this embodiment, the motion sensor can remain active and ready to detect new movements even when the dental instrument is in sleep mode. Therefore, in step 612, if movement is detected while the dental instrument is in sleep mode, an action can be taken based on the detected movement.

[0125] In this embodiment, if motion is detected in step 612, the automatic mode 620 of the dental instrument 310' is activated. In automatic mode, the dental instrument 310' can operate independently without any communication with the external device 330'. Once the control system 300' is placed in automatic mode, the optical sensor 384 can be operated to begin capturing and transmitting optical signals and / or images. For example, upon detecting a signal indicating motion, the optical sensor 384 can operate in image acquisition mode 622 so that the optical sensor can begin capturing one or more pictures or images and transmitting the images to one or more processors 390 of the dental instrument 310'. In some embodiments, in image acquisition mode, the optical sensor is configured to generate a video stream containing multiple images per second, and one or more processors 390 can be configured to sample a portion of the video stream for processing. For example, one or more processors 390 can be configured to process four (4) images per second.

[0126] In this embodiment, the image captured by the optical sensor 384 is processed by processor(s) 390 using a machine learning prediction model 624. The machine learning is configured to predict position 626 by interpreting and / or processing the image using a pre-trained artificial intelligence model to determine the position of the dental instrument, as will be further detailed below with reference to Figures 12 and 13. Specifically, the system can use the machine learning prediction model to predict the position of the dental instrument. For example, in some embodiments, the system can predict whether the dental instrument is in an intraoral position, a buccal traction position, or an extraoral position (or a suspended position).

[0127] In some embodiments, objects appearing in an image can be used to explicitly or implicitly enhance a machine learning model to predict location. For example, teeth, tongue, and / or saliva identified in an image can indicate that a dental instrument is in an intraoral position. Objects identified in an image other than those corresponding to structures inside the patient's mouth (i.e., any object other than teeth, tongue, and saliva) can indicate that a dental instrument is in an extraoral or suspended position. An image without any objects, a black image, or a red image can indicate that a dental instrument is in a cheek traction position.

[0128] In some embodiments, the model can be configured to explicitly predict whether the dental instrument is in one of two positions (e.g., intraoral or buccal retraction), and if not, the system can be configured to infer that the dental instrument is in a third position (e.g., extraoral).

[0129] Referring to Figure 12, the process for training the machine learning prediction model 700 is illustrated. For example, the machine learning prediction model can be initially trained using a classification module implemented on a separate device (e.g., external device 330'). Offloading the training from the dental instrument allows for a reduction in the processing burden and corresponding power consumption of the dental instrument 310', thereby allowing for increased battery life.

[0130] Training the machine learning prediction model 700 may include providing a database 705 containing multiple training images or manually annotated images 710 to determine the position of the dental instrument 310' relative to the patient's oral cavity. For example, the training images 710 may include multiple images labeled as corresponding to images captured intraorally, multiple images corresponding to images captured in a buccal traction position, and multiple images captured extraorally. For example, the training images 710 may be acquired using a similar dental instrument 310' in a controlled environment.

[0131] A minimum number of training images can be provided to ensure proper training of the machine learning prediction model. For example, at least twenty (20) training images per location can be provided, but other numbers, such as hundreds, can also be considered. Having hundreds of training images can improve the success rate of location prediction. It is understood that the training images can contain a wide range of variations to improve the robustness of the trained model. For example, training images can be captured under various lighting conditions and / or in various environments. As another example, intraoral and buccal traction images can be captured from the mouths of various different patients with anatomical differences. In some embodiments, a database 705 containing multiple training or annotated images 710 can be stored on the memory 395 of an external device 330'.

[0132] In some embodiments, the training image 710 may be further preprocessed 720, for example, to improve its quality, control white balance, or reduce its size. In another embodiment, the training image 710 may be used without any preprocessing 720.

[0133] The machine learning prediction model can then be trained 730 using a computer-implemented classification module of one or more processors 339 of external device 330'. The machine learning prediction model can be trained on training images 710 using any suitable supervised machine learning algorithm. As a result, a new machine learning prediction model 740 can be generated.

[0134] In some embodiments, the performance of the new machine learning prediction model 740 can be evaluated. For example, if at least a certain percentage of the images are correctly predicted, the new machine learning prediction model 740 can be evaluated as meeting a predetermined performance criterion 750. For example, the percentage of correct predictions could be 70%, that is, if at least 70% of the images are correctly predicted, the new machine learning prediction model 740 can be evaluated as meeting the performance criterion.

[0135] If the new machine learning prediction model 740 does not meet the performance criteria, the process can return to the training step 730, where the machine learning algorithm and / or hyperparameters can be adjusted as needed. If the new machine learning prediction model 740 meets the performance criteria, it can be encoded 760 into a binary machine learning prediction model 770. The binary machine learning prediction model 770 can have a format suitable for the architecture of the dental instrument 310'. Specifically, the binary machine learning prediction model 770 can be encoded to be compatible with one or more processors 390 of the dental instrument 310'.

[0136] Once coded, the new binary machine learning prediction model 770 can be pushed 780 to the dental instrument 310'. In some embodiments, the binary machine learning prediction model 770 can be pushed 780 to the dental instrument 310' via a firmware update downloaded to the dental instrument 310'. In some embodiments, the firmware update download can be accomplished wirelessly, such as via Wi-Fi or Bluetooth. ® In some embodiments, firmware updates can be downloaded via any other suitable communication process (wired or wireless). In some embodiments, one or more processors 339 of external device 330' can download firmware updates to the memory 338 of dental instrument 310', and one or more processors 390 of dental instrument 310' can restart on the downloaded firmware update in the next power-on cycle of dental instrument 310'. Once the new binary machine learning prediction model 770 is loaded onto dental instrument 310', the new binary machine learning prediction model 770 can operate independently without receiving updates from external device 330'.

[0137] Referring to Figure 13, the steps of predicting position 626 are further described in one embodiment. The optical sensor 384 can operate in image acquisition mode 622, allowing the optical sensor or camera to capture one or more pictures or images as an image stream 800 accessible by one or more processors 390. The processors 390 are configured to select a window of M images 810 from the images in the received stream 800. In some embodiments, for each of the received M images 820, 820', the processor can further preprocess each image 825, 825', for example, to improve its quality, control white balance, or reduce its size. In another embodiment, the received M images 820, 820' can be directly transmitted to the machine learning prediction model 624 without preprocessing 825, 825'.

[0138] As described above, each of the M images can be provided as a separate input to the machine learning prediction model 624. Therefore, for each of the M images received by the machine learning prediction model 624, the predicted position 830, 830' of the dental instrument 310' relative to the patient's mouth is predicted.

[0139] In some embodiments, the predicted positions 830, 830' of the quantity M are further post-processed 840 to determine new predicted positions 626. The post-processing of the predicted positions 830, 830' of the quantity M may further include comparing the predicted positions 830, 830' of the quantity M of dental instruments 310', and adjusting the new predicted positions 626 of the dental instruments if at least a predetermined percentage of the predicted positions 830, 830' of the quantity M are similar.

[0140] For example, image stream 800 may be sampled at a rate of 4 images per second, and processor 390(s) of dental instrument 310' may select a window of M=4 images. If at least 75% of the predicted positions 830 and 830' are similar in number M, i.e., at least 3 out of 4 predicted positions 830 and 830' are similar, the new predicted position 626 of the dental instrument may be adjusted. Therefore, the new predicted position 626 is updated approximately once per second. In other embodiments, other image stream rates may be considered, other numbers M of images may be selected, and other percentages of similar predicted positions may be considered.

[0141] Once the new predicted position 626 is determined, the processor(s) 390 of the dental instrument 310' can further compare the new predicted position 626 with the state of the light source 333 integrated in the dental instrument 310' (i.e., the state of the front LED and the state of the rear LED) 860. If the new predicted position 626 requires the LED state to be modified, the processor(s) 390 can further transmit a new LED state command 870 to the light source or LED 880, as will be described in detail below. Therefore, the LED state 890 will be updated in the next cycle of comparison 860.

[0142] Referring back to Figure 11, once the new predicted position 626 of the dental instrument relative to the patient's oral cavity is determined, the processor(s) 390 of the dental instrument 310' can further control the light output of the light source based on the new predicted position 626. It is understood that controlling the light output may include turning the LED on and / or off before, and turning the LED on and / or off after.

[0143] After the dental instrument 310' is determined to be in the extraoral position (also known as the suspended position) 628c, both the rear LED and the front LED are turned off 630c.

[0144] Once the dental instrument 310' is in the buccal traction position (also known as the buccal position) 628b, the rear LED is turned on while the front LED is turned off 630b.

[0145] After the dental instrument 310' is determined to be in the intraoral position (also known as the oral cavity position) 628a, the front LED turns on and the rear LED turns off 630a.

[0146] As long as automatic mode 620 is activated, or until exit mode 640 is detected, the steps of image acquisition 622, machine learning prediction model prediction 624, position prediction 626, and control of light sources 630a, 630b, and 630c can be continuously repeated. A dental professional can activate exit mode 640 by turning off the dental instrument 310' and disconnecting the power to its electronics. In this embodiment, exit mode 640 can be triggered by an external command executed by the dental professional. The external command can be executed in various forms. For example, in some embodiments, a button can be provided on the dental instrument 310' and operated to enter exit mode 640. In some embodiments, exit mode can be triggered by a voice command. In some embodiments, exit mode can be triggered automatically, for example, after determining that the dental instrument has been placed on a table, in a dental handheld retainer, and / or otherwise stationary for a predetermined amount of time. When the dental instrument 310' is detected to be in exit mode 640, both the rear and front LEDs are turned off 645. The above embodiments allow the dental instrument 310' to be operated in an automatic mode independent of external device 330'.

[0147] In some embodiments, dental professionals can also deactivate the automatic mode 620 by operating a button on the dental instrument 310', by voice command, by checking the dental instrument in a predetermined sequence, or by any other means of controlling the dental instrument.

[0148] When the dental instrument 310' is deactivated from automatic mode 620, the dental instrument 310's processor(s) 390 can be configured to receive command 650. This mode can be similar to manual mode, and dental professionals can transmit commands by operating buttons set on the dental instrument 310', by voice commands, by checking the dental instrument in a predetermined sequence, or by any other means of controlling the dental instrument.

[0149] In some embodiments, the received command 650 may activate automatic mode 652. In this embodiment, the dental instrument 310' returns to automatic mode 620 as described above.

[0150] In some embodiments, the received command 650 may activate either photo capture mode 654 or video streaming mode 656. In both modes, the front LED is turned on and the rear LED is turned off 660a. The dental instrument 310' remains in the selected mode until a new command 650 is received or until an external command executed by a dental professional triggers an exit mode 670 request, such as by operating a button on the dental instrument 310', by a voice command, by checking the dental instrument in a predetermined sequence, or by any other means of controlling the dental instrument.

[0151] When the dental instrument 310' is configured in photo capture mode 654, the optical sensor 384 can operate in image acquisition mode to capture one or more pictures or images and transmit the images to one or more processors 390 of the dental instrument 310'. When the dental instrument 310' is configured in video streaming mode 656, the optical sensor 384 can operate in video acquisition mode to capture video and transmit the video stream to one or more processors 390.

[0152] In some embodiments, photo capture mode 654 or video streaming mode 656 may further include activating communication between processor(s) 390 of dental instrument 310' and processor(s) 339 of external device 330', and displaying the image or video stream directly on display 340 of external device 330'. During photo capture mode 654 or video streaming mode 656, turning on the front LED and turning off the rear LED 660a allows for better illumination of the oral cavity during photo capture or video streaming, thereby improving the quality of the image and / or video stream displayed on display 340.

[0153] In some embodiments, the received command 650 can place the dental instrument 310' into an idle mode 658, in which both the rear LED and the front LED are turned off 660c. The idle mode is useful if dental professionals want to operate the dental instrument 310' in the same way as a conventional dental mouth mirror, i.e., to observe through the mirror without activating any light source.

[0154] The step of receiving command 650 can be repeated continuously as long as command 650 is received or until exit mode 670 is detected. A dental professional can activate exit mode 670 by turning off the dental instrument 310' and disconnecting the power to its electronics. In this embodiment, exit mode 670 can be triggered by an external command executed by the dental professional. External commands can be executed by operating a button on the dental instrument 310', via voice command, by checking the dental instrument in a predetermined sequence, or by any other means of controlling the dental instrument. In some embodiments, exit mode 670 can be triggered automatically, for example, after determining that the dental instrument has been placed on a table, in a dental handheld retainer, and / or otherwise stationary for a predetermined amount of time. When the dental instrument 310' is detected to be in exit mode 670, both the rear LED and the front LED are turned off 675.

[0155] It should be understood that, for the sake of simplicity and clarity, reference numerals may be repeated in the accompanying drawings where appropriate to indicate corresponding or similar elements. Furthermore, numerous specific details are set forth herein to provide a thorough understanding of the exemplary embodiments described herein. However, those skilled in the art will understand that the exemplary embodiments described herein can be practiced without these specific details. In other instances, well-known methods, procedures, and components have not been described in detail so as not to obscure the exemplary embodiments described herein. Moreover, this description should not be construed as limiting the scope of the exemplary embodiments described herein.

[0156] While the foregoing description describes the features of exemplary embodiments, it should be understood that certain features and / or functions of the embodiments may be modified without departing from the spirit and operating principles thereof. For example, various characteristics described by the illustrated embodiments or examples may be selectively combined with each other. Therefore, the foregoing description is intended to illustrate the claimed concepts and not to be restrictive. Those skilled in the art will understand that other variations and modifications may be made without departing from the scope of the invention as defined by the appended claims. The scope of the claims should not be limited by the preferred embodiments and examples, but should be given the broadest interpretation consistent with the entire specification.

[0157] Reference numbers of the components shown in the figure 10 Dental Instruments 100 Head section 102 Shell sidewall 102 Reflective layer 104 Bottom wall of the shell 110 Open-top shell 118 Optical Diffuser Assembly 120 reflective layer 121 Part of the reflective layer 122 Reflective Surface 130 PCB 132 Upper surface 133 Forward Light Source 134 surface 135 Backlight 139 microprocessor 140 Outer Diffuse Layer 141 Heating Component 150 intermediate diffuse layer 160 optical diffuser layer 184 Optical Sensors 200 Handle Part 204 Longitudinal end 300 Dental Instrument Control System 310 Dental Instruments 330 External Devices 333 Light Source 338 Dental Instrument Storage 339. One or more processors of an external device. 340 monitor 384 Optical Sensor 386 motion sensor 390. Processor(s) of dental instruments 395 External device memory 400 methods 410 Image Sensor Input 420 Image Processing 430a Rear LED off, front LED on 430b Rear LED on, Front LED off 430c Turn off all LEDs 440a Low FPS Mode 440b High FPS Mode 441 Free Mode 443 Exit 445 Low Power Mode 447 End 500 Initialization Process 510 Initialization Steps 512 Image Sensor Initialization 514 Video Server Initialization 520 Check motion sensors 525 Sleep Mode 530 Post-exercise wake-up 540 Shutdown 600 methods 610 Check the motion sensor 612 Movement detected 615 Enter sleep mode 620 Automatic Mode 622 Image Acquisition 624 Machine Learning Model 626 New predicted location 628a Oral position 628b cheek position 628c suspended position 630a Rear LED off, front LED on 630b Rear LED on, Front LED off 630c Turn off all LEDs 640 Exit Mode 645 Turn off all LEDs 650 Receive Command 652 Activate Automatic Mode 654 Photo Capture Mode 656 Video Streaming Mode 658 Idle Mode 660a Rear LED off, front LED on 660c Turn off all LEDs 670 Exit Mode 675 Turn off all LEDs Training 700 machine learning models 705 Database 710 training images 720 preprocessed images 730 Supervised training machine learning models 740 New Machine Learning Models 745 Evaluate Model Performance The performance of the new 750 model meets the standards. 760 Transformation Model to Obtain Mirror Architecture 770 New Binary Machine Learning Model 780 Pushing models on devices 800 image streams 810 Select M images in a window 820 image 825 Image Preprocessing 830 Predicted location 840 Post-processing prediction location 860 Compare position and LED status 870 New LED Status 880 LED 890 Update LED status

Claims

1. A method for automatically controlling a dental instrument having an integrated light source and an integrated optical sensor, the method comprising: Optical signals are captured by the integrated optical sensor; The optical signals are processed to determine the position of the dental instrument relative to the patient's oral cavity; as well as The light output of the integrated light source is controlled based on the determined position.

2. The method according to claim 1, wherein, The defined position of the dental instrument includes one of the following: intraoral position, cheek traction position, and extraoral position.

3. The method according to claim 2, wherein, The optical signal includes the image captured by the integrated optical sensor.

4. The method according to claim 3, wherein, Processing the optical signals to determine the position of the dental instrument relative to the patient's mouth includes detecting objects within the image.

5. The method according to claim 4, wherein, Determining the position of the dental instrument in the mouth includes detecting one of the objects corresponding to teeth, tongue, and / or saliva.

6. The method according to claim 4 or 5, wherein, Determining that the dental instrument is in the cheek traction position includes detecting that there are no objects in the image.

7. The method according to any one of claims 4 to 6, wherein, Determining that the dental instrument is in an extraoral position includes detecting objects other than teeth, tongue, and / or saliva.

8. The method according to any one of claims 1 to 3, wherein, Processing the optical signals to determine the position of the dental instrument relative to the patient's oral cavity further includes: The position of the dental instrument relative to the patient's mouth is predicted using a machine learning prediction model.

9. The method according to claim 8, in, The machine learning prediction model is initially trained by a computer-implemented classification module using multiple training images to determine the position of the dental instrument relative to the patient's mouth, wherein the computer is hosted in an external device separate from the dental instrument.

10. The method according to claim 9, in, The trained machine learning prediction model is downloaded from the computer to the processor of the dental instrument.

11. The method according to any one of claims 8 to 10, wherein, Processing the optical signals to determine the position of the dental instrument relative to the patient's oral cavity further includes: Receive a certain number (M) of continuous optical signals. For each of the received number (M) of optical signals, the position of the dental instrument relative to the patient's oral cavity is predicted using the machine learning prediction model; For a number (M) of received optical signals, compare the predicted position of the dental instrument; and If at least a predetermined percentage of the predicted positions in the quantity (M) are similar, the predicted position of the dental instrument is adjusted.

12. The method according to any one of claims 2 to 11, wherein, Controlling the light output of the integrated light source further includes turning on at least one of the integrated light sources when the dental instrument is in the intraoral position or the cheek traction position.

13. The method according to claim 12, wherein, The dental instrument includes a forward light source and a backward light source opposite to the forward light source. The method includes: when the dental instrument is in an intraoral position, turning on the forward light source and turning off the backward light source; and when the dental instrument is in a buccal traction position, turning on the backward light source and turning off the forward light source.

14. The method according to any one of claims 2 to 13, wherein, Controlling the light output of the integrated light source includes turning off the integrated light source when the dental instrument is in an extraoral position.

15. The method according to any one of claims 2 to 14, wherein, The dental instrument further includes a motion sensor, and the method includes: when the motion sensor detects motion of the dental instrument, activating the integrated optical sensor to capture an optical signal.

16. The method according to any one of claims 1 to 15, wherein, The dental instrument is a dental mouth mirror.

17. A dental instrument comprising: Optical sensors suitable for acquiring optical signals; A light source that can be operated to adjust the light output; as well as A processor that operatively communicates with the optical sensor and the light source is configured to receive and process the optical signals to determine the position of the dental instrument relative to the patient's oral cavity, and to send a control signal to the light source based on the determined position to control the light output of the optical sensor.

18. The dental instrument according to claim 17, wherein, The processor also includes a machine learning prediction model for processing the optical signals to determine the position of the dental instrument relative to the patient's mouth.

19. The dental instrument according to claim 18, wherein, The processor also includes a transceiver for communicating with a computer, used to download the machine learning prediction model from the computer. Prior to downloading, the machine learning prediction model is initially trained by the computer-implemented classification module of the computer using multiple training images to determine the position of the dental instrument relative to the patient's mouth through machine learning.

20. The dental instrument according to any one of claims 17 to 19, further comprising a motion sensor, wherein, When the motion sensor detects the movement of the dental instrument, the optical sensor is activated to acquire the optical signal.