System and method for automatically controlling a dental instrument having integrated light sources

Abstract

A system and a method for automatically controlling a dental instrument is provided. The system includes the dental instrument having an optical sensor adapted to acquire an optical signal according to at least one operational mode and light sources operable to adjust a light output. The system also includes a processor in operative communication with the optical sensor and light sources. The processor is configured to receive and process the optical signal to determine a position of the dental instrument with respect to the patient's mouth. The processor is also configured to send a control signal to the light sources and / or the optical sensor to control the light output of the optical sensors and / or the operational mode of the optical sensor based on the determined position.

Description

SYSTEM AND METHOD FOR AUTOMATICALLY CONTROLLING A DENTAL INSTRUMENT HAVING INTEGRATED LIGHT SOURCESCROSS REFERENCE

[0001] This application claims the benefit of, and priority to, US provisional patent application 63 / 484,808 filed on February 14, 2023, and entitled “SYSTEM AND METHOD FOR AUTOMATICALLY CONTROLLING A DENTAL INSTRUMENT HAVING INTEGRATED LIGHT SOURCES”, the content of which is hereby incorporated by reference in its entirety.TECHNICAL FIELD

[0002] The technical field generally relates to illuminating systems, and more specifically to systems for automatically controlling dental instruments, such as dental mirrors, having integrated light sources for illuminating a patient’s mouth.BACKGROUND

[0003] It can be challenging for a dental professional, such as a dentist or a dental hygienist, to have a direct line of sight into a patient’s mouth to perform a dental exam or other dental procedures. Intra-oral mirrors, also known as dental mirrors, are frequently used by such dental professionals to facilitate the viewing of the patient’s mouth, including teeth and gums, by allowing observation of a region of interest in the mouth of the reflective surface of the dental mirror.

[0004] Nonetheless, a patient’s mouth is typically an environment that lacks sufficient illumination to properly examine the region of interest. Thus, in order to improve the visibility within the patient’s mouth, an external light source can often be directed toward the oral cavity. For example, a bright external light source such as one that is focused via one or more reflective and / or lens elements, can be mounted on a multi-position armature to enable the health care provider to selectively position the external light source at a desired angle to provide illumination to a given region within the patient’s mouth.

[0005] However, such external light sources can have various disadvantages, such as inadequate illumination of a specific region in the patient's mouth or the inability to be easily toggled. As such, there is a need for improvement.SUMMARY

[0006] According to an aspect, a method for automatically controlling a dental instrument having integrated light sources and an integrated optical sensor is provided. The method comprises capturing an optical signal via the integrated optical sensor; processing the optical signal to determine a position of the dental instrument with respect to a patient’s mouth; and controlling a light output of the integrated light sources based on the determined position.

[0007] In accordance with an embodiment, the determined position of the dental instrument comprises one of an in-mouth position, a cheek-retracting position, and an out- of-mouth position.

[0008] In accordance with an embodiment, the optical signal comprises an image captured by the integrated optical sensor.

[0009] In accordance with an embodiment, processing the optical signal to determine the position of the dental instrument with respect to the patient’s mouth comprises detecting objects within the image.

[0010] In accordance with an embodiment, determining that the dental instrument is in the in-mouth position comprises detecting that one of the objects corresponds to a tooth, a tongue and / or saliva.

[0011] In accordance with an embodiment, determining that the dental instrument is in the cheek-retracting position comprises detecting that the image is deprived from any objects.

[0012] In accordance with an embodiment, determining that the dental instrument is in the out-of-mouth position comprises detecting objects other than a tooth, a tongue and / or saliva.

[0013] In accordance with an embodiment, processing the optical signal to determine the position of the dental instrument with respect to the patient’s mouth further comprises predicting, using a machine learning predictive model, the position of the dental instrument with respect to the patient’s mouth.

[0014] In accordance with an embodiment, the machine learning predictive model is preliminarily trained by a computer-implemented classification module of a computer by machine learning using a plurality of training images to determine the position of the dental instrument with respect to the patient’s mouth, wherein the computer is hosted in an external device, separated from the dental instrument.

[0015] In accordance with an embodiment, the trained machine learning predictive model is downloaded from the computer to a processor of the dental instrument.

[0016] In accordance with an embodiment, processing the optical signal to determine the position of the dental instrument with respect to the patient’s mouth further comprises receiving a number (M) of consecutive optical signals, for each of the number (M) of optical signals received, predicting, using the machine learning predictive model, the position of the dental instrument with respect to the patient’s mouth; comparing the predicted position of the dental instrument for the number (M) of optical signals received; and adjusting the predicted position of the dental instrument if at least a predefined percentage of the number (M) of predicted position are similar.

[0017] In accordance with an embodiment, controlling the light output of the integrated light sources further comprises turning on at least one of the integrated light sources when the dental instrument is in the in-mouth position or the cheek-retracting position.

[0018] In accordance with an embodiment, the dental instrument comprises a frontfacing light source and a rear-facing light source opposite the front-facing light source, the method comprises turning on the front-facing light source while turning off the rear-facing light source when the dental instrument is in the in-mouth position, and turning on the rearfacing light source while turning off the front-facing light source when the dental instrument is in the cheek-retracting position.

[0019] In accordance with an embodiment, controlling the light output of the integrated light sources comprising turning off the integrated light sources when the dental instrument is in the out-of-mouth position.

[0020] In accordance with an embodiment, the dental instrument further comprises a motion sensor, the method comprising activating the integrated optical sensor to capture optical signal upon detection of a movement of the dental instrument by the motion sensor.

[0021] In accordance with an embodiment, the dental instrument is a dental mirror.

[0022] According to another aspect, a dental instrument is provided. The dental instrument comprises an optical sensor adapted to acquire an optical signal; light sources operable to adjust a light output; and a processor in operative communication with the optical sensor and the light sources, the processor being configured to receive the optical signal and process the optical signal to determine a position of the dental instrument with respect to a patient’s mouth, and to send a control signal to the light sources to control the light output of the optical sensor based on the determined position.

[0023] In accordance with an embodiment, the processor further comprises a machine learning predictive model to process the optical signal to determine the position of the dental instrument with respect to the patient’s mouth.

[0024] In accordance with an embodiment, the processor further comprises a transceiver in communication with a computer to download the machine learning predictive model from the computer, wherein the machine learning predictive model is preliminarily trained by a computer-implemented classification module of the computer by machine learning using a plurality of training images to determine the position of the dental instrument with respect to the patient’s mouth before the download.

[0025] In accordance with an embodiment, the dental instrument further comprises a motion sensor, wherein the optical sensor is activated to acquire the optical signal upon detection of a movement of the dental instrument by the motion sensor.

[0026] According to an aspect, a method for automatically controlling a dental instrument having integrated light sources and an integrated optical sensor is provided. The method includes: capturing an optical signal via the optical sensor; processing the optical signalto determine a position of the dental instrument with respect to the patient’s mouth; and controlling a light output of the light sources and / or an operational mode of the optical sensor, based on the determined position.

[0027] According to an aspect, a system is provided. The system includes: a dental instrument, the dental instrument including: an optical sensor adapted to acquire an optical signal according to at least one operational mode; light sources operable to adjust a light output; and a processor in operative communication with the optical sensor and light sources, the processor being configured to receive the optical signal and process the optical signal to determine a position of the dental instrument with respect to the patient’s mouth, and to send a control signal to the light sources and / or the optical sensor to control the light output of the optical sensors and / or the operational mode of the optical sensor based on the determined position.BRIEF DESCRIPTION OF THE DRAWINGS

[0028] The attached figures illustrate various features, aspects and implementations of the technology described herein.

[0029] Figure 1 is a perspective view of a dental instrument that includes a head portion and a handle, according to an embodiment.

[0030] Figure 2 is a top plan view of the head portion of the dental instrument of Figure 1.

[0031] Figure 3 is bottom plan view of the head portion of the dental instrument of Figure 1.

[0032] Figure 4 is a top plan view of a printed circuit board receivable within an opentop housing of the head portion of the dental instrument of Figure 1.

[0033] Figure 5 is a bottom plan view of the printed circuit board of Figure 4.

[0034] Figure 6 is a partially exploded, partially cross-sectional, perspective view of the head portion of the dental instrument of Figure 1 , with an outer diffusing layer and a reflective layer shown separated from the head portion.

[0035] Figure 7 is a block diagram illustrating a dental instrument control system, according to an embodiment.

[0036] Figures 8 and 9 are flowcharts illustrating a method for automatically controlling a dental instrument having integrated light sources and an integrated optical sensor, according to an embodiment.

[0037] Figure 10 is a block diagram illustrating a dental instrument control system, according to another embodiment.

[0038] Figure 11 is a flowchart illustrating a method for automatically controlling a dental instrument having integrated light sources and an integrated optical sensor, according to another embodiment.

[0039] Figure 12 is a flowchart illustrating generation of a machine learning predictive model, in accordance with an embodiment.

[0040] Figure 13 is a flowchart illustrating processing of images received from a camera of the dental instrument and control of the dental instrument, in accordance with an embodiment.DETAILED DESCRIPTION

[0041] In the following description, various embodiments are described with reference to the figures. In each figure, the same numerical references refer to similar elements. It should also be noted that for the sake of simplicity and clarity, to avoid overburdening the figures with several reference numbers, not all figures contain references to all the components and features. Some components and features can be references in only one figure but can easily be inferred in other figures. Aspects or advantages described in conjunction with a particular embodiment are not necessarily limited to that embodiment and can be practiced in any other embodiments even if not so illustrated.

[0042] The terms “a”, “an” and “one” are defined herein to mean “at least one”, that is, these terms do not exclude a plural number of items, unless stated otherwise.

[0043] Terms such as “substantially”, “generally” and “about”, which modify a value, condition or characteristic of a feature of an exemplary embodiment, should be understood to mean that the value, condition or characteristic is defined within tolerances that are acceptable for the proper operation of this exemplary embodiment for its intended application.

[0044] Expressions such as “match”, “matching” and “matched”, including variants and derivatives thereof, are intended to refer herein to a condition in which two or more elements are either the same or within some predetermined tolerance of each other. That is, these terms are meant to encompass not only “exactly” or “identically” matching the two elements but also “substantially”, “approximately” or “subjectively” matching the two or more elements, as well as providing a higher or best match among a plurality of matching possibilities.

[0045] In the present description, the expression “based on” is intended to mean “based at least partly on”, that is, this expression can mean “based solely on” or “based partially on”, and so should not be interpreted in a limited manner. More particularly, the expression “based on” could also be understood as meaning “depending on”, “representative of”, “indicative of”, “associated with” or similar expressions.

[0046] The present description relates to a system for automatically controlling a dental instrument having integrated light sources and an integrated optical sensor, and corresponding methods theretofore controlling the dental instrument. The expression “dental instrument” herein refers to any tool that can be manipulated by a dental professional to provide dental treatment to a patient. The dental instrument can be inserted into the patient’s mouth to examine, manipulate, treat, restore and / or remove the patient's teeth and / or other biological elements in the patient's mouth, such as gums, saliva, palate, etc. The term "patient" herein refers to a subject undergoing the dental treatment. In embodiments described herein, the patient is a human, but it can be appreciated that the term “patient” can also be applied in a veterinary context where the patient is an animal.

[0047] With reference to Figures 1 to 3, there is illustrated an embodiment of a dental instrument 10. In the illustrated embodiment, the dental instrument 10 is a dental mirror and includes a handle 200 and a head portion 100 positioned at, or in proximity to, alongitudinal end 204 of the handle 200. The head portion 100 of the dental instrument 10 includes a reflective layer 120 with a reflective surface 122. In some embodiment, the reflective layer 120 can be for instance a mirror, or other types of wave reflector. When the dental instrument 10 includes the reflective layer 120, a dental professional can grasp the handle 200 to manipulate the position of the head portion 100 to indirectly view a given area within a patient’s mouth as reflected by the reflective surface 122 of the reflective layer 120. In some embodiments, the reflective layer 120 can be omitted, and be replaced by a non-reflective layer to achieve a similar configuration of the head portion 100 as described herein but without having the reflective surface being present.

[0048] The head portion 100 can also include an open-top housing 110. The open-top housing 110 can include a housing sidewall 102 and a housing bottom wall 104. The housing sidewall 102 and the housing bottom wall 104 can together define a cavity configured to receive internal components, such as a printed circuit board (PCB) including light sources and / or other electronic components.

[0049] In the present embodiment, the housing sidewall 102 can be substantially cylindrical, with the housing bottom wall 104 having a substantially circular surface area. This combination of the housing sidewall 102 and the housing bottom wall 104 can result in the open-top housing 110 being shape like a cup, with the housing sidewall 102 curving inwardly such that the diameter of the housing bottom wall 104 is smaller than the diameter at the top of the open-top housing 110. In some embodiments, the housing sidewall 102 can be substantially straight, such that the diameter of the housing bottom wall 104 and the diameter at the top of the open-top housing 110 are substantially similar. It can be appreciated that the housing sidewall 102 and the housing bottom wall 104 can have different shapes than the one illustrated in the figures, depending for instance on the configuration of the remainder of the dental instrument 10 and its intended use. In some embodiments, for example where the dental instrument 10 is intended to be used to illuminate the patient’s mouth, the open-top housing 110 can be provided with a housing sidewall 102 that is edgeless, or curvilinear, to contribute to increasing the comfort of the patient once the head portion 100 is introduced in their mouth.

[0050] With reference to Figures 3 to 6, the head portion 100 includes light sources 133, 135 which can be configured to emit light. More specifically, the head potion 100 caninclude front-facing light sources 133 which are positioned upwardly and away from the housing bottom wall 104, e.g., toward the underside of the reflective layer 120 when the reflective layer 120 is present. In the illustrated embodiment, the front-facing light sources 133 are provided as components of a PCB 130 adapted to be received within the cavity of the open-top housing 110. The front-facing light sources can be provided on an upper surface 132 of the PCB 130. The PCB 130 can also include rear-facing light sources 135 that are provided on a lower surface 134 of the PCB 130. In some embodiments, the light sources 133, 135 can include light-emitting diodes (LEDs). It can be appreciated that other types of light sources that are configured to emit light can also be used. In some embodiments, although not shown in Figures 4 and 5, the light sources 133, 135 can be included in a center region of the PCB 130.

[0051] The head portion 100 can include an optical diffusing assembly 118. The optical diffusing assembly 118 is provided in between the PCB 130 and the reflective layer 120 and can be partially received within the cavity of the open-top housing 110. In the illustrated embodiment, the optical diffusing assembly 118 can include an outer diffusing layer 140 and an intermediate diffusing layer 150. The intermediate diffusing layer 150 can be provided closest to the front-facing light sources 133 and can be “sandwiched” between the outer diffusing layer 140 and the front-facing light sources 133. Accordingly, when the optical diffusing assembly 118 includes an outer diffusing layer 140 and an intermediate diffusing layer 150, the light emitted from the front-facing light sources 133 can successively travel through the intermediate diffusing layer 150 and the outer diffusing layer 140.

[0052] As shown in Figure 3, the housing bottom wall 104 can be configured to receive therein a corresponding optical diffusing layer 160. In the illustrated embodiment, the housing bottom wall 104 includes two optical diffusing layers 160 and can thus partially be defined by the optical diffusing layers 160. The optical diffusing layers 160 can be configured to diffuse the light emitted by the rear-facing light sources 135. In some embodiments, the optical diffusing layer 160 can be made of a translucent or a transparent material.

[0053] The front-facing light sources 133 and rear-facing light sources 135 can be spaced apart from one another and positioned according to a light source distribution. Theexpression “light source distribution” herein refers to the distribution of the light sources on the PCB 130. An example of a light source distribution can be a circumferential light source distribution or a peripheral light source distribution, as detailed below. As can be appreciated, other forms of distribution can be contemplated, such as a random distribution, where the light sources 133, 135 are randomly distributed, or a distribution according to a given pattern of the light sources 133, 135.

[0054] The light sources 133, 135 can be distributed according to a circumferential light source distribution, with at least some of the light sources 133, 135 being aligned along a circular profile that is concentric with the substantially circular surface area of the housing bottom wall 104 of the open-top housing 110. In the illustrated embodiment, the light sources 133, 135 are spaced apart from one another, and adjacent ones of the light sources 133, 135 are provided at a regular interval from one another. In some embodiments, the circumferential light source distribution includes twenty-four (24) frontfacing light sources 133 and sixteen (16) rear-facing light sources 135 (as shown in Figures 4 and 5). As can be appreciated, more or fewer light sources 133, 135 can be included depending for instance on the choice of light sources, their illuminating performance, other constraints within the open-top housing 110 and with the optical diffusing assembly 118, and the intended use of the dental instrument, among other factors. Other forms of distribution can also be considered based on the open-top housing 110 shape and configuration.

[0055] With reference to Figures 4 and 6, the PCB 130 can be in operative communication with an optical sensor 184. The reflective layer 120 can be a one-way mirror in which an upper surface of the mirror is reflective, while the lower surface of the one-way mirror is translucent or transparent. At least a portion 121 of the reflective layer 120 can be superposed over the optical sensor 184, and the optical sensor 184 can in turn be positioned onto the PCB 130. In some embodiments, a controller, such as a microprocessor 139, can be hosted on the PCB 130 and configured to control the light output of the light sources 133 and / or operate the optical sensor 184. In some embodiments, the PCB 130 can also host a transceiver adapted to communicate with external devices. In some embodiments, the transceiver can include an antenna provided in the handle 200 of the dental instrument for communicating wirelessly with externaldevices. The antenna can communicate with components of the PCB 130 via a wired connection.

[0056] A heating assembly 141 can be provided to generate heat to maintain the reflective layer 120 and / or the head portion 100 at a controllable temperature, for example to prevent fogging when the head portions 100 is inserted in a patient’s mouth. In the present embodiment, the heating assembly 141 is hosted on PCB 130 and in operative communication with the microprocessor 139. The heating assembly 141 is positioned behind the reflective layer 120 and operable by the microprocessor 139. The heating assembly 141 can, for example, include an electronically controllable heating element, such as a resistive heating element, and one or more temperature sensors to measure a temperature of the heating element, a temperature of different locations in the head portion 100, and / or to measure an ambient temperature. It is appreciated, however, that other configurations are possible.

[0057] As can be appreciated, the PCB and its associated components (i.e., light sources 133, 135, optical sensor 184, microprocessor 139, transceiver, etc.) can be powered by a battery. In the present embodiment, the battery is provided in the handle 200, but it is appreciated that other configurations are possible. In some embodiments, the battery can be rechargeable or disposable, depending on the configuration of the dental instrument.

[0058] Now referring to Figure 7, there is illustrated an embodiment of a dental instrument control system 300. The system 300 includes one or more processors 339 in operative communication with light sources 333, an optical sensor 384 and one or more motion sensors 386 integrated in a dental instrument 310, such as the above-described dental instrument 10. It is appreciated, however, that other configurations are possible. For example, in some embodiments, the system 300 can be configured to control other dental instruments having integrated light sources and / or optical sensors, such as a saliva ejector, an air-water syringe, a periodontal probe, among others. The system 300 can further include an external device 330 having a display 340. In the present embodiment, the external device 330 is a tablet incorporating at least one of the one or more processors 339 and having a display 340 that includes a touch screen. It is appreciated, however, that other configurations are possible. For example, in other embodiments, the external device330 can correspond to other computing devices such as a smartphone, personal computer, etc. In some embodiments, at least one of the one or more processors 339 can be incorporated in the dental instrument 310.

[0059] The light sources 333 can be operated to be selectively modulated. By selectively modulated, it understood that individual light sources can be operated to be turned on to emit light and turned off to stop emitting light. It is understood that selectively modulating the individual light sources can also include operating individual light sources at different power levels between 0% (fully off) and 100% (fully on). In some embodiments, light sources 333 can correspond to the above-described light sources 133, 135 integrated to the dental instrument 10, such as the front-facing light sources 133 and the rear-facing light sources 135. As can be appreciated, selectively modulating the light sources can include separately modulating a group of LEDs corresponding to the front-facing light sources 133, and a group of LEDs corresponding to the rear-facing light sources 135. In some embodiments, selectively modulating the light sources can include modulating a subset of LEDs and / or individual LEDs of the front-facing and / or rear-facing light sources 133, 135. As can be appreciated, other configurations are possible. For instance, the light sources 333 can also include a light source on the handle 200 of the above-mentioned dental instrument 10.

[0060] The optical sensor 384 is configured to capture optical signals corresponding to an analog or digital signal resulting from the conversion of light rays detected by the optical sensor. For instance, in the present embodiment, the optical sensor 384 is provided as part of a digital camera, and the optical signal consists of images captured by the camera. The optical sensor can be operated between a plurality of operational modes. For instance, the operational modes can include an image acquisition mode and a sleep mode. The image acquisition mode can include the optical sensor being operated to capture one or more pictures of the patient’s mouth and / or of a surrounding environment. The sleep mode can include the optical sensor being operated to stop capturing images or taking pictures. For instance, in some embodiments, the sleep mode can correspond to the optical sensor being turned off, deactivated, and / or operated in a low power mode. As can be appreciated, in some embodiments, the optical sensor can be operated in the sleep mode to remain on, but without capturing images.

[0061] In some embodiments, the operational modes can include a video-streaming mode and a stream-less mode. In the video-streaming mode, the optical sensor can be operated to stream acquired images to an external device 330, such that the images can be displayed by the external device 330, e.g., a tablet. Streaming the acquired images can include the optical sensor acquiring images and transmitting the acquired images in substantially real-time to the external device. The captured images correspond to continuous sequences, for example as a continuous series of frames captured at a steady rate. For instance, in the video-streaming mode, the optical sensor can be operated to transmit a live video feed to the external device 330. The live video feed can thus be displayed on a display 340 provided on the external device 330. In the stream-less mode, the optical sensor can be configured to acquire images, without streaming the acquired images to the external device 330. In some embodiments, not streaming the acquired images can include capturing images but retaining the images for processing locally instead of transmitting to the external device 330. In some embodiments, not streaming the acquired images can include transmitting acquired images to the external device 330 for processing by the processor(s) 339, but without displaying as a live video feed on the display 340. For example, in the stream-less mode, the optical sensor can be configured to capture individual images instead continuous sequences of images, and / or capture images at a lower resolution for subsequent processing by a processor in the dental instrument 310 and / or a processor on the external device 330, without displaying such images on display 340.

[0062] In some embodiments, the operational modes can further include a high frame per second (FPS) mode and a low FPS mode. The FPS, also known as frame rate, herein refers to the number of images (or frames) captured and / or steamed by the optical sensor each second. The high FPS mode can, for example, correspond to a frame rate of 30 Hz (i.e. 30 frames per second) or above, such as up to 60 Hz. The low FPS mode can correspond to a frame rate below 30 Hz. It is appreciated, however that other configurations are possible. The expressions “high” frames per second and “low” frames per second can be defined relative to the capabilities of the optical sensor. For example, “high” frames per second can be used to refer to a maximum or near maximum framerate of the optical sensor, and / or a framerate suitable for fluid video streaming. “Low” frames per second can be used to refer to framerates below the maximum. In an embodiment, an optical sensor with a maximum frame rate of 60 Hz can be provided. The high FPS modecan correspond to images captured at 60 Hz, 30 Hz or even 24 Hz, whereas the low FPS can correspond to images captured at a lower frequency / rate, such as between 2 Hz and 5 Hz. The optical sensor can be operated between the high and low FPS modes based on power requirements, and / or based on a required level of temporal resolution of captured video for subsequent processing and / or display. For example, when displaying live video on an external device, the optical sensor can be operated in the high FPS mode to provide a clear and fluid video. When video captured by the optical sensor is not being displayed, the optical sensor can be operated in the low FPS mode to save power.

[0063] In some embodiments, the operational modes can further include a high pixel resolution mode and a low pixel resolution mode. The pixel resolution herein refers to the number of pixels contained in images captured and / or streamed by the optical sensor. The high pixel resolution mode can, for example, correspond to images / frames suitable for a high definition (HD) resolution video, such as 720p, 1080p, or above. The low pixel resolution mode can, for example, correspond to images / frames suitable for a standard definition (SD) resolution video, such as 480p, 360p or below. As can be appreciated, the expressions “high” resolution and “low” resolution can be defined relative to the capabilities of the optical sensor. For example, “high” resolution can be used to refer to a maximum or near maximum resolution of the optical sensor, while “low” resolution can be used to refer to resolutions below the maximum. In an embodiment, an optical sensor with a maximum resolution of 800x800 pixel can be provided. The high resolution can correspond to images captured at 800x800 pixels, whereas the low resolution can correspond to images captured at a lower resolution, such as at 400x400 pixels, 200x200 pixels, etc.

[0064] The optical sensor can be operated between the high and low pixel resolution modes based on power requirements, and / or based on a required level of pixel resolution of captured images / video for subsequent processing and / or display. For example, when displaying live video on an external device, the optical sensor can be operated in the high pixel resolution mode to provide a clear image that allows to better discern visual details in the image. When video captured by the optical sensor is not being displayed, the optical sensor can be operated in the low pixel resolution mode to save power.

[0065] As can be appreciated, the optical sensor can be operated according to different combinations of each of the above-described streaming modes, FPS modes, and pixel resolution modes. For instance, the optical sensor can be operated in the low FPS mode, low pixel resolution mode, and stream-less mode simultaneously. In such a configuration, the captured images are of lower resolution and not streamed to the external device 330. As another example, the optical sensor can be operated in the high FPS mode, high pixel resolution mode, and the video-streaming mode simultaneously. In this configuration, the captured images are of a high resolution and streamed to the external device 330. As can be appreciated, other configurations and / or permutations of the modes are possible.

[0066] As can be appreciated, the optical sensor 384 can be provided as part of the dental instrument, allowing the capture of the optical signal inside the patient's mouth. For example, in some embodiments, the optical sensor 384 can correspond to the abovedescribed optical sensor 184 integrated into the head portion of the dental instrument 10. In this configuration, the optical sensor 384 can capture the optical signal when the head portion of the dental instrument is inserted into the patient's mouth. As can be appreciated, the optical sensor 384 can be provided as part of an integrated camera having a lens with a working distance and / or a maximum focal distance suitable for capturing clear images of structures in close proximity to the camera while inside the patient’s mouth. For example, the focal distance of the camera can be 10 cm or less. In some embodiments, the camera can have an adjustable focal distance, for example with a maximum focal distance of 10 cm or less.

[0067] The processor(s) 339 is configured to operatively communicate with the optical sensor. By operatively communicate with the optical sensor, it is understood that the processor(s) 339 is configured to communicate via a wired or wireless communication with the optical sensor 384, to receive the optical signal captured by the optical sensor 384 and / or to transmit control signals to the optical sensor 384. As can be appreciated, the optical signal can be received in different forms. For instance, depending on the operational mode of the optical sensor, the processor(s) 339 can receive individual images or a live video stream.

[0068] The processor(s) 339 is further configured to process the received optical signal.As will be described in more detail hereinbelow, processing the optical signal can involveprocessing images contained in the optical signal to determine a position of the dental instrument with respect to the patient’s mouth. The processor can also be configured to control the light sources 333 and the optical sensor 384, based on the determined position. It can be understood that the processor is also configured to operatively communicate with the light sources 333 via a wired or wireless connection. For instance, the processor(s) 339 can send a signal to control the light sources 333 and / or to operate the optical sensor 384. By sending a signal to control the light sources, it is understood that the processor(s) 339 can be configured to provide commands to selectively turn on and / or off the light sources 333. Similarly, by sending a signal to operate the optical sensor 384, it is understood that the processor(s) 339 can be configured to provide commands to cause the optical sensor 384 to operate between different operational modes, such as between the image acquisition mode and the sleep mode, between the video-streaming mode and the stream-less mode, between the high FPS mode and the low FPS mode, and / or between the high pixel resolution mode and the low pixel resolution mode, as described above.

[0069] The processor(s) 339 can be configured to carry out logical operations in order to process optical signals captured by the optical sensor 384 and / or to control the light sources 333 and the optical sensor 384. The processor can include any circuitry suitable to carry out logic operations, including a microprocessor, digital signal processor (DSP), application-specific integrated circuit (ASIC), multiprocessor, among others. For example, in embodiments where the processor(s) 339 comprises a microprocessor, the processor(s) 339 can be configured to execute instructions stored on a non-transitory memory. The processor(s) 339 can be hosted on a circuit board along with the non- transitory memory.

[0070] The processor(s) 339 described herein can refer to one or more physical or logical processors. In the present embodiment, the processor(s) 339 are provided as part of the external device 330, e.g., the tablet. As can be appreciated, other configurations are possible. For instance, in some embodiments, the processor(s) 339 can comprise circuitry provided in the dental instrument 310. For example, at least part of the processor(s) 339 can be provided on a PCB integrated as part of the dental instrument 310. In some embodiments, the processor(s) 339 can be provided on both the external device 330 and the dental instrument 310, whereby functionalities carried out by theprocessor(s) 339 (such as those described hereinbelow) are distributed between the external device 330 and the dental instrument 310. As can be appreciated, providing the processor(s) 339 on an external device 330 can allow for at least some processing to be offloaded from the dental instrument, thus reducing the processing burden and corresponding power consumption of the dental instrument 310 to allow increased battery life.

[0071] The processor(s) 339 can further be configured to cause a video stream to be displayed. Causing the video stream to be displayed can include providing the images received from the optical sensor to a display 340 in a user viewable format. The display 340 can consequently be configured to receive and display the video stream provided by the processor(s) 339. In some embodiments, the processor can cause single images to be displayed, for instance by providing individual images to the display 340.

[0072] In some embodiments, the display 340 can be provided on the external device 330 and can be hosted on the circuit board along with the processor(s) 339. For instance, the display 340 can correspond to the screen of the tablet. As can be appreciated, other embodiments are possible, for instance the display can be separate from the external device 330, or can be provided on both the external device and a separate device, such as on both the tablet and a separate computer screen.

[0073] In the present embodiment, the dental instrument 310 includes a wireless transceiver adapted to communicate with a transceiver in the tablet. The wireless transceiver in the dental instrument 310 can be adapted to transmit the optical signal captured by the optical sensor 384, and to receive control signals transmitted by the processor(s) 339. As can be appreciated, the transceivers in the tablet and the dental instrument can be configured to communicate via any suitable wireless communication methods, such as Wi-Fi, Bluetooth®, etc.

[0074] The motion sensor(s) 386 is configured to detect movement of the dental instrument 310 in 3D space. The motion sensor(s) 386 can, for example, detect movement in the form of a translation and / or change in orientation of the dental instrument 310, and generate a signal indicative such movement. Such signals can subsequently be processed to determine whether the dental instrument is in motion, for example being indicative that the dental instrument is hand-held or being otherwise manipulated by a dentalprofessional, or whether the dental instrument is stationary, for example being indicative that the dental instrument is resting on a table or in a dental handpiece holder.

[0075] As it can be appreciated, the motion sensor(s) 386 can include one or more accelerometers and / or one or more gyroscopes. The one or more accelerometers can be adapted to measure a rate of change of velocity of the dental instrument 310. The one or more accelerometers can include triaxial accelerometers adapted to detect the movement of the dental instrument 310 along three orthogonal axes. The one or more gyroscopes can be adapted to detect the orientation and / or angular velocity of the dental instrument 310 about three orthogonal axes, such as pitch, roll and yaw.

[0076] In some embodiments, the motion sensor(s) 386 can include accelerometers and / or gyroscopes integrated in the handle of the dental instrument, for example to detect a position and / or orientation of a handle 200 of the dental instrument. In some embodiments, the motion sensor(s) 386 can include accelerometers and / or gyroscopes integrated into the head of the dental instrument, for example to detect a position and / or orientation of a head portion 100 of the dental instrument.

[0077] With reference to Figure 8, a method 400 for automatically controlling a dental instrument using the above-described system 300 is illustrated according to an embodiment. Broadly described, the method involves processing an optical signal from an optical sensor in the dental instrument to determine a position of the dental instrument with respect to a patient’s mouth, and controlling the light sources and the optical sensor based on the determined position.

[0078] A first step 410 of the method 400 can consist of capturing an optical signal via the optical sensor. Capturing the optical signal can involve capturing one or more images with the optical sensor. For example, the optical sensor of the dental instrument can operate in the image acquisition mode to capture one or more images. In some embodiments, images can be captured continuously. For instance, the optical sensor can be configured to function as a video camera and capture multiple images per second. The optical signal can be sent to the processor(s) to be processed and / or displayed. In some embodiments, the optical signal can be transmitted in real-time, directly after being captured by the optical sensor. In some embodiments, the optical signal can be transmitted after a predefined amount of video and / or number of frames have beencaptured. For example, images captured can be temporarily stored in a buffer in memory on the dental instrument, before being transmitted to the processor(s) of the external device. After being transmitted to the processor(s), the buffer can be cleared and newly captured images can be stored therein.

[0079] A second step 420 of the method 400 can consist in determining the position of the dental instrument with respect to the patient’s mouth. Determining the position of the dental instrument can include detecting whether the dental instrument is inside or outside the patient's mouth, and / or determining the position of the dental instrument within or outside the patient's mouth. For instance, in some embodiments, the step 420 of determining can include detecting whether the dental instrument is in an in-mouth position, a cheek-retracting position, and an out-of-mouth position (or airborne position), among other positions.

[0080] The in-mouth position can correspond to the dental instrument being at least partially inside the patient’s mouth. At least partially inside the patient mouth can include the head portion of the dental instrument (such as the head portion 100 of the abovedescribed dental instrument 10) being at least partially inserted into the patient’s mouth. For instance, in some embodiments, the dental instrument can be in the in-mouth position if at least the optical sensor of the dental instrument is positioned within the confines of the patient’s mouth and / or is in a position to capture optical signals corresponding to interior structures of the patient’s mouth.

[0081] The cheek-retracting position can correspond to the dental instrument being used to retract the patient’s cheek from inside the patient's mouth. By retracting the cheek, it is meant that at least a part of the dental instrument is in contact with the cheek. For instance, retracting the cheek can consist of the head portion of the above-described dental instrument 10 being in contact with the cheek. In some embodiment, the front-facing lightsources and / or the reflective surface provided on the head portion of the dental instrument can be facing the cheek and / or at least partially covered or occluded by the cheek, while the cheek is being retracted. As can be appreciated, the cheek-retracting position can correspond to when the dental professional manipulates the dental instrument to touch or pull the patient’s cheek using a front face of the head portion of the dental instrument (i.e.the face of the head portion where front-facing elements are located, such as the reflective surface, the front-facing light sources, the optical sensor, etc.).

[0082] The out-of-mouth position can correspond to the dental instrument being outside of the patient’s mouth. For example, the out-of-mouth position can include the dental instrument resting on a table or a dental handpiece holder, or even being hand-held by the dental professional while the head portion of the dental instrument is outside the boundaries of the patient’s mouth.

[0083] In the present embodiment, the position of the dental instrument is determined in step 420 by using the processor(s) to process the optical signal received from the optical sensor. For example, the processor(s) can process images captured by the optical sensor to determine a current position of the dental instrument. As can be appreciated, the position of the dental instrument can be determined by processing individual images and / or a series of images. Although in the present embodiment the position of the dental instrument in determined by processing images, it is appreciated that in other embodiments data from additional sensors can be used to assist in determining the position of the dental instrument. For example, signals from motion sensors can also be processed to assist in determining the position of the dental instrument.

[0084] In more detail now, processing images to determine the position of the dental instrument in step 420 can include detecting variation of one or more color parameters of images. For instance, detecting variation of one or more colors parameters can include processing images to detect a variation in the tone, hue, shading, saturation, brightness, among other parameters. As an example, the processor can determine that the dental instrument is in the cheek-retracting position and / or the in-mouth position by detecting that the hue of images captured by optical sensor is similar to an expected hue corresponding to an interior of a patient's mouth. For example, an image hue ranging from different shades of pink can be indicative of the dental instrument is in the patient’s mouth. The processor can determine that the dental instrument is in the cheek-retracting position, for example, by detecting that the image hue is in a range from dark pink to black. For example, when the dental instrument is used to retract the patient's cheek and the camera is in contact with the cheek and / or the optical sensor is at least partially occluded by the cheek, the resulting image will be black or of a darker tone compared to when the dentalinstrument is inside the patient’s mouth and not in contact with the cheek. As another example, the processor can determine that the dental instrument is in the out-of-mouth position by detecting that the image hue, or at least a hue of a portion of the image, is not within a range corresponding to an expected hue for a patient’s mouth. For example, by detecting colors other than shades of pink within the image. As yet a further example, the processor can determine that the dental instrument is in the in-mouth position by detecting a color profile indicative of a reflective environment caused by saliva in the patient’s mouth.

[0085] In some embodiments, processing images can include processing a series of images to detect a transition of color parameters, such as a transition to or away from pink or black and / or to or away from a reflective environment. As can be appreciated, the hue and / or other color parameters can be detected and compared to expected values using any suitable techniques. For example, statistical techniques can be applied. Such statistical techniques can include processing the image to generate histograms, such as color histograms representing one or more color channels in the image, and comparing the generated histograms to reference histograms.

[0086] In some embodiments, processing the image to determine the position of the dental instrument in step 420 can include detecting one or more objects within the image. For example, the processor(s) can determine whether the dental instrument is in the inmouth position by detecting one or more objects that correspond to structures inside the patient's mouth. Such objects can include a tooth, a tongue, and / or saliva, among others. Similarly, in some embodiments, the processor(s) can determine whether the dental instrument is in the out-of-mouth position by detecting objects other than those corresponding to structures inside the patient’s mouth (i.e., anything other than the tooth, the tongue, and saliva). The object detection can be carried out in various forms. In some embodiments, image recognition techniques can be applied to detect salient elements within the images. For instance, detecting an object can include the detection of the shape of a tooth in the image.

[0087] As can be appreciated, the detecting variations of color parameters and / or the object recognition can be carried out using artificial intelligence (Al). In some embodiments, a machine learning (ML) model can be trained to determine whether one or more color parameters of the image correspond to expected color parameters of ahuman’s mouth. For instance, the ML model can be trained on one or more datasets containing images of patients’ mouth. In some embodiments, the training datasets can include images labelled as corresponding to images of the interior of a human mouth, and images labelled as corresponding to images of the exterior of a human mouth and / or an environment of a dental clinic. Similarly, a ML model can be trained to detect objects corresponding to expected structures in the patient’s mouth, such as the shape of a tooth, using one or more training datasets containing images of such objects labelled accordingly. In some embodiments, two separate ML models can be trained to carry out the detection techniques separately. In some embodiments, the ML model can be provided on the external device 330, and can be executed by the processor(s) 339. For example, in some embodiments, the ML model can be integrated as part of the tablet and communicate with the processor(s) 339 to carry out the detection of objects and / or color parameters in the image. Other examples of ML implementations will be further detailed below.

[0088] In some embodiments, the position of the dental instrument with respect to the patient’s mouth can be determined in step 420 based on the maximum focal distance of the camera used to capture the images from the dental instrument. The maximum focal distance can correspond to the maximum distance between the lens of the camera and a subject within which the camera can capture a clear and / or focused images of the subject. The camera can capture an image of a subject up to the maximum focal distance before the image gets out of focus and becomes blurred. As can be appreciated, the maximum focal distance can be a fixed property of the camera, based on the lens properties of the camera. For example, the camera provided on the dental instrument can have a fixed or an adjustable lens with a known maximum focal distance of approximately 10cm. Accordingly, it can be understood that images that are in focus correspond to subjects that are within 10cm, and that images that are out of focus can correspond to subject that are further than 10cm and thus outside the patient’s mouth. Thus, in step 420, it can be determined whether the camera is focused on a subject. If it is determined that the camera is focused, the position of the dental instrument can be determined as being in the inmouth position. If it is determined that the camera is out of focus, the position of the dental instrument can be determined as being in the out-of-mouth position.

[0089] In some embodiments, determining the focus of the camera can involve the processor(s) determining whether the image captured by the optical sensor is blurred. For instance, a clear or sharp image, i.e., one that is not blurred, can be identified by the processor(s) as being in focus. Similarly, a blurry image can be identified by the processor(s) 339 as being out of focus. As can be appreciated, any suitable image processing techniques can be used by the processor(s) 339 to determine the blurriness and / or sharpness of the image.

[0090] In some embodiments, determining the focus of the camera can be based on other signals received from the camera. For example, the camera can be configured to generate a focal status indicator that is indicative of whether it the camera is in-focus or out-of-focus. The camera can subsequently communicate the focal status to the processor(s) via a corresponding signal. In some embodiments, the focal status can be transmitted to the processor(s) whenever a new optical signal is captured by the optical sensor, such as each time a new image is captured by the optical sensor. In some embodiments, the focal status can be transmitted to the processor(s) each time a focus of the camera is readjusted (for example as part of an auto-focus functionality of the camera). For example, the focal status can be transmitted to the processor(s) when a change in the position of the dental instrument causes the camera to readjust its focal length. As can be appreciated, other configurations are possible where, for example, the camera periodically or continuously transmits the focal status to the processor(s), regardless of whether a new image is captured, or the focus is adjusted.

[0091] Once the position of the dental instrument with respect to the patient’s mouth has been determined, electronic components of the dental instrument can be operated based on the determined position. In the present embodiment, subsequent steps 430a, 430b, 430c of the method 400 include controlling a light output of the light sources based on the determined position. As can be appreciated, controlling the light output can include modulating a light output of at least one of the light sources, such as by turning on and / or turning off at least one of the light sources. For instance, the processor(s) can send a signal, such as a control signal, to control the output of the at least one of the light sources, upon determination that the dental instrument has transitioned from one position to another. In some embodiments, sending the control signal can involve the processor(s) providing an instruction each time the state of a light source is to be changed. For example,the processor(s) can transmit an on / off instruction that toggles the light source depending on its current state. For instance, when the light source is initially turned on, the instruction sent by the processor(s) can turn it off. Similarly, when the light source is initially turned off, the instruction sent by the processor(s) can turn it on. In some embodiments, transmitting a signal can involve the processor(s) continuously providing a signal to the light source to retain it in an on state, and ceasing the signal when the light source is to be turned off. In such embodiments, the control signal can correspond to a control voltage provided to each light source.

[0092] As described above, the dental instrument can include front-facing light sources and rear-facing light sources. In some embodiments, the front-facing light sources can be together operated as a first group, and the rear-facing light sources can be together operated as a second group. In such embodiments, the processor(s) can be configured to transmit a signal to turn on or off either one of the first or second groups of light sources, based on the determined dental instrument position. As can be appreciated, the control of the light output of the light sources can be carried out in various forms.

[0093] In the present embodiment, following a determination that the dental instrument is in the in-mouth position, the front-facing light sources are turned on while the rear-facing light sources are turned off 430a. In some embodiments, when the dental instrument transitions from the out-of-mouth position to the in-mouth position, the processor(s) can be configured to send a signal to turn on only the front-facing light sources. In this case, since in the dental instrument is initially in the out-of-mouth position, the rear-facing light sources are already turned off, therefore the processor(s) does not need to transmit a signal to turn off the rear-facing light sources. In some embodiments, when the dental instrument transitions from the cheek-retraction position to the in-mouth position, the processor(s) can be configured to send a signal to both turn on the front-facing light sources and turn off the rear-facing light sources.

[0094] Following a determination that the dental instrument is in the cheek-retracting position, the rear-facing light sources are turned on while the front-facing light sources are turned off 430b. In some embodiments, when the dental instrument transitions from the in-mouth position to the cheek-retraction position, the processor(s) can be configured to send a signal to turn on the rear-facing light sources and to turn off the front-facing lightsources. As can be appreciated, in some embodiments, the processor(s) can also be configured to hold a certain stability period, during the transition from the in-mouth position to the cheek-retracting position, before turning on the rear-facing light sources. For instance, the stability period can consist of the processor(s) waiting for at least two seconds, after detecting that the dental instrument is in the cheek-retracting position and after the forward-facing light sources are turned off, before turning on the rearward-facing light sources. More specifically, the stability period can include the processor(s) waiting for the detected image to be stable for the at least two seconds, before proceeding with turning on the rear-facing light sources. As can be appreciated, the stability period can allow avoiding rapid transitions or flickering between light sources during the transition to the cheek-retracting position. As can also be appreciated, other configurations where the stability period is more or less than 2 seconds can also be considered. For example, in some embodiments the stability period can be 1 second. In some embodiments, the stability period can be implemented via a microprocessor provided in the dental instrument. For example, the microprocessor can receive instructions to change light source states from the tablet processor, and hold for the two second period, before executing the change.

[0095] Following a determination that the dental instrument is in the out-of-mouth position (also referred to as the airborne position), both the rear-facing light sources and front-facing light sources are turned off 430c. In some embodiments, when the dental instrument transitions from the in-mouth position to the out-of-mouth position, the processor(s) can be configured to send a signal to turn off only the front-facing light sources. In the in-mouth position, the rear-facing light sources are already turned off. Therefore, when transitioning from the in-mouth position to the out-of-mouth position, the processor(s) does not need to transmit a signal to turn off the rear-facing lights. In some embodiments, the out-of-mouth position can be the default position when the dental instrument is initially turned on. Thus, at the initialisation of the device, the processor(s) can refrain from transmitting instructions to turn on the at least one of the light sources.

[0096] In the present embodiment, following the determination of the position of the dental instrument, another subsequent step 440 of the method 400, consists in controlling the operational mode of the optical sensor. Controlling the operational mode can include the processor(s) sending instructions to the optical sensor as to how images should becaptured and / or how captured images should be transmitted to the external device. For instance, the processor(s) can instruct the optical sensor as to what streaming mode and / or as to what FPS mode the optical sensor should operate in.

[0097] Controlling the operational mode can include causing the optical sensor to operate in a stream-less mode and a low FPS mode 440a. In the present embodiment, the optical sensor is operated in the stream-less mode and a low FPS mode following a determination that the dental instrument is in either in the out-of-mouth position or the cheek- retracting position. As can be appreciated, operating the optical sensor in the low FPS mode can include transmitting instructions to adjust the frame rate of images captured by the optical sensor to a predetermined low frame rate. For instance, the low frame rate can be less than 30 FPS. Reducing the frame rate of the optical sensor in this fashion can allow decreasing the power consumption of the optical sensor. As can be further appreciated, operating the optical sensor in the stream-less mode can include causing the optical sensor to transmit captured images to be processed by the processor(s), but not displayed or streamed live on the external device. For instance, the optical sensor can continue to transmit captured images to the processor(s) on the tablet only to determine the current position of the dental instrument.

[0098] Controlling the operational mode can also include causing the optical sensor to operate in a video-streaming mode and a high FPS mode 440b. In the present embodiment, the optical sensor is operated in the video-streaming mode and the high FPS when the dental instrument is the in-mouth position. As can be appreciated, operating the optical sensor in the high FPS mode can include transmitting instructions to adjust the frame rate of images captured by the optical sensor to a predetermined high frame rate. For instance, the high frame rate can be equal to or greater than 30 FPS, or other frame rate suitable for live streaming video. As can be further appreciated, operating the optical sensor in the video-streaming mode can include causing images captured by the optical sensor to be transmitted to the external device so that they can be displayed. For instance, images captured by the optical sensor can be transmitted to the tablet and displayed on the tablet's screen. In some embodiments, images continuously captured by the optical sensor can be displayed as a live stream on the tablet. As can be appreciated, this mode of operation can allow the dental professional to visualize the inside of the patient's mouth directly on the tablet and have access to places within the mouth that may be more difficultto see with the naked eye. It can also allow more than one individual to see inside the mouth. For example, the dental professional can show the interior of the mouth to the patient or to other professionals via the display.

[0099] As can be appreciated, when the dental instrument is in the in-mouth position, the dental professional may simply want to activate light sources without streaming video for display. In the present embodiment, this is can be achieved by operating the dental instrument in a free mode. The free mode can be triggered by an external command executed by the dental professional. The external command can be executed in various forms. For instance, in some embodiments, a button can be provided on the dental instrument and can be operated to transition between the different operating modes. In some embodiments, the free mode can be accessed via a software application on the external device and displayed on the display. For instance, the free mode can be toggled on or off by a button via a graphical user interface accessible via the display of the tablet. In the present embodiment, following a determination that the dental instrument is in the in-mouth position, a subsequent step 441 involves determining whether the dental instrument is currently being operated in the free mode. If it is determined that the dental instrument is being operated in the free mode, the optical sensor is operated in the streamless and low FPS mode 440a. If it is determined that the dental instrument is not being operated in the free mode, the optical the optical sensor is operated in the video-streaming and high FPS mode 440b, for example to allow capturing images and / or streaming video using the optical sensor.

[0100] Although operation of the light sources and the optical sensor was described above, it is appreciated that other electronic components of the dental instruments can also be operated based on the determined position of the dental instrument with respect to the patient’s mouth. For example, in embodiments where the dental instrument includes a heating assembly, such as the heating assembly 141 described above, the heating assembly can be operated to maintain a defined temperature following a determination that the dental instrument is in the in-mouth temperature. For example, the defined temperature can correspond to approximately 37°C and / or a temperature that is modulated according to a measured ambient temperature. Following a determination that the dental instrument is in the out-of-mouth position, the heating assembly can bedeactivated and / or maintained in a low power mode. The heating assembly can be controlled by microprocessor by providing corresponding control signals and / or voltages.

[0101] As can be appreciated, once a dental procedure is complete, the dental professional may want to shut down the dental instrument and power off its electronic components. In the present embodiment, this can be achieved by operating the dental instrument into an exit state. The exit state can be triggered by an external command executed by the dental professional. The external command can be executed in various forms. For instance, in some embodiments, a button can be provided on the dental instrument and can be operated to enter the exit state. In some embodiments, the exit state can be triggered via a software application on the external device. For instance, the exit state can be triggered by a button provided on a graphical user interface provided by the display of the tablet. In some embodiments, the exit state can be triggered automatically, for example following a determination that the dental instrument has been resting on a table, in a dental handpiece holder and / or is otherwise stationary for a predetermined amount of time.

[0102] In the present embodiment, a subsequent step 443 of method 400 involves determining whether the exit state has been triggered. If it is determined that the exit state has been triggered, the LEDs and / or other electronic components can be powered off and / or placed in a standby or low power mode 445. The method 400 can subsequently reach and end 447 where the dental instrument is shut down, for example requiring the dental instrument to be reinitialised before beginning method 400 again. If it is determined that the exit state has not been triggered, the steps of method 400 can be repeated, for example continuing to receive and process input from optical sensor in step 410.

[0103] The method 400 described above generally involves the interpretation and / or processing of an optical signal to determine the position of the dental instrument. The method 400 can therefore be carried out while the dental instrument is in an image acquisition mode in which optical signals and / or images are being actively captured by the optical sensor. It is appreciated, however, that the dental instrument can operate in other modes where images are not being actively captured by the optical sensor, such as a shutdown mode and / or a sleep mode. Accordingly, with reference to Figure 9, a preliminary initialisation process 500 can be carried out to place the dental instrument,such as the components of the control system 300, in a state enabling the detection and the processing of the optical signal, as well as initiating the process for capturing the optical signal 410 in order to perform the subsequent steps of the method 400.

[0104] Broadly described, the initialisation process 500 can involve initialising the above- mentioned system components 300 to allow capturing optical signals and / or images via optical sensor for subsequent processing. The initialisation can consist mainly in preparing the components of the system so that they can be functional to carry out the steps of the method 400. For example, first initialisation steps 510 can be performed when the system is powered on. The expression powered on herein refers to the system components transitioning from a previously inactive state to an active state, i.e. , from either a powered off or from a sleep state. In some embodiments, the initialisation steps 510 can include initialising the optical sensor 512 and initialising the external device 514. Initialising the optical sensor 512 can consist of providing power to the optical sensor 512 and / or applying initial parameters of the optical sensor. For example, the application of initial parameters can include that the optical sensor applies the low FPS mode and the stream-less mode as a default operating mode. In some embodiments, when the optical sensor 512 is initialised, it can be placed in a standby mode, for example to await a subsequent command before capturing and / or transmitting optical signals and / or images. Initialising the external device 514 can consist of initialising the processor(s) so that it is in a state to begin receiving optical signals and / or images from the optical sensor. The initialisation step 514 can include initializing an image and / or video server on the external device, such that the server begins listening for communications from the dental instrument. In some embodiments, the initialisation step can further include verifying and / or testing communication with the optical sensor to validate that the processor(s) can receive an optical signal.

[0105] Following the initialisation of the system components 510, a subsequent step 520 can consist of detecting movement of the dental instrument via motion sensors, such as the motion sensor(s) 386 described above. For example, signals generated by the motion sensors can be processed by the microprocessor provided on the dental instrument or on the external device to identify patterns representative of movement of the dental instrument. For instance, the motion sensor can detect a change in the position and / ororientation of the dental instrument indicative of the dental instrument being manipulated by the dental professional.

[0106] In the present embodiment, if motion is detected following step 520, the optical sensor can be operated to begin capturing and transmitting optical signals and / or images. For example, after detecting a signal indicative of movement, the optical sensor can operate in the image acquisition mode, so that the optical sensor can begin transmitting images to the processor(s) and so that the above-described method 400 can be carried out. After initialisation 512, and prior to detecting motion, the optical sensor can be continuously active and capturing images, without storing and / or transmitting such images. Thus, following detection of movement by the motion sensor, the optical sensor can be operated to start transmitting images to the processor(s).

[0107] If no motion is detected by the motion sensor following step 520, the optical sensor can enter the sleep mode 525. The sleep mode 525 can be triggered after a certain period of inactivity. For example, if the motion sensor does not detect motion for a certain number of seconds or minutes, the optical sensor and / or other components of the dental instrument can be placed into the sleep mode. In some embodiments, the sleep mode can involve the optical sensor continuing to capture images, but no longer transmitting to the processor(s). In some embodiments, the optical sensor can simply be turned off and / or placed in a low power or standby state in which it does not capture images. As can be appreciated, placing the components of the dental instrument into a sleep mode while the dental instrument is not in use can reduce power consumption and increase the battery life.

[0108] In the present embodiment, the motion sensor(s) can be active and ready to detect new movement even when the dental instrument is in the sleep mode. Accordingly, in step 530, if movement is detected while the dental instrument is in the sleep mode, action can be taken based on the detection of this movement. In particular, components of the dental instrument can be woken up from their sleep mode, for example by sending a signal to activate the optical sensor. Once the components of the dental instrument have been woken up, signals from the motion sensor can be processed again in step 520 to detect movement and carry out corresponding actions, such as beginning the image acquisition and processing 400, or re-entering the sleep mode 525.

[0109] In some embodiments, a subsequent step 540 can involve turning off or shutting down the dental instrument. Turning off the dental instrument can include turning off all components of the dental instrument (i.e., light sources, optical sensor, motion sensor). Turning off the dental instrument 540 can be accomplished by pressing a button provided on the dental instrument. In some embodiments, the dental instrument can be remotely turned off using a control available on the external device. In particular, the command to turn off the dental instrument can be executed via a button, provided by the software application available on the tablet. The tablet processor(s) can therefore send instructions to the microprocessor of the dental instrument to shut down the components.

[0110] Referring now to Figure 10, there is illustrated another embodiment of a dental instrument control system 300’. The system 300’ includes a dental instrument 310’ and an external device 330’. In this embodiment, the dental instrument 310’ comprises processor(s) 390 in operative communication with light sources 333, with an optical sensor 384 and with one or more motion sensors 386, all being integrated in the dental instrument 310’, such as the above-described dental instrument 10. The dental instrument 310’ further comprises memory 338 (e.g., non-volatile memory, such as electrically erasable programmable read-only memory, or other programmable memory), operatively connected to the processor(s) 390 of the dental instrument 310’. In some embodiments, the memory 338 can be embedded in the processor(s) 390 of the dental instrument 310’ (e.g., as part of a system on a chip SOC), while in other embodiments the memory 338 can be provided separately and be in communication with processor 390 via a PCB. In some embodiments, the processor(s) 390 of the dental instrument can comprise a specialized microprocessor, such as for example a T31 video processor, or other type of suitable processor.

[0111] The system 300’ can further include an external device 330’. In the present embodiment, the external device 330’ comprises at least one processor(s) 339, separate and distinct from the processor(s) 390 of the dental instrument 31 O’. The processor(s) 339 of the external device 330’ can be operatively connected to the processor(s) 390 of the dental instrument 310’, and can further be operatively connected to the memory 338 of the dental instrument 310’, for example via a wired or wireless connection. In some embodiment, the external device 330’ can further comprise a display 340.

[0112] It is appreciated, however, that other configurations are possible. For example, in other embodiments, the external device 330’ can correspond to other computing devices such as a smartphone, personal computer, etc.

[0113] The light sources 333 can be operated to be selectively modulated. By selectively modulated, it understood that individual light sources can be operated to be turned on to emit light and turned off to stop emitting light. In some embodiments, light sources 333 can correspond to the above-described light sources 133, 135 integrated to the dental instrument 10, such as the front-facing light sources 133 or front LED and the rear-facing light sources 135 or back LED, with the front LED and / or the back LED can be selectively turned on and turned off.

[0114] The optical sensor 384 is configured to capture optical signals corresponding to an analog or digital signal resulting from the conversion of light rays detected by the optical sensor. For instance, in the present embodiment, the optical sensor 384 is provided as part of a digital camera, and the optical signal consists of images captured by the camera. The optical sensor can be operated between an image acquisition mode and a videostreaming mode. In the image acquisition mode, the optical sensor can be operated to capture one or more pictures of the patient’s mouth and / or of a surrounding environment.

[0115] In the video-streaming mode, the optical sensor can be operated to stream acquired images to an external device 330’, such that the images can be displayed by the external device 330’, e.g., a tablet. Streaming the acquired images can include the optical sensor acquiring images by the processor(s) 390 of the dental instrument 310’, and transmitting the acquired images in substantially real-time to the processor(S) 339 of the external device 330’. The captured images correspond to continuous sequences, for example as a continuous series of frames captured at a steady rate. For instance, in the video-streaming mode, the optical sensor can be operated to transmit a live video feed to the external device 330’. The live video feed can thus be displayed on the display 340 provided on the external device 330’.

[0116] In both the image acquisition mode and the video-streaming mode, the optical sensor 384 operates at a uniform framerate, e.g. at a frame rate of 30 Hz (i.e. 30 frames per second) or below.

[0117] As can be appreciated, the optical sensor 384 can be provided as part of the dental instrument, allowing the capture of the optical signal inside the patient's mouth. For example, in some embodiments, the optical sensor 384 can correspond to the abovedescribed optical sensor 184 integrated into the head portion of the dental instrument 10. In this configuration, the optical sensor 384 can capture the optical signal when the head portion of the dental instrument is inserted into the patient's mouth. As can be appreciated, the optical sensor 384 can be provided as part of an integrated camera having a lens with a working distance and / or a maximum focal distance suitable for capturing clear images of structures in close proximity to the camera while inside the patient’s mouth. For example, the focal distance of the camera can be 10 cm or less. In some embodiment, the optical sensor 384 do not operate in auto-focus mode and operates at a constant focal distance.

[0118] The processor(s) 390 of the dental instrument 310’ is configured to operatively communicate with the processor(s) 339 of the external device 330’. By operatively communicate, it is understood that the processor(s) 390 of the dental instrument 310’ is configured to communicate via a wired or wireless communication with the processor(s) 339 of the external device 330’, to receive the optical signal captured by the optical sensor 384 and / or to transmit control signals to the optical sensor 384. As can be appreciated, the optical signal can be received in different forms. For instance, depending on the operational mode of the optical sensor, the processor(s) 390 of the dental instrument 310’ can receive individual images or a live video stream.

[0119] The processor(s) 390 of the dental instrument 310’ is further configured to process the received optical signal. As will be described in more detail hereinbelow, processing the optical signal can involve processing images contained in the optical signal to determine a position of the dental instrument with respect to the patient’s mouth. The processor(s) 390 can also be configured to control the light sources 333 and the optical sensor 384, based on the determined position.

[0120] It can be understood that the processor(s) 390 of the dental instrument 310’ is configured to operatively communicate with the motion sensor(s) 386, with the optical sensor 384 and with the light sources 333, to receive and process images from the optical sensor 384, to control the light sources 333 and / or to operate the optical sensor 384 in acomplete autonomous mode, without having any connection and / or communication with the external device 330’.Artificial Intelligence implementation:

[0121] With reference to figures 11 to 13, another embodiment of a method 600 for automatically controlling a dental instrument is described. The method 600 can be carried out on the control system 300’ as described above.

[0122] Broadly described, the method comprises a first step of detecting movement of the dental instrument via motion sensors 610. The signals generated by the motion sensors can be processed by the processor 390 provided on the dental instrument 310’ to identify patterns representative of movement of the dental instrument. For instance, the motion sensor can detect a change in the position and / or orientation of the dental instrument indicative of the dental instrument being manipulated by the dental professional.

[0123] In the present embodiment, if no motion is detected by the motion sensor following step 612, the dental instrument 310’ can enter the sleep mode 615. The sleep mode 615 can be triggered after a certain period of inactivity. For example, if the motion sensor does not detect motion for a certain number of seconds or minutes, the dental instrument 310’ can be placed into the sleep mode. In some embodiments, the dental instrument 310’ can simply be turned off and / or placed in a low power or standby state. As can be appreciated, placing the components of the dental instrument into a sleep mode while the dental instrument is not in use can reduce power consumption and increase the battery life.

[0124] In the present embodiment, the motion sensor(s) can be active and ready to detect new movement even when the dental instrument is in the sleep mode. Accordingly, in step 612, if movement is detected while the dental instrument is in the sleep mode, action can be taken based on the detection of this movement.

[0125] In the present embodiment, if motion is detected in step 612, the automatic mode 620 of the dental instrument 310’ is activated. In the automatic mode, the dental instrument 310’ can operate alone, without any communication with the external device 330’. Oncethe control system 300’ has been placed in automatic mode, the optical sensor 384 can be operated to begin capturing and transmitting optical signals and / or images. For example, after detecting a signal indicative of movement, the optical sensor 384 can operate in the image acquisition mode 622, so that the optical sensor can begin to capture one or more pictures or images and transmit images to the processor(s) 390 of the dental instrument 310’. In some embodiments, in the image acquisition mode, the optical sensor is configured to generate a video stream comprising a plurality of images per second, and the processor(s) 390 can be configured to sample a part of the video stream for processing. For example, the processor(s) 390 can be configured to process four (4) images per second.

[0126] In the present embodiment, the images captured by the optical sensor 384 are processed by the processor(s) 390 using a machine learning predictive model 624. The machine learning is configured to predict a position 626 by interpreting and / or processing of the images to determine the position of the dental instrument using a pre-trained artificial intelligence model, as will be further detailed below in reference to Figures 12 and 13. In particular, the system can predict, using a machine learning predictive model, the position of the dental instrument. For instance, in some embodiments, the system can predict whether the dental instrument is in an in-mouth position, a cheek-retracting position, and an out-of-mouth position (or airborne position), among other positions.

[0127] In some embodiment, the objects appearing within the images can be used to explicitly or implicitly augment the machine learning model to predict the position. For example, a tooth, a tongue, and / or saliva, among others, identified within the image can indicate that the dental instrument is in the in-mouth position. Objects other than those corresponding to structures inside the patient’s mouth (i.e., anything other than the tooth, the tongue, and saliva) identified within the image can indicate that the dental instrument is in the out-of-mouth or airborne position. Absence of any objects in the image, black image or red image can indicate that the dental instrument is in the cheek- retracting position.

[0128] In some embodiments, the model can be configured to explicitly predict whether the dental instrument is in one of two positions (e.g., in-mouth or check retracting), and ifnot, the system can be configured to infer that the dental instrument is in a third position (e.g., out-of-mouth).

[0129] With reference to Figure 12, a process fortraining the machine learning predictive model 700 is described. The machine learning predictive model can be preliminarily trained by a computer-implemented classification module on a separate device, such as the external device 330’ for example. Offloading training from the dental instrument can allow reducing the processing burden and corresponding power consumption of the dental instrument 310’ to allow increased battery life.

[0130] Training the machine learning predictive model 700 can consist of providing a database 705 comprising a plurality of training images or manually annotated images 710 to determine the position of the dental instrument 310’ with respect to with respect to the patient’s mouth. For example, training images 710 can including a plurality of images labelled as corresponding to images captured while in-mouth, a plurality of images corresponding to images captured while in the cheek-retracting position, and a plurality of images captured while out-of-mouth. The training images 710 can be acquired, for example, using a similar dental instrument 310’ in a controlled environment.

[0131] A minimum number of training images can be provided to ensure appropriate training of the machine learning predictive model. For example, a minimum of twenty (20) training images per position can be provided, but other numbers of training images could be considered, such as hundreds of training images. Having hundreds of training images can improve the success in prediction of the position. As can be appreciated, the training images can include a wide range of variations to improve robustness of the trained model. For example, the training images can be captured subject to a variety of lighting conditions, and / or in a variety of environments. As another example, in-mouth and check-retracting images can be captured from mouths of a variety of different patients having anatomical differences. In some embodiment, the database 705 comprising the plurality of training or annotated images 710 can be stored on a memory 395 of the external device 330’.

[0132] In some embodiment, the training images 710 can be further pre-processed 720, for example to improve their quality, controlling the white balance or to reduce their size. In another embodiment, the training images 710 can be used without any pre-processing 720.

[0133] The machine learning predictive model can then be trained 730 using the computer-implemented classification module of the processor(s) 339 of the external device 330’. The machine learning predictive model can be trained on the training images 710 using any suitable supervised machine-learning algorithm. As a result, a new machine learning predictive model 740 can be generated.

[0134] In some embodiments, the performance of the new machine learning predictive model 740 can be evaluated 745. For example, the new machine learning predictive model 740 can be evaluated as meeting predetermined performance criteria 750 if at least a certain percentage of images are correctly predicted. For example, the percentage of correct prediction can be 70%, i.e. , if at least 70% of the images are correctly predicted, the new machine learning predictive model 740 can be evaluated as meeting the performance criteria.

[0135] If the new machine learning predictive model 740 does not meet the performance criteria, the process can return to training step 730, where the machine learning algorithm and / or hyperparameters can be tuned as needed. If the new machine learning predictive model 740 meets the performance criteria, the new machine learning predictive model 740 can be encoded 760 as a binary machine learning predictive model 770. The binary machine learning predictive model 770 can have a format that suits the architecture of the dental instrument 310’. In particular, the binary machine learning predictive model 770 can be encoded to be compatible with the processor(s) 390 of the dental instrument 310’.

[0136] Once encoded, the new binary machine learning predictive model 770 can be pushed 780 to the dental instrument 310’. In some embodiments, the binary machine learning predictive model 770 can be pushed 780 to the dental instrument 310’ through a firmware update downloaded to the dental instrument 310’. In some embodiments, the download of the firmware update can be done via wireless connection, such as Wi-Fi or Bluetooth®. In some embodiment, the download of the firmware update can be done by any other suitable communication process, wired or wireless. In some embodiments, the processor(s) 339 of the external device 330’ can download the firmware update on the memory 338 of the dental instrument 310’, and the processor(s) 390 of the dental instrument 310’ can reboot on the downloaded firmware update on the next cycle of power on of the dental instrument 310’. Once the new binary machine learning predictive model770 is loaded on the dental instrument 310’, the new binary machine learning predictive model 770 can run independently, without needing to receive updates from the external device 330’.

[0137] With reference to Figure 13, the step of predicting position 626 is further described, in an embodiment. The optical sensor 384 can operate in the image acquisition mode 622, so that the optical sensor or camera can capture one or more pictures or images as an image stream 800 that can be access by processor(s) 390. The processor(s) 390 is configured to select a window of M images 810 among the images in the received stream 800. In some embodiment, for each of the M images 820, 820’ received, the processor can further pre-process 825, 825’ each image for example to improve their quality, controlling the white balance or to reduce their size. In another embodiment, the M images 820, 820’ received can be directly transferred to the machine learning predictive model 624 without being pre-processing 825, 825’.

[0138] Each of the number M of images can be provided as individual inputs to the machine learning predictive model 624 as described above. As a result, for each of the number M of images received by the machine learning predictive model 624, a predicted position 830, 830’ of the dental instrument 310’ with respect to the patient’s mouth is predicted.

[0139] In some embodiments, the number M of predicted positions 830, 830’ are further post-processed 840 to determine the new predicted position 626. Post-processing the number M of predicted positions 830, 830’ can further comprise comparing the number M of predicted position 830, 830’ of the dental instrument 310’, and adjusting the new predicted position 626 of the dental instrument if at least a predefined percentage of the number M of predicted position 830, 830’ are similar.

[0140] For example, the image stream 800 can be sampled at 4 images per second, and the processor(s) 390 of the dental instrument 310’ can select a window of M = 4 images. The new predicted position 626 of the dental instrument can be adjusted if at least 75% of the number M of predicted position 830, 830’ are similar, i.e. , if at least 3 out of 4 of the predicted position 830, 830’ are similar. Therefore, the new predicted position 626 is updated about each second. In other embodiments, other image stream rate can beconsidered, other number M of images can be selected, and other percentage of similar predicted positions can be considered.

[0141] Once the new predicted position 626 has been determined, the processor(s) 390 of the dental instrument 310’ can further compare 860 the new predicted position 626 with the states of the light sources 333 integrated in the dental instrument 310’, i.e. , the states of the front LED and the states of back LED. If the new predicted position 626 requires the LED states to be modified, then the processor(s) 390 can further transmit the new LED state 870 command to the light sources or LEDS 880, as will be further detailed below. The LED state 890 is therefore updated for the next cycle of comparison 860.

[0142] Referring back to Figure 11 , once the new predicted position 626 of the dental instrument with respect to the patient’s mouth has been determined, the processor(s) 390 of the dental instrument 310’ can further control the light output of the light sources based on the new predicted position 626. As can be appreciated, controlling the light output can include turning on and / or turning off the front LED, and turning on and / or turning off the back LED.

[0143] Following a determination that the dental instrument 310’ is in the out-of-mouth position (also referred to as the airborne position) 628c, both the back LED and the front LED are turned off 630c.

[0144] Following a determination that the dental instrument 310’ is in the cheekretracting position (also referred to as the cheek position) 628b, the back LED are turned on while the front LED are turned off 630b.

[0145] Following a determination that the dental instrument 310’ is in the in-mouth position (also referred to as the mouth position) 628a, the front LED are turned on while the back LED are turned off 630a.

[0146] The steps of image acquisition 622, machine learning predictive model prediction 624, prediction of the position 626, and control of the light sources 630a, 630b, 630c can be repeated continuously, as long as the automatic mode 620 is activated or until an exit mode 640 is detected. The exit mode 640 can be activated by the dental professional, by a shut down of the dental instrument 310’ and power off its electronic components. In thepresent embodiment, the exit mode 640 can be triggered by an external command executed by the dental professional. The external command can be executed in various forms. For instance, in some embodiments, a button can be provided on the dental instrument 310’ and can be operated to enter the exit mode 640. In some embodiments, the exit mode can be triggered via a vocal command. In some embodiments, the exit mode can be triggered automatically, for example following a determination that the dental instrument has been resting on a table, in a dental handpiece holder and / or is otherwise stationary for a predetermined amount of time. When the dental instrument 310’ is detected to be placed in the exit mode 640, both the back LED and the front LED are turned off 645. The above-described embodiment allows the automatic mode to operate the dental instrument 310’ independently from the external device 330’.

[0147] In some embodiment, the dental professional can also deactivate the automatic mode 620, by operating the button provided on the dental instrument 310’, by a vocal command, by checking the dental instrument with a predetermined sequence, or by any other way of controlling the dental instrument.

[0148] When the dental instrument 310’ is deactivated from the automatic mode 620, the processor(s) 390 of the dental instrument 310’ can be configured to receive a command 650. This mode can be assimilated to a manual mode and the command can be transmitted by the dental professional by operating the button provided on the dental instrument 310’, by a vocal command, by checking the dental instrument with a predetermined sequence, or by any other way of controlling the dental instrument.

[0149] In some embodiments, the command 650 received can be to activate the automatic mode 652. In this embodiment, the dental instrument 310’ is back in the automatic mode 620 as described above.

[0150] In some embodiments, the command 650 received can be to activate the photo capture mode 654, or activate the video streaming mode 656. In both modes, the front LED are turned on while the back LED are turned off 660a. The dental instrument 310’ remains in the selected mode until a new command 650 is received or until an exit mode 670 request is triggered by an external command executed by the dental professional, as for example by operating the button provided on the dental instrument 310’, by a vocalcommand, by checking the dental instrument with a predetermined sequence, or by any other way of controlling the dental instrument.

[0151] When the dental instrument 310’ is configured in the photo capture mode 654, the optical sensor 384 can operate in the image acquisition mode to capture one or more pictures or images and transmit images to the processor(s) 390 of the dental instrument 310’. When the dental instrument 310’ is configured in the video streaming mode 656, the optical sensor 384 can operate in the video acquisition mode to capture a video and transmit a video stream to the processor(s) 390.

[0152] In some embodiments, the photo capture mode 654 or the video streaming mode 656 can further comprise activating a communication between the processor(s) 390 of the dental instrument 310’ and the processor(s) 339 of the external device 330’ and display the image or the video streaming directly on the display 340 of the external device 330’. Having the front LED turned on and the back LED turned off 660a during the photo capture mode 654 or the video streaming mode 656 allows a better illumination of the mouth during the photo capture or the video streaming and results in a better quality of the images and / or video stream displayed on the display 340.

[0153] In some embodiments, the command 650 received can be to place the dental instrument 310’ in an idle mode 658 where both the back LED and the front LED are turned off 660c. The idle mode can be useful if the dental professional wants to operate the dental instrument 310’ in the same manner as a traditional dental mirror, i.e. , looking through the mirror without having any light sources activated.

[0154] The step of receiving a command 650 can be repeated continuously, as long as a command 650 is received or until an exit mode 670 is detected. The exit mode 670 can be activated by the dental professional, by a shut down of the dental instrument 310’ and power off its electronic components. In the present embodiment, the exit mode 670 can be triggered by an external command executed by the dental professional. The external command can be executed by operating the button provided on the dental instrument 310’, by a vocal command, by checking the dental instrument with a predetermined sequence, or by any other way of controlling the dental instrument. In some embodiments, the exit mode 670 can be triggered automatically, for example following a determination that the dental instrument has been resting on a table, in a dental handpiece holder and / or isotherwise stationary for a predetermined amount of time. When the dental instrument 310’ is detected to be placed in the exit mode 670, both the back LED and the front LED are turned off 675.

[0155] It will be appreciated that for simplicity and clarity of illustration, where considered appropriate, reference numerals may be repeated among the figures to indicate corresponding or analogous elements. In addition, numerous specific details are set forth in order to provide a thorough understanding of the example implementations described herein. However, it will be understood by those of ordinary skill in the art that the example implementations described herein may be practiced without these specific details. In other instances, well-known methods, procedures, and components have not been described in detail so as not to obscure the example implementations described herein. Also, the description is not to be considered as limiting the scope of the example implementations described herein.

[0156] While the above description describes features of example implementations, it will be appreciated that some features and / or functions of the described implementations are susceptible to modification without departing from the spirit and principles of operation of the described implementations. For example, the various characteristics which are described by means of the represented implementations or examples may be selectively combined with each other. Accordingly, what has been described above is intended to be illustrative of the claimed concept and non-limiting. It will be understood by persons skilled in the art that other variants and modifications may be made without departing from the scope of the invention as defined in the claims appended hereto. The scope of the claims should not be limited by the preferred implementations and examples, but should be given the broadest interpretation consistent with the description as a whole.Numeral references of the elements shown in the drawings10 dental instrument100 head portion102 housing sidewall102 reflective layer104 housing bottom wall110 open - top housing118 optical diffusing assembly120 reflective layer121 portion of the reflective layer122 reflective surface130 PCB132 upper surface133 front - facing light sources134 surface135 rear - facing light sources139 microprocessor140 outer diffusing layer141 heating assembly150 intermediate diffusing layer160 optical diffusing layer184 optical sensor200 handle portion204 longitudinal end300 dental instrument control system310 dental instrument330 external device333 light sources338 memory of dental instrument339 processor(s) of external device340 display384 optical sensor386 motion sensorsprocessor(s) of dental instrument memory of external device method image sensor input image processing a Back LED off Front LED on b Back LED on Front LED offc Turn off all LED a low FPS mode b high FPS mode Free modeExit low power mode end initialisation process initialisation steps image sensor initialisation video server initialisation check motion sensor sleep mode wake up on movement shutdown method check motion sensors motion detectedEnter sleep mode automatic mode image acquisition machine learning model new predicted positiona mouth position b cheek position c airborne positiona Back LED off Front LED on b Back LED on Front LED off c Turn off all LED exit modeTurn off all LED command received activate automatic mode photo capture mode video streaming mode idle mode a Back LED off Front LED on c Turn off all LED exit modeTurn off all LED machine learning model training database training images pre - process images train machine learning model with supervision new machine learning model evaluate model performance new model performance meets criteria transform model for mirror architecture new binary machine learning model push model on device image stream select window of M images image image pre - processing predicted position post - process predicted position compare position and LED states new LED state880 LEDS890 update LED state

Claims

CLAIMS1 . A method for automatically controlling a dental instrument having integrated light sources and an integrated optical sensor, the method comprising: capturing an optical signal via the integrated optical sensor; processing the optical signal to determine a position of the dental instrument with respect to a patient’s mouth; and controlling a light output of the integrated light sources based on the determined position.

2. The method according to claim 1 , wherein the determined position of the dental instrument comprises one of an in-mouth position, a cheek-retracting position, and an out-of-mouth position.

3. The method according to claim 2, wherein the optical signal comprises an image captured by the integrated optical sensor.

4. The method according to claim 3, wherein processing the optical signal to determine the position of the dental instrument with respect to the patient’s mouth comprises detecting objects within the image.

5. The method according to claim 4, wherein determining that the dental instrument is in the in-mouth position comprises detecting that one of the objects corresponds to a tooth, a tongue and / or saliva.

6. The method according to claim 4 or 5, wherein determining that the dental instrument is in the cheek-retracting position comprises detecting that the image is deprived from any objects.

7. The method according to any one of claims 4 to 6, wherein determining that the dental instrument is in the out-of-mouth position comprises detecting objects other than a tooth, a tongue and / or saliva.

8. The method according to any one of claims 1 to 3, wherein processing the optical signal to determine the position of the dental instrument with respect to the patient’s mouth further comprises:predicting, using a machine learning predictive model, the position of the dental instrument with respect to the patient’s mouth.

9. The method according to claim 8, wherein the machine learning predictive model is preliminarily trained by a computer-implemented classification module of a computer by machine learning using a plurality of training images to determine the position of the dental instrument with respect to the patient’s mouth, wherein the computer is hosted in an external device, separated from the dental instrument.

10. The method according to claim 9, wherein the trained machine learning predictive model is downloaded from the computer to a processor of the dental instrument.

11. The method according to any one of claims 8 to 10, wherein processing the optical signal to determine the position of the dental instrument with respect to the patient’s mouth further comprises: receiving a number (M) of consecutive optical signals, for each of the number (M) of optical signals received, predicting, using the machine learning predictive model, the position of the dental instrument with respect to the patient’s mouth; comparing the predicted position of the dental instrument for the number (M) of optical signals received; and adjusting the predicted position of the dental instrument if at least a predefined percentage of the number (M) of predicted position are similar.

12. The method according to any one of claims 2 to 11 , wherein controlling the light output of the integrated light sources further comprises turning on at least one of the integrated light sources when the dental instrument is in the in-mouth position or the cheek- retracting position.

13. The method according to claim 12, wherein the dental instrument comprises a frontfacing light source and a rear-facing light source opposite the front-facing light source, the method comprises turning on the front-facing light source while turning off the rear-facing light source when the dental instrument is in the in-mouth position,and turning on the rear-facing light source while turning off the front-facing light source when the dental instrument is in the cheek-retracting position.

14. The method according to any one of claims 2 to 13, wherein controlling the light output of the integrated light sources comprising turning off the integrated light sources when the dental instrument is in the out-of-mouth position.

15. The method according to any one of claims 2 to 14, wherein the dental instrument further comprises a motion sensor, the method comprising activating the integrated optical sensor to capture optical signal upon detection of a movement of the dental instrument by the motion sensor.

16. The method according to any one of claims 1 to 15, wherein the dental instrument is a dental mirror.

17. A dental instrument, comprising: an optical sensor adapted to acquire an optical signal; light sources operable to adjust a light output; and a processor in operative communication with the optical sensor and the light sources, the processor being configured to receive the optical signal and process the optical signal to determine a position of the dental instrument with respect to a patient’s mouth, and to send a control signal to the light sources to control the light output of the optical sensor based on the determined position.

18. The dental instrument according to claim 17, wherein the processor further comprises a machine learning predictive model to process the optical signal to determine the position of the dental instrument with respect to the patient’s mouth.

19. The dental instrument according to claim 18, wherein the processor further comprises a transceiver in communication with a computer to download the machine learning predictive model from the computer, wherein the machine learning predictive model is preliminarily trained by a computer-implemented classification module of the computer by machine learning using a plurality of training images to determine the position of the dental instrument with respect to the patient’s mouth before the download.

0. The dental instrument according to any one of claims 17 to 19, further comprising a motion sensor, wherein the optical sensor is activated to acquire the optical signal upon detection of a movement of the dental instrument by the motion sensor.

Images