Oral Scanner System

Abstract

This application relates to an oral scanner system, the oral scanner system using at least one oral health sensor configured and / or arranged to output oral health sensor data obtained during a scanning procedure related to at least one oral health condition to perform a scanning procedure of at least a part of the oral cavity; a position detector configured and / or arranged to output position sensor data related to a position or location where the oral scanner is currently performing a scanning procedure or has performed a scanning procedure at a given time; a processor configured and / or arranged to receive the oral health sensor data and the position sensor data, process the position sensor data to determine at least one discrete position or location from at least two discrete positions or locations of at least a part of the oral cavity where the oral scanner is currently performing a scanning procedure or has performed a scanning procedure at a given time, and assign oral health data to the determined discrete position or location, or process the oral health sensor data to determine oral health data related to at least one oral health condition and assign the oral health data to the determined discrete position or location; and a feedback unit configured and / or arranged to provide feedback regarding the oral health sensor data and / or the oral health data for at least two discrete positions or locations during the scanning procedure.

Description

Technical Field

[0001] The present disclosure relates to an oral scanner system comprising an oral scanner, a position sensor, and a processor configured and arranged for processing oral health sensor data and position sensor data related to at least one oral health condition.

Background Art

[0002] Various professional and home-use oral scanner systems are known to those skilled in the art.

[0003] Particularly with respect to home-use oral scanner systems, there is a general interest in providing an oral scanner system that enables improved usability or improved guidance through an oral scan procedure and / or more versatile and ideally intuitively understandable communication of oral health data related to at least one oral health condition in the context of continuous oral care treatment. According to some aspects, there is a desire to provide at least alternative oral scanner systems.

Summary of the Invention

Means for Solving the Problems

[0004] According to at least one aspect, an oral scanner system is provided, the oral scanner system using at least one oral health sensor configured and / or arranged to output oral health sensor data obtained during a scan procedure related to at least one oral health condition to perform a scan procedure of at least a part of the oral cavity, a position detector configured and / or arranged to output position sensor data related to a position or location where the oral scanner is currently performing a scan procedure or has performed a scan procedure at a given time, a processor configured and / or arranged to receive the oral health sensor data and the position sensor data, process the position sensor data to determine at least one discrete position or location from at least two discrete positions or locations of at least a part of the oral cavity where the oral scanner is currently performing a scan procedure or has performed a scan procedure at a given time, assign the oral health sensor data to the determined discrete position or location, and / or process the oral health sensor data to determine oral health data regarding at least one oral health condition and assign the oral health data to the determined discrete position or location, and a feedback unit configured and / or arranged to provide feedback regarding the oral health sensor data and / or the oral health data for at least two discrete positions or locations during the scan procedure, preferably as live or real-time feedback.

[0005] According to at least one aspect, an oral scanner system is provided, the oral scanner system comprising an oral scanner, the oral scanner being configured and / or arranged to acquire and output image data from at least a part of a subject's dentition during an optical scan procedure, a camera, and a position detector configured and / or arranged to acquire and output position sensor data during the optical scan procedure, an oral health sensor, the position sensor comprising at least one from a list including an accelerometer and a gyroscope, a processor configured and / or arranged to receive the image data and the position sensor data, process the position sensor data to determine at least one discrete position or location from at least two discrete positions or locations of at least a part of the oral cavity where the oral scanner is currently performing a scan procedure, process the image data to determine oral health data regarding at least one oral health condition, and assign the determined oral health data to the determined discrete position or location, and a display unit configured and / or arranged to provide a visualization of the oral health sensor data and / or the oral health data for at least two discrete positions or locations during the optical scan procedure, preferably as a live or real-time visualization, more preferably in the form of a single value such as a percentage value for each of the at least two discrete positions or locations.

[0006] The above aspect will be described in more detail in the following description of assisting the user in using the oral scanner system by continuous and / or induced human and device interactions. Live or real-time feedback on support supports more optimized use of the oral scanner system. In addition to the oral scanner system described herein, a method of using the oral scanner system to scan at least a part of the oral cavity is also contemplated.

Brief Description of the Drawings

[0007] The present disclosure will be made more apparent by a detailed description of exemplary embodiments and reference to the drawings.

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

DETAILED DESCRIPTION OF THE INVENTION

[0008] The following is a general disclosure of an exemplary oral scanner and an exemplary processor, and further optional components such as a separate device that implements at least a portion of a feedback unit including, for example, a display and / or an oral care device. The phrase "configured and / or arranged" as used in this disclosure refers to the structural and / or computer-implemented features of each component, and implies that each feature or component is not only suitable for something, but is structurally and / or software-wise arranged to actually perform as intended during operation. Here, it is emphasized that an oral scanner according to this disclosure does not provide the oral care activity itself, in particular does not include an oral cleaning element, that is, an oral scanner without an oral cleaning element or other oral treatment or care element, and does not provide oral cleaning or oral treatment or oral care. In other words, this disclosure relates to an oral scanner having at least one oral health sensor without further oral cleaning / treatment / care functions. As will be described later, such a single oral scanner device may cooperate directly or indirectly with an oral care device configured and / or arranged to provide an oral care activity. In such a system, the oral scanner and the oral care device are dedicated devices optimized for individual tasks, and one or the other device can benefit from information previously recorded by the other device. For example, the oral scanner may scan areas and / or segments of low oral activity by the oral care device, and vice versa. The oral care device may provide feedback to the user to increase oral care activity in areas and / or segments where the oral scanner has determined the presence of oral health problems.

[0009] General Considerations The present disclosure relates to an oral scanner system comprising at least an oral scanner and a processor, where the processor may be physically located in or within the oral scanner, or may be realized as a processor separate from, i.e., remote from, the oral scanner. As will be described in more detail below, the processor may be realized in a distributed manner. The oral scanner system may specifically comprise at least one separate or remote device that realizes at least a part of a feedback unit, such as a display. This does not exclude, for example, the oral scanner itself from alternatively or additionally including a display and / or at least one visual feedback element. The remote display and the remote processor may be arranged together in a separate device, i.e., they may have an integrated outer housing. The separate device may be a proprietary or custom-made device, such as a charger with a display, or a computer, laptop, notebook, tablet, telephone such as a mobile phone or smartphone, or a generally known device such as a smartwatch that can be used to realize a separate display and / or a separate processor. The oral scanner system may comprise at least one oral care device, in particular an electric toothbrush, that is directly or indirectly coupled to the oral scanner and / or the processor, preferably for data exchange by means of wireless communication, for example, for at least a limited period of time, as an alternative to or in addition to the separate device. The oral scanner and the oral care device may share the same handle and may be realized in this way only by attaching their respective oral scanner head or oral care head to the handle. However, it may be preferable to have an independent oral care device that has its own handle and is arranged to be used independently of the oral scanner system, i.e., it may be hardware-disconnected from the oral scanner system. It may be foreseeable that the oral care device may need to be initially registered with the oral care system in order to become part of the oral care system.The oral scanner system may include at least one charger for charging a rechargeable energy storage unit of the oral scanner and / or an oral care device and / or a separate device. The charger(s) may be a wireless charger such as an inductive charger.

[0010] The oral scanner may comprise at least one oral health sensor for obtaining, detecting, measuring or determining and outputting at least one oral health sensor data regarding at least one oral health condition. Hereinafter, one of the terms “obtain”, “detect”, “measure” or “determine” (or other forms of these verbs or nouns derived from these verbs) shall be used in relation to the oral health sensor, which shall also include other terms. The oral scanner system may comprise at least one position sensor configured and / or arranged to provide, i.e., output, position sensor data that enables detecting, measuring or determining at least one discrete position or location (or segment) where the oral scanner is currently performing a scan procedure or was performing a scan procedure at a given time, and the scan procedure includes determination of the oral health sensor data. In this context, the term “discrete” related to the position of a location within the oral cavity shall indicate that the oral cavity is divided into one or more discrete regions or segments, such as the upper and lower jaws. Typically, the discrete regions or segments do not overlap and essentially completely or without gaps cover the parts of the oral cavity intended to be scanned.

[0011] Here, the object of the present proposal is to provide easy-to-understand information. For example, the acquired oral health information or scan procedure progress information is provided in a way that is processed for each discrete position or location (or for each segment). Specifically, it is mentioned that it is reduced to a single value or a single mark, that is, a single percentage value representing the current or finally achieved scan procedure progress or oral health state, or a color indicating the achieved scan procedure progress or oral health state. This oral scanner system is particularly intended for home use by laypersons. Therefore, the improvements and benefits associated with the present proposal are particularly seen in such home use by non-expert users.

[0012] The term "sensor" is to be understood to cover sensor types that measure or determine parameters related to oral health based on ambient light incident on the sensor or external measurement media such as saliva available in the oral cavity analyzed by the sensor, that is, sensors equipped with a sensor receiver. The term "sensor" further covers sensor types that are equipped with a measurement medium such as light, that is, a sensor emitter arranged to emit light, and a sensor receiver such as a light receiver, such that the measurement or determination depends at least in part on a non-external measurement medium that means the measurement medium provided by each sensor emitter. The oral scanner is configured and / or arranged to perform a scan procedure for acquiring oral health sensor data related to the oral scanner determining oral health sensor data, preferably oral health data related to at least one oral health state, from at least a part of the oral cavity via an oral health sensor. Preferably, the oral health sensor data and / or the oral health data determined therefrom are acquired in a position-resolved or location-resolved manner. That is, each oral health sensor data and / or oral health data is assigned to position data or location data derived from position sensor data acquired by a position sensor with respect to the same time or period when the oral health sensor data was acquired.

[0013] In the context of the present disclosure, the term "oral health sensor data" refers to essentially unprocessed data output by an oral health sensor during a scan procedure (e.g., image data if the oral health sensor is a camera, or a pH value if the oral health sensor is a pH sensor), and the term "oral health data" refers to processed oral health sensor data (e.g., a normalized or absolute region per tooth or discrete position or location indicating dental plaque, or an average pH value per discrete position or location). In some cases, oral health sensor data is itself a direct measure of oral health status. For example, it should be understood that oral health sensor data from a halitosis sensor may not require further processing to enable a user to determine whether the user has halitosis, as the halitosis sensor may provide a certain level of sulfur emission. The processing of oral health sensor data can then be considered as a classification into at least one of at least two state classes of the oral health sensor data, e.g., a classification into "no associated level of halitosis" as one state class and "associated level of halitosis" as another state class. The classification can then be performed by a processor by comparison with at least one threshold. More complex classification concepts are described below. Of course, the classification described above can also use processed oral health sensor data, i.e., oral health data. For example, the output from a halitosis sensor may be averaged over several measurement instances and then used for classification.

[0014] The processor is coupled to an oral health sensor and / or a position sensor to receive at least one sensor data, preferably a plurality and / or a series of sensor data. It may receive single sensor data in chronological order and accumulate it into multiple time interval sensor data, or receive multiple sensor data at each measurement time and accumulate multiple sensor data into multiple time interval sensor data. The sensor data may be transmitted to the processor as a sensor signal. For example, the sensor signal may often be a voltage signal that is the output of a sensor measuring physical, chemical, or material properties. The sensor signal may be an analog signal or a digital signal. Here, the term "datum" or "data" refers to the information content of the physical quantity for which the sensor data (datum) or sensor data (data) is transmitted and the "signal". When the term "sensor data" is used in the present disclosure, it shall refer to "oral health sensor data" provided by the oral health sensor and "position sensor data" provided by the position sensor. If it is intended to mean only one of the two types of data, the more limited terms for each are used. The processor is preferably arranged to process sensor data from at least one oral health sensor and at least one position sensor such that at least one position-resolved or location-resolved oral health data regarding at least one oral health state is determined. However, the oral health sensor outputs oral health sensor data that can be processed by the processor to determine oral health data, the position sensor outputs position sensor data that is processed by the processor to determine position data, and it is further clarified that the processor can associate or assign oral health data and position data with each other such that position-resolved or location-resolved oral health data is obtained. As described above, the oral health sensor data can be assigned to the position data without the need for further processing of the oral health sensor data.

[0015] The oral scanner may include a scanner head and a scanner handle that can be removably connected, and thus, it is not excluded that the scanner head and the scanner handle can be non-removably connected and form one integrated device. The oral scanner may have a housing that surrounds a hollow portion where components of the oral scanner, such as an energy source, a controller, a scanner communicator, etc., can be disposed. The housing may be such that the user can conveniently hold the oral scanner by hand. The scanner head may be sized and shaped to be conveniently inserted into the oral cavity. The housing can accommodate at least one user-operable control element, such as an on / off button or an on / off switch or a selector button or a selector switch, or any other such element typically expected or seen on an oral scanner. The housing can further accommodate at least one feedback element of a feedback unit configured and / or arranged to provide the user with perceptible feedback. The feedback unit may include one or several feedback elements, for example, a display provided by a separate device. The at least one feedback element can include, without limitation, at least one from a list including optical feedback elements such as a light emitter or a plurality of light emitters or a display, acoustic feedback elements such as a loudspeaker or a piezoelectric speaker or a buzzer, and a vibrator or any other type of tactile or haptic feedback generator, such as a refreshable braille display, etc.

[0016] In embodiments where the oral scanner system includes a display as an element of the feedback unit, realized, for example, in the oral scanner and / or by a separate device or in a separate device, the display can be arranged to visualize feedback regarding oral health (sensor) data related to at least one oral health state for at least two discrete positions or locations (or segments). For example, the display may be configured and / or arranged to visualize discretely-position-resolved or discretely-location-resolved (or segment-resolved) oral health (sensor) data. The term "oral health (sensor) data" where the sensor is within the data is intended to include oral health sensor data and oral health data. The display may be configured and / or arranged to show a depiction or visualization of at least a portion of the oral cavity, for example, an abstract or generalized depiction of at least a portion of the oral cavity such as the dentition. The display can be arranged to additionally depict at least one oral health state and / or at least one state class related to at least one oral health state for oral health (sensor) data that can be classified for at least one oral health state and / or provide at least one feedback regarding the oral health (sensor) data. The feedback can be realized by changing the depiction or visualization of at least a portion of the oral cavity, or by overlaying a visual representation of discretely-position-resolved or discretely-location-resolved (or segment-by-segment) oral health data on the depiction of at least a portion of the oral cavity, or by depicting oral health data on the display as, for example, text data and associating it with discrete positions or locations (i.e., segments) within the depiction of at least a portion of the oral cavity. The feedback and the depiction or visualization referred to here are typically carried out discretely, i.e., on a segment-by-segment basis.The present disclosure focuses on either an abstract or a more realistic depiction of a complete dentition, such as at least a portion of the oral cavity including the upper and lower jaws, along with overlaid oral health state data related to one or more oral health states, without excluding the possibility that the oral health state (sensor) data is presented as a table of oral health state (sensor) data related to one or several oral health states for discrete positions or locations within at least a portion of the oral cavity, for example. For instance, an overlay of a live image or an image calculated from an acquired image on a model such as a dentition is not considered discretely segmented feedback, as such an overlay leaves the analysis of the segment information to the consideration of an expert user. In the context of the present disclosure, feedback is provided in a processed manner such that it can provide a single display or a single value per segment to a non-expert user without the need for any analysis by the lay user's consideration.

[0017] Feedback regarding oral health (sensor) data may be provided "live" or in real-time, for example, while the user is performing a scan procedure using an oral scanner, meaning that the feedback can adapt to the live progress of the scan procedure, where "live" means that there is a short time delay between the acquisition step and the feedback step, for example, a time delay of less than 10 seconds, less than 5 seconds, less than 4 seconds, less than 3 seconds, less than 2 seconds, or less than 1 second. Feedback regarding oral health (sensor) data may alternatively or additionally be provided at the end of the scan procedure via summary feedback in which the accumulated oral health (sensor) data is presented as a final result. Again, all feedback described herein is to be understood as including discretely position-resolved or location-resolved (or per-segment) feedback. This can include a classification, preferably a discrete position-resolved or location-resolved (or per-segment) classification of the oral health (sensor) data with respect to at least two state classes associated with at least one oral health condition. Alternatively or additionally, the oral health (sensor) data and / or state classes determined by the classification of the current scan procedure may be compared to historical oral health (sensor) data and / or state classes from a previous scan procedure or a series of previous scan procedures, and the trend or progression of the oral health (sensor) data and / or state classes over time may be visualized as feedback. Again, this can be done in a discrete position-resolved or location-resolved (or per-segment) manner. Such historical data may be stored in a memory coupled or connected to a processor. The stored historical data may include oral care activity data regarding at least one oral care activity procedure performed using an oral care device, as will be described in more detail below.

[0018] The processor may be arranged to classify oral health (sensor) data into at least two different state classes related to at least one oral health state, for example, two state classes related to the severity of the oral health state. The processor may preferably be arranged to classify the oral health (sensor) data in a discretely position-resolved or location-resolved manner (or per segment), that is, the classification is performed for a first position or a first location or a first segment such as the upper right molar, or for at least a second position or a second location or a second segment such as the lower left molar or the front teeth. The possibility of subdividing the oral cavity into discrete positions or locations or segments will be explained in more detail below. By way of example, the oral cavity intended to be scanned may be the dentition. Possible segments / discrete positions or locations may be (a1) the upper and lower jaws, or (a2) the mandible and the maxilla, or (b) the upper right molar, the upper front teeth, the upper left molar, the lower left molar, the lower front teeth, and the lower right molar, or (c) the buccal surface of the upper right molar, the occlusal surface of the upper right molar, and the lingual surface of the upper right molar, or (d) the buccal, lingual, and chewing surfaces of tooth number 26 of the human dentition, or one of the above, and the tongue surface. All surfaces of all teeth in the human dentition can result in 72 segments (molars have two surfaces, canines and incisors have two surfaces), or 84 segments if all wisdom teeth are similarly included. In some examples, a complete scan of the user's dentition is intended as a standard scan procedure, but in some examples, the scan procedure only affects the selection of these segments that completely cover the human dentition. The latter may be the case especially when, after a previous scan session and / or after a previous oral care activity, only the selection of segments that cover the complete dentition is selected for repeated scanning or focused scanning.

[0019] The terms "discrete position" and "discrete location" or "segment" are used interchangeably herein. For readability, the present disclosure may not always refer to all three phrases in all instances.

[0020] The processor may be configured and / or arranged to process sensor data in a "live" manner, e.g., during a scan procedure, such that "live" or generally real-time information regarding the progress or status of the scan procedure and / or the progress or status of oral health data collection can be visualized as feedback on the display as already described. The live display may similarly include an abstract or more realistic depiction of at least a portion of the oral cavity and superimposed feedback regarding at least the status of the scan procedure. For example, the various discrete positions or locations or segments of the oral cavity being scanned may be individually highlighted in a graded or staged manner such that the user can readily identify where the oral scanner still needs to be moved or positioned in order to complete the scan procedure. By way of example, at least the depicted portion of the oral cavity may be shown in a starting color, e.g., dark blue, and the individual portions associated with different discrete positions or locations of the depicted portion of the oral cavity may be progressively depicted in brighter colors until they are essentially white in order to show the user the scan procedure that is partially completed or finally completed with respect to the indicated discrete position or location of the oral cavity. Feedback regarding the progress of the scan procedure may be derived independently from position sensor data, e.g., from the cumulative time the oral scanner has performed the scan procedure at individual discrete positions or locations. This does not exclude the processor from being configured and / or arranged to determine the progress of the scan procedure in a more refined manner, e.g., by checking whether an image taken by a camera, which is preferably part of the oral health sensor, from each discrete position or location of the oral cavity includes a sufficiently complete coverage of the discrete position or location of the oral cavity and / or whether such an image has a particular image quality, e.g., is not blurred, out of focus, etc. Feedback regarding the progress of the scan procedure may further include an overlay of position-resolved or location-resolved oral health (sensor) data on an abstract or more realistic depiction of at least a portion of the oral cavity.It should be understood that the visualization feedback overlay for display on a display means the generation of a single image that is displayed on the display by a display controller. Here, an overlay means that a base image, for example, a depiction of a dental arch, is modified to reflect the additional feedback to be provided.

[0021] The various components of an oral scanner system, such as an oral scanner, a processor, a separate display, a charger, and / or an oral care device, may be arranged to communicate for data exchange or, more generally, at least unidirectionally, preferably bidirectionally, between at least two of these components. Such data exchange or communication may be realized, for example, by a wired connection when the processor is housed inside the oral scanner, but preferably by wireless communication when the data exchange is to be performed between separate components. Then, one of the components of the oral scanner system, such as the oral scanner, comprises a scanner communicator such as a transmitter or transceiver, and another component, such as a processor implemented within or by a separate device, comprises a processor communicator such as a receiver or transceiver that can use a proprietary or standardized wireless communication protocol such as the Bluetooth protocol, the Wi-Fi IEEE 802.11 protocol, the Zigbee protocol. Each of the components of the oral scanner system may be arranged to communicate with one or some of the other components of the oral scanner system and / or to wirelessly communicate with another device such as an Internet router or a mobile phone or a tablet or a computer to establish a connection to the Internet, for example, to send data to a cloud server that may be part of the oral scanner system and / or to be arranged to receive data from any Internet service such as a cloud server or a weather channel or a news channel. This means that the oral scanner system may be arranged to communicate with the Internet either directly or indirectly via a detour through a device that is not part of the oral scanner system.

[0022] Furthermore, oral health (sensor) data and / or state classes (positionally or locally resolved) may also be communicated from an oral scanner and / or a processor to an oral care device such as an electric toothbrush, a gum massager, an oral irrigator, a floss device, a calculus remover, a tooth polishing device, a tooth whitening device, etc. Further, the processor may communicate control data to the oral care device, whereby the oral care device may be enabled to select, based on the control data, preferably in a discretely positionally or locally resolved manner, one of at least two operating settings. The latter requires that the discrete position or location where the oral care device is currently performing an oral care activity procedure is also determined or tracked or monitored. An oral care device position sensor may be used for this task, and since the principle is the same, the description of the discrete position or location determination of the oral scanner is referred to.

[0023] Oral Scanner Hardware: Attachment The various hardware components of the oral scanner have already been described. Additionally, the oral scanner may comprise an attachment that is preferably arranged to be replaceable so that different attachments can be used for different users or different applications. One focus of the present disclosure is an oral scanner comprising an oral health sensor comprising a camera as a sensor receiver and at least a first light source as a sensor emitter (see also the following description). The light inlet for the camera and the light outlet of at least the first light source may be provided in the head of the oral scanner. The attachment may be realized as a removable distance attachment. The distance attachment may be arranged to enable a scanning procedure at an essentially constant distance between one or more objects to be scanned, such as teeth, and the light inlet of the camera. The distance piece of the distance attachment may remain in contact with the object to be scanned, specifically the outer surface of the object, in order to maintain a constant distance. The camera can have a focal length that generates a sharp image of an object having a distance to the light inlet of the camera defined by the distance piece. The distance piece may be realized as a closed wall element surrounding the light outlet of the first light source and the light inlet of the camera, whereby the closed wall element effectively blocks ambient light from illuminating the object currently being scanned and thus ultimately reaching the camera. Thus, the distance attachment can solve two problems, namely, maintaining a constant distance during the scanning procedure and effectively blocking ambient light from reaching the surface of the object being scanned. The latter is particularly beneficial for embodiments in which the light emitted by the first light source is mainly involved in oral health sensor data, i.e., the image data output by the camera.

[0024] An attachment, such as a distance attachment, may be removable to allow for replacement of the attachment when it wears out or to allow for changing the attachment when different attachments are used by different users of the oral scanner. The attachment may further be removable to improve access to parts of the oral scanner that benefit from periodic cleaning, such as a window covering the light exit of the first light source and / or the light entrance of the camera. Further, the removable attachment itself may benefit from periodic cleaning, and cleaning is made easier when the attachment is removable. For example, the attachment may be immersed in a cleaning solution to clean it and potentially sterilize it.

[0025] Oral health sensor The oral scanner proposed herein comprises at least one oral health sensor and may comprise two or more different oral health sensors. An oral health sensor is understood to be a sensor arranged to acquire and output oral health sensor data regarding at least one characteristic of the oral cavity, and the oral health sensor data may be related to determining the status of the oral health condition or be a direct measure of the oral health condition. The oral health condition may be related to the presence of at least one of the following: dental plaque, tartar, demineralization, white spot lesions, gingival inflammation, tooth discoloration, stains, gingivitis, enamel erosion and / or wear, cracks, fluorosis, carious lesions, molar incisor hypomineralization (MIH), bad breath, the presence of pathogenic agents such as pathogenic bacteria or fungi causing candidiasis, tooth misalignment, periodontal disease or pulpitis, peri-implantitis, cysts, abscesses, aphthae, and any other indicators that are understood by those skilled in the art to be related to the oral health condition.

[0026] The oral scanner may be arranged to acquire oral health sensor data in a position-resolved or location-resolved manner, if this is possible. For example, bad breath may be an oral health condition that affects the entire oral cavity, and thus may not be perceptibly acquired in a position-resolved or location-resolved manner. However, the latter does not exclude the possibility that bad breath may be acquired in a position-resolved or location-resolved manner, and that feedback regarding this oral health sensor data may also be provided in a position-resolved or location-resolved manner. For example, the feedback for all discrete positions or locations has the same bad breath level or belongs to the same state class.

[0027] Some of the above-mentioned oral health conditions can be detected by visual analysis, which typically requires an oral health optical sensor such as a camera and software implemented on a processor arranged to determine the oral health condition based on oral health sensor data provided by the optical oral health sensor, for example, based on the classification of image data or an image sequence regarding at least two state classes, and potentially also to evaluate the level of severity of the oral health condition. Without being limited by theory, the classification of the input image may be performed by a neural network such as a convolutional neural network (CNN), preferably one that has been trained using training images and associated state class results. The classifier used by the processor may be directly supplied with oral health sensor data, for example, image data, or the oral health sensor data may first be processed by the processor to determine one or several features, which are also referred to herein as oral health data related to at least one oral health condition.

[0028] The oral health sensor may only include a sensor receiver that uses external media such as ambient light, saliva, and gaseous components present in the oral cavity to obtain oral health sensor data. According to some aspects, the oral health sensor can include at least one sensor emitter that provides a primary medium and at least one sensor receiver arranged to detect a secondary medium generated by at least the primary medium and / or the interaction between the primary medium and the oral cavity, e.g., by interaction with oral tissues. This does not exclude the sensor receiver being sensitive to the external media at the same time, as described above. In more specific examples described in more detail below, the at least one sensor emitter is a narrowband light source that emits light in a specific wavelength range as the primary medium, and a second medium, i.e., fluorescence of a higher wavelength, can be generated by the interaction between the emitted light and a specific material present in the oral cavity. The oral health sensor may then further include at least one sensor filter that filters out at least a portion of the primary medium and / or at least a portion of the secondary medium before each medium reaches the sensor receiver. In that case, it would appear obvious that the sensor receiver can be similarly sensitive to ambient light that can pass through the at least one sensor filter. The influence of ambient light on data collection can be reduced by specific means such as the distance attachment described above. In some embodiments, the oral health sensor is an optical sensor such as a photodiode, an M×N array of optoelectronic elements, or a camera.

[0029] According to some aspects, the oral scanner comprises an oral health sensor having at least a first light source and at least one camera, and the oral scanner is configured and / or arranged to perform a scanning procedure, which is typically an optical scanning procedure, where the optical scanning procedure refers to a procedure in which a series of images are captured by the camera. The first light source may comprise a light outlet, the camera may comprise a light inlet, and the light outlet and the light inlet may be provided on the head of the oral scanner. This may enable, for example, arranging a photoelectric sensor element array, such as an M×N photoelectric sensor element array of the camera, at a distance to the light inlet such as a handle, and guiding light from the light inlet to the photoelectric sensor element array by optical elements such as one or more lenses, one or more mirrors, and / or one or more prisms, and / or one or more light guides. A user-operable input element may be provided on the oral scanner that can initiate the optical scanning procedure upon operation by the user. The oral scanner may comprise two or more cameras arranged to enable a three-dimensional scan of at least a portion of the oral cavity.

[0030] The oral scanner may comprise a second light source and potentially additional light sources. Different light sources may use the same light outlet, or each light source may have its own light outlet. The first light source can emit light having a first wavelength or a first wavelength range, and the second light source can emit light having a second wavelength different from the first wavelength, or a second wavelength range that does not overlap or only partially overlaps with the first wavelength or the first wavelength range of the first light source. Additionally or alternatively, the first and second light sources may be arranged to emit different light intensities. However, this does not exclude the possibility that the first and second light sources are provided to have essentially the same wavelength or the same wavelength range and emit light of essentially the same intensity. As an example, the first light source can emit light having a wavelength with a main wavelength of about 405 nm or including it, and the second light source can emit "white" light, i.e., light that essentially covers the complete visible wavelength range between 400 nm and 700 nm or includes several main wavelengths, such that a human can essentially perceive the color impression of the emitted light as white. The light sources are not limited to light sources that emit light in the visible range, and any light source that emits in the infrared (IR) or ultraviolet (UV) wavelength range or at least includes a wavelength range covering these regions is equally considered. The first and / or second light source (and any additional light sources) may be realized by a light-emitting diode (LED), but other light sources, such as laser diodes, conventional light bulbs, especially incandescent bulbs, halogen light sources, gas discharge lamps, arc lamps, etc., are also conceivable.

[0031] The camera may comprise an array of optoelectronic sensor elements, and each optoelectronic sensor element may be arranged to output a signal indicative of the light intensity incident on the optoelectronic region of the optoelectronic sensor element. Each of the optoelectronic sensor elements may have an individual sensitivity range, i.e., an individual wavelength sensitivity, but the array of optoelectronic sensor elements may typically comprise optoelectronic sensor elements all having substantially the same light sensitivity (typical and ignoring differences such as gain that are addressed by calibration). The array of optoelectronic sensor elements may be implemented as a regular M×N array, but does not exclude the optoelectronic sensor elements being arranged in different ways, for example, in coaxial circles. The array of optoelectronic sensor elements may be implemented as a CCD chip or a CMOS chip as typically used in digital cameras. The number of optoelectronic sensor elements may be selected according to the requirements and processing capabilities of the processor. A resolution of 640×480 may be one option, but essentially all other resolutions are conceivable. For example, the camera may be a 4K camera having a resolution of 3840×2160, or the camera may have a lower resolution, for example, a resolution of 320×240. It is not excluded that the camera includes a line sensor as typically used in a paper scanner.

[0032] In the context of the present application, the optoelectronic sensor elements include RGB sensor elements, i.e., each optoelectronic sensor element of the RGB type supplies three signals related to the R (red), G (green), and B (blue) color channels.

[0033] The camera of the oral scanner is not precluded from being implemented as a pinhole camera, but may include additional optical elements such as at least one sensor lens for focusing light onto the array of optoelectronic sensor elements. The camera may further include at least one sensor mirror for directing light onto the array. Additionally, the camera may include at least one sensor filter that selectively absorbs or transmits light of a specific wavelength or at least one wavelength range. The at least one sensor filter may be fixed or movable, i.e., the sensor filter may be arranged to move inside and outside the optical path of the camera. Several sensor filters may be provided to enable selective filtering of the light reaching the array of optoelectronic sensor elements. The sensor filter may be a long-pass filter, a short-pass filter, a band-pass filter, or a monochromatic filter. The sensor filter may apply wavelength-dependent filter characteristics such that a specific wavelength or wavelength range can only pass through with a reduced amplitude, another wavelength or wavelength range can pass through without attenuation, and yet another wavelength or wavelength range can be completely blocked. The sensor filter may be implemented as a color filter or a dichroic filter.

[0034] The first light source may be a narrow-band light source such as an LED. The narrow-band light source can emit light in the range of 390 nm to 410 nm (FWHM) such that a wavelength of about 405 nm is at least close to the main wavelength of the LED. As already mentioned, the light of about 405 nm causes fluorescence to be emitted by the tooth enamel and dental plaque. Subsequently, a sensor filter that transmits only light having a wavelength exceeding about 430 nm may be used. Preferably, the sensor filter is a cut-off filter having a cut-off wavelength of 450 nm that allows light of a longer wavelength to pass towards the optoelectronic sensor element array such that the reflected light rays originating from the first light source are absorbed and only the fluorescence transmitted by the sensor filter is determined.

[0035] The camera may be implemented by a camera module available, for example, from Bison Electronics Inc. in Taiwan. Without limitation, the camera module may include a photosensitive sensor array having 1976×1200 M×N pixel count (i.e., 2.4 megapixel chip) implemented with CMOS technology, although not all pixels necessarily are used to capture an image during scanning. The camera module may include a lens providing a focal length of 12.5 mm so as to be able to capture a sharp image of an object close to the camera. This does not exclude the use of an autofocus camera. A hyperspectral imaging camera also may be used.

[0036] Examples regarding optical sensors, particularly cameras, should not be understood as limiting. At least one oral health sensor may further be implemented as one from a non-limiting group including biosensors such as temperature sensors, pressure sensors, pH sensors, refractive index sensors, resistance sensors, impedance sensors, conductivity sensors, sensors including biological detection elements, e.g., immobilized biological active systems combined with physical sensors (transducers) that convert biological chemical signals into electrical or optical signals and typically include amplifiers, etc.

[0037] As already explained, the oral health sensor acquires and outputs oral health sensor data transmitted in the form of an analog signal or a digital signal, and the processor may be arranged to process the oral health sensor data to determine oral health data and / or state class data, preferably state class data regarding the oral health state.

[0038] Position sensor The term "position sensor" encompasses all position sensor configurations that can determine the discrete position or location or segment at which the oral scanner head performs a scanning procedure at a given time within the oral cavity and may also include such determination for at least one discrete position or location or segment related to the outside of the oral cavity. The use of the term "position sensor" does not mean that the position sensor itself can directly determine a position inside or outside the oral cavity, but rather that discrete positions or discrete locations or segments inside or outside the oral cavity can be derived from position sensor data, for example, by deterministic calculations based on inputs from the position sensor, by decision trees, by clustering, or by classification algorithms. The processor may be configured and / or arranged to perform such determination of discrete positions or locations or segments, at least based on the position sensor data. Oral health sensors such as cameras may further provide position sensor data, i.e., the oral health sensor may additionally be used as a position sensor, or a further camera may be provided as a position sensor. As an example, image data provided by a camera provided on the head of an oral scanner may enable determination of the type of teeth imaged and thus derivation of discrete positions or discrete locations or segments within the scanned oral cavity (see, for example, European Patent No. 2189198 (B1) below).

[0039] European Patent No. 3141151 (A1) describes, among other things, a positioning based on the fusion of image data from a camera that acquires an image of a user while performing an oral care activity using an oral care device (this camera is separate from the oral care device) and data from an accelerometer disposed within the oral care device to determine the orientation of the oral care device with respect to the Earth's gravitational field. On the one hand, based on the classification of the image data created at a given time by a machine learning algorithm specifically trained for each of one of the positions, and on the other hand, based on the classification of the orientation angle determined from the accelerometer data at the same time, a fused positioning result is calculated. The classification algorithm outputs values similar to the probabilities for a plurality of positions within the oral cavity where an oral care activity can be performed. The highest measure typically indicates the location where the activity is being performed with a certain level of confidence. European Patent No. 3141151 (A1) is hereby incorporated by reference into this specification. The position sensor in this example comprises a separate camera as the first position sensor and an accelerometer disposed within an oral care device (which may be an oral scanner according to the present disclosure) as the second position sensor. This shows that the term "position sensor" does not refer to a single sensor configuration, but rather encompasses embodiments where a "position sensor" uses two or more different position sensors to provide position sensor data.

[0040] European Patent Application Publication No. 3528172 (A2) describes, among other things, the determination of discrete positions or locations or segments within the oral cavity where an oral care activity is currently being performed, and this determination depends on the classification of position sensor data, which is a time series of inertial sensor data generated, for example, by an accelerometer and / or a gyroscope located within an oral care device, using a neural network, preferably a recurrent neural network. Based on the trained neural network, the classification of the current time sequence of position sensor data provides a set of values similar to the probabilities for a plurality of possible discrete positions or locations within the oral cavity. The highest value typically indicates the location where the activity is being performed. European Patent No. 3528172 (A2) is hereby incorporated by reference into this specification.

[0041] Each of the above-mentioned techniques and the techniques referred to in the following paragraphs of this section can be used for determining discrete positions or locations within the oral cavity where the oral scanner according to the present disclosure is performing a scanning procedure, but other techniques can be used as well. For example, tracking the positions of the user's head and toothbrush within a calibrated magnetic field so as to be able to determine the relative position of the toothbrush with respect to the user's head and thus with respect to the user's oral cavity, or using ultrasonic emitters on the user's head and toothbrush to track the movement of both within a calibrated ultrasonic receiver configuration. Similarly, IR emitters and receivers may be used. Further techniques, such as motion tracking techniques using multiple cameras known from CGI videos, can be used as well.

[0042] The latter techniques can determine discrete positions or locations where oral care activities, such as toothbrushing, are performed with relatively high precision (e.g., at the level of individual teeth), and the precision can justify the use of the term "position" (this position is still mapped onto a "segment", which can still represent a single tooth or a group of teeth). The techniques described in the previous paragraph were not developed to yield such high precision at least at the time of filing of the present disclosure and may be able to determine one of 16 different segments in the dentition where oral care activities are performed. Then, the term "position" may be more suitable since the determination is typically related to a group of teeth (e.g., upper left molars) or a group of surfaces of a group of teeth (e.g., the buccal surface of the lower right molars). In a more general sense, the term "segment" is used to indicate a discrete position or discrete location.

[0043] European Patent No. 2189198 (B1) describes determining discrete positions or locations within the oral cavity by analyzing camera data from a camera located on a toothbrush head. The analysis of the image data is described as being able to identify the teeth shown in the image. It can be contemplated that a classifier is trained using labeled images of the user's teeth and / or other parts of the oral cavity so that the processor can reliably identify the position within the oral cavity where the scanning procedure is currently being performed.

[0044] U.S. Patent Application Publication No. 2010 / 0170052 (A1) describes determining discrete positions or locations within the oral cavity where oral care activities are being performed by an oral care device by analyzing images from a separately positioned camera that images the user's face and the oral care device. European Patent No. 2189198 (B1) and U.S. Patent Application Publication No. 2010 / 0170052 (A1) are hereby incorporated by reference.

[0045] Processor hardware The processor may be any kind of general-purpose integrated circuit (e.g., IC: CPU) or application-specific integrated circuit (e.g., ASIC), and may be implemented by a microprocessor, a microcontroller, a system-on-chip (SOC), an embedded system, etc. The processor should not necessarily be understood as a single circuit or chip. One part of the processing task may be executed by a first processor subunit, and one or several further processing tasks may be executed by at least a second or several further processor subunits in a distributed manner. It is contemplated to provide the processor in a distributed manner, and different processor subunits may be physically disposed at different positions, such as within or in an oral scanner, within or in a remote device, and / or within or in a cloud computer. The processor may be essentially fully implemented by a cloud computing device. It is also included that the processor may comprise analog circuit elements and integrated circuit elements, or only analog circuit elements.

[0046] The processor has at least one input and at least one output. The processor receives sensor data and / or oral care activity data from the oral care device via the input, and outputs oral health data and / or state class data and / or control data, preferably discretely located or location-resolved oral health data and / or state class data and / or control data, via the output. The state class data refers to data that classifies oral health (sensor) data into at least one of at least two state classes, e.g., a non-severe class and a severe class, or more than two classes, e.g., a non-severe class, a monitored class, and a class recommended for an oral care specialist visit. The latter example is for illustration purposes, and those skilled in the art can use any other number of classes and can appropriately name these classes.

[0047] Processor Software: Classification As described in various previous paragraphs, the processor is configured and / or arranged to classify oral health sensor data and / or oral health data into at least two state classes. In more mathematical terms, oral health (sensor) data (preferably for a given discrete position or location) may be said to be an observation, the state classes are categories, and a classifier algorithm may then be used to determine the category to which the observation belongs. Oral health (sensor) data may include one or several variables or features characterizing the oral health state. For example, the oral health data may include the normalized plaque area for each considered discrete position or location. The classifier may then simply label the input feature (plaque size) into a category by comparison with one or several thresholds. The threshold(s) themselves may be derived from expert opinion or from the analysis of the oral health states of multiple subjects by a machine learning algorithm. Instead of using features or a vector of features derived from the oral health sensor data, the oral health sensor data may be used as input to the classifier without preprocessing. For example, a neural network may be directly fed with image data acquired by an oral health sensor equipped with a camera.

[0048] Thresholds or other parameters affecting the classification may be set to different values for different discrete positions or locations within the oral cavity. Such discrete position- or location-dependent thresholds or parameters affecting the classification for a given oral health state may be influenced, preferably, by at least one from a non-limiting list including, in an inclusive sense (i.e., for all users) or for an individual, the discrete position or location within the oral cavity, the oral health (sensor) data or the history of the development of the state classes related to this discrete position or location for a given oral health state, or the overall or average oral health state status for a given user.

[0049] The above-described threshold-based approach for classification may be practical for oral health data that includes one or two features per oral health state, but different classifier algorithms may be used if the oral health data includes multiple features. For example, a neural network may be applied to the classification task or any other classification algorithm known to those skilled in the art. The classification algorithm may be selected to be one from a non-limiting list including linear classifiers, support vector machines, quadratic classifiers, kernel estimation, boosting, decision trees, neural networks, transformers, genetic programming, and learning vector quantization.

[0050] The state classes may be determined for at least one of at least two discrete positions or locations, preferably for all discrete positions and locations used to subdivide at least a portion of the scanned oral cavity into segments. In each of such discrete positions or locations, at least two state classes may be defined, preferably at least three state classes may be used (similar to a traffic signal system indicating any of green, yellow, or red lights). The underlying thresholds or parameters used by the classifier algorithm may be adaptive and thus may change over time and may be different for different users.

[0051] Processor Software: Temporal Evaluation According to some aspects, the oral scanner system proposed herein is intended to periodically repeat a scanning procedure, such as a light scanning procedure of at least a portion of the oral cavity of a user or a subject to be treated, thereby creating new oral health (sensor) data. The oral scanner system is preferably configured and / or arranged to compare newly determined oral health (sensor) data and / or state class data with previously created oral health (sensor) data and / or state class data, and update information regarding the temporal evolution of the oral health (sensor) data and state class data, which may then lead to the updated information being fed back to the user. The comparison process may result in comparison data and / or discretely position-resolved or location-resolved comparison data. The processor may include a memory for storing and later accessing the previously and currently acquired oral health sensor data and / or position sensor data, and any data created by processing such data, such as oral health data and / or state class data and / or discretely position-resolved or location-resolved oral health sensor data and / or discretely position-resolved or location-resolved state class data, and may further include comparison data and / or discretely position-resolved or location-resolved comparison data. The stored data related to the previous scanning procedure is also referred to as history data. In addition to the data just described, further data, such as history scan procedure progress data or history oral care activity data regarding previous oral care activity procedures performed by an oral care device, may be stored in the memory, and this oral care activity data may be sent to and stored in the memory by the processor. The history data stored in the memory may further be used by the processor to adapt the next scanning procedure, for example, to adapt at least one scanning procedure parameter, and / or to adapt the scanning procedure guidance including at least one automatic feedback provided to the user immediately before or during the next scanning procedure.That is, the scan procedure guidance is not displayed at the end of the current scan procedure, but is automatically displayed immediately before the next scan procedure, meaning that the user can basically benefit from such guidance in the scan procedure about to be initiated. The scan procedure guidance may be determined in a segmented manner, i.e., for each discrete position or location within the oral cavity. Such segmented scan procedure guidance may then be automatically shown when the user reaches each segment.

[0052] Display The oral scanner system may include a display as a feedback element of the feedback unit, preferably a display that enables a visual depiction of oral health data and / or status class data and / or oral scan progress data. The display may be any type of display such as an LCD, LED, OLED (PMOLED or AMOLED) display. The display may be a monochromatic or color display. The display may have any suitable resolution such as a 96×48 resolution for a display mounted on the oral scanner, or may include a custom-made illuminable area. Since the displays of user devices such as mobile phones, table computers, laptops, smart watches, etc. can be used, the respective technologies and resolutions of the displays of such user devices should be considered. In such a case, the app or software executed on such a device may provide relevant programming for the general-purpose processor of the user device to function as at least one processor subunit or as a processor according to the present disclosure. Each app or software may further implement any display control required to visualize the information as discussed herein.

[0053] This description of the display does not exclude that oral health (sensor) data, scan procedure progress data, etc. are additionally or alternatively fed back to the user by other feedback elements of a feedback unit such as a plurality of individual visual feedback elements and / or audio feedback elements and / or tactile feedback units as already described. As an example, assuming that the oral cavity is segmented into four positions and / or locations, for which the scan procedure is monitored and oral health data is alternatively or additionally fed back, the scan procedure progress data can be fed back by using four visual feedback elements that are controlled to start with a first color, for example dark green, and to gradually show a brighter green until the scan procedure is considered complete for a given discrete position or location, after which the light indicator can show, for example, a white signal. For this purpose, RGB light-emitting diodes by light feedback elements can be used. Similarly, for example, live communication of oral health data regarding dental plaque can also use four visual feedback elements, starting with white to indicate the absence of dental plaque and gradually changing towards red to communicate the amount of dental plaque detected at each discrete position or location. Instead of live feedback, the oral health data may be fed back to the user only at the end of the scan procedure to indicate the level of dental plaque identified during the scan procedure. Then, the classification of the oral health data regarding dental plaque may be indicated by a blinking light of the state class "severe". A person skilled in the art will understand how to modify the number of visual feedback elements, the colors used, and other feedback means such as blinking, intensity changes, etc.

[0054] Display software The display is assumed to comprise a display controller that converts oral health (sensor) data, preferably position-resolved or location-resolved oral health (sensor) data and / or state class data and / or scan procedure progress data into a visualization shown on the display, and the visualization is referred to as a feedback screen. The feedback screen may include at least one element of a graphical user interface. In the present disclosure, focus is placed on a feedback screen including a visualization of at least a portion of the oral cavity, and the visualization may be a two-dimensional visualization or a 3D type visualization, where the latter means a visualization on a two-dimensional display that provides a three-dimensional impression. The visualization of at least a portion of the oral cavity may include a visualization of the dentition, i.e., the teeth of the dentition, and may be an abstract visualization or a more realistic visualization. The visualization may be based on a general model of the dentition or may take into account individual data from the user such as missing teeth. The abstract visualization of the complete dentition may include a circle or a ring, and the upper part of the circle or ring visualized on the display may be understood to represent the upper front teeth, and the bottom part of the circle or ring may represent the lower front teeth, in which case the sides may represent the left and right molars, respectively. Instead of a continuous circle or ring, a plurality of segments of the circle or ring may be visualized. For example, an upper segment of about 180 degrees and a lower segment of about 180 degrees may represent the upper and lower jaws, respectively. Alternatively, four segments of about 90 degrees can be used to display a quarter section of the dentition, which is known to those skilled in the art, for example, from the visualization on the Oral-B SmartGuide. Further, six segments may be used. It is also contemplated to visualize each tooth of the general or individualized dentition by a single segment or to use any other type of segmentation that may be appropriate to those skilled in the art. At least one of the segments may be separated into at least two regions that may represent the inner and outer tooth surfaces, preferably three regions representing the inner and outer tooth surfaces (such as the buccal and lingual surfaces) and the occlusal surface that may be particularly sensitive in molars and canines. This is not intended to exclude any other type of fragmentation of the segmented visualization.Although the segment has been described here as a circular or annular portion, it is also conceivable to visualize the segment in a different way. For example, each tooth may be represented by a circle, or the segment representing a plurality of teeth may be visualized as a plurality of overlapping circles, and the number of circles may coincide with the number of teeth typically represented by this segment, but should not be understood as limiting. The visualization of the dental arch may include information as used in accordance with ISO3950:2016. Some exemplary visualizations are further described below with reference to the drawings.

[0055] Instead of an abstract visualization, a more realistic depiction of the dentition may be selected, for example, up to 32 teeth for the permanent dentition of an adult user or up to 24 teeth for the primary dentition of a child. As already described, the visualization may be individualized. For example, the user may be able to input personal dental features such as missing teeth, misaligned teeth, fillings, inlays, crowns, artificial teeth, orthodontic appliances, etc., which may be considered in the visualization. As further described below, the user may further be enabled to provide information about the oral health condition of at least one surface of a tooth, at least one tooth, a group of teeth, or the complete dentition, and / or about the gums. For example, the user may be able to provide inputs regarding tooth discoloration or orthodontic appliances or cavities, and an oral scanner and / or a separate device may be able to provide an interface for inputting the information. Instead of manual input, the oral scanner may be configured and / or arranged to perform a scanning procedure that automatically individualizes the visualization in at least a portion of the oral cavity where relevant oral information is acquired. The above-described interface may be implemented as a graphical user interface, but does not preclude the user from additionally or alternatively providing input by means of a voice recognition interface and / or a keyboard, etc. The interface may further enable the user to input personalization information such as name, email address, etc., and / or may enable a dentist to have dedicated access to any stored data, which may preferably be enabled, for example, by remote access from a computer in the dentist's office.

[0056] The above does not exclude that the visualization of at least a portion of the oral cavity further includes the tongue, preferably various regions of the tongue, the inner cheek, the lips, the uvula, the pharynx, the palate, etc. In some visualizations, at least one of the aforementioned parts such as the tongue and the complete dentition and at least one part of the dentition are visualized.

[0057] This abstract or more realistic visualization of at least a portion of the oral cavity provides a map on which additional data, such as oral health data or scan procedure progress data, can be visualized so that the user can associate the additional information with locations or positions within the oral cavity.

[0058] The visualization referred to can be used in a manifold feedback application. For example, the visualization can be used to provide feedback regarding the progress of a scan procedure in real time, i.e., in a live manner, which means that the discrete position or location at which an oral scanner is currently performing a scan procedure, and each respective visualized segment associated with this discrete position or location, can then be modified so that the progress of the scan procedure can be understood by the user. The visualized segments on which the scan procedure is performed can be additionally visually emphasized, for example, by a halo or similar visual scale, to enable the user to immediately identify the location at which the scan is being performed with the oral scanner. An example where the coloring of each segment starts with a first color and gradually changes to a second color has already been described (where white and black are understood to be colors here). It should be understood that this example refers to a gradual change from one color to another, but is not limiting. For example, the start color and the end color can be selected to be different for different segments. There is no need to have a gradual change. A stepwise change or a single step from the start color to the end color is also envisioned. Further, instead of or in addition to color, the segments can include start and end patterns for visualizing the scan progress.

[0059] Interaction with Oral Care Devices As described above, the oral scanner system may include an oral care device such as an electric toothbrush, an electric floss device, or an electric cleaning device provided for performing oral care activities such as tooth cleaning, interdental area cleaning, and gum massage. The oral care device preferably has its own oral care device position sensor (e.g., an IMU sensor) such that the discrete position or location within the oral cavity where an oral care activity procedure such as brushing or flossing or cleaning is performed can be determined independently of the determination of the discrete position or location of the oral scanner. Additionally or alternatively, the discrete position or location where the oral care device performs the oral care activity procedure may be at least partially determined by using the same position detector that serves to determine the discrete position or location of the oral scanner (e.g., by the same external camera), i.e., the position sensor of the oral scanner may be a shared position sensor.

[0060] The use of a single oral scanner for performing an oral scanning procedure and a single oral care device for performing oral care activities is an interaction between the oral scanner and the oral care device. For example, the oral scanner may provide control data received by the oral care device, and this control data affects the oral care activity as long as at least one oral care guidance is triggered by the control data or at least the operating parameters are affected by the control data. The control data can, in particular, cause the guidance or influence to occur in a discretely position-resolved, or discretely location-resolved, or segment-by-segment manner. The single oral scanner can be used to perform a dedicated scanning procedure that is not affected by any parallel oral care activities, and the oral care device can be used to perform a dedicated oral care activity that is not disrupted by any parallel scanning procedures. Data collected during an oral care activity can likewise be used to determine control data that can be transmitted to the oral scanner to affect the next oral scanning procedure, for example, to limit or focus the scan on segments that were not properly cared for during the oral care activity. An oral care system comprising an oral scanner and an oral care device benefits from a simple juxtaposition of the two devices.

[0061] The oral care device may include a device communicator, such as a receiver or transceiver, for receiving at least control data from a processor via a processor communicator. The control data may specifically be used to select one from at least two different operating settings of the oral care device. Preferably, the control data is used to select one from at least two different operating settings in a discrete position or location-dependent manner, i.e., in a segmented manner. Such operating settings may be related to the recommended time for performing an oral care activity procedure generally or at a specific discrete position or location, or may be related to the recommended minimum and / or maximum pressure or force values applied by the oral care head generally or at a specific discrete position or location, or may be related to the feedback provided to the user when a specific discrete position or location is being treated, or may be related to the operating mode used generally or at a specific discrete position or location. In that case, the oral care device may be arranged to automatically switch to this mode by the received control data. The operating mode may preferably be a motion mode in which the oral care head of the oral care device is driven and may include at least one parameter from a list including speed, frequency, and amplitude.

[0062] Exemplary embodiments While not wishing to be limiting, the present disclosure focuses on an oral scanner system comprising an oral scanner having at least one oral health sensor, a position sensor, a processor, and a feedback unit. The oral scanner is configured and / or arranged to perform a scan procedure of at least a part of the oral cavity, such as a part of or the entire dentition, and / or more parts or other parts of the oral cavity. The oral scanner comprises at least one oral health sensor configured and / or arranged to obtain oral health sensor data regarding at least one oral health condition during the scan procedure and output the oral health sensor data. The position sensor is configured and / or arranged to obtain and output position sensor data related to whether the oral scanner is currently performing a scan procedure or a discrete position / location or segment within the oral cavity where the scan procedure was performed at a given time. Thus, at least a part of the oral cavity may be divided into at least two discrete positions / locations or segments as already described, with reference being made to each previous description of possible subdivisions of the oral cavity. The processor is configured and / or arranged to determine the discrete position / location or segment at which the oral scanner is performing the scan procedure based on the position sensor data and temporally align and assign the oral health sensor data and / or oral health data determined therefrom to the determined discrete position / location or segment, i.e., in the assignment procedure, it is ensured that the oral health sensor data and / or oral health data derived therefrom were obtained at the same time or as close as possible to the time at which the position sensor data was also obtained. This can be achieved by each architecture either automatically feeding sensor data from the same time together or the time being recorded for each set of oral health sensor data or set of oral health sensor data obtained essentially simultaneously, e.g., image data from a camera, and for each set of position sensor data or set of position sensor data obtained essentially simultaneously, e.g., three values from a triaxial accelerometer or image data from a camera, such that the most temporally fitting sensor data can be assigned together.

[0063] According to the present invention, determined discrete position-resolved or location-resolved or segmented oral health sensor data and / or oral health data regarding at least one oral health condition are provided as feedback by a feedback unit to a user during a scanning procedure, preferably as live or real-time feedback, with reference to the previous explanations of the meaning of these terms. This means that the user can follow the progress of the scan regarding at least one oral health condition. Oral health data and / or oral health sensor data regarding at least one oral health condition can be first determined for one discrete position / location or segment and then for a second discrete position / location or segment etc. Alternatively, if the user follows a more random scan course instead of sequentially completing the scanning procedure for each discrete position / location or segment, the user can follow the gradual change over time of the feedback regarding the oral health condition for at least two discrete positions / locations or segments.

[0064] Depending on the type of scanning procedure, i.e., depending on the type of at least one oral health sensor and at least one oral health condition being evaluated, data has to be acquired over a certain time from a given discrete position / location or segment, or if the discrete position / location or segment has a certain size, it may be necessary to acquire oral health sensor data from sub-positions or sub-locations. This method will be described in more detail below. Thus, it may not be sufficient to complete the scanning procedure at a discrete position / location or segment only once or for a short time or at only one sub-position. The progress of the scanning procedure can be additionally provided as feedback to the user by the feedback unit during the scanning procedure, for example, by a visual feedback element that can change color or pattern, and / or by depicting a percentage level assigned to the segment etc.

[0065] Examples of position sensors have already been described. An inertial measurement unit (IMU) comprising an accelerometer and / or gyroscope located on or within an oral scanner is contemplated, specifically an inertial measurement unit implemented as a MEMS sensor. At least one oral health sensor may comprise an optical sensor such as an M×N array of optoelectronic sensor elements, or may be implemented as a camera for taking images. In some cases, oral health sensor data may already provide direct insight into the oral health condition, but it is contemplated that the processor may be configured and / or arranged to process the oral health sensor data to derive oral health data, which is a direct measure of the oral condition. For example, if the oral health sensor is a camera, the oral health sensor data is image data, and the processor may be configured and / or arranged to process the image data to determine oral health data that may be related to plaque or carious lesions or missing teeth or discoloration visible in the image. A list of oral conditions has already been described and is hereby incorporated by reference.

[0066] The processor may be further arranged to classify the oral health sensor data and / or the oral health data with respect to at least two state classes, i.e., the processor may then determine state classification data. Refer to the description of the above classification. The oral health data and the classification results may be determined, in particular, for at least two of at least two discrete positions / locations or segments. Further, the feedback unit may be configured and / or arranged to provide feedback regarding the oral health sensor data and / or the oral health data and / or the state classification data either during the scanning procedure and / or at the end of the scanning procedure. The feedback unit may, in particular, comprise at least one feedback element for visual, auditory and / or tactile or haptic feedback regarding the scanning procedure progress, the oral health data and / or the state classification data when such feedback is provided as discretely position-resolved / location-resolved feedback. The feedback unit may comprise at least two visual feedback elements for feedback regarding the position-resolved or location-resolved feedback. The feedback unit may, in particular, comprise a display. The feedback unit may be provided by a separate device such as a computer, a notebook, a laptop, a tablet, a smartphone, or a smartwatch. The processor may be at least partially provided by a separate device. The separate units or devices described herein are contemplated to be able to communicate in a wireless manner. For example, each of the units or devices may comprise a dedicated communicator for establishing at least one-way or two-way wireless communication. As already explained, the feedback unit may be able to provide an abstract or more realistic visualization of at least a part of the oral cavity being scanned, for example, a depiction of the dental arch, which is taken as an example. The visualization of the dental arch may be overlaid with the visualization of the oral health sensor data, the oral health data, and / or the state classification data.The term "overlaid" should be understood to mean that a two-dimensional image based on a depiction of the dentition may be displayed and may additionally include further information being depicted and / or coloring or patterning of at least portions of the depiction of the dentition.

[0067] It has already been stated that oral health sensor data and / or oral health data and / or state classification data are determined by a processor for at least two discrete positions / places or segments, and that the scan procedure progression may also be determined for these at least two discrete positions / places or segments. The scan procedure progression may depend on at least one of the following: the duration of the scan procedure at each discrete position / place or segment, the quality of the movement such as length, speed, acceleration or direction derived from position sensor data at each discrete position / place or segment, the collection of oral health sensor data of preferably non-overlapping or only partially overlapping content at each discrete position / place or segment, preferably the number of image data collections of a camera, the number of sub-positions or sub-places determined based on position sensor data at each position or place, or the quality assessment of oral health sensor data at each position or place, preferably the quality assessment of image data of a camera.

[0068] Some more detailed explanations are provided for the above possibilities. (a) In some cases, it may be necessary to acquire oral health sensor data several times at the same discrete position / place or segment so that the oral health sensor data can be averaged to achieve a higher reliability. Next, the processor may be configured and / or arranged to determine the scan procedure progression based on the number of oral health data acquisitions by discrete position / place or segment and / or based on the length at a given position / place. (b) The position sensor data can be used by the processor to determine the discrete positions / locations or segments where the scanner executes the scanning procedure. However, although the discrete positions / locations or segments determined by the processor can be the same over several instants, the oral scanner is typically moved. The processor may use the position sensor data to determine the length of the movement during which the oral scanner is determined to be at one discrete position / location or segment. This can be done by double integrating the acceleration data of the accelerometer. For example, the length of the buccal surface of the upper left molar may be about 3 cm, and the processor may then determine whether the movement in one direction is close to or exceeds 3 cm, and then determine whether the scanning procedure is complete for this discrete position / location or segment. If the length of the movement in a direction that may coincide with the elongation direction of the molar, for example, a direction perpendicular to the Earth's gravitational field, is determined to be 2 cm, the processor may provide feedback that about two-thirds or 66% of the scanning procedure has been achieved. (c) The processor may be configured and / or arranged to provide discrete positions / locations or segments only at the level of segments of the oral cavity having a particular size, for example for reasons of reliability, but the inherent resolution of the positioning may be higher, and the processor may check whether various sub-positions within a given discrete position / location where feedback is determined and provided have been visited by the oral scanner in order to determine the progress of the scanning procedure. That is, at the computational level, the discrete position or location can be determined at the resolution of individual tooth surfaces, meaning that feedback is provided only for groups of tooth surfaces and / or groups of teeth, etc. (d) In addition to, for example, an accelerometer or a gyroscope, the processor may use a camera, such as a camera that implements an oral health sensor, as an additional source. The processor may be configured and / or arranged to identify teeth on the image data and / or stitch together images from subsequent time instances acquired within the same discrete / location such that the images create a panoramic image. The length of the imaged tooth at a given discrete position or location may then be confirmed based on the average size of the tooth at the given discrete position or location or, for example, by checking the image quality, specifically the sharpness of the image, assuming that a certain focal length was used, based on the assumed size of the imaged area per pixel. The image stitching method is also described in a co-pending patent application having International Patent Application No. PCT / CN2022 / 082673, which is hereby incorporated by reference into this specification. (e) When the oral health sensor is a camera, the progress of the scanning procedure may depend on the quality of the image. The processor may be configured or arranged to determine the image quality, such as sharpness, and the progress of the scanning procedure may depend on the number of images acquired with a particular image quality.

[0069] Generally, the processor may also use the scan time per position or location and / or the overall scan time and be configured and / or arranged to increase the progress of the scanning procedure when the time per position or location or the overall scan exceeds a certain threshold.

[0070] The acquired oral health sensor data and / or the determined oral health data, specifically the feedback regarding live or real-time, may include feedback regarding the progress of the scanning procedure for each discrete position / location or segment and / or may be accompanied by feedback regarding the reliability or confidence level, from which it can be derived whether the live or real-time feedback is already reliable or whether further scans are required at a given discrete position / location or segment to increase the reliability or confidence level.

[0071] The oral scanner system can be configured and / or arranged to provide additional feedback to the user, or to perform an action when the scan procedure progress reaches a specific progress level value for a given discrete position / location or segment, or when the predetermined progress level value is achieved for all discrete positions or locations. Such an action may be the termination of the scan activity and / or an indication that the complete scan procedure has ended. The user may also receive a specific message that a particular position or location requires further scan activity.

[0072] The oral scanner system may comprise an oral care device as described above. The oral care device may include a device communicator, and the processor may be configured and / or arranged to determine control data based on oral health sensor data obtained during the scan procedure at the end of the scan procedure, and preferably to transmit the control data to the oral care device. The oral care device may be configured and / or arranged to select at least one from at least two operating settings of the oral care device according to the control data.

[0073] Consideration of Embodiments with Reference to the Drawings Figure 1 is a schematic diagram of an exemplary oral scanner system 1 according to the present disclosure. The oral scanner system 1 includes an exemplary oral scanner 100 configured and arranged alone to perform an oral scan procedure without oral care activities, and a processor 200, which in this example is disposed in or within the oral scanner 100. The oral scanner 100 includes a handle portion 101 and a head portion 102. An oral health sensor 110 is disposed in or on the oral scanner 100. Generally, two or more different oral health sensors may be used and thus may be disposed in or on the oral scanner 100. In the illustrated example, at least one measurement inlet, such as a light inlet that cooperates with the oral health sensor 110, is provided in the head portion 102 so that acquisition of oral health data based on light measurement by the oral health sensor 110 is possible in the head portion 102. Here, the head portion 102 includes a flat transparent window 1021 surrounded by a frame structure 1022 that may preferably be arranged and / or configured to receive a removable attachment (see FIG. 2). The head portion 102 is sized to be conveniently introduced into the oral cavity of a human or an animal. The handle portion 101 is sized to be conveniently gripped by a human user's hand. The handle portion 101 and the head portion 102 may be separable from each other. In some embodiments, the handle portion 101 may be equipped with different replaceable head portions in addition to an oral scanner head portion such as a brush head portion. The handle portion 101 may include at least one user-operable input element 103, such as an on / off button and / or a selector button or switch. The oral scanner 100 preferably has an outer housing 104 that may preferably be hollow to accommodate various internal components, such as a rechargeable energy source and preferably a related charging circuit for wireless charging of the energy source, and a circuit board including various electronic components for control of the oral scanner.Generally, the oral scanner 100 is configured and / or arranged to perform a scanning procedure of at least a portion of a subject's oral cavity, i.e., while the user holds and moves the oral scanner 100, the oral scanner acquires oral health sensor data to determine the progress of the scan and preferably analyzes the oral health sensor data acquired regarding at least one oral health condition. Although this is not limiting, the processor 200 may be disposed on a circuit board. The processor 200 is coupled or connected to the oral health sensor 110 to receive signals from the oral health sensor 110, i.e., to receive oral health sensor data at the processor 200. The processor 200 may be configured and / or arranged to process the oral health sensor data to derive or determine oral health data regarding at least one oral health condition such as dental plaque. In some embodiments, the oral health sensor may output oral health sensor data, which is a direct measure of the relevant oral health condition, such that (if applicable) only limited processing of the oral health sensor data is required, such as calculations of normalized values or some reduction to integers. The processor 200 may further be configured and / or arranged to classify the oral health (sensor) data into at least two state classes related to at least one oral health condition, for example, an "oral health no concern" class (or "green" class) and an "oral health concern" class (or "red" class), and this may be performed based on a comparison with at least one threshold. Reference is made to each of the previous paragraphs where the classification is described in more detail. The classification may further be performed regarding at least three classes, for example, in addition to the "green" class, a "low concern" ("orange") class and a "high concern" ("red") class may result from the classification process. It is again noted that one of the main aspects of the present application is the provision of simple feedback (e.g., a single value or a single color or a single pattern, etc.) for each of the segments (discrete positions or locations) being scanned for the user by the feedback unit.The provision of this simple feedback requires some processing of oral health sensor data and / or position sensor data to determine a simple feedback (value) for each segment. The simple feedback may be, for example, a number or a color. In some embodiments, the color shown may vary essentially continuously to convey the feedback, and in some embodiments, the feedback may be limited to a binary or ternary feedback space provided by, for example, two numbers such as 0 and 1, or three numbers such as 0, 1, and 2, or two colors such as green and red, or three colors such as green, yellow, and red.

[0074] As already explained and as further explained with reference to FIG. 3, the oral scanner system 1 may further comprise at least one position sensor coupled or connected to the processor 200, whereby the processor 200 receives signals from the position sensor delivering position sensor data during operation, and the processor 200 can determine from the position sensor data the discrete positions or locations at which the oral scanner is currently performing a scan procedure or was performing a scan procedure at a given time within the oral cavity. As defined above, the discrete positions or locations mean segments of at least a portion of the oral cavity being scanned, and a plurality of segments cover this portion of the oral cavity being scanned without gaps and without overlapping. Time data regarding the absolute or relative time at which the data was acquired may be part of the position sensor data or may be part of the oral health sensor data as described above. The determination of the discrete positions or locations enables the processor 200 to calculate oral health data regarding at least one oral health condition and / or to classify the oral health sensor data and / or the oral health data in a discrete position or location-resolved manner, i.e., for each of the segments mentioned, into at least two oral health condition classes. The oral health sensor data and the position sensor data acquired essentially at the same time may be delivered together to the processor 200 due to the design of the oral scanner system, or the processor may be configured and / or arranged to assign oral health sensor data and position data having the same time information (“time stamp”) or time information (“time stamps”) that best match each other, i.e., are closest in time to each other. The provision of the position sensor data and / or the oral health sensor data may be done in a live manner, but it is noted that each data may preferably be stored over a period of time together with time information and transmitted to the processor at a later point in time, for example, the data may be transmitted every 10 seconds or after the scan procedure has stopped or been completed. The term “position sensor” is intended to include embodiments in which two discrete position sensors, e.g., an IMU provided on the oral scanner and a separate camera, are used together to implement the “position sensor”.

[0075] The oral scanner system 1 may include a feedback unit 120 for providing user-perceivable feedback, specifically, feedback composed of or at least including processed information for each segment, that is, a single feedback provided in the form of a color or a single value for each segment / discrete position or location. For example, as exemplarily shown in FIG. 1, the oral scanner 100 may include a visual feedback unit 121 that is part of the feedback unit 120 for providing visual feedback. In FIG. 1, the visual feedback unit 121 includes four 1 / 4 ring light regions 1211, 1212, 1213, 1214 arranged to form a ring that can be understood to represent four 1 / 4 sections of the dentition. By illuminating the light regions 1211, 1212, 1213, 1214 with light of different colors and / or light having different intensity characteristics, user-perceivable feedback can be provided, for example, in real time during the scanning procedure, and as a result, the user can understand the progress of the scanning procedure in a discrete position or location-resolved manner. Additionally or alternatively, the four light regions 1211, 1212, 1213, 1214 may be used to indicate the severity of the oral health condition during or at the end of the scanning procedure in a discrete position or location-resolved manner, for example, by illuminating each light region with a specific color and / or by applying an intensity variation pattern. These are merely examples, and instead of four light regions, the oral scanner 100 may include two, three, five, six, sixteen, or thirty-two, etc. The light regions and / or the oral scanner system 1 may include a display for more versatile visualization of user-perceivable feedback, for example, displaying values such as percentages for each segment. See the previous paragraph regarding the visualization of feedback.The oral scanner 100 may additionally or alternatively include one or several other feedback elements 122, which are part of a feedback unit 120 such as a light ring at the bottom of the oral scanner 100 for communicating, for example, that the oral scanner 100 is switched on or that an energy storage device needs to be charged, one or several tactile or haptic feedback elements, and / or one or several audible feedback elements. Generally, the processor 200 may be coupled or connected to a memory for storing oral health sensor data and / or oral health data and / or scan progress data and / or state classification data and / or oral care activity data, and this stored data may be stored in a position-resolved or location-resolved manner, specifically, there may be current and historical memory data, where "historical" relates to previous scan procedures or oral care activities. The oral care activity data relates to oral care activity procedures performed using an oral care device, and the data is sent to the processor. All aspects described with respect to this embodiment shown in FIG. 1 are further provided for all other embodiments in the present disclosure without repetition of the same text, provided that the individual aspects do not conflict with another embodiment.

[0076] FIG. 2 is a schematic diagram of another exemplary oral scanner system 1A according to the present disclosure. The oral scanner system 1A herein includes, for example, an exemplary oral scanner 100A and an exemplary separate device 300A including a processor 200A and a display 310A as part of a feedback unit for visualizing user-perceivable feedback (see again the following disclosure with reference to the paragraphs before providing details regarding visualization and FIGS. 5-7). The oral scanner 100A may include a scanner communicator 140A, and the separate device 300A may include a separate device communicator 340A. As a result, the oral scanner 100A and the separate device 300A can communicate wirelessly, for example, via a Bluetooth protocol or an IEEE 820.11 protocol, i.e., exchange signals for delivering data. The possibility of wireless communication is indicated herein and in the following figures by an icon including a small circle and three concentric circular segments, as is a common standard for indicating Wi-Fi connectivity. This does not exclude the possibility of a permanent or temporary additional or alternative wired direct or indirect connection for signal exchange or communication via further devices, such as a charger or a router or a cloud computing device. The separate device 300A is schematically shown herein as a mobile phone, but should not be understood as limiting. Refer to the possibility of realizing the separate device described in the previous paragraph. In FIG. 2, an oral health sensor 110A is shown to be provided within or on the oral scanner 100A to acquire oral health sensor data in the head section 102A of the oral scanner 100A. As shown, the oral health sensor 110A may include a sensor receiver 111A, such as an optical sensor like a camera, and a sensor emitter 112A, such as an optical emitter. A preferably removable attachment 105A is attached to the head portion 102A, which may be preferably realized as a distance attachment herein. Refer to the previous paragraph regarding the attachment of the oral scanner.Instead of the sensor emitter 112A being disposed directly on the head portion 102A, the head portion 102A may include an outlet that communicates with the sensor emitter 112A such that the emitted medium can exit the head portion 102A at the intended location and the sensor emitter 112A itself can be disposed elsewhere within the oral scanner 100A. Similarly, an inlet may be provided in the head portion 102A that communicates with the sensor receiver 111A such that the medium to be measured can enter the head portion 102A at the intended location and the sensor receiver 111A can be disposed at some other location within the oral scanner 100A.

[0077] Regardless of whether the feedback unit is provided at least in part on the oral scanner and / or a separate device, the intent of the feedback described herein is for the user to respond to the feedback and thus enable optimization of the use of the oral scanner system. Here, the use of the oral scanner system focuses, on the one hand, on the use of the oral scanner system during a single scan procedure and, on the other hand, on the long-term use of the oral scanner system over various instances of procedures performed using the components of the oral scanner system (e.g., including the oral scanner and optionally an oral care device for providing oral care activities).

[0078] FIG. 3 is a schematic diagram of an exemplary oral scanner system 1B according to the present disclosure. The oral scanner system 1B includes an oral scanner 100B, a separate device 300B including a display 310B as part of a feedback unit and a processor 200B, and position sensors 400B and 410B each including first and second position sensors 400B and 410B. The oral scanner 100B is configured and / or arranged to utilize position sensor data output by the position sensors 400B and 410B to determine whether the oral scanner 100B is currently executing a scan procedure or a discrete position or location within the oral cavity 500B where a scan procedure is being executed at a given time. The time may be derivable from time values output by the position sensors 400B and 410B together with the associated position sensor data, or a clock may be used for absolute time values. As described above, the position sensors 400B and 410B in this example include two position sensors, one disposed within or on the oral scanner 100B and one separate from the oral scanner 100B.

[0079] The oral cavity 500B shown in FIG. 3 is not desired to be complete, but includes a dental arch 510B, gums 520B, tongue 530B, uvula 540B, lips 550B, inner cheeks 560B, and palate 570B. Although all other regions within the oral cavity 500B can be considered similarly, for simplicity, only the dental arch 510B will be further discussed. In this exemplary description, the dental arch 510B is virtually separated into four 1 / 4 sections 511B, 512B, 513B, 514B that are considered different segments within the oral cavity 500B where the oral scanner 100B can perform a scanning procedure. The segments defined within the oral cavity 500B do not need to cover the entire dental arch 510B and may cover only a portion of the dental arch 510B, which is understood to be the portion of the oral cavity intended to be scanned. The first position sensor 400B is here disposed on or within the oral scanner 100B and may be implemented as an accelerometer and / or gyroscope and / or magnetometer (generally, as an IMU). The position sensor data and the oral health sensor data may be wirelessly transmitted and received to the processor 200B via the processor communicator as already described, and the processor 200B is configured and / or arranged to determine a segment from a list of segments to be scanned, i.e., the discrete position or location where the oral scanner 100B is currently performing a scanning procedure based on the current position sensor data, or where the oral scanner 100B was performing a scanning procedure at a given time based on position sensor data that may include timer data. In this embodiment, the processor 200B may output one of the four dental arch 1 / 4 sections 511B, 512B, 513B, 514B as the scan segment, i.e., as the discrete position or location currently being scanned. The processor 200B may preferably also be configured and / or arranged to output that no scan is currently being performed at any of the defined discrete positions or locations.For example, when the oral scanner 100B is moved outside the oral cavity 500B or across the tongue 530B, the processor may output that it does not occur at any of the discrete positions or locations where the scan procedure was used, or the processor 200B may explicitly indicate that it is outside the discrete position or location where the oral scanner 200B was used. The processor 200B may be further configured and / or arranged to calculate oral health data from the oral health sensor data by assigning the oral health sensor data and / or the oral health data derived therefrom to determined discrete positions or locations (or segments) in a position-resolved or location-resolved, i.e., segmented, manner, i.e., to discrete positions or locations (or segments). See the previous paragraph for details of the determination of the discrete positions or locations and how the oral health data is assigned to the discrete positions or locations. In some embodiments, the processor 200B determines the orientation of the oral scanner 100B with respect to the Earth's gravitational field and determines the discrete position or location (or segment) by sorting the orientation values into predetermined discrete position or location (or segment) buckets, as is known in the art.

[0080] Additionally or alternatively, a second position sensor 410B may be utilized. In the present embodiment, it is a separate camera that captures an image from the outside or inside of the oral cavity 500B, and the image is understood to be position sensor data delivered by the camera 410B. Based solely on the photograph and / or based on data fusion with the position sensor data from the first position sensor 400B, discrete positions or locations (or segments) within the oral cavity 500B may be determined by the processor 200B, where the discrete positions or locations are associated with one of the shown dental arches 1 / 4 sections 511B, 512B, 513B, 514B. The fact that an external camera is shown here does not exclude the alternative or additional use of the camera as a position sensor disposed in the head portion or the handle portion of the oral scanner 100B so as to be able to capture an image from inside the oral cavity 500B or an image from the user's face respectively to assist in the determination of discrete positions or locations (or segments). According to some aspects throughout this specification, a camera that functions as an oral health sensor may be further utilized as a position sensor. For example, see European Patent No. 2189198 (B1) of the previous paragraph. A scanning procedure performed using an oral health sensor equipped with an optical sensor such as a camera is called an optical scanning procedure.

[0081] FIG. 4 is a schematic diagram of an exemplary oral scanner system 1C according to the present disclosure that specifically includes an oral care device 700C. However, some aspects of the oral scanner system 1C are independent of the presence of the oral care device 700C. The oral scanner system 1C may include an oral scanner 100C, a separate device 300C having a display 310C, the aforementioned oral care device 700C exemplified herein as an electric toothbrush, a charger 710C, a base station 720C having a display 721C and a charger 722C, a router 730C, a computer 740C, and a cloud server or cloud computing device 750C, or may interact with these. Various components of the oral care system 1C may preferably all be configured and / or arranged for wireless communication as indicated by the aforementioned icons. It should be understood that the components of the oral scanner system 1C shown here are an optional assembly. For example, the oral scanner system 1C may include only one charger, or may not include a charger at all, or may actually include two chargers, one for the oral scanner 100C and one for the oral care device 700C, and potentially an additional charger for the separate device 300C. As already explained in the previous paragraph, the processor of the oral scanner system 1C may be implemented as a distributed processor, with a first processor subunit disposed within the oral scanner 100C, a second processor subunit provided by the cloud computing device 750C, or a first processor subunit provided by the separate device 300C and a second processor subunit provided by the computer 740C.How the oral care device 700C can be incorporated into the oral scanner system 1C, and that at least one operating setting of the oral care device 700C can be selected based on control data determined by a processor, and / or that the oral care device 700C can be configured and / or arranged to send oral care activity data regarding at least one oral care activity performed using the oral care device 700C to the processor, where reference is made to the previous description regarding that it can be used to adapt the next scanning procedure. Data from one component may be sent directly to another component, for example from the oral care device 700C to the oral scanner 100C, or indirectly, for example from the oral care device 700C to the cloud server 750C, where it may be stored in memory and then sent to the processor from the cloud server 750C, for example on demand. The processor may be located within a separate device 300C and / or within or in the oral scanner 100C. The memory mentioned may be the memory located in any of the components mentioned or may be distributed memory.

[0082] FIG. 5 is a depiction of an exemplary feedback screen 600D that can be visualized on a display of an oral scanner system. The term feedback screen, as used herein, refers to the visualization of feedback to a user by a display that uses specific feedback concepts within the continuous guidance provided to the user by the oral scanner system. The feedback screen is preferably used to assist a user in performing a task of using the oral scanner system by a continuous or guided human and device interaction process, and does not exclude visualizing information such as the current time on the feedback screen. It should be understood that the individual aspects of the feedback screen shown here are not necessarily disclosed together, and different feedback screen aspects may be assembled in any manner, and the examples provided in the figures are merely exemplary. In FIG. 5, the feedback screen 600D includes a first portion 610D and a second portion 620D. The first portion shows a live or saved image 611D from a camera on the head portion of the oral scanner of the oral scanner system. The camera may be included in the oral health sensor. The live image can include unprocessed or processed image data related to the oral health condition, such as plaque image data that appears as red fluorescence. The processor may be configured and / or arranged to analyze the image data, and may determine a boundary line within the image or image portion where the relevant oral health sensor data is located, and each display 612D may be overlaid on the live image 611D and visualized in the same manner as the portion of the live or saved image. The display 612D is shown in FIG. 5, and this display is overlaid on the visualized image data 611D and is provided to provide a visible reference for the area of the tooth that can be seen on the image covered by plaque. Here, the display 612D is derived from the camera data, specifically the camera data that captures fluorescence, and it is stated that the display 612D indicates the area where a scanned oral health problem such as plaque has been found on the currently scanned tooth (live image) or on the saved image (e.g., to show the tooth with the most severe problem).Display 612D is the result of processing optical oral health data captured by a camera, but the display 612D itself has no meaning unless it is overlaid on an image of each part of the oral cavity to which it relates. Only further processing, such as calculating a normalized area of plaque for the total tooth area within a given segment (discrete position or location), enables a single value that is easily understandable for each segment to be presented to the user.

[0083] In the illustrated example, the second portion 620D of the feedback screen 600D includes an abstract visualization of a human dentition 621D. In the example shown, the abstract visualization of the human dentition 621D generally includes six segments (reflecting scanned segments or discrete positions / places) 622D, 623D, 624D, 625D, 626D, and 627D that are arranged with a distance between two adjacent segments in an oval-like configuration. Each of the segments 622D, 623D, 624D, 625D, 626D, and 627D includes a plurality of overlapping circles or bubbles and is understood to be a non-limiting example of a visualization possibility. The upper three segments 622D, 623D, 624D show the upper teeth, and the lower three segments 625D, 626D, 627D show the lower teeth. The upper segment 623D and the lower segment 626D respectively represent positions in the dentition related to the upper and lower front teeth, the left segments 622D and 627D respectively represent positions in the dentition related to the upper and lower left molars, and the right segments 624D and 625D respectively represent positions in the dentition related to the upper and lower right molars. Referring to segment 622D (and also with respect to segment 625E of FIG. 6 as a further example), it is shown that the illustrated abstract segment can be visually separated into two or three or more subdivisions (segments) that may be related to different discrete positions or places in the dentition. These subdivisions may be used, for example, to visually distinguish different teeth or groups of teeth related to a higher-order segment, or different tooth surfaces or groups of tooth surfaces related to a higher-order segment. Segment 622D (and segment 625E of FIG. 6) is separated into three regions 6221D, 6222D, 6223D, where the side regions 6221D and 6223D respectively represent the buccal and lingual surfaces of the molars of segment 622D, and the central region 6222D represents the occlusal or occluding surface of the molars of segment 622D. Such a portion of the feedback screen may be used to provide live or summary feedback to the user as only a small part of the entire feedback screen or as essentially the only part of the feedback screen. FIG. 5 shows a feedback screen that a user can view during a live scan procedure.Segments 622D, 623D, 624D, 625D, 626D, and 627D may be used to indicate the location or site resolved scan procedure progression and / or the severity of the oral health condition, e.g., the total or normalized area of teeth within the segment where dental plaque, etc. has been determined. Again, note that the segments or subdivisions of segments shown on the feedback screen relate to discrete positions or sites within the oral cavity. As already explained in the previous paragraph, the scan procedure progression is first shown for all segments and all segment subdivisions with a base or starting color (e.g., dark blue) or starting pattern, etc., and then the color or pattern, etc. is progressively or stepwise changed towards a different color or pattern, e.g., towards light blue, and finally towards white, to visualize the scan procedure progression for each segment, i.e., for each discrete position or site. It may be preferable to have three or more colors or patterns used for each segment or subdivision of the pattern to indicate the level of the scan procedure progression or the severity of the oral health condition, although it does not exclude the use of only two colors or patterns, etc. In FIG. 5, different intensities of shading are used instead of colors. The severity of the detected oral health condition is determined based on the discrete position or site resolved oral health (sensor) data and may be visualized by adding patterns of different intensities to the colors. In FIG. 5, additional dots are used to indicate the severity of the oral health condition.

[0084] FIG. 6 is a depiction of an exemplary feedback screen 600E that can be visualized on a display of an oral scanner system. Feedback screen 600E includes an abstract visualization of an essentially same dentition 621E as described with respect to FIG. 5, to which each description is referred. Abstract segments 622E, 623E, 624E, 625E, 626E, and 627E are shown. Feedback screen 600E can be understood as a summary screen in which the detected oral health condition, e.g., the severity of dental plaque, is shown in a way that is discretized by different colors or patterns, etc., at discrete positions or locations (in FIG. 6, different intensities of shading are used). In this embodiment, the basic feedback concept described with respect to FIG. 5 is used to show the live status of the oral health condition in each of the segments, or the final status of the oral health condition at the end of the scan procedure, instead of the live or final scan progression described with respect to FIG. 5. Additional patterns or structures may be applied to indicate additional feedback, e.g., the presence of another oral health condition such as tartar (i.e., old dental plaque), and the intensity of the pattern or the number of additional structures may indicate the severity of the additional oral health condition. Additional dots are shown in FIG. 6. Further, feedback screen 600E includes a visualization of the temporal change in at least one oral health condition, e.g., the severity of dental plaque. Such visualized feedback can show, in an appropriate way, the severity of the oral health condition determined in a recent scan procedure and a change indicator for the change in severity compared to the severity in at least one previous scan procedure. The bar indicator with a temporal change arrow shown in FIG. 6 is merely an example of such a visualization of comparison data, i.e., comparison data regarding the comparison of current data with stored historical data. The bar indicator shown includes a bar indicating the oral health condition, where the bottom is related to no problem and the top is related to a concerning state, a first number, here 75, indicating a normalized oral health condition assessment (normalization may be related to a range between 0 and 100 here), and a second number, here 8, indicating the temporal change versus the previous, i.e., the historical scan procedure.The reference guide 630E can be visualized to map, for example, colors or symbols or patterns to the severity of the oral health condition, and the severity shown in the reference guide 630E may match the state class into which the oral health data is classified. In the example shown, three state classes, namely "low", "medium", and "high", are used. In this example, information regarding comparison with historical data is shown as a comprehensive indicator for the entire scanned portion of the oral cavity. In contrast, it can be envisioned that a feedback screen may be shown, where the temporal changes are shown, for example, in a segmented manner as the color of each segment, and / or the assigned values can be used to indicate better or worse temporal changes for each segment, i.e., for each discrete position or location.

[0085] FIG. 7 is a diagram of an exemplary separate device 300F that is part of an oral scanner system and includes a display 310F on which an exemplary feedback screen 600F is visualized. Again, an abstract visualization 621F of the dentition is utilized as in FIGS. 5 and 6. In addition to segments of the dentition, a location where an oral health condition of a particular severity has been detected (i.e., a location where the analysis of the oral health sensor data has resulted in an oral health condition exceeding a threshold), for example, a location where gum inflammation has been detected based on the analysis of image data such as that created by a camera acting as a sensor receiver of an oral health sensor, a position 640F regarding segments of the gums is shown. The feedback screen 600F provides an example of a visualization for providing feedback regarding various oral health conditions classified into different state classes. The reference guide 630F can be visualized to map, for example, colors or symbols or patterns to the type of oral health condition and its classification. The visualized marks 640F, 641F may be overlaid on the abstract visualization 621F of the dentition to provide feedback regarding further oral health conditions, such as cavities. The size of such a mark 641F may be related to the severity and thus the state class. As shown in FIG. 7, the individual discrete positions or locations may be shown in an even more decomposed manner, for example, decomposed at the level of individual teeth.

[0086] The dimensions and values disclosed in this specification should not be understood as being strictly limited to the exact numerical values recited. Instead, unless otherwise indicated, each such dimension is intended to mean both the recited value and a functionally equivalent range surrounding that value. For example, a dimension disclosed as "40 mm" is intended to mean "about 40 mm".

Claims

1. An oral scanner system comprising: An oral scanner configured and / or arranged to perform a scanning procedure of at least a part of the oral cavity, said oral scanner using at least one oral health sensor configured and / or arranged to output oral health sensor data obtained during said scanning procedure related to at least one oral health condition; A position detector configured and / or arranged to output position sensor data regarding whether the oral scanner is currently performing said scanning procedure or the position or location where said scanning procedure was performed at a given time; A processor, Receiving said oral health sensor data and said position sensor data, Processing said position sensor data to determine whether the oral scanner is currently performing said scanning procedure or at least one discrete position or location from at least two discrete positions or locations of said at least a part of the oral cavity where said scanning procedure was performed at said given time, Assigning said oral health sensor data to said determined discrete position or location and / or processing said oral health sensor data to determine oral health data regarding said at least one oral health condition and assigning said oral health data to said determined discrete position or location, a processor configured and / or arranged to; A feedback unit configured and / or arranged to provide feedback regarding said oral health sensor data and / or said oral health data for said at least two discrete positions or locations during said scanning procedure, preferably as live or real-time feedback. An oral scanner system comprising.

2. The oral scanner system according to claim 1, wherein said position sensor includes at least one of an accelerometer or a gyroscope, preferably, said accelerometer or gyroscope is implemented as a MEMS sensor.

3. The oral scanner system according to claim 1 or claim 2, wherein said oral health sensor is an optical sensor.

4. The oral scanner system according to claim 3, wherein said oral health sensor comprises an M×N array of optoelectronic sensor elements, preferably, said optical sensor is a camera.

5. The feedback provided for the at least two discrete positions or locations is in the form of a single value for each of the at least two discrete positions or locations and / or in the form of a single mark such as a color, for the oral scanner system according to any one of claims 1 to 4.

6. The processor is configured and / or arranged to classify the oral health sensor data or the oral health data with respect to at least two state classes regarding the at least one oral health condition, and the feedback unit is configured and / or arranged to provide user-perceivable feedback regarding the state class into which the oral health sensor data or the oral health data is classified for each of the at least two positions or locations, for the oral scanner system according to any one of claims 1 to 5.

7. The feedback unit includes at least one visual feedback element for each of the at least two discrete positions or locations, for the oral scanner system according to any one of claims 1 to 6.

8. The feedback unit includes a display unit, for the oral scanner system according to any one of claims 1 to 7.

9. The feedback unit is realized as a separate device or thereby, and preferably, the separate device is a computer, notebook, laptop, tablet, smartphone, or smartwatch, for the oral scanner system according to any one of claims 1 to 8.

10. The processor is at least partially located in or on the separate device, for the oral scanner system according to claim 9.

11. The oral scanner includes a scanner communicator, the separate device includes a separate device communicator, and the scanner communicator and the separate device communicator are configured and / or arranged for wireless communication, for the oral scanner system according to either claim 9 or 10.

12. The feedback unit is configured and arranged to visualize a depiction of at least a portion of the oral cavity, preferably including at least a visualization of the dentition, and the feedback regarding the minimum oral health state for at least two discrete positions or locations is additionally visualized, preferably the feedback regarding the minimum oral health state for at least two discrete positions or locations is visually overlaid on the depiction of the dentition, or the depiction of the dentition is visually modified to reflect the feedback. The oral scanner system according to any one of claims 1 to 11.

13. The processor is configured and / or arranged to calculate the progress of the scanning procedure of the scanning procedure for at least two discrete positions or locations of at least a portion of the oral cavity, and the feedback unit is configured to provide feedback regarding the progress of the scanning procedure for at least two discrete positions or locations during the scanning procedure, preferably as live or real-time feedback, more preferably in the form of a single value such as a percentage value for each of the at least two discrete positions or locations. The oral scanner system according to any one of claims 1 to 12.

14. The oral scanner system further comprises an oral care device having a device communicator, and the processor is configured and / or arranged to determine control data based on the oral health sensor data obtained during the scanning procedure at the end of the scanning procedure, preferably to transmit the control data to the oral care device, and the oral care device is configured and / or arranged to select at least one from at least two operating settings of the oral care device according to the control data. The oral scanner system according to any one of claims 1 to 13.

15. An oral scanner system, An oral scanner comprising an oral health sensor having a camera configured and / or arranged to acquire and output image data from at least a portion of a subject's dentition during an optical scanning procedure, and a position detector configured and / or arranged to acquire and output position sensor data during the optical scanning procedure, wherein the position sensor comprises at least one from a list comprising an accelerometer and a gyroscope. A processor, receives the image data and the position sensor data, processes the position sensor data to determine at least one discrete position or location from at least two discrete positions or locations of the at least portion of the oral cavity where the oral scanner is currently performing the scanning procedure, configured and / or arranged to process the image data to determine oral health data regarding the at least one oral health condition and assign the oral health data to the determined discrete position or location. A display unit configured and / or arranged to provide visualization of the oral health sensor data and / or the oral health data for the at least two discrete positions or locations during the optical scanning procedure, preferably as a live or real-time visualization, more preferably in the form of a single value such as a percentage value for each of the at least two discrete positions or locations. An oral scanner system comprising the above components.

Images