Oral Scanner System

Abstract

An oral scanner having at least one oral health sensor configured and / or arranged to output oral health sensor data regarding at least one oral health condition, the oral scanner being configured and / or arranged to perform a scanning procedure of at least a portion of a subject's oral cavity using the oral health sensor to obtain oral health sensor data, an oral scanner, a processor that receives the oral health sensor data, processes the oral health sensor data to determine oral health data regarding at least one oral health condition, and after completion of the scanning procedure, classifies the oral health data regarding at least two state classes regarding at least one oral health condition, and determines one state class to which the oral health data belongs from the at least two state classes, or preferably, after completion of the scanning procedure, classifies the oral health sensor data regarding at least two state classes regarding at least one oral health condition, and is configured and / or arranged to determine one state class to which the oral health sensor data belongs from the at least two state classes, a processor, and a feedback unit configured and / or arranged to provide feedback regarding the determined state class, relates to an oral scanner system.

Description

Technical Field

[0001] The present disclosure relates to an oral scanner system comprising an oral scanner having an oral health sensor and a processor configured and arranged for determining oral health data regarding at least one oral health condition.

Background Art

[0002] Various professional and home-use oral scanner systems are known to those skilled in the art.

[0003] Particularly with regard to home-use oral scanner systems, there is a general interest in providing an oral scanner system that enables improved usability or improved guidance through an oral scanning procedure and / or a more versatile and preferably intuitively understandable communication of oral health data regarding at least one oral health condition in the context of continuous oral care treatment. According to some aspects, there is a desire to provide at least alternative oral scanner systems.

Summary of the Invention

Means for Solving the Problems

[0004] According to at least one aspect, an oral scanner having at least one oral health sensor configured and / or arranged to output oral health sensor data regarding at least one oral health condition, the oral scanner being configured and / or arranged to perform a scanning procedure of at least a portion of a subject's oral cavity using the oral health sensor to obtain oral health sensor data, an oral scanner, a processor, which receives the oral health sensor data, processes the oral health sensor data to determine oral health data regarding at least one oral health condition, and after completion of the scanning procedure, classifies the oral health data regarding at least two state classes regarding at least one oral health condition, and determines one state class to which the oral health data belongs from the at least two state classes, or, preferably, after completion of the scanning procedure, classifies the oral health sensor data regarding at least two state classes regarding at least one oral health condition, and is configured and / or arranged to determine one state class to which the oral health sensor data belongs from the at least two state classes, a processor, and a feedback unit configured and / or arranged to provide feedback regarding the determined state class. An oral scanner system is provided.

[0005] According to at least one aspect, an oral scanner includes an oral health sensor having a camera configured and / or arranged to acquire image data from at least a portion of a subject's dentition during an optical scanning procedure, and a position detector configured and / or arranged to acquire position sensor data during the optical scanning procedure, wherein the position sensor includes at least one from a list including an accelerometer and a gyroscope, and a processor configured to receive the image data and the position sensor data, process the position sensor data to determine at least one discrete position or location from at least two discrete positions or locations of at least a portion of the oral cavity at which the oral scanner is currently performing a scan procedure or has performed a scan procedure at a given point in time, process the image data to determine oral health data regarding at least one oral health condition for each of the at least two discrete positions or locations, classify the oral health data regarding at least two state classes regarding at least one oral health condition after completion of the scan procedure, determine one state class to which the oral health data for each of the at least two discrete positions or locations belongs from the at least two state classes, or, preferably after completion of the scan procedure, classify the image data regarding at least two state classes regarding at least one oral health condition, and determine one state class to which the image data for each of the at least two discrete positions or locations belongs from the at least two state classes, and a display unit configured and / or arranged to provide feedback regarding the state class determined for each of the at least two discrete positions or locations is proposed.

[0006] The above aspects are described in more detail in the following description that supports a user in using an oral scanner system by continuous and / or induced human-machine interaction. Feedback regarding the state class supports more optimized use of the oral scanner system. In addition to the oral scanner system described herein, a method of using an oral scanner system to scan at least a portion of the oral cavity is also contemplated.

Brief Description of the Drawings

[0007] The present disclosure will become even more apparent by a detailed description of exemplary embodiments and reference to the drawings.

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Mode for Carrying Out the Invention

[0008] The following is a general disclosure of an exemplary oral scanner and an exemplary processor, and further optional components such as a separate device that implements at least a portion of a feedback unit including, for example, a display and / or an oral care device. As used in this disclosure, the phrase "configured and / or arranged" refers to the structural and / or computer-implemented features of each component, and implies that each feature or component is not only suitable for something, but is structurally and / or software-wise arranged to actually perform as intended during operation. Here, it is emphasized that an oral scanner according to this disclosure does not provide the oral care activity itself, specifically, does not include an oral cleaning element, that is, an oral scanner without an oral cleaning element or other oral treatment or care element, and does not provide oral cleaning or oral treatment or oral care. In other words, this disclosure relates to an oral scanner having at least one oral health sensor without additional oral cleaning / treatment / care functions. As will be described later, such a single oral scanner device may cooperate directly or indirectly with an oral care device configured and / or arranged to provide an oral care activity. In such a system, the oral scanner and the oral care device are dedicated devices optimized for individual tasks, and either device can benefit from information previously recorded by the other device. For example, the oral scanner may scan areas and / or segments of low oral activity by the oral care device, and vice versa. The oral care device may provide feedback to the user to increase oral care activity in areas and / or segments where the oral scanner has determined the presence of an oral health problem.

[0009] [[ID=X]]General Considerations The present disclosure relates to an oral scanner system comprising at least an oral scanner and a processor, where the processor may be physically located in or on the oral scanner or may be realized as a processor separate from, i.e., remote from, the oral scanner. As will be explained in more detail below, the processor may be realized in a distributed manner. The oral scanner system may specifically comprise at least one separate or remote device that realizes at least a part of a feedback unit, such as a display. This does not exclude, for example, that the oral scanner itself alternatively or additionally includes a display and / or at least one visual feedback element. The remote display and the remote processor may be arranged together in a separate device, i.e., they may have an integrated outer housing. The separate device may be a proprietary or custom-made device, such as a charger with a display, or a generally known device such as a computer, laptop, notebook, tablet, telephone such as a mobile phone or smartphone, or a smartwatch that can be used to realize a separate display and / or a separate processor. The oral scanner system may comprise at least one oral care device, in particular an electric toothbrush, that is directly or indirectly coupled to the oral scanner and / or the processor, preferably for data exchange by means of wireless communication, for at least a limited period of time, as an alternative to or in addition to the separate device. The oral scanner and the oral care device may share the same handle and may be realized in this way only by attaching the respective oral scanner head or oral care head to the handle. However, it may be preferred to have an independent oral care device that has its own handle and is arranged to be used independently of the oral scanner system, i.e., hardware-wise detachable from the oral scanner system. It may be foreseeable that the oral care device may need to be registered with the oral care system first in order to become part of the oral care system.The oral scanner system may include at least one charger for charging a rechargeable energy storage unit of the oral scanner and / or the oral care device and / or a separate device. The charger may be a wireless charger such as an inductive charger.

[0010] The oral scanner may comprise at least one oral health sensor for obtaining, detecting, measuring or determining and outputting at least one oral health sensor data regarding at least one oral health condition. Hereinafter, one of the terms "obtaining", "detecting", "measuring" or "determining" (or other forms of nouns derived from these verbs or these verbs) is used in relation to the oral health sensor, which shall also include other terms. The oral scanner system may comprise at least one position sensor configured and / or arranged to provide, i.e., output, position sensor data that enables detecting, measuring, or determining at least one discrete position or location (or segment) where the oral scanner is currently performing a scan procedure or was performing a scan procedure at a given time. The scan procedure includes determining the oral health sensor data. In this context, the term "discrete" related to the position of a location within the oral cavity shall indicate that the oral cavity is divided into one or more discrete regions or segments, such as the upper and lower jaws. Typically, the discrete regions or segments do not overlap and cover the portion of the oral cavity intended to be scanned in an essentially complete or gapless manner.

[0011] Here, the objective of the present proposal is to provide the user with understandable information. For example, the acquired oral health information or scan procedure progress information is provided in a manner processed for each discrete position or location (or for each segment). Specifically, it is mentioned that it is reduced to a single value or a single mark, that is, a single percentage value representing the current or finally achieved scan procedure progress or oral health state, or a color indicating the achieved scan procedure progress or oral health state. This oral scanner system is particularly intended for home use by laypersons. Therefore, the improvements and benefits associated with the present proposal are particularly seen in such home use by non-expert users.

[0012] The term "sensor" is to be understood as covering a sensor type that measures or determines parameters related to oral health based on ambient light incident on the sensor or an external measurement medium such as saliva available in the oral cavity analyzed by the sensor, that is, a sensor equipped with a sensor receiver. The term "sensor" further covers a sensor type comprising a measurement medium such as light, that is, a sensor emitter arranged to emit light, and a sensor receiver such as a light receiver, such that the measurement or determination depends at least in part on a non-external measurement medium that means the measurement medium provided by each sensor emitter. The oral scanner is configured and / or arranged to perform a scan procedure for acquiring oral health sensor data related to the oral scanner determining oral health sensor data, preferably oral health data related to at least one oral health state, from at least a part of the oral cavity via an oral health sensor. Preferably, the oral health sensor data and / or the oral health data determined therefrom are acquired in a position-resolved or location-resolved manner. That is, each oral health sensor data and / or oral health data is assigned to position data or location data derived from position sensor data acquired by a position sensor with respect to the same time or period at which the oral health sensor data was acquired.

[0013] In the context of the present disclosure, the term "oral health sensor data" refers to the essentially unprocessed data output by an oral health sensor during a scan procedure (e.g., image data if the oral health sensor is a camera, or a pH value if the oral health sensor is a pH sensor), and the term "oral health data" refers to the processed oral health sensor data (e.g., a normalized or absolute area per tooth or discrete location or place indicating dental plaque, or an average pH value per discrete location or place). In some cases, oral health sensor data is itself a direct measure of oral health status. For example, it should be understood that oral health sensor data from a halitosis sensor may not require further processing to enable a user to determine whether they have halitosis, as the halitosis sensor may provide a certain level of sulfur emission. The processing of oral health sensor data can then be considered as a classification into at least one of at least two state classes of the oral health sensor data, for example, a classification into "no associated level of halitosis" as one state class and "associated level of halitosis" as another state class. The classification can then be performed by a processor by comparison with at least one threshold. More complex classification concepts are described below. Of course, the classification described above can also use the processed oral health sensor data, i.e., oral health data. For example, the output from a halitosis sensor may be averaged over several measurement instances and then used for classification.

[0014] The processor is coupled to an oral health sensor and / or a position sensor to receive at least one sensor data, preferably a plurality and / or a series of sensor data. It may receive single sensor data in chronological order and accumulate it into a plurality of time interval sensor data, or receive a plurality of sensor data at each measurement time and accumulate the plurality of sensor data into a plurality of time interval sensor data. The sensor data may be transmitted to the processor as a sensor signal. For example, the sensor signal may often be a voltage signal that is the output of a sensor measuring physical, chemical, or material properties. The sensor signal may be an analog signal or a digital signal. Here, the terms "datum" or "data" refer to the information content of the physical quantity to which the sensor data (datum) or sensor data (data) is transmitted and the "signal". When the term "sensor data" is used in this disclosure, it shall refer to the "oral health sensor data" provided by the oral health sensor and the "position sensor data" provided by the position sensor. If it is intended to mean only one of the two types of data, the more limited terms for each are used. The processor is preferably arranged to process the sensor data from at least one oral health sensor and at least one position sensor such that at least one position-resolved or location-resolved oral health data regarding at least one oral health state is determined. However, it is clarified that the oral health sensor outputs oral health sensor data that can be processed by the processor to determine oral health data, the position sensor outputs position sensor data that is processed by the processor to determine position data, and the processor can further associate or assign the oral health data and the position data with each other such that position-resolved or location-resolved oral health data is obtained. As described above, the oral health sensor data can be assigned to the position data without the need for further processing of the oral health sensor data.

[0015] The oral scanner may include a scanner head and a scanner handle that can be removably connected. Thus, it is not excluded that the scanner head and the scanner handle can be non-removably connected and form one integrated device. The oral scanner may have a housing that surrounds a hollow portion in which components of the oral scanner, such as an energy source, a controller, and a scanner communicator, can be arranged. The housing may be sized such that a user can conveniently hold the oral scanner by hand. The scanner head may be sized and shaped to be conveniently inserted into the oral cavity. The housing can accommodate at least one user-operable control element, such as an on / off button or switch or a selector button or switch, or any other such element typically expected or found on an oral scanner. The housing can further accommodate at least one feedback element of a feedback unit configured and / or arranged to provide a user with perceptible feedback. The feedback unit may include one or several feedback elements, such as a display provided by a separate device. The at least one feedback element can include at least one from a list including, in a non-limiting manner, an optical feedback element such as a light emitter or multiple light emitters or a display, an acoustic feedback element such as a loudspeaker or a piezoelectric speaker or a buzzer, and a vibrator or any other type of tactile or haptic feedback generator, such as a tactile or haptic feedback element like a refreshable braille display.

[0016] In embodiments where the oral scanner system includes a display as an element of the feedback unit, realized, for example, in an oral scanner and / or by a separate device or in a separate device, the display can be arranged to visualize feedback regarding oral health (sensor) data related to at least one oral health state for at least two discrete positions or locations (or segments). For example, the display may be configured and / or arranged to visualize discretely resolved or discretely positioned (or segmented) oral health (sensor) data. The term "oral health (sensor) data" where the sensor is within is intended to encompass oral health sensor data and oral health data. The display may be configured and / or arranged to show a depiction or visualization of at least a portion of the oral cavity, e.g., an abstract or generalized depiction of at least a portion of the oral cavity such as the dentition. The display can be arranged to additionally depict at least one oral health state and / or at least one state class with respect to oral health (sensor) data classifiable for at least one oral health state and / or at least one feedback regarding oral health (sensor) data. The feedback can be realized by a change in the depiction or visualization of at least a portion of the oral cavity, or by overlaying a visual representation of discretely positionally resolved or locationally resolved (or segment-by-segment) oral health data on the depiction of at least a portion of the oral cavity, or by depicting oral health data on the display, e.g., as text data, and associating it with discrete positions or locations (i.e., segments) within the depiction of at least a portion of the oral cavity. The feedback and depictions or visualizations referred to herein are typically carried out in a discretely positionally resolved manner, i.e., in a segment-by-segment fashion.The present disclosure focuses on either an abstract or a more realistic depiction of a complete dentition, such as at least a portion of the oral cavity including the upper and lower jaws, along with overlaid oral health state data related to one or more oral health states, but does not exclude that the oral health state (sensor) data is presented as a table of oral health state (sensor) data related to one or several oral health states for discrete positions or locations within at least a portion of the oral cavity, in different manners. For example, an overlay of a live image or an image calculated from an acquired image on a model such as a dentition is not considered discrete segmented feedback, as such an overlay leaves the analysis of the segment information to the discretion of the expert user. In the context of the present disclosure, feedback is provided in a manner that has been processed so as to be able to provide a single display or a single value per segment to a non-expert user without the need for any analysis by the lay user.

[0017] Feedback on oral health (sensor) data may be provided "live" or in real-time, for example, while the user is performing a scan procedure using an oral scanner, meaning that the feedback can adapt to the live progression of the scan procedure, and "live" shall mean that there is a short time delay between the acquisition step and the feedback step, for example, less than 10 seconds, less than 5 seconds, less than 4 seconds, less than 3 seconds, less than 2 seconds, or less than 1 second. Feedback on oral health (sensor) data may alternatively or additionally be provided at the end of the scan procedure via summary feedback in which the accumulated oral health (sensor) data is presented as a final result. Again, all feedback described herein shall be understood to include discretely positionally or spatially resolved (or per-segment) feedback. This can include a classification, preferably a discrete positional or spatial resolution (or per-segment) classification of the oral health (sensor) data into at least two state classes related to at least one oral health condition. Alternatively or additionally, the oral health (sensor) data and / or state classes determined by the classification of the current scan procedure may be compared to historical oral health (sensor) data and / or state classes from a previous scan procedure or a series of previous scan procedures, and the trend or progression of the oral health (sensor) data and / or state classes over time may be visualized as feedback. Again, this may be done in a discretely positionally or spatially resolved (or per-segment) manner. Such historical data may be stored in a memory coupled or connected to a processor. The stored historical data may include oral care activity data related to at least one oral care activity procedure performed using an oral care device, as will be described in more detail below.

[0018] The processor may be arranged to classify oral health (sensor) data into at least two different state classes related to at least one oral health state, for example, two state classes related to the degree of oral health state. The processor may preferably be arranged to classify the oral health (sensor) data in a discretely position-resolved or location-resolved manner (or per segment), that is, the classification is performed for a first position or a first location or a first segment such as the upper right molar, or for at least a second position or a second location or a second segment such as the lower left molar or the incisor. The possibility of subdividing the oral cavity into discrete positions or locations or segments will be explained in more detail below. As an example, the oral cavity intended to be scanned may be the dentition. Possible segments / discrete positions or locations may be (a1) the upper jaw and the lower jaw, or (a2) the mandible and the maxilla, or (b) the upper right molar, the upper front teeth, the upper left molar, the lower left molar, the lower front teeth, and the lower right molar, or (c) the buccal surface of the upper right molar, the occlusal surface of the upper right molar, and the lingual surface of the upper right molar, or (d) the buccal, lingual, and chewing surfaces of the 26th tooth of the human dentition, or one of the above, and the tongue surface. All surfaces of all teeth in the human dentition can result in 72 segments (molars have two surfaces, canines and incisors have two surfaces), or 84 segments if all wisdom teeth are similarly included. In some examples, a complete scan of the user's dentition is intended as a standard scan procedure, but in some examples, the scan procedure only affects the selection of these segments that completely cover the human dentition. The latter may be the case especially when, after a previous scan session and / or after a previous oral care activity, only the selection of segments that cover the complete dentition is selected for repeated scans or focused scans.

[0019] The terms "discrete position" and "discrete location" or "segment" are used interchangeably herein. For readability, the present disclosure may not always refer to all three phrases in all instances.

[0020] The processor may be configured and / or arranged to process sensor data in a "live" manner, for example, during a scanning procedure, such that "live" or generally real-time information regarding the progress or status of the scanning procedure and / or the progress or status of oral health data collection can be visualized as feedback on a display as already described. The live display may similarly include an abstract or more realistic depiction of at least a portion of the oral cavity and superimposed feedback regarding at least the status of the scanning procedure. For example, the various discrete positions or locations or segments of the oral cavity being scanned may be individually highlighted in a graded or staged manner such that the user can easily identify where the oral scanner still needs to be moved or positioned in order to complete the scanning procedure. By way of example, at least the depicted portion of the oral cavity may be shown in a starting color, for example, dark blue, and the individual portions associated with different discrete positions or locations of the depicted portion of the oral cavity may be progressively depicted in a lighter color until essentially white to indicate to the user the scanning procedure that is partially or finally completed with respect to the discrete position or location of the oral cavity shown. Feedback regarding the progress of the scanning procedure may be derived solely from position sensor data, for example, from the cumulative time the oral scanner has performed the scanning procedure at individual discrete positions or locations. This does not exclude the processor from being configured and / or arranged to determine the progress of the scanning procedure in a more refined manner, for example, by checking whether images taken by a camera, which is preferably part of the oral health sensor, from each discrete position or location of the oral cavity include sufficient complete coverage of the discrete position or location of the oral cavity and / or whether such images have a particular image quality, for example, are not blurry, out of focus, etc. Feedback regarding the progress of the scanning procedure may further include an overlay of oral health (sensor) data that is position-resolved or location-resolved onto an abstract or more realistic depiction of at least a portion of the oral cavity.It should be understood that the visualization feedback overlay for display on the display means the generation of a single image to be displayed on the display by the display controller. Here, the overlay means that the base image, for example, the depiction of the dental arch, is modified to reflect the additional feedback to be provided.

[0021] The various components of an oral scanner system, such as an oral scanner, a processor, a separate display, a charger, and / or an oral care device, may be arranged to communicate in at least one direction, preferably in a bi-directional manner, for data exchange or more generally, between at least two of these components. Such data exchange or communication may be realized by a wired connection, for example, when the processor is housed inside the oral scanner, but preferably is realized by wireless communication when the data exchange is to be performed between separate components. Then, one of the components of the oral scanner system, for example, the oral scanner, comprises a scanner communicator such as a transmitter or transceiver, and another component, for example, a processor realized within or by a separate device, comprises a processor communicator such as a receiver or transceiver that can use a proprietary or standardized wireless communication protocol such as the Bluetooth protocol, the Wi-Fi IEEE 802.11 protocol, the Zigbee protocol. Each of the components of the oral scanner system may be arranged to communicate with one or some of the other components of the oral scanner system and / or to wirelessly communicate with another device such as an Internet router or a mobile phone or a tablet or a computer to establish a connection to the Internet, for example, to transmit data to a cloud server that may be part of the oral scanner system and / or to be arranged to receive data from any Internet service such as a cloud server or a weather channel or a news channel. This means that the oral scanner system may be arranged to communicate with the Internet either directly or indirectly via a detour through a device that is not part of the oral scanner system.

[0022] Furthermore, oral health (sensor) data and / or state classes (resolved by position or location) may also be communicated from an oral scanner and / or a processor to an oral care device such as an electric toothbrush, a gum massager, an oral irrigator, a floss device, a calculus remover, a tooth polishing device, a tooth whitening device, etc. Further, the processor may communicate control data to the oral care device, whereby the oral care device may be enabled to select, based on the control data, in a preferably discretely positionally or locationally resolved manner, one of at least two operating settings. The latter requires that the discrete position or location where the oral care device is currently performing an oral care activity procedure is also determined or tracked or monitored. An oral care device position sensor may be used for this task, and since the principle is the same, the description of the discrete position or location determination of the oral scanner is referred to.

[0023] Oral Scanner Hardware: Attachment The various hardware components of the oral scanner have already been described. Additionally, the oral scanner may comprise an attachment that is preferably arranged to be replaceable so that different attachments can be used for different users or different applications. One focus of the present disclosure is an oral scanner comprising an oral health sensor having a camera as a sensor receiver and at least a first light source as a sensor emitter (see also the following description). The light inlet for the camera and the light outlet of at least the first light source may be provided in the head of the oral scanner. The attachment may be realized as a removable distance attachment. The distance attachment may be arranged to enable a scanning procedure at an essentially constant distance between one or more objects to be scanned, such as teeth, and the light inlet of the camera. The distance piece of the distance attachment may remain in contact with the object to be scanned, specifically the outer surface of the object, in order to maintain a constant distance. The camera can have a focal length that generates a sharp image of an object having a distance to the light inlet of the camera defined by the distance piece. The distance piece may be realized as a closed wall element surrounding the light outlet of the first light source and the light inlet of the camera, whereby the closed wall element effectively blocks ambient light from illuminating the object currently being scanned and thus ultimately reaching the camera. Thus, the distance attachment can solve two problems, namely maintaining a constant distance during the scanning procedure and effectively blocking ambient light from reaching the surface of the object being scanned. The latter is particularly beneficial for embodiments in which the light emitted by the first light source is mainly involved in oral health sensor data, i.e., the image data output by the camera.

[0024] An attachment, such as a distance attachment, may be removable to allow for replacement of the attachment when it wears out or to allow for changing the attachment when different attachments are used by different users of the oral scanner. The attachment may further be removable to improve access to parts of the oral scanner that benefit from periodic cleaning, such as a window covering the light exit of the first light source and / or the light entrance of the camera. Further, the removable attachment itself may benefit from periodic cleaning, and the cleaning may be made easier when the attachment is removable. For example, the attachment may be immersed in a cleaning solution to clean it and potentially sterilize it.

[0025] Oral health sensor The oral scanners proposed herein include at least one oral health sensor and may include two or more different oral health sensors. An oral health sensor is understood to be a sensor arranged to acquire and output oral health sensor data regarding at least one characteristic of the oral cavity, and the oral health sensor data may be related to determining the status of the oral health condition or be a direct measure of the oral health condition. The oral health condition may be related to the presence of at least one of the following: dental plaque, tartar, demineralization, white spot lesions, gum inflammation, tooth discoloration, stains, gingivitis, enamel erosion and / or wear, cracks, fluorosis, carious lesions, molar incisor hypo-mineralization (MIH), bad breath, the presence of pathogens such as pathogens or fungi causing candidiasis, tooth misalignment, periodontal ligament disease or periapical inflammation, peri-implantitis, cysts, abscesses, aphthae, and any other indicators understood by those skilled in the art to be related to the oral health condition.

[0026] The oral scanner may be arranged to acquire oral health sensor data in a position-resolved or location-resolved manner, if this is possible. For example, bad breath may be an oral health condition that affects the entire oral cavity, and thus it is to be understood that it may not be perceptibly acquired in a position-resolved or location-resolved manner. However, the latter does not exclude the fact that bad breath may be acquired in a position-resolved or location-resolved manner and that feedback regarding this oral health sensor data may also be provided in a position-resolved or location-resolved manner. For example, the feedback for all discrete positions or locations has the same bad breath level or belongs to the same state class.

[0027] Some of the above-mentioned oral health conditions can be detected by visual analysis, which typically requires an oral health optical sensor such as a camera and software implemented on a processor arranged to determine the oral health condition based on the oral health sensor data provided by the optical oral health sensor, for example, based on the classification of image data or an image sequence regarding at least two state classes, and potentially also to evaluate the level of the degree of the oral health condition. Without being limited by theory, the classification of the input image may be performed by a neural network such as a convolutional neural network (CNN), preferably one that has been trained using training images and associated state class results. The classifier used by the processor may be directly supplied with oral health sensor data, for example, image data, or the oral health sensor data may first be processed by the processor to determine one or several features, which are also referred to herein as oral health data related to at least one oral health condition.

[0028] The oral health sensor may include only a sensor receiver that uses external media such as ambient light, saliva, and gaseous components present in the oral cavity and the like to acquire oral health sensor data. According to some aspects, the oral health sensor can include at least one sensor emitter that provides a primary medium and at least one sensor receiver arranged to detect a secondary medium generated by at least the primary medium and / or the interaction of the primary medium with the oral cavity, for example, by the interaction with oral tissues. This does not preclude the sensor receiver from being sensitive to the external media at the same time, as described above. In more specific examples described in more detail below, the at least one sensor emitter is a narrowband light source that emits light in a specific wavelength range as the primary medium, and by the interaction of the emitted light with a specific material present in the oral cavity, a second medium, that is, fluorescence of a higher wavelength, can be generated. The oral health sensor may then further include at least one sensor filter that filters out at least a portion of the primary medium and / or at least a portion of the secondary medium before each medium reaches the sensor receiver. In that case, it would appear obvious that the sensor receiver can be similarly sensitive to ambient light that can pass through the at least one sensor filter. The influence of ambient light on data collection can be reduced by specific means such as the distance attachment described above. In some embodiments, the oral health sensor is an optical sensor such as a photodiode, an M×N array of optoelectronic elements, or a camera.

[0029] According to some aspects, the oral scanner comprises an oral health sensor having at least a first light source and at least one camera, and the oral scanner is configured and / or arranged to perform a scanning procedure, which is typically an optical scanning procedure, where the optical scanning procedure refers to a procedure in which a series of images are captured by the camera. The first light source may comprise a light exit, the camera may comprise a light entrance, and the light exit and the light entrance may be provided on the head of the oral scanner. This can enable, for example, arranging a photoelectric sensor element array, such as an M×N photoelectric sensor element array of the camera, at a distance to the light entrance such as a handle, and guiding light from the light entrance to the photoelectric sensor element array by optical elements such as one or more lenses, one or more mirrors, and / or one or more prisms, and / or one or more light guides. A user-operable input element may be provided on the oral scanner that can start the optical scanning procedure upon operation by the user. The oral scanner may comprise two or more cameras arranged to enable a three-dimensional scan of at least a portion of the oral cavity.

[0030] The oral scanner may comprise a second light source and potentially additional light sources. Different light sources may use the same light outlet, or each light source may have its own light outlet. The first light source can emit light having a first wavelength or a first wavelength range, and the second light source can emit light having a second wavelength different from the first wavelength, or a second wavelength range that does not overlap or only partially overlaps with the first wavelength or the first wavelength range of the first light source. Additionally or alternatively, the first and second light sources may be arranged to emit different light intensities. However, this does not exclude the first and second light sources being provided such that they have essentially the same wavelength or the same wavelength range and emit light of essentially the same intensity. As an example, the first light source can emit light having a wavelength with a main wavelength of about 405 nm or including it, and the second light source can emit "white" light, i.e., light that essentially covers the complete visible wavelength range between 400 nm and 700 nm or includes several main wavelengths, such that as a result, a human can essentially perceive the color impression of the emitted light as white. The light sources are not limited to light sources that emit light in the visible range, and any light source that emits in the infrared (IR) or ultraviolet (UV) wavelength range or at least includes a wavelength range spanning these regions is equally considered. The first and / or second light source (and any additional light sources) may be realized by a light emitting diode (LED), but other light sources, such as laser diodes, conventional light bulbs, especially incandescent bulbs, halogen light sources, gas discharge lamps, arc lamps, etc. are also conceivable.

[0031] The camera may comprise an array of optoelectronic sensor elements, and each optoelectronic sensor element may be arranged to output a signal indicative of the light intensity incident on the optoelectronic region of the optoelectronic sensor element. Each of the optoelectronic sensor elements may have an individual sensitivity range, i.e., an individual wavelength sensitivity, although the array of optoelectronic sensor elements may typically comprise optoelectronic sensor elements all having substantially the same light sensitivity (typical and ignoring differences such as gain that are addressed by calibration). The array of optoelectronic sensor elements may be implemented as a regular M×N array, although it does not exclude that the optoelectronic sensor elements are arranged in different patterns, e.g., as coaxial circles. The array of optoelectronic sensor elements may be implemented as a CCD chip or a CMOS chip as typically used in digital cameras. The number of optoelectronic sensor elements may be selected according to the requirements and processing capabilities of the processor. A resolution of 640×480 may be one option, although essentially all other resolutions are conceivable. For example, the camera may be a 4K camera having a resolution of 3840×2160, or the camera may have a lower resolution, e.g., 320×240. It is not excluded that the camera includes a line sensor as typically used in paper scanners.

[0032] In the context of the present application, the optoelectronic sensor elements include RGB sensor elements, i.e., each optoelectronic sensor element of the RGB type supplies three signals related to the R (red), G (green), and B (blue) color channels.

[0033] The camera of the oral scanner is not precluded from being implemented as a pinhole camera, but may include additional optical elements such as at least one sensor lens for focusing light onto the array of optoelectronic sensor elements. The camera may further include at least one sensor mirror for directing light onto the array. Additionally, the camera may include at least one sensor filter that selectively absorbs or transmits light of a specific wavelength or at least one wavelength range. The at least one sensor filter may be fixed or movable, i.e., the sensor filter may be arranged to move inside and outside the optical path of the camera. Several sensor filters may be provided to enable selective filtering of the light reaching the array of optoelectronic sensor elements. The sensor filter may be a long-pass filter, a short-pass filter, a band-pass filter, or a monochromatic filter. The sensor filter may apply wavelength-dependent filter characteristics such that a specific wavelength or wavelength range can only pass through with a reduced amplitude, another wavelength or wavelength range can pass through without attenuation, and yet another wavelength or wavelength range can be completely blocked. The sensor filter may be implemented as a color filter or a dichroic filter.

[0034] The first light source may be a narrow-band light source such as an LED. The narrow-band light source can emit light in the range of 390 nm to 410 nm (FWHM) such that the wavelength of about 405 nm is at least close to the main wavelength of the LED. As already described, the light of about 405 nm causes fluorescence to be emitted by the tooth enamel and dental plaque. Subsequently, a sensor filter that only transmits light having a wavelength exceeding about 430 nm may be used. Preferably, the sensor filter is a cut-off filter having a cut-off wavelength of 450 nm that allows light of a longer wavelength to pass towards the optoelectronic sensor element array such that the reflected light rays generated from the first light source are absorbed and only the fluorescence transmitted by the sensor filter is determined.

[0035] The camera may be implemented by, for example, a camera module available from Bison Electronics Inc. in Taiwan. Without limitation, the camera module may include a photoelectric sensor array having 1976×1200 M×N pixels (i.e., a 2.4 megapixel chip) implemented in CMOS technology, although not all pixels necessarily are used to capture an image during scanning. The camera module may include a lens that provides a focal length of 12.5 mm so as to be able to capture a clear image of an object close to the camera. This does not exclude the use of an autofocus camera. A hyperspectral imaging camera also may be used.

[0036] Examples related to optical sensors, particularly cameras, should not be understood as limiting. At least one oral health sensor may further be implemented as one from a group including, without limitation, temperature sensors, pressure sensors, pH sensors, refractive index sensors, resistance sensors, impedance sensors, conductivity sensors, biosensors such as sensors including biological detection elements, e.g., immobilized biological active systems combined with physical sensors (transducers) that convert biological chemical signals into electrical or optical signals and typically include amplifiers, etc.

[0037] As already explained, the oral health sensor acquires and outputs oral health sensor data transmitted in the form of an analog signal or a digital signal, and the processor may be arranged to process the oral health sensor data to determine oral health data and / or state class data, preferably state class data regarding the oral health state.

[0038] Position sensor The term "position sensor" encompasses all position sensor configurations that can determine the discrete position or location or segment at which the oral scanner head performs a scanning procedure at a given time within the oral cavity and may also include such determinations regarding at least one discrete position or location or segment related to the outside of the oral cavity. The use of the term "position sensor" does not mean that the position sensor itself can directly determine a position inside or outside the oral cavity, but rather that discrete positions or discrete locations or segments inside or outside the oral cavity can be derived from position sensor data, for example, by deterministic calculations based on inputs from the position sensor, by decision trees, by clustering, or by classification algorithms. The processor may be configured and / or arranged to perform such determinations of discrete positions or locations or segments based at least on the position sensor data. Oral health sensors such as cameras may further provide position sensor data, i.e., the oral health sensor may additionally be used as a position sensor, or a further camera may be provided as a position sensor. As an example, image data provided by a camera provided on the head of an oral scanner may be used to determine the type of tooth imaged and thus enable the derivation of discrete positions or discrete locations or segments within the scanned oral cavity (see European Patent No. 2189198 (B1) below).

[0039] European Patent No. 3141151 (A1) describes, inter alia, a positioning based on the fusion of image data from a camera (which is separate from the oral care device) that acquires an image of the user while performing an oral care activity using the oral care device, and data from an accelerometer disposed within the oral care device to determine the orientation of the oral care device with respect to the Earth's gravitational field. On the one hand, based on the classification of the image data created at a given time by a machine learning algorithm specifically trained for each of the positions, and on the other hand, based on the classification of the orientation angles determined from the accelerometer data at the same time, a fused positioning result is calculated. The classification algorithm outputs values similar to the probabilities for a plurality of positions within the oral cavity where the oral care activity can be performed. The highest measure typically indicates the location where the activity is being performed with a certain level of confidence. European Patent No. 3141151 (A1) is hereby incorporated herein by reference. The position sensor in this example comprises a separate camera as the first position sensor and an accelerometer disposed within the oral care device (which may be an oral scanner according to the present disclosure) as the second position sensor. This shows that the term "position sensor" does not refer to a single sensor configuration, but rather encompasses embodiments where a "position sensor" uses two or more different position sensors to provide position sensor data.

[0040] European Patent Application Publication No. 3528172 (A2) describes, inter alia, the determination of discrete positions or locations or segments within the oral cavity where an oral care activity is currently being performed, and this determination depends on the classification of position sensor data, which is a time series of inertial sensor data generated, for example, by an accelerometer and / or gyroscope located within the oral care device, using a neural network, preferably a recurrent neural network. Based on the trained neural network, the classification of the current time sequence of the position sensor data provides a set of values similar to the probabilities for a plurality of possible discrete positions or locations within the oral cavity. The highest value typically indicates the location where the activity is being performed. European Patent No. 3528172 (A2) is hereby incorporated herein by reference.

[0041] Each of the above-mentioned techniques and the techniques referred to in the following paragraphs of this section can be used for determining discrete positions or locations within the oral cavity where an oral scanner according to the present disclosure is performing a scanning procedure, although other techniques can be used as well. For example, tracking the positions of a user's head and toothbrush within a calibrated magnetic field so as to be able to determine the relative position of the toothbrush with respect to the user's head and thus with respect to the user's oral cavity, or using ultrasonic emitters on the user's head and toothbrush to track the movement of both within a calibrated ultrasonic receiver configuration. Similarly, IR emitters and receivers may be used. Further techniques, such as motion tracking techniques using multiple cameras known from CGI videos, can be used as well.

[0042] The latter techniques can determine discrete positions or locations where oral care activities, such as toothbrushing, are performed with relatively high accuracy (e.g., at the level of individual teeth), and the accuracy can justify the use of the term "position" (this position is still mapped onto a "segment" which can still represent a single tooth or a group of teeth). The techniques described in the previous paragraph were not developed at least at the time of filing of the present disclosure to provide results with such high accuracy and may be able to determine one of 16 different segments in the dentition where oral care activities are performed. The term "position" may then be more suitable since the determination typically relates to a group of teeth (e.g., upper left molars) or a group of surfaces of a group of teeth (e.g., the buccal surface of the lower right molars). In a more general sense, the term "segment" is used to indicate a discrete position or discrete location.

[0043] European Patent No. 2189198 (B1) describes determining discrete positions or locations within the oral cavity by analyzing camera data from a camera located in a toothbrush head. The analysis of the image data is described as being able to identify the teeth shown in the image. It can be contemplated that a classifier is trained using labeled images of the user's teeth and / or other parts of the oral cavity so that a processor can reliably identify the position within the oral cavity where a scanning procedure is currently being performed.

[0044] U.S. Patent Application Publication No. 2010 / 0170052 (A1) describes determining discrete positions or locations within the oral cavity where oral care activities are being performed by an oral care device by analyzing images from a separately positioned camera that images the user's face and the oral care device. European Patent No. 2189198 (B1) and U.S. Patent Application Publication No. 2010 / 0170052 (A1) are hereby incorporated by reference herein.

[0045] Processor hardware The processor may be any kind of general-purpose integrated circuit (e.g., an IC: CPU) or an application-specific integrated circuit (e.g., an ASIC), and may be implemented by a microprocessor, a microcontroller, a system on chip (SOC), an embedded system, etc. The processor should not necessarily be understood as a single circuit or chip. One part of the processing task may be executed by a first processor subunit, and one or several additional processing tasks may be executed by at least a second or several additional processor subunits in a distributed manner. It is contemplated to provide the processor in a distributed manner, and different processor subunits may be physically disposed at different locations, such as within or on an oral scanner, within or on a remote device, and / or within or on a cloud computer. The processor may be essentially fully implemented by a cloud computing device. The processor may also include analog circuit elements and integrated circuit elements, or only analog circuit elements.

[0046] The processor has at least one input and at least one output. The processor receives sensor data and / or oral care activity data from the oral care device via the input, and outputs oral health data and / or status class data and / or control data, preferably discrete position or position-resolved oral health data and / or status class data and / or control data, via the output. The status class data refers to data that classifies oral health (sensor) data into at least one of at least two status classes, e.g., a non-severe class and a severe class, or more than two classes, e.g., a non-severe class, a monitored class, and a class recommended for an oral care expert visit. The latter examples are for illustration purposes, and those skilled in the art can use any other number of classes and can appropriately name these classes.

[0047] Processor Software: Classification As described in various previous paragraphs, a processor is configured and / or arranged to classify oral health sensor data and / or oral health data into at least two state classes. In more mathematical terms, oral health (sensor) data (preferably for a given discrete position or location) may be said to be an observation, the state classes are categories, and a classifier algorithm may then be used to determine the category to which the observation belongs. Oral health (sensor) data may include one or several variables or features characterizing the oral health state. For example, the oral health data may include a normalized plaque area for each considered discrete position or location. The classifier may then simply label the input feature (plaque size) into a category by comparison with one or several thresholds. The thresholds themselves may be derived from expert opinion or from the analysis of the oral health states of multiple subjects by a machine learning algorithm. Instead of using features or a vector of features derived from the oral health sensor data, the oral health sensor data may be used as input to the classifier without preprocessing. For example, a neural network may be directly fed with image data acquired by an oral health sensor equipped with a camera.

[0048] Thresholds or other parameters affecting the classification may be set to different values for different discrete positions or locations within the oral cavity. Such discrete position- or location-dependent thresholds or parameters affecting the classification for a given oral health state may be influenced, preferably, by at least one from a non-limiting list including, in a comprehensive sense (i.e., for all users) or for an individual, the discrete position or location within the oral cavity, the oral health (sensor) data or the history of the development of the state classes related to this discrete position or location for a given oral health state, or the overall or average oral health state status for a given user.

[0049] The above-described threshold-based approach for classification may be practical for oral health data that includes one or two features per oral health state, but different classifier algorithms may be used if the oral health data includes multiple features. For example, a neural network may be applied to the classification task or any other classification algorithm known to those skilled in the art. The classification algorithm may be selected to be one from a non-limiting list including linear classifiers, support vector machines, quadratic classifiers, kernel estimation, boosting, decision trees, neural networks, transformers, genetic programming, and learning vector quantization.

[0050] The state classes may be determined for at least one of at least two discrete positions or locations, preferably for all discrete positions and locations used to subdivide at least a portion of the scanned oral cavity into segments. In each of such discrete positions or locations, at least two state classes may be defined, preferably at least three state classes may be used (similar to a traffic signal system indicating any of green, yellow, or red lights). The underlying thresholds or parameters used by the classifier algorithm may be adaptive and thus may change over time and may differ for different users.

[0051] Processor Software: Time Evaluation According to some aspects, the oral scanner system proposed herein is intended to periodically repeat a scanning procedure, such as an optical scanning procedure of at least a portion of the oral cavity of a user or a subject to be treated, thereby creating new oral health (sensor) data. The oral scanner system may preferably be configured and / or arranged to compare newly determined oral health (sensor) data and / or state class data with previously created oral health (sensor) data and / or state class data, and update information regarding the temporal evolution of the oral health (sensor) data and state class data, which may then lead to the updated information being fed back to the user. The comparison process may result in comparison data and / or discretely position-resolved or location-resolved comparison data. The processor may comprise a memory for storing and later accessing the previously and currently acquired oral health sensor data and / or position sensor data, and any data created by processing such data, e.g., oral health data and / or state class data and / or discretely position-resolved or location-resolved oral health sensor data and / or discretely position-resolved or location-resolved state class data, and may further comprise comparison data and / or discretely position-resolved or position-resolved comparison data. The stored data related to the previous scanning procedure is also referred to as history data. In addition to the data described above, further data, e.g., history scan procedure progress data or history oral care activity data regarding previous oral care activity procedures performed by an oral care device, may be stored in the memory, and this oral care activity data may be transmitted to and stored in the memory by the processor. The history data stored in the memory may further be used by the processor to adapt the next scanning procedure, e.g., to adapt at least one scanning procedure parameter, and / or to adapt the scanning procedure guidance including at least one automatic feedback provided to the user immediately before or during the next scanning procedure.That is, it means that the scan procedure guidance is automatically displayed immediately before the next scan procedure, rather than being displayed at the end of the current scan procedure, and the user can basically benefit from such guidance in the scan procedure about to be started. The scan procedure guidance may be determined in a segmented manner, that is, for each discrete position or location in the oral cavity. Then, such segmented scan procedure guidance can be automatically shown when the user reaches each segment.

[0052] Display The oral scanner system may include a display as a feedback element of the feedback unit, preferably a display that enables a visual depiction of oral health data and / or status class data and / or oral scan progress data. The display may be any type of display such as an LCD, LED, OLED (PMOLED or AMOLED) display. The display may be a monochromatic or color display. The display may have any suitable resolution such as 96×48 resolution for a display mounted on the oral scanner, or may include a custom-made illuminable area. Since the displays of user devices such as mobile phones, tablet computers, laptops, smart watches, etc. can be used, the respective technologies and resolutions of the displays of such user devices should be considered. In such a case, the app or software executed on such a device may provide relevant programming for the general-purpose processor of the user device so as to function as at least one processor subunit or as a processor according to the present disclosure. Each app or software may further implement any display control required to visualize information as discussed herein.

[0053] This description of the display does not exclude that oral health (sensor) data, scan procedure progress data, etc. are additionally or alternatively fed back to the user by other feedback elements of a feedback unit such as a plurality of individual visual feedback elements and / or audio feedback elements and / or tactile feedback units as already described. As an example, assuming that the oral cavity is segmented into four positions and / or locations, for which the scan procedure is monitored and oral health data is alternatively or additionally fed back, the scan procedure progress data can be fed back by using four visual feedback elements that are controlled to start with a first color, for example dark green, and gradually show a brighter green until the scan procedure is considered complete for a given discrete position or location, after which the light indicator can show, for example, a white signal. For this purpose, RGB light-emitting diodes by means of the light feedback elements can be used. Similarly, for example, live communication of oral health data regarding dental plaque can also use four visual feedback elements, starting with white to indicate the absence of dental plaque and gradually changing towards red to convey the amount of dental plaque detected at each discrete position or location. Instead of live feedback, the oral health data may be fed back to the user only at the end of the scan procedure to indicate the level of dental plaque identified in the scan procedure. Then, the classification of the oral health data regarding dental plaque may be indicated by a blinking light of the status class "severe". A person skilled in the art will understand how to modify the number of visual feedback elements, the colors used, and other feedback means such as blinking and intensity changes.

[0054] Display software The display is assumed to comprise a display controller that converts oral health (sensor) data, preferably position-resolved or location-resolved oral health (sensor) data and / or state class data and / or scan procedure progress data into a visualization shown on the display, the visualization being referred to as a feedback screen. The feedback screen may include at least one element of a graphical user interface. In the present disclosure, the focus is on a feedback screen including a visualization of at least a part of the oral cavity, and the visualization may be a two-dimensional visualization or a 3D-type visualization, the latter meaning a visualization on a two-dimensional display that provides a three-dimensional impression. The visualization of at least a part of the oral cavity may include a visualization of the dentition, i.e., the teeth of the dentition, and may be an abstract visualization or a more realistic visualization. The visualization may be based on a general model of the dentition or may take into account individual data from the user such as missing teeth. An abstract visualization of the complete dentition may include a circle or a ring, and the upper part of the circle or ring visualized on the display may be understood to represent the upper front teeth, and the bottom part of the circle or ring may represent the lower front teeth, in which case the sides may represent the left and right molars, respectively. Instead of a continuous circle or ring, a plurality of segments of the circle or ring may be visualized, for example, an upper segment of about 180 degrees and a lower segment of about 180 degrees may each indicate the upper and lower jaws. Alternatively, four segments of about 90 degrees can be used to display a quarter section of the dentition, which is known to those skilled in the art, for example, from the visualization on the Oral-B SmartGuide. Furthermore, six segments may be used. It is also contemplated to visualize each tooth of the general or individualized dentition by a single segment or to use any other type of segmentation that may be appropriate to those skilled in the art. At least one of the segments may be separated into at least two regions that can represent the inner and outer tooth surfaces, preferably three regions representing the inner and outer tooth surfaces (such as the buccal and lingual surfaces) and the occlusal surface that can be particularly sensitive in molars and incisors. This is not to exclude any other type of fragmentation of the segmented visualization.Although the segment has been described here as a circular or annular portion, it is also conceivable to visualize the segment in a different manner. For example, each tooth may be represented by a circle, or a segment representing a plurality of teeth may be visualized as a plurality of overlapping circles, and the number of circles may coincide with the number of teeth typically represented by this segment, but should not be understood as limiting. The visualization of the dentition may include information as used in accordance with ISO3950:2016. Some exemplary visualizations are further described below with reference to the drawings.

[0055] Instead of an abstract visualization, a more realistic depiction of the dentition may be selected, for example, up to 32 teeth for the permanent dentition of an adult user or up to 24 teeth for the primary dentition of a child. As already mentioned, the visualization may be individualized, for example, the user may be able to input personal dental characteristics such as missing teeth, misaligned teeth, fillings, inlays, crowns, artificial teeth, orthodontic appliances, etc. that can be considered in the visualization. As further explained below, the user may further be enabled to provide information about the oral health status of at least one surface of a tooth, at least one tooth, a group of teeth, or the complete dentition, and / or about the gums. For example, the user can provide inputs regarding tooth discoloration or orthodontic appliances or cavities, etc., and an oral scanner and / or a separate device can provide an interface for inputting the information. Instead of manual input, the oral scanner may be configured and / or arranged to perform a scanning procedure that automates the visualization in at least a portion of the oral cavity by obtaining relevant information about the oral cavity and individualizing it in an automated manner. The above-mentioned interface may be realized as a graphical user interface, but does not preclude the user from additionally or alternatively providing input by means of a voice recognition interface and / or a keyboard, etc. The interface may further enable the user to input personalization information, such as a name, an email address, etc., and / or may enable dedicated access by a dentist to any stored data, which may preferably be enabled, for example, by remote access from a computer in the dentist's office.

[0056] The above does not exclude that the visualization of at least a portion of the oral cavity further includes the tongue, preferably various regions of the tongue, the inner side of the cheek, the lips, the uvula, the pharynx, the palate, etc. In some visualizations, at least one of the aforementioned parts such as the tongue and the complete dentition and at least a portion of the dentition are visualized.

[0057] This abstract or more realistic visualization of at least a portion of the oral cavity provides a map in which additional data, such as oral health data or scan procedure progress data, can be visualized in a manner that allows the user to associate the additional information with locations or positions within the oral cavity.

[0058] The visualization referred to can be used in a manifold feedback application. For example, the visualization may be used to provide feedback regarding the progress of a scan procedure in real time, i.e., in a live manner, which means that the discrete location or place where the oral scanner is currently performing the scan procedure, and each respective visualized segment associated with this discrete location or place, may then be modified so that the progress of the scan procedure can be understood by the user. The visualized segments on which the scan procedure is performed may be additionally visually emphasized, for example, by a halo or similar visual scale, to enable the user to immediately identify the location where the scan is being performed with the oral scanner. An example where the coloring of each segment starts with a first color and gradually changes to a second color has already been described (where white and black are understood to be colors here). It should be understood that this example refers to a gradual change from one color to another, but is not limiting. For example, the start color and end color may be selected to be different for different segments. There is no need to have a gradual change. A stepwise change or a single step from the start color to the end color is also envisioned. Further, instead of or in addition to color, the segments can include start and end patterns for visualizing the scan progress.

[0059] Interaction with an oral care device As described above, the oral scanner system may include an oral care device such as an electric toothbrush, an electric floss device, or an electric cleaning device provided for performing oral care activities such as tooth cleaning, interdental area cleaning, and gum massage. The oral care device preferably has its own oral care device position sensor (e.g., an IMU sensor) such that the discrete position or location within the oral cavity where an oral care activity procedure such as brushing or flossing or cleaning is performed can be determined independently of the determination of the discrete position or location of the oral scanner. Additionally or alternatively, the discrete position or location where the oral care device performs the oral care activity procedure may be at least partially determined by using the same position detector that serves to determine the discrete position or location of the oral scanner (e.g., by the same external camera), i.e., the position sensor of the oral scanner may be a shared position sensor.

[0060] The use of a single oral scanner for performing oral scanning procedures and a single oral care device for performing oral care activities is an interaction between the oral scanner and the oral care device. For example, the oral scanner may provide control data received by the oral care device, and this control data affects oral care activities as long as at least one oral care guidance is triggered by the control data or at least the operating parameters are affected by the control data. The control data can specifically cause guidance or influence to occur in a discretely position-resolved, or discretely position-resolved, or per-segment manner. The single oral scanner can be used to perform a dedicated scanning procedure that is not affected by any parallel oral care activities, and the oral care device can be used to perform a dedicated oral care activity that is not disrupted by any parallel scanning procedures. Data collected during oral care activities can similarly be used to determine control data that can be transmitted to the oral scanner to affect the next oral scanning procedure, for example, to limit or focus the scan on segments that were not properly cared for during the oral care activity. An oral care system comprising an oral scanner and an oral care device benefits from a simple juxtaposition of the two devices.

[0061] The oral care device may include a device communicator, such as a receiver or transceiver, for receiving at least control data from a processor via a processor communicator. The control data may specifically be used to select one from at least two different operating settings of the oral care device. Preferably, the control data is used to select one from at least two different operating settings in a discrete position or location-dependent manner, i.e., in a segmented manner. Such operating settings may be related to the recommended time for performing the oral care activity procedure generally or at a specific discrete position or location, or may be related to the recommended minimum and / or maximum pressure or force values applied by the oral care head generally or at a specific discrete position or location, or may be related to the feedback provided to the user when a specific discrete position or location is being treated, or may be related to the operating mode used generally or at a specific discrete position or location. In that case, the oral care device may be arranged to automatically switch to this mode based on the received control data. The operating mode may preferably be a motion mode in which the oral care head of the oral care device is driven and may include at least one parameter from a list including speed, frequency, and amplitude.

[0062] Exemplary embodiments While not wishing to be limiting, the present disclosure focuses on an oral scanner system comprising an oral scanner having an oral health sensor and a processor. The oral scanner is configured and / or arranged to perform a scan procedure of at least a portion of the oral cavity, such as a portion of the dentition or the entire dentition, and / or more portions or other portions of the oral cavity, and to obtain oral health sensor data related to at least one oral health condition by the oral health sensor. The processor is arranged to receive the oral health sensor data and process the oral health sensor data to determine oral health data or directly utilize the oral health sensor data. Specifically, the processor is configured and / or arranged to classify the oral health sensor data and / or the oral health data with respect to at least two state classes regarding at least one oral health condition, after completion of the scan procedure or at least after completion of the scan procedure for a particular discrete position or location, and to determine one state class to which the oral health sensor data and / or the oral health data belong. See also the discussion prior to the classification. It is again noted that it is preferred that only a small number of state classes exist, such as two or three or four or five state classes used to convey the oral health condition. The small number of state classes enables the conveyance of easily understandable information regarding the oral health condition, preferably in a discretely position / location resolved or segmented manner. The oral scanner system may comprise a feedback unit that provides feedback regarding the determined state class. In some examples, the oral health sensor data is image data, and the oral health data determined by the processor may be the number of teeth having discoloration and the color of the discolored teeth, and the oral health data may be determined by image processing. Then the state class may be related to the degree of discoloration, which may depend on the difference between the color representing no discoloration and the color of the discolored teeth. In some examples, the oral health sensor data is image data, and the image data may be directly input into a classifier, i.e., a classification algorithm, to determine a state class from at least two state classes regarding the oral health condition.Oral health status can be tooth discoloration, and the degree can be directly determined from the image data. In this case, the classifier may be trained using images labeled with respect to the degree or extent of tooth discoloration, for example, labels given by experts in cosmetics and the like.

[0063] The oral scanner system may further comprise a position sensor configured and / or arranged to acquire and output position sensor data related to discrete positions or locations or segments within the oral cavity, wherein at a discrete position or location within the oral cavity, the oral scanner is performing a scan procedure at the present time or has performed a scan procedure at a given time, where the time includes the period necessary to acquire the oral health sensor data and the respective position data. In the case of a period, the central time can be used as the time. Thus, at least a portion of the oral cavity can be divided into at least two discrete positions / locations or segments, as already discussed. The processor is configured and / or arranged to determine the discrete position / location or segment at which the oral scanner is performing or has performed a scan procedure, and to determine discretely position-resolved / location-resolved or segment-resolved oral health sensor data and / or discretely position-resolved / location-resolved or segment-resolved oral health data for each of the at least two discrete positions / locations or segments, wherein each respective oral health sensor data and / or oral health data is assigned in temporal alignment with the determined discrete position / location or segment, i.e., in the assignment procedure, it is ensured that the oral health sensor data and / or the oral health data derived therefrom was acquired at the same time or as close as possible to the time at which the position sensor data was also acquired. This can be achieved by automatically feeding together the sensor data from the same time, or where the time is recorded for each oral health sensor data or a set of oral health sensor data acquired essentially simultaneously, e.g., image data from a camera, and for each position sensor data or a set of position sensor data acquired essentially simultaneously, e.g., three values from a triaxial accelerometer or image data from a camera, for each respective architecture, such that the most temporally compatible sensor data can be assigned together.

[0064] After a scan procedure for a given position or location has been completed, or after the scan procedure has been fully completed, then classification can be performed on discretely position-resolved / location-resolved or segmented oral health sensor data, and / or discretely position-resolved / location-resolved or segmented oral health data, and then for at least one discrete position / location or segment, preferably for at least two discrete positions / locations or segments, more preferably for all discrete positions / locations or segments, feedback regarding the classification result, i.e., the determined one or more state classes, can be provided.

[0065] Where "completion of the scan procedure is used", this shall be taken to mean completion as determined by the oral scanner system or the user, i.e., when the user stops the scan. It is contemplated that positions or locations that have not been scanned sufficiently can then be indicated as having a limited reliability or a low confidence level, respectively. This can be part of the feedback provided by the feedback unit. It should not be excluded that classification can also be performed before completion of the scan procedure, but the classification result can be considered to have the highest reliability or confidence level after completion of the scan procedure.

[0066] Oral health sensor data and / or classification of oral health data can be based on a simple comparison with a threshold. For example, when the normalized area with dental plaque is evaluated, one state class can be assigned when the normalized dental plaque area is less than 0.05, where 1.0 is the complete tooth surface, and another state class is assigned when the normalized dental plaque area is 0.05 or more. In the case of position-resolved or location-resolved oral health sensor data and / or oral health data, the same threshold, i.e., 0.05 in the previous example, can be applied to all positions or locations. Instead of one threshold, two or more thresholds can be used. For example, the first threshold can be 0.05 in the case of dental plaque, and the second threshold can be 0.15, in which case the classification is made with respect to three state classes. However, it is also possible to use different thresholds at different discrete positions / locations or segments. For example, the normalized dental plaque surface on the buccal or lingual surface of molars can be classified by using 0.1 as the threshold since these tooth surfaces typically have higher dental plaque levels. It is also possible to use different classifiers at different discrete positions / locations or segments, specifically, a classifier trained for a particular discrete position / location or segment can then be used for this discrete position / location or segment. Generally, since the thresholds or parameters used in classification are different, the classification can be different for at least two of the different discrete positions / locations or segments.

[0067] In some embodiments, one or more thresholds may be adapted due to oral health (sensor) data and / or the temporal progression of each state class. For example, if the normalized plaque level is low (e.g., less than 0.05), but does not decrease over two or more scan procedures, each threshold may be reduced to, for example, 0.04 or 0.025, etc., to make the risk associated with such a constant plaque level clearer to the user. In such cases, the processor may be coupled or connected to a memory to store the oral health (sensor) data and / or classification data and access such historical data in later scan procedures to analyze the temporal progression.

[0068] Instead of being implemented as a threshold comparison, the oral health sensor data and / or a classifier for classifying the oral health data may implement at least one classification algorithm from a list including linear classifiers, support vector machines, quadratic classifiers, kernel estimation, boosting, decision trees, neural networks, transformers, genetic programming, and learning vector quantization.

[0069] Examples of position sensors have already been considered. An inertial measurement unit (IMU) comprising an accelerometer and / or gyroscope located on or within an oral scanner is contemplated, preferably an IMU implemented as a MEMS sensor. It is again noted here that an oral health sensor for acquiring oral health sensor data may also function as a position sensor simultaneously. Image data output by a camera can be classified, for example, by a classifier algorithm to determine whether an image taken at a given time belongs to a specific discrete position or location. As described above, data from the IMU sensor may be classified in parallel and the results may be fused to determine a discrete position or location, or features derived from the IMU data and image data, or the IMU data and / or image data, may be input into a classifier algorithm. The oral health sensor may comprise an optical sensor such as an M×N array of optoelectronic sensor elements and may be implemented as a camera for taking images. In some cases, oral health sensor data may already provide a direct consideration of the oral health condition (see, for example, the discussion of the above-mentioned halitosis sensor), but it is contemplated that the processor may be configured and / or arranged to process the oral health sensor data to determine oral health data, which is a direct measure of the oral condition. For example, if the oral health sensor is a camera, the oral health sensor data is image data and the processor needs to process the image data to determine the oral health data, which may be related to plaque or dental caries lesions or tooth loss or discoloration visible in the image. See the above list of oral conditions. The processor may be further arranged to classify the oral health sensor data or oral health data with respect to at least two state classes. The oral health data and classification results may be determined specifically for at least two of at least two positions or locations.The processor may be configured and / or arranged to compare the currently determined state class or the position-resolved or location-resolved state class with at least one historical state class or historical position-resolved or location-resolved state class that was determined during at least one previous scanning procedure and stored in the memory as historical state class data.

[0070] The feedback unit may be configured and / or arranged to provide easily understandable feedback regarding the state classification data, preferably oral health (sensor) data, either during the scanning procedure and / or at the completion of the scanning procedure. The easily understandable feedback may mean a single piece of information, preferably a single piece of information for each discrete position / location or segment, such as a value or a color. The feedback unit may comprise at least one feedback element for visual, auditory, and / or tactile or haptic feedback regarding the oral health sensor data and / or the oral health data and / or the state classification data, particularly when such feedback is provided as position-resolved or location-resolved feedback. As described above, the focus of the present invention is on the feedback provided for the classification of the oral health state, preferably in a discretely position-resolved / location-resolved or segment-resolved manner, in order to continuously guide the user to achieve an optimal use of the oral scanner system. The feedback unit may comprise at least two visual feedback elements for the feedback of discretely position-resolved / location-resolved or segment-resolved feedback. Specifically, the feedback unit may comprise a display, and it should be understood that the display may be used to define a plurality of visual feedback elements, with reference being made to each consideration in the previous paragraph. The display may be used to indicate elements of the graphical user interface.

[0071] The feedback unit may be provided by a separate device such as a computer, notebook, laptop, tablet, smartphone, or smartwatch. The processor may be at least partially provided by a separate device. The separate units or devices contemplated herein are intended to be able to communicate in a wireless manner. For example, each of the units or devices may comprise a communicator for establishing at least one-way or two-way or multi-directional wireless communication. As already contemplated, the feedback unit may provide an abstract or more realistic visualization of at least a portion of the oral cavity being scanned, such as a depiction of the dentition, and is taken as an example. The visualization of the dentition may be overlaid with the visualization of oral health sensor data, oral health data, and / or state classification data. The term "overlaid" is to be understood to mean that a two-dimensional image based on the depiction of the dentition may be displayed and may additionally include further information being depicted, and / or coloring or patterning of at least a portion of the depiction of the dentition.

[0072] As already contemplated, the oral scanner system may further comprise an oral care device such as an electric toothbrush, which may comprise a communicator. The processor may be configured and / or arranged to determine control data based on oral health sensor data obtained during a scan procedure after completion of the scan procedure and preferably to transmit the control data to the oral care device, and the oral care device may be configured and / or arranged to select at least one from at least two operating settings of the oral care device in response to the control data. Reference is made to the above consideration of the oral care device included.

[0073] Consideration of Embodiments with Reference to the Drawings FIG. 1 is a schematic diagram of an exemplary oral scanner system 1 according to the present disclosure. The oral scanner system 1 includes an exemplary oral scanner 100 configured and arranged alone to perform an oral scan procedure without oral care activities, and a processor 200, which in this example is disposed in or within the oral scanner 100. The oral scanner 100 includes a handle portion 101 and a head portion 102. An oral health sensor 110 is disposed in or on the oral scanner 100. Generally, two or more different oral health sensors may be used, and thus may be disposed in or on the oral scanner 100. In the illustrated example, at least one measurement inlet, such as a light inlet that cooperates with the oral health sensor 110, is provided in the head portion 102 so that acquisition of oral health data based on light measurement by the oral health sensor 110 is possible in the head portion 102. Here, the head portion 102 includes a flat transparent window 1021 surrounded by a frame structure 1022 that may preferably be arranged and / or configured to receive a removable attachment (see FIG. 2). The head portion 102 is sized to be conveniently introduced into the oral cavity of a human or animal. The handle portion 101 is sized to be conveniently gripped by the hand of a human user. The handle portion 101 and the head portion 102 may be separable from each other. In some embodiments, the handle portion 101 may be equipped with different replaceable head portions in addition to an oral scanner head portion such as a brush head portion. The handle portion 101 may include at least one user-operable input element 103, such as an on / off button and / or a selector button or switch. The oral scanner 100 preferably has an outer housing 104 that may preferably be hollow to accommodate various internal components, such as a rechargeable energy source and preferably a related charging circuit for wireless charging of the energy source, and a circuit board including various electronic components for control of the oral scanner.Generally, the oral scanner 100 is configured and / or arranged to perform a scanning procedure of at least a part of a subject's oral cavity, that is, while the user holds and moves the oral scanner 100, the oral scanner acquires oral health sensor data to determine the progress of the scan, and preferably analyzes the oral health sensor data acquired regarding at least one oral health condition. It is understood that this is not limiting, but the processor 200 may be disposed on the circuit board. The processor 200 is coupled or connected to the oral health sensor 110 to receive a signal from the oral health sensor 110, that is, to receive oral health sensor data in the processor 200. The processor 200 may be configured and / or arranged to process the oral health sensor data to derive or determine oral health data regarding at least one oral health condition such as dental plaque. In some embodiments, the oral health sensor may output oral health sensor data, which is a direct measure of the relevant oral health condition, such that (if applicable) only limited processing of the oral health sensor data is required, such as calculations of normalized values or some reduction to integers. The processor 200 may further be configured and / or arranged to classify the oral health (sensor) data into at least two state classes related to at least one oral health condition, for example, an "oral health no concern" class (or "green" class) and an "oral health concern" class (or "red" class), and this may be done based on a comparison with at least one threshold. Reference is made to each of the previous paragraphs where the classification is described in more detail. The classification may further be done regarding at least three classes, for example, in addition to the "green" class, a "low concern" ("orange") class and a "high concern" ("red") class may result from the classification process. It should be noted again that one of the main aspects of this application is the provision of simple feedback (such as a single value or a single color or a single pattern, etc.) for each of the segments (discrete positions or locations) being scanned for the user by the feedback unit.The provision of this simple feedback requires some processing of oral health sensor data and / or position sensor data to determine a simple feedback (value) for each segment. The simple feedback may be, for example, a number or a color. In some embodiments, the color shown may change in an essentially continuous manner to convey the feedback, and in some embodiments, the feedback may be limited to a binary or ternary feedback space provided by, for example, two numbers such as 0 and 1, or three numbers such as 0, 1, and 2, or two colors such as green and red, or three colors such as green, yellow, and red.

[0074] As already explained and as further explained with reference to FIG. 3, the oral scanner system 1 may further comprise at least one position sensor coupled or connected to the processor 200, whereby the processor 200 receives a signal from the position sensor delivering position sensor data during operation, and the processor 200 can determine from the position sensor data the discrete position or location at which the oral scanner is currently performing a scan procedure or was performing a scan procedure at a given time within the oral cavity. As defined previously, a discrete position or discrete location means a segment of at least a portion of the oral cavity being scanned, and a plurality of segments cover this portion of the oral cavity being scanned in a non-gapped manner and without overlapping. Time data regarding the absolute or relative time at which the data was acquired may be part of the position sensor data or part of the aforementioned oral health sensor data. The determination of the discrete position or location enables the processor 200 to calculate oral health data regarding at least one oral health condition and / or to classify the oral health sensor data and / or oral health data in a discrete position or position-resolved manner, i.e., for each of the segments mentioned, into at least two oral health condition classes. Oral health sensor data and position sensor data acquired essentially at the same time may be delivered together to the processor 200 due to the design of the oral scanner system, or the processor may be configured and / or arranged to assign oral health sensor data and position data having the same time information (“time stamp”) or time information that best matches each other, i.e., the closest time information (time stamp). The provision of the position sensor data and / or oral health sensor data may be done in a live manner, but each data may preferably be stored over a period of time together with time information and transmitted to the processor at a later point in time. It should be noted, for example, that the data may be transmitted every 10 seconds or after the scan procedure has stopped or been completed.The term "position sensor" shall be taken to include embodiments in which two discrete position sensors that together implement a "position sensor" are used, for example, an IMU provided in an oral scanner and a separate camera.

[0075] The oral scanner system 1 may include a feedback unit 120 for providing user-perceivable feedback, specifically, feedback composed of or at least including processed information for each segment, i.e., a single feedback provided in the form of a color or a single value for each segment / discrete position or location. For example, as exemplarily shown in FIG. 1, the oral scanner 100 may include a visual feedback unit 121 which is part of the feedback unit 120 for providing visual feedback. In FIG. 1, the visual feedback unit 121 includes four 1 / 4 ring light regions 1211, 1212, 1213, 1214 arranged to form a ring that can be understood to represent four 1 / 4 sections of the dentition. By illuminating the light regions 1211, 1212, 1213, 1214 with light of different colors and / or light having different intensity characteristics, user-perceivable feedback can be provided, for example, in real time during the scanning procedure, so that the user can understand the progress of the scanning procedure in a discrete position or position-resolved manner. Additionally or alternatively, the four light regions 1211, 1212, 1213, 1214 may be used to indicate the degree of oral health status during or at the end of the scanning procedure in a discrete position or position-resolved manner, for example, by illuminating each light region with a specific color and / or by applying an intensity variation pattern. These are merely examples, and instead of four light regions, the oral scanner 100 may include two, three, five, six, sixteen, or thirty-two, etc. The light regions and / or the oral scanner system 1 may include a display for visualizing user-perceivable feedback in a more versatile manner, for example, displaying values such as percentages for each segment. See the previous paragraph regarding the visualization of feedback.The oral scanner 100 may additionally or alternatively include one or several other feedback elements 122 which are part of a feedback unit 120 such as a light ring at the bottom of the oral scanner 100 for communicating, for example, that the oral scanner 100 is switched on or that an energy storage device needs to be charged, one or several tactile or haptic feedback elements, and / or one or several audible feedback elements. Generally, the processor 200 may be coupled or connected to a memory for storing oral health sensor data and / or oral health data and / or scan progress data and / or state classification data and / or oral care activity data, and this stored data may be stored in a position-resolved or location-resolved manner, specifically, current and historical memory data may be present, where "historical" relates to previous scan procedures or oral care activities. The oral care activity data relates to oral care activity procedures performed using an oral care device, and the data is transmitted to the processor. All aspects described with respect to this embodiment shown in FIG. 1 are further to be understood as provided for all other embodiments in the present disclosure without repetition of the same text, to the extent that the individual aspects do not conflict with other embodiments.

[0076] Figure 2 is a schematic view of an exemplary oral hygiene device 1A according to the present disclosure. The oral scanner system 1A here includes, for example, an exemplary oral scanner 100A and an exemplary separate device 300A including a processor 200A and a display 310A as part of a feedback unit for visualizing user-perceivable feedback (see the previous paragraph providing details regarding visualization and FIGS. 5-7 for further reference to the following disclosure again). The oral scanner 100A may include a scanner communicator 140A, and the separate device 300A may include a separate device communicator 340A. As a result, the oral scanner 100A and the separate device 300A can communicate in a wireless manner, for example, via a Bluetooth protocol or an IEEE 820.11 protocol, that is, exchange signals for delivering data. The possibility of wireless communication is here and in the following figures indicated by an icon including a small circle and three concentric circular segments, as is a common standard for indicating Wi-Fi connectivity. This does not exclude permanent or temporary additional or alternative wired direct or indirect connections for signal exchange or communication via further devices, such as a charger or a router or a cloud computing device. The separate device 300A is schematically shown here as a mobile phone, but should not be understood as limiting. Refer to the possibility of realizing the separate device described in the previous paragraph. In FIG. 2, an oral health sensor 110A is shown to be provided within or on the oral scanner 100A for acquiring oral health sensor data in the head section 102A of the oral scanner 100A. As shown, the oral health sensor 110A may include a sensor receiver 111A, for example, an optical sensor such as a camera, and a sensor emitter 112A such as an optical emitter. A preferably removable attachment 105A is here attached to the head portion 102A, which may preferably be realized as a distance attachment. Refer to the previous paragraph regarding the attachment of the oral scanner.Instead of the sensor emitter 112A being disposed directly in the head portion 102A, the head portion 102A may include an outlet that communicates with the sensor emitter 112A such that the emitted medium can exit the head portion 102A at the intended location and the sensor emitter 112A itself can be disposed at another location within the oral scanner 100A. Similarly, an inlet may be provided in the head portion 102A that communicates with the sensor receiver 111A such that the medium to be measured can enter the head portion 102A at the intended location and the sensor receiver 111A can be disposed at some other location within the oral scanner 100A.

[0077] Regardless of whether the feedback unit is provided at least in part in the oral scanner and / or a separate device, the intent of the feedback contemplated herein is for the user to respond to the feedback and thus enable optimization of the use of the oral scanner system. Here, the use of the oral scanner system focuses, on the one hand, on the use of the oral scanner system during a single scan procedure and, on the other hand, on the long-term use of the oral scanner system over various instances of procedures performed using the components of the oral scanner system (including, for example, the oral scanner and optionally an oral care device for providing oral care activities).

[0078] FIG. 3 is a schematic diagram of an exemplary oral scanner system 1B according to the present disclosure. The oral scanner system 1B includes an oral scanner 100B, a separate device 300B having a display 310B as part of a feedback unit and a processor 200B, and position sensors 400B, 410B each having first and second position sensors 400B and 410B. The position sensor data output by the position sensors 400B, 410B is used to determine whether the oral scanner 100B is currently executing a scan procedure or a discrete position or location within the oral cavity 500B where the scan procedure is being executed at a given time. The time may be derivable from the time values output by the position sensors 400B, 410B together with the associated position sensor data, or a clock may be used for absolute time values. As described above, the position sensors 400B, 410B in this example include two position sensors, one disposed within or on the oral scanner 100B and one separate from the oral scanner 100B.

[0079] The oral cavity 500B shown in FIG. 3 is not desired to be complete, but includes a dental arch 510B, gums 520B, tongue 530B, uvula 540B, lips 550B, inner cheeks 560B, and palate 570B. Although all other regions within the oral cavity 500B can be considered similarly, for simplicity, only the dental arch 510B will be further considered. In this exemplary consideration, the dental arch 510B is virtually separated into four 1 / 4 sections 511B, 512B, 513B, 514B that are considered different segments within the oral cavity 500B where the oral scanner 100B can perform a scanning procedure. The segments defined within the oral cavity 500B do not need to cover the entire dental arch 510B and may cover only a portion of the dental arch 510B, which is understood to be the portion of the oral cavity intended to be scanned. The first position sensor 400B is here disposed on or within the oral scanner 100B and may be implemented as an accelerometer and / or gyroscope and / or magnetometer (generally, as an IMU). The position sensor data and the oral health sensor data may be wirelessly transmitted and received to and from the processor 200B via the processor communicator as already explained, and the processor 200B is configured and / or arranged to determine a segment from a list of segments to be scanned, i.e., the discrete position or location where the oral scanner 100B is currently performing a scanning procedure based on the position sensor data, or where the oral scanner 100B was performing a scanning procedure at a given time based on position sensor data that may include timer data. In this embodiment, the processor 200B may output one of the four dental arch 1 / 4 sections 511B, 512B, 513B, 514B as the scan segment, i.e., as the discrete position or location currently being scanned. The processor 200B may preferably also be configured and / or arranged to output that no scan is currently being performed at any of the defined discrete positions or locations.For example, when the oral scanner 100B is moved outside the oral cavity 500B or across the tongue 530B, the processor may output that it does not occur at any of the discrete positions or locations where the scanning procedure was used, or the processor 200B may explicitly indicate that it is outside the discrete position or location where the oral scanner 200B was used. The processor 200B may be further configured and / or arranged to calculate oral health data from the oral health sensor data by position decomposition or location decomposition, i.e., a segmentation decomposition method, i.e., by assigning the oral health sensor data and / or the oral health data derived therefrom to determined discrete positions or locations (or segments). See the previous paragraphs for details of the determination of the discrete positions or locations and how the oral health data is assigned to the discrete positions or locations. In some embodiments, the processor 200B determines the orientation of the oral scanner 100B with respect to the earth's gravitational field and determines the discrete position or location (or segment) by sorting the orientation values into predetermined discrete position or location (or segment) buckets, as is known in the art.

[0080] Additionally or alternatively, a second position sensor 410B may be utilized, which in this embodiment is a separate camera that captures an image from outside or inside the oral cavity 500B, and the image is understood to be position sensor data delivered by the camera 410B. Based on only the photograph and / or data fusion with the position sensor data from the first position sensor 400B, discrete positions or locations (or segments) within the oral cavity 500B may be determined by the processor 200B, where the discrete position or location is related to one of the shown dental arches 1 / 4 sections 511B, 512B, 513B, 514B. The fact that an external camera is shown here does not exclude the alternative or additional use of a camera as a position sensor disposed on the head portion or the handle portion of the oral scanner 100B so as to be able to capture an image from inside the oral cavity 500B or an image from the user's face respectively to assist in the determination of discrete positions or locations (or segments). According to some aspects throughout this specification, a camera that functions as an oral health sensor may be further utilized as a position sensor. See, for example, European Patent No. 2189198 (B1) of the previous paragraph. A scanning procedure performed using an oral health sensor equipped with an optical sensor such as a camera is called an optical scanning procedure.

[0081] FIG. 4 is a schematic diagram of an exemplary oral scanner system 1C according to the present disclosure that specifically includes an oral care device 700C. However, some aspects of the oral scanner system 1C are independent of the presence of the oral care device 700C. The oral scanner system 1C may include an oral scanner 100C, a separate device 300C including a display 310C, the aforementioned oral care device 700C, exemplified here as an electric toothbrush, a charger 710C, a base station 720C including a display 721C and a charger 722C, a router 730C, a computer 740C, and a cloud server or cloud computing device 750C, or may interact with them. The various components of the oral care system 1C may preferably all be configured and / or arranged for wireless communication as indicated by the aforementioned icons. It should be understood that the components shown here of the oral scanner system 1C are an optional assembly. For example, the oral scanner system 1C may include only one charger, or may not include a charger at all, or rather, may include two chargers, one for the oral scanner 100C and one for the oral care device 700C, and potentially an additional charger for a separate device 300C. As already explained in the previous paragraph, the processor of the oral scanner system 1C may be implemented as a distributed processor, with a first processor subunit disposed within the oral scanner 100C, a second processor subunit provided by the cloud computing device 750C, or the first processor subunit provided by a separate device 300C and the second processor subunit provided by the computer 740C.How the oral care device 700C can be incorporated into the oral scanner system 1C, and that at least one operating setting of the oral care device 700C can be selected based on control data determined by a processor, and / or that the oral care device 700C can be configured and / or arranged to send oral care activity data regarding at least one oral care activity performed using the oral care device 700C to a processor, where reference is made to the previous considerations regarding that it can be used to adapt the next scan procedure. Data from one component may be sent directly to another component, for example, from the oral care device 700C directly to the oral scanner 100C, or indirectly, for example, from the oral care device 700C to the cloud server 750C, where it may be stored in memory, and then, for example, sent on demand from the cloud server 750C to the processor, which may be located within a separate device 300C and / or within or in the oral scanner 100C. The memory mentioned may be a memory located in any of the components mentioned, or a distributed memory.

[0082] FIG. 5 is a depiction of an exemplary feedback screen 600D that can be visualized on the display of an oral scanner system. The term feedback screen, as used herein, refers to the visualization of feedback to a user by a display that uses specific feedback concepts within the continuous guidance provided to the user by the oral scanner system. The feedback screen is preferably used to assist the user in performing tasks using the oral scanner system by a continuous or guided human-machine interaction process, and does not exclude visualizing information such as the current time on the feedback screen. It should be understood that the individual aspects of the feedback screen shown here are not necessarily disclosed together, and different feedback screen aspects may be assembled in any manner, and the examples provided in the figures are merely illustrative. In FIG. 5, the feedback screen 600D includes a first portion 610D and a second portion 620D. The first portion shows a live or saved image 611D from a camera on the head portion of the oral scanner of the oral scanner system. The camera may be included in the oral health sensor. The live image can include unprocessed or processed image data related to the oral health condition, such as plaque image data that appears as red fluorescence. The processor may be configured and / or arranged to analyze the image data, and may determine a boundary line within the image or image portion where the relevant oral health sensor data is located, and each display 612D may be overlaid on the live image 611D and visualized in the same manner as the portion of the live or saved image. The display 612D is shown in FIG. 5, and this display is overlaid on the visualized image data 611D and is intended to provide a visible reference for the area of the tooth that can be seen on the image covered by plaque. Here, the display 612D is derived from the camera data, specifically from the camera data that captures fluorescence, and it is stated that the display 612D indicates the area where a scanned oral health problem such as plaque has been found on the currently scanned tooth (live image) or on the saved image (e.g., to show the tooth with the most serious problem).Display 612D is the result of processing optical oral health data captured by a camera, but the display 612D itself has no meaning unless it is overlaid on an image of each part of the oral cavity to which it relates. Only further processing, such as calculating a normalized area of dental plaque for the total tooth area within a given segment (discrete position or location), enables a single value that is easily understandable for each segment to be presented to the user.

[0083] In the illustrated example, the second portion 620D of the feedback screen 600D includes an abstract visualization of a human dentition 621D. In the example shown, the abstract visualization of the human dentition 621D generally includes six segments (reflecting scanned segments or discrete positions / places) 622D, 623D, 624D, 625D, 626D, and 627D that are arranged with a distance between two adjacent segments in an oval-like configuration. Each of the segments 622D, 623D, 624D, 625D, 626D, and 627D includes a plurality of overlapping circles or bubbles and is understood to be a non-limiting example of a visualization possibility. The upper three segments 622D, 623D, 624D show the upper teeth, and the lower three segments 625D, 626D, 627D show the lower teeth. The upper segment 623D and the lower segment 626D each represent a position in the dentition related to the upper and lower front teeth, respectively, and the left segments 622D and 627D each represent a position in the dentition related to the upper and lower left molars, respectively, and the right segments 624D and 625D each represent a position in the dentition related to the upper and lower right molars, respectively. Referring to segment 622D (and also with respect to segment 625E of FIG. 6 as a further example), it is shown that the illustrated abstract segment can be visually separated into two or three or more subdivisions (segments) that can be related to different discrete positions or places in the dentition. These subdivisions may be used, for example, to visually distinguish different teeth or groups of teeth related to a higher-order segment, or different tooth surfaces or groups of tooth surfaces related to a higher-order segment. Segment 622D (and segment 625E of FIG. 6) is separated into three regions 6221D, 6222D, 6223D, and the side regions 6221D and 6223D each represent the buccal and lingual surfaces of the molar of segment 622D, respectively, and the central region 6222D represents the occlusal surface or biting surface of the molar of segment 622D. Such a portion of the feedback screen may be used to provide live or summary feedback to the user as just a portion of the entire feedback screen or as essentially the only portion of the feedback screen. FIG. 5 shows a feedback screen that a user can view during a live scan procedure.Segments 622D, 623D, 624D, 625D, 626D, and 627D may be used to indicate the position-resolved or location-resolved scan procedure progress and / or the extent of oral health conditions, e.g., the total or normalized area of teeth within the segments where dental plaque, etc. has been determined. Again, note that the segments or subdivisions of segments shown on the feedback screen relate to discrete positions or locations within the oral cavity. As already discussed in the previous paragraph, the scan procedure progress may be visualized by first showing all segments and all segment subdivisions in a base or starting color (e.g., dark blue) or starting pattern, etc., then gradually or stepwise changing the color or pattern, etc. towards a different color or pattern, e.g., bright blue, and finally towards white, to indicate the scan procedure progress for each segment, i.e., for each discrete position or location. It may be preferred to have three or more colors or patterns used for each segment or subdivision of the pattern to indicate the level of scan procedure progress or the extent of oral health conditions, although the use of only two colors or patterns, etc. is not excluded. In FIG. 5, different intensities of shading are used instead of colors. The detected extent of oral health conditions is determined based on discrete position- or position-resolved oral health (sensor) data and may be visualized by adding patterns of different intensities to the colors. In FIG. 5, additional dots are used to indicate the extent of oral health conditions.

[0084] FIG. 6 is a depiction of an exemplary feedback screen 600E that can be visualized on the display of an oral scanner system. Feedback screen 600E includes an abstract visualization of essentially the same dentition 621E as described with respect to FIG. 5, with each description being incorporated by reference. Abstract segments 622E, 623E, 624E, 625E, 626E, and 627E are shown. Feedback screen 600E can be understood as a summary screen in which the detected oral health condition, e.g., the degree of dental plaque, is shown in a discrete or position-resolved manner by different colors or patterns (in FIG. 6a, different intensities of shading are used). In this embodiment, the basic feedback concept considered with respect to FIG. 5 is used to show the live status of the oral health condition in each of the segments, or the final status of the oral health condition at the end of the scan procedure, instead of the live or final scan progression considered with respect to FIG. 5. Additional patterns or structures may be applied to indicate additional feedback, e.g., the presence of another oral health condition such as tartar (i.e., old dental plaque), and the intensity of the pattern or the number of additional structures may indicate the degree of the additional oral health condition. Additional dots are shown in FIG. 6. Further, feedback screen 600E includes a visualization of the temporal change with respect to at least one oral health condition, e.g., the degree of dental plaque. Such visualized feedback can show, in a suitable manner, the degree of the oral health condition determined in a recent scan procedure and a change indicator for the degree of change compared to at least one previous scan procedure. The bar indicator with a temporal change arrow shown in FIG. 6 is merely one example of such a visualization of comparison data, i.e., comparison data regarding the comparison of current data with stored historical data. The bar indicator shown includes a bar indicating the oral health condition, where the bottom is associated with no problem and the top is associated with a concerning state, and a first number, here 75, indicates a normalized oral health condition assessment (normalization can be related to a range between 0 and 100 here), and a second number, here 8, indicates the temporal change relative to the previous, i.e., the historical scan procedure.The reference guide 630E can be visualized to map, for example, colors or symbols or patterns to the degree of oral health status. The degree shown in the reference guide 630E may coincide with the state classes into which the oral health data is classified. In the example shown, three state classes, namely "low", "medium", and "high" are used. In this example, information regarding comparison with historical data is shown as a comprehensive indicator for the entire scanned portion of the oral cavity. In contrast, it can be envisioned that a feedback screen can be shown, where the temporal changes are shown, for example, in a segmented manner as the color of each segment, and / or the assigned values can be used to indicate better or worse temporal changes for each segment, i.e., for each discrete position or location.

[0085] Figure 7 is a diagram of an exemplary separate device 300F that is part of an oral scanner system and includes a display 310F on which an exemplary feedback screen 600F is visualized. Again, an abstract visualization 621F of the dentition is utilized as in FIGS. 5 and 6. In addition to segments of the dentition, locations where a particular degree of oral health status has been detected (i.e., locations where the analysis of oral health sensor data has resulted in an oral health status exceeding a threshold), for example, locations where gum inflammation has been detected based on the analysis of image data such as that created by a camera acting as a sensor receiver of an oral health sensor, a position 640F regarding segments of the gums is shown. The feedback screen 600F provides an example of a visualization for providing feedback regarding various oral health states classified into different state classes. The reference guide 630F can be visualized to map, for example, colors or symbols or patterns to the type of oral health state and its classification. The visualized marks 640F, 641F may be overlaid on the abstract visualization 621F of the dentition to provide feedback regarding further oral health states, such as cavities. The size of such a mark 641F may be related to the degree and thus the state class. As shown in FIG. 7, the individual discrete positions or locations may be shown in an even more decomposed manner, for example, at the level of individual teeth.

[0086] The dimensions and values disclosed in this specification are not to be understood as being strictly limited to the exact numerical values recited. Instead, unless otherwise indicated, each such dimension is intended to mean both the recited value and a functionally equivalent range surrounding that value. For example, a dimension disclosed as "40 mm" is intended to mean "about 40 mm".

Claims

1. An oral scanner system comprising: An oral scanner having at least one oral health sensor configured and / or arranged to output at least one oral health sensor data regarding at least one oral health condition, wherein the oral scanner is configured and / or arranged to execute a scanning procedure of at least a part of a subject's oral cavity using the oral health sensor to acquire the oral health sensor data; A processor, Receiving the oral health sensor data, Processing the oral health sensor data to determine oral health data regarding the at least one oral health condition, and after completion of the scanning procedure, classifying the oral health data with respect to at least two state classes regarding the at least one oral health condition, and determining one state class to which the oral health data belongs from the at least two state classes, or Preferably, after completion of the scanning procedure, classifying the oral health sensor data with respect to at least two state classes regarding the at least one oral health condition, and configured and / or arranged to determine one state class to which the oral health sensor data belongs from the at least two state classes; A feedback unit configured and / or arranged to provide feedback regarding the determined state class.

2. The oral scanner further comprises a position detector configured and / or arranged to acquire and output position sensor data regarding whether the oral scanner is currently executing the scanning procedure or the position or location where the oral scanner executed the scanning procedure at a given time, and the processor Receives the position sensor data, Processes the position sensor data to determine at least one discrete position or location where the oral scanner is currently executing the scanning procedure or where the oral scanner executed the scanning procedure at a given time from at least two discrete positions or locations of the at least part of the oral cavity. Assign the oral health sensor data and / or the oral health data to the determined discrete positions or locations, and create discretely position-resolved or location-resolved oral health sensor data and / or discretely position-resolved or location-resolved oral health data. Preferably, after completion of the scanning procedure, for each of the at least two different discrete positions or locations, one state class to which the discretely position-resolved or location-resolved oral health sensor data and / or the discretely position-resolved or location-resolved oral health data belong is determined from the at least two state classes, and is configured and / or arranged to do so. The oral scanner system according to claim 1, wherein the feedback unit is configured and / or arranged to provide feedback regarding the state class determined for each of the at least two different discrete positions or locations.

3. The oral scanner system according to claim 1 or 2, wherein the processor is configured and / or arranged to perform the classification by comparing at least one oral health data from the oral health sensor data and / or the oral health data with at least one threshold value, preferably at least two different threshold values.

4. The oral scanner system according to claim 2 or 3, wherein the processor is configured and / or arranged to perform the classification by comparing at least one oral health data from the discretely position-resolved or location-resolved oral health sensor data and / or the discretely position-resolved or location-resolved oral health data with at least one threshold value for each of the at least two different discrete positions or locations.

5. The oral scanner system according to claim 3 or 4, wherein the processor is configured and / or arranged to change the at least one threshold value depending on the temporal progression of the determined state class, preferably depending on the temporal progression of the determined state class for each of the at least two discrete positions or locations.

6. The processor is configured and / or arranged to classify the oral health data differently at the at least two different discrete positions or locations, and preferably, at least one threshold or one parameter used in the classification is different at the two different discrete positions or locations, The oral scanner system according to any one of claims 2 to 5.

7. The processor is configured and / or arranged to use the oral health sensor data and / or a classifier for classifying the oral health data after completion of the scanning procedure, and the classifier is a linear classifier, a support vector machine, a quadratic classifier, a kernel estimator, a boosting, a transformer, a decision tree, a neural network, a genetic programming, and at least one classification algorithm from a list including learning vector quantization is implemented, The oral scanner system according to any one of claims 1 to 6.

8. The position sensor includes at least one of an accelerometer or a gyroscope, and preferably, the accelerometer or the gyroscope is realized as a MEMS sensor, The oral scanner system according to any one of claims 2 to 7.

9. The oral health sensor is an optical sensor such as an M×N array of optoelectronic sensor elements, and preferably, the oral health sensor is a camera, The oral scanner system according to any one of claims 1 to 8.

10. The feedback unit includes at least one visual feedback element for each of the at least two discrete positions or locations, and / or the feedback unit includes a display unit, The oral scanner system according to any one of claims 1 to 9.

11. The feedback unit is realized as a separate device or thereby, and preferably, the separate device is a computer, a notebook, a laptop, a tablet, a smartphone, or a smartwatch, and preferably, the processor is at least partially located on or inside the separate device, The oral scanner system according to any one of claims 1 to 10.

12. The oral scanner includes a scanner communicator, the separate device includes a separate device communicator, and the scanner communicator and the separate device communicator are configured and / or arranged for wireless communication. The oral scanner system according to claim 11.

13. The feedback unit is configured and arranged to visualize a depiction of at least a portion of the oral cavity, preferably including at least visualization of the dentition, and the feedback regarding the at least one oral health condition for the at least two positions or locations is additionally visualized, preferably the feedback regarding the at least one oral health condition for the at least two positions or locations is visually superimposed on the depiction of the dentition, or the depiction of the dentition is visually modified to reflect the feedback. The oral scanner system according to any one of claims 1 to 12.

14. The oral scanner system further includes an oral care device having a device communicator, and the processor is configured and / or arranged to determine control data based on the oral health sensor data obtained during the scan procedure at the end of the scan procedure, and preferably to transmit the control data to the oral care device. The oral care device is configured and / or arranged to select at least one operating setting from at least two operating settings of the oral care device according to the control data. The oral scanner system according to any one of claims 1 to 13.

15. An oral scanner system, An oral health sensor having a camera configured and / or arranged to obtain image data from at least a portion of a target dentition during an optical scan procedure, and a position detector configured and / or arranged to obtain position sensor data during the optical scan procedure. An oral scanner, wherein the position sensor includes at least one from a list including an accelerometer and a gyroscope. A processor, Receives the image data and the position sensor data, Process the position sensor data to determine from at least two discrete positions or locations of at least a portion of the oral cavity whether the oral scanner is currently executing the scan procedure or at least one discrete position or location at which the scan procedure was executed at a given time, Process the image data to determine oral health data regarding at least one oral health condition for each of the at least two discrete positions or locations, and after completion of the scan procedure, classify the oral health data with respect to at least two state classes regarding the at least one oral health condition, and determine from the at least two state classes one state class to which the oral health data for each of the at least two discrete positions or locations belongs, or, Preferably, after completion of the scan procedure, a processor configured and / or arranged to classify the image data with respect to at least two state classes regarding the at least one oral health condition and to determine from the at least two state classes one state class to which the image data for each of the at least two discrete positions or locations belongs, An oral scanner system comprising a display unit configured and / or arranged to provide feedback regarding the state class determined for each of the at least two discrete positions or locations.

Images