Oral hygiene system and remote-dental system for compliance monitoring

Abstract

An oral hygiene monitoring system is disclosed to track motion and orientation of an oral hygiene device. A control system may process data output from the motion sensor to determine a position and orientation of the oral hygiene device relative to the user's mouth. In some examples, the system may use machine learning techniques to identify location and orientation, brush stroke type, and other specific actions.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims the benefit of and priority to U.S. Provisional Patent Application No. 62 / 378,139, filed on August 22, 2017, which is hereby incorporated by reference in its entirety. Technical Field

[0003] The present invention relates to methods and apparatus for monitoring oral hygiene activities. Background Art

[0004] Compliance with proper technique and frequency of oral hygiene activities, including brushing and flossing, is critical to dental health. However, compliance is particularly poor among children and adolescents. For example, after bad habits are formed, many areas of the mouth are often missed. Therefore, if the amount of brushing and technique could be monitored, compliance might be increased. However, monitoring oral hygiene equipment technique and the amount of time spent in each area is quite difficult due to various technical limitations.

[0005] According to the Centers for Disease Control and Prevention (CDC), although preventable, tooth decay is the most common chronic disease among children aged 6 to 11 years (25%) and adolescents aged 12 to 19 years (59%). In addition, 28% of adults aged 35 to 44 years have untreated tooth decay. The bacterial biofilm called plaque that develops on the teeth contributes to the formation of tooth decay and gingivitis. However, tooth decay can be prevented or reduced by removing plaque at least once a day for two minutes and preferably twice a day. Atlin T and Horecker E., "Tooth Brushing and Oral Health: How Frequently and When Should Tooth Brushing be Performed", Oral Health & Prevention Dentistry, 2005 3(3): 135-140.

[0006] Additionally, studies have shown that children continually miss the same areas during tooth brushing, which results in the buildup of plaque sequestration on certain teeth. Therefore, the effectiveness of tooth brushing is more important than the length of time the teeth are brushed. Additionally, dental health education has only been shown to generally have only a small and temporary effect on plaque accumulation. Atlin T and Horecker E., "Tooth Brushing and Oral Health: How Frequently and When Should Tooth Brushing be Performed," Oral Health & Prevention Dentistry, 2005 3(3): 135-140. Additionally, many toothpastes include fluoride, which promotes the regrowth of tooth enamel to prevent cavity formation. According to the American Dental Association, compliance with tooth brushing is quite low. For example, only 49% of men and 57% of women brush their teeth twice a day. Summary of the invention

[0007] Therefore, there is a need for a dental system that can increase user compliance with brushing, flossing, or other oral hygiene activities using a regimen recommended by a dentist to reduce cavities, gum disease, and other dental complications resulting from lack of brushing. The present disclosure provides systems and methods for monitoring oral hygiene device usage and electronically providing feedback and other incentives to users to improve compliance.

[0008] The system allows recording of brushing activities (or other oral hygiene activities) and analysis of these activities. It allows the creation of services that provide feedback and incentives to users of the oral hygiene system. The oral hygiene device or associated system component records brushing data during its use via a sensor, wherein the associated system component includes, for example, a camera. In some embodiments, the data is analyzed and compared with reference data. For example, one or more optical sensors that track the movement of a toothbrush relative to the mouth are disclosed. The images output from the optical sensor can be analyzed to determine the orientation and movement of the toothbrush relative to the mouth, and the amount of brushing (or flossing with, for example, a water flosser) in each area can be determined.

[0009] Through the feedback output device, the user receives suggestions for use and motivation for the system and other feedback designed to increase compliance with the recommended usage regimen. For example, the system can let the user know which areas of the mouth they have brushed or flossed, and provide user feedback on places or locations or parts of the mouth that they could brush more, that they have missed entirely. In another example, the system can implement a gamification process to increase motivation to use the hygiene device.

[0010] In some embodiments, the present invention relates to a method for a new way of using an oral hygiene device that notifies a user about his / her brushing practice, for example, by wireless integration with a mobile telecommunication device or other device with a display. The electric toothbrush can also communicate data wirelessly to a base station, which can then send the data to a network to analyze on a cloud server or wirelessly to a mobile device. The mobile telecommunication device can be a mobile phone, a microcomputer with a telecommunication device, or a tablet computer with a telecommunication device. In other embodiments, the data can be sent wirelessly to the base station and then uploaded to the server so that it can be accessed later by a computing device including mobile and non-mobile computing devices. In some examples, the oral hygiene system will include one or more optical sensors or cameras that track the movement of a manual toothbrush (e.g., a non-powered / non-electric toothbrush), and the camera will be integrated with a mobile device, a base station, a local area network, or other computing devices. In this example, any standard toothbrush or water flosser that does not include an electronic device or a motion sensor can be utilized.

[0011] The oral hygiene device system may include an oral hygiene device having a sensor and a base station, the base station physically supporting the oral hygiene device when the oral hygiene device is not being operated by a user. The electronic oral hygiene device may include: (a) signal processing circuitry, (b) memory, (c) a base station interface for exchanging data between the oral hygiene device and the base station, (d) a power supply circuit that may include a rechargeable battery or capacitor, and (e) a controller.

[0012] The base station and / or camera may include: (a) a network interface for exchanging data between the Internet or other network and the base station, and (b) a recharging circuit for recharging a rechargeable battery of the toothbrush, wherein the recharging circuit may optionally also act as a magnetic transmitter connected to a magnetometer sensor in the toothbrush. In other embodiments, the system may not include a base station, and the signal may be sent wirelessly directly to a mobile phone or other wireless terminal, or a separate optical sensor / camera system may record the optical data and send it directly to a mobile device, other computing device or network for analysis. In some embodiments, the base station may include a camera for monitoring and identifying codes on oral hygiene equipment to visually track movement.

[0013] The oral hygiene device system may include a camera positioned separately from the oral hygiene device to record images of the oral hygiene device during brushing. Image processing software may then analyze the brushing motion of the oral hygiene device independently and may also analyze data from a motion sensor attached to the toothbrush. For example, the oral hygiene device may not include any electronics and may instead be a standard toothbrush. In this example, the camera and image processing system may only determine the brushing position and time for each section of the teeth.

[0014] For example, one or more optical sensors may record images of the mouth, oral hygiene equipment, and teeth throughout the brushing period. Image processing software may then identify the toothbrush, features of the toothbrush, the mouth, and the relative positions of each to determine the segments and times of brushing, or use other methods as further discussed herein.

[0015] In some examples, the oral hygiene device may include a pattern for enhanced recognition and spatial orientation calculations. In some examples, accessories for the oral hygiene device may also contain or include a pattern. In addition, the system may combine sensor motion data output from the electronics on the oral hygiene device with the image data to determine the section or portion of the teeth that the user is brushing.

[0016] Electronic configuration

[0017] One or more control systems of the oral hygiene device may be configured to coordinate data exchange between the oral hygiene device, one or more optical sensors, a base station, a mobile device, and / or other networked devices so as to transmit processed signals from the sensors and / or optical sensors for processing to the device for processing. In some embodiments, the oral hygiene device system and associated control system may include a signal conditioning circuit, a memory, an oral hygiene device interface circuit, an oral hygiene device power supply circuit, and a controller circuit, wherein the signal conditioning circuit is used to process signals from the sensor; the memory is used to store processed signals from the sensor; the oral hygiene device interface circuit is used to allow information exchange between the oral hygiene device and the base station and other electronic components; the oral hygiene device power supply circuit is used to power the sensor and the circuit of the toothbrush, and the oral hygiene device power supply circuit includes a rechargeable power supply of the battery and / or capacitor type; and the controller circuit is used to direct the operation of the toothbrush electronic components.

[0018] The base station, one or more optical sensors, and / or other associated camera devices may include the following circuits: data exchange circuitry for exchanging data with a network; interface circuitry suitable for exchanging information with an oral hygiene device; base station power circuitry for powering the base station circuitry and recharging a rechargeable power source of the oral hygiene device when the oral hygiene device is received in the base station. The base station may also include a magnetic field transmitter, which may be a power source or recharging circuitry, or may be a separate magnetic field transmitter. The base station or other electronic device may also include a camera and associated electronic devices. The control circuitry may be configured to store processed signals from the sensor in a memory after detecting a user using a toothbrush, and to command the data exchange circuitry of the base station or other electronic device to transmit the stored signals from the sensor over the network through the interface circuitry of the oral hygiene device and the base station or other electronic device when the oral hygiene device is received in the base station. In some embodiments, raw data from the sensor may be stored on and sent through the data exchange circuitry for processing at the base station or elsewhere.

[0019] Physical Design

[0020] In some embodiments, the oral hygiene device may include an electronic motor for vibrating the head of the oral hygiene device during brushing. In addition, the head of the oral hygiene device including bristles or water flossers may be removably connected to the body or handle of the oral hygiene device and configured for interchangeability of multiple heads. The oral hygiene device may be waterproof. In some embodiments, the base station may be configured to physically receive only one, two, three, four, or five or another number of toothbrushes or other oral hygiene heads.

[0021] In some embodiments, the oral hygiene device may include a visual code or pattern that can be detected and tracked by a camera or vision-based detector. For example, the oral hygiene device head may include a pattern, and the handle may include a pattern. In some embodiments, the handle may include an additional ball or protrusion on the end that includes a larger pattern for detection by the camera. Such a "ball or protrusion" may be a special add-on that clips onto the handle and is not necessarily part of the toothbrush.

[0022] Additionally, the attachment may also be a holder for a toothbrush. For example, a spherical piece may ballast the oral hygiene device with water. Thus, the attachment may be a hollow hemispherical piece with water or other weights at the bottom. This may allow the user to innovatively put down the oral hygiene device at many angles and / or orientations, and the oral hygiene device will be upright regardless of the angle and / or orientation at which the oral hygiene device is put down.

[0023] sensor

[0024] The one or more sensors may include one or more optical sensors separate from the oral hygiene device, which may record images of the oral hygiene device as it is used. If two or more optical sensors are used, the images may be used to track the movement and distance of the oral hygiene device in stereo.

[0025] In an embodiment where the oral hygiene device includes electronic devices, the sensor of the oral hygiene device may be one or more of the following: i) a pressure sensor (10), a motion sensor (11), or ii) any other type of one or more sensors capable of measuring the brushing activity of the toothbrush, such as an accelerometer or an inertial sensor. This may include an accelerometer, a magnetometer, and a gyroscope and / or a gyrometer. In some embodiments, the oral hygiene device may include at least one pressure sensor and at least one acceleration sensor. In some embodiments, the processed signal from the sensor is transmitted to the server via the network via the base station. In addition, the processed signal from the sensor is transmitted to the server via the network via the mobile device.

[0026] In other embodiments, the oral hygiene device may have a pattern for recognition by a vision-based sensor that is stationary and away from the toothbrush, or the oral hygiene device may be just a standard toothbrush. For example, a mobile phone camera or a camera in a base station can be used as an optical sensor to monitor the orientation and position of the toothbrush. In these embodiments, the oral hygiene device may also include a motion sensor, or in other embodiments may have no electronics to save manufacturing costs. Alternatively, as further disclosed herein, the oral hygiene device may have only a pattern for recognition by a camera, or may have no pattern, and an image processing system may recognize the shape, axis, and orientation of the oral hygiene device.

[0027] Computing equipment

[0028] In some embodiments, the mobile telecommunication device is a mobile phone, a microcomputer with telecommunication means, a tablet computer with telecommunication means, or any other device having a display device for displaying information related to the brushing activity and having circuitry for connecting to and communicating with the global network. For example, the mobile device may typically be a mobile phone, but may also include other portable mobile PDA device types ("PDAs") or other types with radio communication capabilities, or even a microcomputer laptop or desktop computer with telecommunication means, a tablet computer with telecommunication means. In other embodiments, the signal may be viewed on a stationary computing device that accesses data via a cloud server.

[0029] Signal Processing

[0030] In some embodiments with electronics in the toothbrush, the control system of the oral hygiene device is configured to store processed signals from the sensor in a memory. In some embodiments, the control system may instead store the raw data from the sensor in a memory to be sent to a base station or other component of the system that can process the raw sensor data. Once the control system and / or other processors in the system determine that the user has started brushing, the control system coordinates the acquisition, processing, and storage of the signal. In other embodiments, the control system may coordinate the storage and transmission of the raw data for processing elsewhere. Next, the control system may be configured to wirelessly send the stored signal to a base station or computing device for further processing or preliminary processing, display, or analysis. In some embodiments, the oral hygiene device may not include a controller or any electronics.

[0031] Signal processing may include filtering, amplification, conversion, analog to digital signal conversion, digital filtering, digital data compression, digital data reduction, digital data calculations, and digital data conversion. This may be performed in several different aspects of a system including an oral hygiene device, a base station, an associated mobile phone, a server linked to the system or other location via a network.

[0032] Data Protocol and Transfer

[0033] In some embodiments, the oral hygiene device interface circuit and the base station and / or camera device interface circuit are wireless circuits, such as: GSM / UMTS and derivatives. In some embodiments, the data exchange circuitry of the base station uses a wireless protocol such as: GSM or other. In some embodiments, the oral hygiene device may have a unique identifier to allow pairing of the mobile device and the toothbrush.

[0034] In other embodiments, the oral hygiene device interface circuit and the camera / base station interface circuit can utilize a wired connection. For example, the data exchange circuit connection to the network is wired. The identification data can be incorporated into a data packet that includes a stored signal from the sensor sent over the network. The identification can include a serial identification number of the oral hygiene device or head, a serial identification number of the base station, or a network address of the base station. In addition, the brushing monitoring data obtained during the measuring step can be time-stamped using data from an internal clock of the oral hygiene device.

[0035] In other embodiments, the network includes at least a wireless local area network (WLAN), and during the communicating step, the oral hygiene device transmits data to the mobile device via the WLAN. The WLAN can operate according to a communication protocol selected from Wi-Fi or Bluetooth protocols. The mobile phone, camera or other computing device can also communicate with a local wireless LAN, and during the communicating step, the toothbrush transmits the data to the mobile device via the wireless LAN.

[0036] The LAN may include a server in communication with at least the toothbrush, and in the communication step, the oral hygiene device may transmit the data to the mobile device via the server. The remote communication network may also include a network of a separate remote wireless LAN, the server communicating with at least one server via the remote network, and the mobile device also communicating with the server via the remote network.

[0037] The information exchanged between the oral hygiene device, the camera, one or more optical sensor devices, the mobile device and / or the base station through the interface circuitry may include data or commands, the data including stored, processed signals from the sensor or raw data from the sensor. Information may be transmitted from the oral hygiene device to the base station, and conversely, from the base station to the toothbrush as needed. The data may also be program or software updates stored and / or executed by the toothbrush. For example, updates and new firmware may be downloaded wirelessly and installed on the toothbrush.

[0038] Cloud servers or local network processing of data

[0039] In some embodiments, the system includes a server, and the stored, processed signals from the sensor or the raw data from the sensor (including the optical sensor) are transmitted to the server via a network, the server including storage means for the transmitted, processed signals and a computing component under the control of a program or software instructions. The program has instructions configured to send an erase command to the oral hygiene device via the network at the end of the transmission to erase the signals stored on the oral hygiene device that have been transmitted to the server. The server can also use the geolocation capabilities of the remote network and / or mobile device to determine the location of the oral hygiene device.

[0040] The server includes a memory for storing a history of stored and processed signals continuously transmitted from the oral hygiene device sensor and / or raw data from the sensor or one or more associated cameras and other devices. The program for controlling the computing component of the server includes software instructions for analyzing and comparing the stored and processed signals and providing calculation results from the analysis and comparison. The program for controlling the computing component of the server may include instructions for making the analysis results available to various computing devices (including mobile devices or stationary devices) by accessing the server through an Internet page or other various methods. The calculation analysis from the server can be directly transmitted or downloaded to the computing device via a network link, which can be performed through a dedicated communication instrument POA link to the base station. Therefore, the calculation results from the server are transmitted to the mobile device via the network through the dedicated communication instrument POA, and then transmitted to the base station and / or the oral hygiene device via the link. When the oral hygiene device is operable and communicates with the server, the server can update the software and / or parameters running and / or used in the oral hygiene device. Similarly, the server can update the application or parameters related to the oral hygiene device and running on the mobile device.

[0041] User Profiles

[0042] The system may include a stored user profile associated with a tooth brushing (or other oral hygiene) activity, and its associated data includes the user's age, size, and gender. During or after the step of monitoring the oral hygiene (e.g., tooth brushing) activity, the oral hygiene device, mobile device, or server may automatically seek to match a user with at least one user profile based on the user profile and past data using at least one predetermined rule. If the user is not a regular user of the oral hygiene device, the user identifies him / her as a visitor on the mobile device.

[0043] In the step of user identification, a specific user may be associated with the oral hygiene device and assumed to be the user. If multiple users of a given oral hygiene device are utilized, the user is associated with the brushing activity at least in the oral hygiene device and possibly in the mobile device and / or server, at least for reference purposes in the latter two.

[0044] In embodiments utilizing a camera, a user profile may have a user picture uploaded or associated with the profile. This would allow a vision-based recognition system to automatically determine the specific user associated with the profile.

[0045] Data Output

[0046] In some embodiments, the oral hygiene device transmits data to a mobile phone, camera, optical sensor device or other computing device in real time, and in the display step, the computing device displays information related to the data on the screen in real time, such as the immediate progress of the user's ongoing brushing episode.

[0047] Calibration / initialization

[0048] In some embodiments, the oral hygiene device and / or camera may be calibrated in the factory or by the user, or both. If the calibration step is performed by the user, the user may be guided in the process by information given by the display of the mobile device.

[0049] Specifically, the visual tracking system can be calibrated by the user using prompts from a base station or associated electronic device (e.g., a cell phone and / or one or more optical sensors). The prompts can be audio or displayed through a user interface. The calibration procedure can request the user to stand at a certain distance from the oral hygiene device and move around the brushing position until certain lights or audible tones are indicated. The system can calibrate oral hygiene devices with or without patterns and with or without motion sensing electronics.

[0050] The calibration system can detect the size and shape of the oral hygiene equipment and the size and shape of the user's head, including the distance of the user from the camera. In some embodiments, the user can hold up a calibration tool the size of a standard oral hygiene equipment to allow the camera (or other optical sensor) to properly calibrate the distance. In some embodiments, motion data can be combined with image data to calibrate the system simultaneously.

[0051] In the initialization step, the system may allow the selection of a desired local wireless network or mobile device. This may be done automatically or with the help of the user, and these operations correspond to network pairing between the elements of the system, which communicate between the elements of the system.

[0052] In some embodiments, the oral hygiene device may include at least a pressure sensor, at least one acceleration sensor, a signal conditioning circuit, a storage circuit, an oral hygiene device interface circuit, an oral hygiene device power supply circuit, and a control circuit, wherein the signal conditioning circuit is used to process the signal from the sensor; the storage circuit is used to store the processed signal from the sensor; the oral hygiene device interface circuit is used to allow information transmission between the oral hygiene device and the base station; the oral hygiene device power supply circuit is used to power the sensor and the circuit of the toothbrush, the oral hygiene device power supply includes a rechargeable power supply of the battery and / or capacitor type; and the control circuit is used for the operation of the oral hygiene device circuit. Preferably, the control circuit can be configured to store the processed signal from the sensor in the memory after detecting the user using the toothbrush, and when the oral hygiene device is received in the base station, command the data exchange circuit of the base station to transmit the stored processed signal from the sensor over the network through the interface circuit of the oral hygiene device and the base station.

[0053] According to the present invention, the base station (and / or optical sensor device) includes: a data exchange circuit with a network; a base station interface circuit suitable for exchanging information with an oral hygiene device and / or a mobile device or other computing device; and a power supply circuit for powering the base station circuit and recharging the rechargeable power supply of the oral hygiene device when the oral hygiene device is received in the base station.

[0054] From another aspect of the same invention, the present invention provides a system for monitoring oral hygiene (e.g., brushing) activity to allow communication with a mobile communication device having a display and information input means and a method for using the system, wherein both the oral hygiene device and the mobile device communicate by radio with a telecommunication network, the telecommunication network being adapted to enable at least the mobile device to communicate with at least one further telecommunication device, the method comprising the following steps: (a) at least one brushing or oral hygiene activity monitoring step, in which the oral hygiene device performs at least one measurement indicative of at least the user's brushing or other oral hygiene activity; (b) at least one two-way communication phase during which: i) the user enters information in the mobile device and the mobile device transmits the information to the oral hygiene device via the telecommunication network, and ii) the oral hygiene device transmits data based on the brushing activity monitoring measurement to the mobile device via the telecommunication network; and (c) at least a display or feedback step, in which the mobile device displays on its screen information based on the brushing (or other oral hygiene) activity monitoring data transmitted in the communication step. The displayed information may represent the output of a calculation performed on the transmitted data, the calculation being performed in the mobile device or in a server.

[0055] The present disclosure provides products and services that improve the use and / or motivation of users to brush their teeth or perform other oral hygiene activities. Feedback is provided through an output device linked to the system. The system provides an oral hygiene device that includes a sensor that monitors the user's brushing activity and provides feedback to the user related to brushing. In some embodiments, a server can provide an application that uses and processes the data received from the sensor to provide output data related to brushing quality and other analysis. Finally, the application running on the server can process the output data to provide feedback to the user in order to provide a fun / interesting dimension to increase the motivation to brush or floss the user's teeth.

[0056] According to some embodiments, an oral hygiene system for monitoring compliance with an oral hygiene regimen includes an oral hygiene device, an optical sensor, a memory, and a control system. The oral hygiene device includes a handle and a head. The memory includes a machine-readable medium, the machine-readable medium includes a machine-executable code, and the machine-executable code stores instructions for executing a method for identifying a specific action of the oral hygiene device. The control system is connected to the memory and includes one or more processors connected to the memory. The control system is configured to execute the machine-executable code to cause the one or more processors to: (i) receive data output by the optical sensor; (ii) process the data using a machine learning model to determine the specific action of the oral hygiene device represented by the data, wherein the specific action includes the orientation and movement of the oral hygiene device; and (iii) output data representing the specific action.

[0057] According to some embodiments, an electronic oral hygiene system for monitoring brushing and compliance with a tooth brushing regimen includes an oral hygiene device, a motion sensor, a memory, and a control system. The oral hygiene device includes a handle and a head. The motion sensor is configured to output motion data related to the motion of the oral hygiene device. The memory is used to store data output by the motion sensor and to communicate data with the motion sensor. The control system determines the position of the head of the oral hygiene device in the user's mouth by comparing the motion data with previously recorded calibration data using a machine learning model.

[0058] According to some embodiments, an oral hygiene system for monitoring brushing and compliance with a tooth brushing regimen includes an oral hygiene device, a sensor, a memory, and a control system. The oral hygiene device includes a handle and a head. The memory includes a machine-readable medium, the machine-readable medium includes a machine executable code, and the machine executable code stores instructions for executing a method for determining the position and orientation of a toothbrush. The control system is connected to the memory and includes one or more processors. The control system is configured to execute the machine executable code so that the control system determines a specific action performed by the oral hygiene device based at least on data output by the sensor, including motion data, wherein the motion data represents the movement of the oral hygiene device. The specific action is determined by processing the motion data with a machine learning model.

[0059] According to some embodiments, a non-transitory computer-readable storage medium has stored thereon instructions for executing a method including machine-executable code which, when executed by at least one machine, causes the machine to: (i) determine, using a machine learning algorithm, a spatial position and orientation of an oral hygiene device based at least on data output by an accelerometer including motion data representing the oral hygiene device; (ii) determine, based on the motion data, a segment of a user's teeth being brushed by the oral hygiene device; and (iii) output on a display an indication of the user brushing their teeth based on the determined spatial position, orientation, and segment of the user's teeth. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] The present invention will now be described in conjunction with exemplary embodiments and the following drawings:

[0061] Figure 1 is a schematic diagram of an example of the system of the present invention;

[0062] Figure 2 is a schematic diagram of an example of an oral hygiene device and an example of a base station of a system;

[0063] Figure 3A is a perspective view of an example of an oral hygiene device and a head according to an embodiment of the present invention;

[0064] Figure 3B is a perspective view of an example of an oral hygiene device handle;

[0065] FIG. 3C to FIG. 3E is a perspective view of an exemplary replaceable head attachable to a head interface;

[0066] Figure 4 is a flow chart illustrating an example of a process in the present disclosure for recording brushing or other hygiene data and providing feedback to a user;

[0067] Figure 5is a diagram showing an example of an oral hygiene device and a base station, wherein the base station or other related equipment has a magnetic field generator therein;

[0068] Fig. 6A is a perspective view showing an example of an oral hygiene device having a visual pattern according to an embodiment of the present invention;

[0069] Figure 6B is a perspective view showing an example of an oral hygiene device head having a visual pattern according to one embodiment of the present invention;

[0070] Figure 7 is a perspective view showing an example of a system for visually identifying the position of an oral hygiene device without a pattern;

[0071] Fig. 8A is a perspective view showing an example of a toothbrush handle having an insert;

[0072] Figure 8B is a perspective view showing an example of a toothbrush with an insert removed;

[0073] Figure 8C is a perspective view showing an example of an insert including a battery and electronics for a toothbrush;

[0074] Fig. 9A is a front view showing an example of a mobile device display with brushing feedback; and

[0075] Fig. 9B is a front view showing an example of a mobile device display with brushing feedback. DETAILED DESCRIPTION

[0076] Various examples of the present invention will now be described. The following description provides specific details for thoroughly understanding and implementing the description of these examples. However, it will be appreciated by those skilled in the relevant art that the present invention may be practiced without many of these details. Similarly, it will also be appreciated by those skilled in the relevant art that the present invention may include many other distinct features not described in detail herein. In addition, some well-known structures or functions may not be shown or described in detail below to avoid making the relevant description unclear unnecessarily.

[0077] The terms used below will be interpreted in their broadest reasonable manner, even when used in conjunction with the detailed description of certain specific examples of the present invention. Of course, certain terms may even be emphasized below; however, any term intended to be interpreted in any limited manner will be clearly and specifically defined in this detailed description section.

[0078] Specific embodiments of the subject matter have been described. Other embodiments are within the scope of the following claims. In some cases, the actions recited in the claims can be performed in a different order and still achieve the desired results. Additionally, the processes depicted in the accompanying drawings do not necessarily require the specific order shown or sequential order to achieve the desired results.

[0079] Although this specification includes many specific implementation details, these should not be interpreted as limitations on any invention or the scope of what may be claimed, but rather as descriptions of features specific to a particular invention. Certain features described in this specification may also be implemented in combination in a single implementation in the context of separate implementations. Conversely, various features described in the context of a single implementation may also be implemented in multiple implementations individually or in any suitable sub-combination. In addition, although the above features may be described as working in certain combinations, and even initially stated as such, in some cases, one or more features from a claimed combination may be removed from the combination, and a claimed combination may be directed to a sub-combination or a variation of a sub-combination.

[0080] Similarly, although operations may be depicted in the accompanying drawings in a specific order, this should not be understood as requiring that such operations be performed in the specific order shown or in a continuous order, or that all of the operations shown be performed to achieve the desired result. In some cases, multitasking and parallel processing may be advantageous. In addition, the separation of various system components in the above-described embodiments should not be understood as requiring such separation in all embodiments, and it should be understood that the described program components and systems can generally be integrated together in a single software product, or packaged into multiple software products.

[0081] Figure 1 An overview of the disclosed oral hygiene device monitoring and feedback system 100 is shown, which includes: an oral hygiene device 1 equipped with a sensor, a base station 2 for receiving and charging the oral hygiene device 1, a mobile device 30 for wirelessly receiving / sending data, a dedicated wireless link POA 8, a server 4 and a network 3 for transmitting information from the server or between various other components of the system 100.

[0082] Data Communications

[0083] The oral hygiene device 1 may have an antenna 5 and a transceiver device for radio communication with a compatible complementary antenna 5 and transceiver device of the base station 2 via a radio link 31. The radio communication link 31 may be, for example, WiFi or GSM or Bluetooth or its derivatives or other proprietary protocols. In addition, one or more optical sensors 9 may communicate with a mobile phone 30, a base station 2, a server 4 or other related computing devices disclosed herein.

[0084] In another embodiment, the antenna and transceiver arrangement is replaced or completed by a wired connection or connector to allow information to be exchanged between the oral hygiene device 1, the optical sensor 9 and / or the base station 2. The wired connector may also provide a power supply from the base station to the oral hygiene device 1 to recharge the rechargeable power supply of the oral hygiene device 1. In another embodiment, the power supply from the base station to the oral hygiene device 1 or the optical sensor device 9 is provided with an electromagnetic induction circuit.

[0085] The base station 2 may be powered by a power cord. Alternatively, the base station 2 may be powered by a rechargeable battery that is recharged from time to time using a battery charger powered by the power grid. The base station 2 has a receiving slot for physically supporting and storing the toothbrush when the toothbrush is not in use by a user.

[0086] The base station 2 and / or the individual optical sensor devices 9 comprise data exchange circuits for data communication with the network 3, wherein the network 3 is, for example, the Internet. Figure 1 As shown, data can be transferred using a radio communication link 31, using an antenna 5 of the base station 2 and a dedicated communication device 8 or an antenna 5 of a POA connected to the network 3. In other embodiments, data transfer between the base station 2 and the network 3 is performed via a wired link, such as ADSL.

[0087] The antenna 5 and transceiver means of the camera / optical sensing device 9 and / or the oral hygiene device 1 are also compatible with the radio communication means of the mobile device 30 over a radio link 31. The radio communication link 31 is, for example, WiFi or GSM or Bluetooth or its derivatives or other suitable protocols. In some embodiments, the radio link 31 is a short-range, local, radio communication link or a radio link 35 such as used in a cellular or other mobile phone system (e.g., GSM and derivatives).

[0088] The mobile device 30 can also exchange data via its radio communication circuit on the network 3 through the dedicated communication device 8 or the POA on the radio link 31. Additionally or alternatively, the mobile device 30 can exchange data directly on the network 3 on the radio link 35.

[0089] The server 4 is connected to the network 3 by any suitable means. The server 4 is broadly defined to include a computing device capable of performing storage and computing operations, for example, on a "cloud" in a computing network. The server 4 may include a storage device, such as a memory, a hard drive, a flash memory, or other storage device, and includes a program-controlled computing device. In order to transfer data, the oral hygiene device control circuit uses a predetermined server 4 address of the network 3. The predetermined address may be initially stored in the oral hygiene device 1 and / or updated later via the network 3. a) Whenever the oral hygiene device 1 in the base station 2 is replaced in a batch configuration; b) at the instruction of the user or server 4, for example, by user action using the interface of the mobile device 30 or a web page to access the server 4 to initiate the transfer; or c) when the activity of the oral hygiene device 1 is detected in real time; or d) the oral hygiene device 1 is removed from the base station 2; or e) at other suitable intervals, data transfer can be performed between the oral hygiene device 1 and the server 4.

[0090] System circuit design and network architecture

[0091] like Figure 2 As shown in , the oral hygiene device 1 may include a pressure sensor 10 and at least one motion sensor 11. When a user applies bristles to their teeth, the pressure sensor 10 detects the force applied to the brushing side of the oral hygiene device 1. The motion sensor 11 may be provided to detect movement of the oral hygiene device 1 in any one or all of three orthogonal axes, or the motion sensor may be capable of detecting acceleration or other motion characteristics in all three axes. The signal output by the sensor is processed by a signal conditioning circuit 12. Examples of signal conditioning include: frequency and noise filtering, amplification, conversion, digital signal processing, and other techniques to optimize the detected signal for analysis.

[0092] In other embodiments, the oral hygiene device 1 may not include any electronics and may be a standard toothbrush. In those embodiments, a separate optical sensor 9 may perform the task of tracking the movement of the oral hygiene device 1 .

[0093] The processed signals or raw data from the sensors are then stored in a memory 14 as determined by the control system 13, which may be a digital signal processor, microcontroller or other processing component, and whose operation is controlled by a program 15. The memory 14 may be included in the oral hygiene device 1 or on a server 4 or other component of the system 100. The program 15 may be updated via an interface circuit 16 of the oral hygiene device 1, a modem for radio communications, and an antenna 5 (and / or a connector, in the case of a contact / wired interface), or other interface of the oral hygiene device 1. More generally, the oral hygiene device interface circuit 16 allows information exchange between the oral hygiene device 1, the optical sensor device 9 and the base station 2 when a radio link 31 is established (and / or when the connector of the toothbrush is mated with the connector of the base station). The oral hygiene device 1 may include a power supply circuit for powering the sensors and circuits of the oral hygiene device 1, and it may include a rechargeable power supply 17.

[0094] The base station 2 may include a base station interface circuit 20, a modem for radio communication, with an antenna 5 (and / or connector) to exchange information over a link 31. In addition, the base station interface circuit 20 is capable of establishing a radio link 31 with a dedicated communication instrument 8 to communicate with the network 3. The base station 2 may utilize a power converter 22 that is regulated to provide appropriate voltage and current to the base station circuit. An electrical connection (not shown) may be provided for providing charging current from the base station 2 to the oral hygiene device 1. In some embodiments, the base station 2 may include a recharging circuit for recharging a battery or power supply of the toothbrush by inductive charging or direct electrical connection.

[0095] The base station 2, optical sensing device 9, or other separate electronic device may also include a magnetic field transmitter 110 that transmits a magnetic field that can be sensed by an associated magnetometer or other magnetic field sensor 11. The magnetic field transmitter 110 may be provided by utilizing charging circuits or other circuits already present in the base station 2 or other electronic device. For example, the base station 2 may have a recharging coil that may also serve as the magnetic field transmitter 110. The recharging coil may be fixed and in a known orientation so as to generate a magnetic field of known strength and polarity orientation. In some embodiments, the base station 2 may include a recharging coil that generates a magnetic field with a polar axis located in a horizontal plane or a vertical plane. In some embodiments, such as in the case of a single-axis recharging coil, this may be a single-axis magnetic field transmitter 110. In other embodiments, a 2-axis or 3-axis magnetic field transmitter 110 may be incorporated into the base station 2. This will advantageously allow one or more fixed magnetic fields with a known orientation so that the magnetometer 11 on the oral hygiene device 1 can sense the strength and polarity of the one or more magnetic fields so as to provide information about the position and orientation of the oral hygiene device 1, or relative changes in position and orientation.

[0096] In some embodiments, other electronic devices or base stations 2 separate from the oral hygiene device 1 may also include a camera 9 that can detect visual patterns on the oral hygiene device 1. The camera 9 may be any suitable camera that can detect visual patterns on the oral hygiene device 1. For example, a camera provided with a mobile phone would be suitable. In other embodiments, a stand-alone camera or optical sensing device 9, a separate camera holder for a mobile phone, a connected mirror, or other camera or imaging device may be utilized.

[0097] In some embodiments, the base station 2 is passive and is under the control of the controller 13 of the oral hygiene device 1 when the circuits of the base station 2 communicate together, in particular when the link 31 is of the wired / contact type with a connector. Figure 2 In the embodiment shown, the base station has a control system 19 for controlling its operation.

[0098] The dedicated communication apparatus 8 may comprise suitable electronics and a radio modem circuit 27 for communicating with the network 3. The dedicated communication apparatus 8 is capable of establishing a radio link 31 with a base station 2 and / or establishing a radio link 31 with a mobile device.

[0099] The mobile device 30 comprises at least a radio modem 26 for establishing a radio link 31. The operation of the mobile device 30 is under the control of a control system 25, for example a central processing unit or μC, and a program 15. The mobile device 30 comprises output means such as a display screen and input means such as a virtual keyboard or a material keyboard. Preferably, the input means and the output means of the mobile device 30 are used in the system for inputting information and for displaying information, in particular the results of calculations performed by the server. The mobile device 30 may also comprise a camera 9 capable of detecting a visual pattern provided on the oral hygiene device to detect movement.

[0100] The program of the computing device of the server 4 allows to store the signals received from the oral hygiene device 1. In addition, the server 4 can analyze the data from the sensor to generate feedback and motivational data about the performance of the user's brushing. The user can access these results on an Internet page hosted by the server 4, or transfer these results to another network server for hosting. In different embodiments, the previous operations and calculations are completed completely or partially in the mobile device 30, and the server 4 is used for general monitoring.

[0101] It should be initially understood that the disclosure herein may be implemented using any type of hardware and / or software, and may be a pre-programmed general purpose computing device. For example, a server, a personal computer, a portable computer, a thin client, or any suitable device or devices may be used to implement the system. The disclosure and / or its components may be a single device at a single location, or multiple devices at a single location or multiple locations, connected together using any suitable communication protocol via any communication medium such as a cable, a fiber optic cable, or wirelessly.

[0102] It should also be noted that the disclosure is shown and discussed herein as having multiple modules that perform specific functions. It should be understood that these modules are only schematically shown based on their functions for the purpose of clarity, and do not necessarily represent specific hardware or software. In this regard, these modules can be implemented as hardware and / or software that basically performs the specific functions discussed. In addition, in the disclosure, modules can be combined together based on the desired specific functions, or divided into additional modules. Thus, the disclosure should not be interpreted as limiting the present invention, but is only understood as illustrating an exemplary embodiment of the present invention.

[0103] A computing system may include a client and a server. The client and the server are usually remote from each other and usually interact through a communication network. The relationship between the client and the server is generated by computer programs running on respective computers and having a client-server relationship with each other. In some embodiments, the server transmits data (e.g., an HTML page) to a client device (e.g., for the purpose of displaying data to a user interacting with the client device and receiving user input therefrom). Data generated at the client device (e.g., a result of a user interaction) may be received from the client device at the server.

[0104] Implementations of the subject matter described in this specification may be implemented in a computing system that includes a back-end component such as a data server, or includes a middleware component such as an application server, or includes a front-end component such as a client computer with a graphical user interface or a web browser through which a user can interact with implementations of the subject matter described in this specification, or any combination of one or more such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication, such as a communication network. Examples of communication networks include local area networks ("LANs") and wide area networks ("WANs"), intranets (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks).

[0105] The embodiments of the subject matter and operations described in this specification may be implemented in digital electronic circuits, or in computer software, firmware or hardware including the structures disclosed in this specification and their structural equivalents, or in a combination of one or more thereof. The embodiments of the subject matter described in this specification may be implemented as one or more computer programs, i.e., one or more modules of computer program instructions encoded on a computer storage medium, for execution by a data processing device or for controlling the operation of a data processing device. Alternatively or additionally, program instructions may be encoded on an artificially generated propagation signal, for example, generated to encode information for transmission to a suitable receiver device for execution by a data processing device. Machine-generated electrical, optical or electromagnetic signals. A computer storage medium may be or be included in a computer-readable storage device, a computer-readable storage substrate, a random or serial access memory array or device, or a combination of one or more thereof. In addition, although a computer storage medium is not a propagation signal, a computer storage medium may be a source or target of computer program instructions encoded in an artificially generated propagation signal. A computer storage medium may also be or be included in one or more separate physical components or media (e.g., multiple CDs, disks or other storage devices).

[0106] The operations described in this specification may be implemented as operations performed by a "data processing apparatus" on data stored on one or more computer-readable storage devices or received from other sources.

[0107] The term "data processing apparatus" includes all types of apparatus, devices and machines for processing data, including, for example, programmable processors, computers, systems on a chip, or a plurality of or a combination thereof. The apparatus may include dedicated logic circuits, such as field programmable gate arrays (FPGAs) or application specific integrated circuits (ASICs). In addition to hardware, the apparatus may also include code that creates an execution environment for the computer program in question, for example, code that constitutes processor firmware, a protocol stack, a database management system, an operating system, a cross-platform runtime environment, a virtual machine, or a combination of one or more of them. The apparatus and execution environment may implement a variety of different computing model infrastructures, such as web services, distributed computing, and grid computing infrastructures.

[0108] A computer program (also referred to as a program, software, software application, script, or code) may be written in any form of programming language and may be deployed in any form, including as a standalone program or as a module, component, subroutine, object, or other unit suitable for a computing environment, wherein the programming language includes a compiled or interpreted language, a declarative or procedural language. A computer program may, but need not, correspond to a file in a file system. A program may be stored in portions of a file that maintain other programs or data (e.g., one or more scripts stored in a markup language document) in a single file dedicated to the program in question, or in multiple collaborative files (e.g., files storing one or more modules, subroutines, or portions of code). A computer program may be deployed to execute on one computer or on multiple computers located at one site or distributed over multiple sites and interconnected by a communications network.

[0109] The processes and logic flows described in this specification may be performed by one or more programmable processors executing one or more computer programs to perform actions by operating on input data and generating output. The processes and logic flows may also be performed by special purpose logic circuits, and the apparatus may also be implemented as special purpose logic circuits, such as field programmable gate arrays (FPGAs) or application specific integrated circuits (ASICs).

[0110] Processors suitable for executing computer programs include, for example, general-purpose microprocessors and special-purpose microprocessors and any one or more processors in any type of digital computer. Typically, the processor will receive instructions and data from a read-only memory or a random access memory or both. The basic elements of a computer are a processor for performing actions according to instructions and one or more storage devices for storing instructions and data. Typically, a computer will also include one or more large-capacity storage devices for storing data, or be operably connected to receive data from the one or more large-capacity storage devices or transfer data to the one or more large-capacity storage devices, wherein the large-capacity storage device is, for example, a magnetic disk, a magneto-optical disk or an optical disk. However, the computer does not need to have such a device. In addition, the computer may be embedded in another device, for example, a mobile phone, a personal digital assistant (PDA), a mobile audio or video player, a game console, a global positioning system (GPS) receiver or a portable storage device (e.g., a universal serial bus (USB) flash drive), to name a few. Devices suitable for storing computer program instructions and data include all forms of non-volatile memory, media and storage devices, including, for example: semiconductor memory devices, such as EPROM, EEPROM and flash memory devices; magnetic disks, such as internal hard disks or removable disks; magneto-optical disks and CDROMs; and DVD-ROM disks. The processor and memory may be supplemented by, or incorporated in, special purpose logic circuits.

[0111] Oral hygiene equipment design

[0112] like FIG. 3A to FIG. 3C As shown in , the oral hygiene device 1 may include a handle 40 and a head 42, wherein the head 42 is removably connected to the handle 40. The handle 40 may include a motor that is mechanically connected to the head 42, and when the motor is activated, the head 42 is vibrated or moved in a manner to brush the user's teeth when the head 42 is placed in the mouth. The handle 40 includes a head interface 46 that removably attaches various heads 42 to the handle 40. The head interface 40 includes leads 48 for transmitting data and power to the various heads 42. For example, some heads 42 may include sensors that require power and data transmission, so power can be transmitted from the power supply of the handle 40 to the head 42 through the leads 48 that form a connection with the head 42 at the head interface 46. There may be various numbers of leads 48 that form a connection on the head interface 46, for example, there may be two leads 48 for power, two leads 48 for data, three leads 48 for power, three leads 48 for data, and other different numbers of leads. In some embodiments, the header interface 46 will form a watertight seal with the header 42 to prevent water from entering the interface and interfering with the transfer of power and data via the electrical leads 48 .

[0113] In some embodiments, most of the circuitry and expensive components may be included inside the handle 40 rather than in the head 42, which may be replaced after a certain number of uses. This will minimize the cost of replacing the head 42. For example, in some embodiments, the battery, controller 13 may be included in the handle 40, and any sensor probes and circuitry for connecting the sensor probes may be included in the head 42. In other embodiments, the head 42 may not include circuitry or electronic components, and will only provide mechanical brushing functions by supporting bristles.

[0114] For example, FIG. 8A to FIG. 8C As shown, the electronics and battery may be included in an insert 800 that can be easily slid into a conventional oral hygiene device 1. For example, the oral hygiene device 1 may include a chamber and a connector that can be connected to a base and an insert 800 that slides into the chamber, and the base forms a watertight seal with the connector. The insert 800 may be shaped in any manner (cylindrical, rectangular, or other) that will slide within the space of a toothbrush. In some examples, the base and connector will include a screw and thread mechanism for attaching the toothbrush. In some examples, the connector and base will include a press-fit configuration to facilitate connection and removal. For example, as FIG. 8A to FIG. 8C As shown in , a connection can be formed using a connector and opposing wings on a base.

[0115] In some embodiments, the oral hygiene device 1 may be just a standard toothbrush, or may be other standard oral hygiene devices 1 that are commercially available and may not have electronics or may only have electronics for moving the head to facilitate brushing. In some embodiments, the oral hygiene device 1 may only include a pattern 120 or an attachment 130 with a pattern 120, and may not include any motion sensing electronics, or may not include any electronics at all. Therefore, in these embodiments, visual tracking software may be used to determine the position and orientation of the oral hygiene device 1.

[0116] The oral hygiene device 1 may also include a speaker 50 and various visual indicators 52 to provide audio feedback and visual feedback to the user. For example, the handle 40 may include a speaker 50 for playing music, real feedback, motivational phrases, remaining time, suggestions on brushing pressure, suggestions on whether certain quadrants are not brushed sufficiently, notification of completion of brushing, etc. In addition, the oral hygiene device 1 may include any number of visual indicators 52 for providing real feedback on brushing including elapsed time, LED indicators for when brushing is complete, warning indicators for improper brushing including indicators for whether each quadrant has been visited. In other embodiments, the oral hygiene device 1 may also use bone conduction sound to convey audio messages to the user.

[0117] As shown in Fig. 6, the oral hygiene device 1 may include a handle 40 and a head 42, wherein either or both of the handle 40 and the head 42 may include a pattern 120 for visually detecting movement and orientation by an associated camera 9. For example, in some embodiments, the back of the head 42 may include a pattern (i.e., "AB" with circles and lines as shown). In other embodiments, the pattern 120 may be included on an attachment 130 that may be attached to the head or neck, applied to the bristles, or elsewhere.

[0118] The handle 40 may also include the pattern 120, or, in some embodiments, the handle 40 may be the only component that includes the pattern 120. The pattern 120 on the handle 40 may be applied directly to the handle 40, or may be located in an attachment 130 that is clamped or connected to the end of the handle 40. The pattern 120 may be located at a convenient location on the attachment 130 or on the handle 40 so that it can be detected at all angles of normal brushing activity. In some embodiments, the handle 40 may include multiple patterns 120 located on different sides for detecting different orientations. For example, in some embodiments, the attachment 130 may be square or circular and have a different pattern 120 on each side so that the system detects the orientation of the oral hygiene device relative to the camera.

[0119] The weight of the attachment 130 can be provided so that the oral hygiene device 1 stands on its own when placed on a flat surface. For example, a weight 130 can be applied to the bottom of the attachment 130 that is heavy enough to keep the oral hygiene device 1 upright. In some embodiments, this may be particularly useful if the bottom of the attachment 130 is spherical. This can make the oral hygiene device interesting, which is attractive to children and even adults.

[0120] The pattern 120 may be applied using paint, other marking processes, or may use a reflective coating, a mirror, or a fluorescent coating. In some embodiments, the pattern 120 may utilize color, or it may be a grayscale image.

[0121] Oral hygiene equipment without graphics or electronics

[0122] A standard oral hygiene device 1 or an oral hygiene device without any electronics or patterns may be utilized.As noted, in some embodiments, the position and movement of the oral hygiene device 1 will be detected.

[0123] sensor

[0124] The oral hygiene device 1 or a separate electronic device (e.g., an optical sensor) may include various sensors that detect certain attributes of brushing that can be analyzed to provide various feedback and other motivational information to the user. For example, one or more optical sensors 9 may also be utilized on a separate electronic device to detect the orientation and movement of the oral hygiene device 1. For example, the optical sensor 9 may be used to capture an image of the oral hygiene device 1, and the image may be sent for processing to identify its boundaries, shape, longitudinal axis, and orientation (e.g., by identifying its bristles). In some embodiments, one or more optical sensors 9 may be utilized to detect a pattern on the oral hygiene device 1, rather than detecting the oral hygiene device 1 itself. The one or more optical sensors 9 used for pattern detection may be oriented in a direction that provides a line of sight to a pattern 120 on the oral hygiene device 1, wherein the pattern 120 may be located on the head 42, the handle 40, or on the attachment 130.

[0125] As another example, the oral hygiene device 1 may include various motion sensors 11 to determine the brushing quality relative to certain quadrants of the mouth or even individual teeth. The motion sensor 11 may include a gyroscope, an accelerometer, a magnetometer, a gyrometer and other various sensors capable of detecting position, motion and acceleration. These various motion sensors 11 may be included in the handle 40 or the head 42. However, it may be advantageous to place the motion sensor 11 in the handle 40, because in some embodiments where the motion sensor 11 is located in the head 42, the motion sensor 11 may experience many additional movements that may interfere with the detection position (e.g., due to brushing and engaging with the teeth). In some embodiments, a magnetometer will sense one or more vectors of the earth's magnetic field. In some embodiments, a three-axis magnetometer will be used, and in other embodiments, a two-axis or one-axis magnetometer will be utilized.

[0126] The magnetic field generator 110 can also be used to generate a known magnetic field with a known polarity that can be sensed by a magnetometer incorporated into the oral hygiene device 1. The magnetic field transmitter 110 can be placed inside a base station 2 that already has a recharging coil and / or interface circuit 20, where the recharging coil and / or interface circuit 20 can be used to generate a detectable magnetic field. In other embodiments, the magnetic field transmitter 110 can be a separate electronic component in the base station 2 or a separate physical component entirely. In some embodiments, the magnetic field transmitter 110 will be located in a stationary unit with a known orientation.

[0127] The oral hygiene device 1 may also include various proximity sensors that detect the proximity of the oral hygiene device 1 to the user's mouth. These sensors may be included at the head 42 or in the handle 40. The proximity sensors may be used to obtain additional position information relevant to determining the quality of the user's brushing.

[0128] Additionally, oral hygiene device 1 may include pressure sensor 10 to determine if the user is applying appropriate pressure when brushing their teeth. Pressure sensor 10 may be incorporated into head 42, which may be more easily flexible or utilize a simple pressure sensor or other component capable of measuring pressure.

[0129] In some examples, the oral hygiene device may include a pH sensor 10. The pH sensor 10 may be used to determine the user's saliva pH. For example, in some examples, the user may be instructed to place the oral hygiene device 1 in the user's mouth to test the saliva pH before using toothpaste or mouthwash. Saliva pH may indicate periodontal disease or gingivitis.

[0130] In other examples, the oral hygiene device 1 or system 100 may also include a depth perception sensor. For example, in some examples, the depth perception sensor will project a laser grid or other laser pattern from the base 2, for example in place of the camera 9, and include a detector that will detect and analyze deformations in the pattern to determine depth. The depth perception sensor can be used to more accurately determine the outlines of individual objects for identification and motion tracking. For example, the system 100 may be able to more easily identify the head and facial features of a user and distinguish them from the oral hygiene device 1. Thus, the depth perception device can be used to determine motion in a plane parallel to the line connecting the base 2 to the user.

[0131] In some examples, the oral hygiene device 1 may also include a depth perception device. For example, in some examples, the oral hygiene device 1 may include a depth perception projector and sensors that project onto the user's teeth. This may be used to form a map of the user's teeth and detect holes or cavities in the user's mouth.

[0132] In some embodiments, the various heads 42 may include a camera 56 that will detect various aspects of tooth quality that may or may not be related to brushing quality. For example, a camera 56 including a near infrared camera 56 may be used on the oral hygiene device 1 to collect data indicative of demineralization or caries or cavities. For example, the oral hygiene device 1 may utilize certain wavelengths that are particularly suitable for detecting these abnormalities, such as wavelengths in the range of 1300nm to 1400nm. In some embodiments, the oral hygiene device 1 may also include a light source 58 that will be focused toward the teeth during brushing and can be used by the camera to detect certain abnormalities.

[0133] In some examples, the system 100 may utilize the output of the camera 56 to form a tarter map of the user's mouth. For example, in some examples, the system 100 may utilize images from the camera 56 to identify tarters based on reflected wavelengths, and construct a schematic or other representation of tarters for the user's mouth. For example, the camera 56 may utilize specific wavelengths and / or filters that more easily reflect tarters, and identify which areas of the mouth have more or less tarter areas or other problems. For example, tarters may cause less light reflection, and may also reflect different wavelengths. As described in further detail below, these different patterns may be filtered or detected by the system through a machine learning algorithm.

[0134] Certain cameras 56 and possibly light sources 58 may also be implemented to detect the level of plaque on the teeth and changes in plaque levels during brushing. In certain embodiments, an infrared or near infrared light source 58 and an appropriate camera 56 that detects and records light in this wavelength range may potentially allow for the detection of plaque.

[0135] Program for brushing analysis and feedback

[0136] The various sensors and optical sensors of the system can collect data related to the quality of the user's brushing or the overall dental health of the user's teeth. Then, the data can be processed using programs or applications installed in various parts of the oral hygiene device monitoring system 100. Therefore, as described above, the data from the sensors and optical sensors can be processed by a program executed by the control system 13 of the oral hygiene device 1, or alternatively, by a program executed by a processor on a mobile device 30, another related computing device or server 4. The processing and analysis of the data by the system 100 will produce output data representing feedback related to the quality of the user's brushing. The feedback can be communicated through the speaker 50 of the oral hygiene device 1 through audio feedback, visually communicated on the indicator 52 of the oral hygiene device 1, or both audio feedback and visual communication on the associated mobile device 30 or when accessing a website hosted or communicating with the server 4.

[0137] Figure 4An example of a process by which an oral hygiene device 1 evaluates the brushing quality of a specific user is shown. Not every step may be required in a specific embodiment, but different combinations of these steps may be implemented in the oral hygiene device monitoring system 100. First, a user may input a user profile 70 into the oral hygiene device monitoring system 100 to allow the user to calibrate the oral hygiene device 72. In some embodiments, the oral hygiene device 1 may be calibrated at the factory, by the user, or both. After calibration, the user may pick up the oral hygiene device 1 and begin brushing her teeth. The oral hygiene device or an associated monitoring device (e.g., a camera) will then determine that brushing is initiated 74 and begin recording sensor data 76 during brushing. The oral hygiene device monitoring system 100 may then analyze the sensor data 78 to output brushing quality feedback 80 to the user.

[0138] User Profiles

[0139] Thus, a user profile 60 may be entered 70 for each specific user of a particular oral hygiene device 1, or associated with a specific account stored on a server 4 within an oral hygiene device, base station, or other computing device. Upon initialization of a new oral hygiene device or a new account on the server 4, the user may enter information that they may use to determine optimal brushing times and characteristics. For example, the program 15 may first request the user's name, gender, height, weight, age, and certain questions about their dental history. The user profile 60 may then be associated with certain data recorded during the user's use of the oral hygiene device, or may be generic and applicable to any oral hygiene device 1 or optical sensor 9 connected to the system 100, wherein certain data includes calibration data specific to a particular oral hygiene device 1, associated optical sensor 9. In some embodiments, the user may upload their own pictures, or may initiate a program that uses one or more optical sensors 9 to capture pictures of the user from the distance at which the user typically brushes.

[0140] Detection and use

[0141] The toothbrushing monitoring system 100 can also determine whether use has occurred and the number of uses per day. In some embodiments, the oral hygiene device 1 and / or the optical sensor detection system detects motion data through the motion sensor 11 and / or the optical sensor 9 and analyzes the data to determine whether use has occurred, or whether the brush has been moved or the use is false.

[0142] When motion indicative of use is detected, the oral hygiene device 1 or optical sensor device 9 may store the position and motion data in its memory 14 for later analysis. This will prevent false positives from being recorded, such as when a user moves a brush in a medicine cabinet, or prevent a child from circumventing the system by briefly shaking the toothbrush, for example.

[0143] For example, the motion indicating use may be associated with a determined acceleration level and / or frequency that is characteristic of a particular user. In other embodiments, the user may press a button or switch on the oral hygiene device 1, the base station 2, or a device having an optical sensor 9 to wake up the sensor on the device, which will then begin recording data. Thus, the system will determine when to start brushing teeth 74. In some embodiments, this will be performed automatically, for example, after certain accelerations and frequencies are detected. Thus, once the user picks up the toothbrush, the motion sensor 11 may begin recording data 76 and send it to any of the various control systems 13 in the system 100, which will be analyzed 78 for characteristics associated with brushing teeth.

[0144] For example, the oral hygiene device 1 will typically rest on its base 2 pointing upward before use, and its orientation is not suitable for the user holding the oral hygiene device 1 to brush their teeth. Therefore, once the user picks up the oral hygiene device 1, the oral hygiene device 1 will typically rotate about 45 degrees to remain primarily horizontal during brushing. Therefore, a threshold criterion for determining the start of brushing 74 is whether the oral hygiene device 1 has been tilted within a certain angle range indicating that the oral hygiene device 1 is horizontal or close to horizontal. This can be an angle range of 20 degrees, 5 degrees, 10 degrees or other suitable ranges. In addition, a suitable range can be indicated during a series of calibrations. Of course, this can be detected by the optical sensor 9 and / or the motion sensor 11.

[0145] In some embodiments, the user may turn on the device and the optical sensor 9 (and / or depth sensor) may begin recording. The system may then check to determine when the pattern 120 is at a determined height indicating that it is close to the user's mouth. This may be combined with the acceleration information detected by the one or more optical sensors 9 and analyzed by the motion sensor 11 as described above.

[0146] In other embodiments, the system 100 may use statistical analysis of the motion data from the motion sensor 11 and / or the optical sensor 9 to perform a determination of whether brushing has been initiated 74 and whether brushing has stopped. The statistical analysis may be performed by correlating the data from the motion sensor 11 and / or the optical sensor 9 with previous brushing or calibration data or data stored from other users. For example, after performing the analysis, a determination threshold of correlation of the motion data with previously recorded calibration data associated with use may be determined, which indicates that brushing has been initiated 74 or is in progress. Thus, once the user begins brushing, the system 100 may record that use has been initiated 74 and record the data 76 in the memory 14 as brushing data until use ceases, such as after the correlation falls below the determination threshold.

[0147] For example, using an optical sensor 9 system arrangement, the optical sensor 9 can output data including an image of an oral hygiene device (e.g., a toothbrush or water flosser) and a user. The data can be sent to various control systems for processing and analysis of the motion. For example, an image processing algorithm can first determine boundary conditions to identify the boundaries of the user's lips / mouth, teeth, head, oral hygiene device, handle, toothbrush head, bristles, water flosser, etc.

[0148] The boundaries of human features can be utilized using standard boundary recognition algorithms, which typically utilize threshold changes in certain colors (frequency of light). Once the boundaries of the oral hygiene device 1 are identified, the longitudinal axis can be identified, and potentially the orientation of the bristles (if it is a toothbrush) to determine the angular orientation about the longitudinal axis. This will allow the system to determine the general orientation and movement of the toothbrush using time-stamped frames from the imaging device.

[0149] Then, by analyzing the relative position of the toothbrush and the characteristics of the mouth, the toothbrush can be identified as being on a certain side of the mouth. In addition, the orientation of the toothbrush relative to the side of the mouth on which it is located can be used to determine which section or portion of the user's teeth is being brushed or washed. For example, when brushing the bottom of the upper molars on the right side, the visual system will determine that the toothbrush is on the right side of the mouth with the bristles facing up.

[0150] Additionally, once the profile and orientation of the toothbrush 1 in each frame is determined, the timestamps of each frame can be used to determine the motion of the toothbrush. For example, the change in position (time and distance) can calculate the speed and acceleration of the change. Thus, as with the motion sensor 11, the image data can be used to determine the motion of the oral hygiene device. Thus, as further disclosed herein, the motion can be used to determine compliance with brushing or other oral hygiene standards.

[0151] Analysis of the motion data (processed from the motion sensor 11 or image data from the optical sensor 9) may utilize a fingerprint or signature type analysis that compares only relative motion. The signature may be determined based on acceleration in certain axes (as detected by the motion sensor 11, time stamped image data, or other methods) because the motion of brushing teeth is typically performed in a relatively rapid motion, which is an atypical characteristic of any other occasional motion of the oral hygiene device 1 (e.g., putting it back in the cabinet). Additionally, the frequency of brushing teeth may be monitored, because brushing teeth is typically a rapid periodic motion, and therefore various bandpass frequencies, low pass and Kalman filters or other techniques may be used to identify certain frequencies and amplitudes of interest among those frequencies indicative of brushing teeth.

[0152] These amplitudes in frequency may be certain frequencies that reach a threshold amplitude, associated or determined to indicate that the user is brushing their teeth. For example, the system 100 may require certain frequencies in the horizontal or vertical axis to determine that brushing has been initiated 74, or the system may require certain periodic accelerations that reach certain thresholds to determine that brushing has been initiated 74. In some embodiments, this may be a frequency of 1 Hz to 5 Hz. Once the data analyzed by the controller 13 is below a determined threshold indicating use, the system 100 may stop recording data or determine that brushing has stopped.

[0153] In addition to statistical analysis, the system can also detect motion indicative of use or actual brushing by using filtering and threshold analysis. For example, the system 100 can first filter the data from the motion sensor 11 to only pass frequencies in a certain band (because brushing is periodic), and monitor those frequencies to detect when the signal reaches a threshold for at least a certain number of cycles or durations as one of them to determine that the user is brushing. For example, if the user brushes their teeth at an average frequency of 1 Hz to 5 Hz (or perhaps less in the case of an electric toothbrush), a 1 Hz to 5 Hz bandpass filtering can be implemented.

[0154] Thus, when the system 100 detects that the amplitude of the frequency band in the range of 1 Hz to 5 Hz reaches a threshold indicating use, the controller 13 may begin recording data from the sensor in the memory 14 for a duration of motion data indicating that the oral hygiene device 1 is being used. Additionally, periodic accelerations on certain axes or angular accelerations reaching a certain threshold amplitude (for circular brushing) may also be used to indicate that brushing has been initiated. Analysis of the data may also be affected by whether the oral hygiene device 1 includes an electronic motor for vibrating the head to assist in brushing. In these embodiments, the data may be filtered to eliminate high frequency accelerations and other noise generated by the electronic motor.

[0155] Quality of brushing - type of movement

[0156] In some embodiments, the quality of brushing can be determined based on the type of motion the user performs with the oral hygiene device 1. Dentists have indicated that certain motions are more or less beneficial for brushing teeth. Different types of motions include circular motions, clockwise and counterclockwise motions, motions from tip to root, and motions from left to right.

[0157] In some examples, the system 100 can determine whether it is the length of a brushing stroke. This can be done by any combination of the disclosed methods, including by determining the magnitude of acceleration and the acceleration time in each stroke direction. For example, the strokes can be filtered out by identifying regular patterns or filtering at certain frequencies and magnitudes. For example, a certain amount of acceleration in certain directions relative to the toothbrush may indicate a brushing stroke.

[0158] Most brushing will be done in the plane of the bristles, as the stroke will be optimized to bring the tips of the bristles into contact with the teeth using the brushing motion. Therefore, the system can filter out accelerations in the plane of the bristles or within a suitable tolerance to further identify accelerations or motions related to the brushing stroke.

[0159] The system 100 can determine whether the motions are performing relative amounts of those motions by filtering the data from the motion sensor 11 or the optical sensor 9 indicative of the respective motions in certain axes. For example, the data from the motion sensor 11 or the optical sensor 9 can be filtered in an axis horizontal to gravity, and the control system 13 or other system 100 processor can process the data to determine whether the acceleration, frequency, or other motion data reaches a large enough amplitude in a certain direction to indicate that a specific motion is being performed.

[0160] In the case of image data, in addition to detecting a threshold value indicating acceleration or speed of brushing, the optical system can also detect when the oral hygiene device 1 is within a certain proximity of or within the user's mouth to determine that brushing has been initiated. For example, if the head can be identified, the system can very reliably determine that the user is brushing his or her teeth as long as the head is within the area defined as within the user's mouth.

[0161] In other examples, acceleration alone may be used to determine whether a back-and-forth motion or a circular motion is being used. In other embodiments, acceleration data from the motion sensor 11 may be integrated to determine the actual motion of the oral hygiene device 1 to assess the type of brush stroke being utilized. Analysis of the data may also be affected by whether the oral hygiene device 1 includes an electronic motor for vibrating the head to assist in brushing. In these embodiments, the data may be filtered to eliminate high frequency acceleration and other noise generated by the electronic motor.

[0162] In some embodiments, an electric motor for vibrating the head 42 may be included in the oral hygiene device 1. In those embodiments, the motion data recorded by the sensor related to the brushing motion will have a smaller amplitude than for a manual brush 1. This is because users of manual toothbrushes will brush their teeth with more vigorous motions without the assistance of an electronic motor and moving the head 42. Therefore, the algorithm used to analyze the motion data to detect the use, movement, and position of the oral hygiene device will be modified to account for the lower amplitude and / or different movements, as well as to include filtering high-frequency noise from the motor. Therefore, in some embodiments, the threshold set for the amplitude required to detect or indicate a brush stroke will be smaller because users of electronic oral hygiene devices generally move the brush at a slower speed and with more linear motions.

[0163] In addition, the pressure sensor 10 can also be used to determine whether brushing is actually performed, or combined with motion data from above. For example, the user may be moving the oral hygiene device 1 instead of pressing on the teeth. Therefore, accordingly, a certain frequency, amplitude or characteristic movement, as well as a certain pressure, are required to eliminate many false alarms caused by accidental movement or pressure of the brush that did not occur during brushing. Therefore, the pressure sensor 10 can output a signal analyzed 78 by the controller 28 to determine the pressure applied to the teeth. If the pressure is higher than a certain threshold, the system 100 can indicate or determine that the user may be brushing his teeth. The analysis can be performed by statistical analysis, threshold analysis or other suitable calculation methods to determine the possibility of brushing based on the amount and / or continuity of the pressure recorded by the pressure sensor 10.

[0164] In some examples, the system 100 and toothbrush 1 can develop a library of specific types of brushing strokes or motions, and provide user feedback about the brushing strokes or motions performed by the user to brush their teeth. For example, the system can maintain a dictionary of motion types for brushing teeth and rank the motion types and the quality of each motion type.

[0165] Examples of motion types can be as follows:

[0166]

[0167] Identification of specific users

[0168] The system 100 may include a stored user profile associated with the user's stored brushing (or other oral hygiene) data and the user's demographic data, wherein the user's demographic data includes the user's age, size, and gender. During or after the step of monitoring oral hygiene (e.g., brushing) activity, the oral hygiene device 1, mobile device 30, or server may automatically seek to match a user with at least one user profile using at least one predetermined rule or algorithm based on the user profile and past data. If the user is not a regular user of the oral hygiene device, the user identifies him / her as a visitor on the mobile device.

[0169] In the step of user identification, a specific user may be associated with the oral hygiene device and assumed to be the user. If multiple users of a given oral hygiene device are utilized, the user is associated with the brushing activity at least in the oral hygiene device and possibly in the mobile device and / or server, at least for reference purposes in the latter two.

[0170] In an embodiment utilizing a camera, a user profile may have a picture of the user uploaded or associated with the profile. This will allow a vision-based recognition system to automatically determine the specific user associated with the profile. In some examples, the system 100 may capture pictures with a camera and identify the specific user by comparing the initially captured picture with each user who initiates brushing. In some examples, the system may determine the user by the position of the user on the camera's frame (e.g., by estimating the user's height or relative height). In other examples, the system 100 may utilize machine learning and computer vision principles to match the user's features and determine which saved user (and associated user profile) is currently brushing. For example, eye color or other facial recognition techniques may be used to match users on a reliable basis, especially when there are only 2, 3, or 4 users to be distinguished per unit.

[0171] In other examples, usage data associated with a specific user may be used to identify the user. For example, usage data for a specific user may be associated with a determined level of acceleration and / or frequency that is characteristic of the user. For example, a specific user may have a determined range of brushing frequencies, or may start on a specific side of the mouth. In some examples, a combination of physical features, motion data, or other indicators may be used to identify users and associate them with their profile data.

[0172] Monitoring the use of replaceable heads

[0173] In addition, the total number of uses of the head 42 of the replaceable oral hygiene device 1 can be detected and stored in the memory 13 of the oral hygiene device 1 or associated with the server 4 to monitor the useful life of the head 42 of a single oral hygiene device 1. Thus, once the head 42 of a particular oral hygiene device 1 has been used a certain number of times or for a certain duration, the system 100 can provide a notification to the user, such as on their mobile device 30 or through a web interface to the server 4. Once the head 42 has been obsolete, the user will disconnect the head 42 and reconnect a new head 42, which can be interpreted or recorded by the system 100 as attaching a new oral hygiene device 1. In addition, each head 42 can include a unique identity module 62 that stores an identifier for that particular head 42, so when the same head 42 is reattached, for example, for cleaning or other purposes, the system 100 will not assume that a new head 42 has been attached.

[0174] When and where to brush your teeth

[0175] Next, the brushing data recorded above can be analyzed 78 to provide feedback 80 on the position and time quality of brushing. This can be presented after brushing is completed, or presented in real time to provide immediate feedback to the user. For example, the motion sensor 11 and / or the optical sensor 9 can detect position information of the oral hygiene device 1. Using accelerometer and gyrometer data, visually detected data from the optical sensor 9 and the pattern 120 or other motion sensor 11, the position, orientation and movement of the oral hygiene device 1 can be determined and extrapolated to calculate the relative position movement of the head 42. For example, if the distance, orientation and direction of the motion sensor 11 to the bristle portion of the head 42 are known, the system 11 will be able to determine the position of the head 42 and its relative movement, orientation and coverage area based on the relative movement of the motion sensor 11.

[0176] This may be calculated by initially calculating a reference coordinate at which the oral hygiene device 1 detects motion, and recording the relative motion relative to one or more initial coordinates to determine a brushing signature. This may be performed by calculating the motion of the head 42 by calculating changes in the orientation and motion of the brush due to acceleration recorded by a gyrometer or accelerometer or visually detected by the optical sensor 9. These calculations may be performed by the control system 13 or other processor utilized in the system 100, including a mobile phone processor executing an application on a mobile phone, or one or more processors on a server running software for analyzing the data.

[0177] Brushing time and location - magnetometer

[0178] In some embodiments, the magnetometer sensor 11 can provide additional location information by detecting the polarity, direction vector and strength of the earth's magnetic field and / or the magnetic field generated by the magnetic field transmitter 110. In some embodiments, this can be a magnetic field transmitter 110 located in the base station 2, because the base station 2 is stationary and the magnetic field transmitter 110 will have a known polarity and direction (e.g., horizontal or vertical and located in a certain direction). This can be detected by the magnetometer 11 positioned in the oral hygiene device 1. Therefore, the strength of the magnetic field detected by the magnetometer sensor 11 will give an estimate of the distance of the oral hygiene device 1 from the base station 2 along a spherical or elliptical curve or egg-shaped curve representing the magnetic field lines around the base station 2 or other associated devices.

[0179] In addition, the magnetometer will be able to sense the vector direction of the magnetic field along the magnetic field line. In other embodiments, the distance of the oral hygiene device 1 from the base station 2 can be calculated using the following: the magnetic field orientation detected by the magnetometer sensor 11 and emitted from the magnetic field transmitter 110 and the attitude information of the accelerometer and gyroscope. This can use the shape of the magnetic field and its vector at a specific distance from the transmitter and the knowledge of its polarity. For example, the inclination of the magnetic field relative to gravity will change predictably at, for example, different distances from the magnetic field transmitter. In addition, by comparing the gravity vector with the vector of the magnetic field, the angle can be used to calculate the height along the shell or magnetic field line. This is because at each height, the angle of the field relative to gravity will be different, because the eggshell will be guided at different angles relative to gravity at each height. This will be particularly correct when the north and south poles are oriented in the vertical direction, so that the magnetic field lines have a component that changes from a horizontal level near the bottom and top of the eggshell to a vertical component near the height of the transmitter.

[0180] Thus, magnetometer data combined with accelerometer data and / or optical data may be used to determine the position of the oral hygiene device 1 within a ring that lies in a horizontal plane with equal magnetic field strength around the transmitter 110. For example, Figure 5 An embodiment of a base 2 is shown, which has a single coil magnetic field transmitter 110, wherein the magnetic field transmitter 110 generates a shell with a portion of a B (magnetic) field vector that changes direction in a vertical plane. The sensor 11 on the oral hygiene device 1 may include a magnetic field sensor 11 and an accelerometer 11, wherein the magnetic field sensor 11 is used to detect the magnetic field generated by the magnetic field transmitter 110, and the accelerometer 11 detects gravity acceleration a in addition to other accelerations. g Therefore, the magnetometer 11 on the oral hygiene device 1 can be positioned using the B field generated by the transmitter 110. Therefore, the magnetic field strength and direction (B t ) can be determined by the magnetometer 11. At the same time, the accelerometer 11 can detect the acceleration from gravity as a vector a g The system 100 can analyze this data and determine the gravity vector a g With magnetic field vector B t Q between o .

[0181] Then, the angle Q o can be used to determine a loop R where the location of the oral hygiene device 1 is known to be at some point along the loop R. For example, first, the strength of the magnetic field B detected by the magnetometer 11 can be used to determine on which magnetic egg or annular shell (e.g., B1, B2, or B3) the oral hygiene device is located. This will narrow the location of the oral hygiene device 1 to the hollow shell or annulus around the transmitter 110. Next, Q oThe system 100 and data processing techniques can be normalized to calculate the vertical position on the shell or ring and thus narrow the position to a ring R around the transmitter 110. Therefore, if the system 100 detects movement to a new ring R, the system will have information about the possible direction and distance traveled. This information will be enhanced by accelerometer data, which will provide further information about the direction of travel. For example, this can provide some upper or lower limits on the direction of travel and / or distance traveled of the oral hygiene device 1. Thus, the system 100 and data processing techniques can be used to provide relative position and movement information of the oral hygiene device 1 and applied to determine the brushing position in the mouth as described herein.

[0182] In some embodiments, the magnetometer sensor 11 can sense the magnetic field emitted by the magnetic field transmitter 110. To do this, these magnetic field data must be filtered out from external noise and in particular from the earth's magnetic field. The earth's magnetic field will have a relatively constant strength and direction at a given position within the scale of the toothbrush's movement. In addition, the earth's magnetic field is very large, and most magnetometers are calibrated according to the scale of the earth's magnetic field. Therefore, in order to use a magnetometer calibrated for the earth's magnetic field, for example, in an embodiment in which both the magnetic fields of the earth and the transmitter 110 are detected to calculate orientation and position changes, some filtering algorithms must be used to distinguish between the two. In some embodiments, the key data that can be used to filter the two is that the intensity of the earth's magnetic field remains relatively constant on the scale of the oral hygiene device movement compared to the magnetic field changes emitted by the magnetic field transmitter 110. Therefore, a time filter can be applied to distinguish the two magnetic fields. In some embodiments, the magnetic field emitted by the transmitter 110 can be pulsed with a specific frequency or amplitude so that it can be easily filtered out using signal processing and data analysis.

[0183] In some embodiments, the magnetic field direction component of the vector data output from the magnetometer 11 can also be used to calculate relative position changes and / or orientation. For example, in some embodiments, the transmitter 110 can transmit a magnetic field having a magnetic field direction component. Figure 5 . The direction or vector information detected by the magnetometer from the magnetic field B generated by the transmitter 110 can be used to provide orientation and or relative position information. This data can then be combined with the data from the direction vector information detected from the earth's magnetic field, which will likely have an orientation different from the orientation of the earth's magnetic field. Therefore, the magnetometer 11 can detect a vector indicating the direction of the earth's magnetic field and a vector of the magnetic field of the transmitter 110 to provide a reference for spatial orientation and position changes.

[0184] In one example, a magnetometer sensing the earth's magnetic field can sense the orientation of the oral hygiene device 1 in a horizontal plane, such as Figure 5, or about the Z-axis or compass as shown in . In some embodiments, this may include not only a vector in the horizontal direction, but also a vector in the vertical direction, which will be constant and based on the inclination of the earth's magnetic field at a specific geographic location. In other embodiments, the transmitter 110 may be placed at a diagonal, horizontal, vertical, or other known orientation used as a reference point to calculate the orientation of the magnetometer 11 and the change in position of the magnetometer 11 and the oral hygiene device 1.

[0185] Additionally, calibration may be required based on the relative orientation of the oral hygiene device 1 when used by the user and the relative orientation of the magnetic field transmitter 110 of the base station. When the shape and orientation of the magnetic field lines change based on the position relative to the magnetic field generator, different formulas, calibrations, or adjustments may need to be performed. For example, near the side of the magnetic field generator, the magnetic flux lines may be oriented in a first direction; however, near either polar end of the transmitter 110 (e.g., above or below, or right or left), the magnetic flux lines may be oriented perpendicular to the first direction near the side or middle of the transmitter 110. Additionally, the user may be asked to brush her teeth at a determined distance from the transmitter 110 to ensure that an appropriate magnetic field for measurement is generated at that location. A beneficial aspect of the coil being physically oriented in a vertical direction is that the magnetic field generated on all sides of the transmitter 110 (and by proxy, the base station 2) assuming the same relative height is relatively the same, so calibration may require a simpler algorithm and / or process. However, if the coil is located in a horizontal plane, the magnetic flux lines may travel in different directions depending on the orientation of the base station 2. In this embodiment, the user may be instructed to rotate the base station 2 to point it in a determined direction of the user relative to where the user normally brushes their teeth. In other embodiments, the calibration may be able to utilize or accommodate changes in the vector direction of the magnetic field emitted by the transmitter 110 .

[0186] Data from the magnetometer 11 may be combined with data output from the accelerometer 11 or data from the gyrometer 11 and accelerometer 11 or optical sensor 9 to determine orientation and / or position. For example, the accelerometer 11 and / or optical sensor 9 data may be first used to determine the orientation of the oral hygiene device 1 relative to gravity during relatively small accelerations, whereby the acceleration due to gravity will be detected by the three-axis accelerometer or image analysis, and thus it may be determined whether the oral hygiene device 1 is tilted about a lateral axis in a horizontal plane, or how it is rotating about its longitudinal axis (the longitudinal axis running longitudinally through the toothbrush) relative to the gravity pointing downward toward the earth.

[0187] If the accelerometer data indicates that the oral hygiene device 1 is experiencing a relatively small amount of acceleration relative to normal brushing motion, the control system may determine that the oral hygiene device 1 is relatively stationary and may utilize the accelerometer data to determine a vector oriented in the direction of gravity.

[0188] If the accelerometer data is combined with the gyroscope data, the deviation of the posture of the toothbrush relative to gravity can be determined to calculate the posture of the toothbrush. For example, then, the initial record of the gravity vector can be used as a reference vector to determine the posture. Then, the deviation from this initial position or posture determined by the accelerometer and gyroscope can be determined based on the gyroscope data by calculating the directional change from the initial reference vector. Therefore, the accelerometer or accelerometer and gyroscope data can be used to determine which direction the bristles are facing. For example, in some embodiments, the accelerometer and gyroscope data can be analyzed to determine whether the bristles are facing up or down, forward, left and right, thereby potentially narrowing down to a specific quadrant or other partition of the mouth. For example, when the bristles of the oral hygiene device 1 face down, they can only brush the top of the lower teeth. If the bristles of the oral hygiene device 1 face up, it can only brush the crowns or tips of the upper teeth. As another example, when the oral hygiene device 1 faces right, it can only brush the left side of the molars, etc. Additionally, in some embodiments, orientation relative to gravity will be deterministic, since the vector representing gravity will always point toward the floor or earth, and brushing teeth will most likely be performed while standing.

[0189] Thus, the orientation of the bristles relative to the teeth can be determined in some aspect or plane of orientation. In certain embodiments, these calculations can be deterministically performed or estimated using a statistical and / or improved model of the mouth. For example, if the accelerometer senses that the bristles of the toothbrush are facing downward within a certain error range or within a statistically significant edge, the system can determine that the surface being brushed is likely the top of the lower teeth (or, for example, the tongue). In other embodiments, as disclosed herein, the brushing orientations can be calculated relative to each other, so a model of the mouth can be fitted each time the user brushes their teeth.

[0190] In order to determine the orientation in the horizontal plane perpendicular to gravity, the earth's magnetic field or a magnetic field generated, for example, by a transmitter 110 of the base station 2 can be used. In some embodiments, the magnetic field transmitter 110 will generate a magnetic field with a direction vector that changes direction in the horizontal plane perpendicular to gravity. Therefore, even if the absolute direction is unknown, the relative orientation of the oral hygiene device 1 relative to the magnetic field detected by the magnetometer 11 and emitted by the transmitter 110 can be determined in the horizontal plane. Therefore, the relative change of the orientation in the horizontal plane can be determined, and the path of movement along the reference coordinate system can be determined. In some embodiments, the reference coordinate system can be based on one of the initial data points or any other data points recorded during brushing. As disclosed herein, these relative changes can be used to calculate the position or reconstruct the shape by using the relative position after the user has finished brushing.

[0191] In some embodiments, data from gyroscopes, magnetometers, optical sensors, and accelerometers can be used to determine orientation relative to gravity and either or both of the magnetic fields of the earth and the transmitter 110. In some embodiments, orientation can be determined and confirmed or verified by a different sensor 11 or optical sensor 9. For example, the angular velocity from the gyroscope can be integrated to determine changes in orientation in certain directions, but the magnetometer readings and / or optical sensor 9 data can be used to correct errors from the integration. In other embodiments, any or both of the magnetometer, gyroscope, and multiple magnetometers can be utilized in various combinations to determine orientation.

[0192] In some embodiments, orientation alone may be utilized to determine the position of the oral hygiene device 1 using statistical analysis as disclosed herein. In other embodiments, inertial changes detected by the gyrometer and / or accelerometer may be used in conjunction with or separately from the readings of the magnetometer 11 to provide further indications of motion or distance to calculate an estimated position of the bristles of the oral hygiene device 1. In some embodiments, the orientation information may be combined with data output from the sensor 11 or the optical sensor 9 indicating translational inertia or position changes. Depending on the position of the inertial sensor, the orientation information may be combined with the inertial motion data to indicate the position of the bristles. For example, if the motion sensor 11 is positioned within the oral hygiene device 1, but in the middle of the longitudinal axis of the toothbrush that the user will hold the oral hygiene device 1, a change in orientation will move the position of the head without moving the position of the motion sensor 11 (although the motion sensor 11 may be rotated in situ). Therefore, the orientation information can also be used to calculate the spatial position of the bristles relative to the position of the sensor 11.

[0193] Movement or position changes can also be calculated from the data output by the magnetometer 11. In some embodiments, the magnetometer 11 can detect the magnetic field generated by the magnetic field transmitter 110 in the base station 2 or another stationary component separate from the oral hygiene device 1. In this embodiment, the strength and orientation of the magnetic field sensed by the single-axis magnetometer, two-axis magnetometer, or three-axis magnetometer 11 can provide additional data about the position movement of the oral hygiene device 1 relative to the magnetic field transmitter 110 in the base station 2, where the base station 2 is fixed and stationary. Therefore, an increase or decrease in the magnetic field will indicate that the oral hygiene device 1 is moving toward or away from the base station 2. In addition, changes in the orientation or inclination of the magnetic field and the polarity output by its magnetometer 11 can be used to determine translation and position. Based on calibration or test data, this information can be used to determine how much per unit change in magnetic field strength is equal to the distance based on the direction of movement (because different directions through the magnetic field will have a higher or lower rate of change). In other embodiments, the per unit change in the inclination or shape of the magnetic field can also be related to the change in position. Each time an oral hygiene device system as disclosed herein is established, including such a system incorporating a magnetometer in the base station 2, the corresponding orientation of the horizontal magnetic field may be different. This is because how each user stands while brushing their teeth, and / or how the base station 2 is oriented on the counter top may change for each user, and may even change each time or after cleaning the countertop, etc. Therefore, adaptive statistical analysis may be used to determine the relative positions of the bristles of the oral hygiene device 1.

[0194] Position data calculated from magnetic field data output from the magnetometer 11 can be combined with inertial data to calculate position changes in the oral hygiene device 1. In some embodiments, inertial data can be used to calculate the distance traveled, and the magnetometer data can also be used to eliminate errors and / or provide limits on the calculation of position changes based on the inertial data. For example, assuming direct perpendicularity to the maximally compressed magnetic field lines, the change in magnetic field strength can have a certain minimum lower limit. Given a certain change in magnetic field strength, it can be determined that the magnetometer has traveled at least a certain Euclidean distance in space (or changed a certain angular orientation). These changes in inclination and field strength can be used to determine distance changes within certain error ranges that can be supplemented or fine-tuned based on accelerometer or gyroscope data. This data can be combined with orientation and inertial data to determine a more accurate travel distance and relative direction travel of the oral hygiene device 1. Brushing Time and Position - Visual Pattern Recognition

[0195] In some embodiments, the movement of the oral hygiene device 1 can be tracked using an optical sensor 9 and a pattern 120 recognition system. For example, as described above, the oral hygiene device 1 can include a pattern 120 on the handle 40 or the head 42, which can be recognized by a visual tracking system. The visual tracking system can be capable of recognizing the orientation, distance, and position of the pattern 120 on the oral hygiene device 1. For example, in some embodiments, the pattern 120 can be located on the head 42, and a separate pattern 120 can be located on the handle 40 to allow the system to determine the position of both the handle 40 and the head 42 of the oral hygiene device 1, thereby assisting in determining the orientation and movement. Visual pattern recognition has been used to detect the movement and orientation of markers, such as the system described in "Towards Positioning through Visual Markers" by Bernhard L. Ecklbauer, the disclosure of which is incorporated by reference in its entirety. For example, image processing software can identify the boundaries of the oral hygiene device through standard boundary image identifiers, identify the appropriate size and size of the object, toothbrush, and then attempt to determine the orientation of the oral hygiene device (or determine the pattern 120 and the orientation of the oral hygiene device, respectively).

[0196] In some embodiments, the visual pattern recognition system can also be used to determine the position and orientation of a person's face. This is useful for comparing the relative position and orientation of the face and / or mouth and the oral hygiene device 1 to determine the position of the oral hygiene device relative to the mouth. In some embodiments, the system may first acquire an image with the oral hygiene device 1 at the same distance from the optical sensor 9 as the person's face. In addition, an initial calibration using the orientation and size of the face can be used to calibrate the distance from the camera 9 to the oral hygiene device 1, so the size and movement can be estimated. In some embodiments, since the size of the oral hygiene device 1 is known, the relative size of the face using the oral hygiene device 1 can be determined to calibrate or estimate the jaw shape and size and modify the algorithm used to determine which area is being brushed.

[0197] For example, if the system can be used to determine the position and orientation of the face, the system can determine whether the oral hygiene device 1 is in the mouth or near the mouth. This will help the system verify and confirm when use starts and stops, because the oral hygiene device 1 will only be used near the user's mouth when it is actually used. Few users will keep the brush near the mouth when the user is not actually brushing their teeth. Instead, users usually wash / put down the oral hygiene device as soon as they finish brushing their teeth.

[0198] Thus, the data detected by the camera can be evaluated to determine the position, movement, and orientation of the oral hygiene device 1. For example, the oral hygiene device 1 may have a code "AB" having a circle and a line as shown in FIG. 6 or located on the back of the head 42, or on the handle 40, or on both. In some embodiments, the pattern 120 may be any other pattern 120 with a different orientation as described herein. The camera 9 can detect the pattern, and the data can be retrieved for processing and analysis. For example, the visual data detected by the camera can be output, and the processor can evaluate the data to determine the orientation and size of the pattern 120 and the relative sizes of certain portions of the pattern 120.

[0199] For example, if the pattern is AB and it is oriented on the back of the head 42 of the oral hygiene device 1 as shown, and the data analysis determines that AB is oriented upright, it is likely that the user is not brushing their teeth. This is because this would mean that the oral hygiene device 1 itself is upright (as shown in Figure 6), which would be a very unlikely position for a user to hold the oral hygiene device 1 and brush their teeth. In contrast, the longitudinal axis of the oral hygiene device 1 is typically maintained in a horizontal plane during brushing. However, if the camera 9 detects data indicating that AB on the head of the oral hygiene device 1 is lateral, this could mean two things: (1) the oral hygiene device 1 is positioned so that the back of the head 42 of the oral hygiene device 1 faces the user because AB is actually visible to the camera 9; and (2) the oral hygiene device 1 is horizontal because AB is oriented on its side. For example, this would provide a high probability that the oral hygiene device 1 is brushing the front teeth. This is because the camera 9 is typically positioned so that the user faces the camera 9 when brushing their teeth. Thus, if AB is visible to camera 9 and is to the side thereof, the oral hygiene device 1 must be oriented with the bristles facing the mouth (to brush the front surface) and brushing the front teeth (not the sides) since AB is still visible to camera 9 from the front.

[0200] However, in many positions of the oral hygiene device 1, the head 42 of the oral hygiene device 1 and any associated pattern 120 may not be visible to the camera 9. For example, when brushing the molars, the tongue, the top surface or the bottom surface of the teeth, the pattern 120 on the back of the head 42 will not be visible. Therefore, in some embodiments, one or more additional patterns 120 may be included on the attachment 130 on the end of the oral hygiene device 1. This will allow the camera 9 to detect the orientation of the attachment 130 and / or the pattern 120 on the handle 40 when the oral hygiene device 1 is inserted into the mouth of the user. For example, in some embodiments, the attachment 130 may be a spherical ball on the bottom of the handle 40 of the oral hygiene device 1, and will include several different patterns in different positions around the ball.

[0201] This will allow the camera to detect the position and orientation of several different patterns. After visually detecting the pattern, the system can determine: (1) which pattern 120 is being detected, (2) the size of the pattern 120, (3) the orientation of the pattern 120, (4) the relative sizes of different components of the pattern 120, and (5) other characteristics of the pattern 120. This information can be downloaded and compared with existing data regarding the type and orientation of the pattern 120 placed on the attachment 130 (and / or the handle 40 or head 42 of the oral hygiene device 1). For example, the system may include a database that stores each of the different patterns 120 and different size and orientation information about the pattern 120 of the oral hygiene device 1 and the distance from the camera 9. For example, each pattern 120 may include information about whether it is found in an upright orientation, the oral hygiene device is on its side, pointing toward the mouth, etc. In other embodiments, the size of the detected pattern 120 may be equivalent to the distance of the oral hygiene device 1 from the camera 9, assuming a set distance. In some embodiments, calibration information may be further added to enhance the system analysis of brushing data for a specific individual and / or a specific bathroom. Thus, each pattern 120 may have a number of pixels associated with each component (e.g., the height / width of certain features), which may be associated with a determined distance from the camera 9. This may be an approximation or average, or use statistics to find the highest probability distance / orientation.

[0202] Then, once the pattern information is determined, it can be compared with calibration information or other data representing the pattern 120 and the corresponding orientation included on, for example, the attachment 130. For example, as shown in Figure 6, if the AB pattern 120 is included on the attachment 130, in an upright orientation and facing forward in the same direction as the bristles, if the pattern is detected to be upright, the user is unlikely to be brushing their teeth. However, again, if the pattern 120 is detected to have a lateral orientation, the user may be brushing their premolars. In another example, if another pattern BC is placed at the bottom of the toothbrush, when the system detects the pattern, the oral hygiene device is likely to be used to clean the molars. Therefore, the orientation of BC can then be used to determine whether the user may be cleaning the top, bottom, or side of the molars. In some embodiments, this can be combined with accelerometer and gyrometer data to determine which side of the mouth is being brushed.

[0203] In yet another embodiment, the system may be able to determine the position of an oral hygiene device (without a pattern) relative to the face, including the vector direction of its longitudinal axis. Thus, the system can then determine whether the oral hygiene device is likely to be on the left or right side of the mouth. This can be accomplished using a visual recognition system as disclosed herein. In other embodiments, the system can determine the position and orientation of the mouth and the oral hygiene device relative to each other. For example, a mouth recognition algorithm can be used to approximate the position of each of the corners or sides of the mouth. Additionally, there may be visual markings on the neck of the oral hygiene device 1 to help the system determine which side of the mouth is being brushed when the user has the oral hygiene device in their mouth.

[0204] There is no pattern on the toothbrush

[0205] like Figure 7 As shown in and in some embodiments, without utilizing pattern 120 or markings, the system may detect only the outline of the handle of the oral hygiene device 1 to determine the orientation of the longitudinal axis relative to gravity. In other embodiments, the system may have additional image processing software to identify specific features of the oral hygiene device including the head (bristles, etc.) by classifying certain portions of the image using a classification algorithm. In some embodiments, the image processing software identifies the longitudinal axis, the head, the base, and possibly the bristles. From this information, the orientation and position of the oral hygiene device can be determined. In some embodiments, similar boundary detection / shape classification software can be utilized to identify the user and the user's mouth. Therefore, as further described herein, the relative position of the oral hygiene device relative to the mouth can be determined.

[0206] The inventors can utilize this system so that no customized oral hygiene device is needed and only a chip including the motion sensor 11 needs to be provided inside the oral hygiene device. Thus, the device can be manufactured using existing oral hygiene device designs and only a chip or controller 13 system including the motion sensor 11, antenna 5 or other wireless connection and memory is implemented. The device can then send all data to a connected smartphone or other connected device 30 (e.g., smart mirror, etc.).

[0207] Combining vision and motion data for position determination

[0208] Visual data can also be used to determine the acceleration and vector or direction of movement of the oral hygiene device 1 while brushing. Visual data can capture data at different positions and time stamps to determine the amount of time recorded as the first point traveling to the second point, and thus determine the combined velocity (direction and speed) and acceleration. As described herein, the position data can be used to calculate the brushing position. This combined with the orientation data will be able to provide sufficient position and orientation data to determine the position in the user's mouth and the section of the mouth being brushed as described herein.

[0209] For example, in some embodiments, visual information from pattern recognition or brush profiles can be used to recalibrate or position output from accelerometer / magnetometer / gyrometer position determinations. In these embodiments, the visual data can be used to recalibrate the drift experienced by the position sensors to return them to a reference coordinate system. In other embodiments, the visual data can be used to recalibrate the entire statistical model used to determine position.

[0210] In some embodiments, the position can be determined independently from the motion / acceleration / position sensor, and the position can be determined independently from the visual recognition data. These two determinations can then be used to determine the final position relative to the mouth. In other embodiments, only the visual recognition data can be used alone to calculate the position relative to the mouth.

[0211] For example, a first example would be provided without the visual pattern 120 added to the oral hygiene device 1. Using only the data output from the one or more motion sensors 11, it may be challenging in some cases to distinguish which side of the mouth the oral hygiene device 1 is located when the oral hygiene device is oriented in the same direction but may brush different sections of the teeth. For example, their orientation around the axis is the same or nearly the same, but their position on one side of the face is on the left or right side of the mouth.

[0212] For example, an ambiguous determination may be that the user is brushing the outer surface of the teeth on the left side of the mouth, or the user is brushing the inner surface of the teeth on the right side of the mouth, and even without the additional visual pattern 120, only the visual information of the oral hygiene device and the user's face, the system can distinguish between left and right. Therefore, the combination of algorithms is beneficial in this case, because the known inertial data is not sufficient to establish the relative spatial position in the coordinate system around the head. Thus, the visual information can be used to make a secondary determination of which side the head of the brush is located, and therefore, the visual information and the orientation information (about an axis or point or relative to gravity) can be combined to determine which side the head of the brush 1 is located and whether (for example, the inner or outer surface of the teeth is being brushed).

[0213] Another example may include an embodiment having a pattern 120 attached to the oral hygiene device 1. For example, the pattern 120 may be added to the bottom of the oral hygiene device 1 and to the back of the head of the brush 1. However, with the pattern 120, there may be positions of the oral hygiene device 1 where visual information alone is insufficient to determine the position and orientation of the oral hygiene device 1 with sufficient accuracy. For example, when the visual label is partially hidden, or the image resolution is too small to accurately detect in size and orientation.

[0214] For example, if the user is brushing their molars, and the only visible pattern 120 is on the bottom of the oral hygiene device 1 and the resolution is low (e.g., because the user is a little too far from the camera device, or because the user is using a camera with insufficient resolution), the system may not be able to determine with sufficient accuracy the angle of the brush 1 on the teeth. Therefore, the system cannot determine whether the user is brushing the outside of the molars in the upper jaw or the outside of the molars in the lower jaw.

[0215] In this case, the angular difference between the two brushing positions (e.g., the angle of the longitudinal axis of the oral hygiene device relative to gravity, because you hold the oral hygiene device at a slightly different angle when brushing the top molars or the bottom molars) may be quite subtle. However, the motion data (particularly acceleration and vertical orientation) may be able to disambiguate the two potential positions narrowed down by the visual data and thus provide the necessary information whether the oral hygiene device 1 is brushing the upper or lower jaw. Therefore, the motion data alone can be supplemented with visual data to determine the position or segment of the teeth being brushed.

[0216] Analysis of brushing time and position-motion data

[0217] In order to use the data from the sensors to estimate the amount of time spent in each section, quadrant, or other logical partition of the mouth, the user may need to calibrate the oral hygiene device 1. In some embodiments, calibration can be performed at the factory, by the user, or both. Thus, calibration can be used to calibrate a specially manufactured unit, as well as to adapt to the geographic, anatomical (i.e., height) and / or bathroom environment of a specific user, for example, the environment may include unique magnetic interference, unique height and orientation (the desktop may not be horizontal, etc.). For example, in some embodiments, the user may apply a colored gel to their teeth. Once the oral hygiene device 1 is in place at the teeth and all the colored gel is brushed off, the user can switch the oral hygiene device 1 to calibration mode while the motion sensor 11, one or more optical sensors 9, and other sensors record data.

[0218] At this point, the user can turn off calibration to stop acquiring calibration data. In other embodiments, once the user turns on the calibration function, the oral hygiene device 1 will detect the points in time at which the user has started and stopped brushing, including any pauses in brushing. The calibration procedure provides reference position, orientation, and motion calibration data, which can then be compared with subsequent brushes using statistical analysis 78 or other analytical methods to determine whether the subsequent brushes have brushed all areas of the mouth for a sufficient amount of time.

[0219] Once the device has been calibrated, or using reference data from previous brushing or brushing with other model users, the brushing data from each use can be compared with the reference data to assess its quality 78 and determine the position of the oral hygiene device 1 in the newly acquired data. For example, the calibration data can be used to prepare a statistical model of the shape and size of a specific user's mouth and to create certain statistical boundaries to determine when the oral hygiene device 1 brushes any determined section of the user's mouth. Then, once the user starts brushing for the second time, the newly recorded data can then be overlapped or correlated with the calibration brushing data associated with the user profile 60 to determine if there are any deficiencies in brushing and where there are deficiencies. For example, the system 100 can determine how long it took to brush each quadrant, how many strokes, or perform other assessments of brushing. In addition, the analysis can indicate that the user brushes too much in certain areas or does not use the correct stroke pattern in general or in specific sections of the user's mouth.

[0220] Correlation can be performed by statistical analysis, for example, the quantitative comparison of this difference can be simply performed by measuring the Euclidean distance in 3xz space. Then, such vectors can be processed by using statistical analysis, including principal component analysis (PCA), hierarchical cluster analysis (HCA), regression analysis and linear discriminant analysis. Statistical methods suitable for high-dimensional data can be used. For example, HCA systematically checks the distance between the data representing each type of motion or position data. Then a dendrogram can be generated, which shows the clustering of the data from the Euclidean distance between and among the data vectors, very similar to an ancestral tree.

[0221] Each statistical data cluster can represent sensor data for each segment, quadrant or other logical partition of the user's mouth. For example, the mouth can be divided into a top and a bottom, wherein the top and the bottom each have a right, a front and a left, and each of the right, the front and the left has an inner surface, a top surface and an outer surface. Therefore, the mouth can have 36 different segments, 10 segments, 8 segments, 12 segments or 4 segments (quadrants), only the top and the bottom, only the outside and the inside, and other logical partitions. Therefore, using reference data, the controller 13 or other processors in the system 100 (for example, a processor in a mobile phone or a server) can calculate a confidence interval or other value indicating the possibility of a specific segment of the user's mouth being brushed by the oral hygiene device, but determine the possibility that the stroke is related or related to the calibration data in these segments. In order to obtain a reference position, the user can be instructed to start brushing at the same position of the mouth. In this way, the data starts from a known position, and the data can be used as a reference point to associate the remaining data using statistical analysis. For example, based on calibration data, angles, orientations, calculated distances and other characteristics from reference positions of the oral hygiene device 1 detected by the motion sensor 11 and / or optical sensor 9 may indicate the likelihood that each new position is associated with a determined position of the mouth.

[0222] In other embodiments, the control system 13 or other system processor (e.g., a processor in a smart phone, server, or other component) can process the statistical data and determine that the brush is brushing a certain section of the mouth if the statistical analysis shows that the brush is within the section of the mouth with more than 95%, 85%, 80%, or other appropriate certainty. In some embodiments, the specificity or sensitivity of the static analysis of brushing can be modified to match the variance of a specific user.

[0223] The analysis may include an output 80 that allows the control system 13 or other processor to determine which brush strokes are in each section of the mouth or group of teeth, and therefore how long the user spends brushing each quadrant, half, or other logical division of the teeth or mouth, and how these times compare to the recommended ranges. In other embodiments, the time when an entry into a certain area begins and ends may be recorded, or other suitable methods may be used to determine how long each section of the mouth is spent brushing.

[0224] In some embodiments, rather than detecting the position of the toothbrush, the system 100 may instruct the user to brush certain sections of the mouth at a time, and only determine whether the user is actually brushing, and only count or record the brushing time when the motion indicating brushing is detected. Then, once the prescribed time of brushing in the indicated section is recorded, the system 100 will indicate to the user that it is time to move to the next section of the mouth, as well as the elapsed time when the user actually brushed his teeth. This prevents the user from taking a break, and thereby brushing less than the optimal time in each section. Therefore, the control system 13 or other processor may analyze the data from the sensor 11 (or pressure sensor 10) to record the amount of time the user brushes in each section when the system 100 indicates that the user should brush in that specific section.

[0225] In other embodiments, the pressure applied to the head 42 due to brushing can also be detected by a pressure sensor 10 incorporated into the oral hygiene device 1. For example, the pressure sensor 10 can be incorporated into the head 42 and detect the pressure associated with use. In addition, the pressure can be mapped to various position data so that the controller 13 or other processor of the system 100 can calculate the amount of pressure used to brush each area of ​​the mouth.

[0226] Machine Learning

[0227] In some examples, the statistical analysis used to implement the various features disclosed in system 100 will be a machine learning or artificial intelligence algorithm. For example, system 100 may process available data sources from sensors included in system 100 as disclosed herein and identify locations within the mouth. In other examples, machine learning algorithms may be used to: (1) identify cavities or plaque using machine vision or a combination of other data, (2) identify locations in the mouth to varying degrees of granularity, (3) identify brush stroke types using a dictionary of strokes disclosed herein, (4) identify users based on motion or image data (e.g., machine vision to identify facial features), or (5) other useful applications of the features described herein.

[0228] The machine learning algorithm may take a variety of forms. For example, the system 100 may utilize more basic machine learning tools including 1) decision trees ("DT"), (2) Bayesian networks ("BN"), (3) artificial neural networks ("ANN"), or (4) support vector machines ("SVM"). In other examples, a deep learning algorithm or other more complex machine learning algorithms may be used.

[0229] DT procedures are often used because they are simple and easy to understand. A DT is a classification diagram that matches input data to questions asked at each successive step in a decision tree. A DT procedure moves down the "branches" of the tree based on the answer to the question (e.g., first branch: Is the patient male? Yes or No. Second branch: Does the patient have difficulty urinating? Yes or No, etc.).

[0230] Bayesian networks ("BNs") are based on the likelihood that something is true, based on given independent variables, and modeled based on probabilistic relationships. BNs are purely based on probabilistic relationships that determine one variable based on the likelihood of another or other variables. For example, BNs can simulate the relationship between symptoms and diseases. Specifically, if the patient's symptoms or biomarker levels are known, BNs can be used to calculate the probability that the patient has a specific disease. Thus, using an effective BN algorithm, inferences can be made based on input data. They are commonly used in the medical field to represent reasoning under uncertain conditions, and are used in a wide range of applications, including disease diagnosis, genetic counseling, and emergency medical decision support system (MDSS) design.

[0231] Artificial neural networks ("ANNs") are computational models inspired by the central nervous system of animals. They map inputs to outputs through a network of nodes. However, unlike BNs, in ANNs, the nodes do not necessarily represent any actual variables. Thus, ANNs may have hidden layers of nodes that are not represented by variables known to an observer.

[0232] ANNs are capable of pattern recognition and have been used in the medical and diagnostic fields. Their computational methods make it easier to understand the complex and unclear processes that may occur during the diagnosis of a disease based on a variety of input data, including symptoms. Although still facing severe limitations, ANNs have proven to be suitable for CDSS design and other biomedical applications, such as the diagnosis of myocardial infarction, MDSS for leukemia management, and cancer detection.

[0233] Support vector machines ("SVMs") come from a framework that utilizes machine learning statistics and vector spaces (a linear algebra concept that represents the number of dimensions in a linear space) equipped with some structure related to limits. In some cases, they can determine a new coordinate system that easily separates the input into two categories. For example, an SVM can identify a line that separates two sets of points originating from different event categories.

[0234] They have been used in practice and are well-founded in theory, but can sometimes be difficult to understand. SVMs have been applied in many areas of biology, such as MDSS for diagnosing tuberculosis infection, tumor classification, and biomarker discovery.

[0235] However, there is a relatively new type of machine learning algorithm that is able to model very complex relationships with many variations, called deep neural networks. Recently, deep neural networks have been developed to solve the problem of speech recognition.

[0236] In the IT industry, many researchers have proposed various DNN architectures in the past few decades to solve the problems associated with algorithms such as ANN. These types of DNNs are CNN (Convolutional Neural Network), RBM (Restricted Boltzmann Machine), LSTM (Long Short-Term Memory), etc. They are all based on ANN theory. They show better performance by overcoming the back-propagation error reduction problem associated with ANN.

[0237] Machine Learning - Training Data

[0238] Machine learning algorithms require training data to identify the features of interest that they are designed to detect. For example, various methods can be used to form machine learning models, including applying randomly assigned initial weights to the network and applying gradient descent using backpropagation to deep learning algorithms. In other examples, a neural network with one or two hidden layers can be used without training using this technique.

[0239] In some examples, the machine learning algorithm will be trained using labeled data or data representing certain features, specific actions or characteristics, including specific positions in the mouth, specific brush strokes, specific users, and others. In some examples, the training data will be pre-filtered or analyzed to determine certain features, including various advanced filters or starting points including motion sensing data (brush pick-up, brush facing a certain direction relative to gravity). In other examples, the data will be labeled with results only, and various related data can be input to train the machine learning algorithm.

[0240] For example, to identify the position in the mouth, various machine learning algorithms may be utilized to input various data disclosed herein, including motion (accelerometer output, gyroscope output, magnetometer output), visual data from a camera on the base 2, or other data related to the position of the oral hygiene device 1 during brushing. For example, in some embodiments, the input data used to determine the position of the toothbrush may include only data output from sensors on the oral hygiene device 1. For example, in some examples, the input data will be labeled data from an accelerometer sensor alone.

[0241] In other examples, the input data may be various combinations of marker data output from accelerometers, magnetometers, and gyroscopes to identify the location. In some examples, the starting and ending points of the input data will be quite important. In some examples, the input data may be a combination of data output from sensors on the oral hygiene device and sensors on the base 2, such as a visual recognition system or a depth perception system.

[0242] Similarly, for the system 100 to identify the type of brush stroke (e.g., a specific motion), the system may utilize machine learning from a combination of data output from various sensors. In some examples, data output from an accelerometer alone may be sufficient to identify a brush stroke. This is a special case because most brush strokes have a repeating specific acceleration pattern and may include angle information relative to gravity as disclosed herein.

[0243] In the system 100 for identifying a user, a machine learning algorithm may be utilized to detect the user's face and identify the user with a unique profile. In these examples, the user may first use the system including a base 2 with a camera 56, which may take an initial picture of the user. The user may then indicate their profile selection, and the system may use the picture to identify the user in the future. Over time, the system may acquire additional photos or videos of the user to make the identification of the user more robust (e.g., more labeled training sets).

[0244] Machine Learning-Obtaining Training Data

[0245] In some examples, the labeling of the training data may include an operator that examines the data recorded when the camera captures an image of the user. In other examples, the user prompts will tell the user (1) where to brush, and (2) the type of brush strokes that may be used (e.g., other specific actions) to train the system. For example, in some examples, the system 100 may utilize a coach or other instructional piece with a mouth diagram that may highlight, light up, or otherwise indicate to the user where to brush. For example, these instructions may be displayed on a display of a mobile device.

[0246] Thus, an automated instruction system can be used to obtain training data for a specific user (to personalize the algorithm) or for many users. For example, where the system 100 implements a mobile device 30, the system can display a schematic diagram of the user's dentition on the mobile device 30 screen and indicate in real time which areas the user should brush in order. The system can then record the data as labeled training data, with each set of data indicating a certain location in the mouth.

[0247] In addition, the system 100 may indicate the type of brush stroke to be used, including a circular stroke, a reciprocating stroke, or a more complex stroke as disclosed herein. Thus, these will provide input training data to the system 100 to learn how to recognize locations in the mouth and certain brush strokes.

[0248] However, in some examples, the input data from coaching style acquisition may need to be filtered to reduce dimensionality before the labeled data is fed into the algorithm used to develop the model. For example, principal component analysis or other dimensionality reduction methods may be implemented before the labeled data is fed into one or more algorithms.

[0249] In other examples, the data may be filtered using various filters before being labeled and input as training data. For example, if a machine learning model is being developed for identifying position, the system may filter out various accelerations that are related to brush travel rather than position, including rapid time variations or periodic accelerations. Similarly, for brush travel, steady accelerations (e.g., gravity) may be filtered out and only periodic accelerations may be analyzed or fed into the system. In other examples, the data may not be pre-filtered, and a sensitive deep learning algorithm may utilize the additional data to reliably determine position.

[0250] In other examples, the data may be pre-filtered or post-filtered (and later rejected after analysis) in the event that the user performs some incorrect action or fails to follow instructions displayed on the mobile phone 30 or other device display. In addition, various filters or techniques may be utilized to determine when the user is in place and following instructions, such as once periodic brushing (e.g., with periodic changes in acceleration) is detected.

[0251] Presentation of feedback

[0252] Once the usage data 78 is analyzed by one or more controllers 13 of the system 100 or other processors included in a smart phone, server, or other component of the system 100, feedback may be presented to the user 80 via a speaker 50, a visual indicator 52 on the oral hygiene device 1, or via an associated mobile device 30 or other computing device in data communication with the system 100. The feedback may be presented immediately or may be used to access the progress of the examination.

[0253] For example, immediate feedback may be provided to the user 80 during brushing, including an indication through audio or visual means of how much time is remaining, whether to brush harder or lighter, whether certain quadrants have been brushed sufficiently, and when brushing is complete. For example, a stop sound or a red light may be produced through the speaker 50 to indicate that brushing is complete.

[0254] In addition, historical and average brushing time and position data can be presented to the user 80 on the mobile device or other computing device using graphs, charts, percentages and other metrics. For example, the user can be presented with the average time spent per day, per quadrant, and the average number of days that the user brushes once, twice, or other times. In addition, the average time spent brushing each tooth can be calculated and presented to the user on the mobile device 30 or other computing device. The program 15 running on the mobile device can use the controller 13 of the mobile device 30 to control the presentation of the data.

[0255] In some examples, the system may combine the filtered and processed position and brush stroke identifications and possibly acid identifications to provide overall feedback. For example, in some examples, the feedback is not just about the time in each position of the mouth, but will also include the strokes used in each position of the mouth. In some examples, certain stroke techniques will present a higher feedback score to the user, or certain strokes used in certain positions in the mouth.

[0256] Therefore, if Fig. 9A and Fig. 9B As shown in , an application according to the present invention may include a display 910 of a mobile device 30 that may include a heat map 920 or other visual representation of the locations that a user has brushed, the accuracy of brushing in each location, the amount of time, and the type of strokes used. This information may provide the user with multiple goals for improving brushing.

[0257] API for dentist integration

[0258] An API may also be developed to pass brushing and usage data to dentists for professional evaluation and feedback on brushing habits and techniques. Additionally, the data may be evaluated to determine brushing techniques that lead to more dental problems, including cavities and gum disease. For example, the width or height of a stroke may be correlated to how high the brush reaches the gum line, indicating whether the gums are being brushed correctly. This may be analyzed to determine if short strokes in height lead to more frequent instances of gum disease.

[0259] Gamification

[0260] The usage data can also be used to create games for children or family members to play alone or against each other to hit certain thresholds of usage. This can provide a unique motivational tool for users to brush their teeth regularly. Thus, since delayed feedback, for example, in the case of gum disease or cavities, is often psychologically discounted, the more immediate and continuous specific and quantitative feedback of the present disclosure will provide better motivation to comply with the recommended brushing regimen.

[0261] In some examples, the game will show what is inside the mouth, how to brush properly, and how to train and evaluate the quality of a child's brushing. In some examples, the user brushes to earn points based on the time, quality, and amount of brushing.

[0262] Tele-Dental Platform

[0263] In some examples, the systems and methods disclosed herein can communicate with a dental professional to provide a diagnosis of dental conditions and feedback on brushing. This can include cavity, plaque, and brushing position time and technique information. For example, in some embodiments, the user profile can be integrated with a server at the dentist's office, or separately include patient data added by the dentist, including any specific diseases or other problems the patient may have.

[0264] For example, a dentist can add specific areas or teeth with cavities, periodontal disease, gingivitis, caries, receding gums, and other issues. These issues can then be mapped to the individual user's dentition and the recommended brushing strategy presented to the user during brushing be altered and evaluated to provide feedback based on that strategy.

[0265] In some examples, a dentist (using a computer or mobile device) may input that a user has receding gums at a certain location in the user's mouth. Thus, this data will be sent to the patient's mobile device 30 and saved with the patient's profile. Thus, as the user brushes, the interface may highlight in red where the user should brush more gently and use circular or other types of strokes to minimize gum damage. Thus, the user will then try to accommodate this request, and feedback may indicate that the pressure in that area is too high (including in real time), the strokes are wrong, too fast, etc., or too much time is spent in a specific area.

[0266] Therefore, a teledentistry system may be able to provide clinician-level feedback during the brushing process. This would allow the brushing experience to be personalized for each user.

[0267] Computer & Hardware Implementation of the Present Disclosure

[0268] It should be initially understood that the disclosure herein may be implemented using any type of hardware and / or software, and may be a pre-programmed general purpose computing device. For example, a server, a personal computer, a portable computer, a thin client, or any suitable device or devices may be used to implement the system. The disclosure and / or its components may be a single device at a single location, or multiple devices at a single location or multiple locations, connected together using any suitable communication protocol via any communication medium such as a cable, a fiber optic cable, or wirelessly.

[0269] It should also be noted that the disclosure is shown and discussed herein as having multiple modules that perform specific functions. It should be understood that these modules are only schematically shown based on their functions for the purpose of clarity, and do not necessarily represent specific hardware or software. In this regard, these modules can be implemented as hardware and / or software that basically performs the specific functions discussed. In addition, in the disclosure, modules can be combined together based on the desired specific functions, or divided into additional modules. Thus, the disclosure should not be interpreted as limiting the present invention, but is only understood as illustrating an exemplary embodiment of the present invention.

[0270] A computing system may include a client and a server. The client and the server are usually remote from each other and usually interact through a communication network. The relationship between the client and the server is generated by computer programs running on respective computers and having a client-server relationship with each other. In some embodiments, the server transmits data (e.g., an HTML page) to a client device (e.g., for the purpose of displaying data to a user interacting with the client device and receiving user input therefrom). Data generated at the client device (e.g., a result of a user interaction) may be received from the client device at the server.

[0271] Implementations of the subject matter described in this specification may be implemented in a computing system that includes a back-end component such as a data server, or includes a middleware component such as an application server, or includes a front-end component such as a client computer with a graphical user interface or a web browser through which a user can interact with implementations of the subject matter described in this specification, or any combination of one or more such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication, such as a communication network. Examples of communication networks include local area networks ("LANs") and wide area networks ("WANs"), intranets (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks).

[0272] The embodiments of the subject matter and operations described in this specification may be implemented in digital electronic circuits, or in computer software, firmware or hardware including the structures disclosed in this specification and their structural equivalents, or in a combination of one or more thereof. The embodiments of the subject matter described in this specification may be implemented as one or more computer programs, i.e., one or more modules of computer program instructions encoded on a computer storage medium, for execution by a data processing device or for controlling the operation of a data processing device. Alternatively or additionally, program instructions may be encoded on an artificially generated propagation signal, for example, generated to encode information for transmission to a suitable receiver device for execution by a data processing device. Machine-generated electrical, optical or electromagnetic signals. A computer storage medium may be or be included in a computer-readable storage device, a computer-readable storage substrate, a random or serial access memory array or device, or a combination of one or more thereof. In addition, although a computer storage medium is not a propagation signal, a computer storage medium may be a source or target of computer program instructions encoded in an artificially generated propagation signal. A computer storage medium may also be or be included in one or more separate physical components or media (e.g., multiple CDs, disks or other storage devices).

[0273] The operations described in this specification may be implemented as operations performed by a "data processing apparatus" on data stored on one or more computer-readable storage devices or received from other sources.

[0274] The term "data processing apparatus" includes all types of apparatus, devices and machines for processing data, including, for example, programmable processors, computers, systems on a chip, or a plurality of or a combination thereof. The apparatus may include dedicated logic circuits, such as field programmable gate arrays (FPGAs) or application specific integrated circuits (ASICs). In addition to hardware, the apparatus may also include code that creates an execution environment for the computer program in question, for example, code that constitutes processor firmware, a protocol stack, a database management system, an operating system, a cross-platform runtime environment, a virtual machine, or a combination of one or more of them. The apparatus and execution environment may implement a variety of different computing model infrastructures, such as web services, distributed computing, and grid computing infrastructures.

[0275] A computer program (also referred to as a program, software, software application, script, or code) may be written in any form of programming language and may be deployed in any form, including as a standalone program or as a module, component, subroutine, object, or other unit suitable for a computing environment, wherein the programming language includes a compiled or interpreted language, a declarative or procedural language. A computer program may, but need not, correspond to a file in a file system. A program may be stored in portions of a file that maintain other programs or data (e.g., one or more scripts stored in a markup language document) in a single file dedicated to the program in question, or in multiple collaborative files (e.g., files storing one or more modules, subroutines, or portions of code). A computer program may be deployed to execute on one computer or on multiple computers located at one site or distributed over multiple sites and interconnected by a communications network.

[0276] The processes and logic flows described in this specification may be performed by one or more programmable processors executing one or more computer programs to perform actions by operating on input data and generating output. The processes and logic flows may also be performed by special purpose logic circuits, and the apparatus may also be implemented as special purpose logic circuits, such as field programmable gate arrays (FPGAs) or application specific integrated circuits (ASICs).

[0277] Processors suitable for executing computer programs include, for example, general-purpose microprocessors and special-purpose microprocessors and any one or more processors in any type of digital computer. Typically, the processor will receive instructions and data from a read-only memory or a random access memory or both. The basic elements of a computer are a processor for performing actions according to instructions and one or more storage devices for storing instructions and data. Typically, a computer will also include one or more large-capacity storage devices for storing data, or be operably connected to receive data from the one or more large-capacity storage devices or transfer data to the one or more large-capacity storage devices, wherein the large-capacity storage device is, for example, a magnetic disk, a magneto-optical disk or an optical disk. However, the computer does not need to have such a device. In addition, the computer may be embedded in another device, for example, a mobile phone, a personal digital assistant (PDA), a mobile audio or video player, a game console, a global positioning system (GPS) receiver or a portable storage device (e.g., a universal serial bus (USB) flash drive), to name a few. Devices suitable for storing computer program instructions and data include all forms of non-volatile memory, media and storage devices, including, for example: semiconductor memory devices, such as EPROM, EEPROM and flash memory devices; magnetic disks, such as internal hard disks or removable disks; magneto-optical disks and CDROMs; and DVD-ROM disks. The processor and memory may be supplemented by, or incorporated in, special purpose logic circuits.

[0278] It will be appreciated by those skilled in the art that many changes may be made to the described embodiments without departing from the spirit and scope of the present invention. In addition, it will be appreciated by those skilled in the art that certain embodiments described for one device or system may be easily or slightly modified to be included in the embodiments described for another device or system without departing from the spirit and scope of the present invention.

[0279] For example, the following selected embodiments are illustrative examples of the present disclosure.

[0280] Selected implementation method

[0281] Embodiment 1. An oral hygiene system for monitoring compliance with an oral hygiene regimen, comprising an oral hygiene device, an optical sensor, a memory and a control system, wherein the oral hygiene device comprises a handle and a head; the memory comprises a machine-readable medium, the machine-readable medium comprises a machine executable code, and the machine executable code stores instructions for executing a method for identifying a specific action of the oral hygiene device; a control system is connected to the memory, the control system comprises one or more processors connected to the memory, the control system is configured to execute the machine executable code to cause the one or more processors to: receive data output by the optical sensor; process the data using a machine learning model to determine the specific action of the oral hygiene device represented by the data, wherein the specific action includes the orientation and movement of the oral hygiene device; and output data representing the specific action.

[0282] Embodiment 2. An oral hygiene system according to embodiment 1, wherein the oral hygiene device includes a pattern, and the control system is also configured to execute machine executable code to cause one or more processors to determine specific actions of the oral hygiene device based at least on analysis of the pattern in data output by the optical sensor.

[0283] Embodiment 3. The oral hygiene system of embodiment 1 or 2, wherein specific movements of the oral hygiene device are determined relative to the user's mouth.

[0284] Embodiment 4. An oral hygiene system according to any of the preceding embodiments, wherein the machine learning model is a deep learning model.

[0285] Embodiment 5. An oral hygiene system according to any of the preceding embodiments, wherein the machine learning model includes labeled training data indicating the location of the mouth.

[0286] Embodiment 6. An oral hygiene system according to any of the preceding embodiments, wherein the control system is further configured to execute machine executable code to cause one or more processors to input data output from motion sensors and optical sensors attached to the oral hygiene device to determine specific actions.

[0287] Embodiment 7. The oral hygiene system of embodiment 5, wherein the labeled training data comprises data automatically labeled by a user brushing their teeth according to instructions on a display of a mobile device.

[0288] Embodiment 8. An oral hygiene system according to any of the preceding embodiments, wherein the specific action is one of a brush stroke type, a brushing position, applying toothpaste, or brushing teeth.

[0289] Embodiment 9. An electronic oral hygiene system for monitoring tooth brushing and compliance with a tooth brushing regimen, comprising an oral hygiene device, a motion sensor, a memory, and a control system, wherein the oral hygiene device comprises a handle and a head; the motion sensor is configured to output motion data related to the movement of the oral hygiene device; the memory is used to store data output by the motion sensor and to communicate data with the motion sensor; the control system determines the position of the head of the oral hygiene device in the user's mouth by comparing the motion data with previously recorded calibration data using a machine learning model.

[0290] Embodiment 10. An electronic oral hygiene system according to embodiment 9, wherein the control system uses a machine learning model to determine the orientation.

[0291] Embodiment 11. An electronic oral hygiene system according to embodiment 10, wherein the machine learning model is a deep learning model.

[0292] Embodiment 12. An electronic oral hygiene system according to embodiment 10 or 11, wherein the machine learning model includes labeled training data indicating the position of the mouth.

[0293] Embodiment 13. The electronic oral hygiene system of embodiment 12, wherein the labeled training data comprises data automatically labeled by a user brushing their teeth according to instructions on a display of the mobile device.

[0294] Embodiment 14. An electronic oral hygiene system according to any one of embodiments 9 to 13, wherein the control system utilizes a machine learning model to further determine the brush stroke type.

[0295] Embodiment 15. The electronic oral hygiene system of embodiment 14, wherein the brush stroke type comprises a circular stroke, a back-and-forth stroke, or an angled stroke.

[0296] Embodiment 16. An oral hygiene system for monitoring toothbrushing and compliance with a tooth brushing regimen, comprising an oral hygiene device, a sensor, a memory and a control system, wherein the oral hygiene device comprises a handle and a head; the memory comprises a machine-readable medium comprising a machine-executable code having stored thereon instructions for executing a method for determining the position and orientation of a toothbrush; a control system is connected to the memory, the control system comprising one or more processors, the control system being configured to execute the machine-executable code so that the control system determines a specific action performed by the oral hygiene device based at least on data output by the sensor, including motion data, the motion data representing the movement of the oral hygiene device, wherein the specific action is determined by processing the motion data using a machine learning model.

[0297] Embodiment 17. The oral hygiene system of embodiment 16, wherein the sensor is one of a gyroscope, a magnetometer, or an accelerometer.

[0298] Embodiment 18. An oral hygiene system according to embodiment 16 or 17, wherein the specific action performed by the oral hygiene device is one of the following: brush stroke type, position in the mouth, brush stroke type at the position in the mouth, or applying toothpaste to the oral hygiene device.

[0299] Embodiment 19. An oral hygiene system according to any one of embodiments 16 to 18, wherein the first mobile device displays a schematic diagram of the user's dentition based on the determined specific actions, and shows information related to the type of brush strokes used in each section of the user's mouth and the amount of time spent brushing each section of the user's mouth.

[0300] Embodiment 20. The oral hygiene system of embodiment 19, wherein a second mobile device in communication with the first mobile device receives input from a user regarding a goal for time, quantity, or accuracy of a specific action.

[0301] Embodiment 21. The oral hygiene system of embodiment 20, wherein the control system is configured to send a notification to the second mobile device and send a reward to the first mobile device if the goal is achieved.

[0302] Embodiment 22. A non-transitory computer-readable storage medium having stored thereon instructions for executing a method including machine-executable code, which, when executed by at least one machine, causes the machine to: use a machine learning algorithm to determine a spatial position and orientation of an oral hygiene device based at least on data output by an accelerometer including motion data representing the oral hygiene device; determine a segment of a user's teeth being brushed by the oral hygiene device based on the motion data; and output an indication of the user brushing their teeth on a display based on the determined spatial position, orientation, and segment of the user's teeth.

[0303] Embodiment 23. The non-transitory computer-readable storage medium of embodiment 22, wherein the segment of the user's tooth comprises an outer surface of an upper molar or an inner surface of a lower molar.

[0304] Embodiment 24. The non-transitory computer-readable storage medium of embodiment 22, wherein the portion of the user's teeth includes an outer surface of an upper incisor or an outer surface of a lower incisor.

[0305] in conclusion

[0306] The various methods and techniques described above provide many ways to perform the present invention. Of course, it should be understood that, according to any specific embodiment described herein, not all the purposes or beneficial effects described may be achieved. Thus, for example, it will be understood by those skilled in the art that the method can be performed in a manner that achieves or optimizes a beneficial effect or a group of beneficial effects as taught herein, without having to achieve or optimize other purposes or beneficial effects as taught or suggested herein. Various alternatives are described herein. It should be understood that some embodiments specifically include one, another or several features, while other embodiments specifically exclude one, another or several features, while other embodiments mitigate specific features by including one, another or several advantageous features.

[0307] In addition, the technical staff will understand the applicability of various features from different embodiments. Similarly, those of ordinary skill in the art can adopt the various elements, features and steps discussed above in various combinations, as well as other known equivalents of each such element, feature or step, to perform the method according to the principles described herein. Among the various elements, features and steps, in different embodiments, some of the various elements, features and steps will be specifically included and other parts of the various elements, features and steps will be particularly excluded.

[0308] Although the present application has been disclosed in the context of certain embodiments and examples, it will be appreciated by those skilled in the art that the embodiments of the present application extend beyond the specifically disclosed embodiments to other alternative embodiments and / or uses and modifications and their equivalents.

[0309] In some embodiments, in the context of describing the specific embodiments of the present application (specifically in the context of some of the following claims), the use of the terms "a" and "an" and "the" and similar references can be interpreted as covering both the singular and the plural. The description of the numerical range herein is intended only to be used as a shorthand method for individually quoting each individual value falling within the range. Unless otherwise indicated herein, each individual value is incorporated into this specification as if it is individually quoted herein. Unless otherwise indicated herein or the context is clearly contradictory, all methods described herein can be performed in any suitable order. The use of any and all examples or exemplary language (e.g., "such as") provided with respect to certain embodiments herein is intended only to better illustrate the present application, rather than to limit the scope of the present application claimed for protection. Any language in the specification should not be interpreted as indicating any undeclared element that is essential to practicing the present application.

[0310] Certain embodiments of the present application are described herein. After reading the foregoing description, variations of these embodiments will become apparent to those of ordinary skill in the art. It is contemplated that the technical staff may appropriately adopt these variations, and may practice the present application in a manner different from that specifically described herein. Therefore, many embodiments of the present application include all modifications and equivalents of the subject matter described in the appended claims as permitted by applicable law. In addition, unless otherwise indicated herein or otherwise clearly contradictory in context, the present application encompasses any combination of all possible variations of the above elements.

[0311] Specific embodiments of the subject matter have been described herein. Other embodiments are within the scope of the following claims. In some cases, the actions recited in the claims can be performed in a different order and still achieve the desired results. Additionally, the processes depicted in the accompanying drawings do not necessarily require the specific order shown or sequential order to achieve the desired results.

[0312] All patents, patent applications, publications of patent applications, and other materials (such as articles, books, specifications, publications, documents, articles, and / or the like) referenced herein are hereby incorporated by reference in their entirety for all purposes, except for any examination document history associated therewith, any of the same examination document history that is inconsistent or conflicting with this document, or any of the same examination document history that may have a limiting effect on the broadest scope of the claims now or later associated with this document. For example, if there is any inconsistency or conflict between the description, definition, and / or use of a term associated with any of the included materials and with this document, the description, definition, and / or use of the term in this document shall control.

[0313] Finally, it should be understood that the embodiments of the present application disclosed herein are illustrations of the principles of the embodiments of the present application. Other modifications that may be adopted may be within the scope of the present application. Therefore, by way of example and not limitation, alternative configurations of the embodiments of the present application may be utilized according to the teachings herein. Therefore, the embodiments of the present application are not limited to those precisely as shown and described.

Claims

1. An oral hygiene system comprising: A toothbrush, including a handle and a head; a sensor configured to output data related to the movement of the toothbrush; as well as A controller comprising one or more processors, wherein the one or more processors are configured to: receiving data output by the sensor; Based on the data, calculating the position of the head of the toothbrush in the user's mouth; and A mobile device associated with the toothbrush is caused to present a schematic diagram of the dentition, the schematic diagram including an indication of the position of the head of the toothbrush within the user's mouth as the user brushes.

2. The system according to claim 1, wherein: The schematic diagram also includes an indication of how much time is left to brush the teeth.

3. The system according to claim 1, wherein: The schematic diagram also includes historical brushing information.

4. The system according to claim 3, wherein: The historical toothbrushing information includes: (i) average time spent brushing teeth per day; (ii) the average time spent brushing each part of the user's mouth; (iii) the average number of times the user brushes their teeth per day; (iv) daily toothbrushing activities; or (v) Any combination of (i) to (iv).

5. The system according to claim 3, wherein: The historical brushing information is presented as: (i) Graphics; (ii) diagrams; (iii) percentage; or (iv) Any combination of (i) to (iv).

6. The system according to claim 1, wherein: The diagram also includes an indication of brushing pressure.

7. The system according to claim 1, wherein: The diagram also includes an indication of the time spent brushing each portion of the user's mouth.

8. The system according to claim 1, wherein: The schematic also includes the following visual representations: (i) the location that the user has swiped; (ii) the accuracy of brushing in each section; or (iii) Both (i) and (ii).

9. The system according to claim 1, wherein: The schematic diagram also includes an indication of whether the user has adequately brushed each portion of the user's mouth.

10. The system according to claim 1, wherein: The sensors are: (i) gyroscope; (ii) accelerometer; (iii) magnetometer; (iv) Inertial sensors; (v) gyroscope; or (vi) Any combination of (i)-(v).

11. The system according to claim 1, wherein: The controller calculates the position of the head of the toothbrush based on a machine learning algorithm.

12. The system of claim 1, wherein: The controller calculates the position of the head of the toothbrush based on a comparison of the current position of the toothbrush with calibration data.

13. The system of claim 1, wherein: The data include: (i) Acceleration data; (ii) directional data; or (iii) Both (i) and (ii).

Images