Oral hygiene system with visual recognition function for monitoring compliance
By integrating optical and motion sensors in dental systems, monitoring and analyzing toothbrush motion data, providing feedback and gamified incentives, the problem of low dental hygiene compliance among children and adolescents is solved, and the execution and effectiveness of dental hygiene habits are improved.
Patent Information
- Application Number
- CN202410960673.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2016-03-14
- Publication Date
- 2024-11-19
AI Technical Summary
Children and adolescents have low compliance with dental hygiene, resulting in high incidence of dental cavity and gum diseases. It is difficult for existing oral hygiene monitoring device technology to effectively monitor brushing time and area coverage.
Develop a dental system containing optical sensors and motion sensors, which provides feedback and encourages users to improve brushing compliance by recording and analyzing toothbrush motion data. The system can connect wirelessly to mobile devices and enhance user motivation using gamification mechanisms.
Improve users' compliance with the frequency and quality of teeth brushing recommended by dentists, reduce the occurrence of dental holes and gum diseases, and enhance dental hygiene habits through real-time feedback and dynamic monitoring.
Smart Images

Figure CN118975723A_ABST
Abstract
Description
[0001] This application is a divisional application of the Chinese invention patent application with application date of March 14, 2016, application number 2016800857375, and invention name “Oral hygiene system with visual recognition function for monitoring compliance”. Technical Field
[0002] The present invention relates to methods and apparatus for monitoring oral hygiene activities. Background Art
[0003] Compliance with proper technique and frequency of oral hygiene activities, including brushing and flossing, is critical to healthy teeth. However, compliance is particularly poor among children and adolescents. For example, many areas of the mouth are often missed after bad habits are formed. Therefore, if the amount of brushing and technique can be monitored, then perhaps compliance can be improved. However, due to various technical limitations, monitoring oral hygiene device technique and the amount of time in each area is quite difficult.
[0004] According to the CDC, although preventable, dental caries is the most common chronic disease in children aged 6 to 11 years (25%) and adolescents aged 12 to 19 years (59%). Another 28% of adults aged 35 to 44 have untreated dental caries. The bacterial biofilm called plaque that forms on the teeth causes dental caries and gingivitis. However, plaque can be removed and dental caries prevented or reduced by brushing for two minutes at least once a day and preferably twice a day. Atlin T and Horecker E., "Tooth Brushing and Oral Health: How Frequently and When Should Tooth Brushing be Performed", Oral Health & Prevention Dentistry, 2005 3(3):135-140.
[0005] Additionally, studies have shown that children continually miss the same areas during brushing, which results in isolated plaque accumulation on certain teeth. Therefore, the effectiveness of brushing is more important than the length of time brushing is used. Additionally, dental health education has only been shown to generally have only a small and temporary effect on plaque accumulation. Atlin T and Horecker E., "Tooth Brushing and Oral Health: How Frequently and When Should Tooth Brushing be Performed," Oral Health & Prevention Dentistry, 2005 3(3):135-140. Additionally, many toothpastes contain fluoride, which promotes the regrowth of tooth enamel to prevent the formation of cavities. According to the American Dental Association, compliance with tooth brushing is very low. For example, only 49% of men and 57% of women brush their teeth twice a day. Summary of the invention
[0006] Therefore, there is a need for a dental system that can increase user compliance with dentist-recommended routines for brushing, flossing, or other oral hygiene activities in order to reduce cavities, gum disease, and other dental complications resulting from lack of brushing. The present disclosure provides systems and methods for monitoring oral hygiene device usage and electronically providing feedback and other encouragement to users to improve compliance.
[0007] The system allows recording of brushing activities (or other oral hygiene activities) and analysis of those activities. The system allows the generation of services that provide feedback and encouragement to users of the oral hygiene system. The oral hygiene device or associated system components (including, for example, a camera) records brushing data via sensors during its use. In some embodiments, the data is analyzed and compared with reference data. For example, one or more optical sensors that track the movement of a toothbrush relative to the mouth are disclosed. The images output from the one or more optical sensors can be analyzed to determine the orientation and movement of the toothbrush relative to the mouth, and the amount of brushing (or flossing with a water pik) in each area can be determined.
[0008] Through the feedback output device, the user receives suggestions for use of the system as well as encouragement and other feedback designed to improve compliance with the recommended usage regimen. For example, the system can let the user know which areas of the mouth have been brushed or flossed, and provide the user with feedback on where they could have brushed more or where they missed completely. In another example, the system can implement a gamification process to enhance motivation to use the hygiene device.
[0009] In some embodiments, the present invention relates to a method or new approach for using an oral hygiene device by informing a user about his / her brushing habits in a new way, such as by wireless integration with a mobile telecommunications device or other device with a display. The electric toothbrush can also wirelessly communicate data to a base station, which can then send the data to a network for analysis on a cloud server, or wirelessly to a mobile device. The mobile telecommunications component can be a mobile phone, a microcomputer with a telecommunications component, or a tablet computer with a telecommunications component. In other embodiments, the data can be wirelessly sent to a base station and then uploaded to a server for later access by a computing device including both mobile and non-mobile computing devices. In some instances, the oral hygiene system will include one or more optical sensors or cameras that track the movement of a standard toothbrush, and the camera will be integrated with a mobile device, a base station, a local area network, or other computing devices. In this instance, any standard toothbrush or irrigator that does not include an electronic device or motion sensor can be used.
[0010] The oral hygiene device system may include an oral hygiene device having a sensor and a base station that physically supports the oral hygiene device when the user is not holding the oral hygiene device. The electronic oral hygiene device may include: (a) signal processing circuitry; (b) memory; (c) a base station interface for exchanging data between the oral hygiene device and the base station; (d) a power supply circuit that may include a rechargeable battery or a capacitor; and (e) a controller.
[0011] The base station and / or camera may include: (a) a network interface for exchanging data between the Internet or other network and the base station; and (b) a recharging circuit for recharging a rechargeable battery of the toothbrush, which may optionally also serve as a magnetic transmitter connected to a magnetometer sensor in the toothbrush. In other embodiments, the system may not include a base station, and the signal may be wirelessly sent directly to a mobile phone or other wireless terminal, or a separate optical sensor / camera system may record optical data and send it directly to a mobile device, other computing device, or network for analysis. In some embodiments, the base station may include a camera for monitoring and identifying a code on the oral hygiene device to visually track movement.
[0012] The oral hygiene device system may include a camera positioned separately from the oral hygiene device to record images of the oral hygiene device during brushing. Image processing software may then analyze the brushing motion of the oral hygiene device independently or in addition to data from a motion sensor attached to the toothbrush. For example, the oral hygiene device may not incorporate any electronics and may instead be a standard toothbrush. In this example, the camera and image processing system may determine the brushing position and time only for each section of the teeth.
[0013] For example, the one or more optical sensors may record images including the mouth, oral hygiene device, and teeth throughout a brushing session. The image processing software may then identify the toothbrush, features of the toothbrush, the mouth, and the relative position of each, or use other methods as further discussed herein, to determine the segments and times of brushing.
[0014] In some examples, the oral hygiene device may include a pattern for enhanced recognition and spatial orientation calculation. In some examples, accessories for the oral hygiene device may also contain or include a pattern. In addition, the system may combine sensor motion data output from the electronics on the oral hygiene device with the image data to determine the section or portion of the teeth that the user is brushing.
[0015] Electrical configuration
[0016] The one or more control systems of the oral hygiene device may be configured to coordinate data exchange between the oral hygiene device, one or more optical sensors, a base station, a mobile device, and / or other networked devices for transmitting processed signals from the sensors and / or optical sensors for processing. In some embodiments, the oral hygiene device system 100 and associated control systems may include: signal conditioning circuitry for processing signals from sensors; memory for storing processed signals from the sensors; oral hygiene device interface circuitry for allowing information exchange between the oral hygiene device and the base station and other electronic components; oral hygiene device power supply circuitry for powering the sensors and circuitry of the toothbrush, the oral hygiene device power supply circuitry comprising a battery and / or capacitor type rechargeable power supply; and controller circuitry for directing the operation of the toothbrush electronics.
[0017] The base station, one or more optical sensors and / or other associated camera devices may include the following circuits: data exchange circuitry for exchanging data with a network; interface circuitry adapted to exchange information with the oral hygiene device; base station power circuitry for powering the base station circuitry and for recharging the rechargeable power source of the oral hygiene device when the oral hygiene device is received in the base station. The base station may also include a magnetic field transmitter, which may be a power source or recharging circuitry, or may be a separate magnetic field transmitter. The base station or other electronic device may also include a camera and associated electronics. The control circuitry may be configured to: upon detection of a user using a toothbrush, store the processed signals from the sensors in a memory, and, when the oral hygiene device is received in the base station, command the data exchange circuitry of the base station or other electronic device to transmit the stored signals from the sensors through the network, through the oral hygiene device and the interface circuitry of the base station or other electronic device. In some embodiments, raw data from the sensors may be stored and sent through the data exchange circuitry for processing at the base station or elsewhere.
[0018] Physical Design
[0019] In some embodiments, the oral hygiene device may include a motor for vibrating the head of the oral hygiene device during brushing. In addition, the head of the oral hygiene device including bristles or a water flosser can be removably connected to the body or handle of the oral hygiene device and is configured for the interchangeability of multiple heads. The oral hygiene device can be waterproof. In some embodiments, the base station can be configured to physically receive only one, two, three, four or five or another number of toothbrushes or other oral hygiene heads.
[0020] In some embodiments, the oral hygiene device may include a visual code or pattern that can be detected and tracked by a camera or vision-based detector. For example, the oral hygiene device head may include a pattern, and the handle may include a pattern. In some embodiments, the handle may include an additional ball or protrusion on the end that includes a larger pattern for detection by the camera. This "ball or protrusion" may be a special add-on that clips onto the handle and is not necessarily part of the toothbrush.
[0021] Moreover, the additional piece can also be a holder for a toothbrush. For example, the ball can ballast the oral hygiene device with water. Thus, the additional piece can be a hollow hemisphere with water or other heavy material at the bottom. This can allow the user to put down the oral hygiene device at many angles, and no matter what angle the oral hygiene device is put down, the oral hygiene device will stand upright.
[0022] sensor
[0023] The one or more sensors may include one or more optical sensors separate from the oral hygiene device that can record images of the oral hygiene device as it is used. If two or more optical sensors are used, the images can be used to track the movement and distance of the oral hygiene device in stereo.
[0024] In an embodiment where the oral hygiene device includes electronic devices, the sensor of the oral hygiene device can be one or more of the following: i) a pressure sensor (10), a motion sensor (11), or ii) any other one or more types of sensors capable of measuring the brushing activity of the toothbrush, such as an accelerometer or an inertial sensor. This may include an accelerometer, a magnetometer, and a gyroscope and / or a gyroscope. In some embodiments, the oral hygiene device may include at least one pressure sensor and at least one acceleration sensor. In some embodiments, the processed signals from the sensors are transmitted to the server via a network via a base station. In addition, the processed signals from the sensors are transmitted to the server via a network via a mobile device.
[0025] In other embodiments, the oral hygiene device may have a pattern for recognition by a vision-based sensor that is stationary and away from the toothbrush, or may simply be a standard toothbrush. For example, a mobile phone camera or a camera in a base station may be used as an optical sensor to monitor the orientation and position of the toothbrush. In these embodiments, the oral hygiene device may also include a motion sensor, or in other embodiments may have no electronics to save manufacturing costs. Alternatively, the oral hygiene device may have only a pattern for recognition by a camera, or may have no pattern and an image processing system may recognize the shape, axis, and orientation of the oral hygiene device, as further disclosed herein.
[0026] Computing Devices
[0027] In some embodiments, the mobile telecommunication component is a mobile phone, a microcomputer with telecommunication components, a tablet computer with telecommunication components, or any other component with a display component and with circuitry for connecting to and communicating with a global network. For example, the mobile device may typically be a mobile phone, but may also include other portable mobile PDA device types ("PDAs") or other types with radio communication capabilities, or even a microcomputer with telecommunication components, a laptop or desktop computer, a tablet computer with telecommunication components. In other embodiments, the signal is viewable on a stationary computing device that accesses data through a cloud server.
[0028] Signal Processing
[0029] In some embodiments with electronics in the toothbrush, the control system of the oral hygiene device is configured to store processed signals from sensors in a memory. In some embodiments, the control system may alternatively store raw data from sensors in a memory for transmission to a base station or other component of the system, where the raw sensor data may be processed. Once the control system and / or other processors in the system determine that the user has started brushing, the control system coordinates the acquisition, processing, and storage of the signal. In other embodiments, the control system may coordinate the storage and transmission of raw data for processing elsewhere. Next, the control system may be configured to wirelessly transmit the stored signals to a base station or computing device for further processing or initial processing, display, or analysis. In some embodiments, the oral hygiene device may not include a controller or any electronics.
[0030] Signal processing may include filtering, amplification, conversion, analog to digital signal conversion, digital filtering, digital data compression, digital data reduction, digital data calculations, and digital data conversion. This may be performed at several different aspects of the system, including the oral hygiene device, a base station, an associated mobile phone, a server linked to the system by a network, or other locations.
[0031] Data Protocol and Transport
[0032] In some embodiments, the oral hygiene device interface circuitry and the base station and / or camera device interface circuitry are wireless circuits, such as: GSM / UMTS and derivatives. In some embodiments, the data exchange circuitry of the base station uses a wireless protocol such as: GSM or other protocols.In some embodiments, the oral hygiene device may have a unique identifier to allow pairing of the mobile device and the toothbrush.
[0033] In other embodiments, the oral hygiene device interface circuit and the camera / base station interface circuit may use a wired connection. For example, the data exchange circuit connection to the network is wired. The identification data may be incorporated into a data packet that includes a stored signal from the sensor sent over the network. The identification may include a serial identification number of the oral hygiene device or head, a serial identification number of the base station, or a network address of the base station. In addition, the brushing monitoring data obtained during the measuring step may be time-stamped using data from an internal clock of the oral hygiene device.
[0034] In other embodiments, the network includes at least a wireless local area network (WLAN), and during the communicating step, the oral hygiene device transmits data to the mobile device via the WLAN. The WLAN can operate according to a communication protocol selected from Wi-Fi or Bluetooth protocols. The mobile device, camera or other computing device can also communicate with a local wireless LAN, and during the communicating step, the toothbrush transmits the data to the mobile device via the wireless LAN.
[0035] The LAN may include a server in communication with at least the toothbrush, and in the communicating step, the oral hygiene device may transmit the data to the mobile device by means of the server. The telecommunication network may also include a network of separate remote wireless LANs, the server communicating with at least one server via the remote network, and the mobile device also communicating with the server via the remote network.
[0036] The information exchanged between the oral hygiene device, the camera, the optical sensor device, the mobile device and / or the base station through the interface circuit may include data or commands, the data including stored, processed signals from the sensor, or raw data from the sensor. Information may be transmitted from the oral hygiene device to the base station, and conversely, from the base station to the toothbrush as needed. The data may also be a program or software upgrade to be stored and / or executed by the toothbrush. For example, upgrades and new firmware may be wirelessly downloaded and installed on the toothbrush.
[0037] Cloud server or local network data processing
[0038] In some embodiments, the system includes a server, and the stored, processed signals from the sensor or raw data from the sensor (including an optical sensor) are transmitted to the server via a network, the server including storage means for the transmitted processed signals and including computing components under the control of a program or software instructions. The program has instructions configured to send an erase command to the oral hygiene device via the network at the end of the transmission to erase the signals stored on the oral hygiene device that have been transmitted to the server. The server may also use the geolocation capabilities of the remote network and / or mobile device to determine the location of the oral hygiene device.
[0039] The server includes a memory for storing a history of continuously transmitted stored and processed signals from the oral hygiene device sensor and / or raw data from the sensor or one or more associated cameras and other devices. The program for controlling the computing components of the server includes software instructions for analyzing and comparing the stored and processed signals and for providing the calculation results from the analysis and comparison. The program for controlling the computing components of the server may include instructions for making the analysis results available for various computing devices (including mobile or stationary devices) by accessing the server through an Internet page or other various methods. The calculation analysis from the server can be directly transmitted or downloaded to the computing device via a network link 35, which can be formed by a dedicated communication device POA link 34 leading to the base station. Therefore, the calculation results from the server are transmitted to the mobile device via the network through the dedicated communication device POA, and then transmitted to the base station and / or the oral hygiene device via links 33, 31 and 32. When the oral hygiene device is in operation and communicating with the server, the server can update the software and / or parameters running and / or used in the oral hygiene device. Similarly, the server may update an application or parameters associated with the oral hygiene device and running on the mobile device.
[0040] User Profiles
[0041] The system may include a stored user profile associated with a tooth brushing (or other oral hygiene) activity, and the relevant data of the user profile includes the user's age, size, and gender. During or after the step of monitoring the oral hygiene (e.g., tooth brushing) activity, the oral hygiene device, mobile device, or server automatically attempts to match the user to at least one user profile based on the user profile and or past data, using at least one predetermined rule. If the user is not a regular user of the oral hygiene device, the user identifies him / her as a guest on the mobile device.
[0042] In the step of user identification, a specific user can be associated with the oral hygiene device and assumed to be the user. If multiple users use a given oral hygiene device, the user is associated with the brushing activity at least in the oral hygiene device and possibly in the mobile device and / or server for reference purposes for the latter two.
[0043] In embodiments using a camera, a user profile may have a user picture uploaded or associated with the profile. This would allow a vision-based recognition system to automatically determine the specific user associated with the profile.
[0044] Data Output
[0045] In some embodiments, the oral hygiene device transmits data in real time to a mobile device, a camera, an optical sensor device, or other computing device, and in a display step, the computing device displays information related to the data on a screen in real time, such as the user's immediate progress for an ongoing brushing event.
[0046] Calibration / initialization
[0047] In some embodiments, the oral hygiene device and / or camera may be calibrated in the factory, or by the user, or both. If the user performs the calibration step, the user may be guided in the process by information given, for example, by a display of the mobile device.
[0048] In particular, the user may calibrate the visual tracking system by following prompts from a base station or associated electronic devices (e.g., mobile and / or optical sensors). The prompts may be audio or provided through a user interface. The calibration procedure may request the user to stand at a certain distance from the oral hygiene device and move around in a brushing position until certain lights or audible tones are indicated. The system may calibrate oral hygiene devices with or without patterns, and with or without motion sensing electronics.
[0049] This calibration system can detect the size and shape of the oral hygiene device and the size and shape of the user's head, including the distance the user is standing away from the camera. In some embodiments, the user can pick up a calibration tool the size of a standard oral hygiene device to allow the camera (or other optical sensor) to properly calibrate the distance. In some embodiments, the motion data can be combined with the image data to calibrate the system simultaneously.
[0050] In an initialization step, the system may allow selection of a desired local wireless network or mobile device. This may be done automatically or with the help of a user, and these operations correspond to network pairing between the elements of the system communicating between them.
[0051] In some embodiments, the oral hygiene device may include: at least one pressure sensor; at least one acceleration sensor; a signal conditioning circuit for processing signals from the sensor; a memory circuit for storing the processed signals from the sensor; an oral hygiene device interface circuit for allowing information transmission between the oral hygiene device and a base station; an oral hygiene device power supply circuit for powering the sensor and the circuit of the toothbrush, the oral hygiene device power supply including a rechargeable power supply of the battery and / or capacitor type; and a control circuit for the operation of the oral hygiene device circuit. Preferably, the control circuit is configured to: upon detecting that a user is using a toothbrush, store the processed signals from the sensor in a memory, and, when the oral hygiene device is received in a base station, command the data exchange circuit of the base station to transmit the stored, processed signals from the sensor through a network, through the oral hygiene device and the interface circuit of the base station.
[0052] According to the present invention, the base station (and / or optical sensor device) comprises: a data exchange circuit with a network; a base station interface circuit adapted to exchange information with the oral hygiene device and / or the mobile device or other computing device; a power supply circuit for powering the base station circuit and for recharging the rechargeable power supply of the oral hygiene device when the oral hygiene device is received in the base station.
[0053] From another viewpoint of the same invention, the present invention provides a system and also a method for monitoring oral hygiene (e.g., brushing) activity using the system, which allows communication with a mobile communication device having a display and information input means, the oral hygiene device and the mobile device both communicating by radio with a telecommunications network, the telecommunications network being adapted to enable at least the mobile device to communicate with at least one further telecommunications device, the method comprising the steps of: (a) at least one brushing or oral hygiene activity monitoring step, wherein the oral hygiene device performs at least one measurement indicative of at least a user's brushing or other oral hygiene activity; (b) at least one two-way communication phase, during which: i) the user enters information in the mobile device and the mobile device transmits the information to the oral hygiene device via the telecommunications network, and ii) the oral hygiene device transmits data based on the brushing activity monitoring measurements to the mobile device via the telecommunications network; and (c) at least one display or feedback step, wherein the mobile device displays on its screen information based on the brushing (or other oral hygiene) activity monitoring data transmitted in the communication step. The displayed information may represent the output of calculations performed on the transmitted data, the calculations being performed in the mobile device or in a server.
[0054] The present disclosure provides a product and service that improves the purpose and / or motivation of a user to brush their teeth or perform other oral hygiene activities. Feedback is provided through an output device linked to the system. The system provides an oral hygiene device that includes a sensor that monitors the user's brushing activity and provides feedback to the user related to brushing. In some embodiments, a server may provide an application that uses and processes the data received from the sensor to provide output data related to brushing quality and other analysis. Finally, the application running on the server may process this output data to provide feedback to the user, thereby providing a playful / interesting dimension to enhance the motivation to brush or floss the user's teeth. BRIEF DESCRIPTION OF THE DRAWINGS
[0055] The present invention will now be described in conjunction with exemplary embodiments and the following drawings:
[0056] Figure 1 is a schematic diagram of the system of the present invention, and
[0057] Figure 2 is a schematic diagram of an oral hygiene device and an exemplary base station of the system.
[0058] Figure 3A is a perspective view of an oral hygiene device and head according to one embodiment of the present invention.
[0059] Figure 3B is a perspective view of an oral hygiene device handle and a replaceable head attachable to a head interface.
[0060] Figure 4 is a flow chart illustrating an embodiment of a process used in the present disclosure to record brushing or other hygiene data and provide feedback to the user.
[0061] Figure 5 is a diagram of an oral hygiene device and a base station, wherein the base station or other associated device has a magnetic field generator therein.
[0062] Figure 6 is a perspective view of an oral hygiene device and head having a visual pattern according to one embodiment of the present invention.
[0063] Figure 7 is a perspective view of a system identifying the location of a visually unpatterned oral hygiene device. DETAILED DESCRIPTION
[0064] Various examples of the present invention will now be described. The following description provides specific details for a thorough understanding and implementation of the description of these examples. However, it will be appreciated by those skilled in the relevant art that the present invention may be practiced without these details. Likewise, it will be appreciated by those skilled in the relevant art that the present invention may include many other various features not described in detail herein. In addition, some well-known structures or functions may not be shown or described in detail below in order to avoid unnecessary ambiguity in the relevant description.
[0065] The terminology used hereinafter is intended to be interpreted in its broadest reasonable manner, even though it is used in conjunction with the detailed description of certain specific examples of the invention. In fact, certain terms may even be emphasized hereinafter; however, any term that is intended to be interpreted in any limiting manner will also be clearly and specifically defined in this detailed description section.
[0066] Particular implementations of the subject matter have been described. Other implementations are within the scope of the following claims. In some cases, the actions recited in the claims can be performed in a different order and still achieve the desired results. Furthermore, the processes illustrated in the accompanying drawings do not necessarily require the particular order shown, or sequential order, to achieve the desired results.
[0067] Although this specification contains many specific implementation details, these details should not be interpreted as limitations on the scope of any invention or the content that may be claimed, but should be interpreted as descriptions of features specific to a particular implementation of a particular invention. Certain features described in this specification in the context of separate implementations may also be implemented in combination in a single implementation. Conversely, various features described in the context of a single implementation may also be implemented individually or in any suitable sub-combination in multiple implementations. In addition, although features may be described above as acting in the form of certain combinations, and even initially claimed as such, in some cases, one or more features from the claimed combination may be removed from the combination, and the claimed combination may be directed to a sub-combination or a variation of the sub-combination.
[0068] Similarly, although operations are depicted in a particular order in the accompanying drawings, this should not be understood as requiring that such operations be performed in the particular order shown or in a sequential order, or that all of the operations shown be performed to achieve the desired result. In some cases, multitasking and parallel processing can be advantageous. In addition, the separation of various system components in the above implementations should not be understood as requiring such separation in all implementations, and it should be understood that the described program components and systems can generally be integrated together in a single software product or packaged into multiple software products.
[0069] Figure 1An overview of the disclosed oral hygiene device monitoring and feedback system 100 is shown, the system 100 comprising: an oral hygiene device 1 equipped with a sensor; a base station 2 for receiving and charging the oral hygiene device 1; a mobile device 30 for wirelessly receiving / sending data; a dedicated wireless link POA 8; a server 4; and a network 3 for transmitting information from the server or between various other components of the system 100.
[0070] Data Communications
[0071] The oral hygiene device 1 may have an antenna 5 and a transceiver member for radio communication with a compatible complementary antenna 5 and transceiver member of the base station 2 via a radio link 31. The radio communication link 31 may be, for example, WiFi or GSM or Bluetooth or a derivative thereof or other proprietary protocol. In addition, one or more optical sensors 9 may communicate with a mobile phone 30, a base station 2, a server 4, or other associated computing devices as disclosed herein.
[0072] In another embodiment, the antenna and transceiver components are replaced or completed by a wired connection or connector to allow information to be exchanged between the oral hygiene device 1, the optical sensor 9 and / or the base station 2. The wired connector can also provide a power supply from the base station to the oral hygiene device 1 for recharging the rechargeable power supply of the latter. In another embodiment, the power supply from the base station to the oral hygiene device 1 or the optical sensor device 9 is provided by an electromagnetic induction circuit.
[0073] The base station 2 may be powered by a power cord. Alternatively, the base station 2 may be powered by a rechargeable battery that is occasionally charged by a battery charger powered by the power grid. The base station 2 has a storage slot for physically supporting and storing the toothbrush when the user is not using the toothbrush.
[0074] The base station 2 and or the separate optical sensor device 9 include data exchange circuits for communicating data with a network 3 (e.g., the Internet). In the case where the antenna 5 of the base station 2 and the dedicated communication device 8 or the antenna 5 of the POA are connected to the network 3, data can be transmitted using a radio communication link 31, such as Figure 1 In other embodiments, data transmission between the base station 2 and the network 3 is performed via a wired link (eg, ADSL).
[0075] The antenna 5 and transceiver components and / or the camera / optical sensing device 9 of the oral hygiene device 1 may also be compatible with the radio communication components of the mobile device 30 via a radio link 31. The radio communication link 31 is, for example, WiFi or GSM or Bluetooth or its derivatives or other suitable protocols. In some embodiments, the radio link 31 is a short-range, local, radio communication link or a radio link 35 such as the radio links used in cellular or other mobile phone systems (e.g., GSM and derivatives).
[0076] The mobile device 30 can also exchange data on a radio link 31 via its radio communication circuit, over the network 3 through a dedicated communication device 8 or a POA. Additionally or alternatively, the mobile device 30 can exchange data on a radio link 35 directly over the network 3.
[0077] The server 4 is connected to the network 3 by any suitable means. The server 4 is broadly defined as including a computing device capable of performing storage and computing operations, for example, on a "cloud" in a computing network. The server 4 may include storage devices, such as memory, hard drives, flash memory or other storage devices, and includes computing components under program control. To transmit data, the oral hygiene device control circuit uses a predetermined server 4 address of the network 3. This predetermined address may be initially stored in the oral hygiene device 1 and / or updated later via the network 3. Data transmission between the oral hygiene device 1 and the server 4 may be performed a) each time the oral hygiene device 1 is replaced in the base station 2 in a batch configuration; b) at the direction of the user or server 4, such as by a user action to initiate transmission using an interface of the mobile device 30 or accessing a web page of the server 4; or c) in real time when oral hygiene device 1 activity is detected; or d) when the oral hygiene device 1 is removed from the base station 2; or e) at other suitable intervals.
[0078] System circuit design and network architecture
[0079] like Figure 2 As shown, the oral hygiene device 1 may include a pressure sensor 10 and at least one motion sensor 11. The pressure sensor 10 detects the force applied to the brushing side of the oral hygiene device 1 when the user applies the bristles to their teeth. The motion sensor 11 may be provided for detecting the movement of the oral hygiene device 1 in any or all three orthogonal axes, or the motion sensor may be capable of detecting acceleration or other motion characteristics in all three axes. The signal output by the sensor is processed by a signal conditioning circuit 12. Examples of signal conditioning include: frequency and noise filtering, amplification, conversion, digital signal processing, and other techniques for optimizing the detected signal for analysis.
[0080] On other embodiments, the oral hygiene device 1 may not include any electronics and may be a standard toothbrush. In those embodiments, a separate optical sensor 9 may perform the task of tracking the movement of the oral hygiene device 1 .
[0081] The processed signals or raw data from the sensors are then stored in a memory 14 as determined by the control system 13, which may be a digital signal processor, microcontroller or other processing component and whose operation is controlled by a program 15. The memory 14 may be included in the oral hygiene device 1 or on the server 4 or other component of the system 100. The program 15 may be updated via the oral hygiene device 1 interface circuit 16, a modem for radio communications, and its antenna 5 (and / or a connector in the case of a contact / wired interface) or other interface of the oral hygiene device 1. More generally, the oral hygiene device interface circuit 16 allows information to be exchanged between the oral hygiene device 1, the optical sensor device 9 and the base station 2 when a radio link 31 is established (and / or the connector of the toothbrush and the connector of the base station are paired together). The oral hygiene device 1 may include a power supply circuit for powering the sensors and circuits of the oral hygiene device 1, and it may include a rechargeable power supply 17.
[0082] The base station 2 may include a base station interface circuit 20, a modem for radio communication, the modem having an antenna 5 (and / or connector) for exchanging information via a link 31. In addition, the base station interface circuit 20 is capable of establishing a radio link 31 with a dedicated communication device 8 for communicating with the network 3. The base station 2 may use a power converter 22, which is regulated 21 to provide appropriate voltage and current to the base station circuit. An electrical connection (not shown) may be provided for providing charging current from the base station 2 to the oral hygiene device 1. In some embodiments, the base station 2 may include a recharging circuit for recharging a battery or power supply of the toothbrush by inductive charging or direct electrical connection.
[0083] The base station 2, optical sensing device 9 or other separate electronic device may also include a magnetic field transmitter 110 that transmits a magnetic field that can be sensed by an associated magnetometer or other magnetic field sensor 11. The magnetic field transmitter 110 can be provided by using charging circuits or other circuits that are already present in the base station 2 or other electronic device. For example, the base station 2 may have a recharging coil that can also be used as a magnetic field transmitter 110. The recharging coil can be fixed and in a known orientation so as to produce a magnetic field with a known strength and polarity orientation. In some embodiments, the base station 2 may include a recharging coil that produces a magnetic field with a polar axis located in a horizontal or vertical plane. In some embodiments, this can be a single-axis magnetic field transmitter 110, such as in the case of a single-axis recharging coil. In other embodiments, a 2-axis or 3-axis magnetic field transmitter 110 can be incorporated into the base station 2. This will advantageously allow one or more fixed magnetic fields with a known orientation to be obtained, so that the magnetometer 11 on the oral hygiene device 1 can sense the strength and polarity of the one or more magnetic fields to provide information about the position and orientation of the oral hygiene device 1 or relative changes in position and orientation.
[0084] In some embodiments, the base station 2 or other electronic device separate from the oral hygiene device 1 may also include a camera 9 that can detect visual patterns on the oral hygiene device 1. The camera 9 can be any suitable camera that can detect visual patterns on the oral hygiene device 1. For example, a camera provided with a mobile phone would be suitable. In other embodiments, a separate camera or optical sensing device 9, a separate camera holder for a mobile phone, a connected mirror, or other camera or imaging device can be used.
[0085] In some embodiments, the base station 2 is passive and the circuitry of the base station 2 is under the control of the controller 13 of the oral hygiene device 1 when the base station 2 and the oral hygiene device 1 communicate together, particularly when the link 31 is of the wired / contact type implemented by a connector. Figure 2 In the embodiment presented, the base station has a control system 19 which controls its operation.
[0086] The dedicated communication device 8 may comprise a radio modem circuit 27 and appropriate electronics for communicating with the network 3. The dedicated communication device 8 is capable of establishing a radio link 31 with a base station 2 and / or establishing a radio link 31 with a mobile device.
[0087] The mobile device 30 comprises at least a radio modem 26 for establishing a radio link 31. The operation of the mobile device 30 is under the control of a control system 25 (e.g. a central processing unit or μC) and a program 15. The mobile device 30 comprises output means (such as a display screen) and input means (such as a virtual or real keyboard). Preferably, the input means and the output means of the mobile device 30 are used in the system for inputting information and for displaying information, in particular the results of calculations performed by the server. The mobile device 30 may also comprise a camera 9 capable of detecting a visual pattern supplied on the oral hygiene device for detecting movement.
[0088] The programming of the computing means of the server 4 allows for the storage of signals received from the oral hygiene device 1. In addition, the server 4 can analyze the data from the sensors to generate feedback and motivational data about the user's performance in brushing their teeth. These results can be accessible to the user on an Internet page hosted by the server 4, or can be transmitted to another network server for hosting. In different embodiments, the previous operations and calculations are completed completely or partially in the mobile device 30, while the server 4 is used for general monitoring.
[0089] First, it should be understood that the disclosure herein can be implemented with any type of hardware and / or software, and can be a pre-programmed general-purpose computing device. For example, the system can be implemented using a server, a personal computer, a portable computer, a thin client, or any suitable one or more devices. The disclosure and / or its components can be a single device at a single location or multiple devices at a single or multiple locations, and the multiple devices are connected together using any appropriate communication protocol via any communication medium (e.g., cable, fiber optic cable) or wirelessly.
[0090] It should also be noted that the present disclosure is shown and discussed herein as having multiple modules that perform specific functions. It should be understood that these modules are only schematically shown based on their functions for the purpose of clarity, and do not necessarily represent specific hardware or software. In this regard, these modules can be hardware and / or software that are implemented to basically perform the specific functions discussed. In addition, modules can be combined together within the present disclosure, or divided into other modules based on desired specific functions. Therefore, the present disclosure should not be interpreted as limiting the present invention, but should only be understood as showing an exemplary implementation thereof.
[0091] A computing system may include a client and a server. The client and the server are generally remote from each other and typically interact through a communication network. The client-server relationship arises from computer programs running on respective computers and having a client-server relationship to each other. In some implementations, the server transmits data (e.g., an HTML page) to a client device (e.g., for the purpose of displaying data to a user interacting with the client device and receiving user input from the user). Data generated at the client device (e.g., a result of a user interaction) may be received at the server from the client device.
[0092] Implementations of the subject matter described in this specification may be implemented in a computing system that includes a back-end component (e.g., as a data server), or includes a middleware component (e.g., an application server), or includes a front-end component (e.g., a client computer with a graphical user interface or a web browser through which a user can interact with an implementation of the subject matter described in this specification), or includes any combination of one or more such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include local area networks ("LANs") and wide area networks ("WANs"), cross-networks (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks).
[0093] The implementation and operation of the subject matter described in this specification may be implemented in digital electronic circuits, or in computer software, firmware or hardware (including the structures disclosed in this specification and their structural equivalents), or in a combination of one or more of them. The implementation of the subject matter described in this specification may be implemented as one or more computer programs, that is, one or more modules of computer program instructions encoded on a computer storage medium for execution by a data processing device or for controlling the operation of the data processing device. Alternatively or additionally, the program instructions may be encoded on an artificially generated propagation signal, such as an electrical signal, optical signal or electromagnetic signal generated by a machine generated to encode information for transmission to a suitable receiver device for execution by a data processing device. The computer storage medium may be a computer-readable storage device, a computer-readable storage substrate, a random or serial access memory array or device, or a combination of one or more of them, or may be included therein. In addition, although the computer storage medium is not a propagation signal, the computer storage medium may be the source or destination of the computer program instructions encoded in the artificially generated propagation signal. The computer storage medium may also be, or may be included in, one or more separate physical components or media (eg, multiple CDs, disks, or other storage devices).
[0094] The operations described in this specification may be implemented as operations performed by a "data processing apparatus" on data stored on one or more computer-readable storage devices or received from other sources.
[0095] The term "data processing equipment" encompasses all kinds of equipment, devices and machines for processing data, including (by way of example) a programmable processor, a computer, a system on a chip, or a plurality of the foregoing, or a combination of the foregoing. The equipment may include a dedicated logic circuit, such as an FPGA (field programmable gate array) or an ASIC (application specific integrated circuit). In addition to hardware, the equipment may also include code that creates an execution environment for the computer program in question, for example, code that constitutes processor firmware, a protocol stack, a database management system, an operating system, a cross-platform runtime environment, a virtual machine, or a combination of one or more of them. The equipment and execution environment may implement a variety of different computing model infrastructures, such as network services, distributed computing, and grid computing infrastructures.
[0096] A computer program (also referred to as a program, software, software application, script, or code) can be written in any form of programming language (including compiled or interpreted languages, declarative or procedural languages) and can be deployed in any form, including as a stand-alone program or as a module, component, subroutine, object, or other unit suitable for use in a computing environment. A computer program may, but need not, correspond to a file in a file system. A program may be stored in a portion of a file that holds other programs or data (e.g., one or more scripts stored in a markup language document), in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files that store portions of one or more modules, subroutines, or codes). A computer program may be deployed to execute on one computer or on multiple computers that are located at one site or distributed across multiple sites and interconnected by a communication network.
[0097] The processes and logic flows described in this specification can be performed by one or more programmable processors that execute one or more computer programs to perform actions by operating on input data and generating output. The processes and logic flows can also be performed by special-purpose logic circuits (e.g., FPGAs (field programmable gate arrays) or ASICs (application-specific integrated circuits)), and the devices can also be implemented as such special-purpose logic circuits.
[0098] Processors suitable for executing computer programs include (by way of example) general and special purpose two kinds of microprocessors and any one or more processors of any kind of digital computer. In general, the processor will receive instructions and data from a read-only memory or a random access memory or both. The basic element of a computer is a processor for performing actions according to instructions and one or more memory devices for storing instructions and data. In general, a computer will also include one or more large-capacity storage devices (e.g., disks, magneto-optical disks, or optical disks) for storing data, or be operably connected to receive data from it, or to transmit data to it, or to perform both. However, a computer does not necessarily have such a device. In addition, a computer may be embedded in another device, such as a mobile phone, a personal digital assistant (PDA), a mobile audio or video player, a game console, a global positioning system (GPS) receiver, or a portable storage device (e.g., a universal serial bus (USB) flash drive), just to name a few. Devices suitable for storing computer program instructions and data include all forms of non-volatile memory, media and storage devices, including by way of example semiconductor memory devices (e.g., EPROM, EEPROM and flash memory devices); magnetic disks (e.g., internal hard disks or removable disks); magneto-optical disks; and CD ROM and DVD-ROM disks. The processor and memory may be supplemented by, or incorporated in, special purpose logic circuitry.
[0099] Oral hygiene device Oral hygiene device design
[0100] As shown in FIG3 , the oral hygiene device 1 may include a handle 40 and a head 42 that can be removably connected to the handle 40. The handle 40 may include a motor that is mechanically connected to the head 42 and, when activated, causes the head 42 to vibrate or move in a manner that brushes the user's teeth when placed in the oral cavity. The handle 40 includes a head interface 46 that removably connects various heads 42 to the handle 40. The head interface 40 includes leads 48 for transmitting both data and power to various heads 42. For example, some heads 42 may include sensors that require power and data transmission, and therefore power may be routed from the power supply of the handle 40 to the head 42 by the leads 48 that form a connection with the head 42 at the head interface 46. There may be various numbers of leads 48 that form a connection on the head interface 46, such as two leads 48 for power, and two leads 48 for data, three leads 48 for power, three leads 48 for data, and other various numbers of leads. In some embodiments, the header interface 46 will form a watertight seal with the header 42 to prevent water from entering the interface and interfering with power and data transmission by the electrical leads 48 .
[0101] In some embodiments, most of the circuitry and expensive components may be contained within the handle 40 rather than within the head 42, which may be disposable after a certain number of uses. This will minimize the cost of replacing the head 42. For example, in some embodiments, the battery, controller 13 may be contained in the handle 40, and any sensor probes and circuitry for connecting the sensor probes may be contained in the head 42. In other embodiments, the head 42 may contain no circuitry or electrical components, and will provide a mechanical brushing function solely by supporting the bristles.
[0102] In some embodiments, the oral hygiene device 1 may be just a standard toothbrush, or other standard oral hygiene device 1 that is commercially available and may not have electronics, or may only have electronics for moving the head to facilitate brushing. In some embodiments, the oral hygiene device 1 may only include a pattern 120 or an accessory 130 with a pattern 120, and may not include any motion sensing electronics, or may not include any electronics at all. Therefore, in these embodiments, visual tracking software may be used to determine the position and orientation of the oral hygiene device 1.
[0103] The oral hygiene device 1 may also include a speaker 50 and various visual indicators 52 to provide audio and visual feedback to the user. For example, the handle 40 may include a speaker 50 for playing music, substantive feedback, motivational phrases, elapsed remaining time, suggestions about brushing pressure, suggestions about whether certain quadrants have not been adequately brushed, notifications for completion of brushing, etc. In addition, the oral hygiene device 1 may include any number of visual indicators 52 for providing substantive feedback about brushing (including elapsed time), LED indicators for indicating when brushing is complete, warning indicators for improper brushing, including indicators for whether each quadrant has been addressed. In other embodiments, the oral hygiene device 1 may also use bone conduction to convey audio messages to the user.
[0104] like Figure 6 As shown, the oral hygiene device 1 can include a handle 40 and a head 42, either or both of which can include a pattern 120 for visual detection of movement and orientation by an associated camera 9. For example, in some embodiments, the back of the head 42 can include a pattern (i.e., "AB" with circles and lines as shown). In other embodiments, the pattern 120 can be included on an attachment 130 that can be attached to the head or attached to the neck, painted in the bristles, or elsewhere.
[0105] The handle 40 may also include the pattern 120, or in some embodiments, may be the only component that includes the pattern 120. The pattern 120 on the handle 40 may be applied directly to the handle 40, or may be located in an attachment 130 that clamps the end of the handle 40 or is connected thereto. The pattern 120 may be located at a convenient location on the attachment 130 or on the handle 40 so that the pattern 120 can be detected at all angles of normal brushing activity. In some embodiments, the handle 40 may include multiple patterns 120 of different sizes for detecting different orientations. For example, in some embodiments, the attachment 130 may be square or circular and have a different pattern 120 on each side to facilitate the system to detect the orientation of the oral hygiene device relative to the camera.
[0106] The attachment 130 can be weighted so that the oral hygiene device 1 stands on its own when placed on a flat surface. For example, a weight 130 can be applied to the bottom of the attachment 130 that is heavy enough to keep the oral hygiene device 1 upright. In some embodiments, this can be particularly useful if the attachment 130 is spherical at the bottom. This will make the oral hygiene device entertaining, which is attractive to children and even adults.
[0107] The pattern 120 may be applied using painting, other marking processes, or it may use a reflective coating, a mirror, or a fluorescent coating. In some embodiments, the pattern 120 may use color, or it may be grayscale.
[0108] Oral hygiene device without graphics or electronics
[0109] A standard oral hygiene device 1 or an oral hygiene device without any electronics or graphics may be used. As indicated, in some embodiments, the position and movement of the oral hygiene device 1 will be detected.
[0110] sensor
[0111] The oral hygiene device 1 or a separate electronic device (e.g., an optical sensor) may incorporate various sensors that detect certain properties of brushing, which may be analyzed to provide various feedback and other motivational information to the user. For example, one or more optical sensors 9 may also be used on a separate electronic device to detect the orientation and movement of the oral hygiene device 1. For example, an optical sensor 9 may be used to capture an image of the oral hygiene device 1, and the image may be sent for processing to identify its boundaries, shape, longitudinal axis, and orientation (e.g., by identifying its bristles). In some embodiments, one or more optical sensors 9 may be used to detect a pattern on the oral hygiene device 1 rather than the oral hygiene device 1 itself. The one or more optical sensors 9 used for pattern detection may be oriented in a direction for providing a visual line of sight to a pattern 120 on the oral hygiene device 1, which may be on the head 42, handle 40, or attachment 130.
[0112] As another example, oral hygiene device 1 may be incorporated with various motion sensors 11 to determine the brushing quality of certain quadrants or even individual teeth relative to the mouth. Motion sensor 11 may include gyroscopes, accelerometers, magnetometers, gyroscopes, and other various sensors capable of detecting position, movement, and acceleration. These various motion sensors 11 may be incorporated in handle 40 or head 42. However, in the embodiment where head 42 and therefore any acceleration or other motion sensor will experience many other motions that may interfere with the detection of position, it may be advantageous to place motion sensor 11 in handle 40. In certain embodiments, magnetometers will sense one or more vectors of the earth's magnetic field. In certain embodiments, a three-axis magnetometer will be used, and in other embodiments, a two-axis or single-axis magnetometer will be used.
[0113] A magnetic field generator 110 may also be used to generate a known magnetic field with a known polarity that can be sensed by a magnetometer incorporated into the oral hygiene device 1. The magnetic field transmitter 110 may be placed inside the base station 2, which may already have a recharging coil and / or interface circuit 20 that can be used to generate a detectable magnetic field. In other embodiments, the magnetic field transmitter 110 may be a separate electronic component in the base station 2 or in a separate physical component entirely. In some embodiments, the magnetic field transmitter 110 will be in a stationary unit with a known orientation.
[0114] The oral hygiene device 1 may also include various proximity sensors that detect the proximity of the oral hygiene device 1 to the user's mouth. These may be incorporated at the head 42 or in the handle 40. The proximity sensors may be used to obtain additional position information relevant to determining the user's brushing quality.
[0115] Additionally, the oral hygiene device 1 may include a pressure sensor 10 to determine if the user is applying appropriate pressure when brushing their teeth. The pressure sensor 10 may be incorporated into the head 42, which may be more flexible or may use a simple pressure transducer or other component capable of measuring pressure.
[0116] In some embodiments, the various heads 42 may incorporate cameras 56 that will detect various aspects of tooth quality that may or may not be related to brushing quality. For example, it may be possible to use cameras 56 (including near infrared cameras 56) on the oral hygiene device 1 to collect data indicative of demineralization or tooth decay or caries. For example, the oral hygiene device 1 may use certain wavelengths that are particularly suitable for detecting these abnormalities, such as in the range of 1300nm-1400nm. In some embodiments, the oral hygiene device 1 may also include a light source 58 that will be focused toward the teeth during brushing and can be used by the camera to detect certain abnormalities.
[0117] Certain cameras 56 and possibly light sources 58 may also be implemented to detect plaque levels on the teeth and changes in plaque levels during brushing. In certain embodiments, an infrared or near infrared light source 58 and an appropriate camera 56 that detects and records light in this wavelength range may potentially allow for detection of plaque.
[0118] Program for swiping analysis and feedback
[0119] The various sensors and optical sensors of the system can collect data related to the quality of brushing performed by the user or the overall dental health of the user's teeth. This data can then be processed using programs or applications installed in various parts of the oral hygiene device monitoring system 100. Therefore, as described above, the data from the sensors and optical sensors can be processed by a program executed by the control system 13 of the oral hygiene device 1, or alternatively, by a processor on the mobile device 30, another associated computing device, or server 4. The processing and analysis of the data by the system 100 will produce output data representing feedback related to the user's brushing quality. This feedback can be communicated visually on the oral hygiene device 1 indicator 52, or on the associated mobile device 30 or on a website hosted by or in communication with the server 4. In these two ways, it is communicated.
[0120] Figure 4An example of a process used by the oral hygiene device 1 to evaluate the brushing quality of a particular user is shown. Each step may not be required in a particular embodiment, but various combinations of these steps may be implemented in the oral hygiene device monitoring system 100. First, the user may enter a user profile 70 into the oral hygiene device monitoring system 100 to allow the user to calibrate the oral hygiene device 72. In some embodiments, the oral hygiene device 1 may be calibrated at the factory, by the user, or in both ways. After calibration, the user may pick up the oral hygiene device 1 and begin brushing her teeth. The oral hygiene device or an associated monitoring device (e.g., a camera) will then determine that brushing has begun 74 and begin recording sensor data 76 during brushing. The oral hygiene device monitoring system 100 may then analyze the sensor data 78 to output brushing quality feedback 80 to the user.
[0121] User Profiles
[0122] Thus, a user profile 60 may be entered 70 for each specific user of a particular oral hygiene device 1 or associated with a specific account stored on a server 4, an oral hygiene device, a base station, or other computing device. When a new oral hygiene device or a new account on a server 4 is initialized, a user may enter their information that can be used to determine optimal brushing times and characteristics. For example, the program 15 may first request the user's name, gender, height, weight, age, and certain questions about their dental history. The user profile 60 may then be associated with certain data recorded during the user's use of the oral hygiene device, including calibration data that is specific to a certain oral hygiene device 1, an associated optical sensor 9, or is generic and applicable to any oral hygiene device 1 or optical sensor 9 connected to the system 100. In some embodiments, a user may upload a picture of themselves, or may initiate a program that uses one or more optical sensors 9 to capture a picture of the user from a distance from which the user would typically brush their teeth.
[0123] Detection and use
[0124] The toothbrush monitoring system 100 can also determine whether use has occurred and the number of uses per day. In some embodiments, the oral hygiene device 1 and / or the optical sensor detection system detects motion data via the motion sensor 11 and / or the optical sensor 9 and analyzes the data to determine whether use has occurred, or to determine whether the toothbrush has been moved or is pretending to be used.
[0125] When motion indicative of use is detected, the oral hygiene device 1 or optical sensor device 9 may store the position and motion data in its memory 14 for later analysis. This will prevent false positives from being recorded (such as when a user moves the toothbrush in a medicine cabinet), or prevent a child from fooling the system by briefly shaking the toothbrush, for example.
[0126] For example, the movement indicating use may be associated with a certain acceleration level and / or frequency that is specific to a particular user. In other embodiments, the user may push a button or switch on the oral hygiene device 1, the base station 2, or a device with an optical sensor 9 to wake up the sensor on the device, which will then begin recording data. Thus, the system will determine when to start brushing 74. In some embodiments, this will be performed automatically, for example, when certain accelerations and frequencies are detected. Thus, once the user picks up the toothbrush, the motion sensor 11 may begin recording data 76 and send it to any of the various control systems 13 in the system 100 to analyze the data 78 for characteristics associated with brushing.
[0127] For example, the oral hygiene device 1 will generally rest on its base 2 facing upward before use, in an orientation that is not suitable for brushing by a user holding the oral hygiene device 1. Therefore, once the user picks up the oral hygiene device 1, the oral hygiene device 1 will generally rotate approximately 45 degrees so as to remain primarily horizontal during brushing. Therefore, a threshold criterion for determining the start of brushing 74 will be whether the oral hygiene device 1 has tilted within a certain angle range indicating that the oral hygiene device 1 is horizontal or nearly horizontal. This can be an angle range of 20 degrees, 5 degrees, 10 degrees or other suitable range. In addition, a series of calibration processes can indicate a suitable range. Of course, this can be detected by the optical sensor 9 and / or the motion sensor 11.
[0128] In some embodiments, the user may turn on the device and the optical sensor 9 may begin recording. The system may then look to determine when the pattern 120 is at a certain height indicating that it is close to the user's mouth. This may be combined with the acceleration information detected by the one or more optical sensors 9 and analyzed as above for the motion sensor 11.
[0129] In other embodiments, the determination of whether brushing has begun 74 and the determination of whether brushing has stopped may be performed by the system 100 using a statistical analysis of the motion data from the motion sensor 11 and / or the optical sensor 9. This statistical analysis may be performed by correlating the data from the motion sensor 11 and / or the optical sensor 9 with previous brushing or calibration data, or stored data from other users. For example, after performing the analysis, a certain threshold of correlation of the motion data with previously recorded calibration data associated with use may be determined, indicating that brushing has begun 74 or is ongoing. Thus, once the user begins brushing, the system 100 may record that use has begun 74 and record the data 76 in the memory 14 as brushing data until use ceases, such as after the correlation drops below a certain threshold.
[0130] For example, using an optical sensor 9 system setup, the optical sensor 9 can output data including an image of an oral hygiene device (e.g., a toothbrush or water flosser) and a user. The data can be sent to various control systems for processing and analysis for motion. For example, an image processing algorithm can first determine boundary conditions to identify the boundaries of the user's lips / mouth, teeth, head, oral hygiene device, handle, head, bristles, water flosser, etc.
[0131] The boundaries of human features can be identified using standard boundary identification algorithms, which generally use threshold changes in certain colors (light frequencies). Once the boundaries of the oral hygiene device 1 are identified, the longitudinal axis can be identified, and potentially the orientation of the bristles (if the oral hygiene device 1 is a toothbrush) to determine the angular orientation about the longitudinal axis. This will allow the system to determine the general orientation and movement of the toothbrush using time-stamped frames from the imaging device.
[0132] Then, by analyzing the relative position of the toothbrush and the characteristics of the mouth, the toothbrush can be identified as being on a certain side of the mouth. In addition, the orientation of the toothbrush relative to the side of the mouth in which it is located can be used to determine which section or portion of the user's teeth is being brushed or line cleaned. For example, if the bottom of the upper molars is being brushed on the right side, the visual system will determine that the toothbrush is on the right side of the mouth with the bristles facing upward.
[0133] Furthermore, once the shape and orientation of the toothbrush 1 is determined in each frame, the timestamp of each frame can be used to determine the motion of the toothbrush. For example, the change in position (time and distance) can calculate the velocity and acceleration of the change. Thus, as with the motion sensor 11, the image data can be used to determine the motion of the oral hygiene device. Thus, the motion can be used to determine compliance with brushing or other oral hygiene standards as further disclosed herein.
[0134] Analysis of the motion data (processed image data from the motion sensor 11 or from the optical sensor 9) may use a fingerprint or signature type of analysis that compares only relative motion. Because the brushing motion is typically performed in a relatively rapid motion that is not characteristic of any other incidental movement of the oral hygiene device 1 (e.g., placing it back in a cabinet), signatures may be determined based on acceleration in certain axes (as detected by the motion sensor 11, time stamped image data, or other methods). Additionally, because brushing is typically a rapid periodic motion, the frequency of brushing may be monitored, and therefore various bandpass frequencies, low pass and Kalman filters or other techniques may be used to identify certain frequencies of interest and amplitudes in those frequencies that are indicative of brushing.
[0135] The amplitudes of these frequencies may be certain frequencies that reach a threshold amplitude that are associated or determined to indicate that the user is brushing. For example, the system 100 may require certain frequencies on the horizontal or vertical axis to determine that brushing has begun 74, or the system may require certain periodic accelerations that reach a certain threshold to determine that brushing has begun 74. In some embodiments, this may be a frequency of 1 Hz-5 Hz. Once the data analyzed by the controller 13 drops below a certain threshold indicating use, the system 100 may stop recording data or determine that brushing has stopped.
[0136] In addition to statistical analysis, the system can detect movement indicative of use or actual brushing by using filtering and threshold analysis. For example, the system 100 can first filter the data from the motion sensor 11 to only pass frequencies in a certain frequency band (because brushing is periodic), and monitor those frequencies to detect when the signal in one of them reaches a threshold for at least a certain number of cycles or durations to determine that the user is brushing. For example, if the user brushes at an average of 1 Hz-5 Hz (or possibly lower in the case of an electric toothbrush), a 1 Hz-5 Hz bandpass filter can be implemented.
[0137] Thus, when the system 100 detects an amplitude reaching a threshold indicating use within a frequency band in the range of 1 Hz-5 Hz, the controller 13 may begin recording data from the sensor in the memory 14, with the continued motion data indicating the duration of time that the oral hygiene device 1 is being used. Additionally, periodic accelerations in certain axes or angular accelerations reaching certain threshold amplitudes (for circular brushing) may also be used to indicate that brushing has begun. Analysis of the data may also be affected by whether the oral hygiene device 1 includes a motor to vibrate the head to assist in brushing. In those embodiments, the data may be filtered to eliminate high frequency accelerations and other noise generated by the motor.
[0138] In some embodiments, the quality of brushing may be determined based on the type of motions the user performs with the oral hygiene device 1. Dentists indicate that certain motions are more conducive to brushing, including circular motions in both clockwise and counterclockwise directions, from tip to root, and from left to right.
[0139] The system 100 can determine whether the relative amounts of these movements are being performed by filtering the data from the motion sensor 11 or optical sensor 9 on certain axes indicative of each movement. For example, the data from the motion sensor 11 or optical sensor 9 on an axis horizontal to gravity can be filtered, and the control system 13 or other system 100 processor can process the data to determine whether the acceleration, frequency, or other motion data reaches an amplitude in a certain direction sufficient to indicate that a particular movement is being performed.
[0140] In the case of image data, in addition to detecting a threshold value indicating acceleration or speed of brushing, the optical system can also detect when the oral hygiene device 1 is within a certain proximity to the user's mouth or within the user's mouth to determine that brushing has begun. For example, if the head can be identified whenever it is within an area defined as being within the user's mouth, the system can determine that the user is brushing his or her teeth with high confidence.
[0141] In other examples, acceleration may be used alone to determine whether a back-and-forth motion or a circular motion is being used. In other embodiments, acceleration data from the motion sensor 11 may be integrated to determine the actual motion of the oral hygiene device 1 in order to assess the type of brushing being used. Analysis of the data may also be affected by whether the oral hygiene device 1 includes a motor to vibrate the head to assist in brushing. In those embodiments, the data may be filtered to eliminate high frequency acceleration and other noise generated by the motor.
[0142] In some embodiments, a motor may be included in the oral hygiene device 1 for vibrating the head 42. In those embodiments, the motion data recorded by the sensor related to the brushing movement will have a smaller amplitude than the manual brush 1. This is because without the assistance of the motor and the movable head 42, the user of the manual toothbrush will brush their teeth with a more vigorous motion. Therefore, the algorithm used to analyze the motion data to detect the use, movement and position of the oral hygiene device will be modified to take into account the lower amplitude and / or different movements and include filtering of high-frequency noise from the motor. Therefore, in some embodiments, the threshold set for the amplitude required to detect or indicate brush wipes will be less because users of electronic oral hygiene devices generally move the brush at a slower pace and make more straight-line movements.
[0143] In addition, the pressure sensor 10 (or in combination with the motion data from above) can also be used to determine whether brushing is actually being performed. For example, the user may be moving the oral hygiene device 1 around the teeth instead of pressing it on the teeth. Therefore, accordingly, requiring the movement to have a certain frequency, amplitude or characteristic and a certain pressure will eliminate many false alarms caused by accidental movement or pressure of the toothbrush that does not occur during brushing. Therefore, the pressure sensor 10 can output a signal, which is analyzed 78 by the controller 28 to determine the pressure being applied to the teeth. If the pressure is above a certain threshold, the system 100 can indicate or determine that the user is likely to be brushing. This analysis can be performed by statistical analysis, threshold analysis or other suitable calculation methods to determine the possibility of brushing based on the amount and / or continuity of the pressure recorded by the pressure sensor 10.
[0144] Usage monitoring of replaceable heads
[0145] Additionally, the total number of uses of the replaceable oral hygiene device 1 head 42 may be detected and stored in a memory 13 of the oral hygiene device 1 or associated with the server 4 to monitor the useful life of a single oral hygiene device 1 head 42. Thus, once a particular oral hygiene device 1 head 42 has been used a certain number of times or durations, the system 100 may provide a notification to the user, such as on the user's mobile device 30 or through a web interface to the server 4. Once a head 42 has been exhausted, the user will disconnect and reconnect a new head 42, which may be interpreted or recorded by the system 100 as attaching a new oral hygiene device 1. Additionally, each head 42 may include a unique identification module 62 that stores an identifier for that particular head 42, such that when the same head 42 is reattached, such as for cleaning or other purposes, the system 100 will not assume that a new head 42 has been attached.
[0146] Brushing time and location
[0147] Next, the brushing data recorded above 78 can be analyzed to provide feedback 80 on the position, timing, and quality of brushing. This can be presented after brushing is completed, or presented in real time to provide immediate feedback to the user. For example, the motion sensor 11 and / or the optical sensor 9 can detect position information of the oral hygiene device 1. Using accelerometer and gyroscope data, visually detected data from the optical sensor 9 or other motion sensor 11, and the pattern 120, the position, orientation, and movement of the oral hygiene device 1 can be determined and extrapolated to calculate the relative position movement of the head 42. For example, if the distance, orientation, and direction of the bristle portion of the motion sensor 11 relative to the head 42 are known, then the system 11 will be able to determine the position of the head 42 and its relative movement, orientation, and coverage area based on the relative movement of the motion sensor 11.
[0148] This can be calculated by initially calculating the reference coordinates of the oral hygiene device 1 when the motion is detected, and recording the relative movement relative to the initial coordinates to determine the characteristics of the brushing. This can be performed by calculating the movement of the head 42 by calculating the changes in the orientation and movement of the toothbrush due to the acceleration recorded by the gyroscope or accelerometer or visually detected by the optical sensor 9. These calculations can be performed by the control system 13 or other processors used in the system 100, including a mobile phone processor executing an application on a mobile phone, or one or more processors running software for analyzing the data on a server.
[0149] Swipe time and location - magnetometer
[0150] In some embodiments, the magnetometer sensor 11 can provide additional location information by detecting the polarity, direction vector and strength of the earth's magnetic field or the magnetic field generated by the magnetic field transmitter 110. In some embodiments, this can be a magnetic field transmitter 110 located in the base station 2, because the base station 2 is stationary and the magnetic field transmitter 110 will have a known polarity and direction (for example, horizontal or vertical and in a certain direction). This can be detected by the magnetometer 11 located in the oral hygiene device 1. Therefore, the strength of the magnetic field detected by the magnetometer sensor 11 will give an estimate of the distance of the oral hygiene device 1 from the base station 2 along a spherical or elliptical curve or egg-shaped curve, which represents the magnetic field lines around the base station 2 or other associated devices.
[0151] In addition, the magnetometer will be able to sense the vector direction of the magnetic field along the magnetic field line. In other embodiments, the distance of the oral hygiene device 1 from the base station 2 can be calculated using the orientation of the magnetic field emitted by the magnetic field transmitter 110 detected by the magnetometer sensor 11 and the spatial orientation information of the accelerometer and the gyroscope. This is possible using the shape of the magnetic field at a specific distance from the transmitter and its vector, as well as the knowledge of its polarity. For example, the inclination of the magnetic field relative to gravity will change predictably at different distances from the magnetic field transmitter, for example. In addition, by comparing the gravity vector with the magnetic field vector, the angle can be used to calculate the height along the shell or magnetic field line. This is because the angle of the field relative to gravity will be different at each height due to the eggshell pointing to a different angle at each height relative to gravity. This is especially true when the north and south poles are oriented in the vertical direction so that the magnetic field lines have a vertical component that changes from the bottom and top of the eggshell near the height of the transmitter.
[0152] Thus, the magnetometer data may be used in conjunction with the accelerometer data and / or optical data to determine the position of the oral hygiene device 1 within a ring located in a horizontal plane having equal magnetic field strength around the transmitter 110. For example, Figure 5 An embodiment of a base 2 is shown having a single coil magnetic field transmitter 110 that produces a sliced shell with a B (magnetic) field vector that changes direction in the vertical plane. The sensor 11 on the oral hygiene device 1 may include a magnetic field sensor 11 for detecting the magnetic field generated by the magnetic field transmitter 110, and a magnetic field sensor 11 for detecting the gravitational acceleration a g The accelerometer 11 of the same acceleration. Therefore, the magnetometer 11 on the oral hygiene device 1 can be positioned within the B field generated by the transmitter 110. Therefore, the magnetometer 11 can determine the magnetic field strength and direction (B t ). At the same time, the accelerometer 11 can use the acceleration from gravity as vector a g The system 100 can analyze that data and determine the gravity vector a g With magnetic field vector B t Q° between.
[0153] Then, it may be possible to use angle Q° to determine loop R, where it is known that the position of the oral hygiene device 1 is at a certain point along loop R. For example, first, the strength of the magnetic field B detected by the magnetometer 11 can be used to determine on which magnetic field egg-shaped or donut-shaped shell (e.g., B1, B2, or B3) the oral hygiene device is. This will narrow the position of the oral hygiene device 1 to the hollow shell or donut around the transmitter 110. Next, Q° can be used to calculate the vertical position on the shell or donut, and thus narrow the position to the loop R around the transmitter 110. Therefore, if the system 100 detects movement to a new loop R, the system will have information about the possible direction and distance traveled. Accelerometer data that provides more information about the direction of travel will enhance this information. For example, this can provide a certain upper or lower limit on the direction and / or distance traveled by the oral hygiene device 1. Therefore, this system 100 and data processing techniques can be used to provide relative position and movement information of the oral hygiene device 1, and applied to determine the brushing position in the mouth, as described herein.
[0154] In some embodiments, the magnetometer sensor 11 can sense the magnetic field emitted by the magnetic field transmitter 110. In order to do this, this magnetic field data must be filtered out from external noise and especially from the earth's magnetic field. The earth's magnetic field has a relatively constant intensity and direction at a given position within the toothbrush's range of movement. In addition, the earth's magnetic field is quite large, and most magnetometers are calibrated according to the scale of the earth's magnetic field. Therefore, in order to use a magnetometer calibrated for the earth's magnetic field, such as in an embodiment where both the earth's magnetic field and the magnetic field of the transmitter 110 are detected to calculate orientation and position changes, some filtering algorithms must be used to distinguish between the two. In some embodiments, the key data that can be used to filter the two is: compared with the detected change of the magnetic field emitted by the magnetic field transmitter 110, the intensity of the earth's magnetic field remains relatively constant within the range of movement of the oral hygiene device. Therefore, a time filter can be applied to distinguish between the two magnetic fields. In some embodiments, the magnetic field emitted by the transmitter 110 can pulsate at a certain frequency or amplitude so that it is easy to filter out using signal processing and data analysis.
[0155] In some embodiments, the magnetic field direction component of the vector data output from the magnetometer 11 may also be used to calculate relative position change and / or orientation. For example, in some embodiments, the transmitter 110 may transmit a signal having Figure 5 The direction or vector information detected by the magnetometer from the magnetic field B generated by the transmitter 110 can be used to provide orientation and or relative position information. This data can then be combined with the data from the direction vector information detected from the geomagnetic field, which is likely to have an orientation different from the orientation of the geomagnetic field. Therefore, the magnetometer 11 can detect a vector indicating the direction of the geomagnetic field and the magnetic field of the transmitter 110 to provide a reference for spatial orientation and position changes.
[0156] In one example, a magnetometer that senses the Earth's magnetic field can sense the position of the oral hygiene device 1 in or around a horizontal plane like a compass. Figure 5 The orientation of the Z axis shown. In some embodiments, this may include vectors not only in the horizontal direction but also in the vertical direction, which will be constant and based on the inclination of the geomagnetic field at a specific geographic location. In other embodiments, the transmitter 110 may be placed in a diagonal, horizontal, vertical or other known orientation that is used as a reference point for calculating the orientation of the magnetometer 11 and changes in the position of the magnetometer 11 and the oral hygiene device 1.
[0157] In addition, calibration may have to be performed based on the relative orientation of the oral hygiene device 1 and the magnetic field transmitter 110 of the base station when used by the user. Because the shape and orientation of the magnetic field lines change based on the position relative to the magnetic field generator, different formulas, calibrations, or adjustments may need to be performed. For example, near the side of the magnetic field generator, the magnetic flux lines may be positioned in a first direction; however, near either polar end of the transmitter 110 (e.g., above or below, or right or left), the flux lines may be oriented perpendicular to the first direction near the side or middle of the transmitter 110. In addition, the user may be required to brush her teeth at a certain distance from the transmitter 110 to ensure that a magnetic field suitable for measurement is generated in this position. The beneficial aspect of the coil being physically oriented in the vertical direction is that, assuming the same relative height, the magnetic field generated is relatively the same on all sides of the transmitter 110 (and alternatively, the base station 2), and thus calibration may require a simpler algorithm and / or process. However, if the coil is located in a horizontal plane, the magnetic flux lines may travel in different directions depending on the orientation of the base station 2. In this embodiment, the user may be instructed to rotate the base station 2 so that it points in a particular direction relative to the user where the user typically brushes their teeth. In other embodiments, the calibration may be able to use or adapt to changes in the vector direction of the magnetic field emitted by the transmitter 110.
[0158] Data from the magnetometer 11 may be combined with data output from the accelerometer 11 or data from the gyroscope 11 and the accelerometer 11 or the optical sensor 9 to determine orientation and / or position. For example, the orientation of the oral hygiene device 1 relative to gravity may be determined first using data from the accelerometer 11 and / or the optical sensor 9 during a time period when the acceleration is relatively small so that the three-axis accelerometer or image analysis will detect the acceleration of gravity, so that it can be determined whether the oral hygiene device 1 is tilted about a lateral axis in a horizontal plane, or it can be determined how the oral hygiene device 1 is rotated about its longitudinal axis (the longitudinal axis extending lengthwise through the toothbrush) relative to the gravity pointing downward to the earth.
[0159] If the accelerometer data indicates that the oral hygiene device 1 is experiencing a relatively small amount of acceleration relative to normal brushing movements, the control system may determine that the oral hygiene device 1 is relatively stationary and the accelerometer data may be used to determine a vector oriented in the direction of gravity.
[0160] If accelerometer data is combined with gyroscope data, the spatial orientation deviation of the toothbrush relative to gravity can be determined to calculate the spatial orientation of the toothbrush. For example, the initial record of the gravity vector can then be used as a reference vector to determine the spatial orientation. Then, the deviation from this initial position or spatial orientation determined by the accelerometer and gyroscope can be determined by calculating the orientation change according to the initial reference vector based on the gyroscope data. Therefore, accelerometer data or accelerometer and data can be used to determine which direction the bristles are facing. Gyroscope For example, in some embodiments, accelerometer and gyroscope data can be analyzed to determine whether the bristles are facing upward or downward, forward, to the left and to the right, thereby potentially narrowing down to a specific quadrant or other partition of the mouth. For example, when the oral hygiene device 1 bristles face downward, the bristles can only brush the top of the lower teeth. If the oral hygiene device 1 bristles face upward, the bristles can only brush the crowns or tips of the upper teeth. As another example, when the oral hygiene device 1 faces right, it can only brush the left side of the molars, etc. Additionally, in some embodiments, the orientation relative to gravity will be deterministic, as the vector representing gravity will always point in the direction towards the floor or earth, and brushing will most likely be done upright.
[0161] Thus, the orientation of the bristles relative to the teeth can be determined in some orientation or plane. In some embodiments, these calculations can be made deterministically, or can be estimated using statistics and / or a refined model of the mouth. For example, if the accelerometer senses that the bristles of the toothbrush are facing downward within a certain error margin or within a statistically significant margin, then the system can determine that the surface being brushed is likely the top of the lower teeth (or, for example, the tongue). In other embodiments, as disclosed herein, the brushing orientations can be calculated relative to each other so that a model of the mouth can be fitted each time the user brushes their teeth.
[0162] In order to determine the orientation in the horizontal plane perpendicular to gravity, for example, the earth's magnetic field or the magnetic field generated by the base station 2 transmitter 110 can be used. In some embodiments, the magnetic field transmitter 110 will generate a magnetic field with a direction vector that changes direction in the horizontal plane perpendicular to gravity. Therefore, even if the absolute direction is not known, the relative orientation of the oral hygiene device 1 relative to the magnetic field detected by the magnetometer 11 and emitted by the transmitter 110 can be determined in the horizontal plane. Therefore, the relative change of this orientation in the horizontal plane can be determined, and the movement path along the reference coordinate system can be determined. In some embodiments, the reference coordinate system can be based on the initial data point or one of any other data points recorded during brushing. As disclosed herein, these relative changes can be used to calculate the position, or to reconstruct the shape by using the relative position after the user has completed brushing.
[0163] In some embodiments, data from gyroscopes, magnetometers, optical sensors, and accelerometers can be used to determine orientation relative to gravity, and either or both of the Earth's magnetic field and the magnetic field of the transmitter 110. In some embodiments, orientation can be determined and confirmed or verified by a different sensor 11 or optical sensor 9. For example, the angular velocity from the gyroscope can be integrated to determine changes in orientation in certain directions, but the magnetometer readings and / or optical sensor 9 data can be used to correct errors from the integration. In other embodiments, either or both of the magnetometer, gyroscope, and magnetometer can be used in various combinations to determine orientation.
[0164] In some embodiments, orientation may be used alone to determine the position of the oral hygiene device 1 using statistical analysis, as disclosed herein. In other embodiments, inertial changes detected by the gyroscope and / or accelerometer may be used in conjunction with or separately from the magnetometer 11 reading to provide further indications of movement or distance to calculate the estimated position of the bristles of the oral hygiene device 1. In some embodiments, orientation information may be combined with data output from the sensor 11 or the optical sensor 9 to indicate translational inertia or position changes. Depending on the position of the inertial sensor, orientation information may be combined with inertial movement data to indicate the position of the bristles. For example, if the motion sensor 11 is located inside the oral hygiene device 1, but in the middle of the longitudinal axis of the toothbrush (where the user will hold the oral hygiene device 1), then changes in orientation will move the head without moving the position of the motion sensor 11 (although it may rotate in the appropriate position). Therefore, orientation information can also be used to calculate the spatial position of the bristles relative to the position of the sensor 11.
[0165] Movement or position change can also be calculated based on the data output by the magnetometer 11. In some embodiments, the magnetometer 11 can detect the magnetic field generated by the magnetic field transmitter 110 in the base station 2 or another stationary component separated from the oral hygiene device 1. In this embodiment, the strength and orientation of the magnetic field sensed by the single-axis, dual-axis or three-axis magnetometer 11 can provide additional data about the position movement of the oral hygiene device 1 relative to the magnetic field transmitter 110 in the fixed and stationary base station 2. Therefore, an increase or decrease in the magnetic field will indicate that the oral hygiene device 1 is moving toward or away from the base station 2. In addition, the change in the orientation or inclination of the magnetic field and its polarity output by the magnetometer 11 can be used to determine translation and position. This information can be used to determine how much the per-unit change in magnetic field strength and distance is based on the direction of movement (because different directions through the magnetic field will have a higher or lower rate of change) based on calibration or experimental data. In other embodiments, the per-unit change in the inclination or shape of the magnetic field can also be associated with the change in position. Each time an oral hygiene device system as disclosed herein is set up (including such a system in which a magnetometer is incorporated in the base station 2), the corresponding orientation of the horizontal magnetic field may be different. This is because how each user stands while they brush their teeth, and / or how the base station 2 is oriented on the countertop may vary from user to user, and even between each cleaning of the countertop and after cleaning the countertop, etc. Therefore, adaptive statistical analysis may be used to determine the relative positions of the bristles of the oral hygiene device 1.
[0166] The position data calculated based on the magnetic field data output from the magnetometer 11 can be combined with inertial data to calculate the position change of the oral hygiene device 1. In some embodiments, the inertial data can be used to calculate the travel distance, and the magnetometer data can also be used to eliminate the error of the calculated result of the position change based on the inertial data and / or provide limits for the calculated result. For example, assuming that the stroke is directly perpendicular to the magnetic lines of force at the position where the magnetic lines of force are most compressed, the change in magnetic field strength can have a certain minimum lower limit. Given a certain change in magnetic field strength, it can be determined that the magnetometer has at least traveled a certain Euclidean distance in space (or changed a certain angular orientation). These changes in inclination and field strength can be used to determine the distance change within a certain error range that can be supplemented or fine-tuned based on accelerometer or gyroscope data. This data can be combined with orientation and inertial data to determine a more accurate travel distance and relative directional stroke of the oral hygiene device 1.
[0167] Brush time and location - visual pattern recognition
[0168] In some embodiments, the movement of the oral hygiene device 1 can be tracked using an optical sensor 9 and a pattern 120 recognition system. For example, as described above, the oral hygiene device 1 can include a pattern 120 on the handle 40 or the head 42 that can be recognized by a visual tracking system. The visual tracking system can be capable of identifying the orientation, distance, and position of the pattern 120 located on the oral hygiene device 1. For example, in some embodiments, the pattern 120 can be on the head 42 and a separate pattern 120 can be on the handle 40 to allow the system to determine the position of both the handle 40 and the head 42 of the oral hygiene device 1, thereby facilitating the determination of orientation and movement. Visual pattern recognition has been used to detect the movement and orientation of markers, such as the system described in "Towards Positioning through Visual Markers" by Bernhard L. Ecklbauer, the disclosure of which is incorporated by reference in its entirety. For example, image processing software can identify the boundaries of the oral hygiene device through standard boundary image identifiers, identify the appropriate size and size of the object, toothbrush, and then attempt to determine the orientation of the oral hygiene device (or determine the orientation of the pattern 120 and the oral hygiene device, respectively).
[0169] In some embodiments, the visual pattern recognition system can also be used to determine the position and orientation of a person's face. This will help compare the relative position and orientation of the face and / or mouth to the oral hygiene device 1 in order to determine the position of the oral hygiene device relative to the mouth. In some embodiments, the system may first acquire an image with the oral hygiene device 1 and the person's face at the same distance from the optical sensor 9. In addition, an initial calibration using the orientation and size of the face can be used to calibrate the distance from the camera 9 to the oral hygiene device 1 so that the size and movement can be estimated. In some embodiments, since the size of the oral hygiene device 1 is known, the relative size of the face using the oral hygiene device 1 can be determined to calibrate or estimate the jaw shape and size and modify the algorithm used to determine which area is being brushed.
[0170] For example, if the system can be used to determine the position and orientation of the face, then the system can determine if the oral hygiene device 1 is in or near the mouth. This will help the system verify and confirm when use starts and stops, because the oral hygiene device 1 will only be near the user's mouth when the user is actually using it. Users rarely hold a toothbrush near their mouth when they are not actually brushing their teeth. Instead, users usually rinse / put down the oral hygiene device immediately after they finish brushing.
[0171] Thus, the data detected by the camera can be evaluated to determine the position, movement and orientation of the oral hygiene device 1. For example, the oral hygiene device 1 can have Figure 6The code "AB" with circles and lines is shown, which is located on the back of the head 42, or on the handle 40, or on both. In some embodiments, the pattern 120 can be any other pattern 120 with different orientations as described herein. The camera 9 can detect the pattern, and the data can be retrieved for processing and analysis. For example, the visual data detected by the camera can be output, and the processor can evaluate the data to determine the orientation and size of the pattern 120 and the relative size of certain parts of the pattern 120.
[0172] For example, if the pattern is AB and is oriented as depicted on the back of the head 42 of the oral hygiene device 1, and the data analysis determines that AB is oriented upright, then the user is most likely not brushing their teeth. This is because this would mean that the oral hygiene device 1 itself is upright (e.g., Figure 6 ), which is a very unlikely position for a user to hold the oral hygiene device 1 for brushing. Instead, during brushing, the longitudinal axis of the oral hygiene device 1 will typically remain in a horizontal plane. However, if the camera 9 detects data indicating that the AB on the head of the oral hygiene device 1 is tilted to one side, then it likely means two things: (1) the oral hygiene device 1 is positioned so that the back of the head 42 of the oral hygiene device 1 faces the user because the AB is actually visible to the camera 9; and (2) the oral hygiene device 1 is horizontal because the AB is oriented on its side. This would (for example) provide a high probability that the oral hygiene device 1 is brushing the front teeth. This is because the camera 9 is typically positioned so that the user faces the camera 9 when they brush their teeth. Therefore, if the AB is visible to the camera 9 and is tilted on its side, the oral hygiene device 1 must be oriented so that the bristles face the mouth (to brush the front surface) and brush the front teeth (not the sides) because the AB is still visible to the forward-facing camera 9.
[0173] However, in many oral hygiene device 1 positions, the head 42 of the oral hygiene device 1 and any associated patterns 120 may not be visible to the camera 9. For example, when brushing the molars, tongue, top or bottom surfaces of the teeth, the pattern 120 on the back of the head 42 will not be visible. Therefore, in some embodiments, one or more additional patterns 120 may be included on the attachment 130 located on the end of the oral hygiene device 1. This will allow the camera 9 to detect the orientation of the attachment 130 and / or the pattern 120 on the handle 40 when the oral hygiene device 1 is inserted into the user's mouth. For example, in some embodiments, the attachment 130 may be a spherical ball on the bottom of the handle 40 of the oral hygiene device 1, and will include several different patterns in different positions around the ball.
[0174] This will allow the camera to detect the position and orientation of several different patterns. When a pattern is visually detected, the system can determine: (1) which pattern 120 is being detected; (2) the size of the pattern 120; (3) the orientation of the pattern 120; (4) the relative sizes of different components of the pattern 120; (5) other characteristics of the pattern 120. This information can be downloaded and compared with existing data about the type and orientation of the pattern 120 placed on the attachment 130 (of the oral hygiene device 1 and / or the handle 40 or head 42). For example, the system may include a database that stores the different sizes of each of the different patterns 120, as well as information about the orientation of the pattern 120 relative to the oral hygiene device 1 and the distance from the camera 9. For example, each pattern 120 may include information about the following: if the pattern 120 is in an upright orientation, the oral hygiene device is on its side, pointing toward the mouth, etc. In other embodiments, assuming a set distance, the size of the detected pattern 120 may be equivalent to the distance of the oral hygiene device 1 from the camera 9. In some embodiments, calibration information may be further added to enhance the system's analysis of swiping data for a specific individual and / or a specific washroom. Thus, each pattern 120 may have a number of pixels associated with each component (e.g., height / width of certain features) that may be associated with a specific distance from the camera 9. This may be an approximation or average, or use statistics to find the distance / orientation with the highest probability.
[0175] Then, once this pattern information is determined, it can be compared to, for example, calibration information or other data indicating the corresponding orientation of the pattern 120 included on the attachment 130. If, for example, Figure 6 As shown, AB pattern 120 is included on attachment 130, has upright orientation and faces forward in the same direction as bristles, so if this pattern is detected to be upright, the user is unlikely to be brushing their teeth. However, again, if this pattern 120 is detected to have an orientation lateral to one side, the user is likely to be brushing their premolars. In another example, if another pattern BC is placed on the bottom of the toothbrush, then when the system detects this pattern, it is likely that an oral hygiene device is being used to clean the molars. Therefore, the orientation of BC can then be used to determine whether the user is likely to be cleaning the top, bottom or side of the molars. In some embodiments, this can be combined with accelerometer and gyroscope data to determine which side of the mouth is being brushed.
[0176] In yet another embodiment, the system may be able to determine the position of an oral hygiene device (without pattern) relative to the face, including the vector direction of its longitudinal axis. Thus, the system may then determine whether the oral hygiene device is likely to be on the left or right side of the mouth. This may be done using a visual recognition system as disclosed herein. In other embodiments, the system may determine the position and orientation of the mouth and the oral hygiene device relative to each other. For example, a mouth recognition algorithm may be used to roughly estimate the position of each corner or side of the mouth. In addition, there may be visual markings on the neck of the oral hygiene device 1 to help the system determine which side of the mouth is being brushed when the user places the oral hygiene device in the mouth.
[0177] No pattern on the toothbrush
[0178] like Figure 7 As shown and in some embodiments, the system may detect only the outline of the handle of the oral hygiene device 1 to determine the orientation of the longitudinal axis relative to gravity, without the use of pattern 120 or markings. In other embodiments, the system may have additional image processing software to identify specific features (bristles, etc.) of the oral hygiene device (including the head) by classifying certain parts of the image using a classification algorithm. In some embodiments, the image processing software represents the longitudinal axis, the head, the base, and possibly the bristles. Based on this information, the orientation and position of the oral hygiene device can be determined. In some embodiments, similar boundary detection / shape classification software can be used to identify the user and the user's mouth. Therefore, the relative position of the oral hygiene device relative to the mouth can be determined, as further explained herein.
[0179] The inventors can use this system so that a custom oral hygiene device is not needed, but only a chip including the motion sensor 11 will need to be provided inside the oral hygiene device. Thus, the device can be manufactured by using an existing oral hygiene device design and only implementing a chip or controller 13 system including the motion sensor 11, antenna 5 or other wireless connectivity and memory. The device can then send all data to a connected smartphone or other connected device 30 (e.g., smart mirror, etc.).
[0180] Combining visual and motion data to determine position
[0181] The visual data can also be used to determine the acceleration and vector or direction of the movement of the oral hygiene device 1 as it brushes the teeth. The visual data can capture different positions and time stamp the data to determine the amount of time recorded to travel from a first point to a second point, and therefore determine the resultant velocity (direction and rate) and acceleration. As described herein, the position data can be used to calculate the brushing position. This combined with the orientation data will be able to provide sufficient position and orientation data to determine the position in the mouth of the user who is brushing and the section of the mouth, as described herein.
[0182] For example, in some embodiments, visual information from pattern recognition or brush profile can be used to recalibrate the position output from accelerometer / magnetometer / gyroscope position determination. In these embodiments, the visual data can be used to recalibrate the drift experienced by the position sensors to bring them back to a reference coordinate system. In other embodiments, the visual data can be used to recalibrate the entire statistical model used to determine position.
[0183] In some embodiments, the position may be determined independently of the motion / acceleration / position sensor, and the position may be determined independently of the visual recognition data. These two determinations may then be used to determine the final position relative to the mouth. In other embodiments, the position relative to the mouth may be calculated using only the visual recognition data alone.
[0184] For example, a first example is a configuration where no visual pattern 120 is added to the oral hygiene device 1. In some cases, it may be challenging to discern which side of the mouth the oral hygiene device is located using only data output from the one or more motion sensors 11 when the oral hygiene device 1 is oriented in the same direction but may be brushing different sections of the teeth. For example, the orientation of the oral hygiene device 1 about the axis is the same or nearly the same, but its position on one side of the face is on the left or right side of the mouth.
[0185] For example, an ambiguous determination may be: is the user brushing the outside of the teeth on the left side of the mouth, or is the user brushing the inside of the teeth on the right side of the mouth? Even without an additional visual pattern 120, the system can distinguish between left and right as long as there is visual information of the oral hygiene device and the user's face. So, in this case, the combination of algorithms is beneficial because the known inertial data is not sufficient to establish the relative spatial position on a coordinate system around the head. Therefore, the visual information can be used to make a secondary determination of which side of the head the brush is located on, and therefore, the visual information and orientation information (about an axis or point or relative to gravity) can be combined to determine which side of the head the brush 1 is located on and whether (for example, the inside or outside of the teeth are being brushed).
[0186] Another example may include an embodiment having a pattern 120 attached to the oral hygiene device 1. For example, the pattern 120 may be added to the bottom of the oral hygiene device 1 and the back of the head of the brush 1. However, with the pattern 120, there may be positions of the oral hygiene device 1 where visual information alone is insufficient to accurately determine the position and orientation of the oral hygiene device 1. For example, when the visual label is partially hidden or the image resolution is too small to accurately detect the size and orientation.
[0187] For example, if the user is brushing their molars, and the only visible pattern 120 is on the bottom of the oral hygiene device 1, and the resolution is low (e.g., because the user is a little too far from the camera device, or because the user is using a camera with insufficient resolution), then the system may not be able to determine accurately enough the angle at which the brush 1 is on the teeth. Therefore, the system cannot determine whether the user is brushing the outside of the molars in the upper jaw or the outside of the molars in the lower jaw.
[0188] In this case, the angular difference between the two brushing positions (e.g., the angle of the longitudinal axis of the oral hygiene device relative to gravity, because the oral hygiene device is held at a slightly different angle when brushing the top or bottom molars) may be quite difficult to detect. However, the motion data (particularly acceleration and vertical orientation) may be able to eliminate the ambiguity of the two potential positions narrowed down by the visual data and thus provide the necessary information to determine whether the oral hygiene device 1 is brushing the upper or lower jaw. Therefore, the visual data alone can be supplemented with motion data to determine the position or segment of the teeth being brushed.
[0189] Brushing time and location - motion data analysis
[0190] In order to use the data from the sensors to estimate the amount of time spent in each section, quadrant, or other logical partition of the mouth, the user may need to calibrate the oral hygiene device 1. In some embodiments, the calibration may be performed at the factory, by the user, or both. Thus, calibration may be used to calibrate a custom unit and adapted to the geography, anatomical structure (i.e., height), and / or bathroom environment of a particular user, which may, for example, include unique magnetic interference, unique height and orientation (the desktop may not be flat, etc.). For example, in some embodiments, the user may apply a colored gel to their teeth. Then, once the oral hygiene device 1 is in position near the teeth and all the colored gel is brushed off, the user may switch the oral hygiene device 1 to calibration mode while the motion sensor 11, one or more optical sensors 9, and other sensors record data.
[0191] At this point, the user can turn off calibration to stop acquiring calibration data. In other embodiments, once the user turns on the calibration function, the oral hygiene device 1 will detect the points at which the user has started and stopped brushing, including any pauses in brushing. This calibration procedure provides reference position, orientation, and motion calibration data, which can then be compared to subsequent brushing using statistical analysis 78 or other analysis methods to determine whether subsequent brushing brushed all areas of the mouth for a sufficient amount of time.
[0192] Once the device is calibrated, either using reference data from previous brushing or brushing with other model users, the brushing data from each use can be compared to the reference data to assess its quality 78 and determine the position of the oral hygiene device 1 in the newly acquired data. For example, the calibration data can be used to prepare a statistical model of the shape and size of a particular user's mouth and to form certain statistical boundaries for determining when the oral hygiene device 1 is brushing any particular section of the user's mouth. Then, once the user begins brushing for a second time, the newly recorded data can then be overlapped or correlated with the calibration brushing data associated with the user's profile 60 to determine if and where there are any deficiencies in brushing. For example, the system 100 can determine how much time it takes to brush each quadrant, how many wipes, or perform other assessments of brushing. In addition, the analysis can indicate that the user is brushing too much in certain areas, or is not using the correct wiping pattern overall or in specific sections of the user's mouth.
[0193] Association can be performed by statistical analysis, for example, quantitative comparison of such differences can be simply performed by measuring the Euclidean distance in 3xz space. Then, such vectors can be processed by using statistical analysis, and the statistical analysis includes principal component analysis (PCA), hierarchical cluster analysis (HCA), regression analysis and linear discriminant analysis. Statistical methods suitable for high-dimensional data can be used. As an example, HCA systematically checks the data representing each type of motion or the distance between the data. Then a dendrogram very much like an ancestral tree can be generated, which shows the clustering of data according to the Euclidean distance between and among the data vectors.
[0194] Each statistical data cluster can represent sensor data corresponding to each section, quadrant or other logical partition of the user's mouth. For example, the mouth can be divided into top and bottom, wherein the top and bottom each have a right side portion, a front side portion and a left side portion, and each of the right side portion, the front side portion and the left side portion has an inner face, a top face and an outer face. Therefore, the mouth can have 36 different sections, 10 sections, 8 sections, 12 sections or 4 sections (quadrants), only top and bottom partitions, only outer and inner partitions, and other logical partitions. Therefore, using reference data, the controller 13 or other processors in the system 100 (for example, processors in mobile phones or servers) can calculate the confidence interval or other values indicating the possibility that the oral hygiene device is brushing a specific section of the user's mouth, rather than determining the possibility that the wiping is associated or related to the calibration data in these sections. In order to obtain a reference position, the user can be guided to start brushing at the same position of the mouth. In this way, the data starts at a known position, and the data can be used as a reference point to use statistical analysis to make the remaining data related. For example, angles, orientations, calculated distances, and other characteristics from reference positions of the oral hygiene device 1 detected by the motion sensor 11 and / or optical sensor 9 may indicate the likelihood that each new position is associated with a certain position of the mouth based on the calibration data.
[0195] In other embodiments, the control system 13 or other system processor (e.g., a processor in a smartphone, server, or other component) may process the statistical data and determine that the brush is brushing a certain section of the mouth if the statistical analysis shows with greater than 95%, 85%, 80%, or other suitable certainty that the brush is within that section of the mouth. In some embodiments, the specificity or sensitivity of the brush static analysis may be modified to match the variability of a particular user.
[0196] This analysis may include an output 80 that allows the control system 13 or other processor to determine which brush strokes are in each section of the mouth or dental appliance, and therefore determine how much time the user spends brushing each quadrant, half or tooth, or other logical division of the mouth, and how these times compare to the recommended examples. In other embodiments, the start and end times of entering a certain area may be recorded, or other suitable methods may be used to determine how much time is spent brushing each section of the mouth.
[0197] In some embodiments, rather than detecting the position of the toothbrush, the system 100 may instruct the user to brush certain sections of the mouth one at a time and only determine if the user is actually brushing and only count or record brushing time when motion indicating brushing is detected. Then, once brushing in the instructed sections has been recorded for the prescribed time, the system 100 will indicate to the user that it is time to move to the next section of the mouth, as well as the elapsed time when the user is actually brushing. This prevents the user from interrupting and thereby brushing for less than the optimal amount of time in each section. Thus, the control system 13 or other processor may analyze the data from the sensor 11 (or pressure sensor 10) to record that the user is brushing in each section, while the system 100 indicates the amount of time the user should brush in that particular section.
[0198] In other embodiments, the pressure applied by brushing on the head 42 may also be detected by a pressure sensor 10 incorporated into the oral hygiene device 1. For example, the pressure sensor 10 may be incorporated into 42 and detect the pressure associated with use. Additionally, the pressure may be mapped to various position data, and thus the controller 13 or other processor of the system 100 may calculate the amount of pressure used to brush each area of the mouth.
[0199] Presentation of feedback
[0200] Once the usage data 78 has been analyzed by one or more controllers 13 of the system 100 or other processors contained in a smart phone, server, or other component of the system 100, feedback 80 may be presented to the user through a speaker 50, a visual indicator 52 on the oral hygiene device 1, or through an associated mobile device 30 or other computing device in data communication with the system 100. This feedback may be presented immediately or made available for access to check progress.
[0201] For example, immediate feedback 80 may be provided to the user during brushing, including indications provided by audio or visual means indicating how much time is remaining, whether to brush harder or softer, whether certain quadrants have been adequately brushed, and when brushing is complete. For example, a red light or a stop sound may be generated by the speaker 50 to indicate that brushing is complete.
[0202] In addition, historical and average brushing time and location data 80 may be presented to the user on the mobile device or other computing device using graphs, charts, percentages, and other indicators. For example, the average time spent per quadrant per day may be presented to the user, as well as the average number of days that the user brushed once, twice, or other times. In addition, the average time spent brushing each tooth may be calculated and presented to the user on the mobile device 30 or other computing device. The program 15 running on the mobile device may use the mobile device 30 controller 13 to control the presentation of the data.
[0203] API for dentist integration
[0204] An API could also be developed to transmit brushing and usage data to dentists for professional evaluation and feedback on brushing habits and techniques. Additionally, this data could be evaluated to determine brushing techniques that lead to more dental problems, including cavities and gum disease. For example, the width or height of a wipe could be correlated to how high the brush reaches along the gum line, indicating whether the gums are being properly brushed. This could be analyzed to determine if short wipes at the proper height lead to more frequent gum disease.
[0205] Gamification
[0206] The usage data can also be used to create games for children or family members to play individually or against each other to reach a certain usage threshold. This can provide a unique motivational tool for users to brush their teeth regularly. Therefore, since delayed feedback is often psychologically discounted in cases such as gum disease or cavities, the more immediate and continuous, more specific and more quantitative feedback of the present disclosure will provide a stronger motivation to adhere to the recommended brushing regimen.
Claims
1. An electronic oral hygiene system, comprising: An oral hygiene device comprising: a visual pattern; an optical sensor configured to output visual data associated with the visual pattern and a face of a user; and A control system, wherein the control system is configured to: determining an orientation of the user's face based on the visual data; Based on the visual data and the orientation of the user's face, a position of the oral hygiene device in the user's mouth is determined.
2. The electronic oral hygiene system according to claim 1, characterized in that The control system determines a position of the oral hygiene device in the user's mouth based on a statistical analysis.
3. The electronic oral hygiene system according to claim 2, characterized in that The visual pattern is located directly on the handle of the oral hygiene device.
4. The electronic oral hygiene system according to claim 2, characterized in that The control system is also configured to: During a calibration process, recording calibration data from the optical sensor; Wherein the statistical analysis is performed based on a comparison of the visual data with the calibration data.
5. The electronic oral hygiene system according to claim 4, characterized in that The statistical analysis includes determining relative positional movement of the oral hygiene device.
6. The electronic oral hygiene system according to claim 1, characterized in that The visual pattern comprises at least two colors.
7. An electronic oral hygiene system, comprising: An oral hygiene device comprising: a visual pattern; an optical sensor configured to output visual data associated with the visual pattern and a face of a user; and A control system, wherein the control system is configured to: determining a position of a user's face based on the visual data; A position of the oral hygiene device in the user's mouth is determined based on the visual data and the position of the user's face.
8. The electronic oral hygiene system according to claim 7, characterized in that The control system determines a position of the oral hygiene device in the user's mouth based on a statistical analysis.
9. The electronic oral hygiene system according to claim 8, characterized in that The visual pattern is located directly on the handle of the oral hygiene device.
10. The electronic oral hygiene system according to claim 8, characterized in that The control system is also configured to: During the calibration process, recording calibration data from the motion sensor and the optical sensor; Wherein the statistical analysis is performed based on a comparison of the motion data and the visual data with the calibration data.
11. The electronic oral hygiene system according to claim 10, characterized in that The statistical analysis includes determining relative positional movement of the oral hygiene device.
12. The electronic oral hygiene system according to claim 7, characterized in that: The visual pattern comprises at least two colors.
13. An oral hygiene system for monitoring brushing and compliance with a toothbrush regimen, comprising: An oral hygiene device comprising a handle and a head; Optical sensors; a memory including a machine-readable medium including machine-executable code having stored thereon instructions for performing a method of determining an orientation of the oral hygiene device; a control system coupled to the memory, the control system being configured to execute the machine executable code so that the control system: During a calibration process, recording calibration data from the optical sensor, the calibration data representing an image of the oral hygiene device in a fixed orientation; During the calibration process, facial data representing a user's face is recorded; during the calibration process, comparing the size of the visual pattern on the oral hygiene device to the size of the user's face; storing the calibration data in a memory; During a use process, recording usage data from the optical sensor; and A statistical analysis is performed on the usage data and the calibration data to determine at least one orientation of the oral hygiene device.
14. The oral hygiene system according to claim 13, characterized in that The oral hygiene device further includes a gyroscope that outputs data related to changes in orientation of the oral hygiene device, and wherein the control system determines the orientation of the oral hygiene device additionally based on data output from the gyroscope.
15. The oral hygiene system according to claim 13, characterized in that The control system also uses data output from the optical sensor to determine a relative change in position of the oral hygiene device.
16. The oral hygiene system according to claim 15, characterized in that The control system utilizes data output from the optical sensor to determine an estimated distance window within which the oral hygiene device has changed position.
17. The oral hygiene system according to claim 13, wherein: The control system utilizes statistical analysis to determine one or more of orientation and position changes.
18. The oral hygiene system according to claim 17, characterized in that The statistical analysis is performed using the relative position changes based on the reference coordinate system determined during each swiping process.
19. The oral hygiene system according to claim 18, characterized in that The statistical analysis is performed by fitting the data from the optical sensor to calibration data after the control system determines a completed wiping process.
20. The oral hygiene system of claim 13, wherein: The oral hygiene device includes a visual pattern.
