Oral hygiene system

By using a tooth display and marker removal mechanism within the oral hygiene system, the problem of improper brushing in children and adolescents has been addressed, improving adherence to and effectiveness of dental health management.

CN114652079BActive Publication Date: 2024-11-12COLGATE PALMOLIVE CO
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202210148496.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2017-12-28
Filing Date
2018-12-12
Publication Date
2024-11-12
Estimated Expiration
2038-12-12

AI Technical Summary

Technical Problem

Children and adolescents are particularly poor at adhering to oral hygiene programs, leading to frequent dental problems such as tooth decay and gingivitis, and the effectiveness of existing dental health education is limited.

Method used

Design an oral hygiene system including an oral hygiene device, a sensor, a display device, and a processor. The display device shows tooth segments and covers markings. In response to the proximity of the device head to the tooth segment, the markings are removed to promote proper brushing action.

Benefits of technology

It improves user adherence to oral hygiene protocols, reduces the occurrence of cavities and gum disease, provides real-time feedback and guidance, and enhances dental health management.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114652079B_ABST
    Figure CN114652079B_ABST
Patent Text Reader

Abstract

The present invention relates to an oral hygiene system. A method for promoting compliance with an oral hygiene regimen is provided, the method comprising displaying a representation of at least a portion of a set of teeth of a user on a display device. The method further comprises overlaying a marker on the representation such that the marker is associated with a first segment of the representation. In response to determining, by at least one of the one or more processors, that a head of an oral hygiene device is positioned directly adjacent to a first segment of the set of teeth corresponding to the first segment of the representation for at least a predetermined amount of time, removing the marker from the display device.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application is a divisional application of the Chinese patent application with the application date of December 12, 2018, application number "201880080804.3", and invention name "Oral Hygiene System". Technical Field

[0002] The present disclosure relates generally to oral hygiene systems and, more particularly, to oral hygiene systems and methods for promoting compliance with an oral hygiene regimen. Background Art

[0003] Following the correct technique and frequency of oral hygiene activities, including brushing and flossing, is essential for dental health. Dental plaque is a bacterial biofilm that forms on teeth and causes caries, gingivitis, and other dental problems. However, dental plaque can be removed by brushing the teeth at least once a day for two minutes, and preferably twice a day, to inhibit or reduce caries.

[0004] However, children and adolescents are particularly poor at complying with oral hygiene regimens. For example, after developing bad habits, many sections of the teeth are often missed. According to the CDC, although preventable, dental caries is the most common chronic disease in children aged 6–11 (25%) and adolescents aged 12–19 (59%). In addition, 28% of adults aged 35 to 44 have untreated dental caries. Studies have shown that children repeatedly miss the same areas during tooth brushing, which leads to isolated plaque accumulation on certain teeth. Therefore, more important than the length of brushing time is the effectiveness of tooth brushing. In addition, dental health education alone has been shown to generally have only a small and temporary effect on plaque accumulation. According to the American Dental Association, compliance with a proper oral hygiene regimen is quite low. For example, only 49% of men and 57% of women brush their teeth twice a day.

[0005] Therefore, there is a need for oral hygiene systems and methods that promote user adherence to a dentist-recommended hygiene regimen to reduce cavities, gum disease, and other dental complications caused by inadequate brushing. The present disclosure is directed to addressing these needs and others. Summary of the invention

[0006] According to some embodiments of the present disclosure, a method for promoting compliance with an oral hygiene regimen includes: displaying a representation of at least a portion of a set of teeth of a user on a display device. The method also includes overlaying a marker on the representation such that the marker is associated with a first segment of the representation. In response to determining, by at least one of the one or more processors, that a head of an oral hygiene device is positioned directly adjacent to a first segment of the set of teeth corresponding to the first segment of the representation for at least a predetermined amount of time, removing the marker from the display device.

[0007] According to some embodiments of the present disclosure, an oral hygiene system includes an oral hygiene device, a sensor, a display device, one or more processors, and a storage device. The oral hygiene device includes a handle and a head. The storage device stores instructions that, when executed by at least one of the one or more processors, cause the oral hygiene system to display a representation of at least a portion of a set of teeth of a user on the display device. The instructions also cause the oral hygiene system to overlay a mark on the representation so that the mark is associated with a first segment of the representation. In response to determining by at least one of the one or more processors that the head of the oral hygiene device is positioned directly adjacent to a first segment of the set of teeth corresponding to the first segment of the representation for at least a predetermined amount of time, the mark is removed from the display. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Figure 1 is a schematic diagram of an example of an oral hygiene system;

[0009] Figure 2 are examples of oral hygiene devices and Figure 1 A schematic diagram of an exemplary base station of a system;

[0010] Figure 3A is a perspective view of an oral hygiene device and head according to some embodiments of the present disclosure;

[0011] FIG3B is a perspective view of an example of an oral hygiene device handle;

[0012] 3C-3E are perspective views of exemplary replaceable heads attachable to a head interface;

[0013] Figure 4 is a flow chart illustrating an example of a process for recording brushing or other hygiene data and providing feedback to a user according to some embodiments of the present disclosure;

[0014] Figure 5 is a diagram showing an example of an oral hygiene device and a base station, wherein the magnetic field generator is in the base station or other associated device;

[0015] 6A is a perspective view showing an example of an oral hygiene device having a visual pattern, according to some embodiments of the present disclosure;

[0016] 6B is a perspective view showing an example of an oral hygiene device head having a visual pattern, according to some embodiments of the present disclosure;

[0017] Figure 7 is a perspective view illustrating an example of a system for visually identifying a position of an oral hygiene device without a pattern;

[0018] FIG8A is a perspective view showing an example of a toothbrush handle having an insert;

[0019] FIG8B is a perspective view showing an example of a toothbrush with an insert removed;

[0020] FIG8C is a perspective view showing an example of an insert including a battery and electronics for a toothbrush;

[0021] FIG9A is a front view showing an example of a mobile device display with brushing feedback;

[0022] FIG9B is a front view showing an example of a mobile device display with brushing feedback;

[0023] Fig.10 is a schematic diagram of an oral hygiene system according to some embodiments of the present disclosure;

[0024] Fig.11A yes Fig.10 A front view of a display device of an oral hygiene system;

[0025] Fig. 11B yes Fig.10 Another front view of the display device of the oral hygiene system;

[0026] Fig.12 Is used for operation Fig.10 A schematic diagram of an oral hygiene system method;

[0027] Fig.13A is a front view of a display device of an oral hygiene system according to some embodiments of the present disclosure; and

[0028] Fig. 13B is a front view of an oral hygiene device in a three-dimensional volumetric space. DETAILED DESCRIPTION

[0029] Figure 1 An overview of an oral hygiene device monitoring and feedback system 100 is shown, the system comprising: an oral hygiene device 1 equipped with a sensor, a base station 2 for receiving and charging the oral hygiene device 1, a mobile device 30 for wirelessly receiving / sending data, a dedicated wireless link POA 8, a server 4 and a network 3 for transmitting information from a server or between other components of the system 100.

[0030] Data Communications

[0031] The oral hygiene device 1 may have an antenna 5 and a transceiver member for radio communication with a compatible complementary antenna 5 and transceiver member of the base station 2 via a radio link 31. The radio communication link 31 may be, for example, WiFi or GSM or Bluetooth or a derivative thereof or other proprietary protocol. In addition, one or more optical sensors 9 may communicate with a mobile phone 30, a base station 2, a server 4 or other associated computing device disclosed herein.

[0032] In another embodiment, the antenna and transceiver components are replaced or completed by a wired connection or connector to allow information to be exchanged between the oral hygiene device 1, the optical sensor / camera 9 and / or the base station 2. The wired connector can also provide power from the base station to the oral hygiene device 1 for recharging the rechargeable power supply of the oral hygiene device. In another embodiment, the power supply from the base station to the oral hygiene device 1 or the optical sensor device 9 is provided with an electromagnetic induction circuit.

[0033] The base station 2 may be powered by a power cord. Alternatively, the base station 2 may be powered by a rechargeable battery that is charged from time to time with a battery charger that is powered by the power grid. The base station 2 has a receiving slot that is used to physically support and store the toothbrush when the user is not using the toothbrush.

[0034] The base station 2 and / or the individual optical sensor devices 9 include data exchange circuitry for transmitting data using a network 3 (eg, the Internet). Figure 1 The radio communication link 31 shown transmits data with the antenna 5 of the base station 2 and with the antenna 5 of a dedicated communication device 8 or POA connected to the network 3. In other embodiments, the data transmission between the base station 2 and the network 3 is performed via a wired link (e.g., ADSL).

[0035] The antenna 5 and transceiver components and / or the camera / optical sensing device 9 of the oral hygiene device 1 are also compatible with the radio communication components of the mobile device 30 via a radio link 31. For example, the radio communication link 31 may be WiFi or GSM or Bluetooth or its derivatives or other suitable protocols. In some embodiments, the radio link 31 is a short-range, local, radio communication link or a radio link 35, such as a link used in a cellular or other mobile phone system (e.g., GSM and derivatives).

[0036] The mobile device 30 can also exchange data on the network 3 via its radio communication circuit through the dedicated communication device 8 or POA on the radio link 31. Additionally, or alternatively, the mobile device 30 can exchange data directly on the network 3 on the radio link 35.

[0037] The server 4 is connected to the network 3 by any suitable means. The server 4 is broadly defined as comprising a computing device capable of storing and performing computing operations, for example, on the "cloud" in a computing network. The server 4 may include storage devices, such as memory, hard drives, flash memory or other storage devices, and includes computing components under program control. To transmit data, the oral hygiene device control circuit uses a predetermined server 4 address of the network 3. This predetermined address may be initially stored in the oral hygiene device 1 and / or updated later via the network 3. Data transmission between the oral hygiene device 1 and the server 4 may be performed in the following circumstances: a) each time the oral hygiene device 1 is replaced in the base station 2 in a batch configuration; b) at the direction of the user or server 4, for example, by user action using an interface of the mobile device 30 or accessing a web page of the server 4 when the transmission is initiated or c) in real time when activity of the oral hygiene device 1 is detected; or d) when the oral hygiene device 1 is removed from the base station 2 or e) at other appropriate intervals.

[0038] System circuit design and network architecture

[0039] like Figure 2 As shown, the oral hygiene device 1 may include a pressure sensor 10 and at least one sensor 11 . Figure 2 The sensor 11 shown may refer to any suitable type of sensor. When the user applies the bristles to their teeth, the pressure sensor 10 detects the force applied to the brushing side of the oral hygiene device 1. The sensor 11 can be a motion sensor that detects motion in any one or all three of the orthogonal axes of the oral hygiene device 1, or a motion sensor capable of detecting acceleration or other motion characteristics in all three axes. The signal output by the sensor is processed by a signal conditioning circuit 12. Examples of signal conditioning include: frequency and noise filtering, amplification, conversion, digital signal processing, and other techniques for optimizing the detected signal for analysis.

[0040] In other embodiments, the oral hygiene device 1 may not include any electronics and may be a standard toothbrush. In those embodiments, a separate optical sensor / camera 9 may perform the task of tracking the movement of the oral hygiene device 1 .

[0041] The processed signals or raw data from the sensors are then stored in a memory 14 as determined by a control system 13, which may be a digital signal processor, a microcontroller or other processing component and whose operation is controlled by a program 15. The memory 14 may be included in the oral hygiene device 1 or on the server 4 or on other components of the system 100. The program 15 may be updated via the oral hygiene device 1 interface circuit 16, i.e. a modem for radio communication and its antenna 5 (and / or a connector in the case of a contact / wired interface) or other interface of the oral hygiene device 1. More generally, the oral hygiene device interface circuit 16 allows information to be exchanged between the oral hygiene device 1, the optical sensor device 9 and the base station 2 when a radio link 31 is established (and / or the connectors of the toothbrush and the base station are mated together). The oral hygiene device 1 may include a power supply circuit for powering the sensors and circuits of the oral hygiene device 1, and it may include a rechargeable power supply 17.

[0042] The base station 2 may include a base station interface circuit 20, i.e., a modem for radio communications, having an antenna 5 (and / or connector) to exchange information via a link 31. In addition, the base station interface circuit 20 is capable of establishing a radio link 31 with a dedicated communication device 8 to communicate with the network 3. The base station 2 may utilize a power converter 22, which is regulated 21 to provide appropriate voltage and current to the base station circuitry. An electrical connection (not shown) may be provided for providing a charging current from the base station 2 to the oral hygiene device 1. In some embodiments, the base station 2 may include a recharging circuit for recharging a battery or power supply of the toothbrush by inductive charging or direct electrical connection.

[0043] The base station 2, optical sensing device 9 or other separate electronic device may also include a magnetic field transmitter 110 that transmits a magnetic field that can be sensed by an associated magnetometer or other magnetic field sensor. The magnetic field transmitter 110 may be provided by utilizing a charging circuit or other circuit that is already present in the base station 2 or other electronic device. For example, the base station 2 may have a recharging coil that may also serve as the magnetic field transmitter 110. The recharging coil may be fixed and in a known orientation so as to produce a magnetic field with a known strength and polarity orientation. In some embodiments, the base station 2 may include a recharging coil that generates a magnetic field with a polar axis located in a horizontal or vertical plane. In some embodiments, this may be a single-axis magnetic field transmitter 110, for example, in the case of a single-axis recharging coil. In other embodiments, a 2-axis or 3-axis magnetic field transmitter 110 may be incorporated into the base station 2. This will advantageously allow a fixed magnetic field of a known orientation so that the magnetometer (sensor 11) on the oral hygiene device 1 can sense the strength and polarity of the magnetic field so as to provide information about the position and orientation of the oral hygiene device 1, or relative changes in position and orientation.

[0044] In some embodiments, the base station 2 or other electronic device separate from the oral hygiene device 1 may also include a camera 9 that can detect visual patterns on the oral hygiene device 1. The camera 9 may be any suitable camera that can detect visual patterns on the oral hygiene device 1. For example, a camera provided with a mobile phone would be suitable. In other embodiments, a separate camera or optical sensing device 9, a separate camera holder for a mobile phone, a connected mirror or other camera or imaging device may be used.

[0045] In some embodiments, the base station 2 is passive and the circuits of the base station are under the control of the controller 13 of the oral hygiene device 1 when communicating together, specifically when the link 31 is of the wired / contact type with a connector. Figure 2 In the embodiment shown, the base station has a control system 19 which controls its operation.

[0046] The dedicated communication device 8 may comprise a radio modem circuit 27 and appropriate electronics for communicating with the network 3. The dedicated communication device 8 is capable of establishing a radio link 31 with a base station 2 and / or establishing a radio link 31 with a mobile device.

[0047] The mobile device 30 comprises at least a radio modem 26 for establishing a radio link 31. The operation of the mobile device 30 is under the control of a control system 25 (e.g., a central processing unit or μC) and a program 15. The mobile device 30 comprises output means (e.g., a display screen) and input means (e.g., a virtual or physical keyboard). Preferably, the input means and the output means of the mobile device 30 are used in the system to input information and to display information, in particular the results of operations performed by the server. The mobile device 30 may also comprise a camera 9 capable of detecting a visual pattern provided on the oral hygiene device for detecting movement.

[0048] The programming of the computing components of the server 4 allows for the storage of signals received from the oral hygiene device 1. In addition, the server 4 can analyze the data from the sensors to generate feedback and motivational data about the user's performance while brushing. These results can be accessed by the user on an Internet page hosted by the server 4, or transferred to another network server for hosting. In various embodiments, the previous operations and calculations are all or partly performed in the mobile device 30, and the server 4 is used for routine monitoring.

[0049] First, it should be understood that the disclosure herein can be implemented with any type of hardware and / or software, and can be a pre-programmed general-purpose computing device. For example, a server, a personal computer, a portable computer, a thin client, or any suitable one or more devices can be used to implement the system. The present disclosure and / or its components can be a single device at a single location, or multiple devices at a single or multiple locations, and the multiple devices are connected together using any appropriate communication protocol through any communication medium (e.g., cable, fiber optic cable) or wirelessly.

[0050] It should also be noted that the present disclosure is illustrated and discussed herein as having multiple modules that perform specific functions. It should be understood that, for the sake of clarity only, these modules are schematically shown based on their functions only, and do not necessarily represent specific hardware or software. In this regard, these modules can be implemented as hardware and / or software that basically performs the specific functions discussed. In addition, modules can be combined together in the present disclosure, or divided into additional modules based on the specific functions required. Therefore, the present disclosure should not be interpreted as limiting the present invention, but is only understood as illustrating an exemplary embodiment thereof.

[0051] A computing system may include a client and a server. The client and the server are typically remote from each other and typically interact via a communication network. The relationship of the client and the server is generated by computer programs that run on respective computers and have a client-server relationship with each other. In some embodiments, the server transmits data (e.g., an HTML page) to a client device (e.g., for the purpose of displaying data to a user interacting with the client device and receiving user input from it). Data generated at the client device (e.g., a result of a user interaction) may be received at the server from the client device.

[0052] Embodiments of the subject matter described in this specification may be implemented in a computing system comprising a back-end component, e.g., as a data server; or a middleware component, e.g., an application server; or a front-end component, e.g., a client computer with a graphical user interface or a web browser, through which a user can interact with embodiments of the subject matter described in this specification; or any combination of one or more of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include local area networks ("LANs") and wide area networks ("WANs"), interconnected networks (e.g., the Internet), and point-to-point networks (e.g., ad hoc point-to-point networks).

[0053] The embodiments of the subject matter and operations described in this specification may be implemented in digital electronic circuits or in computer software, firmware or hardware, including the structures disclosed in this specification and their structural equivalents, or a combination of one or more of them. The embodiments of the subject matter described in this specification may be implemented as one or more computer programs, i.e., one or more modules in computer program instructions, which are encoded on a computer storage medium to be executed by a data processing device, or to control the operation of a data processing device. Alternatively or in addition, program instructions may be encoded on an artificially generated propagation signal (e.g., a machine-generated electrical, optical or electromagnetic signal), which is generated to encode information for transmission to a suitable receiver device for execution by a data processing device. A computer storage medium may be a computer-readable storage device, a computer-readable storage substrate, a random or serial access memory array or device, or a combination of one or more of them, or included in the above-mentioned devices. In addition, although a computer storage medium is not a propagation signal, a computer storage medium may be a source or destination of computer program instructions encoded in an artificially generated propagation signal. The computer storage medium may also be, or be included in, one or more separate physical components or media (eg, multiple CDs, disks, or other storage devices).

[0054] The operations described in this specification may be implemented as operations performed by a "data processing apparatus" on data stored on one or more computer-readable storage devices or received from other sources.

[0055] The term "data processing equipment" encompasses all kinds of equipment, devices and machines for processing data, including, for example, a programmable processor, a computer, a system on a chip, or a plurality or combination of the foregoing. The equipment may include dedicated logic circuits, such as an FPGA (field programmable gate array) or an ASIC (application-specific integrated circuit). In addition to hardware, the equipment may also include code that creates an execution environment for the computer program in question, such as code that constitutes processor firmware, a protocol stack, a database management system, an operating system, a cross-platform runtime environment, a virtual machine, or a combination of one or more of them. The equipment and execution environment may implement a variety of different computing model architectures, such as network services, distributed computing, and grid computing architectures.

[0056] A computer program (also referred to as a program, software, software application, script, or code) may be written in any form of programming language, including compiled or interpreted languages, declarative languages, or procedural languages, and it may be deployed in any form, including as a stand-alone program or as a module, component, subroutine, object, or other unit suitable for use in a computing environment. A computer program may, but need not, correspond to a file in a file system. A program may be stored in a portion of a file that holds other programs or data (e.g., one or more scripts stored in a markup language document), in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files that store portions of one or more modules, subroutines, or code). A computer program may be deployed to execute on one computer or on multiple computers, the computers being located at one site or distributed across multiple sites and interconnected by a communications network.

[0057] The processes and logic flows described in this specification can be performed by one or more programmable processors executing one or more computer programs to perform actions by operating on input data and generating output. The processes and logic flows can also be performed by special purpose logic circuits, and the device can also be implemented as a special purpose logic circuit, such as an FPGA (field programmable gate array) or an ASIC (application-specific integrated circuit).

[0058] Processors suitable for executing computer programs include, for example, general-purpose microprocessors and special-purpose microprocessors, and any one or more processors of any kind of digital computer. In general, the processor will receive instructions and data from a read-only memory or a random access memory or both. The basic elements of a computer are a processor for performing actions according to instructions and one or more storage devices for storing instructions and data. Typically, a computer will also include one or more mass storage devices (e.g., magnetic disks, magneto-optical disks, or optical disks) to store data, or be operably coupled to receive data from or transmit data to or both of the one or more mass storage devices. However, a computer does not necessarily have such a device. In addition, a computer may be embedded in another device, such as a mobile phone, a personal digital assistant (PDA), a mobile audio or video player, a game console, a global positioning system (GPS) receiver, or a portable storage device (e.g., a universal serial bus (USB) flash drive), to name just a few examples. Suitable devices for storing computer program instructions and data include all forms of non-volatile memory, media and storage devices including, by way of example: semiconductor memory devices such as EPROM, EEPROM and flash memory devices; magnetic disks, such as internal hard disks or removable disks; magneto-optical disks; and CD ROM and DVD-ROM disks. The processor and memory may be supplemented by, or incorporated in, special purpose logic circuits.

[0059] Oral Hygiene Device Design

[0060] like Figure 3A As shown in FIG. 3C , the oral hygiene device 1 may include a handle 40 and a head 42 that may be removably connected to the handle 40. The handle 40 may include a motor that is mechanically connected to the head 42 and that vibrates or moves the head 42 in a manner that brushes the user's teeth when placed inside the oral cavity and activated. The handle 40 includes a head interface 46 that removably attaches various heads 42 to the handle 40. The head interface 40 includes leads 48 for both data and power transmission to the various heads 42. For example, some heads 42 may include sensors that require power and data transmission, and therefore power may be transmitted from a power source of the handle 40 to the head 42 through leads 48 that form a connection with the head 42 at the head interface 46. There may be various numbers of leads 48 that form a connection on the interface 46 of the head, for example, there may be two leads 48 for power, and two leads 48 for data, three leads 48 for power, three leads 48 for data, and other various numbers of leads. In some embodiments, the header interface 46 will form a watertight seal with the header 42 to prevent water from entering the interface and interfering with power and data transmission via the electrical leads 48 .

[0061] In some embodiments, most of the circuitry and expensive components may be housed inside the handle 40, rather than the head 42, which may be disposable after a certain number of uses. This will minimize the cost of replacing the head 42. For example, in some embodiments, the battery, controller 13 may be housed in the handle 40, and any sensor probes and circuitry to connect the sensor probes may be housed in the head 42. In other embodiments, the head 42 may contain no circuitry or electrical components, and will provide mechanical brushing functionality solely by supporting the bristles.

[0062] For example, as shown in Figures 8A-8C, the electronics and batteries can be housed inside an insert 800 that can be easily slid into a conventional oral hygiene device 1. For example, the oral hygiene device 1 can include a chamber and a connector that can be connected to a base and an insert 800 that slides into the chamber and the base forms a watertight seal with the connector. The insert 800 can be in the form of any shape (cylindrical, rectangular, or other shape) that will slide within the space of a toothbrush. In some instances, the base and connector will include screws and threaded mechanisms to attach a toothbrush. In some instances, the connector and base will include a press-fit configuration to facilitate connection and disengagement. For example, the connection can be made using relative tabs on the connector and base, as shown in Figures 8A-8C.

[0063] In some embodiments, the oral hygiene device 1 may be just a standard toothbrush or other standard oral hygiene device 1 that is commercially available and may not have electronics, or may have only electronics for moving the head to facilitate brushing. In some embodiments, the oral hygiene device 1 may include only a pattern 120 or an attachment 130 having a pattern 120, and may not include any motion sensing electronics, or may not include any electronics at all. Thus, in these embodiments, visual tracking software may be used to determine the position and orientation of the oral hygiene device 1.

[0064] The oral hygiene device 1 may also include a speaker 50 and various visual indicators 52 to provide audio and visual feedback to the user. For example, the handle 40 may include a speaker 50 for playing music, substantive feedback, motivational phrases, remaining time, suggestions on brushing pressure, suggestions on whether certain quadrants are not being adequately brushed, notification that brushing is complete, etc. In addition, the oral hygiene device 1 may include any number of visual indicators 52 for providing substantive feedback on brushing, including elapsed time, LED indicators for indicating when brushing is complete, warning indicators for indicating improper brushing, including indicators for indicating whether each quadrant has been addressed. In other embodiments, the oral hygiene device 1 may also utilize bone conduction to convey audio messages to the user.

[0065] like Figure 6A-6B As shown, the oral hygiene device 1 can include a handle 40 and a head 42, either or both of which can include a pattern 120 for visual detection of movement and orientation by an associated camera 9. For example, in some embodiments, the back of the head 42 can include a pattern (i.e., "AB" with circles and lines as shown). In other embodiments, the pattern 120 can be included on an attachment 130 that can be attached to the head or neck, applied to the bristles, or elsewhere.

[0066] The handle 40 may also include a pattern 120, or in some embodiments, may be the only component that includes a pattern 120. The pattern 120 on the handle 40 may be applied directly to the handle 40, or may be in an attachment 130 that clamps the end of the handle 40 or is connected to the end of the handle. The pattern 120 may be positioned at a convenient location on the attachment 130 or on the handle 40 so that it can be detected at all angles of normal brushing activity. In some embodiments, the handle 40 may include multiple patterns 120 on different sides for detecting different orientations. For example, in some embodiments, the attachment 130 may be square or circular and have a different pattern 120 on each side so that the system detects the orientation of the oral hygiene device relative to the camera.

[0067] The attachment 130 can be weighted so that the oral hygiene device 1 stands on its own when placed on a flat surface. For example, a weight 130 heavy enough to keep the oral hygiene device 1 upright can be applied to the bottom of the attachment 130. In some embodiments, if the attachment 130 is spherical on the bottom, this may be particularly useful. This will provide the oral hygiene device with an entertaining feature that will interest children and even adults.

[0068] The pattern 120 may be applied using paint, other marking processes, or the pattern may use a reflective coating, a mirror, or a fluorescent coating. In some embodiments, the pattern 120 may utilize color, or it may be grayscale.

[0069] Oral hygiene device without graphics or electronics

[0070] A standard oral hygiene device 1 or an oral hygiene device without any electronics or patterns may be used.As shown, in some embodiments, the position and movement of the oral hygiene device 1 will be detected.

[0071] sensor

[0072] The oral hygiene device 1 or a separate electronic device (e.g., an optical sensor) may include various sensors that detect certain attributes of brushing, which may be analyzed to provide various feedback and other motivational information to the user. For example, one or more optical sensors 9 may also be utilized on a separate electronic device to detect the orientation and movement of the oral hygiene device 1. For example, the optical sensor 9 may be used to capture an image of the oral hygiene device 1, and the image may be sent for processing to identify its boundaries, shape, longitudinal axis, and orientation (e.g., by identifying its bristles). In some embodiments, the optical sensor 9 may be used to detect a pattern on the oral hygiene device 1 rather than the oral hygiene device 1 itself. The optical sensor 9 for pattern detection may be oriented in a direction to provide a visual line of sight to a pattern 120 on the oral hygiene device 1, which may be on the head 42, the handle 40, or the attachment 130.

[0073] As another example, the oral hygiene device 1 can incorporate various motion sensors 11 to determine the brushing quality of certain quadrants or even single teeth of the oral cavity. The motion sensor 11 may include a gyroscope, an accelerometer, a magnetometer, a gyroscope, and other various sensors capable of detecting position, movement, and acceleration. These various motion sensors 11 may be incorporated in the handle 40 or the head 42. However, it may be advantageous to place the motion sensor 11 in the handle 40, because in some embodiments where the motion sensor 11 is in the head 42, (e.g., due to brushing and engaging with the teeth) the motion sensor 11 may experience a large amount of additional motion, which may interfere with the detection position. In some embodiments, a magnetometer will sense the vector of the earth's magnetic field. In some embodiments, a three-axis magnetometer will be used, and in other embodiments, a two-axis or single-axis magnetometer will be utilized.

[0074] The magnetic field generator 110 can also be used to generate a known magnetic field with a known polarity that can be sensed by a magnetometer incorporated into the oral hygiene device 1. The magnetic field transmitter 110 can be placed inside the base station 2, which already has a recharging coil and / or interface circuit 20 that can be used to generate a detectable magnetic field. In other embodiments, the magnetic field transmitter 110 can be a separate electronic component in the base station 2 or in a separate physical component entirely. In some embodiments, the magnetic field transmitter 110 will be in a stationary unit with a known orientation.

[0075] The oral hygiene device 1 may also include various proximity sensors that detect the proximity of the oral hygiene device 1 to the user's mouth. These sensors may be incorporated into the head 42 or the handle 40. The proximity sensors may be used to obtain additional position information relevant to determining the quality of the user's brushing.

[0076] Additionally, the oral hygiene device 1 may include a pressure sensor 10 to determine if the user is applying appropriate pressure when brushing. The pressure sensor 10 may be incorporated into the head 42, which may be more easily flexed or utilize a simple pressure transducer or other component capable of measuring pressure.

[0077] In some examples, the oral hygiene device may contain a pH sensor 10. The pH sensor 10 may be used to determine the user's saliva pH. For example, in some examples, the user may be instructed to place the oral hygiene device 1 in the user's mouth to test the saliva pH before using toothpaste or mouthwash. Saliva pH may indicate periodontal disease or gingivitis.

[0078] In other examples, the oral hygiene device 1 or system 100 may also include a depth perception sensor. For example, in some examples, the depth perception sensor will project a laser grid or other laser pattern from the base station 2, for example, in place of the camera 9, and include a detector that will detect and analyze distortions in the pattern to determine depth. The depth perception sensor can be used to more accurately determine the outlines of individual objects for identification and motion tracking. For example, the system 100 can more easily identify the head and facial features of a user and distinguish them from the oral hygiene device 1. Thus, the depth perception device can be used to determine motion in a plane parallel to the line connecting the base station 2 to the user.

[0079] In some examples, the oral hygiene device 1 may also include a depth perception device. For example, in some examples, the oral hygiene device 1 may include a depth perception projector and sensors that project onto the user's teeth. This may be used to form a map of the user's teeth and detect holes or cavities in the user's mouth.

[0080] In some embodiments, the various heads 42 may include a camera 56 that will detect various aspects of tooth quality that may or may not be related to the quality of brushing. For example, a camera 56 including a near infrared camera 56 can be used on the oral hygiene device 1 to collect data indicative of demineralization or caries or dental caries. For example, the oral hygiene device 1 may utilize specific wavelengths that are particularly suitable for detecting these abnormalities, for example, in the range of 1300-1400nm. In some embodiments, the oral hygiene device 1 may also include a light source 58 that will be focused toward the teeth during brushing and can be utilized by the camera to detect certain abnormalities.

[0081] In some instances, the output of camera 56 can be used by system 100 to form a tartar map of the user's mouth. For example, in some instances, system 100 can use images from camera 56 to identify tartar based on reflected wavelengths, and construct a schematic or other representation of the tartar for the user's mouth. For example, camera 56 can use filters for specific wavelengths and / or that more easily reflect tartar, and identify which areas of the mouth have more or less tartar areas or other problems. For example, tartar may cause light to reflect less, and may also reflect different wavelengths. These different patterns can be filtered or detected by the system through a machine learning algorithm, as described in further detail below.

[0082] Certain cameras 56 and possible light sources 58 may also be implemented to detect the level of plaque on the teeth and changes in plaque levels during brushing. In certain embodiments, an infrared or near infrared light source 58 and an appropriate camera 56 that detects and records light in this wavelength range may potentially allow for the detection of plaque.

[0083] Program for brushing analysis and feedback

[0084] The various sensors and optical sensors of the system can collect data related to the quality of the user's brushing or the overall dental health of the user's teeth. The data can then be processed using programs or applications installed in various parts of the oral hygiene device monitoring system 100. Therefore, as described above, the data from the sensors and optical sensors can be processed by the control system 13 of the oral hygiene device 1 or alternatively by a program executed by a processor on the mobile device 30, another associated computing device, or the server 4. The processing and analysis of the data by the system 100 will produce output data representing feedback related to the user's brushing quality. The feedback can be conveyed through the speaker 50 of the oral hygiene device 1 through audio feedback, visually on the indicator 52 of the oral hygiene device 1, or in two ways on the associated mobile device 30, or when accessing a website hosted by the server or a website that communicates with the server 4.

[0085] Figure 4 An example of a process in which an oral hygiene device 1 evaluates the brushing quality of a particular user is shown. In certain embodiments, not every step may be required, but various combinations of these steps may be implemented in an oral hygiene device monitoring system 100. First, a user may input a user profile 70 into the oral hygiene device monitoring system 100 to allow the user to calibrate the oral hygiene device 72. In some embodiments, the oral hygiene device 1 may be calibrated at the factory, by the user, or both. After calibration, the user may pick up the oral hygiene device 1 and begin brushing. Next, the oral hygiene device or an associated monitoring device (e.g., a camera) will determine that brushing is initiated 74 and begin recording sensor data 76 during brushing. The oral hygiene device monitoring system 100 may then analyze the sensor data 78 to output brushing quality feedback 80 to the user.

[0086] User Profiles

[0087] Thus, a user profile 60 may be input 70 for each particular user of a particular oral hygiene device 1, or may be associated with a particular account stored on the server 4, within an oral hygiene device, a base station, or other computing device. After initializing a new oral hygiene device or a new account on the server 4, the user may enter their information, which may be used to determine optimal brushing times and characteristics. For example, the program 15 may first request the user's name, gender, height, weight, age, and certain questions about their dental history. The user profile 60 may then be associated with certain data recorded during the user's use of the oral hygiene device, including calibration data that is specific to a particular oral hygiene device 1, an associated optical sensor 9, or that is generic and applicable to any oral hygiene device 1 or optical sensor 9 connected to the system 100. In some embodiments, the user may upload a picture of themselves, or may initiate a program that uses the optical sensor 9 to capture a picture of the user from the distance at which the user typically brushes.

[0088] Detection usage

[0089] The toothbrushing monitoring system 100 can also determine whether use has occurred and the number of uses per day. In some embodiments, the oral hygiene device 1 and / or the optical sensor detection system detects motion data via the motion sensor 11 and / or the optical sensor 9 and analyzes the data to determine whether use has occurred or whether the toothbrush has been moved or whether it is pretend use.

[0090] When motion indicative of use is detected, the oral hygiene device 1 or optical sensor device 9 may store the position and motion data in its memory 14 for later analysis. This will prevent false positives from being recorded, such as when a user moves a toothbrush in a medicine cabinet, or prevent a child from circumventing the system by briefly shaking the toothbrush, for example.

[0091] For example, the movement indicating use can be associated with a certain acceleration level and / or frequency that is characteristic of a particular user. In other embodiments, the user can press a button or switch on the oral hygiene device 1, the base station 2, or a device with an optical sensor / camera 9 to wake up the sensor on the device, which will then begin recording data. Thus, the system will determine when to start brushing teeth 74. In some embodiments, for example, this will be performed automatically when certain accelerations and frequencies are detected. Thus, once the user picks up the toothbrush, the motion sensor 11 can begin recording data 76 and send it to any of the various control systems 13 in the system 100 to analyze the data 78 for characteristics associated with brushing teeth.

[0092] For example, the oral hygiene device 1 will typically be placed on its base station 2 pointing upward before use in an orientation that is not suitable for the user to hold the oral hygiene device 1 to brush their teeth. Therefore, once the user picks up the oral hygiene device 1, the oral hygiene device 1 will typically rotate about 45 degrees to remain primarily horizontal during brushing. Therefore, a threshold criterion for determining the start of brushing 74 is whether the oral hygiene device 1 has been tilted within a certain angle range, indicating that the oral hygiene device 1 is horizontal or nearly horizontal. This can be an angle range of 20 degrees, 5 degrees, 10 degrees or other suitable ranges. In addition, a series of calibration sessions can indicate a suitable range. Of course, this can be detected by the optical sensor 9 and / or the motion sensor 11.

[0093] In some embodiments, the user can turn on the device and the optical sensor / camera 9 (and / or depth sensor) can start recording. The system can then look to determine when the pattern 120 is at a certain height indicating that it is close to the user's mouth. This can be combined with the acceleration information detected by the optical sensor 9 and analyzed as above for the motion sensor 11.

[0094] In other embodiments, determining whether brushing has been initiated 74 and whether it has stopped can be performed by the system 100 using statistical analysis of motion data from the motion sensor 11 and / or the optical sensor 9. This statistical analysis can be performed by correlating the data from the motion sensor 11 and / or the optical sensor 9 with previous brushing or calibration data or stored data of other users. For example, after performing this analysis, a certain threshold of correlation of the motion data with previously recorded calibration data associated with the use can be determined, which indicates that brushing has been initiated 74 or is in progress. Therefore, once the user starts brushing, the system 100 can record that the use has been initiated 74 and record data 76 in the memory 14 as brushing data until the use stops, such as after the correlation drops below a certain threshold.

[0095] For example, using an optical sensor / camera 9 system setup, the optical sensor / camera 9 can output data including an image of an oral hygiene device (e.g., a toothbrush or water flosser) and a user. The data can be sent to various control systems for processing and motion analysis. For example, an image processing algorithm can first determine boundary conditions to identify the boundaries of the user's lips / mouth, teeth, head, oral hygiene device, handle, head, bristles, water flosser, etc.

[0096] Standard recognition algorithms that typically utilize threshold changes of certain colors (frequency of light) can be used to utilize the boundaries of recognized human features. Once the boundaries of the oral hygiene device 1 are identified, the longitudinal axis can be identified, and potentially the orientation of the bristles (if a toothbrush) to determine the angular orientation about the longitudinal axis. This will allow the system to determine the approximate orientation and motion of the toothbrush, where the frames from the imaging device are time stamped.

[0097] The toothbrush can then be identified as being on a certain side of the mouth by analyzing the relative position of the toothbrush and the characteristics of the mouth. In addition, the orientation of the toothbrush relative to the side of the mouth it is in can be used to determine which section or portion of the user's teeth is being brushed or flossed. For example, the bottom of the upper molars are being brushed on the right side, then the visual system will determine that the toothbrush is on the right side of the mouth, with the bristles facing upward.

[0098] Furthermore, once the profile and orientation of the oral hygiene device 1 is determined in each frame, the timestamp of each frame can be used to determine the motion of the toothbrush. For example, the change in position (time and distance) can calculate the velocity and acceleration of the change. Thus, as with the motion sensor 11, the image data can be used to determine the motion of the oral hygiene device. Thus, the motion can be used to determine compliance with brushing or other oral hygiene standards as further disclosed herein.

[0099] Analysis of the motion data (either from the processing of the motion sensor 11 or from the image data of the optical sensor 9) may utilize a fingerprint or signature type analysis that compares only relative movement. The signature may be determined based on the acceleration of certain axes (as detected by the motion sensor 11, time stamped image data, or other methods) since the motion of brushing teeth is typically performed in relatively rapid motions that are not characteristic of any other incidental movement of the oral hygiene device 1 (e.g., putting it back in a cabinet). Additionally, the frequency of brushing teeth may be monitored since brushing teeth is typically a rapid, periodic motion, and therefore various bandpass frequencies, low pass and Kalman filters or other techniques may be used to identify certain frequencies of interest and the magnitude of those frequencies that are indicative of brushing teeth.

[0100] These amplitudes of frequency may be certain frequencies reaching a threshold amplitude that are associated or determined to indicate that the user is brushing. For example, the system 100 may require certain frequencies of the horizontal or vertical axis to determine that brushing has been initiated 74, or the system may require certain periodic accelerations reaching certain thresholds to determine that brushing has been initiated 74. In some embodiments, this may be a frequency of 1-5 Hz. Once the data analyzed by the controller 13 falls below a certain threshold indicating use, the system 100 may stop recording data or determine that brushing has stopped.

[0101] In addition to statistical analysis, the system can also detect movement that indicates use or actual brushing by using filtering and threshold analysis. For example, the system 100 can first filter the data from the motion sensor 11 to pass only frequencies in a certain frequency band (because brushing is periodic), and monitor those frequencies to detect when this signal reaches a threshold over at least a certain number of cycles or durations to determine that the user is brushing. For example, if the user brushes at an average of 1-5 Hz (or perhaps less in the case of an electric toothbrush), a 1-5 Hz bandpass filter can be implemented.

[0102] Thus, when the system 100 detects that the amplitude of the frequency band in the 1-5 Hz range reaches a threshold indicating use, the controller 13 may begin recording data from the sensor in the memory 14 for the duration that the motion data indicates that the oral hygiene device 1 is being used. Additionally, periodic accelerations of certain axes or angular accelerations reaching certain threshold amplitudes (for circular brushing) may also be used to indicate that brushing has been initiated. Analysis of the data may also be affected by whether the oral hygiene device 1 includes a motor to vibrate the head to assist in brushing. In those embodiments, the data may be filtered to eliminate high frequency accelerations and other noise generated by the motor.

[0103] Brushing quality - movement type

[0104] In some embodiments, the quality of brushing based on the type of movement performed by the user using the oral hygiene device 1 can be determined. Dentists have shown that certain movements are more or less beneficial for brushing. Different types of movements include circular movements, clockwise and counterclockwise movements, tip to root movements, and side to side movements.

[0105] In some examples, the system 100 can determine the length of a brushing stroke. This can be accomplished by any combination of the disclosed methods, including by determining the magnitude of the acceleration and the acceleration time in each direction of the stroke. For example, the strokes can be filtered by identifying regular patterns or filtering at certain frequencies and magnitudes. For example, a certain amount of acceleration about the toothbrush in certain directions will likely indicate a brushing stroke.

[0106] Most brushing will occur in the bristle plane, as the stroke will be optimized to contact the tips of the bristles with the teeth using a brushing motion. Thus, the system can filter accelerations in the bristle plane or within a suitable tolerance to further identify accelerations or movements associated with a brushing stroke.

[0107] The system 100 can determine whether the relative amounts of these movements are being performed by filtering the data from the motion sensor 11 or the optical sensor 9 in certain axes indicative of each movement. For example, the data from the motion sensor 11 or the optical sensor 9 can be filtered in an axis horizontal to gravity, and the control system 13 or other system 100 processor can process the data to determine whether the acceleration, frequency, or other motion data reaches a significant enough magnitude in a certain direction to indicate that the particular movement is being performed.

[0108] In the case of image data, in addition to detecting an acceleration or speed threshold indicative of brushing, the optical system can detect when the oral hygiene device 1 is within a certain proximity to the user's mouth, or inside the user's mouth to determine that brushing is initiated. For example, if the head can be identified, the system can determine that the user is indeed brushing whenever the head is within an area defined as being inside the user's mouth.

[0109] In other examples, acceleration alone may be used to determine whether a back-and-forth motion or a circular motion is being used. In other embodiments, acceleration data from motion sensor 11 may be integrated to determine the actual movement of oral hygiene device 1 to assess the type of brush stroke utilized. Analysis of the data may also be affected by whether oral hygiene device 1 includes a motor to vibrate the head to assist in brushing. In those embodiments, the data may be filtered to eliminate high frequency acceleration and other noise generated by the motor.

[0110] In some embodiments, the motor of the vibrating head 42 may be included in the oral hygiene device 1. In those embodiments, the motion data recorded by the sensor about the brushing movement will have a smaller amplitude than manual brushing. This is because the user of a manual toothbrush will brush with more violent movements without the help of the motor and the moving head 42. Therefore, the algorithm used to analyze the motion data to detect the use, movement and position of the oral hygiene device will be modified to take into account the low amplitude and / or different movements, and include filtering the high-frequency noise from the motor. Therefore, in some embodiments, the threshold set for the amplitude required to detect or indicate the brush stroke will be smaller because users using electronic oral hygiene devices generally move the brush at a slower rhythm and make more straight-line movements.

[0111] In addition, the pressure sensor 10 can also be used to determine whether brushing teeth is actually being performed, or used in combination with the motion data from above. For example, the user may be moving the oral hygiene device 1 around the teeth but not pressing on the teeth. Therefore, accordingly, a movement of a specific frequency, amplitude or characteristic is required, and a specific pressure will eliminate many false positives caused by accidental movement or pressure of the brush that does not occur during brushing teeth. Therefore, the pressure sensor 10 can output a signal that is analyzed 78 by the controller 28 to determine the pressure applied to the teeth. If the pressure is above a certain threshold, the system 100 can indicate or determine that the user may be brushing teeth. This analysis can be performed by statistical analysis, threshold analysis or other suitable calculation methods for determining the possibility of brushing teeth based on the amount and / or continuous nature of the pressure recorded by the pressure sensor 10.

[0112] In some examples, the system 100 and oral hygiene device 1 can form a library of specific types of brushing strokes or motions and provide feedback to the user about the brushing strokes or motions that the user performs for brushing their teeth. For example, the system can maintain a dictionary of motion types for brushing teeth and rank the motion types and the quality of each motion type.

[0113] Examples of motion types can be the following:

[0114]

[0115]

[0116] Identification of specific users

[0117] The system 100 may include a stored user profile associated with the user's stored brushing (or other oral hygiene) data and the user's demographic data (including the user's age, size, and gender). During or after the step of monitoring oral hygiene (e.g., brushing) activity, the oral hygiene device 1, mobile device 30, or server may automatically seek to match the user to at least one user profile using at least one predetermined rule or algorithm that depends on the user profile and past data. If the user is not a regular user of the oral hygiene device, the user identifies him / her as a customer of the mobile device.

[0118] In the step of user identification, a particular user can be associated with the oral hygiene device and presumed to be the user. If multiple users use a given oral hygiene device, the user is associated with the brushing activity at least in the oral hygiene device and possibly in the mobile device and / or server, at least for reference purposes for the last two.

[0119] In an embodiment utilizing a camera, a user profile may have a picture of a user uploaded or associated with the profile. This will allow a visual-based recognition system to automatically determine a specific user associated with the profile. In some instances, the system 100 may capture a picture with a camera and identify a specific user by comparing the initially captured picture with each user who initiates brushing. In some instances, the system may determine the user (e.g., by estimating the user's height or relative height) by the user's position on the camera frame. In other instances, the system 100 may utilize machine learning and computer vision principles to match the user's features and determine which saved user (and associated user profile) is currently brushing. For example, eye color or other facial recognition techniques may be utilized to reliably match users, especially when each device only has a total of 2, 3, or 4 users to be distinguished.

[0120] In other examples, usage data associated with a particular user may be used to identify the user. For example, usage data for a particular user may be associated with a particular acceleration level and / or frequency that is characteristic of the user. For example, a particular user may have a certain frequency range for brushing, or may start on a particular side of the mouth. In some examples, a combination of physical features, motion data, or other indicators may be utilized to identify a user and associate the user with their profile data.

[0121] When and where to brush your teeth

[0122] Next, the brushing data recorded above can be analyzed 78 to provide feedback 80 on the position and time quality of brushing. This can be presented after brushing is completed or in real time to provide instantaneous feedback to the user. For example, the motion sensor 11 and / or the optical sensor 9 can detect position information of the oral hygiene device 1. Using accelerometer and gyroscope data, visual detection data from the optical sensor 9 and the pattern 120 or other motion sensor 11, the position, orientation and movement of the oral hygiene device 1 can be determined and extrapolated to calculate the relative position movement of the head 42. For example, if the distance, orientation and direction of the bristle portion of the motion sensor 11 to the head 42 are known, the system 11 will be able to determine the position of the head 42 and its relative movement, orientation and coverage area based on the relative movement of the motion sensor 11.

[0123] This can be calculated by first calculating the reference coordinates at which the oral hygiene device 1 detects motion, and recording the relative movement about the initial coordinates to determine the signature of the brushing. This can be performed by calculating the changes in the orientation of the brush and the movement due to the acceleration recorded by the gyroscope or accelerometer or visually detected by the optical sensor 9, calculating the movement of the head 42. These calculations can be performed by the control system 13 or other processors used in the system 100, including a mobile phone processor executing an application on a mobile phone, or a processor on a server running software for analyzing data.

[0124] Brushing time and location - magnetometer

[0125] In some embodiments, the magnetometer sensor 11 can provide additional location information by detecting the polarity, direction vector and strength of the earth's magnetic field and / or the magnetic field generated by the magnetic field transmitter 110. In some embodiments, this can be a magnetic field transmitter 110 located in the base station 2, because the base station 2 is stationary and the magnetic field transmitter 110 will have a known polarity and direction (e.g., horizontal or vertical and in a certain direction). This can be detected by the magnetometer 11 located in the oral hygiene device 1. Therefore, the strength of the magnetic field detected by the magnetometer sensor 11 will give an estimate of the distance of the oral hygiene device 1 to the base station 2 along a spherical or elliptical curve or egg-shaped curve, which represents the magnetic field lines around the base station 2 or other associated devices.

[0126] In addition, the magnetometer will be able to sense the vector direction of the magnetic field along the magnetic field line. In other embodiments, the following items can be used to calculate the distance of the oral hygiene device 1 to the base station 2: the magnetic field orientation detected by the magnetometer sensor 11 emitted from the magnetic field transmitter 110 and the attitude information of the accelerometer and gyroscope. This is possible using the shape of the magnetic field and its vector at a specific distance from the transmitter and the knowledge of its polarity. For example, the magnetic field inclination relative to gravity will change predictably at various distances from, for example, the magnetic field transmitter. In addition, by comparing the gravity vector with the vector of the magnetic field, the angle can be used to calculate the height along the shell or magnetic field line. This is because the angle of the field relative to gravity will be different at each height, because the egg-shaped shell will point to different angles relative to gravity at each height. This will be particularly correct when the North Pole and the South Pole are oriented in the vertical direction, so that the magnetic field line has such a component that it changes from a horizontal line near the bottom and top of the egg-shaped shell to a vertical line at about the height of the transmitter.

[0127] Thus, magnetometer data combined with accelerometer data and / or optical data can be used to determine the position of the oral hygiene device 1 within a ring located in a horizontal plane of equal magnetic field strength around the transmitter 110. For example, Figure 5An embodiment of a base station 2 is shown having a single coil magnetic field transmitter 110 that generates a thin layer of a B (magnetic) field vector that changes direction in the vertical plane. The sensor 11 on the oral hygiene device 1 may include a magnetic field sensor 11 to detect the magnetic field generated by the magnetic field transmitter 110 and an accelerometer 11 to detect the gravitational acceleration a g and other accelerations. Therefore, the magnetometer 11 on the oral hygiene device 1 can be located together with the B field generated by the transmitter 110. Therefore, the magnetic field strength and direction (B t ) can be determined by the magnetometer 11. At the same time, the accelerometer 11 can obtain the vector a from g The system 100 can analyze the data and determine the gravity vector a g With magnetic field vector B t Q between o .

[0128] Then, the angle Q o can be used to determine a loop R where the location of the oral hygiene device 1 is known to be at some point along the loop R. For example, first, the strength of the magnetic field B detected by the magnetometer 11 can be used to determine in which magnetic field egg or annular shell (e.g., B1, B2, or B3) the oral hygiene device is located. This will narrow the location of the oral hygiene device 1 to the hollow shell or annular portion surrounding the transmitter 110. Next, Q o Can be used to calculate the vertical position on the shell or annular portion, and therefore narrow the position to the ring R around the transmitter 110. Therefore, if the system 100 detects movement to a new ring R, the system will have information about the possible direction and distance of travel. This information will be enhanced by accelerometer data, which will provide further information about the direction of travel. For example, this can provide certain upper or lower limits on the direction and / or distance traveled by the oral hygiene device 1. Therefore, the system 100 and data processing techniques can be used to provide relative position and movement information of the oral hygiene device 1, and be applied to determine the brushing position in the oral cavity as described herein.

[0129] In some embodiments, the magnetometer sensor 11 can sense the magnetic field emitted by the magnetic field transmitter 110. To this end, this magnetic field data must be filtered out from external noise and in particular from the magnetic field of the earth. At a specific position on the toothbrush moving range, the magnetic field of the earth will have a relatively constant intensity and direction. In addition, the magnetic field of the earth is quite large and most magnetometers are calibrated to the range of the magnetic field of the earth. Therefore, in order to use a magnetometer calibrated for the magnetic field of the earth, for example, in an embodiment in which both the magnetic field of the earth and the magnetic field of the transmitter 110 are detected to calculate orientation and position changes, some filtering algorithms must be used to distinguish the two magnetic fields. In some embodiments, the key data that can be used to filter these two magnetic fields is that the intensity of the magnetic field of the earth remains relatively constant over the range of movement of the oral hygiene device compared to the detected change in the magnetic field emitted by the magnetic field transmitter 110. Therefore, a time filter can be applied to distinguish the two magnetic fields. In some embodiments, the magnetic field emitted by the transmitter 110 can be pulsed at a certain frequency or amplitude so that it can be easily filtered out using signal processing and data analysis.

[0130] In some embodiments, the magnetic field direction component of the vector data output from the magnetometer 11 can also be used to calculate relative position change and / or orientation. For example, in some embodiments, the transmitter 110 can transmit a signal having Figure 5 The illustrated vector orientation magnetic field. The direction or vector information detected by the magnetometer from the magnetic field B generated by the transmitter 110 can be used to provide orientation and / or relative position information. This data can then be combined with data from the direction vector information detected from the earth's magnetic field, which will likely have an orientation different from the orientation of the earth's magnetic field. Therefore, the magnetometer 11 can detect a vector indicating the direction of the earth's magnetic field and a vector of the magnetic field of the transmitter 110 to provide a reference for orientation in space and a reference for position changes.

[0131] In one example, a magnetometer that senses the earth's magnetic field can sense the orientation of the oral hygiene device 1 in a horizontal plane, such as a compass or relative Figure 5 In some embodiments, this may include a vector that will be constant not only in the horizontal direction but also in the vertical direction and based on the inclination of the earth's magnetic field at a specific geographic location. In other embodiments, the transmitter 110 may be placed in a diagonal, horizontal, vertical, or other known orientation that is used as a reference point to calculate the orientation of the magnetometer 11 and changes in the position of the magnetometer 11 and the oral hygiene device 1.

[0132] In addition, calibration may need to be performed based on the relative orientation of the oral hygiene device 1 to the magnetic field transmitter 110 of the base station when used by the user. Because the shape and orientation of the magnetic field lines change based on the position relative to the magnetic field generator, different formulas, calibrations, or adjustments may need to be performed. For example, near the side of the magnetic field generator, the magnetic flux lines may be oriented in a first direction; however, near either polar end of the transmitter 110 (e.g., above or below, or right or left), the magnetic flux lines may be oriented perpendicular to the first direction near the side or middle of the transmitter 110. In addition, the user may be required to brush their teeth at a specific distance from the transmitter 110 to ensure that the appropriate magnetic field is generated for measurement at that location. A beneficial aspect of the coil physically oriented in the vertical direction is that the magnetic field generated on all sides of the transmitter 110 (and by proxy, the base station 2) at the assumed relatively same height is relatively the same, and thus calibration may require a simpler algorithm and / or process. However, if the coil is located in a horizontal plane, the magnetic flux lines may propagate in different directions depending on the orientation of the base station 2. In this embodiment, the user may be instructed to rotate the base station 2 so that it points in a specific direction relative to the user, in which the user typically brushes his teeth. In other embodiments, calibration can utilize or accommodate changes in the vector direction of the magnetic field emitted by transmitter 110 .

[0133] The data from the magnetometer 11 can be combined with the data output from the accelerometer 11 or the data from the gyroscope 11 and the accelerometer 11 or the optical sensor / camera 9 to determine the orientation and / or position. For example, the data from the accelerometer 11 and / or the optical sensor / camera 9 can first be used to determine the orientation of the oral hygiene device 1 relative to gravity during a period of relatively small acceleration, whereby the acceleration of gravity will be detected by a three-axis accelerometer or image analysis, so that it can be determined whether the oral hygiene device 1 is tilted about a lateral axis in the horizontal plane, or how it is rotated about its longitudinal axis (the longitudinal axis extending through the length of the toothbrush) relative to the gravity pointing downward toward the earth.

[0134] If the accelerometer data indicates that the oral hygiene device 1 is experiencing a relatively small amount of acceleration relative to normal brushing movements, the control system can determine that the oral hygiene device 1 is relatively stationary and the accelerometer data can be used to determine a vector oriented in the direction of gravity.

[0135] If accelerometer data is combined with gyroscope data, the deviation of the posture of the toothbrush relative to gravity can be determined to calculate the posture of the toothbrush. For example, the initial record of the gravity vector can then be used as a reference vector to determine the posture. Then, the deviation of this initial position or posture determined by the accelerometer and gyroscope can be determined by calculating the orientation change from the initial reference vector based on the gyroscope data. Therefore, the accelerometer or accelerometer and gyroscope data can be used to determine which direction the bristles are facing. For example, in some embodiments, the accelerometer and gyroscope data can be analyzed to determine whether the bristles are facing upward, forward or downward, facing the front side, the left side and the right side, thereby potentially narrowing to a specific quadrant or other division of the oral cavity. For example, when the bristles of the oral hygiene device 1 face downward, they can only brush the top of the lower teeth. If the bristles of the oral hygiene device 1 face upward, they can only brush the crowns or cusps of the upper teeth. As another example, when the oral hygiene device 1 faces the right side, it can only brush the left side of the molars, etc. Additionally, in some embodiments, the orientation relative to gravity will be deterministic, as the vector representing gravity will always point towards the floor or earth, and brushing will most likely be done standing upright.

[0136] Thus, it is possible to determine the orientation of the bristles relative to the teeth in some aspect or plane of orientation. In some embodiments, these calculations can be performed deterministically or estimated using statistical data and / or a modified model of the oral cavity. For example, if an accelerometer senses that the bristles of a toothbrush are facing downward within a certain error margin or within a statistically valid margin, the system can determine that the surface being brushed is likely the top of the lower teeth (or, for example, the tongue). In other embodiments, as disclosed herein, brushing orientations can be calculated relative to each other so that a model of the oral cavity can be adapted each time a user brushes their teeth.

[0137] In order to determine the orientation in the horizontal plane perpendicular to gravity, the earth's magnetic field or a magnetic field generated by, for example, a transmitter 110 of the base station 2 can be used. In some embodiments, the magnetic field transmitter 110 will generate a magnetic field with a direction vector that changes direction in the horizontal plane perpendicular to gravity. Therefore, even if the absolute direction is not known, the relative orientation of the oral hygiene device 1 relative to the magnetic field detected by the magnetometer 11 and emitted by the transmitter 110 can be determined in the horizontal plane. Therefore, the relative change of this orientation in the horizontal plane can be determined, and the movement path along the reference coordinate system can be determined. In some embodiments, the reference coordinate system can be based on one of the initial data points or any other data points recorded during the brushing session. As disclosed herein, after the user has finished brushing, these relative changes can be used to calculate the position or reconstruct the shape by using the relative position.

[0138] In some embodiments, data from gyroscopes, magnetometers, optical sensors, and accelerometers can be used to determine orientation relative to gravity and one or both of the magnetic fields of the earth and transmitter 110. In some embodiments, orientation can be determined and confirmed or verified by a different sensor 11 or optical sensor 9. For example, angular velocity from a gyroscope can be integrated to determine changes in orientation in certain directions, but the integrated errors can be corrected using magnetometer readings and / or data from the optical sensor / camera 9. In other embodiments, any or both of a magnetometer, gyroscope, and magnetometer can be used in various combinations to determine orientation.

[0139] In some embodiments, orientation alone can be used to determine the position of the oral hygiene device 1 using statistical analysis as disclosed herein. In other embodiments, inertial changes detected by the gyroscope and / or accelerometer can be used in conjunction with or separately from the readings of the magnetometer 11 to provide further indications of movement or distance to calculate the estimated position of the bristles of the oral hygiene device 1. In some embodiments, the orientation information can be combined with data indicating translational inertia or position changes output from the sensor 11 or the optical sensor 9. Depending on the location of the inertial sensor, the orientation information can be combined with the inertial movement data to indicate the position of the bristles. For example, if the motion sensor 11 is located inside the oral hygiene device 1, but in the middle of the longitudinal axis of the toothbrush, where the user will hold the oral hygiene device 1, a change in orientation will move the head without moving the position of the motion sensor 11 (although it can be rotated into place). Therefore, the orientation information can also be used to calculate the position of the bristles in space relative to the position of the sensor 11.

[0140] The change in movement or position can also be calculated from the data output by the magnetometer 11. In some embodiments, the magnetometer 11 can detect the magnetic field generated by the magnetic field transmitter 110 in the base station 2 or another stationary component separated from the oral hygiene device 1. In this embodiment, the strength and orientation of the magnetic field sensed by the single-axis, two-axis or three-axis magnetometer 11 can provide additional data about the position movement of the oral hygiene device 1 relative to the magnetic field transmitter 110 (which is fixed and stationary) in the base station 2. Therefore, an increase or decrease in the magnetic field will indicate that the oral hygiene device 1 is moving toward or away from the base station 2. In addition, the change in the orientation or inclination of the magnetic field and its polarity output by the magnetometer 11 can be used to determine the translation and position. This information can be used to determine how much distance is equal to per unit change in magnetic field strength based on the direction of movement based on calibration or experimental data (because different directions through the magnetic field will have a higher or lower rate of change). In other embodiments, the per unit change in the inclination or shape of the magnetic field can also be related to the change in position. Each time the oral hygiene device system disclosed in this article is set up, including such a system in which a magnetometer is incorporated in the base station 2, the corresponding orientation of the horizontal magnetic field can be different. This is because the way each user stands while brushing, and / or the way the base station 2 is oriented on the countertop may vary for each user, and even vary somewhat between each cleaning of the countertop and after cleaning of the countertop. Therefore, adaptive statistical analysis may be used to determine the relative position of the bristles of the oral hygiene device 1.

[0141] The position data calculated from the magnetic field data output by the magnetometer 11 can be combined with inertial data to calculate the position change in the oral hygiene device 1. In some embodiments, the inertial data can be used to calculate the distance traveled, and the magnetometer data can also be used to eliminate errors, and / or provide limits for the calculation of the position change based on the inertial data. For example, assuming that the magnetic field lines are directly perpendicular to the magnetic field lines, where most of the magnetic field lines are compressed, the change in magnetic field intensity may have a certain minimum lower limit. Considering a certain change in magnetic field intensity, it can be determined that the magnetometer has at least traveled a certain Euclidean distance in space (or changed a certain angular orientation). These changes in inclination angle and field intensity can be used to determine the distance change within certain error margins, which can be supplemented or fine-tuned according to accelerometer or gyroscope data. This data can be combined with orientation and inertial data to determine a more accurate travel distance and relative travel direction of the oral hygiene device 1.

[0142] Brushing time and location - visual pattern recognition

[0143] In some embodiments, the optical sensor / camera 9 and pattern 120 recognition system can be used to track the movement of the oral hygiene device 1. For example, as described above, the oral hygiene device 1 can include a pattern 120 on the handle 40 or the head 42 that can be recognized by the visual tracking system. The visual tracking system is capable of identifying the orientation, distance, and position of the pattern 120 on the oral hygiene device 1. For example, in some embodiments, the pattern 120 can be on the head 42, and a separate pattern 120 can be on the handle 40 to allow the system to determine the position of the handle 40 and the head 42 of the oral hygiene device 1 to help determine the orientation and movement. Visual pattern recognition has been used to detect the movement and orientation of markers, for example, the system described in "Towards Positioning through Visual Markers" by Bernhard L. Ecklbauer, the disclosure of which is incorporated herein by reference in its entirety. For example, image processing software can identify the boundaries of the oral hygiene device through standard boundary image identifiers, identify the appropriate size of the object and the size of the toothbrush, and then attempt to determine the orientation of the oral hygiene device (or determine the orientation of the pattern 120 and the oral hygiene device, respectively).

[0144] In some embodiments, the visual pattern recognition system can also be used to determine the position and orientation of a person's face. It would be useful to compare the relative position and orientation of the face and / or mouth and the oral hygiene device 1 in order to determine the position of the oral hygiene device relative to the mouth. In some embodiments, the system can first acquire an image with the oral hygiene device 1 at the same distance from the optical sensor / camera 9 as from the person's face. Additionally, an initial calibration using the orientation and size of the face can be used to calibrate the distance from the camera 9 to the oral hygiene device 1 so that the size and movement can be estimated. In some embodiments, since the size of the oral hygiene device 1 is known, the relative size of the face using the oral hygiene device 1 can be determined to calibrate or estimate the shape and size of the chin and modify the algorithm used to determine which area is being brushed.

[0145] For example, if the system can be used to determine the position and orientation of the face, the system can determine whether the oral hygiene device 1 is in or near the mouth. This will help the system verify and confirm when use starts and stops, because the oral hygiene device 1 will only be near the user's mouth when the user is actually using it. It is rare for a user to keep a toothbrush near the mouth when the user is not actually brushing their teeth. Instead, the user usually rinses / puts down the oral hygiene device immediately after finishing brushing their teeth.

[0146] Thus, the data detected by the camera can be evaluated to determine the position, movement and orientation of the oral hygiene device 1. For example, the oral hygiene device 1 can have a camera on the back of the head 42 or on the handle 40 or both with a Figure 6A-6B The code "AB" for the circle and line shown. In some embodiments, the pattern 120 can be any other pattern 120 with a different orientation as described herein. The camera 9 can detect the pattern, and the data can be retrieved for processing and analysis. For example, the visual data detected by the camera can be output, and the processor can evaluate the data to determine the orientation and size of the pattern 120 and the relative sizes of certain portions of the pattern 120.

[0147] For example, if the pattern is AB and is oriented as shown on the back of the head 42 of the oral hygiene device 1, and the data analysis determines that AB is oriented upright, then the user is most likely not brushing their teeth. This is because this would mean that the oral hygiene device 1 itself is upright (e.g., Figure 6A-6B ), which is a highly unlikely position for a user holding the oral hygiene device 1 while brushing their teeth. Instead, the longitudinal axis of the oral hygiene device 1 will typically remain in a horizontal plane during brushing. However, if the camera 9 detects data indicating that AB on the head of the oral hygiene device 1 is sideways, this may mean two things: (1) the oral hygiene device 1 is positioned with the back of the head 42 of the oral hygiene device 1 facing the user because AB is actually visible to the camera 9, and (2) the oral hygiene device 1 is horizontal because AB is oriented on its side. For example, this would provide a high probability that the oral hygiene device 1 is brushing the front teeth. This is because the camera 9 is typically positioned so that the user faces the camera 9 while brushing their teeth. Therefore, if AB is visible to the camera 9 and is on its side, the oral hygiene device 1 must be oriented with the bristles facing the mouth (to brush the front surface) and brushing the front teeth (not the side) because AB is still visible to the forward-facing camera 9.

[0148] However, in many positions of the oral hygiene device 1, the head 42 of the oral hygiene device 1 and any associated pattern 120 may not be visible to the camera 9. For example, the pattern 120 on the back of the head 42 will not be visible when brushing the molars, tongue, top or bottom surfaces of the teeth. Therefore, in some embodiments, additional patterns 120 may be included on the attachment 130 on the end of the oral hygiene device 1. This will allow the camera 9 to detect the orientation of the pattern 120 on the attachment 130 and / or handle 40 when the oral hygiene device 1 is inserted into the user's mouth. For example, in some embodiments, the attachment 130 can be a spherical bulb on the bottom of the handle 40 of the oral hygiene device 1 and include several different patterns at different positions around the sphere.

[0149] This will allow the camera to detect the position and orientation of several different patterns. Upon visually detecting a pattern, the system can determine (1) which pattern 120 is being detected, (2) the size of the pattern 120, (3) the orientation of the pattern 120, (4) the relative sizes of different components of the pattern 120, and (5) other characteristics of the pattern 120. This information can be downloaded and compared with existing data related to the type and orientation of the pattern 120 placed on the attachment 130 (and / or the handle 40 or head 42 of the oral hygiene device 1). For example, the system may include a database that stores each of the different patterns 120 and different size and orientation information about the pattern 120 associated with the oral hygiene device 1 and the distance from the camera 9. For example, each pattern 120 may include information about whether the oral hygiene device is on its side, pointing toward the mouth, etc. if it is found in an upright orientation. In other embodiments, the size of the detected pattern 120 may be equal to the distance of the oral hygiene device 1 from the camera 9, assuming a set distance. In some embodiments, calibration information may be further added to enhance the system analysis of brushing data for a specific individual and / or a specific bathroom. Thus, each pattern 120 may have a number of pixels associated with each component (e.g., height / width of certain features) that may be associated with a particular distance from the camera 9. This may be an approximation or average, or use statistics to find the highest probability distance / orientation.

[0150] Then, once this pattern information is determined, it can be compared to calibration information or other data representing the pattern 120 and the corresponding orientation included on, for example, the attachment 130. For example, if the AB pattern 120 is included on, for example, Figure 6A-6B On the attachment 130 shown, with an upright orientation and facing forward in the same direction as the bristles, if the pattern is detected to be upright, the user is unlikely to be brushing his teeth. However, again, if this pattern 120 is detected to have a lateral orientation, the user may be brushing his premolars. In another example, if another pattern BC is placed on the bottom of the toothbrush, the oral hygiene device may be used to clean the molars when the system detects the pattern. Therefore, the orientation of BC can then be used to determine whether the user may be cleaning the top, bottom or side of the molars. In some embodiments, this can be combined with accelerometer and gyroscope data to determine which side of the oral cavity is being brushed.

[0151] In yet another embodiment, the system is capable of determining the position of an oral hygiene device (without a pattern) relative to the face, including the vector direction of its longitudinal axis. Therefore, the system can then determine whether the oral hygiene device may be on the left or right side of the oral cavity. This can be accomplished using a visual recognition system disclosed herein. In other embodiments, the system can determine the position and orientation of the oral cavity and the oral hygiene device relative to each other. For example, an oral recognition algorithm can be used to approximate the position of each corner or side of the oral cavity. In addition, there can be visual markings on the neck of the oral hygiene device 1 to help the system determine which side of the oral cavity is being brushed when the user places the oral hygiene device inside the oral cavity.

[0152] There is no pattern on the toothbrush

[0153] like Figure 7 As shown, and in some embodiments, the system may detect only the outline of the handle of the oral hygiene device 1 to determine the orientation of the longitudinal axis relative to gravity without utilizing the pattern 120 or markings. In other embodiments, the system may have additional image processing software to identify specific features of the oral hygiene device including the head (bristles, etc.) by classifying certain portions of the image using a classification algorithm. In some embodiments, the image processing software identifies the longitudinal axis, the head, the base, and may also identify the bristles. From this information, the orientation and position of the oral hygiene device can be determined. In some embodiments, similar boundary detection / shape classification software can be utilized to identify the user and the user's oral cavity. Therefore, the relative position of the oral hygiene device relative to the oral cavity can be determined, as further explained herein.

[0154] The inventors can utilize this system so that a customized oral hygiene device is not required and only a chip needs to be provided inside the oral hygiene device including the motion sensor 11. Thus, the device can be manufactured using an existing oral hygiene device design and only a chip or controller 13 system including the motion sensor 11, antenna 5 or other wireless connection and memory is implemented. The device can then send all data to a connected smartphone or other connected device 30 (e.g., smart mirror, etc.).

[0155] Combining visual and motion data for position determination

[0156] Visual data can also be used to determine the acceleration and vector or direction of motion of the oral hygiene device 1 while it is brushing. Visual data can capture different positions and time stamp the data to determine the amount of time recorded to travel from a first point to a second point, and therefore the velocity (direction and speed) and acceleration. As described herein, the position data can be used to calculate the brushing position. This combined with the orientation data will be able to provide sufficient position and orientation data to determine the position in the user's mouth and the section of the mouth being brushed as described herein.

[0157] For example, in some embodiments, visual information from pattern recognition or brush profiles can be used to recalibrate the position output from the accelerometer / magnetometer / gyroscope position determination. In these embodiments, the visual data can be used to recalibrate the drift experienced by the position sensor to return it to a reference coordinate system. In other embodiments, the visual data can be used to recalibrate the entire statistical model used to determine position.

[0158] In some embodiments, the position can be determined independently from the motion / acceleration / position sensor and independently from the visual recognition data. These two determinations can then be used to determine the final position relative to the oral cavity. In other embodiments, only the visual recognition data can be used alone to calculate the position relative to the oral cavity.

[0159] For example, a first example would be a setup without the visual pattern 120 added to the oral hygiene device 1. Using only the data output from the motion sensor 11, in some cases it may be challenging to distinguish which side of the mouth the oral hygiene device 1 is when the oral hygiene device is oriented in the same direction but may brush different sections of the teeth. For example, their orientation about the axis is the same or nearly the same, but their position on one side of the face is on the left or right side of the mouth.

[0160] For example, an ambiguous determination could be: is the user brushing the outer surfaces of the teeth on the left side of the mouth or is the user brushing the inner surfaces of the teeth on the right side of the mouth? Even without the additional visual pattern 120, the system can distinguish left from right using visual information of the oral hygiene device and the user's face alone. Therefore, the combination of algorithms is beneficial in this case because the inertial data is not known to be sufficient to establish relative spatial position in a coordinate system around the head. Therefore, the visual information can be used to make a secondary determination of which side of the head the brush is on, and therefore, the visual information and orientation information (with respect to an axis or point or relative to gravity) can be combined to determine which side of the head the oral hygiene device 1 is on and if (e.g., the inner or outer surface of the teeth is being brushed).

[0161] Another example may include an embodiment having a pattern 120 attached to the oral hygiene device 1. For example, the pattern 120 may be added to the bottom of the oral hygiene device 1 and to the back of the head of the oral hygiene device 1. However, with the pattern 120, there may be some positions of the oral hygiene device 1 where the visual information alone will not be sufficient to determine the position and orientation of the oral hygiene device 1 with sufficient accuracy. For example, when the visual label is partially hidden or the image resolution is too small to accurately detect in size and orientation.

[0162] For example, if the user is brushing their molars, and the only visible pattern 120 is on the bottom of the oral hygiene device 1, and the resolution is low (e.g., because the user is a little too far from the camera device, or because the user is using a camera with insufficient resolution), the system may not be able to determine with sufficient accuracy the angle of the oral hygiene device 1 on the teeth. Therefore, the system cannot determine whether the user is brushing the outside of the molars on the upper jaw or the outside of the molars on the lower jaw.

[0163] In this case, the angular difference between the two brushing positions (e.g., the angle of the longitudinal axis of the oral hygiene device relative to gravity, because the oral hygiene device is held at slightly different angles when brushing the top or bottom molars) can be quite slight. However, the motion data (particularly acceleration and vertical orientation) may be able to distinguish between the two possible positions narrowed down by the visual data and thus provide the necessary information whether the oral hygiene device 1 is brushing the upper or lower jaw. Therefore, the visual data alone can be supplemented with motion data to determine the position or segment of the teeth being brushed.

[0164] Analysis of brushing time and position-motion data

[0165] In order to use the data from the sensors to estimate the amount of time spent in each section, quadrant, or other logical division of the oral cavity, the user may need to calibrate the oral hygiene device 1. In some embodiments, calibration can be performed at the factory, by the user, or both. Thus, calibration can be used to calibrate a specially manufactured unit and adapt to the topography, anatomical structure (i.e., height), and / or bathroom environment of a specific user, which may, for example, include unique magnetic interference, unique height and orientation (the desktop may not be horizontal, etc.). For example, in some embodiments, the user can apply a colored gel to their teeth. Then, once the oral hygiene device 1 is in position on the teeth and all the colored gel is brushed off, the user can switch the oral hygiene device 1 to calibration mode while the motion sensor 11, optical sensor 9, and other sensors are recording data.

[0166] At this point, the user can turn off calibration to stop the collection of calibration data. In other embodiments, once the user turns on the calibration function, the oral hygiene device 1 will detect the points in time when the user starts and stops brushing, including any pauses in brushing. This calibration procedure provides reference position, orientation, and motion calibration data, which can then be compared with subsequent brushing using statistical analysis 78 or other analysis methods to determine whether the subsequent brushing has brushed all areas of the oral cavity and for a sufficient period of time.

[0167] Once the device is calibrated, or using reference data from previous brushing and / or other model users brushing, the brushing data for each use can be compared to the reference data to assess its quality 78 and determine the position of the oral hygiene device 1 in the newly acquired data. For example, the calibration data can be used to prepare a statistical model of the shape and size of a particular user's mouth, and used to create certain statistical boundaries to determine when the oral hygiene device 1 is brushing any particular section of the user's mouth. Then, once the user starts brushing for the second time, the newly recorded data can be overwritten or associated with the calibration brushing data associated with the user profile 60 to determine if and where there are defects in brushing. For example, the system 100 can determine how much time it takes to brush each quadrant, how many strokes, or perform other evaluations on brushing. In addition, the analysis can indicate that the user is brushing too much in certain areas or is not using the correct stroke pattern overall or in a particular section of the user's mouth.

[0168] Correlation can be performed by statistical analysis, for example, quantitative comparison of these differences can be performed by measuring the Euclidean distance in 3xz space only. Such vectors can then be processed using statistical analysis (including principal component analysis (PCA), hierarchical cluster analysis (HCA), regression analysis, and linear discriminant analysis). Statistical methods suitable for high-dimensional data can be utilized. As an example, HCA systematically checks the distance between data representing each type of motion or position data. Then, a dendrogram representing the clustering of data can be generated from the Euclidean distance between and among the data vectors, much like an ancestral tree.

[0169] Each statistical data cluster can represent the sensor data of each section, quadrant or other logical division of the user's oral cavity.For example, the oral cavity can be divided into top and bottom, and the top and bottom each have right, front and left, and each of the right, front and left has inner, top and outer faces.Therefore, the oral cavity can have 36 different sections, 10 sections, 8 sections, 12 sections, or 4 sections (quadrants), only top and bottom, only outer and inner and other logical divisions.Therefore, using reference data, other processors in controller 13 or system 100 (for example, processors in mobile phones or servers) can calculate confidence intervals or other values, and the confidence intervals or other values ​​indicate the possibility of the oral hygiene device brushing the specific section of the user's oral cavity, but the possibility of the association or correlation of the stroke with the calibration data in those sections can be determined.In order to obtain a reference position, the user can be instructed to initiate the brushing at the same position of the oral cavity.In this way, the data starts at a known position, and it can be used as a reference point to use statistical analysis to associate the rest of the data. For example, angles, orientations, calculated distances, and other characteristics from reference positions of the oral hygiene device 1 detected by the motion sensor 11 and / or optical sensor / camera 9 may indicate the likelihood that each new position is associated with a certain position of the oral cavity based on the calibration data.

[0170] In other embodiments, the control system 13 or other system processor (e.g., a processor in a smartphone, server, or other component) can process the statistical data and determine that the brush is brushing a certain section of the mouth if the statistical analysis shows that there is greater than 95%, 85%, 80%, or other suitable certainty that the brush is within the section of the mouth. In some embodiments, the specificity or sensitivity of the static analysis of brushing can be modified to match the differences of a particular user.

[0171] This analysis may include output 80 that allows the control system 13 or other processor to determine which brush strokes are in each section of the mouth or group of teeth, and therefore determine how much time the user spends brushing each quadrant, half or tooth, or other logical division of the mouth, and how those times compare to the recommended regimen. In other embodiments, the start and end times of entering a certain area or other suitable methods may be recorded to determine how much time is spent brushing each section of the mouth.

[0172] In some embodiments, rather than detecting the position of the toothbrush, the system 100 may instruct the user to brush one of certain sections of the oral cavity at a time and only determine whether the user is actually brushing or only count or record the brushing time when a motion indicating brushing is detected. Then, once brushing has been recorded in a specified section within a specified time, the system 100 will indicate to the user the time that has passed when it is time to move to the next section of the oral cavity and when the user is actually brushing. This prevents the user from taking a break and therefore prevents brushing for less than the optimal amount of time in each section. Therefore, the control system 13 or other processor can analyze the data from the sensor 11 (or pressure sensor 10) to record the amount of time the user brushes in each section when the system 100 indicates that the user should brush in that particular section.

[0173] In other embodiments, the pressure applied by brushing the teeth on the head 42 may also be detected by a pressure sensor 10 incorporated into the oral hygiene device 1. For example, the pressure sensor 10 may be incorporated into the head 42 and detect the pressure associated with use. Additionally, the pressure may be mapped to various position data, and thus the controller 13 or other processor of the system 100 may calculate the amount of pressure used to brush each area of ​​the oral cavity.

[0174] Machine Learning

[0175] In some examples, the statistical analysis used to implement the various features disclosed in system 100 will be a machine learning or artificial intelligence algorithm. For example, system 100 can process available data sources from system 100 including sensors as disclosed herein and identify locations within the oral cavity. In other examples, machine learning algorithms can be used to: (1) identify cavities or plaque using machine vision or other combinations of data, (2) identify locations of varying degrees of granularity in the oral cavity; (3) identify brush stroke types using the stroke dictionary disclosed herein, (4) identify users from motion or image data (e.g., machine vision to identify facial features), or (5) other useful applications of the features described herein.

[0176] Machine learning algorithms can take many forms. For example, system 100 can utilize more basic machine learning tools, including 1) decision trees ("DT"), (2) Bayesian networks ("BN"), (3) artificial neural networks ("ANN"), or (4) support vector machines ("SVM"). In other examples, deep learning algorithms or other more complex machine learning algorithms can be used.

[0177] DT programs are commonly used because of their simplicity and ease of understanding. A DT is a classification diagram that matches input data to questions asked at each successive step in a decision tree. The DT program moves down the "branches" of the tree based on the answer to the question (e.g., first branch: Is the patient a male? Yes or No. Second branch: Does the patient have problems urinating? Yes or No, etc.).

[0178] Bayesian networks ("BNs") are based on the likelihood that something is true based on given independent variables and are modeled based on probabilistic relationships. BNs are purely based on probabilistic relationships, which determine the likelihood of one variable based on another or other variables. For example, BNs can simulate the relationship between symptoms and diseases. Specifically, if the patient's symptoms or biomarker levels are known, BNs can be used to calculate the probability that the patient has a specific disease. Therefore, using an effective BN algorithm, inferences can be made based on input data. They are commonly used by the medical field to represent reasoning under uncertainty in a wide range of applications, including disease diagnosis, genetic counseling, and emergency medical decision support system (MDSS) design.

[0179] Artificial neural networks ("ANNs") are computational models inspired by the central nervous system of animals. They map inputs to outputs through a network of nodes. However, unlike BNs, in ANNs, nodes do not necessarily represent any actual variables. Therefore, ANNs can have hidden layers of nodes represented by variables that are not known to the observer.

[0180] ANNs have the ability to recognize patterns and have been used in the fields of medicine and diagnosis. Their computational methods make it easier to understand the complex and unclear processes that may occur during disease diagnosis based on input data and various input data including symptoms. Although still facing excessive limitations, ANNs have been proven to be suitable for CDSS design and other biomedical applications, such as diagnosis of myocardial infarction, MDSS for leukemia management, and cancer detection.

[0181] Support vector machines ("SVMs") come from a framework that utilizes machine learning statistics and vector spaces (a linear algebra concept that represents the number of dimensions in a linear space) equipped with some type of restricted correlation structure. In some cases, they can determine a new coordinate system that easily separates the input into two classifications. For example, an SVM can identify a line that separates two groups of points originating from different event classifications.

[0182] They have practical applications and are well-founded in theory, but can sometimes be difficult to understand. SVMs have been applied in many biological fields, such as MDSS for diagnosing tuberculosis infection, tumor classification, and biomarker discovery.

[0183] However, there are relatively new machine learning algorithms that are able to model very complex relationships with a large number of variations called deep neural networks. Deep neural networks have recently been developed to solve the problem of speech recognition.

[0184] In the IT industry, in the past few decades, many researchers have proposed various DNN architectures to solve problems related to algorithms (e.g., ANN). These types of DNNs are CNN (Convolutional Neural Network), RBM (Restricted Boltzmann Machine), LSTM (Long Short-Term Memory), etc. They are all based on the theory of ANN. They show better performance by overcoming the problem of back propagation error reduction associated with ANN.

[0185] Machine Learning – Training Data

[0186] Machine learning algorithms require training data to identify the features of interest they are designed to detect. For example, a variety of methods can be utilized to form machine learning models, including applying randomly assigned initial weights to the network and applying gradient descent using backpropagation for deep learning algorithms. In other instances, a neural network with one or two hidden layers can be used without training using such techniques.

[0187] In some instances, labeled data or data representing specific features, specific actions or characteristics, including specific locations in the mouth, specific brush strokes, specific users, and others, will be used to train the machine learning algorithm. In some instances, the training data will be pre-filtered or analyzed to determine certain features, including various advanced filters or starting points including motion sensing data (brush pick-up, brush facing certain directions relative to gravity). In other instances, only the resulting labeled data will be used, and various related data can be input to train the machine learning algorithm.

[0188] For example, to identify the position in the oral cavity, various machine learning algorithms may be utilized that input various data disclosed herein, including motion (accelerometer output, gyroscope output, magnetometer output), visual data from a camera on the base station 2, or other data related to the position of the oral hygiene device 1 during brushing. For example, in some embodiments, the input data used to determine the position of the toothbrush may include only data output from sensors on the oral hygiene device 1. For example, in some instances, the input data will be labeled data from only an accelerometer sensor.

[0189] In other examples, the input data may be various combinations of marker data output from accelerometers, magnetometers, and gyroscopes to identify the location. In some examples, the starting and ending points of the input data will be very important. In some examples, the input data may be a combination of data output from sensors on the oral hygiene device and sensors on the base station 2 (e.g., a visual recognition or depth perception system).

[0190] Similarly, for the system 100 to identify brush stroke types (e.g., specific motions), the system can utilize machine learning from a combination of data output from various sensors. In some instances, data output from an accelerometer alone may be sufficient to identify a brush stroke. This is particularly the case because most brush strokes have a repeating specific acceleration pattern and may include angular information about gravity as disclosed herein.

[0191] In the system 100 for identifying a user, a machine learning algorithm may be utilized to detect the user's face and identify the user with a unique profile. In these examples, the user may first use the system including a base station 2 having a camera 56 that may take an initial picture of the user. The user may then indicate their profile selection, and the system may use the picture to identify the user in the future. Over time, the system may acquire additional pictures or videos of the user to make the identification of the user more robust (e.g., more labeled training sets).

[0192] Machine Learning - Obtaining Training Data

[0193] In some instances, the marking of the training data may include an operator examining the recorded data as the camera captures an image of the user. In other instances, the user prompts will inform the user of (1) where to brush, and (2) the type of brush strokes that may be used (e.g., other specific motions) to train the system. For example, in some instances, the system 100 may utilize a diagram of the mouth of a trainer or other instructor that may highlight, light up, or otherwise instruct the user where to brush. For example, these instructions may be displayed on a display of a mobile device.

[0194] Thus, an automated instruction system may be used to acquire training data for a specific user (with a personalized algorithm) or for many users. For example, where the system 100 implements a mobile device 30, the system may display a schematic diagram of the user's dentition on the screen of the mobile device 30 and instruct the user which areas should be brushed in order in real time. The system may then record the data as labeled training data, where each set of data indicates a certain location in the oral cavity.

[0195] Additionally, the system 100 can indicate the type of brush stroke to be used, including circular, back and forth, or more complex strokes as disclosed herein. Thus, these will provide input training data to the system 100 to learn how to recognize locations in the oral cavity and certain brush strokes.

[0196] However, in some instances, it may be desirable to filter the input data from the coaching style collection to reduce dimensionality before feeding the labeled data into the algorithm used to develop the model. For example, principal component analysis or other dimensionality reduction methods may be implemented before the labeled data is fed into the algorithm.

[0197] In other instances, various filters may be utilized to filter the data prior to labeling and prior to inputting the data as training data. For example, if a machine learning model for identifying position is being developed, the system may filter out various accelerations including rapid time variations or periodic accelerations that are related to brush travel rather than position. Similarly, for brush travel, steady accelerations (e.g., gravity) may be filtered out, and only periodic accelerations will be analyzed or fed into the system. In other instances, the data may not be pre-filtered, and a sensitive deep learning algorithm may reliably determine position with the additional data.

[0198] In other instances, data may be pre-filtered or post-filtered (rejected later after analysis) in cases where the user is performing an error or is not following instructions displayed on the mobile device 30 or other device display. Additionally, various filters or techniques may be utilized to determine when the user is in position and following instructions, for example, once periodic brushing is detected (e.g., periodic changes in acceleration).

[0199] Feedback presentation

[0200] Once the controller 13 of the system 100, or other processor contained in a smartphone, server, or other component of the system 100, has analyzed the usage data 78, feedback may be presented to the user 80 via the speaker 50, visual indicator 52 on the oral hygiene device 1, or via an associated mobile device 30 or other computing device in data communication with the system 100. This feedback may be presented immediately, or may be accessed to check progress.

[0201] For example, instantaneous feedback may be provided to the user 80 during brushing, including indications by audio or visual means of how much time is left, whether to brush harder or softer, whether certain quadrants have been brushed sufficiently, and when brushing is complete. For example, a red light or stop sound may be produced by the speaker 50 to indicate that brushing is complete.

[0202] In addition, historical and average brushing time and location data can be presented to the user 80 on the mobile device or other computing device using graphs, charts, percentages, and other metrics. For example, the user can be presented with the average time spent per day, per quadrant, and the average number of days that the user brushes once, twice, or other times. In addition, the average time spent brushing each tooth can be calculated and presented to the user on the mobile device 30 or other computing device. The program 15 running on the mobile device can control the presentation of the data using the controller 13 of the mobile device 30.

[0203] In some instances, the system may combine filtered and processed position and brush stroke identifications and possible plaque identification to provide holistic feedback. For example, in some instances, feedback will not only be about the time in each position of the mouth, but will also include the strokes used in each position of the mouth. In some instances, certain stroke techniques will present higher feedback scores to the user, or certain strokes used in certain positions in the mouth.

[0204] 9A and 9B, an application according to some embodiments may include a display 910 of a mobile device 30 that may include a heat map 920 or other visual representation of locations that a user has brushed, the accuracy of brushing in each location, the amount of time, and the type of strokes used. This information may provide the user with multiple goals for improving brushing.

[0205] refer to Fig.10 , the oral hygiene system 1000 includes an oral hygiene device 1002, a sensor 1004, a display device 1006, a processor 1008, a storage device 1010, and a communication module 1012. The oral hygiene system 1000 is generally used to promote compliance with an oral hygiene regimen by executing associated applications using the processor 1008 and the storage device 1010 and displaying the applications on the display device 1006.

[0206] The oral hygiene device 1002 is similar to the oral hygiene device 1 ( Figure 3A ) and more generally may be any typical manual toothbrush or electric toothbrush. The oral hygiene device 1002 includes a head 1002a and a handle 1002b ( Fig. 13B ). The sensor 1004 is generally used to track the movement of the oral hygiene device 1002. The sensor 1004 may be an optical sensor, a camera, a pressure sensor, a motion sensor, a proximity sensor, a depth perception sensor, a gyroscope, a magnetometer sensor, any other suitable sensor, or any combination thereof.

[0207] The display device 1006 is typically used to display still images, video images, or both. The display device 1006 can be, for example, a display device, a smart phone, a tablet computer, a laptop computer, a smart watch, a television, a smart mirror, or any other suitable display device. The display device 1006 can also include a user interface to receive input from a user, such as a touch screen interface, a graphical user interface, a hardware interface, etc., or any combination thereof.

[0208] The storage device 1010 stores instructions (e.g., associated software applications) that can be executed by the processor 1008. The sensor 1004, the display device 1006, the processor 1008, and the storage device 1010 can be communicatively coupled to each other. Although the sensor 1004, the processor 1008, the storage device 1010, and the display device 1006 are shown as separate components, the sensor 1004, the processor 1008, the storage device 1010, or any combination thereof can be included in a single housing (e.g., within a smartphone). Alternatively, the processor 1008 and the storage device 1010 can be included in a controller (not shown) that is the same as or similar to the controller 13 described above.

[0209] In some embodiments, the sensor 1004, the display device 1006, the processor 1008, the memory 1010, and the communication module 1012 may be integrated into a single housing 1014. In some embodiments, the housing 1014 is a smart phone. The smart phone may also include a speaker (not shown), a light (e.g., an LED light), a camera (e.g., a forward camera), a microphone, etc., or any combination thereof. Alternatively, the sensor 1004, the display device 1006, the processor 1008, the memory 1010, the communication module 1012, or any combination thereof may be decoupled from each other as separate components. For example, the housing 1014 may include the display device 1006, the memory 1008, the processor 1010, and the communication module 1012, while the sensor 1004 is a separate component (e.g., an independent sensor as part of the oral hygiene device 1002 base station). Therefore, various combinations of the basic components described herein may be integrated into the housing 1014.

[0210] refer to Fig.11A and Fig. 11B , the schematic diagram 1100 and the timer 1102 are displayed on the display device 1006. Typically, the processor 1008 executes an associated software application to cause the schematic diagram 1100 and the timer 1102 to be displayed on the display device 1006.

[0211] Schematic diagram 1102 represents at least a portion of a set of teeth of a user. As shown, schematic diagram 1102 includes a set of maxillary teeth 1110 and a set of mandibular teeth 1120. The set of maxillary teeth 1110 is divided into a plurality of maxillary segments 1112, and the set of mandibular teeth 1120 is also divided into a plurality of mandibular segments 1122. As shown, the plurality of maxillary segments 1112 and the plurality of mandibular segments 1122 each include four segments having substantially the same size. Each of the plurality of maxillary segments 1112 includes an occlusal surface 1114, an inner surface 1116, and an outer surface 1118. Similarly, each of the plurality of mandibular segments 1122 includes an occlusal surface 1124, an inner surface 1126, and an outer surface 1128.

[0212] In some embodiments, the plurality of maxillary segments 1112 and / or the plurality of mandibular segments 1122 may also include a representation of a single tooth (not shown). Although the schematic diagram 1102 is shown as a plan view including the set of maxillary teeth 1110 and the set of mandibular teeth 1120, other views and orientations of the set of teeth are contemplated. For example, the schematic diagram 1100 may include a front view or a side view of the maxillary teeth, the mandibular teeth, or both. In addition, in some embodiments, the schematic diagram 1012 includes only a portion of a set of teeth of the user. For example, the schematic diagram 1100 may include only a set of maxillary teeth 1110, a set of mandibular teeth 1120, or any number of multiple maxillary segments 1112 or mandibular segments 1122 (e.g., one segment, three segments, etc.) or any combination thereof. In addition, although the schematic diagram 1100 is shown as two-dimensional, the schematic diagram 1102 may be a three-dimensional representation of a set of teeth of the user. In other embodiments, the schematic diagram 1100 may also include a representation of the user's tongue (not shown).

[0213] refer to Fig. 11B , a first mark 1131, a second mark 1132, and a third mark 1133 are displayed on the display device 1006 and overlaid on the schematic diagram 1100. Generally, the marks 1131, 1132, 1133 are overlaid on the schematic diagram 1100 to facilitate the user of the system 1000 to brush the associated sections of the user's teeth. As shown, the first mark 1131 is overlaid on the second section of the plurality of mandibular sections 1122. As shown, overlaying the first mark 1131 associates the first mark 1131 with the second section of the plurality of mandibular sections 1122. The second mark 1132 is overlaid on the fourth section of the plurality of mandibular sections 1122 to associate the second mark 1132 with the fourth section of the plurality of mandibular sections 1122. Similarly, the third mark 1133 is overlaid on the second section of the plurality of maxillary sections 1112 to associate the third mark 1133 with the second section of the plurality of maxillary sections 1112. In this manner, various markers may be overlaid on the schematic diagram 1100 to associate each marker with a desired portion of a set of teeth in the schematic diagram 1100 .

[0214] The position of each of the markers 1131, 1132, 1133 relative to the schematic diagram 1100 can be used to further associate each marker with a specific surface of a set of teeth. For example, as shown, the first marker 1131 is directly overlaid on top of the second segment of the plurality of mandibular segments 1122. Therefore, the first marker 1131 is associated with the occlusal surface 1124 of the second segment of the plurality of mandibular segments 1122. The second marker 1132 is overlaid on the schematic diagram 1110 so that the second marker 1132 is generally adjacent to but spaced apart from the fourth segment of the plurality of mandibular segments 1122. This positioning of the second marker 1132 associates the second marker with the inner surface 1126 of the fourth segment of the plurality of mandibular segments 1122. The third marker 1133 is overlaid on the schematic diagram 1100 so that it partially overlaps the second segment of the plurality of maxillary segments 1112, associating the third marker 1133 with both the occlusal surface 1114 and the outer surface 1118. In this way, the positioning of each marker can be used to associate the marker with various segments in the schematic diagram 1100 with increased granularity. Although not shown, a marker can also be associated with multiple segments by overlaying on the schematic diagram 1100 so that it overlaps multiple segments of the maxillary or mandibular segments of the teeth.

[0215] Each of the marks 1131, 1132, 1133 can be a still image, a video image, an animated image, etc. The image selected for each mark is generally used to promote the user of the system 1000 to brush the associated section of the user's teeth. To this end, the image can have a negative connotation, which encourages the user to want to remove the image from the display device. For example, the mark can be an image of a monster, an alien, a frowning face, a fictional villain / character, a storm cloud, etc. or any combination thereof. Alternatively, the image can be associated with a positive connotation, which encourages the user to try to collect or obtain the items / things in the image. For example, the mark can be an image of a coin or money, a point, a star, an animal, a collectible, etc. or any combination thereof. Finally, the mark can be more generally represented by any image, such as a shape (such as a circle, a square, a triangle or any other polygon), a check mark, other symbols or any combination thereof.

[0216] Although schematic 1100 is shown as including three markers (markers 1131, 1132, and 1133), any number of markers is possible, for example, one marker, two markers, five markers, ten markers, sixteen markers, etc.

[0217] refer to Fig.12 The method 1200 for promoting compliance with an oral hygiene regimen using the system 1000 includes a first step 1202 , a second step 1204 , a third step 1206 , a fourth step 1208 , and a fifth step 1210 .

[0218] The first step 1202 includes displaying the schematic diagram 1100 ( Fig.11A ). The first step 1202 can be initiated by a variety of triggering events, such as the initiation of a user brushing session. The user can indicate that a user brushing session has been initiated by providing an input (e.g., pressing a button on the display device 1006). Alternatively, the first step 1202 can be initiated by using the sensor 1004 to determine that the oral hygiene device 1002 is moving (e.g., the user has picked up a toothbrush). This movement indicates that the user has initiated a user brushing session and initiates the first step 1202 of the method 1200.

[0219] The second step 1204 includes overlaying a mark on the schematic diagram 1100 displayed on the display device 1006. For example, the first mark 1131 ( Fig. 11B ) can be overlaid on the second segment of the plurality of mandibular segments 1122. The first marker 1131 can be overlaid on the schematic diagram 1100 in a variety of ways. For example, the first marker 1131 can be suddenly displayed on the schematic diagram 1100, or the marker 1131 can appear slowly (e.g., the marker 1131 starts to appear as translucent and becomes more opaque) within a predetermined time period (e.g., one second, five seconds, ten seconds, etc.). In some embodiments, an animation can be used to overlay the first marker 1131 during the second step 1204. For example, the first marker 1131 can first appear on the far left side of the display device 1006 and move toward its final position on the schematic diagram 1100. Overlaying the first marker 1131 in the second step 1204 can also include playing a related sound through a speaker (not shown).

[0220] Similar to the first step 1202, the second step 1204 can be initiated by a variety of triggering events. For example, the second step 1204 can be initiated after the system 1000 has determined that a predetermined amount of time has passed (e.g., two seconds, ten seconds, thirty seconds, one minute, etc.) since the user's brushing session has been initiated. The second step 1204 can also be automatically initiated when the user's brushing session is initiated, so that the overlaid mark is displayed while the schematic 1100 is displayed on the display device 1006 during the first step 1202. Alternatively, the triggering event that initiates the second step 1204 can be a user input received by the display device 1006.

[0221] In the second step 1204, the mark can be overlaid on any part of the schematic 1100 (e.g., the first mark 1131, the second mark 1132, or the third mark 1133). In addition, the second step 1204 can include overlaying multiple marks (e.g., the first mark 1131 and the third mark 1133). The section of the schematic 1100 selected for overlaying the mark during the second step 1204 can be random or predetermined. For example, an individual (e.g., a user, a parent of the user, a dentist, or any other third party) can input via the display device 1006 the section of the schematic 1100 that should be overlaid with the mark. For example, if the user has cavities or other dental problems in a certain area of ​​the user's mouth, the mark can be overlaid on the corresponding section of the schematic 1100 during the second step 1204 to help prevent future cavities or dental problems in that area.

[0222] The third step 1206 includes determining the position of the oral hygiene device 1002 relative to the user's mouth / teeth. Generally, the system 1000 determines the position of the oral hygiene device 1002 in the user's mouth using the sensor 1004, the processor 1008, and the storage device 1010. Any of the above-mentioned mechanisms can be used to determine the position of the oral hygiene device 1002 during the third step 1206 (e.g., visual patterns, optical sensors, motion sensors, proximity sensors, pressure sensors, depth perception sensors, cameras, gyroscopes, magnetic field generators, and magnetometer sensors, or any combination thereof).

[0223] During a third step 1206, the position of the oral hygiene device 1002 is associated with a segment of a set of teeth of the user. This segment of the set of teeth of the user is then associated with a segment of the schematic diagram 1100 ( Fig.11A and Fig. 11B ). For example, if it is determined that the head of the oral hygiene device 1002 is positioned on the outer surface of the left anterior quadrant of the user's mandibular teeth (e.g., upper lateral incisors), the location of the head of the oral hygiene device 1002 is associated with the outer surface 1128 of the second segment of the plurality of mandibular segments 1122 in the schematic 1100. If the oral hygiene device 1002 is positioned generally adjacent to or proximate to the user's oral cavity, but not directly adjacent to any teeth, then the location is not associated with a segment of the schematic 1100.

[0224] The fourth step 1208 includes removing the marking from the display device 1006 in response to determining that the head of the oral hygiene device 1002 is positioned directly adjacent to (e.g., in contact with) a segment of a set of teeth corresponding to the segment of the schematic diagram 1100 that includes the marking within a predetermined amount of time. For example, as described above, the first marking 1131 is overlaid on the occlusal surface 1124 of the second segment of the plurality of mandibular segments 1122, and the segment of the schematic diagram 1100 is associated with a segment of the set of teeth of the user. If it is determined that the head of the oral hygiene device 1002 is positioned over the associated segment of the set of teeth within the predetermined period of time, the first marking 1131 is removed from the display device 1006.

[0225] The predetermined amount of time for removing the indicia is typically selected to prompt the user to brush the associated section of a set of teeth according to proper brushing habits, and more generally can be any time period (e.g., one second, five seconds, ten seconds, one minute, two minutes, etc.). Timer 1102 ( Fig.11A and Fig. 11B ) can be used to show the user how long they should brush a particular section of a set of teeth, as a countdown to show the user how long they need to brush the associated section of the set of teeth in order to remove markings, to show the user the total time that has elapsed in a given user brushing session, or any combination thereof.

[0226] Requiring the user to brush the associated section of a set of teeth for a predetermined period of time to remove the marking helps promote compliance with a proper oral hygiene regimen. For example, if the predetermined period of time is five seconds, the user must brush the occlusal surface of the left front quadrant of the user's teeth for five seconds in order to remove the first marking 1131 from the display device 1106. In this example, the first marking 1131 may be an image of a monster, which may motivate or encourage the user to brush the associated section of their teeth to remove the image of the monster.

[0227] Removing the mark in the fourth step 1208 can be accomplished in a variety of ways. For example, in response to the above-mentioned removal conditions, the first mark 1131 can be immediately removed from the display device 1006. Alternatively, the transparency of the first mark 1131 can be increased over a predetermined amount of time, so that the first mark slowly disappears from the display device 1006. In another example, the removal of the first mark 1131 includes an animation (e.g., the first mark 1131 moves across the display device 1006 and disappears).

[0228] In some embodiments, the fourth step 1208 also includes overlaying a removal image on the mark before removing the mark from the display device 1006. The removal image is generally used to emphasize that the mark is being removed from the display device. For example, the removal image can be an "X", a lightning ball, a cloud, a fire / explosion, or any other image that conveys to the user that the mark is being removed. In one example, the first mark 1131 is an image of a monster, and the removal image is an image of a lightning ball, which allows the user to perceive that the monster has been "destroyed". More generally, the removal image can be any still image or video image.

[0229] The fourth step 1208 may also include determining that the movement of the head of the oral hygiene device 1002 corresponds to a predetermined brush stroke type (e.g., a circular brush stroke, a back-and-forth brush stroke, or an angled brush stroke as described herein). In such an embodiment, the indicia is removed after determining that: (1) the position of the head of the oral hygiene device 1002 corresponds to the segment of the schematic 1100 associated with the indicia within a predetermined amount of time, and (2) the movement of the head of the oral hygiene device 1002 corresponds to a predetermined brush stroke during at least a portion of the predetermined amount of time. More generally, any other triggering event or condition may be added to the fourth step 1208 before causing the indicia to be removed from the display device 1006.

[0230] The second step 1204, the third step 1206, and the fourth step 1208 may be repeated one or more times to further help promote compliance with the oral hygiene regimen. Fig. 11B ) is removed, the second step 1204 is repeated, and the second mark 1132 ( Fig. 11B ) is overlaid on the schematic diagram 1100. Then, the third step 1206 is repeated to determine the position of the oral hygiene device 1002 again, and once the above conditions are met, the second mark 1132 is removed in a fourth step 1208. In this way, multiple marks can be overlaid and removed during a given brushing session to promote compliance with an oral hygiene regimen. Marks can be overlaid on the schematic diagram 1100 during the process of steps 1204, 1206 and 1208 being repeated in a predetermined sequence or a random sequence. For example, a first predetermined sequence may include sequentially overlaying one or more marks on each segment of the schematic diagram 1100 to encourage the user to brush all corresponding segments of the user's teeth (for example, when steps 1204, 1206 and 1208 are repeated, the marks are moved along the schematic diagram 1100). Fig.11A In another example, the second predetermined sequence may include sequentially overlaying marks according to the user's brushing history, which may be stored in the storage device 1010 (e.g., overlaying marks on segments of the schematic 1100 that the user most often misses when brushing or segments where the user has cavities).

[0231] In some embodiments, the fourth step 1208 does not completely remove the marker from the display device 1006, but rather moves the marker from a first position on the schematic diagram 1100 to a second position on the schematic diagram 1100. For example, instead of removing the first marker 1131 from the schematic diagram 1100 after all conditions are met, the first marker 1131 can be moved to a second position on the schematic diagram (e.g., Fig. 11B The position of the second mark 1132 is shown).

[0232] The fifth step 1210 includes capturing an image of the user using a camera. As described above, the display device 1006 may include a camera, the sensor 1004 may include a camera, or the camera may be a separate component. The image of the user may include an augmented reality image overlaid on at least a portion of the image of the user. For example, the augmented reality image may be a hat, ear, eye, nose, clothing, sparkle, or other object or graphic superimposed on the image of the user. In addition, the image may include an associated custom message that the user may enter using a user input (e.g., a touch screen keyboard) of the display device 1006.

[0233] The sixth step 1212 includes transmitting the notification to a third party (e.g., a parent or dentist of the user) via the communication module 1012. The notification may include the image and / or augmented reality image of the user acquired during the fifth step 1210. The notification may also include information about the user's brushing session (e.g., how long the user has been brushing, whether the user has successfully removed all marks, etc.). The notification also helps promote compliance with the oral hygiene routine by allowing a third party to monitor the user's brushing habits. The notification may also be sent to a user's social media account (e.g., Facebook, Twitter, etc.) shared with a third party. Although the sixth step 1212 is shown as after the fifth step 1210, the sixth step 1212 may also be directly after completing the fourth step 1208 (i.e., sending the notification without capturing the user's image).

[0234] The seventh step 1214 includes displaying the selectable items on the display device 1006. Fig.13A , multiple selectable items 1300 are displayed on the display device 1006. Multiple selectable items 1300 are generally used as a user interface to allow the user to control or start various aspects of the associated application. For example, selecting one of the multiple selectable items 1300 can cause the above-mentioned camera to take a photo of the user (e.g., start the fifth step 1210).

[0235] Although the plurality of selectable items 1300 is shown as including two selectable items, any number of selectable items (e.g., one selectable item, five selectable items, fifteen selectable items, etc.) may be displayed on the display device 1006. Fig.13A 13. Although shown as rectangles in FIG. 13, the plurality of selectable items 1300 may generally be text, images, symbols, or a combination thereof.

[0236] In some embodiments, the number of multiple optional items 1300 can correspond to the number of marks removed from the display device 1006 when steps 1202 to 1208 are repeated during a brushing session. For example, if the user removes two marks from the display device 1006 during a brushing session, the multiple optional items 1300 include two optional items that the user can select. Similarly, the number of multiple optional items 1300 can increase as the user successfully removes marks during multiple brushing sessions. For example, a given optional item will only appear (or "unlock") after the user removes all marks during a predetermined number of consecutive brushing sessions (e.g., two sessions, four sessions, ten sessions, etc.). In this way, the number of multiple optional items 1300 can be used as a reward system to motivate or encourage users to follow a proper oral hygiene regimen.

[0237] like Fig.13A As shown, a plurality of selectable items 1300 are displayed on display device 1006 in coordinate system 1302. Each of the plurality of selectable items 1300 is associated with a location in coordinate system 1302. As shown, a first one of the plurality of selectable items 1300 has a location 1304 in coordinate system 1302.

[0238] Step 1216( Fig.12 ) includes receiving a selection of a selectable item displayed on the display device 1006. The user selects one or more of the plurality of selectable items 1300 by moving the oral hygiene device 1002 relative to the display device 1006 to a position corresponding to the position of the selectable item in the coordinate system 1302.

[0239] refer to Fig. 13B , the oral hygiene device 1002 is positioned in a three-dimensional volume 1320 that is substantially in front of the display device 1006 and / or the sensor 1004. As described above, the sensor 1004 and the display device 1006 can be included in a housing (e.g., a smartphone). Preferably, the sensor 1004 is a camera included with the display device 1006 as part of the smartphone, such that the three-dimensional volume 1320 is substantially in front of both the display device 1006 and the sensor 1004. In these embodiments, the three-dimensional volume 1320 corresponds to the field of view of the sensor 1004.

[0240] As shown, the three-dimensional volumetric space 1320 includes a coordinate system 1322. The coordinate system 1322 allows the system 1000 to determine the position of the head 1002a of the oral hygiene device 1002 in the three-dimensional volumetric space 1320 using the sensor 1004, the processor 1008, and the storage device 1010. The coordinate system 1322 of the three-dimensional volumetric space 1320 corresponds to the coordinate system 1302 of the display device 1006, which means that the coordinate system 1302 ( Fig.13A ) has an associated position in coordinate system 1322 ( Fig. 13B ).

[0241] To select multiple optional items 1300 ( Fig.13A ), the user moves the oral hygiene device 1002 within the three-dimensional volume 1320 until the position of the head 1002a is the coordinate system 1322 ( Fig. 13B ) corresponds to the position in coordinate system 1302 ( Fig.13A ) in the position of the selectable item in the coordinate system 1302. In addition, it is not required that the position of the head 1002a in the coordinate system 1322 exactly corresponds to the position of the selectable item in the coordinate system 1302, and the position of the head 1002a in the coordinate system 1322 can be determined by determining that the position of the head 1002a in the coordinate system 1322 is within a predetermined distance ( Fig.13A ), to receive a selection. In other words, the head 1002a does not need to be precisely positioned to select a selectable item. The predetermined distance may be, for example, one-quarter inch, one inch, two inches, four inches, six inches, or any other suitable distance. After the user moves the head 1002a of the oral hygiene device 1002 to the associated position, the system 1000 receives a selection of the selectable item, which triggers a corresponding function (e.g., causing the camera to take a photo of the user, causing an augmented reality image to be overlaid on the user's image, etc.).

[0242] Although the system 1000 and associated method 2000 have been shown and described herein as displaying the schematic diagram 1100, the timer 1102, and / or the plurality of selectable items 1300, it is expressly contemplated that other images may be displayed on the display device 1006. For example, in some embodiments, a representation of the oral hygiene device 1002 may be displayed on the display device 1002. The representation of the oral hygiene device may be animated so that its movement is substantially similar to the movement of the oral hygiene device 1002 (e.g., if the user is moving the oral hygiene device 1002 from one side to another, the representation also moves from one side to another). In addition, the representation of the oral hygiene device may be an image of the oral hygiene device (e.g., an image of a typical toothbrush or an image of the actual oral hygiene device 1002), or more generally any other image. For example, the representation of the oral hygiene device may be a sword, a baseball bat, a hockey stick, or any other object. Thus, the user may move the oral hygiene device 1002 to cause a corresponding movement of the representation of the oral hygiene device on the display device 1006.

[0243] Computer and Hardware Implementation of the Present Disclosure

[0244] First, it should be understood that the disclosure herein can be implemented with any type of hardware and / or software, and can be a pre-programmed general-purpose computing device. For example, a server, a personal computer, a portable computer, a thin client, or any suitable one or more devices can be used to implement the system. The present disclosure and / or its components can be a single device at a single location, or multiple devices at a single or multiple locations, and the multiple devices are connected together using any appropriate communication protocol through any communication medium (e.g., cable, fiber optic cable) or wirelessly.

[0245] It should also be noted that the present disclosure is illustrated and discussed herein as having multiple modules that perform specific functions. It should be understood that, for the sake of clarity only, these modules are schematically shown based on their functions only, and do not necessarily represent specific hardware or software. In this regard, these modules can be implemented as hardware and / or software that basically performs the specific functions discussed. In addition, modules can be combined together in the present disclosure, or divided into additional modules based on the specific functions required. Therefore, the present disclosure should not be interpreted as limiting the present invention, but is only understood as illustrating an exemplary embodiment thereof.

[0246] A computing system may include a client and a server. The client and the server are typically remote from each other and typically interact via a communication network. The relationship of the client and the server is generated by computer programs that run on respective computers and have a client-server relationship with each other. In some embodiments, the server transmits data (e.g., an HTML page) to a client device (e.g., for the purpose of displaying data to a user interacting with the client device and receiving user input from it). Data generated at the client device (e.g., a result of a user interaction) may be received at the server from the client device.

[0247] Embodiments of the subject matter described in this specification may be implemented in a computing system that includes a back-end component, e.g., as a data server; or a middleware component, e.g., an application server; or a front-end component, e.g., a client computer with a graphical user interface or web browser, through which a user can interact with embodiments of the subject matter described in this specification; or any combination of one or more of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include local area networks ("LANs") and wide area networks ("WANs"), interconnected networks (e.g., the Internet), and point-to-point networks (e.g., ad hoc point-to-point networks).

[0248] The embodiments of the subject matter and operations described in this specification may be implemented in digital electronic circuits or in computer software, firmware or hardware, including the structures disclosed in this specification and their structural equivalents, or a combination of one or more of them. The embodiments of the subject matter described in this specification may be implemented as one or more computer programs, that is, one or more modules in computer program instructions, which are encoded on a computer storage medium to be executed by a data processing device, or to control the operation of a data processing device. Alternatively or in addition, the program instructions may be encoded on an artificially generated propagation signal, such as a machine-generated electrical, optical or electromagnetic signal, which is generated to encode information for transmission to a suitable receiver device for execution by a data processing device. The computer storage medium may be a computer-readable storage device, a computer-readable storage substrate, a random or serial access memory array or device, or a combination of one or more of them, or included in the above-mentioned devices. In addition, although the computer storage medium is not a propagation signal, the computer storage medium may be a source or destination of computer program instructions encoded in an artificially generated propagation signal. The computer storage medium may also be, or be included in, one or more separate physical components or media (eg, multiple CDs, disks, or other storage devices).

[0249] The operations described in this specification may be implemented as operations performed by a "data processing apparatus" on data stored on one or more computer-readable storage devices or received from other sources.

[0250] The term "data processing equipment" encompasses all kinds of equipment, devices and machines for processing data, including, for example, a programmable processor, a computer, a system on a chip, or a plurality or combination of the foregoing. The equipment may include dedicated logic circuits, such as an FPGA (field programmable gate array) or an ASIC (application-specific integrated circuit). In addition to hardware, the equipment may also include code that creates an execution environment for the computer program in question, for example, code that constitutes processor firmware, a protocol stack, a database management system, an operating system, a cross-platform runtime environment, a virtual machine, or a combination of one or more of them. The equipment and execution environment may implement a variety of different computing model architectures, such as network services, distributed computing, and grid computing architectures.

[0251] A computer program (also referred to as a program, software, software application, script, or code) may be written in any form of programming language, including compiled or interpreted languages, declarative languages, or procedural languages, and it may be deployed in any form, including as a stand-alone program or as a module, component, subroutine, object, or other unit suitable for use in a computing environment. A computer program may, but need not, correspond to a file in a file system. A program may be stored in a portion of a file that holds other programs or data (e.g., one or more scripts stored in a markup language document), in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files that store portions of one or more modules, subroutines, or code). A computer program may be deployed to execute on one computer or on multiple computers, the computers being located at one site or distributed across multiple sites and interconnected by a communications network.

[0252] The processes and logic flows described in this specification can be performed by one or more programmable processors executing one or more computer programs to perform actions by operating on input data and generating output. The processes and logic flows can also be performed by special purpose logic circuits, and the device can also be implemented as a special purpose logic circuit, such as an FPGA (field programmable gate array) or an ASIC (application-specific integrated circuit).

[0253] Processors suitable for executing computer programs include, for example, general-purpose microprocessors and special-purpose microprocessors, and any one or more processors of any kind of digital computer. In general, the processor will receive instructions and data from a read-only memory or a random access memory or both. The basic elements of a computer are a processor for performing actions according to instructions and one or more storage devices for storing instructions and data. Typically, a computer will also include one or more mass storage devices (e.g., magnetic disks, magneto-optical disks, or optical disks) to store data, or be operably coupled to receive data from or transmit data to or both of the one or more mass storage devices. However, a computer does not necessarily have such a device. In addition, a computer may be embedded in another device, such as a mobile phone, a personal digital assistant (PDA), a mobile audio or video player, a game console, a global positioning system (GPS) receiver, or a portable storage device (e.g., a universal serial bus (USB) flash drive), to name just a few examples. Suitable devices for storing computer program instructions and data include all forms of non-volatile memory, media and storage devices including, by way of example: semiconductor memory devices such as EPROM, EEPROM and flash memory devices; magnetic disks, such as internal hard disks or removable disks; magneto-optical disks; and CD ROM and DVD-ROM disks. The processor and memory may be supplemented by, or incorporated in, special purpose logic circuits.

[0254] Those skilled in the art will appreciate that numerous changes may be made to the described embodiments without departing from the spirit and scope of the present invention. In addition, those skilled in the art will also recognize that certain embodiments described for one device or system may be easily or slightly modified to be included in the embodiments described for another device or system without departing from the spirit and scope of the present invention.

[0255] By way of example, the following selected embodiments are illustrative examples of the present disclosure.

[0256] Selected Examples

[0257] While the above description and appended claims disclose multiple embodiments, other alternative aspects of the invention are disclosed in the following additional embodiments.

[0258] Embodiment 1. A method for promoting compliance with an oral hygiene regimen, the method comprising: displaying a representation of at least a portion of a set of teeth of a user on a display device; overlaying a mark on the representation so that the mark is associated with a first segment of the representation; and removing the mark from the display device in response to at least one of the one or more processors determining that within at least a predetermined amount of time, the head of the oral hygiene device is positioned directly adjacent to a first segment of the set of teeth corresponding to the first segment of the representation.

[0259] Embodiment 2. The method according to any one of Embodiments 1 further includes transmitting a notification to a third party via a communication module in response to removing the mark.

[0260] Embodiment 3. The method according to any one of Embodiments 1 and 2 further includes capturing the image of the user using a camera and displaying the image of the user on the display device.

[0261] Example 4. The method according to any one of Examples 1-3 further includes displaying an optional item on the display device, wherein the optional item is located at a first position in a coordinate system, and the first position in the coordinate system is associated with a position in a volume space substantially in front of the display device; and receiving a selection of the optional item in response to determining by at least one of the one or more processors that the head of the oral hygiene device is within a predetermined distance of the position in the volume space associated with the first position in the coordinate system within a predetermined amount of time.

[0262] Embodiment 5. The method according to any one of Embodiment 4 further includes capturing the image of the user using a camera and displaying the image of the user on the display device; and after receiving a selection of the optional item, transmitting the image of the user to a third party through a communication module.

[0263] Embodiment 6. The method according to any one of Embodiment 4 further includes capturing the image of the user using a camera and displaying the image of the user on the display device; and after receiving a selection of the optional item, overlaying a graphic associated with the optional item on the image of the user on the display device.

[0264] Embodiment 7. The method according to any one of embodiments 1-6 further includes transmitting the user's image and the overlaid graphics to a third party via a communication module.

[0265] Embodiment 8. The method of any one of embodiments 1-7, wherein the determining further comprises determining that the movement of the head of the oral hygiene device corresponds to a predetermined brush stroke type.

[0266] Embodiment 9. The method according to any one of Embodiments 8, wherein the predetermined brush stroke type is a circular brush stroke, a back and forth brush stroke, an angled brush stroke, or any combination thereof.

[0267] Embodiment 10. A method according to any one of embodiments 1-9, wherein the first tooth segment represents a portion corresponding to a complete set of maxillary teeth or a complete set of mandibular teeth.

[0268] Embodiment 11. A method according to any one of embodiments 1-10, wherein the first segment of the representation corresponds to a segment of multiple segments of a complete set of maxillary teeth or a segment of multiple segments of a complete set of mandibular teeth.

[0269] Example 12. A method according to any one of Examples 1-11, wherein the first section of the set of teeth has an inner surface, an outer surface, and an occlusal surface, wherein the determining further includes determining that the head of the oral hygiene device is directly adjacent to one of the inner surface, the outer surface, or the occlusal surface of the set of teeth.

[0270] Embodiment 13. An oral hygiene system, the system comprising: an oral hygiene device, the oral hygiene device comprising a handle and a head; a sensor; a display device; one or more processors; and a storage device storing instructions, the instructions, when executed by at least one of the one or more processors, causing the oral hygiene system to: display a representation of at least a portion of a set of teeth of a user on the display device; overlay a mark on the representation so that the mark is associated with a first segment of the representation; and remove the mark from the display in response to at least one of the one or more processors determining that the head of the oral hygiene device is positioned directly adjacent to a first segment of the set of teeth corresponding to the first segment of the representation for at least a predetermined amount of time.

[0271] Embodiment 14. The system of any one of Embodiments 13, further comprising a communication module configured to transmit a notification to a third party in response to the removal of the indicia from the display device.

[0272] Embodiment 15. The system according to any one of Embodiments 13 and 14 further includes a camera configured to capture an image of a user, wherein the instructions, when executed by at least one of the one or more processors, cause the display device to display the image of the user.

[0273] Embodiment 16. The system according to any one of Embodiments 15 further comprises a communication module configured to transmit the image of the user to a third party.

[0274] Example 17. A system according to any one of Examples 13-16, wherein the instructions, when executed by at least one of the one or more processors, cause the oral hygiene system to display a selectable item on the display device, the selectable item being located at a first position in a coordinate system, the first position in the coordinate system being associated with a position in a volume space substantially in front of the display device; and receiving a selection of the selectable item in response to determining by the sensor that the head of the oral hygiene device is within a predetermined distance of the position in the volume space associated with the first position in the coordinate system within a predetermined amount of time.

[0275] Example 18. A system according to any of Example 17, wherein the instructions, when executed by at least one of the one or more processors, cause the oral hygiene system to overlay a graphic associated with the optional item on the image of the user on the display device in response to receiving a selection of the optional item.

[0276] Embodiment 19. The system of any one of Embodiments 18, further comprising a communication module configured to transmit the image of the user and the overlaid graphics to a third party.

[0277] Embodiment 20. The system of any of Embodiments 13-19, wherein the determining further comprises determining that the movement of the head of the oral hygiene device corresponds to a predetermined brush stroke type.

[0278] Embodiment 21. The system of any one of Embodiment 20, wherein the predetermined brush stroke type is a circular brush stroke, a back and forth brush stroke, an angled brush stroke, or any combination thereof.

[0279] Example 22. A system according to any of Examples 13-21, wherein the first segment of the representation corresponds to a complete set of maxillary teeth or a complete set of mandibular teeth.

[0280] Example 23. A system according to any of Examples 13-22, wherein the first segment of the representation corresponds to one segment of multiple segments of a complete set of maxillary teeth or one segment of multiple segments of a complete set of mandibular teeth.

[0281] Embodiment 24. A system according to any one of embodiments 13-23, wherein the sensor is an optical sensor, a motion sensor, a gyroscope, a magnetometer, an accelerometer, a camera, or any combination thereof.

[0282] in conclusion

[0283] The various methods and techniques described above provide a variety of ways to perform the present invention. Of course, it should be understood that according to any particular embodiment described herein, not all of the described objects or advantages may be achieved. Thus, for example, one skilled in the art will recognize that the method may be performed in a manner that achieves or optimizes one advantage or a group of advantages taught herein without having to achieve other objects or advantages taught or suggested herein. A variety of alternatives are mentioned herein. It should be understood that some embodiments specifically include one, another, or several features, while other embodiments specifically exclude one, another, or several features, while other embodiments mitigate specific features by including one, another, or several advantageous features.

[0284] In addition, the skilled person will recognize the applicability of various features from different embodiments. Similarly, the various elements, features and steps discussed above and other known equivalents of each such element, feature or step may be employed by a person of ordinary skill in the art in various combinations to perform methods according to the principles described herein. Among the various elements, features and steps, some will be specifically included and others will be specifically excluded in different embodiments.

[0285] Although the present application has been disclosed in the context of certain embodiments and examples, those skilled in the art will appreciate that the embodiments of the present application extend beyond the specifically disclosed embodiments to other alternative embodiments and / or uses and modifications and their equivalents.

[0286] In some embodiments, the terms "one", "an", "said" and similar narrations used in the context of describing a specific embodiment of the present application (especially in the context of certain claims in the following claims) can be interpreted as covering both the singular and the plural. The description of the range of values ​​herein is intended only to be used as a shorthand method for individually referring to each individual value falling within the range. Unless otherwise specified herein, each individual value is incorporated into this specification as if individually narrated herein. Unless otherwise specified herein or otherwise clearly contradicted with the context, all methods described herein can be performed in any suitable order. The use of any and all examples or exemplary language (e.g., "for example") provided herein with respect to certain embodiments is intended only to better illustrate the present application and does not limit the scope of the present application to which protection is otherwise claimed. The language in this specification should not be interpreted as indicating any unclaimed elements that are essential to the implementation of the present application.

[0287] Certain embodiments of the present application are described herein. After reading the above description, variations of those embodiments will become apparent to those of ordinary skill in the art. It is conceivable that the technician may adopt such variations as needed, and may practice the present application differently from the manner specifically described herein. Therefore, many embodiments of the present application include all modifications and equivalents of the subject matter recited in the appended claims as allowed by applicable law. In addition, unless otherwise specified herein or otherwise clearly contradicted with the context, the present application encompasses any combination of the above elements in all possible variations thereof.

[0288] Particular embodiments of the subject matter have been described. Other embodiments are within the scope of the following claims. In some cases, the actions recited in the claims can be performed in a different order and still achieve the desired results. Additionally, the processes depicted in the accompanying drawings do not necessarily require the particular order or sequential order shown to achieve the desired results.

[0289] All patents, patent applications, publications of patent applications, and other materials, such as articles, books, specifications, publications, documents, articles, etc., referred to herein are hereby incorporated by reference in their entirety for all purposes, except for any litigation document history related to any of the foregoing, any of the foregoing that is inconsistent or conflicting with this document, or any of the foregoing that may have a limiting effect on the broadest scope of the claims now or later associated with this document. For example, if there is any inconsistency or conflict between a term associated with any incorporated material and the description, definition, and / or use of the term associated with this document, the description, definition, and / or use of the term in this document shall control.

[0290] Finally, it should be understood that the embodiments of the present application disclosed herein are illustrations of the principles of the embodiments of the present application. Other modifications that can be adopted may be within the scope of the present application. Therefore, as an example and not a limitation, alternative configurations of the embodiments of the present application may be utilized according to the teachings herein. Therefore, the embodiments of the present application are not limited to those embodiments precisely shown and described.

Claims

1. A method for promoting compliance with an oral hygiene regimen, the method comprising: displaying, on a display device, a representation of at least a portion of a set of teeth of a user; overlaying a mark on the representation such that the mark is associated with a first section of the representation; as well as causing the indicia to be removed from the display device in response to determining, by at least one of the one or more processors, that a head of the oral hygiene device was positioned directly adjacent to a first segment of the set of teeth corresponding to a first segment of the representation for at least a period of time, Wherein causing the marking to be removed comprises overlaying a removal image on the marking prior to removing the marking from the display device and after positioning the head of the oral device adjacent to the first section of the set of teeth, the removal image being removed simultaneously with the removal of the marking. The method according to claim 1 , wherein the mark is a graphic symbol representing an object. The method of claim 1 , wherein the marking obscures the representation of the set of teeth.

4. The method according to claim 1, further comprising: displaying a selectable item on the display device, the selectable item being located at a first position in a coordinate system, the first position in the coordinate system being associated with a position in a volumetric space substantially in front of the display device; and receiving a selection of the selectable item in response to determining, by at least one of the one or more processors, that the head of the oral hygiene device is within a predetermined distance of a location in the volume space associated with a first location in the coordinate system within an amount of time.

5. The method according to claim 4, further comprising: capturing an image of the user using a camera and displaying the image of the user on the display device; and after receiving the selection of the selectable item, transmitting the image of the user to a third party via a communication module.

6. The method according to claim 4, further comprising: capturing an image of the user using a camera and displaying the image of the user on the display device; and after receiving a selection of the selectable item, overlaying a graphic associated with the selectable item on the image of the user on the display device, and transmitting the user's image and the overlaid graphic to a third party via a communication module.

7. The method of claim 1, wherein the indicia is an image of a monster, a frowning face, a fictional character, a storm cloud, money, a dot, a star, an animal, or a collectible.

8. The method of claim 1, wherein the mark is an image of an alien, a coin, a circle, a square, a triangle, or a check mark.

9. The method of claim 1, wherein the indicia is an image of a symbol.

10. The method of claim 1, wherein the determining further comprises determining that the movement of the head of the oral hygiene device corresponds to a predetermined brush stroke type selected from a plurality of predetermined brush stroke types.

11. The method of claim 10, wherein the plurality of predetermined brush stroke types is one of: a circular brush stroke, a back and forth brush stroke, an angled brush stroke, or any combination thereof.

12. The method of claim 1, wherein the first tooth segment representation corresponds to a complete set of maxillary teeth or a complete set of mandibular teeth.

13. The method of claim 1, wherein the first segment of the representation corresponds to one of a plurality of segments of a complete set of maxillary teeth or one of a plurality of segments of a complete set of mandibular teeth.

14. The method of claim 1, wherein the first section of the set of teeth has an inner surface, an outer surface, and an occlusal surface, wherein the determining further comprises determining that the head of the oral hygiene device is directly adjacent to one of the inner surface, the outer surface, or the occlusal surface of the set of teeth.

15. An oral hygiene system, the system comprising: An oral hygiene device, the oral hygiene device comprising a handle and a head; sensor; Display device; one or more processors; as well as a storage device storing instructions that, when executed by at least one of the one or more processors, cause the oral hygiene system to: displaying on the display device a representation of at least a portion of a set of teeth of a user; overlaying a mark on the representation such that the mark is associated with a first section of the representation; causing the indicia to be removed from the display in response to determining, by at least one of the one or more processors, that for at least a period of time, the head of the oral hygiene device was positioned directly adjacent to a first segment of the set of teeth corresponding to a first segment of the representation, Wherein causing the marking to be removed comprises overlaying a removal image on the marking prior to removing the marking from the display device and after positioning a head of an oral device adjacent to the first section of the set of teeth, the removal image being removed simultaneously with the removal of the marking.

16. The system of claim 15, further comprising a camera configured to capture an image of the user, wherein The instructions, when executed by at least one processor of the one or more processors, cause the display device to display an image of the user.

17. The system of claim 15, further comprising a communication module configured to transmit the image of the user to a third party.

18. A system according to claim 15, wherein the instructions, when executed by at least one of the one or more processors, cause the oral hygiene system to: display an optional item on the display device, the optional item being located at a first position in a coordinate system, the first position in the coordinate system being associated with a position in a volume space substantially in front of the display device; receive a selection of the optional item in response to determining by the sensor that the head of the oral hygiene device is within a predetermined distance of the position in the volume space associated with the first position in the coordinate system for a predetermined amount of time; and wherein the instructions, when executed by at least one of the one or more processors, cause the oral hygiene system to overlay a graphic associated with the optional item on the image of the user on the display device in response to receiving a selection of the optional item.

19. The system of claim 15, wherein the indicia is one of a still image, a video image, or an animated image.

20. The system of claim 15, wherein the marking obscures the representation of a portion of the set of teeth.

21. The system of claim 15, wherein the indicia is an image of a monster, a frowning face, a fictional character, a storm cloud, money, dots, stars, an animal, or a collectible.

22. The system of claim 15, wherein the indicia is an image of an alien, a coin, a circle, a square, a triangle, or a check mark.

23. The system of claim 15, wherein the indicia is an image of a symbol.