Toothbrush system, control method, and program

Abstract

This toothbrush system comprises: a toothbrush for care of the oral cavity; a light source that emits light having a predetermined wavelength with which plaque reacts; an imaging unit that acquires a plurality of images including the toothbrush (11a or 11b) in a state in which the light is emitted; a detection unit (103) that detects a brush region including the toothbrush in an evaluation image included in the plurality of images, and detects the presence or absence of plaque in the detected brush region on the basis of the evaluation image; and a notification unit (104) that transmits information relating to the presence or absence of plaque in the brush region.

Description

Toothbrush System, Control Method, and Program

[0001] The present disclosure relates to a toothbrush system, a control method, and a program.

[0002] As one of the oral care supports for users, there is a method in which a dental hygienist visually observes the user's toothbrush and gives recommendations on the replacement timing, as well as points out and guides on brushing habits. In order to perform oral care appropriately, not only the brushing method but also the management of the cleaning ability of the toothbrush due to dirt on the tips of the bristles of the toothbrush is necessary.

[0003] Patent Document 1 describes a smart toothbrush system that performs health measurement based on intraoral measurement and simultaneously realizes health care while keeping the original convenience and footprint of the toothbrush. In Patent Document 1, the toothbrush cleaning stand holds the toothbrush so that the tips of the bristles of the toothbrush face the bacterial sensor, measures the bacteria attached to the brush with the bacterial sensor, and then cleans the toothbrush.

[0004] Japanese Patent Application Laid-Open No. 2022-164210

[0005] In such a system, it is desired that the state of the toothbrush can be easily detected at a low cost. Therefore, a toothbrush system or a control method capable of easily detecting the state of the toothbrush is provided.

[0006] A toothbrush system according to an aspect of the present disclosure includes a toothbrush for caring for the oral cavity, a light source that emits light of a predetermined wavelength to which dental plaque reacts, an imaging unit that acquires a plurality of images including the toothbrush in a state where the light is emitted, a detection unit that detects a brush region including the toothbrush in an evaluation image included in the plurality of images and detects the presence or absence of dental plaque in the detected brush region based on the evaluation image, and a notification unit that notifies information regarding the presence or absence of dental plaque in the brush region.

[0007] The present disclosure can provide a toothbrush system or a control method capable of easily detecting the state of the toothbrush.

[0008] Figure 1 is an external view of the main body of the toothbrush system according to the embodiment. Figure 2 is an enlarged view of the head according to the embodiment. Figure 3 is an external view when the toothbrush part according to the embodiment is attached to the main body. Figure 4 is an external view when the toothbrush part according to the embodiment is attached to the main body. Figure 5 is an external view when the light-shielding member according to the embodiment is attached to the main body. Figure 6 is a schematic configuration diagram of the toothbrush system according to the embodiment. Figure 7 is a functional block diagram of the mobile terminal according to the embodiment. Figure 8 is a flowchart showing the operation flow of the mobile terminal according to the embodiment. Figure 9 is a diagram showing an example of an image according to the embodiment. Figure 10 is a diagram showing an example of an image according to the embodiment. Figure 11 is a diagram showing an example of a display image according to the embodiment. Figure 12 is an enlarged view of a display image according to the embodiment. Figure 13 is a diagram showing an example of a display image according to the embodiment.

[0009] A toothbrush system according to one aspect of the present disclosure includes a toothbrush for oral care, a light source that emits light of a predetermined wavelength to which plaque reacts, an imaging unit that acquires a plurality of images including the toothbrush when the light is emitted, a detection unit that detects a brush region including the toothbrush in an evaluation image included in the plurality of images and detects the presence or absence of plaque in the detected brush region based on the evaluation image, and a notification unit that notifies information regarding the presence or absence of plaque in the brush region.

[0010] According to this, the toothbrush system can detect the condition of the toothbrush based on images captured by the imaging unit. Therefore, the toothbrush system can easily and inexpensively detect the condition of the toothbrush. Furthermore, by using images for detection, the condition of the toothbrush can be monitored even while brushing teeth. This can improve the efficiency of oral care and reduce the burden on teeth or gums.

[0011] For example, the notification unit may, as a notification of the information, superimpose the area on the evaluation image in which plaque detected in the brush area exists. This allows the user to determine whether or not to clean the toothbrush based on the displayed information.

[0012] For example, the notification unit may determine whether the amount of plaque present in the brush area is above a predetermined standard, and if the amount of plaque present in the brush area is above the standard, it may notify the user that it is time to clean the toothbrush. This allows the user to determine whether or not they need to clean their toothbrush.

[0013] For example, the toothbrush system may further include a selection unit that selects from the plurality of images an image in which the movement of the toothbrush is below a predetermined threshold as the evaluation image. This would improve the accuracy of detecting the brush area and plaque in the toothbrush system.

[0014] For example, the notification unit may further notify the user to stop the toothbrush operation if none of the multiple images contain an image in which the toothbrush movement is below the threshold. This would allow the toothbrush system to improve the accuracy of detecting the brush area and plaque.

[0015] For example, the detection unit may generate an HSV or HSL image of the brush area of ​​the evaluation image and detect the presence or absence of plaque in the brush area based on the brightness value of the HSV image or the luminance value of the HSL image. In this way, the toothbrush system can appropriately detect plaque in the brush area.

[0016] Furthermore, a control method according to one aspect of the present disclosure is a control method for a toothbrush system, the toothbrush system comprising a toothbrush for oral care, a light source that emits light of a predetermined wavelength to which plaque reacts, and an imaging unit that acquires a plurality of images including the toothbrush when the light is emitted, the control method detects a brush region including the toothbrush in an evaluation image included in the plurality of images, detects the presence or absence of plaque in the detected brush region based on the evaluation image, and notifies information regarding the presence or absence of plaque in the brush region.

[0017] According to this, the control method can detect the state of the toothbrush based on images captured by the imaging unit. Therefore, the control method can easily and inexpensively detect the state of the toothbrush. Furthermore, by using images for detection, the state of the toothbrush can be monitored even while brushing teeth. This can improve the efficiency of oral care and reduce the burden on teeth or gums.

[0018] Furthermore, a program according to one aspect of this disclosure is a program that causes a computer to execute the control method.

[0019] These comprehensive or specific embodiments may be implemented as a system, method, integrated circuit, computer program, or recording medium such as a computer-readable CD-ROM, or as any combination of a system, method, integrated circuit, computer program, and recording medium.

[0020] The embodiments will be described in detail below, with reference to the drawings as appropriate. However, unnecessarily detailed explanations may be omitted. For example, detailed explanations of already well-known matters and redundant explanations of substantially identical configurations may be omitted. This is to avoid the following explanation becoming unnecessarily verbose and to facilitate understanding for those skilled in the art.

[0021] The inventors provide the accompanying drawings and the following description so that those skilled in the art may fully understand this disclosure, and they are not intended to limit the subject matter described in the claims.

[0022] (Embodiment) [1. Configuration] [1-1. Configuration of the main body] Figure 1 is an external view of the main body 10 in the toothbrush system according to this embodiment. As shown in Figure 1, the main body 10 has a toothbrush-shaped housing that can be handled with one hand, and the housing includes a head portion 10a (also called the tip portion) that is placed in the user's oral cavity when taking dental scans, a handle portion 10b that the user grasps, and a neck portion 10c that connects the head portion 10a and the handle portion 10b.

[0023] Figure 2 is an enlarged view of the head unit 10a shown in Figure 1. The head unit 10a comprises an imaging optical system 12 (also called the imaging unit) and a plurality of LEDs 26A to 26D.

[0024] For example, the imaging optical system 12 is incorporated into the head portion 10a and the neck portion 10c. For example, the imaging optical system 12 includes an image sensor and a lens arranged on its optical axis.

[0025] The image sensor is an imaging device such as a CMOS (Complementary Metal-Oxide-Semiconductor) sensor or a CCD (Charge Coupled Device) element.

[0026] The imaging optical system 12 may also include a blue light cut filter that cuts out the blue wavelength light component contained in the light incident on the image sensor.

[0027] The multiple LEDs 26A to 26D are illumination devices (light sources) that irradiate light onto the tooth being photographed during imaging. The multiple LEDs 26A to 26D are, for example, blue LEDs (Light Emitting Diodes) that emit blue light with a peak wavelength of 405 nm. As shown in Figure 2, in this embodiment, the multiple LEDs 26A to 26D are arranged to surround the entrance of the imaging optical system 12. At least some of the multiple LEDs 26A to 26D may be white LEDs. In addition, any light source may be used instead of LEDs.

[0028] [1-2. Attachments] The toothbrush system according to this embodiment has one or more attachments that can be attached to or removed from the main body 10. The toothbrush system also has an oral camera mode for taking pictures of the condition inside the oral cavity and a toothbrush mode for displaying the condition inside the oral cavity while brushing teeth.

[0029] In toothbrush mode, the toothbrush part 11a, which is one of the attachments, is attached to the main body 10. Figure 3 is an external view when the toothbrush part 11a is attached to the main body 10. As shown in Figure 3, the toothbrush part 11a is attached to the head part 10a of the main body 10.

[0030] Although Figure 3 shows an example of a toothbrush section 11a having a circular brush, toothbrush sections of other shapes may be used. Figure 4 is an external view when the toothbrush section 11b is attached to the main body section 10. As shown in Figure 4, a toothbrush section 11b having a deck brush-shaped brush may be used.

[0031] In addition, either the toothbrush part 11a or the toothbrush part 11b may be used, or both the toothbrush part 11a and the toothbrush part 11b may be included in multiple attachments of the toothbrush system.

[0032] Furthermore, in oral camera mode, a light-shielding member may be attached to the head portion 10a to reduce the influence of ambient light. Figure 5 is an external view when the light-shielding member 11c is attached to the main body portion 10. As shown in Figure 5, by attaching the light-shielding member 11c, which is one of the attachments, to the head portion 10a, the influence of ambient light can be reduced. This improves the quality of the captured image, thereby improving the accuracy of processing using the image. Note that in oral camera mode, neither attachment is required to be attached to the main body portion 10.

[0033] In any of the attachments shown in Figures 3 to 5, the imaging optical system 12 and the multiple LEDs 26A to 26D are exposed, allowing for light irradiation and imaging of the oral cavity care area (e.g., teeth). Alternatively, the imaging optical system 12 and the multiple LEDs 26A to 26D may be covered with a light-transmitting material instead of being exposed.

[0034] Note that the attachment shapes shown in Figures 3 to 5 are just examples, and attachments of any shape may be used.

[0035] [1-3. Overall Functional Configuration] Figure 6 is a schematic diagram of the toothbrush system according to this embodiment. As shown in Figure 6, the toothbrush system according to this embodiment is generally configured to use the main body 10 to photograph the teeth and to perform image processing on the captured image.

[0036] As shown in Figure 6, the toothbrush system includes a main unit 10, a mobile terminal 70, and a cloud server 80. The mobile terminal 70 is, for example, a wirelessly wireless smartphone or tablet. The mobile terminal 70 includes, for example, a touchscreen 72 capable of displaying dental images as an input and output device. The mobile terminal 70 functions as the user interface for the toothbrush system.

[0037] The cloud server 80 is a server that can communicate with the mobile terminal 70 via the internet or the like, and provides the mobile terminal 70 with an application for using the main unit 10. For example, the user downloads the application from the cloud server 80 and installs it on the mobile terminal 70. The cloud server 80 also acquires dental images captured by the main unit 10 via the mobile terminal 70.

[0038] The main unit 10 includes a central control unit 50, which is the main part that controls the system, a plurality of LEDs 26A to 26D, an LED control unit 54, an actuator 36, an actuator 40, a lens driver 56, and a position sensor 90.

[0039] Furthermore, the main unit 10 includes a wireless communication module 58 that communicates wirelessly with the mobile terminal 70, and a power supply control unit 60 that supplies power to the central control unit 50 and the like.

[0040] The central control unit 50 of the main unit 10 is mounted, for example, on the handle portion 10b of the main unit 10. For example, the central control unit 50 also includes a controller 62 such as a CPU (Central Processing Unit) or MPU (Micro Processing Unit) that executes various processes described later, and a memory 64 such as a RAM (Random Access Memory) or ROM (Read Only Memory) that stores programs for causing the controller 62 to execute various processes. In addition to programs, the memory 64 also stores dental images (image data) captured by the image sensor 14 and various setting data.

[0041] The controller 62 transmits the dentition image output from the imaging device 14 to the mobile terminal 70 via the wireless communication module 58. The mobile terminal 70 displays the transmitted dentition image on the touch screen 72, thereby presenting the dentition image to the user.

[0042] The LED control unit 54 is mounted, for example, on the handle portion 10b of the main body portion 10, and executes lighting and extinguishing of the plurality of LEDs 26A to 26D based on a control signal from the controller 62. The LED control unit 54 is constituted by, for example, a circuit.

[0043] The actuator 36 is mounted, for example, on the head portion 10a or the neck portion 10c of the main body portion 10, and adjusts the composition of the imaging optical system 12. Specifically, the actuator 36 moves the housing holding the imaging device 14 and the like in the extending direction of the optical axis in order to adjust the angle of view.

[0044] The actuator 40 is mounted, for example, on the head portion 10a or the neck portion 10c of the main body portion 10, and adjusts the focus of the imaging optical system 12. Specifically, the actuator 40 moves the lens in the extending direction of the optical axis in order to adjust the focus.

[0045] The lens driver 56 is mounted, for example, on the handle portion 10b of the main body portion 10, and controls the actuator 36 and the actuator 40 based on a control signal from the controller 62 of the central control unit 50. The lens driver 56 is constituted by, for example, a circuit.

[0046] The wireless communication module 58 is mounted, for example, on the handle portion 10b of the main body portion 10, and performs wireless communication with the mobile terminal 70 based on a control signal from the controller 62. The wireless communication module 58 executes wireless communication compliant with an existing communication standard such as WiFi (registered trademark) or Bluetooth (registered trademark) with the mobile terminal 70. The dentition image is transmitted from the main body portion 10 to the mobile terminal 70 via the wireless communication module 58. Also, an operation signal is transmitted from the mobile terminal 70 to the main body portion 10 via the wireless communication module 58.

[0047] In the case of this embodiment, the power control unit 60 is mounted on the handle portion 10b of the main body portion 10, and distributes the power of the battery 66 to the central control unit 50, the LED control unit 54, the lens driver 56, and the wireless communication module 58. The power control unit 60 is constituted by, for example, a circuit. In the case of this embodiment, the battery 66 is a rechargeable secondary battery, and is wirelessly charged by an external charger 69 connected to a commercial power supply via a coil 68 mounted on the main body portion 10.

[0048] The position sensor 90 is a sensor for detecting the posture and position of the main body portion 10, and is, for example, a multi-axis (here, three axes of x, y, and z) acceleration sensor. For example, the position sensor 90 may be a six-axis sensor having a three-axis acceleration sensor and a three-axis gyro sensor.

[0049] [1-4. Functional Configuration of Portable Terminal] FIG. 7 is a functional block diagram of the portable terminal 70. The portable terminal 70 includes an acquisition unit 101, a selection unit 102, a detection unit 103, and a notification unit 104.

[0050] The acquisition unit 101 acquires a plurality of images (image data) transmitted from the main body portion 10. The selection unit 102 selects an evaluation image to be used for the detection process of dental plaque from the plurality of acquired images.

[0051] The detection unit 103 detects the brush area included in the evaluation image, and detects the presence or absence or amount of dental plaque in the brush area. The notification unit 104 notifies (for example, displays) the user of the detection result of the presence or absence or amount of dental plaque.

[0052] The functions of the acquisition unit 101, the selection unit 102, the detection unit 103, and the notification unit 104 are realized, for example, when a processor such as a CPU included in the portable terminal 70 executes a program stored in a memory included in the portable terminal 70. Note that at least a part of the acquisition unit 101, the selection unit 102, the detection unit 103, and the notification unit 104 may be constituted by a circuit.

[0053] Also, at least a part of the function of the notification unit 104 may be realized by a display unit (display device), a speaker, or a vibrator included in the portable terminal 70.

[0054] [2. Operation] The operation of the toothbrush system will be described below. Figure 8 is a flowchart showing the flow of operations of the portable terminal 70 in the toothbrush system. The processes shown in Figure 8 are repeated, for example, at predetermined time intervals. The processes shown in Figure 8 may also be triggered by user operation or other conditions.

[0055] First, the acquisition unit 101 acquires a plurality of images transmitted from the main unit 10 (S101). These plurality of images are obtained, for example, by a user taking pictures of their teeth and gums in their oral cavity while performing a toothbrushing action using the main unit 10. These plurality of images are also obtained by the main unit 10 irradiating the teeth with light including the wavelength range of blue light and taking pictures of the teeth and toothbrush unit 11a or 11b that are showing a fluorescence reaction. Here, blue light is an example of irradiation light of a predetermined wavelength that excites fluorescent substances contained in dental plaque. The fluorescent substance is, for example, porphyrin.

[0056] Here, the multiple images may be a video or multiple still images. Image data may be transmitted for each frame of the video or for each still image, or for every multiple frames. In addition, the acquisition unit 101 may acquire sensor data from the main unit 10 in addition to image data.

[0057] [2-1. Selection process of evaluation images] Next, the selection unit 102 selects an evaluation image to be used for plaque detection processing from the multiple acquired images (S102). For example, the selection unit 102 detects the brush region including the brush portion of the toothbrush part 11a or 11b from among the multiple images and detects the movement of the brush region. The selection unit 102 selects the image in which the movement of the brush region is less than a predetermined threshold from among the multiple images as the evaluation image. As a result, plaque can be detected using an image with little movement, thereby improving the accuracy of plaque detection.

[0058] Figure 9 shows an example of image 201A when the toothbrush part 11a is attached to the main body part 10. As shown in Figure 9, the brush portion of the toothbrush part 11a is included in the image.

[0059] Figure 10 shows an example of image 201B when the toothbrush part 11b is attached to the main body part 10. As shown in Figure 10, the brush portion of the toothbrush part 11b is included in the image.

[0060] Note that in Figures 9 and 10, the images include the care area (teeth, etc.) in addition to the toothbrush part 11a or 11b, but the care area does not need to be included.

[0061] The selection unit 102 detects the brush area using, for example, known image analysis or image recognition techniques. For example, the shape of the toothbrush part 11a or 11b and the positional relationship between the toothbrush part 11a or 11b and the imaging unit are known. Therefore, it is known where in the image the brush portion of the toothbrush part 11a or 11b will appear. The shape and color of the appearing brush portion are also known. Therefore, the selection unit 102 can detect, for example, a brush area that is included in a predetermined area in the image, has a predetermined shape, and has a predetermined color. It is not necessary to use all of the area's position, shape, and color; at least one may be used. Also, it is not necessary to use all color components (for example, the R, G, and B components in an RGB image, or the H, S, and V components in an HSV image, etc.) to determine the color area; at least one color component may be used.

[0062] Furthermore, the selection unit 102 may use the change (difference) in pixel values ​​within the brush region between images as the movement of the brush region. Alternatively, the selection unit 102 may use the change in the position or size of the detected brush region between images.

[0063] Note that the selection unit 102 may detect the movement of the entire image instead of the movement of the brush area. In this case, the movement of the brush area can still be detected indirectly. In this case, detection of the brush area at this timing is not required.

[0064] Furthermore, if none of the multiple images contain any image where the brush area movement is less than a predetermined threshold (No in S103), and this condition continues for a predetermined time (Yes in S104), the notification unit 104 notifies the user to stop the toothbrush operation (S105). For example, the notification unit 104 displays a message instructing the user to stop the toothbrush operation on the display of the mobile terminal 70. This prevents a situation from continuing for a long period of time without plaque detection. Instead of a message, an icon or the like may be used, or notification may be given by sound or vibration.

[0065] On the other hand, if none of the images contain a brush movement less than a predetermined threshold (No in S103), and this state does not continue for a predetermined time (No in S104), then new images are acquired (S101), and the processing from step S102 onwards is performed on the newly acquired images.

[0066] [2-2. Plaque Detection Process] If an evaluation image is selected (Yes in S103), the detection unit 103 detects the brush region including the brush portion of the toothbrush part 11a or 11b in the evaluation image (S106). For example, the detection unit 103 detects the brush region in the evaluation image using the same method as the brush region detection process by the selection unit 102 described above. If the selection unit 102 has detected a brush region, the detection unit 103 may use that result. Alternatively, the selection unit 102 may perform a simplified (low-accuracy) detection of the brush region, and the detection unit 103 may perform a more detailed (high-accuracy) detection of the brush region again.

[0067] Next, the detection unit 103 detects plaque in the brush area using the evaluation image (S107). For example, the evaluation image is an RGB image.

[0068] The detection unit 103 may perform image processing as a preprocessing step for the plaque detection process or the brush area detection process described above. This image processing may include, for example, white balance adjustment processing.

[0069] For example, the detection unit 103 generates an HSV image by converting the color space of the evaluation image (RGB image) to the HSV space. Next, the detection unit 103 detects a region in the HSV image where at least one of the multiple pixels included in the brush region satisfies the following conditions: saturation is within a first predetermined range (e.g., 30 to 80 in 8-bit representation), hue is within a second predetermined range (e.g., 140 to 170 in 8-bit representation), and brightness is within a third predetermined range (e.g., 100 to 180 in 8-bit representation). This region is identified as a plaque region where plaque exists. Note that the first, second, and third predetermined ranges are not limited to the numerical ranges described above, as long as they can distinguish between the actual plaque region and other regions.

[0070] The detection unit 103 may use an HSL image instead of an HSV image. In this case, the detection unit 103 generates an HSL image by converting the color space of the evaluation image (RGB image) to the HSL space. The detection unit 103 then detects as a plaque area an area in which at least one of the multiple pixels included in the brush area of ​​the HSL image is located, satisfying at least one of the following conditions: saturation within a fourth predetermined range, hue within a fifth predetermined range, and luminance within a sixth predetermined range.

[0071] Furthermore, the notification unit 104 displays plaque in the brush area (S108). Specifically, the detection unit 103 generates a display image indicating the detected plaque area. The notification unit 104 displays the generated display image on the display unit of the mobile terminal 70 (S108).

[0072] Figure 11 shows an example of a display image 202A when the toothbrush part 11a is attached to the main body part 10. Figure 12 is an enlarged view of the region 204 shown in Figure 11. As shown in Figures 11 and 12, the display image 202A is an image in which the plaque region 203 detected in the brush region is superimposed on the evaluation image.

[0073] Figure 13 shows an example of a display image 202B when the toothbrush part 11b is attached to the main body part 10. Similarly in this case, the display image 202B is an image in which the plaque area 203 detected in the brush area is superimposed on the evaluation image.

[0074] Here, we show an example where information indicating the presence or absence of plaque (binary) is detected as the plaque region 203, but the amount of plaque (multi-level) may also be detected. For example, the accumulation level (concentration or density) of the fluorescent substance can be detected by comparing the intensity of red fluorescence per unit area of ​​the plaque region 203. For example, the detection unit 103 may detect the accumulation level based on the brightness V value of the HSV image of the plaque region 203. Alternatively, the detection unit 103 may detect the accumulation level based on the luminance L value of the HSL image. Furthermore, in the displayed image, for example, grayscale display is performed according to the accumulation level.

[0075] In this example, plaque detection and display of plaque areas are performed only on the brush area. However, similar plaque detection and display of plaque areas may also be performed on the tooth area, which includes the teeth, in addition to the brush area. Alternatively, similar plaque detection and display of plaque areas may be performed on all areas of the evaluation image.

[0076] Next, the detection unit 103 determines whether the amount of plaque in the brush area is above a predetermined standard (S109). For example, the detection unit 103 determines that the amount of plaque in the brush area is above a predetermined standard if the number of pixels determined to be plaque areas is above a predetermined threshold. Alternatively, the detection unit 103 determines that the amount of plaque in the brush area is above a predetermined standard if the ratio of the number of pixels determined to be plaque areas to the total number of pixels in the brush area is above a predetermined threshold.

[0077] If the amount of plaque in the brush area exceeds a predetermined standard (Yes in S109), the notification unit 104 notifies the user that it is time to clean the toothbrush (S110). For example, the notification unit 104 displays a message prompting the user to clean the toothbrush on the display of the mobile terminal 70. Instead of a message, an icon or the like may be used, or notification may be given by voice or vibration.

[0078] On the other hand, if the amount of plaque in the brush area is below a predetermined standard (No in S109), the process is terminated.

[0079] Furthermore, the depth of field of the camera may be set so that the area including the tip of the brush, not just the teeth, is in focus. For example, using the mating surface of the teeth as a reference, a front depth of field of about 8 mm and a rear depth of field of 20 mm may be ensured. This allows for clear, blur-free imaging of the toothbrush bristles.

[0080] Furthermore, it is not necessary to perform all the processes shown in Figure 8; only some of them may be performed. For example, in Figure 8, both the display of plaque in the brush area (S108) and notification of the timing for cleaning the toothbrush (S110) are performed, but only one of them may be performed. Also, notifications to stop the toothbrush operation (S104 and S105) do not need to be given. In addition, in the selection of the evaluation image (S102), the evaluation image may be selected according to factors other than motion.

[0081] [3. Summary] As described above, the toothbrush system according to this embodiment comprises a toothbrush for oral care (for example, a toothbrush part 11a or 11b), a light source that emits light of a predetermined wavelength that plaque reacts to (for example, a plurality of LEDs 26A to 26D), an imaging unit (for example, an imaging optical system 12 or an image sensor 14) that acquires a plurality of images including the toothbrush when light is emitted, a detection unit 103 that detects the brush region including the toothbrush in the evaluation image included in the plurality of images and detects the presence or absence of plaque in the detected brush region based on the evaluation image, and a notification unit 104 that notifies information regarding the presence or absence of plaque in the brush region.

[0082] According to this, the toothbrush system can detect the condition of the toothbrush based on images captured by the imaging unit. Therefore, the toothbrush system can easily and inexpensively detect the condition of the toothbrush. Furthermore, by using images for detection, the condition of the toothbrush can be monitored even while brushing teeth. This can improve the efficiency of oral care and reduce the burden on teeth or gums.

[0083] For example, as shown in Figures 11 to 13, the notification unit 104 displays the areas where plaque is detected in the brush area superimposed on the evaluation image as a notification of information. This allows the user to determine whether or not to clean the toothbrush based on the displayed information.

[0084] For example, the notification unit 104 determines whether the amount of plaque present in the brush area is above a predetermined standard (for example, step S109 in Figure 8), and if the amount of plaque present in the brush area is above the standard, it notifies the user that it is time to clean the toothbrush (for example, step S110 in Figure 8). This allows the user to determine whether or not they need to clean their toothbrush.

[0085] For example, the toothbrush system further includes a selection unit 102 that selects an image from among multiple images in which the toothbrush movement is below a predetermined threshold as an evaluation image (for example, step S102 in Figure 8). This toothbrush system can improve the accuracy of detecting the brush area and plaque.

[0086] For example, if the notification unit 104 does not contain any images in which the toothbrush movement is below a threshold (for example, No in step S103 of Figure 8), it notifies the user to stop the toothbrush operation (for example, in step S105 of Figure 8). This toothbrush system can improve the accuracy of detecting the brush area and plaque.

[0087] For example, the detection unit 103 generates an HSV or HSL image of the brush area of ​​the evaluation image and detects the presence or absence of plaque in the brush area based on the brightness value of the HSV image or the luminance value of the HSL image. In this way, the toothbrush system can appropriately detect plaque in the brush area.

[0088] The toothbrush system according to the embodiments of this disclosure has been described above, but this disclosure is not limited to these embodiments.

[0089] For example, the above description mainly described the processing performed on the mobile terminal 70. At least some of these processes may be performed on the main unit 10 or the cloud server 80.

[0090] Furthermore, each processing unit included in the toothbrush system according to the above embodiment is typically implemented as an LSI, which is an integrated circuit. These may be individually integrated into a single chip, or some or all of them may be integrated into a single chip.

[0091] Furthermore, integrated circuit implementation is not limited to LSIs; it may also be achieved using dedicated circuits or general-purpose processors. Alternatively, an FPGA (Field Programmable Gate Array), which can be programmed after LSI manufacturing, or a reconfigurable processor capable of reconfiguring the connections and settings of circuit cells within the LSI, may be used.

[0092] Furthermore, in each of the above embodiments, each component may be implemented by being composed of dedicated hardware or by executing a software program suitable for each component. Each component may also be implemented by a program execution unit such as a CPU or processor reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory.

[0093] Furthermore, this disclosure may be implemented as a control method or the like performed by a toothbrush system. Alternatively, this disclosure may be implemented as a main unit, a portable terminal, or a cloud server included in a toothbrush system.

[0094] Furthermore, the division of functional blocks in the block diagram is just one example; multiple functional blocks can be implemented as a single functional block, a single functional block can be divided into multiple parts, or some functions can be moved to other functional blocks. In addition, the functions of multiple functional blocks with similar functions can be processed in parallel or time-sharing by a single piece of hardware or software.

[0095] Furthermore, the order in which each step in the flowchart is performed is illustrative for the purpose of specifically illustrating this disclosure, and may be in a different order. Also, some of the above steps may be performed simultaneously (in parallel) with other steps.

[0096] Although a toothbrush system, etc., relating to one or more embodiments has been described above based on embodiments, this disclosure is not limited to these embodiments. Without departing from the spirit of this disclosure, various modifications that a person skilled in the art could conceive of may be applied to these embodiments, and forms constructed by combining components from different embodiments may also be included within the scope of one or more embodiments.

[0097] This disclosure is applicable to toothbrush systems.

[0098] 10 Main body 10a Head 10b Handle 10c Neck 11a, 11b Toothbrush 11c Light-shielding member 12 Imaging optical system 14 Image sensor 26A, 26B, 26C, 26D LED 36, 40 Actuator 50 Central control unit 54 LED control unit 56 Lens driver 58 Wireless communication module 60 Power control unit 62 Controller 64 Memory 66 Battery 68 Coil 69 Charger 70 Mobile terminal 72 Touchscreen 80 Cloud server 90 Position sensor 101 Acquisition unit 102 Selection unit 103 Detection unit 104 Notification unit 201A, 201B Image 202A, 202B Display image 203 Plaque area 204 Area

Claims

1. A toothbrush system comprising: a toothbrush for oral care; a light source that emits light of a predetermined wavelength that reacts to plaque; an imaging unit that acquires multiple images including the toothbrush when the light is emitted; a detection unit that detects a brush region including the toothbrush in an evaluation image included in the multiple images and detects the presence or absence of plaque in the detected brush region based on the evaluation image; and a notification unit that notifies information regarding the presence or absence of plaque in the brush region.

2. The toothbrush system according to claim 1, wherein the notification unit, as notification of the information, superimposes on the evaluation image the region in which plaque detected in the brush region exists.

3. The toothbrush system according to claim 1, wherein the notification unit determines whether the amount of plaque present in the brush area is above a predetermined standard, and if the amount of plaque present in the brush area is above the standard, it notifies the user that it is time to clean the toothbrush as a notification of the information.

4. The toothbrush system according to claim 1, further comprising a selection unit that selects from the plurality of images an image in which the movement of the toothbrush is less than a predetermined threshold as the evaluation image.

5. The toothbrush system according to claim 4, wherein the notification unit further notifies the user to stop the toothbrush operation if the plurality of images do not include any image in which the movement of the toothbrush is less than the threshold.

6. The toothbrush system according to any one of claims 1 to 5, wherein the detection unit generates an HSV image or an HSL image of the brush region of the evaluation image, and detects the presence or absence of plaque in the brush region based on the brightness value of the HSV image or the luminance value of the HSL image.

7. A control method for a toothbrush system, wherein the toothbrush system comprises a toothbrush for oral care, a light source that emits light of a predetermined wavelength to which plaque reacts, and an imaging unit that acquires a plurality of images including the toothbrush when the light is emitted, the control method detects a brush region including the toothbrush in an evaluation image included in the plurality of images, detects the presence or absence of plaque in the detected brush region based on the evaluation image, and notifies information regarding the presence or absence of plaque in the brush region.

8. A program that causes a computer to execute the control method described in claim 7.

Images