Oral care system, control method, and program

Abstract

This oral care system comprises: a main body part (10); a toothbrush part (11a) configured to be capable of changing between a first state in which the toothbrush part (11a) is coupled to the main body part (10) and a second state in which the toothbrush part (11a) is separated from the main body part (10); a determination unit (102) that determines, from an image, whether the toothbrush part (11a) is in the first state or the second state; a UI generation unit (103) that generates a UI screen for receiving inputs of a plurality of items; and a display unit (104) that displays the UI screen. The UI generation unit (103) stores a plurality of GUI components for receiving input of a plurality of items, and a plurality of pieces of item-related information, which is information relating to the plurality of items. The UI generation unit (103) determines, in accordance with the result of the determination by the determination unit, a GUI component or item-related information to be placed on the UI screen from the plurality of GUI components and the plurality of pieces of item-related information.

Description

Oral care system, control method, and program 【0001】 The present disclosure relates to an oral care system, a control method, and a program. 【0002】 An oral care system that can attach a plurality of attachments such as a toothbrush to a main body is known. For example, Patent Document 1 describes an oral camera having a dental plaque detection function using fluorescence measurement. In the technique described in Patent Document 1, an identification member is provided at a position on the end face of the replacement brush that overlaps the input / output port of the fluorescence detection module when the replacement brush is attached, and it is identified which of the replacement brush and the replacement probe is attached to the main body. 【0003】 Japanese Patent Application Laid-Open No. 2020-48965 【0004】 However, an additional function is required to identify attachments such as a toothbrushing part, leading to an increase in the size or cost of the oral care system. 【0005】 Therefore, an oral care system or a control method that can easily detect the attached / detached state of the toothbrushing part is provided. 【0006】An oral care system according to one aspect of the present disclosure is an oral care system comprising a main body, the main body comprising a light source provided at one end of the main body, which emits light of a predetermined wavelength that reacts to plaque toward a care area, and an imaging unit that captures an image of the care area, including reflected light and fluorescence from the care area, the oral care system further comprising a toothbrush unit configured to switch between a first state coupled to the tip and a second state separated from the main body, a determination unit that determines from the image whether the toothbrush unit is in the first state or the second state, a UI generation unit that generates a UI (User Interface) screen that accepts input of multiple items, and a display unit that displays the UI screen, the UI generation unit comprising a plurality of GUIs (Graphical User Interfaces) for accepting input of the plurality of items The system stores an Interface component and a plurality of item-related information which is information relating to the plurality of items. Depending on the result of the determination by the determination unit, it determines which GUI component or item-related information to place on the UI screen from the plurality of GUI components and the plurality of item-related information. 【0007】 This disclosure provides an oral care system or control method that can easily detect the attachment / detachment status of the toothbrush head. 【0008】Figure 1 is an external view of the main body of the oral care system according to the embodiment. Figure 2 is an enlarged view of the head part according to the embodiment. Figure 3 is an external view when the toothbrush part according to the embodiment is attached to the main body. Figure 4 is an external view when the toothbrush part according to the embodiment is attached to the main body. Figure 5 is an external view when the light-shielding member according to the embodiment is attached to the main body. Figure 6 is a schematic configuration diagram of the oral care system according to the embodiment. Figure 7 is a functional block diagram of the mobile terminal according to the embodiment. Figure 8 is a flowchart showing the operation flow of the mobile terminal according to the embodiment. Figure 9 is a diagram showing an example of image data when no attachment is attached to the main body according to the embodiment. Figure 10 is a diagram showing an example of image data when the toothbrush part is attached to the main body according to the embodiment. Figure 11 is a diagram showing an example of image data when the toothbrush part is attached to the main body according to the embodiment. Figure 12 is a diagram showing an example of image data when the light-shielding member is attached to the main body according to the embodiment. Figure 13 is a diagram showing an example of a UI image in toothbrush mode according to the embodiment. Figure 14 is a diagram showing an example of a UI image in oral camera mode according to the embodiment. Figure 15 shows an example of the setting menu in toothbrush mode according to the embodiment. Figure 16 shows an example of the setting menu in oral camera mode according to the embodiment. 【0009】 In oral care systems that use attachments, the processing of images acquired by the imaging unit, or the analysis data, differs depending on the presence or type of attachment attached to the main unit. Therefore, it is necessary to identify the presence or type of attachment attached to the main unit. 【0010】An oral care system according to one aspect of the present disclosure is an oral care system comprising a main body, the main body comprising a light source provided at one end of the main body, which emits light of a predetermined wavelength that reacts to plaque toward a care area, and an imaging unit that captures an image of the care area, including reflected light and fluorescence from the care area, the oral care system further comprising a toothbrush unit configured to switch between a first state coupled to the tip and a second state separated from the main body, a determination unit that determines from the image whether the toothbrush unit is in the first state or the second state, a UI generation unit that generates a UI (User Interface) screen that accepts input of multiple items, and a display unit that displays the UI screen, the UI generation unit comprising a plurality of GUIs (Graphical User Interfaces) for accepting input of the plurality of items The system stores an Interface component and a plurality of item-related information which is information relating to the plurality of items. Depending on the result of the determination by the determination unit, it determines which GUI component or item-related information to place on the UI screen from the plurality of GUI components and the plurality of item-related information. 【0011】 According to this, the oral care system can determine whether or not the toothbrush is attached to the main body based on the image captured by the imaging unit. Therefore, the attachment / detachment status of the toothbrush can be easily detected. Furthermore, it may be possible to miniaturize and lighten the main body, as well as reduce manufacturing costs. In addition, the oral care system can appropriately generate UI images according to the attachment / detachment status of the toothbrush. 【0012】 For example, the determination unit may determine that the first state exists if the image includes at least a portion of the toothbrush portion. 【0013】 According to this, the oral care system can easily detect the state in which the toothbrush part is attached to the main body based on the image captured by the imaging unit. 【0014】 For example, the determination unit may determine that the second state exists if at least a portion of the toothbrush portion is not included in the image. 【0015】According to this, the oral care system can easily detect, based on images captured by the imaging unit, when the toothbrush unit is not attached to the main body. 【0016】 For example, the oral care system may further include a light-shielding member that can be attached to the tip, and the determination unit may determine that the second state exists when at least a part of the light-shielding member is included in the image. 【0017】 According to this, the oral care system can easily detect, based on images captured by the imaging unit, when the toothbrush unit is not attached to the main body. 【0018】 Furthermore, a control method according to one aspect of the present disclosure is a control method for an oral care system, wherein the oral care system comprises a main body, the main body comprising a light source provided at one end of the main body, which emits light of a predetermined wavelength that reacts to plaque toward a care area, and an imaging unit that captures an image including the care area and reflected light and fluorescence from the care area, the oral care system further comprises a toothbrush section configured to switch between a first state coupled to the tip and a second state separated from the main body, the control method determines from the image whether the toothbrush section is in the first state or the second state, generates a UI (User Interface) screen that accepts input of multiple items, displays the UI screen, and in generating the UI screen, according to the result of the determination, generates multiple GUIs (Graphical User Interfaces) for accepting input of the multiple items The GUI component or item-related information to be placed on the UI screen is determined from the Interface component and the item-related information, which is information about the multiple items. 【0019】 According to this, the control method can determine whether or not the toothbrush unit is attached to the main body based on the image captured by the imaging unit. Therefore, the attachment / detachment status of the toothbrush unit can be easily detected. Furthermore, it may be possible to miniaturize and lighten the main body and reduce manufacturing costs. In addition, the control method can appropriately generate UI images according to the attachment / detachment status of the toothbrush unit. 【0020】 Furthermore, a program according to one aspect of this disclosure is a program that causes a computer to execute the control method. 【0021】 These comprehensive or specific embodiments may be implemented as a system, method, integrated circuit, computer program, or recording medium such as a computer-readable CD-ROM, or as any combination of a system, method, integrated circuit, computer program, and recording medium. 【0022】 The embodiments will be described in detail below, with reference to the drawings as appropriate. However, unnecessarily detailed explanations may be omitted. For example, detailed explanations of already well-known matters and redundant explanations of substantially identical configurations may be omitted. This is to avoid the following explanation becoming unnecessarily verbose and to facilitate understanding for those skilled in the art. 【0023】 The inventors provide the accompanying drawings and the following description so that those skilled in the art may fully understand this disclosure, and they are not intended to limit the subject matter described in the claims. 【0024】 (Embodiment) [1. Configuration] [1-1. Configuration of the main body] Figure 1 is an external view of the main body 10 in the oral care system according to this embodiment. As shown in Figure 1, the main body 10 has a toothbrush-shaped housing that can be handled with one hand, and the housing includes a head portion 10a (also called the tip portion) that is placed in the user's oral cavity when taking dental arch images, a handle portion 10b that the user grasps, and a neck portion 10c that connects the head portion 10a and the handle portion 10b. 【0025】 Figure 2 is an enlarged view of the head unit 10a shown in Figure 1. The head unit 10a comprises an imaging optical system 12 (also called the imaging unit) and a plurality of LEDs 26A to 26D. 【0026】 For example, the imaging optical system 12 is incorporated into the head portion 10a and the neck portion 10c. For example, the imaging optical system 12 includes an image sensor and a lens arranged on its optical axis. 【0027】The image sensor is an imaging device such as a CMOS (Complementary Metal-Oxide-Semiconductor) sensor or a CCD (Charge Coupled Device) element. 【0028】 The imaging optical system 12 may also include a blue light cut filter that cuts out the blue wavelength light component contained in the light incident on the image sensor. 【0029】 The multiple LEDs 26A to 26D are illumination devices (light sources) that irradiate light onto the tooth being photographed during imaging. The multiple LEDs 26A to 26D are, for example, blue LEDs (Light Emitting Diodes) that emit blue light with a peak wavelength of 405 nm. As shown in Figure 2, in this embodiment, the multiple LEDs 26A to 26D are arranged to surround the entrance of the imaging optical system 12. At least some of the multiple LEDs 26A to 26D may be white LEDs. In addition, any light source may be used instead of LEDs. 【0030】 [1-2. Attachments] The oral care system according to this embodiment has one or more attachments that can be attached to or removed from the main body 10. The oral care system also has an oral camera mode for taking pictures of the condition inside the oral cavity and a toothbrush mode for displaying the condition inside the oral cavity while brushing teeth. 【0031】 In toothbrush mode, the toothbrush part 11a, which is one of the attachments, is attached to the main body 10. Figure 3 is an external view when the toothbrush part 11a is attached to the main body 10. As shown in Figure 3, the toothbrush part 11a is attached to the head part 10a of the main body 10. 【0032】 Although Figure 3 shows an example of a toothbrush section 11a having a circular brush, toothbrush sections of other shapes may be used. Figure 4 is an external view when the toothbrush section 11b is attached to the main body section 10. As shown in Figure 4, a toothbrush section 11b having a deck brush-shaped brush may be used. 【0033】In addition, either the toothbrush portion 11a or the toothbrush portion 11b may be used, or both the toothbrush portion 11a and the toothbrush portion 11b may be included in multiple attachments of the oral care system. 【0034】 Furthermore, in oral camera mode, a light-shielding member may be attached to the head portion 10a to reduce the influence of ambient light. Figure 5 is an external view when the light-shielding member 11c is attached to the main body portion 10. As shown in Figure 5, by attaching the light-shielding member 11c, which is one of the attachments, to the head portion 10a, the influence of ambient light can be reduced. This improves the quality of the captured image, thereby improving the accuracy of processing using the image. Note that in oral camera mode, neither attachment is required to be attached to the main body portion 10. 【0035】 In any of the attachments shown in Figures 3 to 5, the imaging optical system 12 and the multiple LEDs 26A to 26D are exposed, allowing for light irradiation and imaging of the oral cavity care area (e.g., teeth). Alternatively, the imaging optical system 12 and the multiple LEDs 26A to 26D may be covered with a light-transmitting material instead of being exposed. 【0036】 Note that the attachment shapes shown in Figures 3 to 5 are just examples, and attachments of any shape may be used. 【0037】 [1-3. Overall Functional Configuration] Figure 6 is a schematic diagram of the oral care system according to this embodiment. As shown in Figure 6, the oral care system according to this embodiment is generally configured to use the main body 10 to photograph the dentition and to perform image processing on the captured image. 【0038】 As shown in Figure 6, the oral care system includes a main unit 10, a mobile terminal 70, and a cloud server 80. The mobile terminal 70 is, for example, a wirelessly wireless smartphone or tablet. The mobile terminal 70 is equipped with, for example, a touchscreen 72 capable of displaying dental images as an input and output device. The mobile terminal 70 functions as the user interface for the oral care system. 【0039】 The cloud server 80 is a server that can communicate with the mobile terminal 70 via the internet or the like, and provides the mobile terminal 70 with an application for using the main unit 10. For example, the user downloads the application from the cloud server 80 and installs it on the mobile terminal 70. The cloud server 80 also acquires dental images captured by the main unit 10 via the mobile terminal 70. 【0040】 The main unit 10 includes a central control unit 50, which is the main part that controls the system, a plurality of LEDs 26A to 26D, an LED control unit 54, an actuator 36, an actuator 40, a lens driver 56, and a position sensor 90. 【0041】 Furthermore, the main unit 10 includes a wireless communication module 58 that communicates wirelessly with the mobile terminal 70, and a power supply control unit 60 that supplies power to the central control unit 50 and the like. 【0042】 The central control unit 50 of the main unit 10 is mounted, for example, on the handle portion 10b of the main unit 10. For example, the central control unit 50 also includes a controller 62 such as a CPU (Central Processing Unit) or MPU (Micro Processing Unit) that executes various processes described later, and a memory 64 such as a RAM (Random Access Memory) or ROM (Read Only Memory) that stores programs for causing the controller 62 to execute various processes. In addition to programs, the memory 64 also stores dental images (image data) captured by the image sensor 14 and various setting data. 【0043】 The controller 62 transmits the dental image output from the image sensor 14 to the mobile terminal 70 via the wireless communication module 58. The mobile terminal 70 displays the transmitted dental image on the touchscreen 72, thereby presenting the dental image to the user. 【0044】The LED control unit 54 is mounted, for example, on the handle portion 10b of the main body portion 10, and executes lighting and extinguishing of a plurality of LEDs 26A to 26D based on a control signal from the controller 62. The LED control unit 54 is constituted by, for example, a circuit. 【0045】 The actuator 36 is mounted, for example, on the head portion 10a or the neck portion 10c of the main body portion 10, and performs composition adjustment of the imaging optical system 12. Specifically, the actuator 36 moves a housing that holds the imaging element 14 and the like in the extending direction of the optical axis in order to adjust the angle of view. 【0046】 The actuator 40 is mounted, for example, on the head portion 10a or the neck portion 10c of the main body portion 10, and performs focus adjustment of the imaging optical system 12. Specifically, the actuator 40 moves a lens in the extending direction of the optical axis in order to adjust the focus. 【0047】 The lens driver 56 is mounted, for example, on the handle portion 10b of the main body portion 10, and controls the actuator 36 and the actuator 40 based on a control signal from the controller 62 of the central control unit 50. The lens driver 56 is constituted by, for example, a circuit. 【0048】 The wireless communication module 58 is mounted, for example, on the handle portion 10b of the main body portion 10, and performs wireless communication with the portable terminal 70 based on a control signal from the controller 62. The wireless communication module 58 executes wireless communication compliant with an existing communication standard such as WiFi (registered trademark) or Bluetooth (registered trademark) with the portable terminal 70. A dental arch image is transmitted from the main body portion 10 to the portable terminal 70 via the wireless communication module 58. Also, an operation signal is transmitted from the portable terminal 70 to the main body portion 10 via the wireless communication module 58. 【0049】In this embodiment, the power control unit 60 is mounted on the handle portion 10b of the main body 10 and distributes power from the battery 66 to the central control unit 50, LED control unit 54, lens driver 56, and wireless communication module 58. The power control unit 60 is composed of, for example, a circuit. In this embodiment, the battery 66 is a rechargeable secondary battery and is wirelessly charged by an external charger 69 connected to a commercial power source via a coil 68 mounted on the main body 10. 【0050】 The position sensor 90 is a sensor for detecting the attitude and position of the main body 10, and is, for example, a multi-axis (in this case, three axes: x, y, and z) accelerometer. For example, the position sensor 90 may be a six-axis sensor having a three-axis accelerometer and a three-axis gyroscope. 【0051】 [1-4. Functional Configuration of the Mobile Terminal] Figure 7 is a functional block diagram of the mobile terminal 70. The mobile terminal 70 comprises an acquisition unit 101, a determination unit 102, a UI generation unit 103, and a display unit 104. 【0052】 The acquisition unit 101 acquires image data transmitted from the main unit 10. The determination unit 102 determines from the acquired image data whether or not an attachment is attached to the main unit 10, and what type of attachment is attached. 【0053】 The UI generation unit 103 generates a UI image to be displayed on the display unit 104 based on the determination result of the determination unit 102. For example, the UI generation unit 103 stores multiple GUI (Graphical User Interface) components for receiving input of multiple items, and multiple item-related information which is information about multiple items. The UI generation unit 103 determines which GUI components or item-related information to place on the UI screen from the multiple GUI components and multiple item-related information according to the determination result of the determination unit 102. 【0054】The functions of the acquisition unit 101, the determination unit 102, and the UI generation unit 103 are realized, for example, by a processor such as a CPU in the mobile terminal 70 executing a program stored in the memory of the mobile terminal 70. At least a portion of the acquisition unit 101, the determination unit 102, and the UI generation unit 103 may be composed of circuits. 【0055】 The display unit 104 is a display device provided by the mobile terminal 70 and displays the UI image generated by the UI generation unit 103. The display unit 104 may also display intraoral image data acquired by the acquisition unit 101, or image data generated from said image data. 【0056】 [2. Operation] [2-1. Operation of the mobile terminal 70] The operation of the oral care system will be described below. Figure 8 is a flowchart showing the flow of operation of the mobile terminal 70 in the oral care system. The process shown in Figure 8 is repeated, for example, at predetermined time intervals. The process shown in Figure 8 may also be executed triggered by user operation or other conditions. 【0057】 First, the acquisition unit 101 acquires image data transmitted from the main unit 10 (S101). This image data is obtained when the user uses the main unit 10 to photograph their own teeth and gums in their oral cavity. This image data is also obtained when the main unit 10 irradiates the teeth with light including the wavelength range of blue light and photographs the teeth that are showing a fluorescence reaction. Here, blue light is an example of irradiation light of a predetermined wavelength that excites fluorescent substances contained in dental plaque. The fluorescent substance is, for example, porphyrin. 【0058】 Here, the image data may be a video or one or more still images. Furthermore, if the image data is a video or multiple still images, the image data may be transmitted frame by frame of the video or per still image. In the case of a video, the image data may be transmitted for every multiple frames. Additionally, the acquisition unit 101 may acquire sensor data from the main unit 10 in addition to the image data. 【0059】Next, the determination unit 102 determines, based on the acquired image data, whether or not an attachment is attached to the main unit 10, and / or the type of attachment that is attached (S102). Based on this determination result, the determination unit 102 switches between oral camera mode and toothbrush mode. 【0060】 As described above, in oral camera mode, no attachment is mounted on the main unit 10, or the light-shielding member 11c shown in Figure 5 is mounted on the main unit 10. In toothbrush mode, the toothbrush unit 11a shown in Figure 3 (or the toothbrush unit 11b shown in Figure 4) is mounted on the main unit 10. 【0061】 Therefore, if the toothbrush unit 11a is attached to the main unit 10 (Yes in S103), the UI generation unit 103 sets the operation mode to toothbrush mode and generates a UI image corresponding to the toothbrush mode (S104). 【0062】 On the other hand, if the toothbrush part 11a is not attached to the main body part 10 (No in S103), the UI generation unit 103 sets the operation mode to oral camera mode and generates a UI image corresponding to the oral camera mode (S105). Here, the state in which the toothbrush part 11a is not attached to the main body part 10 is, for example, a state in which no attachment is attached to the main body part 10, or a state in which the light-shielding member 11c is attached to the main body part 10. 【0063】 Next, the display unit 104 displays the UI image generated in step S104 or S105 (S106). 【0064】[2-2. Determination process for the presence or absence of attachments] Next, the details of the determination process by the determination unit 102 in step S102 will be explained. The determination unit 102 determines, for example, that the toothbrush part 11a (or 11b) is attached to the main body 10 if the image data includes at least a part of the toothbrush part 11a. The determination unit 102 also determines that the toothbrush part 11a is not attached to the main body 10 if the image data does not include at least a part of the toothbrush part 11a (or 11b). Alternatively, the determination unit 102 determines that the toothbrush part 11a is not attached to the main body 10 if the image data includes at least a part of the light-shielding member 11c. 【0065】 Figure 9 shows an example of image data 201A when no attachments are mounted on the main unit 10. As shown in Figure 9, if no attachments are included in the image, it is determined that the toothbrush unit 11a (or 11b) is not mounted on the main unit 10. 【0066】 Figure 10 shows an example of image data 201B when the toothbrush part 11a is attached to the main body part 10. As shown in Figure 10, if at least a part of the toothbrush part 11a (in this example, the tip of the brush) is included in the image, it is determined that the toothbrush part 11a is attached. 【0067】 Figure 11 shows an example of image data 201C when the toothbrush part 11b is attached to the main body part 10. As shown in Figure 11, if at least a part of the toothbrush part 11b (in this example, the tip of the brush) is included in the image, it is determined that the toothbrush part 11b is attached. 【0068】 Figure 12 shows an example of image data 201D when the light-shielding member 11c is attached to the main body 10. As shown in Figure 12, if at least a part of the light-shielding member 11c is included in the image, it is determined that the light-shielding member 11c is attached. 【0069】The determination of whether or not the toothbrush part 11a, toothbrush part 11b, or light-shielding member 11c is included in the image can be performed using known image analysis or image recognition techniques. For example, the shape of the attachment and the positional relationship between the attachment and the imaging unit are known. Therefore, it is known where in the image a part of the attachment will be captured. The shape and color of the captured part of the attachment are also known. Therefore, for example, it is possible to determine whether or not the attachment is included in the image depending on whether or not a region of a predetermined shape and color is included at a predetermined position in the image. These regions of position, shape, and color are set in advance for each attachment. It is not necessary to use all of the regions of position, shape, and color; at least one may be used. Also, it is not necessary to use all color components (for example, the R, G, and B components in an RGB image, or the H, S, and V components in an HSV image, etc.) to determine the color region; at least one color component may be used. 【0070】 [2-3. UI Image Generation Process] Next, the details of the UI image generation process by the UI generation unit 103 in steps S104 and S105 will be explained. 【0071】 The toothbrush mode and the oral camera mode differ in the processes performed and the functions that can be used. Therefore, the UI generation unit 103 generates a UI image corresponding to each mode. 【0072】 For example, processes used in toothbrush mode but not in oral camera mode include pressure detection, care score calculation, and brushing time evaluation. Also, processes not used in toothbrush mode but used in oral camera mode include periodontal disease detection. Furthermore, processes used in both modes include ambient light detection and plaque highlighting. 【0073】 The pressure detection process estimates the pressure applied when the toothbrush part 11a is pressed against the teeth or gums, and displays the estimated result. 【0074】The care score calculation process evaluates whether oral care, such as brushing teeth, was performed correctly and displays the evaluation results. For example, the amount of plaque after brushing is determined based on image data, and the evaluation result is calculated based on the amount of plaque, etc. 【0075】 The brushing time evaluation process assesses whether the amount of time spent brushing teeth is appropriate. For example, the time from the start of brushing is measured, and the actual brushing time is displayed. 【0076】 The periodontal disease assessment process determines the presence or possibility of periodontal disease based on image data and displays the assessment result. 【0077】 The ambient light detection process determines the ambient light conditions based on image data and displays the result. 【0078】 The plaque highlighting process detects plaque based on image data and highlights the areas containing plaque within the image data. 【0079】 The process described here is merely an example; some of the processes described above may be used, or other processes may be used. In other words, there should be a process that is used in one of the toothbrush mode and the oral camera mode, but not in the other. 【0080】 The UI generation unit 103 stores multiple GUI components for receiving input for multiple items, and multiple item-related information, which is information about multiple items. When in toothbrush mode (when the toothbrush unit 11a is attached to the main unit 10), the UI generation unit 103 generates a UI image that includes GUI components and item-related information related to the processing used in toothbrush mode. When in oral camera mode (when the toothbrush unit 11a is not attached to the main unit 10), the UI generation unit 103 generates a UI image that includes GUI components and item-related information related to the processing used in oral camera mode. 【0081】Figure 13 shows an example of a UI image in toothbrush mode. The UI image 301A shown in Figure 13 includes multiple pieces of information 303 to 307 associated with the toothbrush mode, and a setting menu button 302. For example, the UI image 301A includes information 303 related to care score processing, information 304 related to brushing time evaluation processing, information 305 related to pressure detection processing, and information 306 related to ambient light determination processing. The UI image 301A also includes information 307 indicating the determined operating mode. 【0082】 Figure 14 shows an example of a UI image in oral camera mode. The UI image 301B shown in Figure 14 includes multiple pieces of information 306 to 308 associated with the oral camera mode, and a setting menu button 302. For example, the UI image 301B includes information 306 related to ambient light detection processing and information 308 related to periodontal disease detection processing. The UI image 301B also includes information 307 indicating the determined operating mode. 【0083】 The UI images shown herein are examples only, and this disclosure is not limited to these examples. For example, each piece of information does not need to be displayed at all times and may be displayed depending on user actions or other conditions. 【0084】 Furthermore, in the UI images 301A and 301B shown in Figures 13 and 14, the settings menu is displayed when the settings menu button 302 is selected (tapped or long-pressed, etc.). 【0085】 Figure 15 shows an example of the settings menu in toothbrush mode. As shown in Figure 15, the settings menu 311A ​​includes multiple setting menu items 312A for multiple processes used in toothbrush mode. When each item 312A is selected, a detailed settings menu for the corresponding process is displayed. 【0086】 Figure 16 shows an example of the settings menu in oral camera mode. As shown in Figure 16, the settings menu 311B includes multiple setting menu items 312B for multiple processes used in oral camera mode. When each item 312B is selected, the detailed settings menu for the corresponding process is displayed. 【0087】 Note that the method for displaying setting menu 311A ​​or 311B is not limited to this example; any method may be used. For example, the setting menu corresponding to the information shown in Figure 13 or Figure 14 may be displayed when that information is selected. Alternatively, the setting menu may always be displayed. 【0088】 Furthermore, while this example shows the display of settings menu items related to processes used in the current operating mode, and not those related to processes not used in the current operating mode, it is also acceptable for all settings menu items to always be displayed, with those related to processes not used in the current operating mode being grayed out. 【0089】 [3. Summary] As described above, the oral care system according to this embodiment includes a main body 10. The main body 10 includes a light source (for example, a plurality of LEDs 26A to 26D) provided at one end of the main body 10, which is the tip (for example, the head 10a), that emits light of a predetermined wavelength to which plaque reacts toward the care area (for example, teeth or gums in the oral cavity), and an imaging unit (for example, an imaging optical system 12 or an image sensor 14) that captures an image of the care area, as well as reflected light and fluorescence from the care area. The oral care system further includes a toothbrush unit 11a (or 11b) configured to switch between a first state in which it is coupled to the tip and a second state in which it is separated from the main body 10, a determination unit 102 that determines from an image whether the toothbrush unit 11a is in the first state or the second state, a UI generation unit 103 that generates a UI (User Interface) screen that accepts input of a plurality of items, and a display unit 104 that displays the UI screen. The UI generation unit 103 stores multiple GUI components for receiving input of multiple items (for example, setting menus 311A ​​or 311B) and multiple item-related information (for example, information 303 to 308) which are information related to multiple items. Depending on the result of the determination by the determination unit 102, it determines which GUI components or item-related information to place on the UI screen from the multiple GUI components and the multiple item-related information. 【0090】According to this, the oral care system can determine whether or not the toothbrush unit 11a is attached to the main body based on the image captured by the imaging unit. Therefore, the attachment / detachment status of the toothbrush unit 11a can be easily detected. Furthermore, it may be possible to miniaturize and lighten the main body 10, and reduce manufacturing costs. In addition, the oral care system can appropriately generate UI images according to the attachment / detachment status of the toothbrush unit 11a. 【0091】 For example, if the determination unit 102 determines that the toothbrush unit 11a is in a first state, the UI generation unit 103 places a GUI component from among multiple GUI components that is predetermined and associated with the first state on the UI screen. Alternatively, if the determination unit 102 determines that the toothbrush unit 11a is in a first state, the UI generation unit 103 places item-related information from among multiple item-related information that is predetermined and associated with the first state on the UI screen. If the determination unit 102 determines that the toothbrush unit 11a is in a second state, the UI generation unit 103 places a GUI component from among multiple GUI components that is predetermined and associated with the second state on the UI screen. Alternatively, if the determination unit 102 determines that the toothbrush unit 11a is in a second state, the UI generation unit 103 places item-related information from among multiple item-related information that is predetermined and associated with the second state on the UI screen. 【0092】 For example, the determination unit 102 determines that the first state is present if the image includes at least a portion of the toothbrush part 11a. 【0093】 According to this, the oral care system can easily detect the state in which the toothbrush part 11a is connected to the main body part 10 based on the image captured by the imaging unit. 【0094】 For example, the determination unit 102 determines that the image is in a second state if at least a portion of the toothbrush part 11a is not included. 【0095】 According to this, the oral care system can easily detect, based on images captured by the imaging unit, that the toothbrush unit 11a is not connected to the main body unit 10. 【0096】For example, the oral care system further includes a light-shielding member 11c that can be attached to the tip, and the determination unit 102 determines that the image is in a second state if at least a part of the light-shielding member 11c is included. 【0097】 According to this, the oral care system can easily detect, based on images captured by the imaging unit, that the toothbrush unit 11a is not connected to the main body unit 10. 【0098】 The oral care system according to the embodiments of this disclosure has been described above, but this disclosure is not limited to these embodiments. 【0099】 For example, the above description mainly described the processing performed on the mobile terminal 70. At least some of these processes may be performed on the main unit 10 or the cloud server 80. 【0100】 Furthermore, each processing unit included in the oral care system according to the above embodiment is typically implemented as an LSI, which is an integrated circuit. These may be individually integrated into a single chip, or some or all of them may be integrated into a single chip. 【0101】 Furthermore, integrated circuit implementation is not limited to LSIs; it may also be achieved using dedicated circuits or general-purpose processors. Alternatively, an FPGA (Field Programmable Gate Array), which can be programmed after LSI manufacturing, or a reconfigurable processor capable of reconfiguring the connections and settings of circuit cells within the LSI, may be used. 【0102】 Furthermore, in each of the above embodiments, each component may be implemented by being composed of dedicated hardware or by executing a software program suitable for each component. Each component may also be implemented by a program execution unit such as a CPU or processor reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory. 【0103】Furthermore, this disclosure may be implemented as a control method or the like executed by an oral care system. Alternatively, this disclosure may be implemented as a main unit, a portable terminal, or a cloud server included in an oral care system. 【0104】 Furthermore, the division of functional blocks in the block diagram is just one example; multiple functional blocks can be implemented as a single functional block, a single functional block can be divided into multiple parts, or some functions can be moved to other functional blocks. In addition, the functions of multiple functional blocks with similar functions can be processed in parallel or time-sharing by a single piece of hardware or software. 【0105】 Furthermore, the order in which each step in the flowchart is performed is illustrative for the purpose of specifically illustrating this disclosure, and may be in a different order. Also, some of the above steps may be performed simultaneously (in parallel) with other steps. 【0106】 Although one or more embodiments of an oral care system, etc., have been described above based on embodiments, this disclosure is not limited to these embodiments. Without departing from the spirit of this disclosure, various modifications that a person skilled in the art could conceive of are applied to these embodiments, and forms constructed by combining components from different embodiments may also be included within the scope of one or more embodiments. 【0107】 This disclosure is applicable to oral care systems. 【0108】10 Main body 10a Head 10b Handle 10c Neck 11a, 11b Toothbrush 11c Light-shielding member 12 Imaging optical system 14 Image sensor 26A, 26B, 26C, 26D LED 36, 40 Actuator 50 Central control unit 54 LED control unit 56 Lens driver 58 Wireless communication module 60 Power control unit 62 Controller 64 Memory 66 Battery 68 Coil 69 Charger 70 Mobile terminal 72 Touchscreen 80 Cloud server 90 Position sensor 101 Acquisition unit 102 Judgment unit 103 UI generation unit 104 Display unit 201A, 201B, 201C, 201D Image data 301A, 301B UI image 302 Setting menu button 303, 304, 305, 306, 307, 308 Information 311A, 311B Settings Menu 312A, 312B Items

Claims

1. An oral care system comprising: a main body, the main body comprising: a light source provided at the tip, which is one end of the main body, which emits light of a predetermined wavelength that reacts to plaque toward the care area; an imaging unit that captures an image of the care area, including reflected light and fluorescence from the care area; the oral care system further comprising: a toothbrush unit configured to switch between a first state coupled to the tip and a second state separated from the main body; a determination unit that determines from the image whether the toothbrush unit is in the first state or the second state; a UI generation unit that generates a UI (User Interface) screen that accepts input of multiple items; and a display unit that displays the UI screen; the UI generation unit stores a plurality of GUI (Graphical User Interface) components for accepting input of the plurality of items, and a plurality of item-related information which is information relating to the plurality of items. An oral care system that determines which GUI components or item-related information to place on the UI screen from the plurality of GUI components and the plurality of item-related information, in accordance with the result of the determination by the determination unit.

2. The oral care system according to claim 1, wherein the determination unit determines that the first state is present when the image includes at least a portion of the toothbrush portion.

3. The oral care system according to claim 1 or 2, wherein the determination unit determines that the second state is present when at least a portion of the toothbrush portion is not included in the image.

4. The oral care system according to claim 1 or 2, further comprising a light-shielding member detachable from the tip, wherein the determination unit determines that the second state is present when at least a portion of the light-shielding member is included in the image.

5. A control method for an oral care system, wherein the oral care system comprises a main body, the main body comprises a light source provided at one end of the main body, which emits light of a predetermined wavelength that reacts to plaque toward a care area, and an imaging unit that captures an image including the care area and reflected light and fluorescence from the care area, the oral care system further comprises a toothbrush section configured to switch between a first state where it is coupled to the tip and a second state where it is separated from the main body, the control method determines from the image whether the toothbrush section is in the first state or the second state, generates a UI (User Interface) screen that accepts input of multiple items, displays the UI screen, and in generating the UI screen, depending on the result of the determination, generates a plurality of GUIs (Graphical User Interfaces) for accepting input of the plurality of items A control method for determining GUI components or item-related information to be placed on the UI screen from an Interface component and a plurality of item-related information which is information relating to the plurality of items.

6. A program that causes a computer to execute the control method described in claim 5.

Images