Oral care device, oral area identification method and storage medium

Abstract

The embodiments of the present application relate to an oral care device, an oral area identification method and a storage medium. The oral care device comprises a care member, a housing, an image collector, a computing processor and a display module, wherein the care member is configured to perform a care operation on an oral cavity, and the care member is connected to the housing; the image collector is configured to collect a target image when a user uses the oral care device; the computing processor is configured to identify, on the basis of the target image, a target oral area where the oral care device is located; the computing processor is further configured to delete, in a preset manner, the target image collected by the image collector; and the display module is configured to display first information on the basis of the target oral area. The oral care device, the oral area identification method and the storage medium can implement local computation and oral area identification in the oral care device and do not require to send collected information to other devices, such that data leakage can be prevented, thereby improving the privacy security of the user.

Description

Oral care devices and oral region recognition methods and storage media Technical Field

[0001] This application relates to the field of oral care technology, specifically to an oral care device, an oral region recognition method, and a storage medium. Background Technology

[0002] As people's living standards improve, more and more people are paying attention to oral health. Various oral care devices (such as water flossers and electric toothbrushes) have been launched on the market to help users maintain their oral health. However, in these devices, information is often collected during use, which can easily lead to data leaks and violate user privacy.

[0003] Summary of the Invention

[0004] This application discloses an oral care device and an oral region recognition and storage medium, which can realize the local calculation and recognition of oral regions in the oral care device without sending the collected information to other devices, thereby avoiding data leakage and improving user privacy and security.

[0005] This application discloses an oral care device, which includes a care component, a housing, an image acquisition unit, a computing processor, and a display module. The care component is connected to the housing, and both the image acquisition unit and the display module are mounted on the housing. The housing has a receiving space for accommodating a circuit board. The computing processor is mounted on the circuit board. The image acquisition unit and the display module are electrically coupled to the computing processor.

[0006] The nursing device is configured to perform oral care procedures.

[0007] The image acquisition device is configured to acquire a target image when a user uses the oral care device; the target image includes at least a facial image or an image of the inside of the mouth.

[0008] The computing processor is configured to identify the target oral cavity region where the oral care device is located based on the target image; the computing processor is also configured to delete the target image acquired by the image acquisition device according to a preset method; and...

[0009] The display module is configured to display first information based on the target oral cavity region, the first information being used to indicate that the oral care device is located in the target oral cavity region.

[0010] In this embodiment, the oral care device includes an image acquisition unit, a computing processor, and a display module. After the image acquisition unit captures the target image, the computing processor can directly identify the oral cavity region without sending the target image to other external devices. This avoids data leakage during target image transmission, improving user privacy and security. Furthermore, the display module can show initial information indicating that the oral care device is located in the target oral cavity region, allowing users to easily understand the target region and improving the user experience. Moreover, the computing processor deletes target images according to a preset method, reducing the storage space required by the oral care device and enabling localized oral cavity region recognition even in devices with limited storage space. Additionally, localized oral cavity region recognition in the oral care device reduces data transmission time, improving the efficiency and timeliness of oral cavity region recognition, and further enhancing the accuracy of the initial information displayed by the display module.

[0011] As an optional implementation, the oral care device further includes: a posture sensor configured to acquire posture data of the oral care device; and the computing processor further configured to identify the target oral cavity region where the oral care device is located based on the target image and the posture data.

[0012] In this embodiment of the application, the computing processor can combine the attitude data collected by the attitude sensor and the target image collected by the image acquisition device to jointly identify the target oral cavity region, which can improve the accuracy of target oral cavity region identification.

[0013] As an alternative implementation, the computing processor is further configured to delete the target image after identifying the target oral region where the oral care device is located.

[0014] In this embodiment, after the computing processor identifies the target oral cavity region based on the target image, the target image is deleted and not stored, thereby reducing the storage space required by the oral care device and lowering the cost of the oral care device.

[0015] As an optional implementation, the oral care device further includes: a memory configured to store target images acquired by the image acquisition device; and the computing processor further configured to control the memory to delete at least some of the stored target images when the number of target images stored in the memory reaches a target number, or when the occupied space of the memory is greater than a space threshold.

[0016] In this embodiment, a memory is used to store the target images. When the number of target images reaches a preset target number, or when the memory occupies more than a set space threshold, some or all of the target images stored in the memory are deleted in a timely manner. This ensures that the oral care device has enough storage space to store the target images newly acquired by the image acquisition device. Localized oral region recognition can also be achieved in oral care devices with small storage space, avoiding the problem of target image loss or limited functionality of oral care device due to insufficient storage space.

[0017] As an optional implementation, the computing processor is further configured to control the memory to delete the target image corresponding to the first oral cavity region when it detects that the target oral cavity region where the oral care device is located has switched from a first oral cavity region to a second oral cavity region.

[0018] In this embodiment, when the target oral cavity region switches from the first oral cavity region to the second oral cavity region, the computing processor deletes the target image of the first oral cavity region. This ensures that the target image stored in the memory matches the current second oral cavity region, thereby reducing the storage space of the memory and improving the accuracy of oral cavity region recognition.

[0019] As an optional implementation, the memory includes random access memory (RAM).

[0020] In this embodiment, the oral care device caches the target image acquired by the image acquisition device in RAM, and the RAM storage space is automatically overwritten when it is exhausted, thus avoiding data redundancy.

[0021] As an optional implementation, the oral care device further includes: a care component configured to perform oral care operations; a pressure sensor configured to collect pressure information corresponding to the care component; and a computing processor further configured to control the image acquisition device to acquire a target image when it is determined, based on the pressure information, that the care component has entered the oral cavity.

[0022] In this embodiment, the oral care device uses a pressure sensor to detect entry points. Only when the device detects that the care device has entered the oral cavity, i.e., when the oral care device is performing oral care operations, will the image acquisition device be controlled to acquire target images. This can improve the accuracy of oral cavity area detection and reduce the power consumption loss caused by the continuous acquisition of images by the image acquisition device.

[0023] As an optional implementation, the pressure sensor is further configured to collect pressure information of the care device corresponding to the target oral cavity region; and the display module is further configured to display first information based on the target oral cavity region and the pressure information corresponding to the target oral cavity region; the first information is used to indicate that the oral care device is in the target oral cavity region and to indicate the pressure information corresponding to the target oral cavity region.

[0024] In this embodiment, the first information displayed by the display module can indicate the pressure information corresponding to the target oral cavity area, so that the user can understand the pressure of the nursing device on the target oral cavity area, thereby adjusting the use of the nursing device to avoid damage to the oral cavity area due to excessive pressure, and also to avoid poor nursing effect of the oral care device due to insufficient pressure.

[0025] As an optional implementation, the image acquisition device is further configured to preprocess the target image; and the computing processor is further configured to identify the target oral region where the oral care device is located based on the preprocessed target image.

[0026] In this embodiment of the application, the target image can be optimized by preprocessing the target image through the image acquisition device, so that the computing processor can identify the target oral cavity region more accurately based on the preprocessed target image, thereby improving the recognition accuracy of the target oral cavity region.

[0027] As an optional implementation, the display module includes a liquid crystal display screen; the liquid crystal display screen is further configured to display an oral cavity model, and according to the target oral cavity region, displays first information in the model area corresponding to the oral cavity model and the target oral cavity region using a first display method.

[0028] In this embodiment of the application, by displaying an oral cavity model on a liquid crystal display screen, users can better and more intuitively understand the location of the oral cavity and each oral cavity region; and by displaying the target oral cavity region where the current oral care device is located in real time in a first display mode, users can more easily locate the target oral cavity region during the care process, thereby improving the intuitiveness of the first information display.

[0029] As an optional implementation, the first display method includes displaying the model area corresponding to the target oral cavity region using a first color, and / or flashing the model area corresponding to the target oral cavity region according to a first flashing frequency.

[0030] In this embodiment, by using different colors or flashing frequencies, the current target oral cavity area is displayed, allowing the user to more intuitively locate the current target oral cavity area and improving the display effect of the first information.

[0031] As an optional implementation, the liquid crystal display screen is further configured to display real-time nursing information corresponding to the target oral cavity area, the real-time nursing information including one or more of real-time nursing duration, real-time nursing progress, and real-time pressure information.

[0032] In this embodiment, since the image acquisition and processing of the oral care device are integrated, real-time nursing information can be determined, the area being cared for can be accurately located, and the entire process of oral care can be displayed in real time by displaying the real-time nursing information corresponding to the target oral area, which improves the richness of information display and allows users to have a more comprehensive understanding of the nursing process.

[0033] As an optional implementation, the computing processor is further configured to determine the care trajectory of the oral care device based on multiple frames of target images; and the display module is further configured to display second information based on the care trajectory, the second information being used to indicate the care trajectory.

[0034] In this embodiment, by displaying second information indicating the care trajectory on the LCD screen, the care trajectory of the oral care device in the oral cavity is displayed intuitively, making the information displayed by the display module more diverse, thereby making it easier for users to understand the movement of the oral care device during the care process.

[0035] As an optional implementation, the computing processor is further configured to identify the target image using a lightweight network model to obtain the target oral region where the oral care device is located.

[0036] In this embodiment, the computing processor uses a lightweight network model to identify the target oral cavity region, which can reduce the model parameters and computational load for oral cavity region identification, reduce the hardware burden of oral care equipment, and accelerate the identification efficiency of the target oral cavity region.

[0037] This application discloses a method for oral cavity region recognition, applied to an oral care device, the method comprising:

[0038] When a user uses the oral care device, a target image is acquired by an image acquisition device; the target image includes at least a facial image or an image of the inside of the mouth;

[0039] Based on the target image, the target oral cavity region where the oral care device is located is identified, and the target image acquired by the image acquisition device is deleted according to a preset method; and,

[0040] Based on the target oral cavity region, a first piece of information is displayed via a display module, the first piece of information indicating that the oral care device is located in the target oral cavity region.

[0041] In this embodiment, since the image acquisition device, computing processor, and display module are all located inside the oral care device, when a user uses the device, after the image acquisition device captures the target image, the computing processor can directly identify the oral cavity region without sending the target image to other external devices. This avoids data leakage during target image transmission, improving user privacy and security. Furthermore, the display module can show first information indicating that the oral care device is located in the target oral cavity region, allowing users to easily understand the target region and improving the user experience. Moreover, the computing processor deletes target images according to a preset method, reducing the storage space required by the oral care device and enabling localized oral cavity region recognition even in devices with limited storage space. Additionally, localized oral cavity region recognition within the oral care device reduces data transmission time, improving the efficiency and timeliness of oral cavity region recognition, and further enhancing the accuracy of the first information displayed by the display module.

[0042] As an optional implementation, the method further includes: acquiring posture data of the oral care device through a posture sensor; and identifying the target oral region where the oral care device is located based on the target image, which includes: identifying the target oral region where the oral care device is located based on the target image and the posture data.

[0043] In this embodiment, the oral care device can improve the accuracy of target oral region identification by combining posture data collected by a posture sensor and target images collected by an image acquisition device.

[0044] As an optional implementation, deleting the target image acquired by the image acquisition device in a preset manner includes: after identifying the target oral cavity region where the oral care device is located based on the target image, deleting the target image acquired by the image acquisition device.

[0045] In this embodiment, after the oral care device identifies the target oral region based on the target image, it deletes the target image and does not store it, thereby reducing the storage space required by the oral care device and lowering its cost.

[0046] As an optional implementation, the method further includes: storing the target images acquired by the image acquisition device in a memory; and deleting the target images acquired by the image acquisition device in a preset manner, including: when the number of target images stored in the memory reaches a target number, or when the occupied space of the memory is greater than a space threshold, controlling the memory to delete at least a portion of the target images stored in the memory.

[0047] In this embodiment, by storing the target image in the memory, and promptly deleting some or all of the target images stored in the memory when the number of target images reaches a preset target number or when the memory occupancy exceeds a set space threshold, the oral care device is ensured to have sufficient storage space to store the target images newly acquired by the image acquisition device. Localized oral region recognition can also be achieved in oral care devices with small storage space, avoiding the problem of target image loss or limited functionality of oral care device due to insufficient storage space.

[0048] As an optional implementation, deleting the target image acquired by the image acquisition device in a preset manner includes: when it is detected that the target oral cavity region where the oral care device is located has switched from a first oral cavity region to a second oral cavity region, controlling the memory to delete the target image corresponding to the first target oral cavity region.

[0049] In this embodiment, when the target oral cavity region switches from the first oral cavity region to the second oral cavity region, the oral care device controls the memory to delete the target image of the first oral cavity region to ensure that the target image stored in the memory matches the current second oral cavity region, thereby improving the accuracy of oral cavity region recognition.

[0050] As an optional implementation, the oral care device includes a care component; the method further includes: acquiring pressure information corresponding to the care component via a pressure sensor; and, when a user uses the oral care device, acquiring a target image via an image acquisition device includes: controlling the image acquisition device to acquire a target image when it is determined, based on the pressure information, that the care component has entered the oral cavity.

[0051] In this embodiment, the oral care device uses pressure information collected by a pressure sensor to perform entry detection. When the device detects that the care component has entered the oral cavity, i.e., the device is performing oral care, the image acquisition unit is controlled to acquire a target image. This improves the accuracy of oral cavity area detection and reduces the power consumption loss caused by continuous image acquisition.

[0052] As an optional implementation, the method further includes: acquiring pressure information of the nursing device corresponding to the target oral cavity region through the pressure sensor; the step of displaying first information through a display module according to the target oral cavity region includes: displaying first information through a display module according to the target oral cavity region and the pressure information corresponding to the target oral cavity region; the first information is used to indicate that the oral care device is in the target oral cavity region and to indicate the pressure information corresponding to the target oral cavity region.

[0053] In this embodiment, the oral care device can display the first information through the display module to indicate the pressure information corresponding to the target oral cavity area, so that the user can understand the pressure of the care device on the target oral cavity area, thereby adjusting the use of the care device to avoid damage to the oral cavity area due to excessive pressure, and also to avoid poor care effect of the oral care device due to insufficient pressure.

[0054] As an optional implementation, the method further includes: preprocessing the target image; and identifying the target oral cavity region where the oral cleaning device is located based on the target image, which includes: identifying the target oral cavity region where the oral care device is located based on the preprocessed target image.

[0055] In this embodiment, the oral care device can optimize the target image by preprocessing the target image through the image acquisition device; and can identify a more accurate target oral cavity region based on the preprocessed target image, thereby improving the recognition accuracy of the target oral cavity region.

[0056] As an optional implementation, the display module includes a liquid crystal display screen; the method further includes: displaying a dental model through the liquid crystal display screen, and displaying first information in the model area corresponding to the dental model and the target dental area according to the target dental area using a first display method.

[0057] In this embodiment, the oral care device displays an oral cavity model on an LCD screen, enabling users to better and more intuitively understand the location of the oral cavity and its various regions. Furthermore, the target oral cavity region where the oral care device is located is displayed in real time on the LCD screen in a first display mode, making it easier for users to locate the target oral cavity region during the care process, thereby improving the intuitiveness of the first information display.

[0058] As an optional implementation, the method further includes: displaying real-time nursing information corresponding to the target oral cavity area, wherein the real-time nursing information includes one or more of real-time nursing duration, real-time nursing progress, and real-time pressure information.

[0059] In this embodiment, because the image acquisition and processing of the oral care device are integrated, the oral care device can determine real-time care information and accurately locate the area being cared for. By displaying the real-time care information corresponding to the target oral area, the entire process of oral care is presented in real time, which improves the richness of information display and allows users to have a more comprehensive understanding of the care process.

[0060] As an optional implementation, the method further includes: determining the care trajectory of the oral care device based on multiple target images; and displaying second information via a display module based on the care trajectory, the second information indicating the care trajectory.

[0061] In this embodiment, by displaying second information indicating the care trajectory on the LCD screen, the care trajectory of the oral care device within the oral cavity is displayed intuitively. This makes the information displayed by the display module more diverse, thereby making it easier for users to understand the movement of the oral care device during the care process.

[0062] As an optional implementation, identifying the target oral cavity region where the oral hygiene device is located based on the target image includes: identifying the target image using a lightweight network model to obtain the target oral cavity region where the oral care device is located.

[0063] In this embodiment, the oral care device uses a lightweight network model to identify the target oral region, which can reduce the model parameters and computational load for oral region identification, reduce the hardware burden of the oral care device, and accelerate the identification efficiency of the target oral region.

[0064] This application discloses an oral care device, including a memory and a processor. The memory stores a computer program, which, when executed by the processor, causes the processor to implement the method described in any of the above embodiments.

[0065] This application discloses a computer-readable storage medium that stores a computer program, which, when executed by a processor, implements the methods described in any of the above embodiments.

[0066] This application discloses a computer program product, including a computer program, which, when executed by a processor, implements the method described in any of the above embodiments. Attached Figure Description

[0067] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0068] Figure 1 shows an application scenario of oral care equipment in the prior art.

[0069] Figure 2 shows an application scenario of an oral care device in one embodiment;

[0070] Figure 3 is a structural block diagram of an oral care device in one embodiment;

[0071] Figure 4 is a schematic diagram of the 16 oral care areas commonly used in the medical industry;

[0072] Figure 5 is a structural block diagram of an oral care device in another embodiment;

[0073] Figure 6 is a structural block diagram of an oral care device in another embodiment;

[0074] Figure 7 is a structural block diagram of an oral care device in another embodiment;

[0075] Figure 8 shows an application scenario of an electric toothbrush in one embodiment;

[0076] Figure 9 is a schematic diagram of the display interface of the liquid crystal display screen in one embodiment;

[0077] Figure 10 is a schematic diagram of the interface of an oral cavity model in one embodiment;

[0078] Figure 11 is a schematic diagram of a dot matrix formed by multiple LEDs in one embodiment;

[0079] Figure 12 is a flowchart of an oral cavity region recognition method in one embodiment;

[0080] Figure 13 is a structural block diagram of an oral care device in one embodiment. Detailed Implementation

[0081] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0082] It is understood that the terms "first," "second," etc., used in this application may be used herein to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish one element from another. For example, without departing from the scope of this application, a first oral cavity region may be referred to as a second oral cavity region, and similarly, a second oral cavity region may be referred to as a first oral cavity region. The first oral cavity region and the second oral cavity region are two distinct oral cavity regions of the user.

[0083] In related technologies, data transmission between multiple devices occurs during oral care using oral care equipment. Taking an electric toothbrush as an example, as shown in Figure 1, the oral care process involves an electric toothbrush 20 and a terminal device 30, where the electric toothbrush 20 may be equipped with a camera 10.

[0084] During the brushing process using the electric toothbrush 20, accurate oral cavity area recognition is required. The electric toothbrush 20 can capture image data through the camera 10, and then transmit the captured image data to the terminal device 30. The terminal device 30 processes the image data and calculates the oral cavity area, and then feeds back the oral cavity area recognition result to the electric toothbrush 20. In other words, for the electric toothbrush 20 to perform oral cavity area recognition calculation, it must communicate with the terminal device 30 and send image data to the terminal device 30 to obtain the oral cavity area recognition result. This makes it impossible for the electric toothbrush 20 to independently complete the data processing and result presentation functions, increasing the complexity and inconvenience of the electric toothbrush 20.

[0085] Optionally, the electric toothbrush 20 and the terminal device 30 can establish a communication connection via WiFi, Bluetooth, or other means, and transmit data through this connection. However, data transmission between different devices is vulnerable to security vulnerabilities, which can be exploited by third parties to obtain or tamper with transmitted image data or oral care data, leading to user privacy leaks. Furthermore, in certain situations (such as unstable network or poor signal), data transmission may be affected, resulting in data transmission failures or delays, leading to inaccurate oral cavity area recognition.

[0086] This application discloses an oral care device, an oral region recognition method, and a storage medium, which can realize the local calculation and recognition of oral regions in the oral care device without sending the collected information to other devices, thereby avoiding data leakage and improving user privacy and security.

[0087] Figure 2 illustrates an application scenario of an oral care device in one embodiment. As shown in Figure 2, the oral care device 200 may include a care component 110 and a housing 120, with the care component 110 connected to the housing 120. The care component 110 is configured to perform oral care operations and can directly contact the user's mouth. The care component 110 may include, but is not limited to, a toothbrush head, a massage head, a cleaning head, and a nozzle. The housing 120 is for the user to hold.

[0088] Optionally, the oral care device 200 may include an image acquisition unit, a computing processor, and a display module. The image acquisition unit and the display module are both mounted on the housing 120; the housing 120 also has a receiving space for accommodating a circuit board; the computing processor is mounted on this circuit board; and the image acquisition unit and the display module are electrically coupled to the computing processor.

[0089] During the oral care operation performed by the oral care device 200 on the user's mouth, the image acquisition device on the oral care device 200 captures a target image and transmits it to the computing processor. The computing processor identifies the target oral region based on the received target image, determines the target oral region where the oral care device 200 is located, and can delete the target image captured by the image acquisition device according to a preset method to reduce the storage space occupied by the target image in the oral care device 200. The computing processor can directly transmit relevant data of the target oral region to the display module through circuitry. The display module then displays the first information indicating that the oral care device 200 is located in the target oral region, so that the user is aware of the target oral region where the oral care device 200 is located.

[0090] In some embodiments, the oral care device 200 may also be equipped with sensors such as a posture sensor, a pressure sensor, and a temperature sensor, which are used to collect corresponding data to assist the oral care device 200 in performing oral care operations on the user.

[0091] Optionally, the oral care device 200 may also be equipped with a memory for storing target images acquired by the image acquisition device, and may also be used to store data acquired by various sensors, etc., to provide data support for the oral care device 200 to determine the target oral cavity area.

[0092] In some embodiments, as shown in FIG3, the oral care device 200 may include an image acquisition unit 210, a computing processor 220, and a display module 230. The computing processor 220 may be connected to both the image acquisition unit 210 and the display module 230.

[0093] Alternatively, since wireless connections are susceptible to monitoring and interference from third parties, the image acquisition unit 210, the computing processor 220, and the display module 230 are connected via a wired circuit within the oral care device 200.

[0094] Image acquisition device 210 is configured to acquire target images when a user uses oral care device 200.

[0095] During the oral care operation performed by the oral care device 200 on the user's oral cavity, the image acquisition device 210 on the oral care device 200 can acquire target images.

[0096] In some embodiments, the image acquisition device 210 may include at least one camera, and the target image may include at least a facial image or an image inside the mouth. The user's facial image refers to an image containing the user's facial region, and may include at least one of the user's facial features; the image inside the mouth refers to an image inside the user's mouth, and may include at least one of the user's teeth, gums, tongue, etc.

[0097] Furthermore, when the image acquisition device 210 includes only one camera, the camera can be positioned on the back of the housing 120 of the oral care device 200, facing the user. The front of the housing 120 refers to the side corresponding to the care part of the care component 110 (e.g., when the care component 110 is a toothbrush head, the care part refers to the bristles), and the back of the housing 120 refers to the side facing away from the care part on the care component 110. When the image acquisition device 210 includes two cameras, one camera can be positioned on the back of the housing 120 to capture images of the user's face, and the other camera can be positioned on the care component 110, which, as the care component 110 is inserted into the user's mouth, captures images of the inside of the user's mouth. The image acquisition device 210 may also include more than two cameras, and the cameras can be configured according to actual needs.

[0098] Optionally, the image acquisition unit 210 may have functions such as automatic exposure, automatic white balance, automatic focus, and automatic setting of ROI (Region of Interest).

[0099] Automatic exposure refers to the function of automatically adjusting the camera's exposure parameters according to the current lighting conditions of the oral care equipment 200, in order to ensure that the captured target image has appropriate brightness.

[0100] Automatic white balance refers to the function of sensing the color information in the image captured by the camera and automatically adjusting the camera's white balance parameters to eliminate the influence of ambient light on image color.

[0101] Autofocus refers to the ability to analyze the sharpness information in the camera's image in real time and automatically adjust the camera's focus to ensure that the captured target image is clear and sharp, avoiding blur.

[0102] In some embodiments, the image acquisition unit 210 is further configured to preprocess the target image.

[0103] It should be noted that, in order to improve the recognition accuracy of the target oral cavity region and enable the computing processor 220 to better process the target image, the image acquisition unit 210 can preprocess the target image after acquiring it.

[0104] Optionally, the target image may be preprocessed, including but not limited to image smoothing, image denoising, image cropping, color correction, and image enhancement.

[0105] Taking image denoising as an example, in some embodiments, after acquiring the target image, the image acquisition unit 210 can perform denoising processing on the target image to remove noise interference generated by the environment during the image acquisition process. The denoising methods that can be used include, but are not limited to, mean filtering, median filtering, Gaussian filtering, bilateral filtering, non-local mean denoising, wavelet denoising, etc.

[0106] Taking image enhancement as an example of preprocessing, in some embodiments, after acquiring the target image, the image acquisition unit 210 can perform image enhancement on the target image to improve the visual effect and detail representation of the image. Possible image enhancement methods include, but are not limited to, histogram equalization, contrast stretching, sharpening, frequency domain enhancement, and pseudo-color enhancement.

[0107] In some embodiments, after the image acquisition unit 210 has completed the preprocessing of the target image, the preprocessed target image can be sent to the computing processor 220. Through the preprocessing of the target image by the image acquisition unit 210, the target image can be optimized, so that the computing processor 220 can identify a more accurate target oral cavity region based on the preprocessed target image, thereby improving the recognition accuracy of the target oral cavity region.

[0108] The computing processor 220 is configured to identify the target oral cavity region where the oral care device 200 is located based on the target image; the computing processor is also configured to delete the target image acquired by the image acquisition device 210 in a preset manner.

[0109] It should be noted that the target oral cavity area refers to the oral cavity area where one or more teeth are cared for by the care component 110 of the current oral care device 200. The oral cavity area may include the tooth area and / or tooth surface. The tooth area may consist of one or more teeth, and the tooth surface may be divided into the medial surface, the lateral surface, and the occlusal surface. The medial surface refers to the surface of the tooth near the tongue, the lateral surface refers to the surface of the tooth near the lips, and the occlusal surface refers to the surface of the tooth used for biting.

[0110] The target oral cavity area refers to the area of ​​the oral cavity that the oral care device is currently treating. It should be noted that the higher the accuracy of the target oral cavity area, the more precise and targeted the oral procedures can be performed.

[0111] To facilitate understanding of oral cavity regions, it should be noted that the tooth regions in the human oral cavity can typically be divided into four, six, eight, or even more refined and complex sixteen regions. In some embodiments, as shown in Figure 4, which is a schematic diagram of oral cavity region division in one embodiment, the oral cavity may include 16 oral cavity regions, of which 6 may include tooth regions, such as "maxillary left molar region 410", "maxillary incisor region 420", "maxillary right molar region 430", "mandibular left molar region 440", "mandibular incisor region 450", and "mandibular right molar region 460".

[0112] For ease of understanding, the maxilla and mandible are separated by dashed lines in Figure 4, and line segments are used as an auxiliary tool to understand the boundaries between oral cavity regions. Among them, the dental region "maxillary incisor region 420" formed by the six incisors of the maxilla can be divided into two oral cavity regions, namely "maxillary incisor lateral surface 421" and "maxillary incisor medial surface 422"; similarly, the dental region "mandibular incisor region 450" formed by the six incisors of the mandible can also be divided into two oral cavity regions, namely "mandibular incisor lateral surface 451" and "mandibular incisor medial surface 452".

[0113] Compared to molars, incisors in the oral cavity are divided into two sides: an outer side near the cheek and an inner side near the tongue. Molars, on the other hand, can be divided into three surfaces: an outer side near the cheek, an inner side near the tongue, and a relatively flat occlusal surface used for grinding food. Therefore, the oral cavity region "maxillary left molar region 410" formed by the five molars on the left side of the maxilla can be divided into three oral cavity regions: "maxillary left molar lateral surface 411", "maxillary left molar medial surface 413", and "maxillary left molar occlusal surface 412". Similarly, the oral cavity region "maxillary right region 430" formed by the five molars on the right side of the maxilla, the oral cavity region "mandibular left region 440" formed by the five molars on the left side of the mandible, and the oral cavity region "mandibular right region 460" formed by the five molars on the right side of the mandible all have similar oral cavity region divisions. The oral cavity region exemplified in this embodiment of the invention is for the purpose of illustrative understanding of the technical solution and is not intended to limit the technical solution provided in this embodiment of the invention.

[0114] In some embodiments, the computing processor 220 may use a machine vision algorithm to identify the target image and obtain the target image features corresponding to the target image; and determine the target oral cavity region corresponding to the target image based on the target image.

[0115] Taking an image of the inside of the oral cavity as an example, in some embodiments, the computing processor 220 can use machine vision algorithms to identify tooth features in the target image to obtain target tooth features; then, based on the target tooth features, it determines the target oral cavity region corresponding to the target tooth features. Different oral cavity regions correspond to different tooth features.

[0116] In some embodiments, the computing processor 220 may first determine the tooth region corresponding to the target tooth features based on the target tooth features, and then determine the target oral cavity region. For example, the computing processor 220 may determine, based on the target oral cavity features in the image of the inside of the oral cavity, that the teeth in the target image decrease in size from left to right and the tongue is below the target image, and thus confirm that the tooth region corresponding to the target oral cavity features is the "maxillary left molar region". If the tooth region in the target image has uneven pits and grooves, then the computing processor 220 may confirm that the target oral cavity region is the "maxillary left molar occlusal surface".

[0117] Taking a user's face image as an example, in some embodiments, the computing processor 220 determines the target oral cavity region where the oral care device is located by recognizing the facial features of the user in the face image. Specifically, the computing processor 220 can determine the target oral cavity region by recognizing the number, type, and shape of each facial feature in the face image.

[0118] For example, if the computing processor 220 detects that the facial image contains only one eye, one ear, and one eyebrow of the user, and the shape of the eye is left eye, the shape of the ear is left ear, and the shape of the eyebrow is left eyebrow, it indicates that the user is aligning the oral care device parallel to the occlusal surface. In this case, the computing processor 220 can confirm that the target oral cavity area where the oral care device is located is the "occlusal surface of the maxillary left molar".

[0119] Optionally, after the image acquisition unit 210 has completed the preprocessing of the target image, the computing processor 220 is further configured to identify the target oral cavity region where the oral care device 200 is located based on the preprocessed target image.

[0120] In other embodiments, the computing processor 220 may use a region recognition model to identify oral cavity regions in the target image to obtain the target oral cavity region where the oral care device 200 is located. Specifically, the region recognition model may include a lightweight network model.

[0121] In some embodiments, before using the region recognition model, it is necessary to train and optimize the region recognition model using a large number of target images of labeled oral cavity regions.

[0122] Specifically, taking the target image as an image of the inside of the oral cavity as an example, the training process of the region recognition model is as follows: First, acquire multiple frames of sample images of the inside of the oral cavity with the target oral cavity region already labeled. The multiple frames of sample images of the inside of the oral cavity can contain multiple sample images of the inside of the oral cavity under different angles and conditions (such as lighting, angle, occlusion, etc.). Multiple frames of sample images of the inside of the oral cavity can also be generated through geometric transformation (translation, rotation, color, brightness) or mosaic transformation, and the target oral cavity region is labeled on them.

[0123] Then, the training parameters of the pre-trained region recognition model are set, such as batch size, optimization algorithm (e.g., SGD (stochastic gradient descent)), learning rate, etc. Multiple frames of sample intraoral images and corresponding target oral region annotations are input into the pre-trained region recognition model. The weights and biases of the region recognition model are updated through backpropagation, allowing the model to gradually learn the features of the oral region.

[0124] Optionally, the computing processor 220 can use regularization techniques (such as L1 and L2 regularization to prevent model overfitting), dropout techniques (randomly discarding a portion of neurons during training to reduce the model's dependence on specific neurons and improve the model's generalization ability), and learning rate decay (gradually reducing the learning rate as training progresses, so that the model converges more stably in the later stages) to optimize the region recognition model and obtain a region recognition model with higher recognition accuracy.

[0125] In some embodiments, the computing processor 220 is further configured to identify the target oral region where the oral care device 200 is located by using a lightweight network model to identify the target image.

[0126] It should be noted that lightweight network models refer to machine learning and deep learning algorithms that run efficiently in resource-constrained environments. They typically have fewer parameters and computational load, and occupy less storage space. While ensuring recognition accuracy, they can significantly reduce computation time and power consumption, alleviate the hardware burden of oral care devices, accelerate the recognition efficiency of target oral regions, and are easier to deploy and update on smaller oral care devices.

[0127] Alternatively, lightweight network models can be used, including but not limited to the classic MobileNet neural network series (MobileNetV1, MobileNetV2, MobileNetV3), the ShuffleNet ultra-lightweight convolutional neural network series (ShuffleNetV1, ShuffleNetV2), GhostNet convolutional neural network, etc.

[0128] In some embodiments, the computing processor 220 may obtain a lightweight network model based on the pruning of a pre-trained model. Specifically, a large neural network model suitable for the task is first selected as the pre-trained model to ensure that the large model has sufficient capacity to capture complex features in the data. The pre-trained model is then trained using a sample dataset to obtain a trained large model. The sample dataset contains multiple frames of target images labeled with the target oral cavity region.

[0129] Then, based on the complexity of the trained large model and the limitations of the oral care device hardware, a suitable pruning strategy is selected. Available pruning strategies include, but are not limited to, weight pruning and structural pruning (such as neuron pruning and channel pruning). A preset evaluation method is used to determine the importance of the weights or connections of each parameter. Available evaluation methods include the magnitude of the weights, gradients, and the impact of weights on output changes. Based on the evaluation results, parameters with unimportant weights (weight values ​​less than a preset weight threshold) are removed to complete the pruning process, resulting in a lightweight network model.

[0130] In some embodiments, the pruned lightweight network model can also be fine-tuned to recover the performance lost due to pruning. This fine-tuning process can be carried out by adjusting the learning rate and other training parameters to adapt to the structure of the pruned lightweight network model.

[0131] Optionally, the pruning and fine-tuning process can be iterated multiple times to make the pruned lightweight network model fit the model size of the oral care device.

[0132] Display module 230 is configured to display first information based on the target oral cavity area, the first information being used to indicate that the oral care device 200 is in the target oral cavity area.

[0133] After receiving the target oral cavity region sent by the computing processor 220, the display module 230 can generate first information based on the target oral cavity region and display the first information.

[0134] In some embodiments, the display module 230 can generate corresponding first information based on a preset display template and the target oral cavity region. The display templates corresponding to different display formats may be different.

[0135] Optionally, the display module 230 may display the first information in various forms, including but not limited to one or more of text descriptions, graphic indicators, sound prompts, and haptic feedback.

[0136] Taking the text description of the first information as an example, the display module 230 can display a concise and clear text description on the interface, such as "Currently located on the inner surface of the mandibular incisor".

[0137] Taking the graphical indication of the first information as an example, the display module 230 can use icons, graphics, or color codes to represent different oral cavity areas. For example, the target oral cavity area where the current oral care device is located can be highlighted with a bright color, while other oral cavity areas are displayed with different colors than the target area.

[0138] Taking haptic feedback as an example, the display module 230 can convey information to the user through vibration or other haptic means. For example, when the oral care device 200 moves to a preset oral region, it can emit a slight vibration to alert the user.

[0139] Taking the display of the first information with an audio prompt as an example, in some embodiments, the display module 230 may include a voice player for generating sound through the vibration of the motor itself (bone conduction) or through a speaker (loudspeaker). The voice player can announce the first information by voice. For example, it may announce, "The target oral cavity area where the current oral care device is located is the outer surface of the maxillary incisors."

[0140] In this embodiment, the oral care device includes an image acquisition unit, a computing processor, and a display module. After the image acquisition unit captures the target image, the computing processor can directly identify the oral cavity region without sending the target image to other external devices. This avoids data leakage during target image transmission, improving user privacy and security. Furthermore, the display module can show initial information indicating that the oral care device is located in the target oral cavity region, allowing users to easily understand the target region and improving the user experience. Moreover, the computing processor deletes target images according to a preset method, reducing the storage space required by the oral care device and enabling localized oral cavity region recognition even in devices with limited storage space. Additionally, localized oral cavity region recognition in the oral care device reduces data transmission time, improving the efficiency and timeliness of oral cavity region recognition, and further enhancing the accuracy of the initial information displayed by the display module.

[0141] As shown in Figure 5, in some embodiments, the oral care device 200 may also include a posture sensor 240.

[0142] The attitude sensor 240 is configured to collect attitude data of the oral care device 200.

[0143] Optionally, the attitude sensor 240 may include at least a multi-axis sensor and an angular velocity sensor. The multi-axis sensor may be a six-axis sensor or a combination of multiple three-axis sensors, such as a nine-axis sensor. The attitude data may include the magnitude and direction of the moving speed, the magnitude and direction of the acceleration, and the magnitude and direction of the angular velocity of the oral care device 200.

[0144] In some embodiments, the computing processor 220 is further configured to identify the target oral cavity region where the oral care device 200 is located based on the target image and posture data.

[0145] In this embodiment, when a user uses an oral care device for oral care, the oral care device 200 acquires real-time images of the user's face during the oral care process via an image acquisition device 210. Additionally, the oral care device 200 also acquires real-time posture data of itself during the oral care process via a posture sensor. The oral care device 200 then uses a computing processor 220 to obtain motion information based on the acquired facial images and posture data.

[0146] After determining the action information, the computing processor 220 of the oral care device 200 determines the matching result based on the action information. The matching result is obtained by matching the action information with the standard action information corresponding to each oral cavity area. The standard action information refers to the information corresponding to the user's standard oral care actions in the oral cavity area, and this standard action information can be obtained through pre-collected and entered information.

[0147] In some embodiments, the computing processor 220 is further configured to delete the target image acquired by the image acquisition unit 210 after identifying the target oral region where the oral care device 200 is located.

[0148] Optionally, after identifying the target oral cavity area where the oral care device 200 is located, the computing processor 220 can generate a deletion instruction to delete the target image acquired by the image acquisition unit 219, so as to avoid the accumulation of target images and occupy the space of the oral care device 200, thereby reducing the cost of the oral care device.

[0149] As shown in Figure 6, in some embodiments, the oral care device 200 also includes a memory 250.

[0150] The memory 250 is configured to store the target image acquired by the image acquisition unit 210.

[0151] It should be noted that the memory 250 may include random access memory (RAM). Compared to storing the target image in the FLASH plugin, this application caches the target image in RAM, overwriting it when the RAM space is full. This avoids data redundancy and also utilizes the volatility of RAM data storage to prevent privacy leaks of the target image due to data leakage.

[0152] In some embodiments, the computing processor 220 is further configured to control the memory 250 to delete at least a portion of the stored target images when the number of target images stored in the memory 250 reaches a target number, or when the occupied space of the memory 250 is greater than a space threshold.

[0153] It should be noted that the target number can be flexibly adjusted based on the storage capacity of the oral care device 200, user habits, and the need for oral region recognition. The space threshold can be set by comprehensively considering the total storage capacity of the oral care device 200, the storage needs of other functions, and the user's preference for storage space.

[0154] In this embodiment, the target image is stored in the memory 250. When the number of target images reaches a preset target number, or when the space occupied by the memory 250 exceeds a set space threshold, some or all of the target images stored in the memory are deleted in a timely manner. This ensures that the oral care device 200 has enough storage space to store the target images newly acquired by the image acquisition device. Localized oral region recognition can also be achieved in oral care devices with small storage space, avoiding the problem of target image loss or limited functionality of oral care device due to insufficient storage space.

[0155] In some embodiments, the computing processor 220 is further configured to control the memory 250 to delete the target image corresponding to the first oral region when it detects that the target oral region where the oral care device 200 is located has switched from the first oral region to the second oral region.

[0156] When the target oral cavity region where the oral care device 200 is located changes from the first oral cavity region to the second oral cavity region, it indicates that the oral care device 200 has completed the care operation for the first oral cavity region. Therefore, there is no need to use the target image corresponding to the first oral cavity region. Thus, the target images corresponding to the first oral cavity region are deleted, which helps to reduce the occupation of storage space and also avoids the computing processor 220 from confusing the image data of different oral cavity regions.

[0157] In some embodiments, the computing processor 220 can detect movement information of the care device 110 corresponding to a first oral cavity region, and compare the changes in the movement information with a preset threshold to determine whether the oral care device 200 is in the first oral cavity region. If the detected change in the movement information is greater than the preset threshold, it is confirmed that the oral care device 200 has switched from the first oral cavity region to a second oral cavity region, where the first and second oral cavity regions are different oral cavity regions in the user's mouth. If the detected change in the movement information is less than or equal to the preset threshold, it is confirmed that the target oral cavity region where the oral care device 200 is located is still the first oral cavity region. The location data may include one or more movement information such as movement distance, movement direction, and movement speed.

[0158] Optionally, the computing processor 220 can detect the movement information of the nursing component 110 in the target oral cavity area through one or more of the following: image acquisition device 210, accelerometer, laser rangefinder, velocity sensor, ultrasonic sensor, and photoelectric sensor.

[0159] Taking the image acquisition device 210 as an example, the computing processor 220 can determine the movement information of the nursing device 110 relative to the first oral cavity region by analyzing the changes in tooth shape in multiple consecutive target images acquired by the image acquisition device 210.

[0160] Taking an optical flow sensor as an example, the optical flow sensor can collect images of the oral environment where the nursing device 110 is located. By analyzing the image differences of multiple consecutive frames of oral environment images, the movement information of the nursing device 110 relative to the first oral region can be determined.

[0161] In some embodiments, during the process of the oral care device 200 caring for the first oral region, the computing processor 220 continuously detects whether the care device 110 remains in the first oral region. If the care device 110 remains in the first oral region, the control memory 250 continuously stores each frame of target image acquired by the image acquisition device 210. If the care device 110 does not remain in the first oral region, in order to avoid confusion between the target image corresponding to the new oral region and the target image corresponding to the first oral region, which would cause the computing processor 220 to make a recognition error, the control memory 250 deletes the target image corresponding to the first oral region and starts storing the target image corresponding to the second oral region.

[0162] In some embodiments, the computing processor 220 can mark the location of a first oral cavity area where the nursing operation has been completed, and after the target image area where the oral care device 200 is located moves from the first oral cavity area to a second oral cavity area, it detects whether there is a location mark in the second oral cavity area. If there is a location mark in the second oral cavity area, it means that the nursing operation in the second oral cavity area has been completed and no further nursing is required. Then, the display module 230 of the oral care device 200 can display a movement prompt to remind the user that the current oral cavity area has been completed and the user can move to the next oral cavity area to be cared for. If there is no location mark in the second oral cavity area, the nursing component 110 of the oral care device 200 can perform nursing operations on the second oral cavity area. This can reduce the possibility of repeated nursing and make the entire oral care process more convenient and comfortable.

[0163] In some embodiments, the oral care device 200 may further include a timestamp unit for recording the acquisition time of each target image after the image acquisition device 210 acquires the target image.

[0164] Optionally, the computing processor 220 can detect a first target image whose time difference between the acquisition time and the current time is greater than a preset time difference, and control the memory 250 to delete the first target image, so as to ensure that the obtained target oral cavity area is the oral cavity area where the oral care device 200 is located in real time.

[0165] As shown in Figure 7, in some embodiments, the oral care device 200 may also include a pressure sensor 260.

[0166] Pressure sensor 260 is configured to collect pressure information corresponding to nursing component 110.

[0167] The pressure information corresponding to the nursing component 110 may refer to the pressure value experienced by the nursing component 110 in the target oral cavity area.

[0168] The computing processor 220 is also configured to control the image acquisition unit 210 to acquire a target image when it is determined, based on pressure information, that the nursing piece 110 has entered the oral cavity.

[0169] Optionally, the computing processor 220 can compare the pressure information corresponding to the nursing device 110 with a preset pressure threshold. If the pressure information is greater than the preset pressure threshold, the computing processor 220 can confirm that the nursing device 110 has entered the oral cavity; if the pressure information is less than or equal to the preset pressure threshold, the computing processor 220 can confirm that the nursing device 110 has not entered the oral cavity, and therefore does not control the image acquisition unit 210 to acquire the target image. The preset pressure threshold refers to the threshold at which the nursing device 110 contacts and applies a certain pressure to the oral cavity. This improves the accuracy of oral cavity region detection and reduces the power consumption loss caused by the continuous image acquisition by the image acquisition unit 210.

[0170] Optionally, if the computing processor 220 confirms that the oral care device 110 has not entered the oral cavity, it can control the display module 230 to output a second prompt message to remind the user to bring the oral care device into contact with the oral cavity or teeth so that the oral care device can perform care operations.

[0171] In some embodiments, the oral care device 200 may further include a temperature and humidity sensor for collecting temperature and humidity information of the environment in which the care device 110 is located; and the computing processor 220 may be used to determine that the care device 110 has entered the oral cavity when the temperature information is within a preset temperature range and the humidity information is within a preset humidity range, and then control the image acquisition device 210 to acquire a target image. The preset temperature range and preset humidity range are both normal oral temperature and humidity ranges.

[0172] In some embodiments, a pressure sensor may be disposed on the care unit 110. After the computing processor 220 identifies the target oral cavity area where the oral care device 200 is located, the pressure sensor 260 is also configured to collect pressure information of the care unit 110 corresponding to the target oral cavity area.

[0173] Optionally, the display module 230 is further configured to display first information based on the target oral cavity region and the pressure information corresponding to the target oral cavity region; the first information is used to indicate that the oral care device 200 is in the target oral cavity region and to indicate the pressure information corresponding to the target oral cavity region.

[0174] Specifically, the display module 230 is also configured to display first information based on the target oral cavity area and the pressure range to which the pressure information corresponding to the target oral cavity area belongs, so as to indicate that the oral care device 200 is in the target oral cavity area and that the pressure information corresponding to the target oral cavity area belongs to the pressure range.

[0175] In some embodiments, the display module 230 may use different colors to display the first information, wherein different colors may be used to indicate that the pressure information corresponding to the target oral cavity region belongs to a different pressure range. For example, pressure range A may be represented by blue, that is, on the display module 230, "left mandibular occlusal surface" is displayed in blue, indicating that the oral care device 200 is located on the left mandibular occlusal surface, and the pressure information corresponding to the left mandibular occlusal surface belongs to pressure range A.

[0176] In this embodiment of the application, the first information displayed by the display module 230 can indicate the pressure information corresponding to the target oral cavity area, so that the user can understand the pressure of the nursing device 110 in the target oral cavity area, thereby adjusting the use of the nursing device 110 to avoid damage to the oral cavity area due to excessive pressure, and also to avoid poor nursing effect of the oral care device 200 due to insufficient pressure.

[0177] In some embodiments, the oral care device 200 may further include a distance sensor for detecting distance data between the care device 110 and the oral cavity; the computing processor 220 may also control the image acquisition unit 210 to acquire a target image when the distance data between the care device 110 and the oral cavity is detected to be less than a distance threshold. This avoids problems such as unclear target images caused by the care device 110 being far from the oral cavity, thereby improving the accuracy of the target image.

[0178] In some embodiments, the timestamp unit may also record the duration of nursing operations performed by the nursing component 110 of the oral care device 200 in various oral regions.

[0179] Specifically, when the computing processor 220 detects that the duration of the oral care device 200's care operation in the target oral region exceeds the preset care duration, it can control the display module 230 to output a display movement prompt to indicate to the user that the current oral region has been cared for and the user can move to the next oral region to be cared for. This avoids over-care of some oral regions while leaving others uncared for, thus providing the user with a more complete oral care experience.

[0180] As shown in Figure 8, in some embodiments, the display module 230 of the oral care device 200 may include a liquid crystal display screen.

[0181] Optionally, the size and shape of the LCD screen are not limited here.

[0182] The LCD screen is configured to display a dental model and, based on the target dental area, displays first information in the model area corresponding to the dental model and the target dental area using a first display method.

[0183] In this embodiment, by displaying an oral cavity model on a liquid crystal display screen, users can better and more intuitively understand the location of the oral cavity and its various regions; and by displaying the target oral cavity region where the current oral care device 200 is located in real time in a first display mode, users can more easily locate the target oral cavity region during the care process.

[0184] Optionally, the first display method includes displaying the model area corresponding to the target oral cavity region using a first color, and / or flashing the model area corresponding to the target oral cavity region according to a first flashing frequency.

[0185] In this embodiment of the application, by using different colors or flashing frequencies, the current target oral cavity area is displayed, allowing the user to more intuitively locate the current target oral cavity area and improving the display effect of the first information.

[0186] In some embodiments, the liquid crystal display screen is further configured to display real-time nursing information corresponding to the target oral cavity area, the real-time nursing information including one or more of real-time nursing duration, real-time nursing progress, and real-time pressure information.

[0187] Taking an electric toothbrush as an example of an oral care device 200, Figure 9 is a schematic diagram of the display interface of a liquid crystal display screen in one embodiment. As shown in Figure 9, the interface 900 displayed on the liquid crystal display screen on the electric toothbrush handle may include a model area 910 and a text area 920; the model area 910 can be used to display an oral cavity model; the text area 920 can be used to display real-time care information corresponding to the target oral cavity area.

[0188] Specifically, as shown in Figure 10, in the oral cavity model displayed in model area 910, the areas filled with mesh graphics represent oral cavity areas that have been brushed or are being brushed, while the unfilled areas represent oral cavity areas that have not yet been brushed. The real-time care information displayed in text area 920 may include one or more of the following: real-time care duration, real-time care progress, and real-time pressure information. For example, displaying "29%" may indicate that the real-time care progress of the current target oral cavity area is 29%, displaying "00:34" may indicate that the real-time care duration of the current target oral cavity area is 34 seconds, displaying "1N" may indicate that the real-time pressure of the current target oral cavity area is 1 Newton, and displaying "Location recognition in progress" may indicate that the computing processor 220 is recognizing the target oral cavity area.

[0189] In some specific embodiments, Figure 10 is a schematic diagram of the interface of an oral cavity model in one embodiment. As shown in Figure 10, in one embodiment, after the computing processor 220 determines the target oral cavity area where the oral care device 200 is located, a display is made in the model area of ​​the display module 230.

[0190] Figure 10 shows a two-dimensional image of an oral model 1000 with 16 oral regions. The 13 unfilled regions represent oral regions that have not yet been cared for by the oral care device 200. The regions filled with diagonal lines and outlined with dashed lines represent the target oral regions where the oral care device 200 is located (the region outlined with dashed lines in Figure 10 is the "inner surface of the maxillary right molar"). The oral regions filled with grids represent oral regions where oral care has been performed (the oral regions where oral care has been performed in Figure 10 are the "outer surface of the maxillary anterior incisor" and the "inner surface of the maxillary anterior incisor").

[0191] It should be noted that the oral cavity model displayed on the LCD screen can not only use graphic filling to indicate whether the brushing operation has been completed, but can also use different colors, different brightness, different flashing frequencies and other display methods to distinguish whether the brushing operation of each oral cavity area has been completed by the algorithm. There are no restrictions on this.

[0192] It should be noted that a three-dimensional dynamic display effect can also be used on the model area of ​​the LCD screen. By magnification and highlighting, it can be distinguished from other oral areas, highlighting the "inner surface of the maxillary right molar" as the target oral area where the oral care device 200 is located. At the same time, the oral areas that have been treated and those that have not been treated can also be displayed separately in the three-dimensional dynamic image, so that users can intuitively distinguish the target oral area, the completed oral area, and the untreated oral area.

[0193] In some embodiments, the display module 230 may include a voice player for generating sound through the vibration of the motor itself (bone conduction) or through a speaker. The voice player can announce the target oral cavity area where the oral care device 200 is located, the corresponding care duration, the corresponding pressure information, and the distance between the care device 110 and the target oral cavity area, so that the user can know the real-time care information of the oral care device 200.

[0194] Optionally, the display module 230 can also use different flashing frequencies to represent different pressure information corresponding to oral cavity regions. For example, a higher flashing frequency indicates greater pressure information corresponding to the target oral cavity region; a lower flashing frequency indicates less pressure information corresponding to the target oral cavity region.

[0195] In some embodiments, the computing processor 220 is further configured to control the liquid crystal display to adopt a second display mode when an abnormality is detected in the real-time nursing information corresponding to the target oral cavity region, displaying the oral cavity model and the model region corresponding to the target oral cavity region; the second display mode is different from the first display mode.

[0196] Optionally, anomalies occur in the real-time nursing information corresponding to the target oral region, including one or more of the following:

[0197] The nursing time for the target oral region is less than the time threshold;

[0198] The pressure information corresponding to the target oral cavity region is greater than the pressure threshold;

[0199] The distance between the nursing component 110 and the target oral cavity area is greater than the distance threshold.

[0200] In this embodiment of the application, when the computing processor 220 detects an abnormality in the real-time nursing information (such as nursing duration or pressure information) of the target oral cavity area, it adopts a second display method different from the first display method to display an oral cavity model and a model area corresponding to the target oral cavity area on the screen to remind the user to pay attention to the abnormal situation, thereby ensuring the safety of the oral care process.

[0201] In some embodiments, the computing processor 220 is also configured to determine the care trajectory of the oral care device 200 based on multiple frames of target images.

[0202] Optionally, the care trajectory of the oral care device 200 refers to the movement trajectory of the care component 110 of the oral care device 200 during the user's oral care process; it can represent the care path of the oral care device 200 in the user's mouth, moving from one oral region to another. For example, the oral care device 200 can move from oral region A to oral region B and then to oral region C.

[0203] In an optional embodiment, the oral care device 200 determines the target oral cavity region where the oral care device 200 is located in each of the multiple target images based on the multiple target images; then, based on each target oral cavity region and according to the acquisition time of the multiple target images, it generates a care trajectory of the oral care device 200 and sends the care trajectory to the display module 230.

[0204] Optionally, the display module 230 is also configured to display second information based on the nursing trajectory, the second information being used to indicate the nursing trajectory.

[0205] In one embodiment, after receiving the care trajectory sent by the computing processor 220, the display module 230 can display second information in text form, such as "The current user has moved the oral care device 200 from the lateral surface of the mandibular left molar to the occlusal surface of the mandibular left molar". The display module 230 can also display the second information in image form, such as the care device 110 moving from the lateral surface of the mandibular left molar in the dental model (see Figure 4) to the occlusal surface of the mandibular left molar, to show the user the movement trajectory when the oral care device 200 is performing care operations.

[0206] It should be noted that the image of the nursing trajectory can be displayed in real time while the oral care device 200 is performing nursing operations, or it can be displayed after the oral care device 200 has finished performing nursing operations, so as to reproduce the movement trajectory of the oral care device during the nursing operation. This embodiment does not limit this and can be selected according to the actual situation.

[0207] As shown in Figure 11, the display module 230 may include a dot matrix 1100 formed by multiple light-emitting diodes (LEDs).

[0208] The computing processor 220 is also configured to determine the target LED group corresponding to the target oral cavity region based on the target oral cavity region, generate control instructions based on the target LED group, and send the control instructions to the display module 230, wherein the target LED group contains multiple LEDs.

[0209] The display module 230 is also configured to control each LED in the target LED group to be in a first display state according to the control command, so as to display the first information.

[0210] The LEDs in the dot matrix 1100 are circular or elliptical. These LEDs are divided into multiple LED groups, each corresponding to a different oral cavity region. In Figure 11, each circle represents one LED, and four or five connected LEDs form an LED group, which represents one oral cavity region. For example, the dotted line encloses an LED group consisting of five vertically arranged LEDs, which can represent the oral cavity region "the inner surface of the maxillary right molar".

[0211] It should be noted that all LEDs in the same LED group must be in the same display state.

[0212] Optionally, the first display state includes one or more of the following: displaying a second color, flashing at a second frequency, and displaying at a first brightness.

[0213] For example, in Figure 11, a constantly lit green light can be used to display the oral regions where nursing operations have been completed, namely the "lateral surface of the maxillary anterior incisor" and the "medial surface of the maxillary anterior incisor" (the two horizontal rows of circles filled with grid in Figure 11); a blue light that flashes at a second frequency can be used to display the target oral region where the oral care device 200 is located, namely the "medial surface of the maxillary right molar" (the vertical row of circles outlined by a dashed line and filled with diagonal lines in Figure 11); and a yellow light with a brightness lower than the above two oral regions can be used to display the oral regions that have not yet been cared for (the unfilled areas in Figure 11).

[0214] As shown in Figure 12, in one embodiment, a method for identifying oral cavity regions is provided, which can be applied to the oral care device 200 described above. This method may include the following steps 1210 to 1230.

[0215] Step 1210: When the user is using the oral care device, a target image is acquired by an image acquisition device; the target image includes at least a face image or an image of the inside of the mouth.

[0216] Step 1220: Based on the target image, identify the target oral region where the oral care device is located, and delete the target image acquired by the image acquisition device according to a preset method.

[0217] Step 1230: Based on the target oral cavity area, display first information through the display module. The first information is used to indicate that the oral care device is in the target oral cavity area.

[0218] Optionally, the oral care device includes a care component, a housing, an image acquisition unit, a computing processor, and a display module. The care component is connected to the housing, and both the image acquisition unit and the display module are mounted on the housing. The housing has a receiving space for accommodating a circuit board. The computing processor is mounted on the circuit board. The image acquisition unit and the display module are electrically coupled to the computing processor.

[0219] In some embodiments, the oral cavity region recognition method may further include the steps of: acquiring posture data of the oral care device through the posture sensor 240; and step 1220 may further include the step of: identifying the target oral cavity region where the oral care device 200 is located based on the target image and posture data.

[0220] Optionally, the step 1220 of deleting the target image acquired by the image acquisition device in a preset manner may also include the step of: after identifying the target oral region where the oral care device is located based on the target image, deleting the target image acquired by the image acquisition device 210.

[0221] In some embodiments, the oral cavity region recognition method may further include the steps of: storing target images acquired by an image acquisition device in a memory 250; and deleting target images acquired by an image acquisition device in a preset manner in step 1220 may further include the steps of: controlling the memory 250 to delete at least a portion of the target images stored in the memory when the number of target images stored in the memory 250 reaches a target number, or when the occupied space of the memory 250 is greater than a space threshold.

[0222] Optionally, the step 1220 of deleting the target image acquired by the image acquisition device in a preset manner may further include the step of: when the target oral cavity region where the oral care device is located is detected to switch from the first oral cavity region to the second oral cavity region, the control memory 250 deletes the target image corresponding to the first target oral cavity region.

[0223] In some embodiments, the oral care device 200 may include a care piece 110 and an oral region recognition method, and may also include the steps of: collecting pressure information corresponding to the care piece 110 through a pressure sensor 260; and controlling an image acquisition device 210 to acquire a target image when it is determined that the care piece 110 has entered the oral cavity based on the pressure information.

[0224] Optionally, the oral cavity region identification method may further include the steps of: collecting pressure information of the nursing device 110 in the target oral cavity region through the pressure sensor 260; and step 1230 may further include the steps of: displaying first information through the display module 230 based on the target oral cavity region and the pressure information corresponding to the target oral cavity region; the first information is used to indicate that the oral care device 200 is in the target oral cavity region and to indicate the pressure information corresponding to the target oral cavity region.

[0225] In some embodiments, the oral cavity region identification method may further include the step of: determining the pressure range to which the pressure information corresponding to the target oral cavity region belongs; and step 1230 may further include the step of: displaying first information through the display module 230 according to the target oral cavity region and the pressure range, so as to indicate that the oral care device 200 is in the target oral cavity region and that the pressure information corresponding to the target oral cavity region belongs to the pressure range.

[0226] Optionally, the oral cavity region recognition method may further include the step of: preprocessing the target image; and step 1220 may further include the step of: recognizing the target oral cavity region where the oral care device 200 is located based on the preprocessed target image.

[0227] In some embodiments, the display module 230 may include a liquid crystal display screen.

[0228] Optionally, step 1230 may further include the steps of: displaying the oral cavity model on the liquid crystal display screen, and displaying first information in the model area corresponding to the oral cavity model and the target oral cavity area according to the first display method.

[0229] In some embodiments, the oral cavity region recognition method may further include the step of: when an abnormality is detected in the nursing information corresponding to the target oral cavity region, controlling the liquid crystal display screen to adopt a second display mode to display the oral cavity model and the model region corresponding to the target oral cavity region; the second display mode is different from the first display mode.

[0230] In some embodiments, the display module 230 may include a dot matrix formed by a plurality of LEDs.

[0231] Optionally, step 1230 may further include the steps of: determining a target LED group corresponding to the target oral cavity region, wherein the target LED group contains multiple LEDs; and generating a control instruction based on the target LED group, wherein the control instruction is used to control each LED in the target LED group to be in a first display state to display first information.

[0232] In some embodiments, the oral cavity region recognition method may further include the steps of: determining the care trajectory of the oral care device 200 based on multiple target images; and displaying second information through the display module 230 based on the care trajectory, the second information being used to indicate the care trajectory.

[0233] Optionally, the oral cavity region recognition method may further include the step of: recognizing the target image through a lightweight network model to obtain the target oral cavity region where the oral care device 200 is located.

[0234] In this embodiment, the oral care device includes an image acquisition unit, a computing processor, and a display module. After the image acquisition unit captures the target image, the computing processor can directly identify the oral cavity region without sending the target image to other external devices. This avoids data leakage during target image transmission, improving user privacy and security. Furthermore, the display module can show initial information indicating that the oral care device is located in the target oral cavity region, allowing users to easily understand the target region and improving the user experience. Moreover, the computing processor deletes target images according to a preset method, reducing the storage space required by the oral care device and enabling localized oral cavity region recognition even in devices with limited storage space. Additionally, localized oral cavity region recognition in the oral care device reduces data transmission time, improving the efficiency and timeliness of oral cavity region recognition, and further enhancing the accuracy of the initial information displayed by the display module.

[0235] Figure 13 is a structural block diagram of an oral care device in one embodiment. As shown in Figure 13, the oral care device 200 may include one or more components such as a processor 1310 and a memory 1320 coupled to the processor 1310, wherein the memory 1320 may store one or more computer programs that can be configured to implement the methods described in the above embodiments when executed by one or more processors 1310.

[0236] The processor 1310 may include one or more processing cores. The processor 1310 connects to various parts of the oral care device 200 through various interfaces and lines, and performs various functions and processes data of the oral care device 200 by running or executing instructions, programs, code sets or instruction sets stored in the memory 1320, and calling data stored in the memory 1320.

[0237] The memory 1320 may include random access memory (RAM) or read-only memory (ROM). The memory 1320 can be used to store instructions, programs, code, code sets, or instruction sets. The memory 1320 may include a program storage area and a data storage area. The program storage area may store instructions for implementing an operating system, instructions for implementing at least one function, instructions for implementing the various method embodiments described above, etc. The data storage area may also store data created during the use of the oral care device 200.

[0238] This application discloses a computer-readable storage medium storing a computer program, wherein the computer program, when executed by a processor, implements the methods described in the above embodiments.

[0239] This application discloses a computer program product, including a computer program, which, when executed by a processor, implements the methods described in the above embodiments.

[0240] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. The storage medium can be a magnetic disk, optical disk, read-only memory (ROM), etc.

[0241] Any references to memory, storage, databases, or other media used herein may include non-volatile and / or volatile memory. Suitable non-volatile memory may include ROM, Programmable ROM (PROM), Erasable PROM (EPROM), Electrically Erasable PROM (EEPROM), or flash memory. Volatile memory may include Random Access Memory (RAM) used as external cache memory.

[0242] The foregoing has provided a detailed description of an oral care device, an oral region recognition method, and a storage medium disclosed in the embodiments of this application. Specific examples have been used to illustrate the principles and implementation methods of this application. The descriptions of the embodiments above are merely for the purpose of helping to understand the method and its core ideas. Furthermore, those skilled in the art will recognize that, based on the ideas of this application, there will be changes in the specific implementation methods and application scope. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. An oral care device characterized by, The oral care device includes a care component, a housing, an image acquisition unit, a computing processor, and a display module. The care component is connected to the housing, and both the image acquisition unit and the display module are mounted on the housing. The housing has a receiving space for accommodating a circuit board. The computing processor is mounted on the circuit board. The image acquisition unit and the display module are electrically coupled to the computing processor. The nursing device is configured to perform oral care procedures. The image acquisition device is configured to acquire a target image when a user uses the oral care device; the target image includes at least a facial image or an image of the inside of the mouth. The computing processor is configured to identify the target oral cavity region where the oral care device is located based on the target image; the computing processor is also configured to delete the target image acquired by the image acquisition device according to a preset method; and... The display module is configured to display first information based on the target oral cavity region, the first information being used to indicate that the oral care device is located in the target oral cavity region.

2. The oral treatment device of claim 1, wherein, The oral care equipment also includes: An attitude sensor, configured to acquire attitude data of the oral care device; and, The computing processor is further configured to identify the target oral cavity region where the oral care device is located based on the target image and the posture data.

3. The oral care device of claim 1, wherein, The computing processor is further configured to delete the target image after identifying the target oral region where the oral care device is located.

4. The oral care device of claim 1, wherein, The oral care equipment also includes: The memory is configured to store the target image acquired by the image acquisition device; and, The computing processor is further configured to control the memory to delete at least a portion of the stored target images when the number of target images stored in the memory reaches a target number, or when the occupied space of the memory exceeds a space threshold.

5. The oral care device of claim 4, wherein, The computing processor is further configured to control the memory to delete the target image corresponding to the first oral cavity region when it detects that the target oral cavity region where the oral care device is located has switched from the first oral cavity region to the second oral cavity region.

6. The oral care device of claim 4, wherein, The memory includes random access memory (RAM).

7. The oral care device of claim 1, wherein, The oral care equipment also includes: A pressure sensor, configured to acquire pressure information corresponding to the nursing component; and, The computing processor is further configured to control the image acquisition device to acquire a target image when it is determined, based on the pressure information, that the nursing device has entered the oral cavity.

8. The oral care device of claim 7, wherein, The pressure sensor is further configured to acquire pressure information of the nursing device corresponding to the target oral cavity region; and, The display module is further configured to display first information based on the target oral cavity region and the pressure information corresponding to the target oral cavity region; the first information is used to indicate that the oral care device is in the target oral cavity region and to indicate the pressure information corresponding to the target oral cavity region.

9. The oral care device of claim 1, wherein, The image acquisition device is further configured to preprocess the target image; and, The computing processor is further configured to identify the target oral region where the oral care device is located based on the preprocessed target image.

10. The oral care device of claim 1, wherein, The display module includes a liquid crystal display screen; The liquid crystal display screen is further configured to display a dental model, and, based on the target dental area, employs a first display method. In this manner, first information is displayed in the model area corresponding to the oral cavity model and the target oral cavity region.

11. The oral care device of claim 10, wherein, The first display method includes displaying the model area corresponding to the target oral cavity region using a first color, and / or flashing the model area corresponding to the target oral cavity region according to a first flashing frequency.

12. The oral care device of claim 10, wherein, The LCD screen is also configured to display real-time nursing information corresponding to the target oral cavity area, the real-time nursing information including one or more of real-time nursing duration, real-time nursing progress and real-time pressure information.

13. The oral care device of claim 1, wherein, The computing processor is further configured to determine the care trajectory of the oral care device based on multiple frames of target images; and, The display module is further configured to display second information based on the nursing trajectory, the second information being used to indicate the nursing trajectory.

14. The oral care device of claim 1, wherein, The computing processor is further configured to identify the target image through a lightweight network model to obtain the target oral region where the oral care device is located.

15. An oral region identification method characterized by comprising: The method, applied to oral care devices, includes: When a user uses the oral care device, a target image is acquired by an image acquisition device; the target image includes at least a facial image or an image of the inside of the mouth; Based on the target image, the target oral cavity region where the oral care device is located is identified, and the target image acquired by the image acquisition device is deleted according to a preset method; and, Based on the target oral cavity region, a first piece of information is displayed via a display module, the first piece of information indicating that the oral care device is located in the target oral cavity region.

16. The method of claim 15, wherein, The method further includes: The posture data of the oral care device is collected by a posture sensor; and... The step of identifying the target oral cavity region where the oral care device is located based on the target image includes: Based on the target image and the posture data, the target oral cavity area where the oral care device is located is identified.

17. The method of claim 15, wherein, The step of deleting the target image acquired by the image acquisition device according to a preset method includes: After identifying the target oral region where the oral care device is located based on the target image, the target image acquired by the image acquisition device is deleted.

18. The method of claim 15, wherein, The method further includes: The target image acquired by the image acquisition device is stored in the memory; and... The step of deleting the target image acquired by the image acquisition device according to a preset method includes: If the number of target images stored in the memory reaches the target number, or if the memory occupies more space than the space threshold, the memory is controlled to delete at least a portion of the target images stored in the memory.

19. The method of claim 18, wherein, The step of deleting the target image acquired by the image acquisition device according to a preset method includes: If the target oral cavity region where the oral care device is located is detected to have switched from the first oral cavity region to the second oral cavity region, the memory is controlled to delete the target image corresponding to the first target oral cavity region.

20. The method of claim 15, wherein, The oral care device includes care components; the method further includes: Pressure information corresponding to the nursing component is collected through a pressure sensor; and... The step of acquiring a target image via an image acquisition device when the user is using the oral care device includes: When it is determined that the nursing device has entered the oral cavity based on the pressure information, the image acquisition device is controlled to acquire a target image.

21. An oral care device characterized by, The system includes a memory and a processor, wherein the memory stores a computer program that, when executed by the processor, causes the processor to perform the method as described in any one of claims 15 to 20.

22. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the method as described in any one of claims 15 to 20.

Images