Nursing information visual identification method and device, electronic equipment and storage medium
By setting up a camera in a personal care device and collecting images within the preset care range, and combining the recognition model to extract feature information, the problem of user privacy leakage is solved, achieving higher privacy protection performance.
Patent Information
- Application Number
- CN202411046435.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-31
- Publication Date
- 2024-11-26
AI Technical Summary
Image information collected by cameras in existing personal care devices may lead to user privacy leakage, especially malicious attacks and internal personnel access controls cannot effectively prevent user privacy leakage.
By setting up a camera in a personal care device, only the target image is collected within the preset care range, ensuring that the image clarity within the range is higher than that outside the range, using the recognition model to extract feature information to identify care information, reducing privacy leakage risk.
It effectively reduces the risk of user privacy information leakage, improves the privacy protection performance of electronic devices, and ensures that even internal personnel cannot obtain user sensitive information.
Smart Images

Figure CN119027630A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of personal care technology, and in particular to a method, device, electronic device and storage medium for visually identifying care information. Background Art
[0002] As users have higher and higher requirements for the intelligence of personal care devices, personal care devices are provided with cameras to collect required image information and realize corresponding functions of the personal care devices based on the image information collected by the cameras.
[0003] However, the image information collected by the camera may cause the user's privacy information to be leaked. Summary of the invention
[0004] The embodiments of the present application disclose a nursing information visual recognition method, device, electronic device and storage medium, so that the electronic device can reduce the risk of leakage of user's privacy information.
[0005] The present application embodiment discloses a nursing information visual recognition method, which is applied to an electronic device, wherein the electronic device includes a camera, and the method includes:
[0006] In an operation scenario corresponding to the personal care device, a target image obtained by the camera acquiring an image of a target object is obtained;
[0007] Determining care information corresponding to the personal care device according to the target image;
[0008] Among them, in the operating scenario corresponding to the personal care device, the clarity of the target image of the target object obtained by the camera within the preset care range of the camera is higher than the clarity of the image obtained by the camera outside the preset care range of the camera.
[0009] As an optional implementation, the distance between the maximum clarity position of the camera in the preset care range of the camera and the middle value of the preset care range is less than or equal to a distance threshold; the maximum clarity position is the distance position in the preset care range where the clarity of the image acquired by the camera is the maximum clarity.
[0010] As an optional implementation, the preset care range is related to the setting position of the camera on the electronic device.
[0011] As an optional implementation, the care information includes at least one of personal care information, personal care device information, and user information corresponding to a user using the personal care device.
[0012] As an optional embodiment, the personal care device includes an oral care device, and the target object includes an inner area of the oral cavity and / or at least a partial facial area outside the oral cavity of a user using the oral care device.
[0013] As an optional embodiment, the target object includes any one of the following: the oral cavity and nose area, the oral cavity and chin area, the oral cavity area, the nose and chin area.
[0014] As an optional implementation, the preset care range is determined according to the depth of field range of the camera, and the maximum value of the depth of field range is less than or equal to a first depth of field threshold.
[0015] As an optional implementation, the first depth of field threshold is related to an average value of a plurality of sample distances between the camera and the target object.
[0016] As an optional implementation, the length of the depth of field range is the sum of the foreground depth of field and the back depth of field, the foreground depth of field is the difference between the average value and the first distance, the back depth of field is the difference between the second distance and the average value, the first distance is the minimum sample distance among the multiple sample distances, and the second distance is the maximum sample distance among the multiple sample distances.
[0017] As an optional implementation, the electronic device is an oral care device; wherein,
[0018] The focal length of the camera is less than or equal to 2 mm, and the vertical field of view angle is greater than or equal to 45°; or, the maximum value of the preset care range is less than or equal to 20 cm.
[0019] As an optional embodiment, the middle value of the preset care range ranges from 7.5 cm to 12.5 cm.
[0020] As an optional implementation manner, determining the care information corresponding to the personal care device according to the target image includes:
[0021] The target image is input into a first recognition model, feature information corresponding to the target object in the target image is extracted through the first recognition model, and based on the feature information, care information corresponding to the personal care device is output; the first recognition model is obtained by training a first sample image set, and the first sample image set includes multiple first sample images and care information corresponding to the multiple first sample images respectively.
[0022] As an optional implementation manner, determining the care information corresponding to the personal care device according to the target image includes:
[0023] extracting a first image corresponding to the target object from the target image;
[0024] The first image is input into a second recognition model, feature information of the first image is extracted through the second recognition model, and based on the feature information, care information corresponding to the personal care device is output.
[0025] As an optional embodiment, the electronic device is an oral care device, which includes a handle and a care piece, the handle includes a free end and a connecting end relative to each other, the connecting end of the handle is connected to the care piece, and the camera is arranged at a first position of the handle, and the distance between the first position and the connecting end is smaller than the distance between the first position and the free end.
[0026] The present application embodiment discloses a nursing information visual recognition device, which is applied to an electronic device, wherein the electronic device includes a camera, and the device includes:
[0027] An acquisition module, used to acquire a target image obtained by the camera acquiring an image of a target object in an operation scenario corresponding to the personal care device;
[0028] A determination module, configured to determine the care information corresponding to the personal care device according to the target image;
[0029] Among them, in the operating scenario corresponding to the personal care device, the clarity of the target image of the target object obtained by the camera within the preset care range of the camera is higher than the clarity of the image obtained by the camera outside the preset care range of the camera.
[0030] An embodiment of the present application discloses an electronic device, including a camera, a memory and a processor, wherein a computer program is stored in the memory, and the processor is used to obtain a target image obtained by the camera capturing an image of a target object. When the computer program is executed by the processor, the processor implements any one of the nursing information visual recognition methods disclosed in the embodiment of the present application.
[0031] An embodiment of the present application discloses an electronic device, which includes a camera, wherein a maximum value of a depth of field range corresponding to the camera is less than or equal to a first depth of field threshold, and the first depth of field threshold is related to a sample distance between the camera and a target object.
[0032] As an optional implementation, the first depth of field threshold is related to an average value of a plurality of sample distances between the camera and the target object.
[0033] As an optional implementation, the length of the depth of field range is the sum of the foreground depth of field and the back depth of field, the foreground depth of field is the difference between the average value and the first distance, the back depth of field is the difference between the second distance and the average value, the first distance is the minimum sample distance among the multiple sample distances, and the second distance is the maximum sample distance among the multiple sample distances.
[0034] As an optional implementation, the electronic device is an oral care device, and the first depth of field threshold is 20 centimeters.
[0035] As an optional implementation, the electronic device is an oral care device, the focal length of the camera is less than or equal to 2 mm, and the vertical field of view angle is greater than or equal to 45°.
[0036] As an optional implementation, the range of the middle value of the depth of field range includes 7.5 cm to 12.5 cm.
[0037] As an optional embodiment, the electronic device is an oral care device, which includes a handle and a care piece, the handle includes a free end and a connecting end relative to each other, the connecting end of the handle is connected to the care piece, the camera is arranged at a first position of the handle, and the distance between the first position and the connecting end is smaller than the distance between the first position and the free end.
[0038] An embodiment of the present application discloses a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, any one of the nursing information visual recognition methods disclosed in the embodiment of the present application is implemented.
[0039] Compared with the related art, the embodiments of the present application have the following beneficial effects:
[0040] The embodiment of the present application provides a nursing information visual recognition method, device, electronic device and storage medium. The method can be applied in an electronic device, the electronic device includes a camera, in the operation scene corresponding to the personal care device, the electronic device obtains the target image obtained by the camera through image acquisition of the target object, and determines the nursing information corresponding to the personal care device according to the target image. In the operation scene corresponding to the personal care device, the clarity of the target image of the target object obtained by the camera within the preset nursing range of the camera is higher than the clarity of the image obtained by the camera outside the preset nursing range of the camera. The electronic device can determine the nursing information corresponding to the personal care device according to the target image containing the target object. At the same time, the clarity of the image corresponding to the object outside the preset distance range of the camera is low, so that while realizing the recognition of the nursing information corresponding to the personal care device, the risk of privacy leakage is greatly reduced, and the privacy protection performance of the electronic device is improved. BRIEF DESCRIPTION OF THE DRAWINGS
[0041] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0042] Figure 1 This is an application scenario diagram of a nursing information visual recognition method disclosed in an embodiment of the present application;
[0043] Figure 2 It is a flow chart of a nursing information visual recognition method disclosed in an embodiment of the present application;
[0044] Figure 3 is a schematic diagram of an image acquisition range of a camera disclosed in an embodiment of the present application;
[0045] Figure 4 is a schematic diagram of a target image captured by a camera when an oral care device is in operation, as disclosed in an embodiment of the present application;
[0046] Figure 5 It is a structural schematic diagram of an oral care device disclosed in an embodiment of the present application;
[0047] Figure 6 is a schematic diagram of a depth of field range of a camera disclosed in an embodiment of the present application;
[0048] Figure 7 This is a schematic diagram of the corresponding relationship between the distance between a subject and a camera and the clarity of the subject disclosed in an embodiment of the present application;
[0049] Figure 8 It is a structural schematic diagram of an electronic device disclosed in an embodiment of the present application;
[0050] Fig. 9 It is a structural schematic diagram of a nursing information visual recognition device disclosed in an embodiment of the present application;
[0051] Fig.10 It is a schematic diagram of the structure of another electronic device disclosed in an embodiment of the present application. DETAILED DESCRIPTION
[0052] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0053] It should be noted that the terms "including" and "having" and any variations thereof in the embodiments of the present application and the accompanying drawings are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device including a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products or devices.
[0054] When a camera is set on an electronic device and a target image is obtained by capturing an image of a target object through the camera, the target image may contain the target object required to identify the care information corresponding to the personal care device, and may also carry sensitive information. If there are no effective privacy protection measures, the sensitive information may be leaked, that is, the user's privacy may be leaked.
[0055] There are two main aspects that cause user privacy leakage. First, malicious attackers obtain the target image captured by the camera through network hacking. Second, the manufacturer or service provider of the electronic device obtains and uses the target image without the user's knowledge. Both of the above aspects pose a serious threat to the user's privacy. Although, at present, higher-level security protection measures can be taken for the camera on the software system, such as using data encryption and access control, the above measures can only prevent attacks by malicious attackers, but cannot prevent the internal personnel of the software system from accessing the target image. That is, the above technical solution cannot fully protect the user's privacy. Therefore, there is an urgent need for a technical solution that can better protect user privacy, so that even internal personnel cannot obtain user privacy.
[0056] The embodiments of the present application disclose a nursing information visual recognition method, device, electronic device, and storage medium, so that the electronic device can reduce the risk of leakage of user's privacy information. Detailed descriptions are given below.
[0057] Please refer to Figure 1 , which shows an application scenario diagram of a nursing information visual recognition method provided by an embodiment of the present application. Figure 1As shown, the personal care system may include a terminal device 110 and a personal care device 120, and the terminal device 110 may be connected to the personal care device 120 for communication. The personal care device 120 may include a care piece and a handle, and the care piece is used to perform care operations on the user's body parts, and the care piece may be detachably connected to the handle. The operation scene corresponding to the personal care device 120 may include the personal care device 120 being in a wake-up state, a standby state, and an operation state, etc. Among them, the standby state may refer to a state in which most components of the personal care device 120 are not powered. The wake-up state may refer to a state in which the personal care device 120 is turned on and has not started working, or may refer to a state in which the personal care device 120 is awakened from the standby state and the personal care device 120 has not started working. If the personal care device 120 has an indicator light or a screen, when entering the wake-up state from the standby state, there is usually an indication such as the screen or indicator light is on or the indicator light flashes. The operation state may refer to a state in which the personal care device 120 is used for a care operation.
[0058] Optionally, the terminal device 110 may include a display screen 111, which may be used to display care information corresponding to the personal care device 120, or time information, etc. Figure 1 As shown, the terminal device 110 displays the location of the personal care device 120 and the care duration. The terminal device 110 may also include an audio playback device such as a speaker 112 to achieve audio playback.
[0059] Optionally, the personal care device 120 may include, but is not limited to, an electric toothbrush, an irrigator, a dental scaler, an oral endoscope, a tooth stick, a beauty instrument, a shaver, a massage chair, a hair removal instrument, and light and electric care equipment for treatment. Taking the personal care device 120 as an electric toothbrush as an example, the care part may be a brush head, and the brush head may be composed of a brush rod and bristles. Optionally, a motor may be provided in the handle, and when the electric toothbrush is in operation, the motor is in working state and drives the brush head to move to achieve cleaning and care of the oral cavity.
[0060] In an optional embodiment, the terminal device 110 may include a camera. The terminal device 110 may be an intelligent interactive platform used in conjunction with the personal care device 120, such as a central control, a magic mirror, etc. The terminal device 110 is usually set at a fixed position, such as a mirror, a washbasin, etc., and its position is fixed. The position of the user when using the personal care device 120 is relatively in a specific distance interval. In the operation scene corresponding to the personal care device 120, the distance between the camera and the target object is within the preset care range of the camera. The target image is obtained by capturing an image of the target object through the camera. The clarity of the target object in the target image is greater than or equal to the preset clarity, so that the terminal device 110 can determine the care information corresponding to the personal care device 120 according to the target image.
[0061] In another optional embodiment, the personal care device 120 may include a camera. In the operating scenario corresponding to the personal care device 120, the distance between the camera and the target object is within a preset care range of the camera. The target object is imaged by the camera to obtain a target image. The clarity of the target object in the target image is greater than or equal to the preset clarity, so that the personal care device 120 can determine the care information corresponding to the personal care device 120 based on the target image.
[0062] The images obtained by the camera combined with the personal care device 120 can realize many applications, including but not limited to obtaining user behavior information and device behavior and information by vision. Exemplarily, the detection and acquisition of user conditions or behaviors by using images can realize oral conditions, such as cleaning-related and health-related detection according to the type of personal care device 120; skin conditions, such as water-oil-related, skin color-related, acne-related, hair-related, and sensitivity-related detection; and care positions, such as brushing position, flushing position, oral endoscopic position, beauty position, hair removal position, and massage position detection can be realized. Exemplarily, the detection and acquisition of device conditions or behaviors by using images can realize the use of device consumable accessories, such as the use of brush heads, and visually judge the bristle condition and color change of the bristles to determine whether the brush head needs to be replaced. The acquisition of information by using images can be realized by AI (Artificial Intelligence) technology, and the information associated with the result can be extracted from the image to obtain the desired information.
[0063] Please refer to Figure 2, which shows a flow chart of a nursing information visual recognition method provided in an embodiment of the present application. The nursing information visual recognition method can be applied to an electronic device, and the electronic device can be a terminal device or a personal care device, which is not specifically limited in this embodiment. Among them, the electronic device may include a camera. The electronic device can be a terminal device 110, or the personal care device 120 itself.
[0064] like Figure 2 As shown, the nursing information visual recognition method may include steps 202 to 204.
[0065] Step 202: In an operation scene corresponding to the personal care device, a target image is obtained by acquiring an image of a target object by a camera.
[0066] Among them, in the operation scenario corresponding to the personal care device, the clarity of the target image of the target object obtained by the camera within the preset care range of the camera is higher than the clarity of the image obtained by the camera outside the preset care range of the camera. The image obtained by the camera outside the preset distance range of the camera is a blurred image, and the clarity of the blurred image is less than the preset clarity. It should be noted that the target object may refer to an object for image acquisition to determine the care information corresponding to the personal care device, that is, the electronic device can obtain the target image including the target object through the camera acquisition, and identify the care information corresponding to the personal care device. Exemplarily, the target object may be a body part of a user using the personal care device, or it may be a part of the personal care device. The target image acquired by the camera may include only the target object, or it may include the target object and other objects except the target object.
[0067] It should be noted that the clarity of the target object in the target image should satisfy the electronic device's ability to identify the target object to obtain the care information corresponding to the personal care device. The preset clarity may refer to the minimum clarity required for the electronic device to identify the characteristic information of the object from the image. The electronic device cannot obtain the characteristic information from the blurred image, thereby preventing the characteristic information of the object outside the preset care range of the camera from being leaked through the target image captured by the camera. Optionally, the preset clarity may be the clarity corresponding to the maximum value of the depth of field range of the camera. In this embodiment, the object within the preset care range of the camera, that is, the object whose distance from the camera is within the preset care range of the camera, the clarity of the image obtained by the camera through image capture of the object is greater than or equal to the preset clarity, so that no matter whether a malicious attacker invades the camera or the electronic device, or an internal personnel checks the target image captured by the camera, the characteristic information of the object outside the preset care range of the camera cannot be obtained, which greatly reduces the risk of user privacy leakage.
[0068] For example, the distance outside the preset distance range of the camera may include the distance between the personal care device and the user when the personal care device is not in operation, so that the camera cannot capture a clear user image when the personal care device is not in operation. For example, the distance between the electric toothbrush and the user when the electric toothbrush is not held by the user.
[0069] Exemplarily, the distance outside the preset distance range of the camera may also include the distance between the camera and other objects other than the target object in the operation scenario of the personal care device, so that the camera cannot capture clear images of other objects in the operation scenario of the personal care device. For example, when brushing teeth, the distance between the electric toothbrush and other objects. In this embodiment, it can be ensured that the camera captures a clear image of the target object, and realizes accurate recognition of care information. At the same time, the image of the object outside the preset care range is blurred, which can reduce the risk of affecting user privacy.
[0070] Exemplarily, the distance between the maximum clarity position of the camera in the preset care range of the camera and the middle value of the preset care range is less than or equal to the distance threshold, wherein the maximum clarity position is the distance position in the preset care range at which the clarity of the image acquired by the camera corresponds to the maximum clarity. It should be noted that the clarity of the image acquired by the camera at the maximum clarity position is the greatest, and the farther the object is from the maximum clarity position, the lower the clarity of the image corresponding to the object acquired by the camera. The maximum clarity position can be the middle value of the preset care range, or it can be a distance position that is closer to the middle value of the preset care range. Setting the maximum clarity position of the camera close to the middle value of the preset care range can ensure that the clarity of the image corresponding to the target object in the target image is relatively large, further improving the recognition accuracy of the care information.
[0071] Exemplarily, the clarity of the image acquired by the camera at the middle value of the preset care range of the camera is greater than the clarity of the image acquired by the camera at other distances of the preset care range of the camera, that is, in the image acquired by the camera, the clarity of the object whose distance from the camera is the middle value of the preset care range is the greatest. It is possible to determine the distance that appears most frequently among all the distances between the target object and the camera in the operation scene corresponding to each personal care device, and determine the middle value of the preset care range based on the distances that appear most frequently, such as setting the middle value of the preset care range to the average value of the distances that appear most frequently, so that the camera can capture high-definition target objects multiple times to ensure the recognition accuracy of care information.
[0072] It should be noted that the care information corresponding to the personal care device may refer to information associated with the personal care device. Optionally, the care information corresponding to the personal care device may include but is not limited to at least one of personal care information, personal care device information, and user information corresponding to the user using the personal care device. Among them, personal care information may refer to relevant information for performing care operations using personal care devices, such as the current position of the personal care device, the movement trajectory of the personal care device during the care operation, the care effect of the personal care device, the care duration, etc. Taking the personal care device as an electric toothbrush as an example, the personal care information may include the current position of the electric toothbrush, the brushing trajectory of the electric toothbrush, the health of the oral cavity (such as the number of caries, etc.), the care effect (such as the degree of reduction of dental plaque in the oral cavity when the electric toothbrush is cleaned) and the brushing duration, etc. Optionally, personal care device information refers to the personal care device's own information, such as the type of personal care device, the care piece information of the personal care device, and the handle information of the personal care device. Taking the personal care device as an electric toothbrush as an example, the personal care device information may include the type of toothbrush, the brush head information, and the handle information, etc. The toothbrush type may include adult toothbrushes and children's toothbrushes, etc., the brush head information may include brush head size, bristle density, bristle hardness, etc., and the handle information may include handle length, handle material, etc. Optionally, the user information may include but is not limited to user identification (such as name), user gender, and user age.
[0073] In an optional embodiment, the preset care range is related to the setting position of the camera on the electronic device. It should be noted that the setting position of the camera on the electronic device is different, and the distance between the target object and the camera in the operation scene corresponding to the personal care device is different. Therefore, when determining the preset care range of the camera, it should be reasonably set according to the setting position of the camera on the electronic device, so that in the operation scene corresponding to the personal care device, the target image captured by the camera includes the target object with a clarity greater than or equal to the preset clarity, while reducing the risk of privacy leakage of users.
[0074] In an optional embodiment, the personal care device may include an oral care device, and the target object includes the inner area of the oral cavity of the user using the oral care device and / or at least a portion of the facial area outside the oral cavity. Figure 3As shown, the camera may be set on the oral care device 310, and the oral care device 310 is in operation. When the oral care device 310 is in operation, the camera may capture a target image including the inner area of the oral cavity and / or a part of the facial area, that is, the target object includes the inner area of the oral cavity and / or a part of the facial area. Optionally, the target object may include any one of the oral cavity and nose area, the oral cavity and chin area, or the oral cavity area, the nose and chin area. When the oral care device 310 is in operation, the camera may capture a target image of the oral cavity and nose area, or a target image of the oral cavity and chin area, or a target image of the oral cavity area, the nose and chin area, as the user moves. The oral care device 310 may determine the position of the oral care device by analyzing the objects included in the target image. In this embodiment, the type of camera can be selected so that in the operation scenario of the personal care device, the target image captured by the camera only includes part of the user's facial area and / or the inner area of the oral cavity, so as to avoid the target image including the entire face of the user, and to avoid leakage of the entire facial information of the user, thereby further improving the privacy of the personal care device. At the same time, the electronic device can also determine the care information corresponding to the personal care device based on the collected target image containing part of the facial area and / or the inner area of the oral cavity. Exemplarily, when the oral care device is in operation, the target image collected by the camera includes the inner area of the user's oral cavity, and the electronic device can identify oral health information (such as the number of caries, etc.), oral cleaning effect and the location of the oral care device based on the target image. When the oral care device is in operation, the target image collected by the camera includes part of the facial area outside the oral cavity, and the electronic device can determine the location of the oral care device based on the target image.
[0075] Optionally, the care information corresponding to the personal care device may include the location of the oral care device, and the location of the oral care device may include the upper teeth area and the lower teeth area. If the target image includes the oral cavity and the nose area, it can be determined that the location of the oral care device is in the upper teeth area. If the target image includes the oral cavity and the chin area, it can be determined that the location of the oral care device is in the lower teeth area. Furthermore, the camera can also capture the care parts of the oral care device, taking the use of the oral care device to care for the buccal side of the teeth as an example, Figure 4As shown, if the care piece is relatively on the left side of the lips, the position of the oral care device can be determined to be the left side of the mouth. If the care piece is relatively in the middle range of the lips, the position of the oral care device can be determined to be the front of the mouth. If the care piece is relatively on the right side of the lips, the position of the oral care device can be determined to be the right side of the mouth. It can be understood that the position of the oral care device described in this embodiment may refer to the position of the care piece of the oral care device. In this embodiment, when the oral cleaning device is in operation, a target image including a partial facial area of the user and the care piece is captured by a camera, and the position of the oral cleaning device can be determined based on the target image, thereby improving the degree of refinement in identifying the position of the oral care device, while effectively ensuring the privacy and security of the user.
[0076] Optionally, refer to Figure 5 The electronic device may include an oral care device 500, the oral care device 500 includes a handle 510 and a care piece 520, the handle 510 includes a relatively free end 511 and a connecting end 512, the connecting end 512 of the handle 510 is connected to the care piece 520, the camera 530 is set at a first position of the handle 510, and the distance between the first position and the connecting end 512 is smaller than the distance between the first position and the free end 511. In this embodiment, the camera 530 is arranged close to the connection end 512 of the oral care device 500, which can effectively prevent the user's hands, saliva, foam, etc. from blocking the camera 530. The camera 530 is arranged at the upper end of the handle 510. When the user uses the oral care device 500, the camera 530 does not need to extend into the oral cavity, so that at least part of the user's facial area can be captured to achieve positioning. At the same time, the camera 530 is arranged close to the care part 520 of the oral care device 500. Compared with being arranged far away from the care part 520, the distance between the camera 530 and the user's facial area is shortened, so that the maximum value of the preset care range of the camera 530 can be set smaller, thereby reducing the range of clear images captured by the camera 530, and further improving the privacy protection performance of the electronic device.
[0077] Optionally, in case the electronic device is an oral care device, the focal length of the camera is less than or equal to 2 mm, and the vertical field of view angle is greater than or equal to 45°. In this embodiment, by selecting a camera with a smaller focal length and a larger field of view angle to capture the target image, since the depth of field of the camera is small and the field of view angle is large, it is ensured that when the oral care device is used to perform care operations on various dental areas of the oral cavity, the target image captured by the camera includes the internal area of the user's oral cavity and / or at least part of the facial area outside the oral cavity, thereby ensuring the effectiveness and accuracy of identifying the care information corresponding to the personal care device.
[0078] Optionally, the electronic device may be an oral care device, wherein the maximum value of the preset care range is less than or equal to 20 cm. It should be noted that, according to actual experience, when using an oral care device for oral care operations, the distance between the camera set on the oral care device and the user's facial area is less than 20 cm. If the maximum value of the preset care range is set at 20 cm, the camera can capture a clear user's facial area in any case in the operating scene corresponding to the oral care device to realize the recognition of care information. It is understandable that if the distance between the camera and the target object is less than 20 cm in the operating scene corresponding to the oral care device, the maximum value of the preset care range can be appropriately reduced to further improve the privacy protection performance of the electronic device. Optionally, the range of the middle value of the preset care range includes 7.5 cm to 12.5 cm. Optionally, the middle value of the preset care range can be 7.5 cm, 10 cm, and 12.5 cm. It should be noted that the definition corresponding to the focus distance of the camera is the maximum definition, that is, when the distance between the subject and the camera is the focus distance, the definition of the subject in the image captured by the camera is the maximum definition. In the operating scenario corresponding to the personal care device, the distance between the camera and the target object may change back and forth. For example, when brushing teeth, the distance between the camera set on the electric toothbrush and the user's facial area changes back and forth. By selecting a camera with a suitable focus distance, the definition of the target object in the target image captured by the camera is as high as possible, further improving the accuracy of identifying care information.
[0079] Step 204: determining the care information corresponding to the personal care device according to the target image.
[0080] It should be noted that the electronic device can determine the care information corresponding to the personal care device based on the target image captured by the camera. Exemplarily, the electronic device is preset with a recognition model, which can be obtained by training a sample image set, and the sample image set may include multiple sample images and care information corresponding to the multiple sample images. The recognition model is trained through the sample image set to obtain a trained recognition model, so that in the operating scenario corresponding to the personal care device, the electronic device can input the target image captured by the camera into the recognition model to obtain the care information output by the recognition model. Among them, the recognition model may include a classification model. In this embodiment, since the image of the object within the preset care range of the camera is clear, when the electronic device uses the recognition model to determine the care information, the interference of other objects outside the preset care range can be avoided, thereby improving the accuracy of visual recognition.
[0081] In an optional embodiment, determining the care information corresponding to the personal care device according to the target image may include that the electronic device inputs the target image into a first recognition model, extracts feature information corresponding to the target object in the target image through the first recognition model, and outputs the care information corresponding to the personal care device based on the feature information. The first recognition model is obtained by training a first sample image set, and the first sample image set includes a plurality of first sample images and care information corresponding to the plurality of first sample images. It should be noted that the first sample image may include an image obtained by a camera capturing an image of the target object in an operating scene corresponding to the personal care device.
[0082] In an optional embodiment, determining the nursing information corresponding to the personal care device according to the target image may include extracting a first image corresponding to the target object from the target image, inputting the first image into a second recognition model, extracting feature information of the first image through the second recognition model, and outputting the nursing information corresponding to the personal care device based on the feature information. The second recognition model is obtained by training the second sample image set, and the second sample image set includes a plurality of second sample images and the nursing information corresponding to the plurality of second sample images. It should be noted that in the operation scene corresponding to the personal care device, the camera acquires an image of the target object to obtain a third sample image, and performs image extraction processing on the third sample image to obtain a second sample image corresponding to the target object. In this embodiment, the first image corresponding to the target object is extracted from the target image, and the first image is recognized by the second recognition model to obtain the nursing information. Since the influence of other objects in the target image other than the target object is reduced, the recognition accuracy of the nursing information can be improved.
[0083] In an embodiment of the present application, the electronic device obtains a target image obtained by a camera performing image acquisition on a target object, and determines the nursing information corresponding to the personal care device based on the target image. In the operation scenario corresponding to the personal care device, the clarity of the target image of the target object within the preset nursing range of the camera obtained by the camera is higher than the clarity of the image obtained by the camera outside the preset nursing range of the camera, and the clarity of the image obtained by the camera outside the preset distance range of the camera is lower. The electronic device can determine the nursing information corresponding to the personal care device based on the target image containing the target object. At the same time, the clarity of the image corresponding to the object outside the preset distance range of the camera is lower, so that while realizing the recognition of the nursing information corresponding to the personal care device, the risk of privacy leakage is greatly reduced, and the privacy protection performance of the electronic device is improved.
[0084] In an optional embodiment, the preset care range of the camera is determined based on the depth of field range of the camera, and the maximum value of the depth of field range is less than or equal to the first depth of field threshold. It should be noted that the depth of field range of the camera refers to the distance range between the camera and the subject when the camera is able to capture a clear image of the subject, and the clarity of the clear image is greater than or equal to the preset clarity. That is, if the distance between the subject and the camera is within the depth of field range of the camera, the subject is clear in the target image captured by the camera, and the electronic device can obtain the feature information of the subject based on the target image. If the distance between the subject and the camera is outside the depth of field range of the camera, the subject is blurred in the image captured by the camera, and the electronic device cannot obtain the feature information of the subject based on the image. Figure 6 As shown in the figure, the depth of field range of the camera is [a, b], the minimum value of the depth of field range is a, the maximum value of the depth of field range is b, the position with a distance from the camera is the closest clear point of the camera, and the position with a distance from the camera is the farthest clear point of the camera. If the target object is within the depth of field range of the camera, the camera can capture a clear target object. Please refer to Figure 7 , which shows the corresponding relationship between the distance between the subject and the camera and the clarity of the subject. The clarity of objects outside the depth of field will have a gradually blurred effect.
[0085] In the operation scene corresponding to the personal care device, the distance between the target object and the camera is within a target range distance. A suitable camera can be selected according to the target distance range so that the depth of field range of the camera includes the target range distance, or the depth of field range coincides with the target range distance, to ensure that in the operation scene corresponding to the personal care device, the camera can capture a target image including a target object with a clarity higher than or equal to a preset clarity, so that the electronic device can determine the care information corresponding to the personal care device according to the target image. Optionally, the difference between the minimum value of the target distance range and the minimum value of the depth of field range of the camera is less than or equal to a first preset difference, and the difference between the maximum value of the depth of field range of the camera and the maximum value of the target distance range is less than or equal to a second preset difference, so as to ensure that the distance range of the clear image that the camera can capture is as small as possible, so as to realize the care information recognition function while greatly reducing the risk of user privacy leakage. Among them, the first preset difference and the second preset difference can be the same or different. Among them, the range of the first preset difference can include 0 to 3 centimeters. Optionally, the first preset difference range may be 0, 0.5 cm, 1 cm, 1.5 cm, 2 cm, 2.5 cm or 3 cm. The second preset difference range may include 0 to 3 cm. Optionally, the second preset difference range may be 0, 0.5 cm, 1 cm, 1.5 cm, 2 cm, 2.5 cm or 3 cm.
[0086] It should be noted that, due to the different actions and postures of different users in the operation scenes corresponding to the personal care device, the distance between the camera and the target object may be different for different users in the operation scenes corresponding to the personal care device. The distance between the camera and the target object may also be different for the same user at different stages in the operation scene. The first depth of field threshold should be greater than the distance between the camera and the target object under normal circumstances for different users and different postures, so that the selected camera can ensure that in most cases, a clear target object can be obtained by image acquisition of the target object, thereby ensuring the validity of the care information determined by the electronic device. Optionally, the first depth of field threshold is related to multiple sample distances between the camera and the target object. It should be noted that the sample distance may refer to the distance between the camera and the target object collected during the historical operation of the personal care device. The multiple sample distances may be obtained based on the same user or based on multiple users.
[0087] Exemplarily, in operating scenarios corresponding to one or more personal care devices, multiple images obtained by a camera capturing an image of a target object can be acquired, and a sample distance between the camera and the target object can be determined based on the multiple images to determine a first depth of field threshold corresponding to the required camera.
[0088] Optionally, the electronic device may determine an average value of multiple sample distances. Since the camera is located on the electronic device, the movements and postures of the same user may vary in the operation scenario corresponding to the personal care device. Changes in the user's movements and postures may cause the distance between the camera and the target object to change, that is, in the operation scenario corresponding to the personal care device, the camera may move within a certain distance range relative to the target object. The average value of the multiple sample distances can be considered as the use distance between the target object and the camera in the operation scenario corresponding to the personal care device, that is, it can be considered that the distance between the target object and the camera for each user in the operation scenario corresponding to the personal care device varies around the use distance.
[0089] Optionally, the first depth of field threshold is related to the average value of multiple sample distances between the camera and the target object. The first depth of field threshold is positively correlated with the average value of the multiple sample distances. The larger the average value of the multiple sample distances, the larger the first depth of field threshold. Optionally, the focus distance of the camera can be determined as the average value. The focus distance of the camera can be understood as the distance between the subject and the camera when the camera captures the subject with the highest clarity. That is, when the distance between the subject and the camera is the focus distance of the camera, the clarity of the captured object is the maximum clarity. Please continue to refer to Figure 7 , the focus distance of the camera is c.
[0090] It is understandable that in the operation scenario of the personal care device, the movements and postures of the same user are changing, so the distance between the camera and the target object is changing. For example, during the brushing process, the distance between the camera set on the handle and the user's face is from the average value, then gradually decreases to the minimum distance, then gradually increases to the average value, and then increases to the maximum distance. Therefore, the change value of the distance between the camera and the target object in the operation scenario of the personal care device can be estimated, and the length of the depth of field range can be determined based on the change value. Exemplarily, a first preset change value and a second preset change value can be predetermined, and the parameters of the camera are determined according to the first preset change value, the second preset change value and the average value of multiple sample distances. The first preset change value may be the difference between the focus distance and the minimum value of the depth of field range, and the second preset change value may be the difference between the maximum value of the depth of field range and the focus distance. The length of the depth of field range may be determined according to the sum of the first preset change value and the second preset change value, and the focus distance of the camera may be determined according to the average value of the multiple sample distances. According to the determined focus distance and the length of the depth of field range, the type of camera to be set in the electronic device is selected, so that the nursing information can be identified while greatly reducing the risk of user privacy leakage. Among them, the first preset change value and the second preset change value of this embodiment can be determined by the setting personnel.
[0091] Optionally, the length of the depth of field range is the sum of the front depth of field and the back depth of field, the front depth of field is the difference between the average value of multiple sample distances and the first distance, the back depth of field is the difference between the second distance and the average value of multiple sample distances, the first distance is the minimum sample distance among the multiple sample distances, and the second distance is the maximum sample distance among the multiple sample distances. It should be noted that determining the first distance and the second distance based on the acquired multiple sample distances can improve the reliability of the determined length of the depth of field range. Please continue to refer to Figure 6 The first distance is the foreground depth of the camera. When the distance between the camera and the target object is less than the average value of multiple sample distances, the camera can still clearly capture the target object. The second distance is the backfield depth of the camera. When the distance between the camera and the target object is greater than the average value of multiple sample distances, the camera can still clearly capture the target object. This can ensure that in the operating scenarios corresponding to the personal care device, the camera can capture clear target objects.
[0092] For example, taking the electronic device as an electric toothbrush, the camera is set on the handle, and the target object is a face, when the first user is brushing his teeth, the collected distances between the camera and the face of the first user are 6cm, 8cm, 10cm, and 12cm; when the second user is brushing his teeth, the distances between the camera and the face range from 5cm, 7cm, 9cm, 11cm, 13cm, and 15cm; when the third user is brushing his teeth, the distances between the camera and the face range from 6cm, 8cm, 10cm, and 13cm. It can be determined that the average value is 9.5 cm, the second distance is 15 cm, and the third distance is 6 cm.
[0093] In this embodiment, the camera set on the electronic device can clearly capture the target object in the operation scene corresponding to the personal care device, while the characteristic information of other objects outside the depth of field range is blurred and cannot be captured due to the optical characteristics of the camera lens. In this embodiment, the optical characteristics of the camera lens, i.e., the depth of field, are utilized to achieve accurate shooting of the target object. By selecting a camera with matching focus distance, foreground depth of field and back depth of field, it can be ensured that when the distance between the camera and the target object changes within a certain range, the distance between the target object and the camera is always maintained within the depth of field of the camera, while other areas will be blurred because they exceed the depth of field range of the camera. Through the selection strategy of the camera, the focus distance and the front and back depth of field can be accurately controlled, achieving efficient shooting of the target object and effective protection of user privacy.
[0094] Please refer to Figure 8 , which shows a structural schematic diagram of an electronic device provided in an embodiment of the present application, the electronic device 810 may include a camera 811, the maximum value of the depth of field range corresponding to the camera 811 is less than or equal to a first depth of field threshold, and the first depth of field threshold is related to the sample distance between the camera 811 and the target object.
[0095] Optionally, the first depth of field threshold is related to an average value of multiple sample distances between the camera and the target object. By collecting multiple sample distances and determining the average value of the multiple sample distances, the maximum value of the depth of field range is determined, so that in most cases, the camera can clearly capture the target image, thereby improving the recognition effect in the corresponding operating scenario of the personal care device.
[0096] Optionally, the length of the depth of field range is the sum of the front depth of field and the back depth of field, the front depth of field is the difference between the average value and the first distance, the back depth of field is the difference between the second distance and the average value, the first distance is the minimum sample distance among multiple sample distances, and the second distance is the maximum sample distance among multiple sample distances.
[0097] Optionally, the electronic device is an oral care device, and the first depth of field threshold is 20 cm. Optionally, the maximum value of the depth of field range corresponding to the camera is 20 cm, 18 cm, 17 cm or 15 cm.
[0098] Optionally, the electronic device is an oral care device, the focal length of the camera is less than or equal to 2 mm, and the vertical field of view angle is greater than or equal to 45°.
[0099] Optionally, the range of the middle value of the depth of field range includes 7.5 cm to 12.5 cm. Optionally, the focus distance range of the camera includes 7.5 cm to 12.5 cm. Exemplarily, the focus distance of the camera is 7.5 cm, 10 cm or 12.5 cm.
[0100] Optionally, the electronic device is an oral care device, the oral care device comprises a handle and a care piece, the handle comprises a free end and a connecting end opposite to each other, the connecting end of the handle is connected to the care piece, the camera is arranged at a first position of the handle, the distance between the first position and the connecting end is smaller than the distance between the first position and the free end. Optionally, the camera can capture an image of the care piece.
[0101] Please refer to Fig. 9 , which shows a schematic diagram of the structure of a nursing information visual recognition device disclosed in an embodiment of the present application. Fig. 9 As shown, the nursing information visual recognition device 900 may include an acquisition module 910 and a determination module 920. The acquisition module 910 is used to acquire a target image obtained by a camera performing image acquisition on a target object in an operation scene corresponding to the personal care device. The determination module 920 is used to determine the nursing information corresponding to the personal care device according to the target image. In the operation scene corresponding to the personal care device, the clarity of the target image of the target object acquired by the camera within the preset nursing range of the camera is higher than the clarity of the image acquired by the camera outside the preset nursing range of the camera.
[0102] In an optional embodiment, the distance between the maximum clarity position of the camera in the preset care range of the camera and the middle value of the preset care range is less than or equal to the distance threshold; the maximum clarity position is the distance position in the preset care range where the clarity of the image acquired by the camera is the maximum clarity corresponding to the distance position.
[0103] In an optional embodiment, the preset care range is related to the setting position of the camera on the electronic device.
[0104] In an optional embodiment, the care information includes at least one of personal care information, personal care device information, and user information corresponding to a user using the personal care device.
[0105] In an optional embodiment, the personal care device includes an oral care device, and the target object includes an area inside the oral cavity and / or at least a portion of the facial area outside the oral cavity of a user using the oral care device.
[0106] In an optional embodiment, the target object includes any one of the following: the mouth and nose area, the mouth and chin area, the mouth area, the nose and chin area.
[0107] In an optional embodiment, the preset care range is determined based on the depth of field range of the camera, and the maximum value of the depth of field range is less than or equal to the first depth of field threshold.
[0108] In an optional embodiment, the first depth of field threshold is related to an average value of a plurality of sample distances between the camera and the target object.
[0109] In an optional embodiment, the length of the depth of field range is the sum of the front depth of field and the back depth of field, the front depth of field is the difference between the average value and the first distance, the back depth of field is the difference between the second distance and the average value, the first distance is the minimum sample distance among multiple sample distances, and the second distance is the maximum sample distance among multiple sample distances.
[0110] In an optional embodiment, the electronic device is an oral care device;
[0111] Among them, the focal length of the camera is less than or equal to 2 mm, and the vertical field of view angle is greater than or equal to 45°; or, the maximum value of the preset care range is less than or equal to 20 cm.
[0112] In an optional embodiment, the middle value of the preset care range ranges from 7.5 cm to 12.5 cm.
[0113] In an optional embodiment, the determination module 920 is also used to input the target image into a first recognition model, extract feature information corresponding to the target object in the target image through the first recognition model, and output care information corresponding to the personal care device based on the feature information; the first recognition model is trained by a first sample image set, and the first sample image set includes multiple first sample images and care information corresponding to the multiple first sample images respectively.
[0114] In an optional embodiment, the determination module 920 is also used to extract a first image corresponding to the target object from the target image; and input the first image into a second recognition model, extract feature information of the first image through the second recognition model, and output care information corresponding to the personal care device based on the feature information.
[0115] In an optional embodiment, the electronic device is an oral care device, which includes a handle and a care piece. The handle includes a free end and a connecting end relative to each other. The connecting end of the handle is connected to the care piece. The camera is arranged at a first position of the handle. The distance between the first position and the connecting end is smaller than the distance between the first position and the free end.
[0116] See also Fig.10 , Fig.10 is a schematic diagram of the structure of another electronic device disclosed in the embodiment of the present application. Fig.10 As shown, the electronic device 1000 may include:
[0117] Camera 1010;
[0118] A memory 1020 storing executable program codes;
[0119] a processor 1030 coupled to the memory 1020;
[0120] Among them, the processor 1030 can be connected to the camera 1010, and the processor 1030 is used to obtain the target image obtained by the camera capturing the target object. The processor 1030 calls the executable program code stored in the memory 1020 to execute any one of the nursing information visual recognition methods disclosed in the embodiments of the present application.
[0121] An embodiment of the present application discloses a computer-readable storage medium storing a computer program, wherein when the computer program is executed by the processor, the processor implements any one of the nursing information visual recognition methods disclosed in the embodiment of the present application.
[0122] It should be understood that the "one embodiment" or "an embodiment" mentioned throughout the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. Those skilled in the art should also be aware that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily required for the present application.
[0123] In the various embodiments of the present application, it should be understood that the size of the serial numbers of the above-mentioned processes does not necessarily mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
[0124] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0125] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0126] If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-accessible memory. Based on this understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product, which is stored in a memory and includes several requests for a computer device (which can be a personal computer, a server or a network device, etc., specifically a processor in a computer device) to perform some or all of the steps of the above-mentioned methods of various embodiments of the present application.
[0127] Those skilled in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium, and the storage medium includes a read-only memory (ROM), a random access memory (RAM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), a one-time programmable read-only memory (OTPROM), an electronically erasable rewritable read-only memory (EEPROM), a compact disc (CD-ROM) or other optical disc storage, magnetic disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.
[0128] The above is a detailed introduction to a nursing information visual recognition method, device, electronic device and storage medium disclosed in the embodiment of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method and core idea of the present application. At the same time, for those of ordinary skill in the art, according to the idea of the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.
Claims
1. A nursing information visual recognition method, characterized in that: Applied to an electronic device, the electronic device includes a camera, and the method includes: In an operation scenario corresponding to the personal care device, a target image obtained by the camera acquiring an image of a target object is obtained; Determining care information corresponding to the personal care device according to the target image; Among them, in the operating scenario corresponding to the personal care device, the clarity of the target image of the target object obtained by the camera within the preset care range of the camera is higher than the clarity of the image obtained by the camera outside the preset care range of the camera.
2. The method according to claim 1, characterized in that The distance between the maximum clarity position of the camera in the preset care range of the camera and the middle value of the preset care range is less than or equal to the distance threshold; the maximum clarity position is the distance position in the preset care range where the clarity of the image acquired by the camera is the maximum clarity.
3. The method according to claim 1, characterized in that The preset care range is related to the setting position of the camera on the electronic device.
4. The method according to claim 1, characterized in that The care information includes at least one of personal care information, personal care device information, and user information corresponding to a user using the personal care device.
5. The method according to claim 1, characterized in that The personal care device comprises an oral care device, and the target object comprises an inner area of an oral cavity and / or at least a part of a facial area outside an oral cavity of a user using the oral care device.
6. The method according to claim 5, characterized in that The target object includes any one of the following: the mouth and nose area, the mouth and chin area, the mouth area, the nose and chin area.
7. The method according to claim 1, characterized in that The preset care range is determined according to the depth of field range of the camera, and the maximum value of the depth of field range is less than or equal to a first depth of field threshold.
8. The method according to claim 7, characterized in that The first depth of field threshold is related to an average value of a plurality of sample distances between the camera and the target object.
9. The method according to claim 8, characterized in that The length of the depth of field range is the sum of the foreground depth of field and the back depth of field, the foreground depth of field is the difference between the average value and the first distance, the back depth of field is the difference between the second distance and the average value, the first distance is the minimum sample distance among the multiple sample distances, and the second distance is the maximum sample distance among the multiple sample distances.
10. The method according to claim 1, characterized in that The electronic device is an oral care device; wherein, The focal length of the camera is less than or equal to 2 mm, and the vertical field of view angle is greater than or equal to 45°; or, the maximum value of the preset care range is less than or equal to 20 cm.
11. The method according to claim 10, characterized in that The middle value of the preset care range ranges from 7.5 cm to 12.5 cm.
12. The method according to claim 1, characterized in that The determining, according to the target image, the care information corresponding to the personal care device comprises: The target image is input into a first recognition model, feature information corresponding to the target object in the target image is extracted through the first recognition model, and based on the feature information, care information corresponding to the personal care device is output; the first recognition model is obtained by training a first sample image set, and the first sample image set includes multiple first sample images and care information corresponding to the multiple first sample images respectively.
13. The method according to claim 1, characterized in that The determining, according to the target image, the care information corresponding to the personal care device comprises: Extracting a first image corresponding to the target object from the target image; The first image is input into a second recognition model, feature information of the first image is extracted through the second recognition model, and based on the feature information, care information corresponding to the personal care device is output.
14. The method according to claim 1, characterized in that The electronic device is an oral care device, which includes a handle and a care piece. The handle includes a free end and a connecting end relative to each other. The connecting end of the handle is connected to the care piece. The camera is set at a first position of the handle. The distance between the first position and the connecting end is smaller than the distance between the first position and the free end.
15. A nursing information visual recognition device, characterized in that: Applied to electronic equipment, the electronic equipment includes a camera, and the device includes: An acquisition module, used to acquire a target image obtained by the camera acquiring an image of a target object in an operation scenario corresponding to the personal care device; A determination module, configured to determine the care information corresponding to the personal care device according to the target image; Among them, in the operating scenario corresponding to the personal care device, the clarity of the target image of the target object obtained by the camera within the preset care range of the camera is higher than the clarity of the image obtained by the camera outside the preset care range of the camera.
16. An electronic device, characterized in that: It includes a camera, a memory and a processor, wherein the memory stores a computer program, and the processor is used to obtain a target image obtained by the camera capturing an image of a target object. When the computer program is executed by the processor, the processor implements any method as claimed in claims 1 to 14.
17. An electronic device, characterized in that: The electronic device includes a camera, a maximum value of a depth of field range corresponding to the camera is less than or equal to a first depth of field threshold, and the first depth of field threshold is related to a sample distance between the camera and a target object.
18. The electronic device according to claim 17, characterized in that: The first depth of field threshold is related to an average value of a plurality of sample distances between the camera and the target object.
19. The electronic device according to claim 18, characterized in that: The length of the depth of field range is the sum of the foreground depth of field and the back depth of field, the foreground depth of field is the difference between the average value and the first distance, the back depth of field is the difference between the second distance and the average value, the first distance is the minimum sample distance among the multiple sample distances, and the second distance is the maximum sample distance among the multiple sample distances.
20. The electronic device according to claim 17, characterized in that: The electronic device is an oral care device, and the first depth of field threshold is 20 centimeters.
21. The electronic device according to claim 17, characterized in that: The electronic device is an oral care device, the focal length of the camera is less than or equal to 2 mm, and the vertical field of view angle is greater than or equal to 45°.
22. The electronic device according to claim 21, characterized in that: The intermediate values of the depth of field range range from 7.5 cm to 12.5 cm.
23. The electronic device according to claim 17, characterized in that: The electronic device is an oral care device, which includes a handle and a care piece. The handle includes a free end and a connecting end relative to each other. The connecting end of the handle is connected to the care piece. The camera is set at a first position of the handle, and the distance between the first position and the connecting end is smaller than the distance between the first position and the free end.
24. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 14 is implemented.
Citation Information
Patent Citations
Image blurring method, image blurring device, mobile terminal and storage medium
CN108076286A
Image processing method, device and electronic apparatus
CN108230252A
Motion tracking of dental care implement
CN115398492A
Control method and device of oral cavity cleaning equipment, electronic equipment and storage medium
CN117918988A
