Hand cleaning method, intelligent lock and storage medium

Abstract

The invention discloses a hand cleaning method, an intelligent lock and a storage medium, and relates to the technical field of computer vision, in the method, when it is detected that a user enters a recognition range, the identity of the user is recognized according to palm vein features of the user, under the condition that recognition is passed, the palm bacterial content of the user is detected, and the bacterial content is obtained; acquiring a palm image of a user, and identifying dirt in the palm image to obtain the content of the dirt in the palm image; generating a bacterial dirt detection result by combining the bacterial content and the dirt content, and if the bacterial dirt detection result meets a preset condition, cleaning the hand of the user. Therefore, the problem that an existing intelligent lock cannot automatically clean the hands of the user is solved.

Description

Technical Field

[0001] The present application relates to the field of computer vision technology, and in particular to a hand cleaning method, a smart lock and a storage medium. Background Art

[0002] With the improvement of quality of life and the development of smart home technology, the functions of smart locks such as smart door locks are becoming more and more powerful, so more and more consumers choose smart door locks as important devices for home entrances. Smart door locks include multiple recognition methods, such as fingerprint recognition, facial recognition, and palm vein recognition. Existing palm vein recognition door locks require users to raise their hands within a certain distance range for 1 to 2 seconds, and then put down their hands after successful recognition before pulling the handle. When users come back from outdoors, they may bring some bacteria home. After contacting the door lock, the bacteria and dirt will be left on the handle, resulting in cross-infection of bacteria on the user's hands.

[0003] Due to the need for sterilization and disinfection, China Patent No. CN218324321U discloses a multi-fingerprint smart lock that can automatically disinfect and clean. The fingerprint sensor and cleaning slide cover are set on the handle to achieve the cleaning and disinfection of the fingerprint sensor. In actual use, only the fingerprint module of the lock is cleaned and disinfected, and the user's hands are not cleaned and disinfected, resulting in bacteria and dirt on the hands of users after returning home.

[0004] Therefore, there is an urgent need to solve the problem that current smart locks cannot automatically clean users' hands. Summary of the invention

[0005] The embodiments of the present application provide a hand cleaning method, a smart lock, and a storage medium, which can clean the hands of a user, thereby preventing the user from bringing bacteria and dirt on the hands back home.

[0006] To achieve the above objectives, the embodiments of the present application adopt the following technical solutions: A hand cleaning method is applied to a smart lock, the method comprising: when a user is detected to enter an identification range, identifying the user's identity according to the palm vein characteristics of the user, and if the identification is successful, detecting the bacterial content of the user's palm to obtain the bacterial content; Acquire a palm image of the user, and identify dirt in the palm image to obtain the dirt content in the palm image; A bacteria and dirt detection result is generated in combination with the bacteria content and the dirt content. If the bacteria and dirt detection result meets a preset condition, the user's hands are cleaned.

[0007] In combination with the first aspect, in a possible design, if the bacteria and dirt detection result meets a preset condition, controlling the cleaning module to clean the user's hands includes: If the bacteria content is greater than a first threshold or the dirt content is greater than a second threshold, cleaning the user's hands; If the bacteria content is greater than a third threshold and the dirt content is greater than a fourth threshold, cleaning the user's hands; The first threshold is greater than the third threshold, and the second threshold is greater than the fourth threshold.

[0008] In combination with the first aspect, in a possible design, the smart lock includes a sensing module, and the detecting that a user enters a recognition range includes: When the sensing module detects that the user enters the recognition range, it sends a first instruction to the main control module of the smart lock, so that the main control module controls the palm vein recognition module and the camera module deployed on the smart lock to turn on.

[0009] In combination with the first aspect, in a possible design, the user's identity is identified according to the palm vein feature of the user, and if the identification is successful, the bacterial content of the palm of the user is detected to obtain the bacterial content, including: Identifying the palm vein features of the user and matching the palm vein features with pre-recorded template features; When the match is successful, the bacterial content of the palm of the user is detected to obtain the bacterial content.

[0010] In combination with the first aspect, in a possible design, the smart lock includes a drive unit, a motor, and a solution storage bottle, and the cleaning of the user's hands includes: A second instruction is sent to the driving unit, wherein the second instruction is used for the driving unit to drive the motor to rotate to press the button of the solution storage bottle, so that the solution storage bottle releases the cleaning disinfectant to the user's hand.

[0011] In combination with the first aspect, in a possible design, the smart lock includes a light source transmitter and an image processing and analysis unit, and the detection of the bacterial content of the palm of the user to obtain the bacterial content includes: Start the light source transmitter to emit light toward the palm area of ​​the user; Processing the fluorescence data returned from the palm area by an image processing and analysis unit to obtain a fluorescence image; The bacteria in the fluorescent image are identified to obtain the bacterial content in the fluorescent image.

[0012] In combination with the first aspect, in a possible design manner, the method further includes: Regularly generate a health report of the user according to the detection result, wherein the health report includes a palm health curve of the user; A health indication is sent to the user based on the palm health curve.

[0013] In a second aspect, an embodiment of the present application provides a smart lock, the smart lock comprising: The sensing module is configured to send a first instruction to the main control module when detecting that a user enters the recognition range; A main control module is configured to control the palm vein recognition module and the camera module deployed on the smart lock to start in response to the first instruction; The palm vein recognition module is configured to recognize the identity of the user according to the palm vein characteristics of the user, and send a third instruction to the main control module when the recognition is successful, so that the main control module starts the bacteria detection module; The bacteria detection module is configured to detect the bacteria content of the palm of the user to obtain the bacteria content; The camera module obtains the palm image of the user, and identifies dirt in the palm image to obtain the dirt content in the palm image; The main control module is further configured to generate a bacteria and dirt detection result based on the bacteria content and the dirt content, and send a second instruction to the cleaning module if the bacteria and dirt detection result meets a preset condition; The cleaning module is configured to clean the user's hands in response to a second instruction.

[0014] In a third aspect, an embodiment of the present application provides a computer device, comprising a memory and a processor, wherein the memory stores a computer program, and the processor is configured to execute the method of the first aspect and possible design methods thereof by executing the computer program.

[0015] In a fourth aspect, an embodiment of the present application provides a storage medium, in which a computer program is stored, wherein the computer program is configured to execute the method of the first aspect and its possible design manner when running.

[0016] Compared with the prior art, the embodiments of the present application provide a hand cleaning method, a smart lock and a storage medium. In this method, when it is detected that a user enters the identification range, the user's identity is identified according to the user's palm vein characteristics. If the identification is passed, the bacterial content of the user's palm is detected to obtain the bacterial content; the user's palm image is obtained, and the dirt in the palm image is identified to obtain the dirt content in the palm image; the bacteria and dirt detection results are generated by combining the bacteria content and the dirt content. If the bacteria and dirt detection results meet the preset conditions, the user's hands are cleaned. This embodiment automatically identifies the hand hygiene status, combines identity recognition with hand cleaning without interfering with user identity verification, reduces the user's active operation steps, and thus improves the convenience and comfort of user use. The user only needs to enter the identification range, and the smart lock will automatically detect and start the cleaning program according to the situation, which not only saves time, but also avoids the situation where the handle is contaminated due to human negligence and failure to clean the hands in time.

[0017] Details of one or more embodiments of the present application are set forth in the following drawings and description to make other features, objects, and advantages of the present application more readily apparent. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings: Figure 1 A schematic diagram showing the hardware structure of a smart lock provided in an embodiment of the present application is shown; Figure 2 A flow chart of a hand cleaning method provided in an embodiment of the present application is shown; Figure 3 A flowchart of a user identity identification method provided by an embodiment of the present application is shown; Figure 4 A flow chart of a bacteria detection method provided in an embodiment of the present application is shown; Figure 5 A flow chart of a cleaning method provided in an embodiment of the present application is shown; Figure 6 A hardware structure block diagram of a computer device provided in an embodiment of the present application is shown; Figure 7 A schematic diagram of the structure of the front side of a smart door lock provided in an embodiment of the present application is shown; Figure 8 A schematic diagram showing the internal structure of a smart door lock provided in an embodiment of the present application is shown; Fig. 9A flow chart of a hand cleaning method for a smart door lock provided in an embodiment of the present application is shown.

[0019] In the accompanying drawings, 101, sensing module; 102, main control module; 103, palm vein recognition module; 104, bacteria detection module; 105, camera module; 106, cleaning module; 107, other modules; 701, outer shell cover; 702, injection hole; 703, detection and recognition window; 801, motor; 802, solution storage bottle. DETAILED DESCRIPTION

[0020] In order to more clearly understand the purpose, technical solutions and advantages of the present application, the present application is described and illustrated below in conjunction with the accompanying drawings and embodiments.

[0021] Unless otherwise defined, the technical terms or scientific terms involved in this application shall have the general meaning understood by people with general skills in the technical field to which this application belongs. The words "one", "a", "the", "these" and the like in this application do not indicate a quantitative limitation, and they may be singular or plural. The terms "include", "comprise", "have" and any variants thereof involved in this application are intended to cover non-exclusive inclusions; for example, a process, method and system, product or device comprising a series of steps or modules (units) is not limited to the listed steps or modules (units), but may include unlisted steps or modules (units), or may include other steps or modules (units) inherent to these processes, methods, products or devices. The words "connect", "connected", "coupled" and the like involved in this application are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. The "multiple" involved in this application refers to two or more. "And / or" describes the association relationship of associated objects, indicating that there may be three relationships, for example, "A and / or B" may mean: A exists alone, A and B exist at the same time, and B exists alone. Generally, the character " / " indicates that the objects associated with each other are in an "or" relationship. The terms "first", "second", "third", etc. in this application are only used to distinguish similar objects and do not represent a specific ordering of the objects.

[0022] The embodiment of the present application is applicable to unlocking scenarios where users authenticate their identities through palm vein recognition, such as cabinet locks, car locks, door locks, etc. The user raises his hand and stays for a period of time for the smart lock to identify the user's identity. After successful identification, the user's hand dirt and bacteria information is detected to obtain the test result. The test result includes the bacteria content of the user's palm and the dirt content of the palm. When the test result meets the preset conditions, the cleaning module deployed in the smart lock is controlled to automatically clean the user's hand. After the cleaning is completed, the user pulls the handle. When there are bacteria and dirt on the user's hand, it does not contact the handle. After the user's hand is cleaned, it contacts the handle again. Therefore, the embodiment of the present application avoids cross-infection caused by bacteria and dirt on the user's hand on the handle by cleaning the user's hand, and also avoids the bacteria and dirt on the user's hand after unlocking to pollute the environment (such as indoor environment, objects in the cabinet, car, etc.). By combining palm vein recognition, bacteria and dirt detection and automatic hand sterilization and disinfection, the problem of cross-infection caused by bacteria and dirt on the user's hand is solved more thoroughly.

[0023] The method provided in the embodiment of the present application can be applied to smart locks, including smart cabinet locks, smart car locks, smart door locks, etc. It is understandable that a smart lock is a lock that replaces a traditional mechanical lock with electronic technology and intelligent control. In addition to palm vein recognition and authentication, smart locks can also combine technologies such as fingerprint recognition, facial recognition, and voiceprint recognition to achieve user identity authentication. During the identity authentication process, the bacteria and dirt on the user's hands are detected, and the bacteria content and dirt content are combined to determine whether the user's palm is clean and healthy to reduce misjudgment. As an example, Figure 1 A schematic diagram showing the hardware structure of a smart lock provided in an embodiment of the present application is shown in FIG. Figure 1 As shown, the smart lock includes: a sensing module 101, a main control module 102, a palm vein recognition module 103, a bacteria detection module 104, a camera module 105, a cleaning module 106 and other modules 107. Each hardware module is described below.

[0024] The sensing module 101 is used to sense whether an object has entered the recognition range. If so, the sensing module 101 sends a first instruction to the main control module 102. The sensing module 101 may include but is not limited to a high-definition cat's eye camera, a radar sensing module, a biometric sensor, and an environmental monitoring sensor. In addition, the sensing module 101 can be installed on the front panel of the smart lock (i.e., the side facing the outside of the lock) to capture and record outdoor information (or information outside the vehicle, information outside the cabinet door, etc.) in real time, such as people entering and exiting, activity trajectories, etc.

[0025] The main control module 102 has three main functions. The first function is control and coordination, that is, receiving and processing input signals from various modules, such as user operation instructions from sensors, password keyboards, card readers, mobile phone applications (APPs), etc., and then performing corresponding processing and operations according to the preset program to coordinate the work between the various components of the smart lock. The second function is power management, specifically controlling the power on and off of each module. For example, in response to the first instruction, the palm vein recognition module 103 and the camera module 105 are controlled to power on, so that the palm vein recognition module 103 and the camera module 105 are started synchronously. The third function of the main control module 102 is security and protection, identity authentication, encryption and decryption, data storage, local communication, etc.

[0026] The palm vein recognition module 103 is controlled by the main control module 102. It obtains the palm vein features of the user by performing feature extraction processing on the palm image collected in the recognition area, and identifies whether the user's identity matches based on the palm vein features. If a match is found, the smart lock is controlled to open.

[0027] The bacteria detection module 104 is controlled by the main control module 102 and is used to detect the bacteria content in the palm of the user. The bacteria detection module 104 includes a light source emitter and an image analysis processing unit. The light source emitter is used to emit light to the palm area of ​​the user, and the light causes the bacteria in the palm area to emit fluorescence. The image analysis processing unit collects the fluorescence and forms an image, identifies the bacteria in the fluorescence image, and obtains the bacteria content in the fluorescence image.

[0028] The camera module 105 is controlled by the main control module 102, and can scan the palm for image recognition processing to detect the dirt content of the user's palm. As an example, the camera module 105 includes a cat's eye and an image processing unit.

[0029] The cleaning module 106 can clean the user's hands, and its cleaning methods include but are not limited to: spraying disinfectant, disinfectant foam, hand sanitizer, irradiating ultraviolet rays, etc. It should be noted that the cleaning module 106 automatically turns on when it detects that the bacteria content and dirt content of the user's hands meet the preset conditions, without the need for manual operation by the user. The cleaning process is fully automated, and the intelligent experience is better.

[0030] Other modules 107 include but are not limited to: WIFI module, Bluetooth module, voice module, fingerprint recognition module, etc. For these modules, please refer to the introduction of related technologies, and no redundant description is given here.

[0031] It can be understood by those skilled in the art that Figure 1 The structure shown is only for illustration and does not limit the structure of the smart lock. Figure 1 More or fewer components as shown, or with Figure 1By way of example and not limitation, a proximity sensor module may be added to the door body (or cabinet), and the proximity sensor module is configured to generate a wake-up signal when detecting an approaching object entering the sensing area to control the main control module to open. Alternatively, other modules 107 may be reduced in the smart lock.

[0032] Below, taking the smart lock that is a smart door lock as an example, combined with the smart door lock including the above-mentioned modules, a hand cleaning method provided in an embodiment of the present application is described. Figure 2 A flow chart of a hand cleaning method provided in an embodiment of the present application is shown. Figure 2 As shown, the method includes steps S201 to S204.

[0033] Step S201: When the sensing module detects that the user enters the recognition range, the palm vein recognition module and the camera module deployed on the smart door lock are controlled to start.

[0034] The sensing module 101 can be installed on the door body or on the wall outside the door. The installation position of the sensing module 101 is based on the ability to detect the entry and exit of people within the recognition range. The sensing module 101 can include but is not limited to a high-definition cat-eye camera, a radar sensing module, a biometric sensor, and an environmental monitoring sensor.

[0035] In some embodiments, the sensing module 101 includes a radar sensing module, and step S201 further includes: when the radar sensing module detects that a user enters the identification range, sending a first instruction to the main control module 102 of the smart door lock, so that the main control module 102 controls the palm vein recognition module 103 and the camera module 105 deployed on the smart door lock to turn on.

[0036] In this embodiment, the sensing module 101 is a radar sensing module. When a user (or object) approaches the smart door lock and maintains a relative period of time, the radar sensing module is awakened and sends a first instruction to the main control module. The first instruction is used to indicate that a user is detected entering the identification range.

[0037] The palm vein recognition module 103 and the camera module 105 are electrically connected to the main control module respectively. When a user is detected, the palm vein recognition module 103 and the camera module 105 are in a closed state, thereby saving power. When the main control module receives the first instruction, the main control module powers on the palm vein recognition module 103 and the camera module 105 respectively, so that the palm vein recognition module 103 and the camera module 105 are controlled to be turned on.

[0038] In some embodiments, the palm vein recognition module 103 and the camera module 105 are started at the same time, so that the process of detecting bacteria and dirt on the hand is more synchronized. After the palm vein recognition module 103 and the camera module 105 are controlled to be turned on, the identification of the user's identity and the identification of dirt on the user's palm can be performed simultaneously, that is, after step S201, step S202 and step S203 can be executed respectively.

[0039] In other embodiments, after the camera module 105 is started, it will not immediately identify the dirt on the palm of the user, but will identify the dirt on the palm of the user after the palm vein recognition module 103 passes the user's identity authentication, which can reduce unnecessary image processing links. In other words, step S203 can be executed when the user's identity authentication passes, so that only the dirt on the palm of the user who has passed the identity authentication can be identified to reduce power consumption.

[0040] Step S202: Identify the user's identity according to the palm vein characteristics of the user. If the identification is successful, start the bacteria detection module to detect the bacteria content of the user's palm to obtain the bacteria content.

[0041] This step uses palm vein recognition, that is, the user raises his hand and stays in the detection and recognition window, and the palm vein recognition module 103 in the smart door lock recognizes the palm in the detection and recognition window area. If the recognition is successful, the bacteria detection module 104 will be activated to detect the bacteria content of the user's palm when the user raises his hand and stays. Among them, the detection and recognition window is the middle front area of ​​the smart door lock.

[0042] In some embodiments, when the user raises his hand, the palm is open and roughly parallel to the smart door lock, so that the palm vein recognition module 103 can obtain the palm vein characteristics of the user. In other embodiments, the user's hand is in a posture of holding the door handle, with the palm facing the door handle, and the palm vein recognition module 103 collects a picture of the user's palm (a local palm vein image) and extracts the user's palm vein characteristics from the palm picture. In the above two implementations, there is no contact between the user's palm and the handle, so the bacteria and dirt on the user's hand will not be transferred to the handle, so only the user's hand needs to be cleaned, and there is no need to clean the handle. One cleaning can prevent the bacteria and dirt on the user's hand from contaminating the handle, and can also prevent the user from bringing bacteria and dirt back into the room.

[0043] In some embodiments, such as Figure 3 As shown, step S202 further includes step S301 to step S302.

[0044] Step S301: Identify the palm vein features of the user through a palm vein recognition module, and match the palm veins with pre-recorded template features.

[0045] The template feature can be set by the user on the application of the mobile terminal, and the palm vein image of the user can be input as the template feature of the user.

[0046] In this step, the palm vein recognition module 103 includes an optical acquisition system, an image processing chip, and a feature extraction storage module. The optical acquisition system emits infrared light to illuminate the palm veins. The image processing chip uses the absorption characteristics of hemoglobin to near-infrared rays to obtain the image of the palm veins. The feature extraction storage module matches the extracted palm vein features with the template features stored in the system to perform personal identification. Specifically, the texture of each person's palm veins is unique, which makes the palm vein recognition technology have extremely high recognition accuracy and anti-counterfeiting performance; only need to place the palm on the recognition device, no contact is required to complete the identity verification, the operation is simple and fast, and the hygiene is good, reducing the risk of cross infection, in line with modern hygiene requirements; at the same time, the palm vein is hidden inside the palm, not easy to be forged or copied, compared with other biometric technologies, such as fingerprint recognition and face recognition, it has higher security and can effectively prevent identity theft.

[0047] Step S302: When the match is successful, the bacteria detection module is started to detect the bacteria content of the user's palm to obtain the bacteria content.

[0048] The bacteria detection module 104 includes a light source transmitter and an image processing and analysis unit, and mainly uses optical principles to detect bacteria. Specifically, the light source transmitter emits a specific light source to the user's palm, causing the bacteria on the palm to emit specific fluorescence. The image processing and analysis unit calculates the bacterial content of the palm through an image recognition algorithm.

[0049] In some embodiments, such as Figure 4 As shown, step S302 includes steps S401 to S403.

[0050] Step S401: Start the light source transmitter to emit light toward the palm area of ​​the user.

[0051] Step S402: The fluorescence data returned from the palm area is processed by the image processing and analysis unit to obtain a fluorescence image.

[0052] Step S403: Identify the bacteria in the fluorescent image to obtain the bacterial content in the fluorescent image.

[0053] In this embodiment, the fluorescence emitted by the bacteria is processed by the image processing and analysis unit and then imaged to obtain a fluorescence image. The image processing and analysis unit identifies the bacteria in the fluorescence image and obtains the bacterial content. The bacterial content may be the area ratio of the fluorescent area in the fluorescence image to the palm area. The larger the area ratio, the higher the bacterial content, indicating that the hands are more dirty; the smaller the area ratio, the lower the bacterial content, indicating that the hands are more clean.

[0054] Through the above step S202, the embodiment of the present application identifies the identity of the user, and if the identification is successful, the bacterial content on the user's hands is detected so that the subsequent steps can determine whether the bacterial content on the user's hands exceeds the standard.

[0055] Step S203: obtaining a palm image of the user through a camera module, and identifying dirt in the palm image to obtain the dirt content in the palm image.

[0056] The camera module 105 includes a cat's eye and an image processing unit. The camera module 105 can scan the palm for image recognition processing, capture and determine whether there is dirt on the palm, so as to determine whether the dirt content of the user's hand exceeds the standard in the subsequent step.

[0057] Step S204: Generate a bacteria and dirt detection result based on the bacteria content and the dirt content. If the bacteria and dirt detection result meets a preset condition, control the cleaning module to clean the user's hands.

[0058] In this step, the preset conditions are used to determine whether the bacteria and dirt on the user's hands exceed the standard. If the bacteria and dirt detection result meets the preset conditions, it means that the bacteria and dirt on the hands exceed the standard, otherwise it means that the bacteria and dirt on the hands do not exceed the standard. In the case that the bacteria and dirt exceed the standard, the user's hands are cleaned.

[0059] It is worth mentioning that in this step, it is considered that determining whether the user's hands are clean only by the bacteria content or only by the dirt content is prone to misjudgment. Therefore, the bacteria detection module 104 and the camera module 105 are used in combination, and the cleanliness and health of the user's palms are determined based on the results of the two, which reduces misjudgment and improves detection accuracy.

[0060] Specifically, Figure 5 As shown, step S204 includes: step S501 to step S502.

[0061] Step S501: If the bacteria content is greater than a first threshold or the dirt content is greater than a second threshold, the cleaning module is controlled to clean the user's hands.

[0062] Step S502: If the bacteria content is greater than the third threshold and the dirt content is greater than the fourth threshold, control the cleaning module to clean the user's hands; wherein the first threshold is greater than the third threshold, and the second threshold is greater than the fourth threshold.

[0063] It can be seen from step S502 that when it is detected that the bacteria content and the dirt content simultaneously meet the threshold, the user's hands are cleaned; otherwise, it is recorded that the user's palms are clean and healthy.

[0064] When the bacteria content is greater than the first threshold or the dirt content is greater than the second threshold, the user's hands only need to be cleaned if either condition is met.

[0065] For example, the first threshold and the second threshold may be 0.7, and the third threshold and the fourth threshold may be set to 0.3. When any value of the bacteria content and the dirt content is greater than 0.7, the user's hands are cleaned, but if the bacteria content or the dirt content is between 0.3 and 0.7, the user's hands are cleaned only when both the bacteria content and the dirt content are greater than 0.3. This method of setting two thresholds for the bacteria content and the dirt content respectively reduces the misjudgment of the cleanliness and health of the user's palms and improves the detection accuracy.

[0066] In this embodiment, the cleaning method for the user's hands includes but is not limited to: a solution storage bottle or an ultraviolet lamp is built into the smart door lock to control the solution storage bottle to spray disinfectant or disinfectant foam, or to control the ultraviolet lamp to irradiate ultraviolet rays.

[0067] As an example, the cleaning module 106 includes a driving unit, a motor, and a solution storage bottle. Controlling the cleaning module 106 to clean the user's hands includes: sending a second instruction to the driving unit, the second instruction is used for the driving unit to drive the motor to rotate to press the button of the solution storage bottle, so that the solution storage bottle releases the cleaning disinfectant to the user's hands.

[0068] In this step, the driving unit (ie, the motor) rotates and drives the push rod, so that the push rod presses the button of the solution storage bottle, causing the solution storage bottle to spray out the corresponding liquid (ie, the cleaning disinfectant).

[0069] Through the above steps S201 to S204, the embodiment of the present application provides a hand cleaning method for a smart door lock, which is applied to a smart door lock, and the smart door lock includes a sensing module 101, a palm vein recognition module 103, a camera module 105, and a bacteria detection module 104. When the sensing module 101 detects that the user enters the recognition range, the palm vein recognition module 103 and the camera module 105 deployed on the smart door lock are controlled to start. The user's identity is identified according to the palm vein characteristics of the user. If the identification is passed, the bacteria detection module 104 is started to detect the bacterial content of the user's palm to obtain the bacterial content. The user's palm image is obtained through the camera module 105, and the dirt in the palm image is identified to obtain the dirt content in the palm image. The bacteria and dirt detection results are generated in combination with the bacteria content and the dirt content. If the bacteria and dirt detection results meet the preset conditions, the cleaning module 106 is controlled to clean the user's hands. This embodiment automatically identifies the hand hygiene status, combines identity recognition with hand cleaning without interfering with user identity verification, reduces the user's active operation steps, and thus improves the convenience and comfort of user use. The user only needs to enter the recognition range, and the smart door lock will automatically detect and start the cleaning program according to the situation, which not only saves time, but also avoids the situation where the handle and indoor hygiene are contaminated due to human negligence and failure to clean the hands in time.

[0070] The embodiment of the present application also provides a computer device, Figure 6 FIG. 1 shows a hardware structure block diagram of a computer device provided in an embodiment of the present application. Figure 6 As shown, the computer device may include one or more ( Figure 6 Only one is shown in the figure) processor 602, and memory 604 for storing data. Processor 602 may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA. The above-mentioned computer device may also include a transmission device 606 and an input and output device 608 for communication functions. It can be understood by those skilled in the art that Figure 6 The structure shown is only for illustration and does not limit the structure of the above-mentioned computer device. Figure 6 More or fewer components as shown, or with Figure 6 Different configurations are shown.

[0071] The memory 604 can be used to store computer programs, for example, software programs and modules of application software. The processor 602 executes various functional applications and data processing by running the computer programs stored in the memory 604, that is, to implement the above method. The memory 604 can be used to store data, such as template features, etc. The memory 604 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 604 may further include a memory remotely arranged relative to the processor 602, and these remote memories may be connected to the computer device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0072] The transmission device 606 is used to receive or send data via a network. The specific example of the above network may include a wireless network provided by a communication provider of the computer device. In one example, the transmission device 606 includes a network adapter (Network Interface Controller, referred to as NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device 606 can be a radio frequency (Radio Frequency, referred to as RF) module, which is used to communicate with the Internet wirelessly.

[0073] Optionally, in this embodiment, the processor may be configured to execute the following steps S1 to S4 through a computer program.

[0074] S1. When the sensing module detects that the user enters the recognition range, the palm vein recognition module and the camera module deployed on the smart door lock are controlled to start.

[0075] S2. Identify the user's identity according to the palm vein characteristics of the user. If the identification is successful, start the bacteria detection module to detect the bacteria content of the user's palm to obtain the bacteria content.

[0076] S3. Acquire the palm image of the user through the camera module, identify the dirt in the palm image, and obtain the dirt content in the palm image.

[0077] S4. Generate a bacteria and dirt detection result based on the bacteria content and the dirt content. If the bacteria and dirt detection result meets a preset condition, control the cleaning module to clean the user's hands.

[0078] The present application also provides a smart door lock, including: The sensing module 101 is configured to send a first instruction to the main control module 102 when detecting that a user enters the recognition range; The main control module 102 is configured to control the palm vein recognition module 103 and the camera module 105 deployed on the smart door lock to start in response to the first instruction; The palm vein recognition module 103 is configured to recognize the identity of the user according to the palm vein characteristics of the user, and if the recognition is successful, send a third instruction to the main control module 102 so that the main control module 102 starts the bacteria detection module 104; The bacteria detection module 104 is configured to detect the bacteria content of the palm of the user to obtain the bacteria content; The camera module 105 obtains the user's palm image, and identifies the dirt in the palm image to obtain the dirt content in the palm image; The main control module 102 is further configured to generate a bacteria and dirt detection result based on the bacteria content and the dirt content, and send a second instruction to the cleaning module 106 if the bacteria and dirt detection result meets a preset condition; The cleaning module 106 is configured to clean the user's hands in response to the second instruction.

[0079] Figure 7 The figure shows a schematic diagram of the front structure of a smart door lock provided by an embodiment of the present application. Figure 7 As shown, the smart door lock includes a housing cover 701, a spray hole 702, and a detection and identification window 703. When the user places his palm on the detection and identification window 703, the smart door lock identifies the user based on the palm vein characteristics of the user's palm, and if the identification passes, the smart door lock detects the cleanliness and health of the user's hand. If the detection result of bacteria and dirt on the hand meets the preset conditions, the cleaning disinfectant will be sprayed from the spray hole 702 to clean the user's hand.

[0080] Figure 8 FIG. 1 shows a schematic diagram of the internal structure of a smart door lock provided in an embodiment of the present application. Figure 8 As shown, the smart door lock also includes a motor 801, a solution storage bottle 802, a palm vein recognition module 103 and a bacteria detection module 104. The solution storage bottle 802 can store, but is not limited to: hand sanitizer, disinfectant, etc. When the bacteria detection module 104 detects that the bacteria exceeds the first threshold, the main control module will send a command to start the motor 801, and the motor rotation drives the push rod to press the spray button of the solution storage bottle 802, thereby spraying the corresponding liquid. Figure 7 and Figure 8 For an introduction to other hardware modules not covered, refer to Figure 1 and related instructions.

[0081] The method provided in the embodiment of the present application is introduced below with a specific example. Fig. 9 As shown, it shows a flow chart of a hand cleaning method for a smart door lock provided in an embodiment of the present application, the method comprising: S901. Use mobile terminal APP to set up the anti-virus spray system.

[0082] Specifically, the user can turn on, turn off or set the anti-virus spray function in the APP. For example, if the number of times of spraying liquid is set to twice, the motor drives the push rod to press the spray button of the solution storage bottle 802 twice.

[0083] S902: When a person returns home, the radar detects that the person is approaching.

[0084] For an introduction to this step, please refer to the above step S201.

[0085] S903, start the palm vein recognition module, and when the palm information is successfully matched, execute step S904.

[0086] S904: Start the bacteria detection module to detect the bacteria content in the palm.

[0087] S905: Determine whether the bacterial content is greater than a first threshold.

[0088] S906: Start the camera module to capture a palm image.

[0089] S907. Determine the dirt content of the palm of the corresponding person through image recognition analysis.

[0090] S908: Determine whether the dirt content is greater than a second threshold.

[0091] If the bacteria content is greater than the first threshold, or the dirt content is greater than the second threshold, execute S910, otherwise, execute S909.

[0092] S909: If the bacteria content is greater than the third threshold and the dirt content is greater than the fourth threshold, execute S910; otherwise, execute S911.

[0093] S910, start the cleaning module. After S910, execute S912.

[0094] S911. Record information about whether the user's palms are clean and healthy.

[0095] S912. According to the instruction, the motor rotates to press the spray button of the solution storage bottle to spray out the solution stored in the bottle.

[0096] This instruction is equivalent to the second instruction above. After S912, S913 is executed.

[0097] S913. Record information about whether the user's palms are dirty and unhealthy.

[0098] Through the methods provided by S901 to S913, the smart door lock can not only clean the user's hands when the user unlocks the door, but also record the cleanliness and health of the user's palms. As an example, the clean and healthy information can be transmitted to the user's mobile terminal (such as a mobile phone), and a health report can be regularly generated in the APP of the mobile terminal, and the cleanliness and health of the user's hands can be presented in the form of a health curve. If the user's hands are frequently unclean and unhealthy (such as the user cleans his hands every time he unlocks the door), the user is reminded to pay attention to health instructions such as cleaning, maintaining hygiene, and washing hands frequently to reduce the spread of diseases and protect the health of himself and his family.

[0099] In addition, in combination with the method provided in the above embodiments, a storage medium may be provided in this embodiment to implement the method. The storage medium stores a computer program; when the computer program is executed by a processor, any one of the hand cleaning methods of the smart door lock in the above embodiments is implemented.

[0100] The embodiment of the present application also provides a computer program product. When the computer program product is run on a computer, the computer executes each function or step executed by the processor in the above method embodiment.

[0101] It should be understood that the specific embodiments described herein are only used to explain the application, rather than to limit it. Based on the embodiments provided in this application, all other embodiments obtained by ordinary technicians in this field without creative work are within the protection scope of this application.

[0102] Obviously, the drawings are only some examples or embodiments of the present application. For ordinary technicians in the field, the present application can also be applied to other similar situations based on these drawings without creative work. In addition, it is understandable that although the work done in this development process may be complicated and lengthy, for ordinary technicians in the field, certain changes in design, manufacturing or production based on the technical content disclosed in this application are only conventional technical means and should not be regarded as insufficient content disclosed in this application.

[0103] The term "embodiment" in this application refers to a specific feature, structure or characteristic described in conjunction with the embodiment that can be included in at least one embodiment of the present application. The appearance of this phrase in various locations in the specification does not necessarily mean the same embodiment, nor does it mean that it is mutually exclusive with other embodiments and is independent or optional. It is clearly or implicitly understood by those of ordinary skill in the art that the embodiments described in this application can be combined with other embodiments without conflict.

[0104] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of patent protection. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the scope of protection of the present application. Therefore, the scope of protection of the present application shall be subject to the attached claims.

Claims

1. A method for cleaning hands, characterized in that: Applied to a smart lock, the method comprises: When it is detected that a user enters the identification range, the identity of the user is identified according to the palm vein characteristics of the user, and if the identification is successful, the bacterial content of the palm of the user is detected to obtain the bacterial content; Acquire a palm image of the user, and identify dirt in the palm image to obtain the dirt content in the palm image; A bacteria and dirt detection result is generated in combination with the bacteria content and the dirt content. If the bacteria and dirt detection result meets a preset condition, the user's hands are cleaned.

2. The hand cleaning method according to claim 1, characterized in that: If the bacteria and dirt detection result meets the preset condition, controlling the cleaning module to clean the user's hands includes: If the bacteria content is greater than a first threshold or the dirt content is greater than a second threshold, cleaning the user's hands; If the bacteria content is greater than a third threshold and the dirt content is greater than a fourth threshold, cleaning the user's hands; The first threshold is greater than the third threshold, and the second threshold is greater than the fourth threshold.

3. The hand cleaning method according to claim 1, characterized in that: The smart lock includes a sensing module, and the detection of a user entering a recognition range includes: When the sensing module detects that the user enters the recognition range, it sends a first instruction to the main control module of the smart lock, so that the main control module controls the palm vein recognition module and the camera module deployed on the smart lock to turn on.

4. The hand cleaning method according to claim 1, characterized in that: The identification of the user according to the palm vein feature of the user, and if the identification is successful, detecting the bacterial content of the palm of the user to obtain the bacterial content, includes: Identifying the palm vein features of the user and matching the palm vein features with pre-recorded template features; When the match is successful, the bacterial content of the palm of the user is detected to obtain the bacterial content.

5. The hand cleaning method according to claim 1, characterized in that: The smart lock includes a driving unit, a motor and a solution storage bottle, and the cleaning of the user's hands includes: A second instruction is sent to the driving unit, wherein the second instruction is used for the driving unit to drive the motor to rotate to press the button of the solution storage bottle, so that the solution storage bottle releases the cleaning disinfectant to the user's hand.

6. The hand cleaning method according to claim 1 or claim 4, characterized in that: The smart lock includes a light source transmitter and an image processing and analysis unit. The detection of the bacterial content of the palm of the user to obtain the bacterial content includes: Start the light source transmitter to emit light toward the palm area of ​​the user; Processing the fluorescence data returned from the palm area by an image processing and analysis unit to obtain a fluorescence image; The bacteria in the fluorescent image are identified to obtain the bacterial content in the fluorescent image.

7. The hand cleaning method according to claim 1, characterized in that: The method further comprises: Regularly generate a health report of the user according to the detection result, wherein the health report includes a palm health curve of the user; A health reminder is sent to the user based on the palm health curve.

8. A smart lock, characterized in that: The smart lock comprises: The sensing module is configured to send a first instruction to the main control module when detecting that a user enters the recognition range; A main control module is configured to control the palm vein recognition module and the camera module deployed on the smart lock to start in response to the first instruction; The palm vein recognition module is configured to recognize the identity of the user according to the palm vein characteristics of the user, and send a third instruction to the main control module when the recognition is successful, so that the main control module starts the bacteria detection module; The bacteria detection module is configured to detect the bacteria content of the palm of the user to obtain the bacteria content; The camera module obtains the palm image of the user, and identifies dirt in the palm image to obtain the dirt content in the palm image; The main control module is further configured to generate a bacteria and dirt detection result based on the bacteria content and the dirt content, and send a second instruction to the cleaning module if the bacteria and dirt detection result meets a preset condition; The cleaning module is configured to clean the user's hands in response to a second instruction.

9. A computer device, characterized in that: include: A memory and a processor, wherein the memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the processor executes the hand cleaning method according to any one of claims 1 to 7 by executing the computer instructions.

10. A storage medium, characterized in that: The storage medium stores a computer program, wherein the computer program is configured to execute the hand cleaning method according to any one of claims 1 to 7 when executed.

Images