Smart door lock control method and device

Abstract

A smart door lock control method and a device, relating to the technical field of smart door locks. The method comprises: a smart door lock being unlocked on the basis of acquired first information; when it is determined that there is a person entering a door, determining user identity information corresponding to the first information or determining user identity information of the person entering the door; if a user corresponding to the user identity information is one of users in user information, acquiring door entering states of all the users in the user information, wherein the user information comprises user identity information of at least one user, and face feature information of the at least one user is stored in the smart door lock; and if it is determined, on the basis of the door entering states of all the users in the user information, that all the users in the user information have entered the door, disabling a face recognition function of the smart door lock, thereby reducing the power consumption of the smart door lock.

Description

Intelligent door lock control method and device

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on February 22, 2024, with application number 202410199330.1 and application name “A Smart Door Lock Control Method and Device”, the entire contents of which are incorporated by reference into this application. Technical Field

[0003] The embodiments of the present application relate to the technical field of smart door locks, and in particular to a smart door lock control method and device. Background Art

[0004] The application of smart door locks is becoming more and more common. They integrate functions such as screen display, fingerprint unlocking, and face recognition unlocking, bringing convenience to users' lives.

[0005] For smart door locks that support facial recognition unlocking, when the passive infrared (PIR) detector detects a person approaching the door lock, it activates the camera to capture and recognize the person's face. In some cases, the facial recognition process may be mistakenly activated, resulting in higher power consumption for the smart door lock. For example, whenever someone passes in front of the smart door lock, the camera used to capture the face image is activated, increasing the power consumption of the smart door lock.

[0006] Summary of the Invention

[0007] The embodiments of the present application provide a smart door lock control method and device for saving power consumption of the smart door lock.

[0008] In a first aspect, a smart door lock control method is provided, which is applied to a smart door lock, the method comprising: unlocking according to acquired first information; after determining that someone has entered the door, determining the user identity information corresponding to the first information or determining the user identity information of the person entering the door; if the user corresponding to the user identity information belongs to the user in the user information, obtaining the entry status of all users in the user information, wherein the user information includes the user identity information of at least one user, and the facial feature information of the at least one user is stored in the smart door lock; if it is determined that all users in the user information have entered the door according to the entry status of all users in the user information, turning off the face recognition function of the smart door lock.

[0009] In the above implementation, after the smart door lock is successfully unlocked, it can identify the user entering the door. If it is determined based on the user's identity information that the user has stored facial features in the smart door lock, the smart door lock will further determine whether all users who have stored facial features in the smart door lock have entered the door. If so, the smart door lock's facial recognition function will be disabled. After that, if the smart door lock's PIR detector or other device detects a person approaching, the smart door lock will not activate the camera to capture facial images for facial recognition, thereby saving power consumption.

[0010] In one possible implementation, determining that someone has entered the door includes: triggering a first detection device to perform detection; and determining whether someone has entered the door based on detection information from the first detection device. The above implementation can improve the reliability of smart door lock control.

[0011] In a possible implementation, the first detection device is a time of flight (TOF) sensor.

[0012] In one possible implementation, obtaining the entry status of all users in the user information includes: updating the entry status information corresponding to the user identity information in the user information; and determining the entry status of all users in the user information based on the entry status information corresponding to the user identity information in the updated user information.

[0013] In one possible implementation, determining the user identity information of the person entering the door includes: sending a first request to a server in the whole-house smart system, the first request being used to request obtaining the user identity information of the person entering the door within a first time period after unlocking the smart door lock, and the whole-house smart system including the smart door lock; receiving the user identity information from the server; if the user identity information from the service includes n user identity information, then determining whether the users corresponding to the n user identity information are the users in the user information, where n is an integer greater than or equal to 2; if m users corresponding to m user identity information in the n user identity information are the users in the user information, then updating the entry status of the m users in the user information, where m is an integer greater than or equal to 1 and less than or equal to n.

[0014] Correspondingly, obtaining the door entry status of all users in the user information may include: obtaining the door entry status information corresponding to the identity information of all users in the updated user information, and determining the door entry status of all users in the user information.

[0015] The above implementation method can improve the reliability or precision of smart door lock control.

[0016] In one possible implementation, the first information is biometric information; and determining the user identity information corresponding to the first information includes: determining the user identity information corresponding to the first information based on a correspondence between the biometric information and the user identity information.

[0017] In one possible implementation, the first information is password information, and the password information of different users is different; determining the user identity information corresponding to the first information includes: determining the user identity information corresponding to the first information based on the correspondence between the password information and the user identity information.

[0018] In one possible implementation, the first information is access control information obtained from a near field communication (NFC) device, and the access control information stored in different NFC devices is different; determining the user identity information corresponding to the first information includes: determining the user information corresponding to the first information based on the correspondence between the access control information and the user identity.

[0019] In one possible implementation, after turning off the face recognition function of the smart door lock, it also includes: when it is determined that a user has gone out based on the door opening and closing events detected by the smart door lock, restoring the face recognition function of the smart door lock; and updating the entry status of all users in the user information.

[0020] In one possible implementation, after turning off the face recognition function of the smart door lock, it also includes: when it is determined that someone has gone out based on the door opening and closing events detected by the smart door lock, obtaining the user identity information of the person going out; if the user corresponding to the user identity information belongs to the user in the user information, restoring the face recognition function of the smart door lock; and updating the corresponding entry status information in the user information based on the user identity information of the person going out.

[0021] In one possible implementation, obtaining the user identity information of the person going out includes: sending a second request to the server, wherein the second request is used to request obtaining the user identity information of the user who went out during the time period of the door opening event and the door closing event detected by the smart door lock; and receiving the user identity information from the server.

[0022] In a second aspect, a smart door lock control method is provided, which is applied to a smart door lock in a whole-house smart system, wherein the whole-house smart system also includes a server, and the method includes: after unlocking the smart door lock and determining that someone has entered the door, sending a first request to the server, wherein the first request is used to request to obtain the user identity information of the person entering the door; receiving the user identity information from the server; if the user corresponding to the user identity information belongs to the user in the user information, obtaining the entry status of all users in the user information; wherein the user information includes the user identity information of at least one user, and the facial feature information of the at least one user is stored in the smart door lock; if it is determined that all users in the user information have entered the door based on the entry status of all users in the user information, then turning off the face recognition function of the smart door lock.

[0023] In the above implementation, after the smart door lock is successfully unlocked, it can identify the user entering the door. If the user's identity information determines that the user has stored facial features in the smart door lock, the smart door lock will further determine whether all users who have stored facial features in the smart door lock have entered the door. If so, the smart door lock's facial recognition function will be disabled. After that, if the smart door lock's PIR detector detects someone approaching, the smart door lock will not activate the camera to capture facial images for facial recognition, thereby saving power consumption.

[0024] In a possible implementation, the determining whether someone enters the door includes: triggering a first detection device to perform detection; and determining whether someone enters the door based on detection information of the first detection device.

[0025] In a possible implementation, the first detection device is a TOF sensor.

[0026] In one possible implementation, obtaining the entry status of all users in the user information includes: updating the corresponding entry status information in the user information based on the user identity information from the server; and determining the entry status of all users in the user information based on the entry status information corresponding to all user identity information in the updated user information.

[0027] In one possible implementation, after turning off the face recognition function of the smart door lock, it also includes: when it is determined that someone has gone out based on the door opening and closing events detected by the smart door lock, restoring the face recognition function of the smart door lock; and updating the entry status information of all user identity information in the user information.

[0028] In one possible implementation, after turning off the face recognition function of the smart door lock, it also includes: when it is determined that someone has gone out based on the door opening and closing events detected by the smart door lock, obtaining the user identity information of the person going out; if the user corresponding to the user identity information belongs to the user in the user information, restoring the face recognition function of the smart door lock; and updating the corresponding entry status information in the user information based on the user identity information of the person going out.

[0029] In one possible implementation, obtaining the user identity information of the person going out includes: sending a second request to the server, wherein the second request is used to request obtaining the user identity information of the person going out within the time period of the door opening event and the door closing event detected by the smart door lock; and receiving the user identity information from the server.

[0030] In a third aspect, a method for obtaining user identity information is provided, which is applied to a server in a whole-house smart system, wherein the whole-house smart system includes a smart door lock. The method includes: receiving a first request from the smart door lock, wherein the first request is used to request obtaining user identity information of a person entering the door; in response to the first request, obtaining second information collected by a device in the whole-house smart system within a first time period after the smart door lock is unlocked, and determining the user identity information of the person entering the door within the first time period based on the second information; and sending the user identity information to the smart door lock.

[0031] In one possible implementation, obtaining the second information collected by the devices in the whole-house smart system within the first time period after the smart door lock is unlocked includes: obtaining the image collected by the first camera in the whole-house smart system within the first time period; determining the user identity information of the person entering the door within the first time period based on the second information includes: performing image recognition on the image, and determining the user identity information of the person entering the door within the first time period based on the image recognition result.

[0032] In one possible implementation, the obtaining of the second information collected by the devices in the whole-house smart system within the first time period after the smart door lock is unlocked includes: obtaining information of the device that creates a connection detected by the routing device in the whole-house smart system within the first time period; and determining the user identity information of the person who enters the door within the first time period based on the second information includes: determining the corresponding user identity information based on the information of the disconnected device.

[0033] In one possible implementation, the obtaining of the second information collected by the devices in the whole-house smart system within the first time period after the smart door lock is unlocked includes: obtaining the fingerprint information collected by the control panel in the whole-house smart system within the first time period; the determining of the user identity information of the person entering the door within the first time period based on the second information includes: determining the corresponding user identity information based on the fingerprint information collected by the control panel within the first time period.

[0034] In a fourth aspect, a whole-house smart system is provided, comprising a smart door lock and a server; the smart door lock is used to implement the method described in any one of the first aspects, or to execute the method described in any one of the second aspects; the server is used to implement the method described in any one of the third aspects.

[0035] In a fifth aspect, a device is provided, such as a smart door lock, comprising a unit or module for executing any of the methods described in the first aspect, or comprising a unit or module for executing any of the methods described in the second aspect.

[0036] In a sixth aspect, a device is provided, such as a server, comprising a unit or module for executing any method described in the third aspect.

[0037] In the seventh aspect, a smart door lock is provided, comprising: one or more processors, wherein the one or more processors are configured to execute the method as described in any one of the first aspects, or execute the method as described in any one of the second aspects.

[0038] In an eighth aspect, a server is provided, comprising: one or more processors, wherein the one or more processors are configured to execute the method as described in any one of the third aspects.

[0039] In the ninth aspect, a readable storage medium is provided, which includes a program. When the program is run on a device, the device executes any method as described in the first aspect, or executes any method as described in the second aspect, or executes any method as described in the third aspect.

[0040] In the tenth aspect, a chip system is provided, comprising: the chip system comprises at least one chip and a memory, the at least one chip being used to read and execute a program stored in the memory to implement a method as described in any one of the first aspects, or to implement a method as described in any one of the second aspects, or to implement a method as described in any one of the third aspects.

[0041] In the eleventh aspect, a program product is provided. When the program product is run on a device, the device executes the method as described in any one of the first aspect, or executes the method as described in any one of the second aspect, or executes the method as described in any one of the third aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] FIG1 is a schematic diagram of an application scenario provided by an embodiment of the present application;

[0043] FIG2 is a schematic diagram of the hardware structure of the smart door lock provided in an embodiment of the present application;

[0044] FIG3 is a functional structure diagram of an intelligent door lock control system provided in an embodiment of the present application;

[0045] FIG4 is a flow chart of a smart door lock control method provided in an embodiment of the present application;

[0046] FIG5 is a schematic diagram of a smart door lock control process in a scenario of unlocking based on face recognition provided by an embodiment of the present application;

[0047] FIG6 is a schematic diagram of a smart door lock control process in a scenario of unlocking based on fingerprint recognition provided by an embodiment of the present application;

[0048] FIG7 is a schematic diagram of a smart door lock control process in a scenario where unlocking is performed based on access control information from an NFC device, provided by an embodiment of the present application;

[0049] FIG8 is a schematic diagram of a process for restoring the face recognition function of a smart door lock provided in an embodiment of the present application;

[0050] FIG9 is a schematic diagram of another process for restoring the face recognition function of a smart door lock according to an embodiment of the present application;

[0051] FIG10 is a schematic structural diagram of a device provided in an embodiment of the present application;

[0052] FIG11 is a schematic structural diagram of a smart door lock provided in an embodiment of the present application;

[0053] FIG12 is a schematic diagram of the structure of a server provided in an embodiment of the present application. DETAILED DESCRIPTION

[0054] The present invention provides a method for controlling a smart door lock and related devices capable of implementing the method. In the present invention, upon determining that all users whose facial feature information has been entered into the smart door lock have entered the door, the face recognition function of the smart door lock is disabled, thereby reducing the possibility of false activation of the face recognition function and saving power consumption of the smart door lock.

[0055] The embodiments of the present application are described in detail below with reference to the accompanying drawings.

[0056] Referring to Figure 1, a schematic diagram of an application scenario provided by an embodiment of the present application is shown. As shown in Figure 1, the scenario includes a smart door lock 100, which can be connected to a routing device 300 set in a room via a wired or wireless method (e.g., wireless LAN or Bluetooth wireless communication method). The smart home devices in the whole house smart system in the room (e.g., camera 400a, control panel 400b, etc.) can be connected to the routing device 300 and connected to the cloud server 700 through the routing device 300 and the network 500.

[0057] In another possible implementation, the smart door lock 100 can communicate with the server 700 without going through the routing device 300. Exemplarily, the smart door lock 100 has a mobile communication function, such as a cellular communication function, and can communicate with the server 700 through a mobile communication network.

[0058] The smart door lock 100 can also communicate with the device 200 wirelessly, for example, the smart door lock 100 and the device 200 can communicate based on NFC.

[0059] Among them, device 200 is a device with wireless transceiver function, which can be a mobile device, a handheld device (such as a mobile phone), a wearable device, etc., and this application is not limited.

[0060] The smart door lock 100 has a face recognition unlocking function and can also support other unlocking methods, for example, it can support fingerprint unlocking, iris unlocking, password unlocking, NFC recognition unlocking, etc., which is not limited in the embodiments of this application.

[0061] Currently, the process of using the face recognition unlocking function is as follows: when the smart door lock 100 detects the presence of people nearby, such as when the PIR detector (or PIR probe) in the smart door lock 100 detects that someone is approaching the smart door lock, or when the microphone in the smart door lock 100 collects a sound signal, the camera in the smart door lock 100 is activated. The camera captures the user's facial image, and the smart door lock 100 recognizes the facial image. If the feature information of the facial image matches the facial feature information stored in the smart door lock 100, the smart door lock is unlocked to allow the user to enter.

[0062] In some cases, the facial recognition process may be mistakenly activated, resulting in higher power consumption in the smart door lock. For example, whenever someone passes in front of the smart door lock, the camera used to capture facial images will be activated, increasing the power consumption of the smart door lock.

[0063] The present invention provides a method for controlling a smart door lock. Based on the application scenario shown in FIG1 , in the present invention, upon determining that all users whose facial feature information has been entered have entered the door, the smart door lock 100 can disable the facial recognition function, thereby reducing the possibility of false activation of the facial recognition function and saving power consumption of the smart door lock 100.

[0064] 2 , which is a schematic diagram of the hardware structure of a smart door lock according to an embodiment of the present application. As shown in FIG2 , the smart door lock 100 may include a processor 110 , a face detection module 170 , and a power supply module 190 .

[0065] Optionally, the smart door lock 100 may also include one or more of the following modules: a communication module 120, a speaker 130A, a microphone 130B, a display screen 140, a doorbell / press component 150, a PIR detector 160, a sensor module 161, etc.

[0066] The face detection module 170 may include a camera 170A, which is used to capture facial images. The power module 190 may include a battery 190C, which is used to provide power for the components in the smart door lock 100 (such as the processor 110, the camera 170A, etc.). Optionally, the power module 190 may also include one or more of a charging management module 190A and a power management module 190B. The communication module 120 may include one or more of a Wi-Fi module 120A, a Bluetooth module 120B, an NFC module 120C, a mobile communication module 120D, etc. The sensor module 161 may include one or more of a fingerprint sensor 161A, a touch sensor 161B, a TOF sensor 161C, etc.

[0067] The TOF sensor 161C can be set on one side of the door to detect whether the user enters the door.

[0068] Among them, the processor 110 can be connected to the communication module 120, the speaker 130A, the microphone 130B, the display screen 140, the doorbell / press component 150, the PIR detector 160, the face detection module 170 and other components. The processor 110 can be used to receive the signals (or data) sent by these devices and perform corresponding processing.

[0069] Optionally, the processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, a neural network processing unit (NPU), a deep learning processor, etc. The different processing units may be independent devices or integrated into one or more processors.

[0070] In some embodiments of the present application, the processor 110 may include a microcontroller unit (MCU) and a deep learning processor. The MCU may serve as the control unit of the entire electronic device, and the MCU may control the camera and the deep learning processor. The deep learning processor may perform face recognition processing based on RAW images, and the deep learning processor may control the camera.

[0071] The communication module 120 may be a wireless communication module that may provide wireless communication functions such as wireless local area networks (WLAN), Bluetooth (BT), near field communication (NFC), and mobile communication applied to the smart door lock 100. For example, the mobile communication module 120D may have a cellular communication function, such as supporting a fifth generation mobile communication technology (5G) system or a 6G system or a future evolution system. For example, the mobile communication module 120D includes an embedded subscriber identity module (eSIM).

[0072] The smart door lock 100 can implement audio functions through the speaker 130A, microphone 130B, etc. In the embodiment of the present application, the speaker 130A can be used to play audio, for example, it can be used to play prompt audio to the user. In the embodiment of the present application, the microphone 130B can be used to collect sound (such as the user's voice, etc.).

[0073] Display screen 140 can be used to display a digital interface. A user can enter a number on the digital interface of display screen 140 to generate a password. The digital password can then be used to unlock the door lock. Display screen 140 includes a display panel. Optionally, display screen 140 can be located on the inside of the door, allowing the user to view the situation outside the door through the display screen while at home.

[0074] The doorbell / press component 150 can be integrated into the electronic device as a component. Alternatively, the smart door lock 100 may not include the doorbell 150, but instead be connected to the doorbell in communication (e.g., wired communication or wireless communication). Optionally, touching the doorbell can trigger the electronic device to collect visual information.

[0075] The PIR detector 160 can detect infrared signals in a space and determine whether there is a person in the space based on the infrared signals.

[0076] The camera 170A can sense the depth information of a human face and can be used to capture images of the human face.

[0077] The charging management module 190A is used to receive charging input from a charger, which can be a wireless charger or a wired charger.

[0078] Power management module 190B is used to connect battery 190C, charging management module 190A, and processor 110. Power management module 190B receives input from battery 190C and / or charging management module 190A to power other devices or components. Power management module 190B can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, power management module 190B can also be provided in processor 110. In other embodiments, power management module 190B and charging management module 190A can also be provided in the same device.

[0079] The fingerprint sensor 161A is used to collect fingerprints. Optionally, the smart door lock 100 can collect and save fingerprint information of at least one user.

[0080] Touch sensor 161B, also known as a "touch panel." The touch sensor 161B can be disposed on the display screen 140. The touch sensor 161B and the display screen 140 form a touch screen, also known as a "touch screen." The touch sensor 161B is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to a processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 140. In other embodiments, the touch sensor 161B can also be disposed on the surface of the smart door lock 100, at a location different from that of the display screen 140.

[0081] Optionally, the sensor module 161 may also include a vibration sensor (not shown in FIG2 ). The vibration sensor can detect a vibration signal and transmit the detected vibration signal to the processor 110. The processor 110 can subsequently determine whether it is a visitor knocking on the door based on a comparison of a preset knock vibration waveform with the received vibration signal. The preset knock vibration waveform can be pre-stored locally or on a server. Optionally, when comparison is required, the smart door lock 100 can obtain the knock vibration waveform from the server through the communication module 120.

[0082] It should be understood that the smart door lock 100 shown in FIG2 is only an example, and the structure shown in FIG2 does not constitute a specific limitation on the smart door lock 100. In some embodiments of the present application, the smart door lock 100 may include more components than those shown in FIG2 (for example, it may also include a switch control module for controlling the lock tongue, such as a lock tongue drive device, a drive motor, a transmission device, etc.), or fewer components, or combine certain components, or split certain components, or arrange the components differently. The components shown in FIG2 can be implemented in hardware, software, or a combination of software and hardware, including one or more signal processing and / or application-specific integrated circuits.

[0083] Before using the face recognition function of the smart door lock, it is necessary to collect facial feature information (or face entry), and the collected facial feature information is stored in the smart door lock. In an embodiment of the present application, user information can be created in the smart door lock for users whose facial feature information has been collected. The user information includes user identity information of at least one user and entry status information corresponding to the user identity information. The user identity information can be set by the user, for example, the user identity information can be the user's name, user nickname, user ID, etc., and the user identity information can uniquely identify a user. The entry status information can indicate whether the user has entered the door. For example, if the entry status information is "not entered" or "out", or the value of the entry status information is 0, it means that the user has not entered the door. If the entry status information is "entered" or the value of the entry status information is 1, it means that the user has entered the door.

[0084] Optionally, the user information may adopt a data structure of a user list, and this application does not limit the data structure of the user information. Table 1 exemplifies a type of user information.

[0085] Table 1: User Information

[0086] The facial feature information of the first user and the second user in Table 1 has been stored in the smart door lock.

[0087] Exemplarily, the process of creating the user information is as follows: when a user with an administrator identity (hereinafter referred to as administrator) operates the smart door lock to enter the face of the first user, the administrator operates the smart door lock according to the operation prompt information for entering the face displayed on the display screen of the smart door lock, so that the smart door lock collects the face image of the first user, and obtains the facial feature information corresponding to the face image by recognizing the face image. The administrator sets the corresponding user identity information for the facial feature information according to the operation prompt information for setting the user identity displayed on the display screen of the smart door lock. Thereafter, the smart door lock creates a correspondence between the facial feature information and the user identity information, and stores the user identity information in the above-mentioned user information. Optionally, at this time, the entry status information corresponding to the user identity information can be set to the "not entered" status by default.

[0088] In an embodiment of the present application, a user's user identity information can establish a correspondence with the user's biometric information (such as facial feature information, fingerprint information, iris information, etc.), password, access control information in the NFC device, and other information.

[0089] For example, fingerprint information is unique and can be used to identify a user, that is, a correspondence can be established between fingerprint information and user identity information. If a user successfully unlocks a smart door lock using a fingerprint, the smart door lock can determine the user's user identity information based on the user's fingerprint information.

[0090] For another example, different passwords can be set for different users so that the passwords can also uniquely identify the users. If the user successfully unlocks the smart door lock using the password, the smart door lock can determine the user's identity information based on the password used by the user.

[0091] For another example, different access control information can be set for different users, so that the access control information can also uniquely identify the user. If the user successfully unlocks the smart door lock using an NFC device, the smart door lock can determine the user's user identity information based on the access control information obtained from the NFC device.

[0092] Based on the smart door lock structure shown in Figure 2, see Figure 3 for a functional structural diagram of a smart door lock control system provided in an embodiment of the present application. A smart door lock control system can be a physical device or a logical device. The logical device can be understood as a logical unit / module that has the functions of a smart door lock, without limiting the type or performance of the hardware device. For example, the logical device can be one or more logical units / modules in one or more hardware devices.

[0093] As shown in FIG3 , the processor 110 may include: a face recognition module 1101 , a fingerprint recognition module 1102 , a password matching module 1103 , an NFC processing module 1104 , a control module 1105 and a door entry determination module 1106 .

[0094] The face recognition module 1101 can recognize the face image collected by the smart door lock and output the recognition result to the control module 1105. For example, it can output an indication of successful face recognition or an indication of failed face recognition to the control module 1105. Successful face recognition means that the collected face image matches the facial feature information stored in the smart door lock.

[0095] The fingerprint recognition module 1102 can recognize the fingerprint collected by the smart door lock and output the recognition result to the control module 1105. For example, it can output an indication of successful fingerprint recognition or an indication of failed fingerprint recognition to the control module 1105. Among them, successful fingerprint recognition means that the collected fingerprint matches the fingerprint feature information stored in the smart door lock.

[0096] The password matching module 1103 can match the password received by the smart door lock with the password stored in the smart door lock, and display the matching result to the control module 1105. For example, it can output an indication of a successful password match or an indication of a failed password match to the control module 1105. A successful password match means that the received password is the same as the password stored in the smart door lock.

[0097] The NFC processing module 1104 can match the access control information obtained by the smart door lock from the NFC device with the access control information stored in the smart door lock, and display the matching result to the control module 1105. For example, it can output an indication of a successful access control information match or an indication of a failed access control information match to the control module 1105. A successful access control information match means that the received access control information is the same as the access control information stored in the smart door lock.

[0098] The control module 1105 can send an unlock instruction to the mechanism or component for controlling the lock tongue based on the indication information output by the face recognition film 1101, the fingerprint recognition module 1102, the password matching module 1103, or the NFC processing module 1104. For example, if the control module 1105 receives the indication information output by the face recognition module 1101 indicating successful recognition, the unlock instruction is sent to the mechanism or component for controlling the lock tongue.

[0099] After sending the unlock command, if the control module 1105 detects a door closing event, it instructs the door entry determination module 1106 to determine whether the user has entered the door and receives the determination result sent by the door entry determination module 1106. The determination result may include: the user has entered the door or the user has not entered the door. After receiving the determination result, the control module 1105 can determine whether all users in the user information have entered the door based on the user information. If all users have entered the door, the smart door lock's facial recognition function is disabled.

[0100] Disabling the facial recognition function of the smart door lock can be understood as: when the PIR detector detects a person approaching the door lock, the camera will not be activated to capture facial images. For example, when the control module 1105 receives detection data from the PIR detector and determines that a person is approaching the smart door lock based on the detection data, the camera used for facial image capture will not be activated, for example, the camera will not be powered on, thereby reducing the functionality of the smart door lock.

[0101] The entry determination module 1106 can determine whether the user has entered the door based on the detection data from the detection device. Taking the smart door lock structure shown in Figure 2 as an example, after receiving an instruction from the control module 1105, the entry determination module 1106 can trigger the TOF sensor 161C to perform distance measurement and receive the distance measurement data returned by the TOF sensor 161C. The entry determination module 1106 determines whether the user has entered the door based on the distance measurement data and outputs the determination result to the control module 1105.

[0102] Exemplarily, the door entry judgment module 1106 can calculate the variance of the distance measurement data from the TOF sensor 161C within a set time period (such as 1 second). If the variance is greater than a set threshold, it can be determined that the user has entered the door.

[0103] Exemplarily, the variance satisfies the following calculation formula:

[0104] Among them, s 2 is the variance of the ranging data; n is the number of ranging data; x1 represents the first ranging data, x2 represents the second ranging data, and so on; M is the average value of n ranging data.

[0105] It should be understood that in the functional structure of the smart door lock control system shown in FIG3 , each module can be further split or merged, and this application does not limit this.

[0106] It should be understood that the functional structure of the smart door lock control system shown in FIG3 is only one possible example, and the structure shown in FIG3 does not constitute a specific limitation on the smart door lock 100. In some embodiments of the present application, the processor 110 may include more components than shown in FIG3, or fewer components, or combine certain components, or split certain components, or arrange the components differently. The components shown in FIG3 can be implemented in hardware, including one or more signal processing and / or application-specific integrated circuits, software, or a combination of software and hardware.

[0107] 4 is a flow chart of a smart door lock control method according to an embodiment of the present invention. This flow can be implemented by a smart door lock, and more specifically, by a processor in the smart door lock.

[0108] As shown in FIG4 , the method may include the following steps:

[0109] Step 401: The smart door lock is unlocked.

[0110] In one possible implementation, the smart door lock obtains first information and unlocks the door according to the first information.

[0111] The first information may be biometric information, an input password, or access control information obtained from an NFC device, which is not limited in this application. The biometric information may include, for example, a face image, a fingerprint, or an iris.

[0112] Taking the first information as a facial image as an example, after the smart door lock collects the facial image, it recognizes the facial image. If the recognition is successful, it will unlock the door.

[0113] Step 402: After determining that someone enters the door, the smart door lock determines the user identity information corresponding to the first information or determines the user identity information of the person entering the door.

[0114] In one possible implementation, when the smart door lock is unlocked according to the first information, the smart door lock determines the user identity information corresponding to the first information. In another possible implementation, after determining that someone enters the door, the smart door lock obtains the user identity information of the person entering the door.

[0115] In one possible implementation, before the smart door lock determines the user identity information corresponding to the first information, it can trigger a first detection device to perform a detection, obtain detection information from the first detection device, and determine whether someone has entered the door based on the detection information of the first detection device. If it is determined that someone has entered the door based on the detection information of the first detection device, the user identity information corresponding to the first information is determined. In other words, before determining the user identity information corresponding to the first information, it is first determined whether someone has entered the door after the smart door lock is unlocked. If someone has entered the door, the operation of determining the user identity information corresponding to the first information is performed. This can improve reliability. For example, after the smart door lock is unlocked, it is possible that the user has not entered the door. For example, the user unlocked the door only to put an item into the door and the user did not enter the door. In this case, there is no need to determine the user identity information.

[0116] Optionally, the first detection device may be a detection device provided in a smart door lock. The first detection device may also be provided independently of the smart door lock. In this case, the first detection device and the smart door lock may communicate wirelessly or wiredly.

[0117] Optionally, the first detection device may be a TOF sensor, for example, the TOF sensor 161C in FIG. 2 .

[0118] In one possible implementation, if the first information can uniquely identify the user, the smart door lock can determine the user identity information based on the first information.

[0119] Exemplarily, if the first information is biometric information, due to the uniqueness of the biometric information, the smart door lock can determine the user identity information corresponding to the biometric information based on the correspondence between the biometric information and the user identity information.

[0120] As another example, if the first information is password information, and the password information of different users is different, the smart door lock can determine the user identity information corresponding to the password based on the correspondence between the password information and the user identity information.

[0121] As another example, if the first information is access control information obtained from an NFC device, and the access control information stored in different NFC devices is different, the smart door lock can determine the user information corresponding to the access control information based on the correspondence between the access control information and the user identity.

[0122] In another possible implementation, based on the architecture shown in Figure 1, the smart door lock can request the server to identify the person entering the door. This method can be applicable to situations where the first information cannot uniquely identify the user and the user's identity information cannot be determined from the first information, such as when the first information is a password shared by multiple users.

[0123] The process of the smart door lock requesting the server to identify the identity of the person entering the door may include: the smart door lock sends a first request to the server, and the first request is used to request to obtain the user identity information of the person entering the door; the server responds to the first request, obtains the second information collected by the devices in the whole house smart system within the first time period after the smart door lock is unlocked, determines the user identity information of the person entering the door within the first time period based on the second information, and sends the user identity information to the smart door lock.

[0124] In the embodiment of the present application, the server can obtain the second information from different types of devices to determine the user identity information. The following lists several implementation methods of using the server to identify the user identity of the person entering the door.

[0125] Method 1 for identifying users entering the door: The server obtains the image captured by the camera, identifies the image, and determines the identity information of the user entering the door based on the image recognition result.

[0126] In this implementation, after the server receives the first request from the smart door lock, it obtains the image captured by the first camera in the whole-house smart system within the first time period, performs image recognition on the captured image, and determines the user identity information of the person entering the door within the first time period based on the image recognition result.

[0127] The starting moment of the first time period may be the moment when the smart door lock is unlocked. For example, the smart door lock may carry a timestamp in the first request, which indicates the moment when the smart door lock is unlocked. The starting moment of the first time period may also be the moment when the server receives the first request. This application is not limited. The length of the first time period may be pre-set. For example, the length of the first time period may be set according to the user's behavioral habits when entering the door (for example, taking off outer clothes, changing into slippers, etc.). For example, the length of the first time period may be 30 seconds, which is not limited in this application.

[0128] For example, upon receiving the first request from the smart door lock, the server may activate the first camera, with the image acquisition area of ​​the first camera covering the entrance area. The server may obtain images captured by the first camera during the first time period and perform recognition on these images, such as analyzing the user's entry behavior and faces in the images, to determine the identity of the person entering the door.

[0129] Optionally, the server may analyze the images captured by the first camera within the first time period based on artificial intelligence (AI) technology to determine the identity information of the person entering the door.

[0130] Furthermore, the server may turn off the first camera at the end of the first time period to save power consumption.

[0131] By adopting the above-mentioned door entry user identification method 1, in the scenario where multiple people enter the door when the door is unlocked at one time, the user identity information of the multiple people can be identified.

[0132] Method 2 for identifying the user entering the door: The server determines the identity information of the person entering the door based on the changes in the connection between the routing device and the device.

[0133] In this implementation, after receiving the first request from the smart door lock, the server obtains the information of the devices established for connection detected by the routing device in the whole house smart system within the first time period, and determines the corresponding user identity information based on the information of the devices established for connection with the routing device.

[0134] Normally, if a user enters the house, the device they carry with them (such as a mobile phone) will automatically establish a Wi-Fi connection with the router at home. Considering that the signal coverage range of the router may be large, the device carried by the user may have established a connection with the router before the user enters the house. Therefore, the starting time of the first time period can be at or before the moment the smart door lock is unlocked, such as 30 seconds before the unlocking moment, and this application does not limit it. The end time of the first time period can be a set time length after the moment the smart door lock is unlocked, and this application does not limit the value of this time length.

[0135] Exemplarily, after receiving the first request from the smart door lock, the server sends a request message to the router, where the request message is used to request information about the device that has established a connection detected by the router within a first time period. The router sends device information to the server based on the request message, where the device has established a Wi-Fi connection with the router within the first time period. The server determines the corresponding user identity information based on the device information and the correspondence between the device information and the user identity information stored in the server.

[0136] Optionally, a correspondence between the user identity information and the identification information of a device (such as a mobile phone) used by the user may be pre-set in the server.

[0137] Entrance user identification method 3: The server determines the identity information of the entrance user based on the fingerprint information corresponding to the touch operation received by the control panel.

[0138] In some cases, users may need to turn on the lights by touching the control panel after entering the door. Some control panels have fingerprint collection and recognition functions. In this implementation, after receiving the first request from the smart door lock, the server can obtain the fingerprint information collected by the control panel within a first time period and determine the corresponding user identity information based on the fingerprint information collected by the control panel within the first time period.

[0139] The starting moment of the first time period may be the moment when the smart door lock is unlocked. For example, the smart door lock may carry a timestamp in the first request, which indicates the moment when the smart door lock is unlocked. The starting moment of the first time period may also be the moment when the server receives the first request. This application is not limited. The length of the first time period may be pre-set. For example, the length of the first time period may be set according to the user's behavioral habits when entering the door (for example, taking off outer clothes before turning on the lights). For example, the length of the first time period may be 30 seconds, which is not limited in this application.

[0140] It is understandable that the above are only exemplary ways of identifying the identity of the user entering the door with the help of the server, and this application does not limit this.

[0141] In one possible implementation, the smart door lock may first use locally stored information (such as facial feature information, fingerprint information, password, etc.) to determine the user identity information corresponding to the first information. If the user identity information corresponding to the first information cannot be determined, the smart door lock may then request the server to identify the person entering the door. In another possible implementation, after determining that someone has entered the door, the smart door lock may directly request the server to identify the user identity of the person entering the door.

[0142] In one possible implementation, after receiving the first request from the smart door lock, the server can use the method with higher priority to identify the identity of the person entering the door according to the priorities corresponding to different methods of identifying the user entering the door. If the identification fails, the server can use the method with lower priority to identify the identity of the person entering the door, and so on.

[0143] In a possible implementation, if the identity recognition of the person entering the door fails, that is, the user identity information of the person entering the door cannot be determined, the process can be terminated.

[0144] Step 403: The smart door lock determines whether the user corresponding to the user identity information belongs to the user in the user information. If the user corresponding to the user identity information belongs to the user in the user information, the process proceeds to step 404; if the user corresponding to the user identity information does not belong to the user in the user information, the process ends.

[0145] In this step, the smart door lock can query whether the user identity information exists in the user information. If the user identity information is stored in the user information, it indicates that the user corresponding to the user identity information belongs to the user in the user information.

[0146] Step 404: The smart door lock obtains the door entry status of all users in the user information.

[0147] In one possible implementation, after the smart door lock determines that the user corresponding to the user identity information belongs to the user in the user information, it can update the entry status information corresponding to the user identity information in the user information, and then determine the entry status of all users in the user information based on the entry status information corresponding to all user identity information in the updated user information.

[0148] In one possible implementation, if the smart door lock obtains user identity information of n users (n is an integer greater than or equal to 2) (for example, when the above-mentioned door entry user identification method 1 is used to request the server to identify the user identity information), the smart door lock can respectively determine whether the users corresponding to the n user identity information are the users in the user information. If the m users corresponding to the user identity information of m (m is an integer greater than or equal to 1 and less than or equal to n) of the n user identity information are the users in the user information, the door entry status information corresponding to the m user identity information in the user information is updated, and then the door entry status of all users is determined based on the door entry status information corresponding to all user identity information in the updated user information.

[0149] Step 405: If it is determined based on the entry status of all users in the user information that all users in the user information have entered the door, then step 406 is executed; otherwise, this process ends.

[0150] Step 406: Turn off the face recognition function of the smart door lock.

[0151] Based on the process shown in Figure 4, once the smart door lock is successfully unlocked, it can identify the user entering the door. If the user's identity information indicates that the user has stored facial features in the smart door lock, the smart door lock will further determine whether all users who have stored facial features in the smart door lock have entered the door. If so, the smart door lock's facial recognition function is disabled. Afterwards, if the smart door lock's PIR detector detects someone approaching, the smart door lock will not activate the camera to capture facial images for facial recognition, thereby saving power.

[0152] In one possible implementation, after disabling the facial recognition function of a smart door lock, it can be restored when someone leaves the house. For a smart door lock, when someone presses the door handle to open it, the smart door lock can detect the door opening event and determine that the door was opened from the inside. Subsequently, when the smart door lock detects a door closing event (i.e., the door is closed), it can be determined that someone has left the house. When the smart door lock determines that someone has left the house based on the door opening and closing events detected by the smart door lock, the facial recognition function is restored and the entry status of all users in the user information is updated. That is, the entry status information corresponding to all user identity information in the user information is updated to "not entered."

[0153] In another possible implementation, after disabling the face recognition function of a smart door lock, when someone leaves the house, the face recognition function is restored only if the person leaving the house is determined to be the user in the user information. For example, when the smart door lock determines that someone has left the house based on door opening and closing events detected by the smart door lock, the user identity information of the person leaving the house is obtained. If the user corresponding to the user identity information is the user in the user information, the face recognition function of the smart door lock is restored and the user entry status of the user in the user information is updated. This allows for more accurate updating of the user information, which in turn can further save the power consumption of the smart door lock.

[0154] In one possible implementation, a smart door lock can use the fingerprint recognition function of the door handle to obtain the user identity information of the person leaving the house. If the door handle has fingerprint recognition, after disabling the smart door lock's facial recognition function, when the user presses the door handle to open the door, the user's fingerprint information can be collected and sent to the processor in the smart door lock. When the smart door lock detects that the door is closed, the corresponding user identity information can be determined based on the fingerprint information. If the user identity information is the same as the user identity information in the user information, the entry status information corresponding to the user identity information in the user information is updated to the "not entered" status, and the smart door lock's facial recognition function is restored.

[0155] In another possible implementation, the smart door lock can request a server to identify the person leaving the house. After disabling the smart door lock's facial recognition function, when someone leaves the house, the smart door lock can send a second request to the server, requesting the user identity information of the person leaving the house during the time period of the door opening and closing events detected by the smart door lock. After receiving the second request, the server can obtain the user identity information of the person leaving the house during the second time period of the door opening and closing events detected by the smart door lock, and send this user identity information to the smart door lock.

[0156] The starting time of the second time period may be the moment when the smart door lock detects that the door is opened from the inside, or the moment before this moment and the first time period from this moment; the ending time of the second time period may be the moment when the smart door lock detects that the door is closed, or the moment after this moment and the second time period from this moment. The second time period may be pre-set, for example, according to the length of time from the user entering the image acquisition area of ​​the camera used to detect the door area to opening the door and leaving. For example, the first time period is 30 seconds, which is not limited in this application. The second time period may be pre-set, for example, according to the length of time the device carried by the user follows the user out of the door, resulting in the disconnection of the Wi-Fi connection with the routing device.

[0157] Optionally, the second request may include time information of the door opening event and the door closing event detected by the smart door lock.

[0158] In the embodiment of the present application, the server can determine the user identity information of the person who goes out in the following manner. The following lists several implementation methods of using the server to identify the identity of the user who goes out.

[0159] Method 1 for identifying users who are leaving their homes: The server obtains images captured by the camera, identifies the images, and determines the identity of the user who is leaving their homes based on the image recognition results.

[0160] This implementation is similar to the specific implementation of the aforementioned method for identifying users entering the door 1. After receiving the second request from the smart door lock, the server obtains images captured by the first camera in the entire home smart system during the second time period, performs image recognition on the captured images, and determines the user identity information of the person who left the house during the second time period based on the image recognition results.

[0161] For example, upon receiving the second request from the smart door lock, the server may activate the first camera, with the image capture area of ​​the first camera covering the entrance area. The server may obtain images captured by the first camera during the second time period and perform recognition on these images, such as analyzing the user's behavior habits when leaving the house and faces in the images, to determine the identity of the person leaving the house.

[0162] Optionally, the server may analyze the images captured by the first camera during the second time period based on AI technology to determine the identity information of the person going out.

[0163] Furthermore, the server may turn off the first camera at the end of the second time period to save power consumption.

[0164] By adopting the above-mentioned method 1 for identifying users going out, when multiple people go out at one time when the door is opened, the identity information of the multiple people going out can be identified.

[0165] Out-of-home user identification method 2: The server determines the identity information of the out-of-home user based on changes in the connection between the routing device and the device.

[0166] This implementation is similar to the specific implementation of the aforementioned entry user identification method 2. After receiving the second request from the smart door lock, the server obtains information about disconnected devices detected by the routing device in the entire home smart system during the second time period and determines the corresponding user identity information based on the information about the devices disconnected from the routing device.

[0167] Exemplarily, after receiving the second request from the smart door lock, the server sends a request message to the router, where the request message is used to request information about disconnected devices detected by the router within a second time period. The router sends device information to the server based on the request message, and the device disconnected from the router's Wi-Fi connection within the second time period. The server determines the corresponding user identity information based on the device information and the correspondence between the device information and the user identity information stored in the server.

[0168] Out-of-home user identification method 3: The server determines the identity information of the out-of-home user based on the fingerprint information corresponding to the touch operation received by the control panel.

[0169] This implementation is similar to the specific implementation of method 3 for identifying user entry. In some cases, users may need to turn off lights by touching the control panel before leaving. Some control panels have fingerprint collection and recognition capabilities. In this implementation, after receiving the second request from the smart door lock, the server can obtain fingerprint information collected by the control panel during the second time period and determine the corresponding user identity information based on the fingerprint information collected by the control panel during the second time period.

[0170] It will be understood that the above are only exemplary ways of identifying the identity of a person who goes out with the help of a server, and this application does not limit this.

[0171] In one possible implementation, the smart door lock can first determine the user identity information of the person going out based on the fingerprint information collected by the door handle. If the fingerprint recognition fails and the user identity information of the person going out cannot be determined, the server is requested to identify the person going out.

[0172] In one possible implementation, after receiving the second request from the smart door lock, the server can use the method with higher priority to identify the identity of the person going out according to the priorities corresponding to different methods of identifying users going out. If the identification fails, the server can use the method with lower priority to identify the identity of the person going out, and so on.

[0173] In one possible implementation, if the identity recognition of the person going out fails, that is, the user identity information of the person going out cannot be determined, the smart door lock can restore the face recognition function.

[0174] Based on the architecture shown in FIG2 and the process shown in FIG4 , taking the first information as facial information as an example, that is, taking the unlocking function based on facial recognition as an example, FIG5 exemplifies a schematic diagram of the smart door lock control process in a scenario where unlocking is based on facial recognition.

[0175] As shown in Figure 5, the process may include the following steps:

[0176] Step 500: The PIR detector of the smart door lock detects that someone is approaching.

[0177] Step 501: The PIR detector notifies the processor of the smart door lock that someone is approaching.

[0178] Step 502: After receiving the notification, the processor instructs the face detection module to start face detection, for example, by powering on a camera in the face detection module to start the camera.

[0179] Step 503: After the camera in the face detection module is activated, it starts to collect the user's face image.

[0180] Step 504: The camera of the face detection module sends the collected face image to the processor of the smart door lock.

[0181] Step 505: After receiving the facial image, the processor performs facial recognition on the facial image. For example, the facial image is matched with facial image feature information stored in the smart door lock.

[0182] Step 506: If the face recognition is successful, the processor sends an unlock instruction to the switch control module for controlling the lock tongue.

[0183] For the convenience of description, the user corresponding to the face image that is successfully unlocked is referred to as the entry user.

[0184] Step 507: After receiving the unlocking instruction, the switch control module controls the relevant driving mechanism of the lock tongue to perform the unlocking operation.

[0185] Step 508: When the door is closed, the switch control module may detect the door closing event.

[0186] Step 509: The switch control module sends the detected door closing event information to the processor.

[0187] Step 510: After receiving the door closing event information, the processor instructs the TOF sensor provided inside the door to start distance measurement detection.

[0188] Step 511: After being activated, the TOF sensor performs distance measurement detection and collects distance measurement data.

[0189] Step 512: The TOF sensor sends the collected ranging data to the processor.

[0190] Step 513: The processor determines whether the user enters the door based on the distance measurement data. If yes, step 514 is executed.

[0191] Step 514: The processor updates the entry status of the user entering the door in the user information. For example, the entry status of the user entering the door is updated to "enter".

[0192] Step 515: The processor determines whether all users in the user information have entered the door. Exemplarily, the processor determines whether the entry status of all users in the user information is "enter the door". If so, step 516 is executed.

[0193] Step 516: The processor turns off the face recognition function of the smart door lock.

[0194] Based on the architecture shown in Figure 2 and the process shown in Figure 4, taking the first information as fingerprint information as an example, that is, taking the unlocking function based on fingerprint recognition as an example, Figure 6 exemplifies a schematic diagram of the smart door lock control process in a scenario where unlocking is based on fingerprint recognition.

[0195] As shown in Figure 6, the process may include the following steps:

[0196] Step 600: When the user places his finger on the fingerprint collection window of the smart door lock, the fingerprint sensor uses the user's fingerprint information.

[0197] Step 601: The fingerprint sensor sends the collected fingerprint information to the processor of the smart door lock.

[0198] Step 602: After receiving the fingerprint information, the processor performs fingerprint recognition. For example, the fingerprint information is matched with the fingerprint information stored in the smart door lock.

[0199] Step 603: If the fingerprint recognition is successful, the processor sends an unlocking instruction to the switch control module for controlling the lock tongue.

[0200] For the convenience of description, the user corresponding to the fingerprint information of the successful unlocking is called the entry user.

[0201] Step 604: After receiving the unlocking instruction, the switch control module controls the relevant driving mechanism of the lock tongue to perform the unlocking operation.

[0202] Step 605: When the door is closed, the switch control module may detect the door closing event.

[0203] Step 606: The switch control module sends the detected door closing event information to the processor.

[0204] Step 607: The processor instructs the TOF sensor provided inside the door to start distance measurement detection.

[0205] Step 608: After the TOF sensor is activated, it performs distance measurement detection and collects distance measurement data.

[0206] Step 609: The TOF sensor sends the collected ranging data to the processor.

[0207] Step 610: The processor determines whether the user enters the door based on the distance measurement data. If yes, step 611 is executed.

[0208] Step 611: The processor determines whether the incoming user is the user in the user information. If yes, step 612 is executed.

[0209] Exemplarily, the processor may determine corresponding user identity information based on the fingerprint information, and then determine whether the user identity information exists in the user information. If the user identity information exists in the user information, the user entering the door is the user in the user information.

[0210] Step 612: The processor updates the entry status of the user entering the door in the user information. For example, the entry status of the user entering the door is updated to "enter".

[0211] Step 613: The processor determines whether all users in the user information have entered the door. Exemplarily, the processor determines whether the entry status of all users in the user information is "enter the door". If so, step 614 is executed.

[0212] Step 614: The processor turns off the face recognition function of the smart door lock.

[0213] Based on the architecture shown in Figures 1 and 2 and the process shown in Figure 4, Figure 7 illustrates a schematic diagram of a smart door lock control process in a scenario where the first information is access control information from an NFC device and unlocking is performed based on the access control information from the NFC device. The access control information is shared by multiple users, that is, the access control information stored in the NFC devices of multiple users is the same.

[0214] As shown in Figure 7, the process may include the following steps:

[0215] Step 701: The NFC module of the smart door lock sends the access control information from the NFC device to the processor of the smart door lock.

[0216] For example, when an NFC device (such as a mobile phone with a built-in NFC chip) is close to the smart door lock, the NFC module in the smart door lock can read the access control information stored in the NFC device.

[0217] Step 702: After receiving the access control information, the processor verifies the access control information. For example, the processor matches the access control information with the access control information stored in the smart door lock.

[0218] Step 703: If the verification is successful, the processor sends an unlocking instruction to the switch control module for controlling the lock tongue.

[0219] Step 704: After receiving the unlocking instruction, the switch control module controls the relevant driving mechanism of the lock tongue to perform the unlocking operation.

[0220] Step 705: When the door is closed, the switch control module may detect the door closing event.

[0221] Step 706: The switch control module sends the detected door closing event information to the processor.

[0222] Step 707: The processor instructs the TOF sensor provided inside the door to start distance measurement detection.

[0223] Step 708: After the TOF sensor is activated, it performs distance measurement detection and collects distance measurement data.

[0224] Step 709: The TOF sensor sends the collected ranging data to the processor.

[0225] Step 710: The processor determines whether the user enters the door based on the distance measurement data. If yes, step 711 is executed.

[0226] Step 711: The processor sends a first request to the server, where the first request is used to request to obtain the user identity information of the user entering the door.

[0227] In one possible implementation, the processor of the smart door lock may send the first request to the server through a router.

[0228] In another possible implementation, the processor of the smart door lock may send the first request to the server without going through a router. For example, the processor sends the first request to the server through the wireless communication module of the smart door lock.

[0229] Step 712: The server obtains the user identity information of the user entering the door in response to the first request.

[0230] Exemplarily, the implementation method of the server obtaining the user identity information of the door-entering user can refer to the relevant content of the aforementioned embodiment, for example, the door-entering user identification method 1, the door-entering user identification method 2 or the door-entering user identification method 3 can be adopted.

[0231] Step 713: The server sends the user identity information to the processor of the smart door lock.

[0232] In one possible implementation, the server may send the user identity information to the processor of the smart door lock via a router.

[0233] In another possible implementation, the server can send the user identity information to the processor of the smart door lock without going through the router.

[0234] Step 714 : The processor determines whether the incoming user (ie, the user corresponding to the user identity information) is the user in the user information. If yes, step 715 is executed.

[0235] Exemplarily, the processor may determine corresponding user identity information based on the fingerprint information, and then determine whether the user identity information exists in the user information. If the user identity information exists in the user information, the user entering the door is the user in the user information.

[0236] Step 715: The processor updates the entry status of the user entering the door in the user information. For example, the entry status of the user entering the door is updated to "enter".

[0237] Step 716: The processor determines whether all users in the user information have entered the door. Exemplarily, the processor determines whether the entry status of all users in the user information is "enter the door". If so, execute step 717.

[0238] Step 717: The processor turns off the face recognition function of the smart door lock.

[0239] Based on the architecture shown in FIG2 above, FIG8 exemplarily shows a flow chart of restoring the face recognition function of a smart door lock.

[0240] As shown in FIG8 , the process may include the following steps:

[0241] Step 801: When the user inside the door opens the door, the switch control module of the smart door lock can detect the door opening event and send the door opening event information to the processor of the smart door lock.

[0242] Step 802: When the door is closed, the switch control module of the smart door lock can detect the door closing event and send the door closing event information to the processor of the smart door lock.

[0243] Step 803: The processor of the smart door lock determines that a user has gone out based on the door opening event and the door closing event.

[0244] Step 804: The processor of the smart door lock updates the door entry status of all users in the user information, and updates the door entry status of all users to "not entered the door".

[0245] Step 805: The processor of the smart door lock restores the face recognition function.

[0246] Based on the architecture shown in Figures 1 and 2 above, Figure 9 exemplifies a flow chart of restoring the face recognition function of a smart door lock.

[0247] As shown in FIG9 , the process may include the following steps:

[0248] Step 901: When the user inside the door opens the door, the switch control module of the smart door lock can detect the door opening event and send the door opening event information to the processor of the smart door lock.

[0249] Step 902: When the door is closed, the switch control module of the smart door lock can detect the door closing event and send the door closing event information to the processor of the smart door lock.

[0250] Step 903: The processor of the smart door lock determines that a user has gone out based on the door opening event and the door closing event.

[0251] Step 904: The processor of the smart door lock sends a second request to the server, where the second request is used to request the user identity information of the user going out.

[0252] In one possible implementation, the processor of the smart door lock may send the second request to the server through a router.

[0253] In another possible implementation, the processor of the smart door lock may send the second request to the server without going through a router. For example, the processor sends the second request to the server through the wireless communication module of the smart door lock.

[0254] Step 905: The server obtains the user identity information of the out-of-home user in response to the second request.

[0255] For example, the implementation method of the server obtaining the user identity information of the out-of-home user may refer to the relevant content of the aforementioned embodiments, for example, out-of-home user identification method 1, out-of-home user identification method 2 or out-of-home user identification method 3 may be adopted.

[0256] Step 906: The server sends the user identity information to the processor of the smart door lock.

[0257] In one possible implementation, the server may send the user identity information to the processor of the smart door lock via a router.

[0258] In another possible implementation, the server can send the user identity information to the processor of the smart door lock without going through the router.

[0259] Step 907: The processor of the smart door lock determines whether the user going out is the user in the user information based on the user identity information of the user going out. If yes, execute step 908.

[0260] Exemplarily, the processor may determine whether the user identity information exists in the user information. If the user identity information exists in the user information, the out-of-home user is the user in the user information.

[0261] Step 908: The processor of the smart door lock updates the entry status of the user who is leaving the house in the user information. For example, the entry status of the user who is leaving the house is updated to "not entering the house".

[0262] Step 909: The processor of the smart door lock restores the face recognition function.

[0263] For example, if the face recognition function of the smart door lock has been turned off before step 909, the face recognition function is restored in step 909; if the face recognition function of the smart door lock has not been turned off before step 909, step 909 is not executed, but the face recognition function is kept on.

[0264] It is understood that in order to implement the functions in the above embodiments, the device includes hardware structures and / or software modules corresponding to the execution of each function. It should be readily apparent to those skilled in the art that, in combination with the units and method steps of each example described in the embodiments disclosed in this application, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application scenario and design constraints of the technical solution.

[0265] Figures 10 and 11 are schematic diagrams of possible devices provided in embodiments of the present application. These devices can be used to implement the functions of the processor in the smart door lock in the above method embodiment, thereby also achieving the beneficial effects of the above method embodiment.

[0266] As shown in Figure 10, the device 1000 includes a processing unit 1010 and a transceiver unit 1020. The device 1000 is used to implement the functions of the smart door lock or server in the method embodiments shown in Figures 4, 5, 6, 7, 8 or 9 above.

[0267] In one possible implementation, when the device 1000 is used to implement the function of the smart door lock in the embodiment of the method of the present application: the processing unit 1010 is used to unlock the door according to the obtained first information; after determining that someone enters the door, determine the user identity information corresponding to the first information or determine the user identity information of the person entering the door; if the user corresponding to the user identity information belongs to the user in the user information, then obtain the entry status of all users in the user information, wherein the user information includes the user identity information of at least one user, and the facial feature information of the at least one user is stored in the smart door lock; if it is determined that all users in the user information have entered the door according to the entry status of all users in the user information, then turn off the face recognition function of the smart door lock.

[0268] In another possible implementation, when the device 1000 is used to implement the function of the smart door lock in the embodiment of the method of the present application: the processing unit 1010 is used to: after unlocking the smart door lock and determining that someone has entered the door, send a first request to the server through the transceiver unit 1020, and the first request is used to request to obtain the user identity information of the person entering the door; the transceiver unit 1020 is used to receive the user identity information from the server; the processing unit 1010 is also used to: if the user corresponding to the user identity information belongs to the user in the user information, then obtain the entry status of all users in the user information, wherein the user information includes the user identity information of at least one user, and the facial feature information of the at least one user is stored in the smart door lock; if it is determined that all users in the user information have entered the door based on the entry status of all users in the user information, then turn off the face recognition function of the smart door lock.

[0269] When the device 1000 is used to implement the function of the server in the embodiment of the method of the present application: the transceiver unit 1020 is used to receive a first request from the smart door lock, and the first request is used to request to obtain the user identity information of the person entering the door; the processing unit 1010 is used to respond to the first request, obtain the second information collected by the device in the whole-house smart system within the first time period after the smart door lock is unlocked, determine the user identity information of the person entering the door within the first time period based on the second information, and send the user identity information to the smart door lock through the transceiver unit 1020.

[0270] A more detailed description of the processing unit 1010 and the transceiver unit 1020 can be directly obtained by referring to the relevant description in the method embodiment shown in Figures 4, 5, 6, 7, 8 or 9, and will not be repeated here.

[0271] As shown in Figure 11, the smart door lock 1100 includes a processor 1110 and an interface circuit 1120. The processor 1110 and the interface circuit 1120 are coupled to each other. It is understood that the interface circuit 1120 can be a transceiver or an input / output interface. Optionally, the smart door lock 1100 may also include a memory 1130 for storing instructions executed by the processor 1110, or storing input data required by the processor 1110 to execute instructions, or storing data generated after the processor 1110 executes instructions. Optionally, the processor 1110 and the memory 1130 may be integrated together.

[0272] When the smart door lock 1100 is used to implement the method shown in Figure 4, Figure 5, Figure 6, Figure 7, Figure 8 or Figure 9, the processor 1110 is used to implement the function of the above-mentioned processing unit 1010, and the interface circuit 1120 is used to implement the function of the above-mentioned transceiver unit 1020.

[0273] As shown in Figure 12, server 1200 includes a processor 1210 and an interface circuit 1220. The processor 1210 and the interface circuit 1220 are coupled to each other. It will be appreciated that the interface circuit 1220 may be a transceiver or an input / output interface. Optionally, server 1200 may further include a memory 1230 for storing instructions executed by processor 1210, or for storing input data required by processor 1210 to execute instructions, or for storing data generated after processor 1210 executes instructions. Optionally, processor 1210 and memory 1230 may be integrated.

[0274] When the server 1200 is used to implement the method shown in FIG. 7 or FIG. 9 , the processor 1210 is used to implement the functions of the processing unit 1010 , and the interface circuit 1220 is used to implement the functions of the transceiver unit 1020 .

[0275] When the above-mentioned device (for example, including the smart door lock shown in FIG11 or the server shown in FIG12 ) is a chip system, the chip system implements the function of the processor in the device in the above-mentioned method embodiment.

[0276] It is understood that the processor in the embodiments of the present application may be a central processing unit (CPU), or may be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field programmable gate arrays (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. The general-purpose processor may be a microprocessor or any conventional processor.

[0277] In this application, another example of a smart door lock is provided, which includes at least one processor and at least one memory, the at least one processor and the at least one memory are coupled, and the at least one memory is used to store instructions. When the instructions are executed by the at least one processor, the smart door lock executes the method in the above embodiment. Taking the smart door lock as an example, as shown in Figure 11, the smart door lock 1100 includes a processor 1110 and a memory 1130. The processor 1110 and the memory 1130 are coupled, and the memory 1130 stores instructions. When the instructions stored in the memory 1130 are executed by the processor 1110, the smart door lock 1100 executes the method executed by the smart door lock in the above embodiment. Optionally, the processor 1110 and the memory 1130 can be integrated together.

[0278] In the present application, another example of a server is provided, which includes at least one processor and at least one memory, the at least one processor and the at least one memory are coupled, and the at least one memory is used to store instructions. When the instructions are executed by the at least one processor, the server executes the method in the above embodiment. Taking the server including a processor and a memory as an example, as shown in Figure 12, the server 1200 includes a processor 1210 and a memory 1230. The processor 1210 and the memory 1230 are coupled, and the memory 1230 stores instructions. When the instructions stored in the memory 1230 are executed by the processor 1210, the server 1200 executes the method executed by the server in the above embodiment. Optionally, the processor 1210 and the memory 1230 can be integrated together.

[0279] The method steps in the embodiments of the present application can be implemented in hardware or in software instructions that can be executed by a processor. The software instructions can be composed of corresponding software modules, and the software modules can be stored in random access memory, flash memory, read-only memory, programmable read-only memory, erasable programmable read-only memory, electrically erasable programmable read-only memory, registers, hard disk, mobile hard disk, CD-ROM or any other form of storage medium well known in the art. An exemplary storage medium is coupled to the processor so that the processor can read information from the storage medium and write information to the storage medium. The storage medium can also be an integral part of the processor. The processor and storage medium can be located in an ASIC. In addition, the ASIC can be located in a network device or a terminal. The processor and storage medium can also exist in a network device or a terminal as discrete components.

[0280] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented using software, all or part of the embodiments may be implemented in the form of a program product (also referred to as a computer program product). The program product includes one or more programs or instructions. When the program or instruction is loaded and executed on the device, the process or function described in the embodiment of the present application is performed in whole or in part.

[0281] In the various embodiments of the present application, unless otherwise specified or there is a logical conflict, the terms and / or descriptions between different embodiments are consistent and can be referenced by each other. The technical features in different embodiments can be combined to form new embodiments according to their inherent logical relationships.

[0282] In this application, "at least one" means one or more, and "more" means two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. In the text description of this application, the character " / " generally indicates that the previous and next associated objects are in an "or" relationship; in the formula of this application, the character " / " indicates that the previous and next associated objects are in a "division" relationship. "Including at least one of A, B and C" can mean: including A; including B; including C; including A and B; including A and C; including B and C; including A, B and C.

[0283] It is understood that the various numbers used in the embodiments of this application are merely for ease of description and are not intended to limit the scope of the embodiments of this application. The order of the sequence numbers of the above-mentioned processes does not necessarily imply a specific order of execution; the order of execution of the processes should be determined by their functions and inherent logic.

Claims

1. A smart door lock control method, characterized in that: Applied to a smart door lock, the method includes: Unlocking according to the acquired first information; After determining that someone has entered the door, determining the user identity information corresponding to the first information or determining the user identity information of the person who has entered the door; If the user corresponding to the user identity information belongs to the user in the user information, then obtaining the door entry status of all users in the user information; wherein the user information includes the user identity information of at least one user, and the facial feature information of the at least one user is stored in the smart door lock; If it is determined according to the entry status of all users in the user information that all users in the user information have entered the door, the face recognition function of the smart door lock is turned off.

2. The method according to claim 1, wherein Determining that someone enters the door includes: triggering a first detection device to perform detection; Determine whether someone enters the door based on the detection information of the first detection device.

3. The method according to any one of claims 1 to 2, characterized in that The obtaining of the entry status of all users in the user information includes: Updating the entry status information corresponding to the user identity information in the user information; The entry status of all users in the user information is determined according to the entry status information corresponding to all user identity information in the updated user information.

4. The method according to any one of claims 1 to 3, wherein The user identity information of the person entering the door is determined, including: Sending a first request to a server in a whole-house smart system, the first request being used to request obtaining user identity information of a person who enters the door within a first time period after the smart door lock is unlocked, the whole-house smart system including the smart door lock; receiving user identity information from the server; If the user identity information from the service includes n user identity information, determining whether the users corresponding to the n user identity information are the users in the user information, where n is an integer greater than or equal to 2; If m users corresponding to m user identity information among the n user identity information are users in the user information, then the entry status information corresponding to the user identity information of the m users in the user information is updated, where m is an integer greater than or equal to 1 and less than or equal to n.

5. The method according to any one of claims 1 to 3, wherein The first information is biometric information; and determining the user identity information corresponding to the first information includes: determining the user identity information corresponding to the first information based on a correspondence between the biometric information and the user identity information; or The first information is password information, and the password information of different users is different; determining the user identity information corresponding to the first information includes: determining the user identity information corresponding to the first information according to the correspondence between the password information and the user identity information; or The first information is access control information obtained from a near-field communication (NFC) device, and the access control information stored in different NFC devices is different from each other; determining the user identity information corresponding to the first information includes: determining the user information corresponding to the first information based on the correspondence between the access control information and the user identity.

6. The method according to any one of claims 1 to 5, wherein: After the face recognition function of the smart door lock is turned off, the method further includes: When it is determined that someone has left the house based on the door opening and closing events detected by the smart door lock, the face recognition function of the smart door lock is restored; Update the entry status information corresponding to all user identity information in the user information.

7. The method according to any one of claims 1 to 5, wherein: After the face recognition function of the smart door lock is turned off, the method further includes: When it is determined that someone has gone out based on the door opening and closing events detected by the smart door lock, obtaining user identity information of the person who has gone out; If the user corresponding to the user identity information belongs to the user in the user information, restoring the face recognition function of the smart door lock; According to the user identity information of the person going out, the corresponding entry status information in the user information is updated.

8. The method according to claim 7, wherein The step of obtaining the user identity information of the person going out includes: Send a second request to the server, the second request is used to request to obtain the door opening event and door closing event detected by the smart door lock User identity information of people who go out during the time period; Receive user identity information from the server.

9. A smart door lock control method, characterized in that: A smart door lock is applied to a whole-house smart system, wherein the whole-house smart system further includes a server, and the method includes: After unlocking the smart door lock and confirming that someone enters the door, a first request is sent to the server, wherein the first request is used to request the user identity information of the person entering the door; receiving user identity information from the server; If the user corresponding to the user identity information belongs to the user in the user information, then obtaining the door entry status of all users in the user information; wherein the user information includes the user identity information of at least one user, and the facial feature information of the at least one user is stored in the smart door lock; If it is determined according to the entry status of all users in the user information that all users in the user information have entered the door, the face recognition function of the smart door lock is turned off.

10. The method according to claim 9, wherein Determining that someone enters the door includes: triggering a first detection device to perform detection; Determine whether someone enters the door based on the detection information of the first detection device.

11. The method according to any one of claims 9 to 10, wherein: The obtaining of the entry status of all users in the user information includes: According to the user identity information from the server, updating the corresponding entry status information in the user information; The entry status of all users in the user information is determined according to the entry status information corresponding to all user identity information in the updated user information.

12. The method according to any one of claims 9 to 11, wherein: After the face recognition function of the smart door lock is turned off, the method further includes: When it is determined that someone has left the house based on the door opening and closing events detected by the smart door lock, the face recognition function of the smart door lock is restored; Update the entry status information corresponding to all user identity information in the user information.

13. The method according to any one of claims 9 to 11, wherein: After the face recognition function of the smart door lock is turned off, the method further includes: When it is determined that someone has gone out based on the door opening and closing events detected by the smart door lock, obtaining user identity information of the person who has gone out; If the user corresponding to the user identity information belongs to the user in the user information, restoring the face recognition function of the smart door lock; According to the user identity information of the person going out, the corresponding entry status information in the user information is updated.

14. The method according to claim 13, wherein The step of obtaining the user identity information of the person going out includes: Sending a second request to the server, wherein the second request is used to request obtaining user identity information of a person who has left the house during the time period of the door opening event and the door closing event detected by the smart door lock; Receive user identity information from the server.

15. A method for obtaining user identity information, characterized in that: A server applied to a whole-house smart system including a smart door lock is provided. The method includes: receiving a first request from the smart door lock, wherein the first request is for requesting to obtain user identity information of a person entering the door; In response to the first request, obtaining second information collected by devices in the whole-house smart system within a first time period after the smart door lock is unlocked, and determining user identity information of a person who enters the door within the first time period based on the second information; Send the user identity information to the smart door lock.

16. The method according to claim 15, wherein The acquiring of second information collected by the devices in the whole-house smart system within a first time period after the smart door lock is unlocked includes: Acquire images captured by a first camera in the whole-house smart system during the first time period; The determining, based on the second information, the user identity information of the person who enters the door during the first time period includes: Perform image recognition on the image, and determine user identity information of people who enter the door during the first time period based on the image recognition result.

17. The method according to claim 15, wherein The acquiring of second information collected by the devices in the whole-house smart system within a first time period after the smart door lock is unlocked includes: Obtaining information about devices that have established connections detected by a routing device in the whole-house smart system within the first time period; The determining, based on the second information, the user identity information of the person who enters the door during the first time period includes: The corresponding user identity information is determined according to the information of the disconnected device.

18. The method according to claim 15, wherein The acquiring of second information collected by the devices in the whole-house smart system within a first time period after the smart door lock is unlocked includes: Obtaining fingerprint information collected by the control panel in the whole-house intelligent system during the first time period; The determining, based on the second information, the user identity information of the person who enters the door during the first time period includes: The corresponding user identity information is determined according to the fingerprint information collected by the control panel during the first time period.

19. A whole-house intelligent system, characterized in that: It comprises a smart door lock and a server; the smart door lock is used to implement the method as described in any one of claims 1-8, or execute the method as described in any one of claims 9-14; the server is used to implement the method as described in any one of claims 15-18.

20. A smart door lock, characterized in that: include: One or more processors, wherein the one or more processors are configured to execute the method according to any one of claims 1 to 8, or to execute the method according to any one of claims 9 to 14.

21. A server, characterized in that: include: One or more processors configured to execute the method of any one of claims 15-18.

22. A readable storage medium, characterized in that The readable storage medium includes a program, and when the program is run on a device, the device executes the method according to any one of claims 1 to 8, or the method according to any one of claims 9 to 14, or the method according to any one of claims 15 to 18.

23. A chip system, characterized in that: include: The chip system includes at least one chip and a memory, and the at least one chip is used to read and execute the program stored in the memory to implement the method as described in any one of claims 1 to 8, or to implement the method as described in any one of claims 9 to 14, or to implement the method as described in any one of claims 15 to 18.

24. A program product, characterized in that When the program product is run on a device, the device is caused to execute the method according to any one of claims 1 to 8, or the method according to any one of claims 9 to 14, or the method according to any one of claims 15 to 18.

Images