Intelligent door lock face recognition system and device with automatic tracking function

By combining the face position discrimination algorithm and camera angle adjustment motor in the intelligent door lock system, the automatic tracking function is realized, which solves the problem of users frequently adjusting positions, improves recognition efficiency and accuracy, and improves user experience.

CN119251933APending Publication Date: 2025-01-03JIANGXI DINGSHAN INFORMATION TECHNOLOGY CO LTD
View PDF 18 Cites 0 Cited by

Patent Information

Application Number
CN202411064078.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-05
Publication Date
2025-01-03

AI Technical Summary

Technical Problem

Face recognition smart door locks lack automatic tracking function, which causes users to frequently adjust their positions to obtain the best recognition angle, which reduces recognition efficiency and accuracy, and affects user experience and brand image.

Method used

Design an intelligent door lock system that includes door lock main control, face recognition module and camera angle adjustment motor. Through face position discrimination algorithm and camera angle adjustment motor, the motor automatically captures the user's face position and adjusts the camera angle to ensure that the face is always located The center of the picture.

Benefits of technology

It improves the efficiency and accuracy of facial recognition, and improves user experience and customer satisfaction.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119251933A_ABST
    Figure CN119251933A_ABST
Patent Text Reader

Abstract

The invention discloses an intelligent door lock face recognition system and device with an automatic tracking function. The system comprises a door lock master controller which is connected with a lock body and a face recognition module and used for controlling a switch of the face recognition module and obtaining a comparison result of the face recognition module to control the switch of the lock body; the face recognition module is connected with a camera angle adjusting motor and used for conducting face recognition according to the switching instruction of the door lock master controller and sending face position judgment information to the camera angle adjusting motor; the camera angle adjusting motor is used for operating and adjusting the angle of a camera according to the face position judgment information; and the lock body is used for controlling a switch of the lock body according to the comparison result. The face position of the user is automatically captured and the angle of the camera is actively adjusted by using a face position judgment algorithm and a camera angle adjusting motor, so that the face of the user is always positioned in the center of a picture, and the recognition efficiency and accuracy are improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of intelligent door locks and face recognition technology, and in particular to an intelligent door lock face recognition system and device with automatic tracking function. Background Art

[0002] Nowadays, face recognition technology has become a very widely used biometric technology. This technology uses a person's facial appearance characteristics as the analysis target for identity recognition. Like other human biometric features such as fingerprints and irises, face recognition also has the characteristics of uniqueness and difficulty in being copied.

[0003] Facial recognition smart door locks are very popular, but basically no screen is provided for users to align the recognition angle. Therefore, when users perform facial recognition, they will encounter the problem of having to frequently adjust their position to obtain the best recognition angle. The recognition efficiency and accuracy are low, the user experience is relatively poor, which affects the brand image and is not conducive to the spread of brand word-of-mouth. Summary of the invention

[0004] In order to solve the above-mentioned technical problems, the present invention provides a smart door lock face recognition system with automatic tracking function to solve the technical problem that directly transmitting the original sampling value will increase the network transmission pressure and waste disk storage space.

[0005] An intelligent door lock face recognition system with automatic tracking function, comprising:

[0006] The door lock master control is connected to the lock body and the face recognition module, and is used to control the switch of the face recognition module and obtain the comparison result of the face recognition module to control the switch of the lock body;

[0007] A face recognition module, connected to the door lock main control and the camera angle adjustment motor, for performing face recognition according to the switch command of the door lock main control and sending face position determination information to the camera angle adjustment motor;

[0008] A camera angle adjustment motor is connected to the face recognition module and is used to adjust the angle of the camera according to the face position identification information;

[0009] The lock body is connected to the door lock main control and is used to control the switch of the lock body according to the comparison result.

[0010] Preferably, the face recognition module includes:

[0011] A camera, used to obtain a facial image;

[0012] A face comparison algorithm module, used for performing face comparison on the face image;

[0013] The face position identification algorithm module is used to identify the position of the face in the face image.

[0014] Preferably, the door lock master control further includes:

[0015] Human body sensing module, used to detect whether someone is approaching;

[0016] When someone approaches, the door lock master controller sends out the switch command to control the face recognition module to start working.

[0017] Preferably, when someone approaches, the door lock master controller issues the switch command to control the face recognition module to start working, including:

[0018] When sensing that someone is approaching, the door lock master sends the switch command to the camera in the face recognition module;

[0019] The camera captures an image according to the switch instruction to obtain the face image;

[0020] The face image is sent by the camera to the face position identification algorithm module and the face comparison algorithm module;

[0021] The face position identification algorithm module performs recognition based on the face image to obtain the position of the face in the face image;

[0022] The face comparison algorithm module performs recognition and comparison based on the face image, determines whether the person in the face image is a person allowed by the user, and obtains the comparison result.

[0023] Preferably, the camera angle adjustment motor is connected to the face recognition module, comprising:

[0024] The face position identification algorithm module sends the position of the face in the face image to the camera angle adjustment motor;

[0025] The camera angle adjustment motor adjusts the angle of the camera according to the camera angle adjustment motor to automatically track the position of the face in the face image.

[0026] Preferably, after the face comparison algorithm module performs recognition and comparison based on the face image and determines whether the person in the face image is a person allowed by the user, it also includes:

[0027] The comparison result includes a recognition success result and a recognition failure result;

[0028] When it is determined that the person in the face image is a person allowed by the user, the recognition success result is sent to the door lock master control;

[0029] When it is determined that the person in the face image is not or is not certain to be a person permitted by the user, the recognition failure result is sent to the door lock master control.

[0030] Preferably, after the door lock master receives the recognition failure result, the following steps are performed:

[0031] The door lock master controller issues the switch command again, controls the camera to capture the image again, and obtains a new face image;

[0032] The face position identification algorithm module and the face comparison algorithm module re-recognize the new face image.

[0033] A face recognition method for an intelligent door lock with an automatic tracking function, comprising:

[0034] When the human body sensing module senses someone approaching, the door lock master sends a switch command to the camera;

[0035] The camera takes pictures according to the switch instruction to obtain a face image;

[0036] The face position identification algorithm module obtains the position of the face in the face image according to the face image;

[0037] The camera angle adjustment motor adjusts the angle of the camera according to the position of the face in the face image;

[0038] The face comparison algorithm module identifies, based on the face image, whether the person in the face image is a person permitted by the user;

[0039] When it is recognized that the person in the face image is a person allowed by the user, the door lock master controls the lock body to open.

[0040] Preferably, when it is recognized that the person in the face image is not or is not determined to be a person permitted by the user, the method includes:

[0041] The door lock master controller sends the switch command again to control the camera to reacquire the facial image;

[0042] The face comparison algorithm module re-identifies the face according to the re-acquired face image;

[0043] The face position identification algorithm module re-acquires the position of the face in the face image according to the re-acquired face image, and adjusts the angle of the camera;

[0044] When it is recognized that the person in the re-acquired face image is a person allowed by the user, the door lock master controls the lock body to open.

[0045] An electronic device comprises: a processor and a memory, wherein the memory is used to store computer program codes, and the computer program codes include computer instructions. When the processor executes the computer instructions, the electronic device executes the face recognition method for a smart door lock with an automatic tracking function as described in any one of claims 8 to 9.

[0046] The present invention discloses a smart door lock face recognition system and device with automatic tracking function. The system includes a door lock master control, which is connected to a lock body and a face recognition module, and is used to control the switch of the face recognition module and obtain the comparison result of the face recognition module to control the switch of the lock body; the face recognition module is connected to a camera angle adjustment motor, and is used to perform face recognition according to the switch instruction of the door lock master control, and send face position discrimination information to the camera angle adjustment motor; the camera angle adjustment motor is used to adjust the angle of the camera according to the face position discrimination information; the lock body is used to control the switch of the lock body according to the comparison result. The present invention uses a face position discrimination algorithm and a camera angle adjustment motor to automatically capture the user's face position and actively adjust the camera angle, ensuring that the user's face is always located in the center of the picture, thereby accelerating recognition efficiency and accuracy.

[0047] It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the background technology, the drawings required for use in the embodiments of the present invention or the background technology will be described below.

[0049] The drawings herein are incorporated into the specification and constitute a part of the specification. These drawings illustrate embodiments consistent with the present disclosure and, together with the specification, are used to illustrate the technical solutions disclosed in the present invention.

[0050] Figure 1 A schematic diagram of a smart door lock face recognition system with automatic tracking function provided by an embodiment of the present invention;

[0051] Figure 2 A schematic diagram of a process flow of a smart door lock face recognition system with automatic tracking function provided by an embodiment of the present invention;

[0052] Figure 3 A schematic flow chart of a face recognition method for a smart door lock with automatic tracking function provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0053] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0054] The terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units that are not listed, or may optionally include other steps or units that are inherent to these processes, methods, products or devices.

[0055] The term "and / or" herein is only a description of the association relationship of the associated objects, indicating that there may be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the term "at least one" herein represents any combination of at least two of any one or more of a plurality of. For example, including at least one of A, B, and C can represent including any one or more elements selected from the set consisting of A, B, and C.

[0056] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present invention. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0057] In addition, in order to better illustrate the present invention, numerous specific details are provided in the following specific embodiments. It should be understood by those skilled in the art that the present invention can be implemented without certain specific details. In some examples, methods, means, components and circuits well known to those skilled in the art are not described in detail in order to highlight the subject matter of the present invention.

[0058] Nowadays, face recognition technology has become a very widely used biometric technology. This technology uses a person's facial appearance characteristics as the analysis target for identity recognition. Like other human biometric features such as fingerprints and irises, face recognition also has the characteristics of uniqueness and difficulty in being copied.

[0059] Facial recognition smart door locks are very popular, but basically no screen is provided for users to align the recognition angle. Therefore, when users perform facial recognition, they will encounter the problem of having to frequently adjust their position to obtain the best recognition angle. The recognition efficiency and accuracy are low, the user experience is relatively poor, which affects the brand image and is not conducive to the spread of brand word-of-mouth.

[0060] The present invention discloses a smart door lock face recognition system and device with automatic tracking function. The system includes a door lock master control, which is connected to a lock body and a face recognition module, and is used to control the switch of the face recognition module and obtain the comparison result of the face recognition module to control the switch of the lock body; the face recognition module is connected to a camera angle adjustment motor, and is used to perform face recognition according to the switch instruction of the door lock master control, and send face position discrimination information to the camera angle adjustment motor; the camera angle adjustment motor is used to adjust the angle of the camera according to the face position discrimination information; the lock body is used to control the switch of the lock body according to the comparison result. The present invention uses a face position discrimination algorithm and a camera angle adjustment motor to automatically capture the user's face position and actively adjust the camera angle, ensuring that the user's face is always located in the center of the picture, accelerating recognition efficiency and accuracy, and improving customer satisfaction.

[0061] Example 1

[0062] A smart door lock face recognition system with automatic tracking function, reference Figure 1 ,include:

[0063] The door lock master is connected to the lock body and the face recognition module, and is used to control the switch of the face recognition module and obtain the comparison result of the face recognition module to control the switch of the lock body;

[0064] The face recognition module is connected to the door lock main control and the camera angle adjustment motor, and is used to perform face recognition according to the switch command of the door lock main control and send face position determination information to the camera angle adjustment motor;

[0065] The camera angle adjustment motor is connected to the face recognition module and is used to adjust the angle of the camera according to the face position identification information;

[0066] In this embodiment, the camera angle adjustment motor is a brushless drive motor that can control the left and right and up and down rotation axes to adjust the camera angle and place the face in the center of the face image;

[0067] The lock body is connected to the door lock main control and is used to control the switch of the lock body according to the comparison result.

[0068] Preferably, the face recognition module, reference Figure 1 ,include:

[0069] A camera, used to obtain a facial image;

[0070] The face comparison algorithm module is used to compare the face images;

[0071] The face position identification algorithm module is used to identify the position of the face in the face image;

[0072] The face position identification algorithm module can quickly identify the user's face position, provide information on the deviation distance from the image center, and determine the position of the face in the face image.

[0073] Preferably, the door lock master, refer to Figure 1 , also includes:

[0074] Human body sensing module, used to detect whether someone is approaching;

[0075] When someone approaches, the door lock master controller sends a switch command to control the face recognition module to start working.

[0076] Preferably, when someone approaches, the door lock master sends a switch command to control the face recognition module to start working. Figure 2 ,include:

[0077] When it senses someone approaching, the door lock master sends a switch command to the camera in the face recognition module;

[0078] The camera captures images according to the switch command to obtain a face image;

[0079] The face image is sent by the camera to the face position identification algorithm module and the face comparison algorithm module;

[0080] The face position identification algorithm module recognizes the face image and obtains the face position in the face image;

[0081] The face matching algorithm module performs recognition and matching based on the face image, determines whether the person in the face image is a person allowed by the user, and obtains the matching result.

[0082] Preferably, the camera angle adjustment motor is connected to the face recognition module, including:

[0083] The face position identification algorithm module sends the face position in the face image to the camera angle adjustment motor;

[0084] The camera angle adjustment motor adjusts the angle of the camera according to the camera angle adjustment motor, and automatically tracks the position of the face in the face image.

[0085] Preferably, after the face comparison algorithm module performs recognition and comparison based on the face image and determines whether the person in the face image is a person allowed by the user, it also includes:

[0086] The comparison results include successful identification results and failed identification results;

[0087] When it is determined that the person in the face image is a person allowed by the user, the recognition success result is sent to the door lock master control;

[0088] When it is determined that the person in the face image is not or is not certain to be the person allowed by the user, a recognition failure result is sent to the door lock master control.

[0089] Preferably, when the door lock master receives the recognition failure result, refer to Figure 2 ,include:

[0090] The door lock master sends a switch command again to control the camera to take images again and obtain a new face image;

[0091] The face position identification algorithm module and the face comparison algorithm module re-recognize the new face image.

[0092] Example 2

[0093] A face recognition method for smart door locks with automatic tracking function, reference Figure 3 ,include:

[0094] S100, when the human body sensing module senses that someone is approaching, the door lock master sends a switch command to the camera;

[0095] S200, the camera shoots according to the switch instruction to obtain a face image;

[0096] S300, the face position identification algorithm module obtains the position of the face in the face image according to the face image;

[0097] S400, a camera angle adjustment motor adjusts the angle of the camera according to the position of the face in the face image;

[0098] S500, the face comparison algorithm module identifies whether the person in the face image is a person allowed by the user according to the face image;

[0099] S600, when the person in the face image is recognized as a person allowed by the user, the door lock master controls the lock body to open.

[0100] Preferably, when it is recognized that the person in the face image is not or is not determined to be a person permitted by the user, the method includes:

[0101] The door lock master controller sends a switch command again to control the camera to reacquire the face image;

[0102] The face matching algorithm module re-identifies the face based on the re-acquired face image;

[0103] The face position identification algorithm module re-acquires the face position in the face image based on the re-acquired face image, and adjusts the angle of the camera;

[0104] When it is recognized that the person in the re-acquired face image is a person allowed by the user, the door lock master controls the lock body to open.

[0105] Example 3

[0106] An electronic device comprises: a processor and a memory, the memory is used to store computer program code, the computer program code comprises computer instructions, when the processor executes the computer instructions, the electronic device executes a smart door lock face recognition method with automatic tracking function according to any one of claims 8 to 9.

[0107] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0108] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here. Those skilled in the art can also clearly understand that the descriptions of the various embodiments of the present invention have different focuses. For the convenience and brevity of description, the same or similar parts may not be repeated in different embodiments. Therefore, for parts not described or not described in detail in a certain embodiment, refer to the records of other embodiments.

[0109] In the several embodiments provided by the present invention, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0110] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0111] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0112] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented by software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present invention is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted through the computer-readable storage medium. The computer instructions can be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a digital versatile disc (DVD)), or a semiconductor medium (eg, a solid state disk (SSD)).

[0113] A person skilled in the art can understand that to implement all or part of the processes in the above-mentioned embodiments, the processes can be completed by a computer program to instruct the relevant hardware, and the program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the above-mentioned method embodiments. The aforementioned storage medium includes: a read-only memory (ROM) or a random access memory (RAM), a magnetic disk or an optical disk, and other media that can store program codes.

Claims

1. A smart door lock face recognition system with automatic tracking function, characterized in that: include: The door lock master control is connected to the lock body and the face recognition module, and is used to control the switch of the face recognition module and obtain the comparison result of the face recognition module to control the switch of the lock body; A face recognition module, connected to the door lock main control and the camera angle adjustment motor, for performing face recognition according to the switch command of the door lock main control and sending face position determination information to the camera angle adjustment motor; A camera angle adjustment motor is connected to the face recognition module and is used to adjust the angle of the camera according to the face position identification information; The lock body is connected to the door lock main control and is used to control the switch of the lock body according to the comparison result.

2. According to claim 1, a smart door lock face recognition system with automatic tracking function is characterized in that: The face recognition module comprises: A camera, used to obtain a facial image; A face comparison algorithm module, used for performing face comparison on the face image; The face position identification algorithm module is used to identify the position of the face in the face image.

3. The intelligent door lock face recognition system with automatic tracking function according to claim 2 is characterized in that: The door lock master control also includes: Human body sensing module, used to detect whether someone is approaching; When someone approaches, the door lock master controller sends out the switch command to control the face recognition module to start working.

4. The intelligent door lock face recognition system with automatic tracking function according to claim 3 is characterized in that: When someone approaches, the door lock master controller sends out the switch command to control the face recognition module to start working, including: When sensing that someone is approaching, the door lock master sends the switch command to the camera in the face recognition module; The camera captures an image according to the switch instruction to obtain the face image; The face image is sent by the camera to the face position identification algorithm module and the face comparison algorithm module; The face position identification algorithm module performs recognition based on the face image to obtain the position of the face in the face image; The face comparison algorithm module performs recognition and comparison based on the face image, determines whether the person in the face image is a person allowed by the user, and obtains the comparison result.

5. The intelligent door lock face recognition system with automatic tracking function according to claim 4 is characterized in that: The camera angle adjustment motor is connected to the face recognition module and includes: The face position identification algorithm module sends the position of the face in the face image to the camera angle adjustment motor; The camera angle adjustment motor adjusts the angle of the camera according to the camera angle adjustment motor to automatically track the position of the face in the face image.

6. The intelligent door lock face recognition system with automatic tracking function according to claim 5 is characterized in that: After the face comparison algorithm module performs recognition and comparison based on the face image and determines whether the person in the face image is a person allowed by the user, it also includes: The comparison result includes a recognition success result and a recognition failure result; When it is determined that the person in the face image is a person allowed by the user, the recognition success result is sent to the door lock master control; When it is determined that the person in the face image is not or is not certain to be a person permitted by the user, the recognition failure result is sent to the door lock master control.

7. The intelligent door lock face recognition system with automatic tracking function according to claim 6 is characterized in that: When the door lock master receives the recognition failure result, it includes: The door lock master controller issues the switch command again, controls the camera to capture the image again, and obtains a new face image; The face position identification algorithm module and the face comparison algorithm module re-recognize the new face image.

8. A face recognition method for an intelligent door lock with automatic tracking function, characterized in that: include: When the human body sensing module senses someone approaching, the door lock master sends a switch command to the camera; The camera takes pictures according to the switch instruction to obtain a face image; The face position identification algorithm module obtains the position of the face in the face image according to the face image; The camera angle adjustment motor adjusts the angle of the camera according to the position of the face in the face image; The face comparison algorithm module identifies, based on the face image, whether the person in the face image is a person permitted by the user; When it is recognized that the person in the face image is a person allowed by the user, the door lock master controls the lock body to open.

9. The intelligent door lock face recognition system with automatic tracking function according to claim 8, characterized in that: When it is recognized that the person in the face image is not or is not determined to be a person permitted by the user, the method includes: The door lock master controller sends the switch command again to control the camera to reacquire the facial image; The face comparison algorithm module re-identifies the face according to the re-acquired face image; The face position identification algorithm module re-acquires the position of the face in the face image according to the re-acquired face image, and adjusts the angle of the camera; When it is recognized that the person in the re-acquired face image is a person allowed by the user, the door lock master controls the lock body to open.

10. An electronic device, characterized in that: include: A processor and a memory, the memory being used to store computer program codes, the computer program codes comprising computer instructions, and when the processor executes the computer instructions, the electronic device executes a smart door lock face recognition method with automatic tracking function as described in any one of claims 8 to 9.

Citation Information

Patent Citations

  • Shooting angle adjustment method and device for camera

    CN105357442A

  • Interactive robot on basis of human face detection

    CN106355242A

  • Face recognition-based unlocking method and door lock

    CN107146305A

  • Camera automatic adjustment method and device, equipment and storage medium

    CN110460772A

  • Method and system for adaptively improving face image acquisition and storage medium

    CN110738142A