Early warning system based on face recognition smart door lock

By introducing sensing and alarm drive devices into face recognition smart door locks, the problem of not being able to drive away wandering strangers in time in the prior art is solved, and timely alarm and drive away strangers are realized, and user safety is improved sex.

CN115691020BActive Publication Date: 2024-11-12LANGYUAN TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202211407431.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-11-10
Publication Date
2024-11-12
Estimated Expiration
2042-11-10

AI Technical Summary

Technical Problem

The existing facial recognition smart door lock cannot alarm in time to drive away strangers who are wandering, which poses a security threat.

Method used

An early warning system based on face recognition smart door lock is designed, including a sensing device, a face image acquisition device, a control device and an alarm drive device. By detecting the person signal to be identified, collecting face image information, and determining whether it is A face template has been built. If otherwise, the alarm will be driven away, and the alarm method will be determined based on the distance between the person to be identified and the residence time.

Benefits of technology

Effectively protect users' safety, drive away strangers in time through alarm drive devices (such as buzzers and speakers), and further treat them with tear gas or thick smoke when necessary, improving the user's sense of security.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115691020B_ABST
    Figure CN115691020B_ABST
Patent Text Reader

Abstract

The present application discloses an early warning system based on face recognition intelligent door lock, characterized in that it comprises: a control device (1); a storage device (2), a face image acquisition device (3), a display device (4), a sensing device (5), a door lock control device (8) and an alarm and expulsion device (9) electrically connected to the control device (1). An early warning system based on face recognition intelligent door lock is established by combining the alarm and expulsion device with the face recognition intelligent door lock, and the control device (1) determines whether the face in the face image information is a face in the established face template, and according to the determination result, an alarm and expulsion are performed on the strangers lingering at the door.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of smart door locks, and in particular to an early warning system based on face recognition smart door locks. Background Art

[0002] In recent years, thanks to the development of face recognition technology, various smart door locks based on face recognition technology have appeared on the market. The basic principle of these face recognition smart door locks is to identify the biological characteristics of the current face, establish a face feature template, and then compare and analyze it with the established face feature template. According to the results of the comparison and analysis, it is determined whether the person being tested is a user. If it is a user, the door lock is controlled to open. If it is not a user, the door lock will not open.

[0003] The widespread use of facial recognition smart door locks has greatly improved the convenience of opening doors and reduced the anxiety caused by lost keys compared to traditional key opening methods.

[0004] As people's safety awareness increases, they pay more and more attention to guarding against strangers, especially families with children, who need to guard against the dangers posed by strangers to their children. However, for strangers wandering at the door, the current face recognition smart door locks cannot promptly alarm and drive them away, and cannot remind users that strangers stalking, peeping or eavesdropping outside the door may pose a considerable threat to the safety of home users.

[0005] Therefore, it is necessary to provide an early warning system based on face recognition smart door lock. Summary of the invention

[0006] The embodiment of the present application provides a related technical solution of an early warning system of a face recognition smart door lock, so as to solve the technical problem in the prior art that the face recognition smart door lock cannot drive away strangers wandering at the door.

[0007] The present application provides an early warning system based on face recognition smart door lock, which is characterized by comprising:

[0008] Control device; a storage device, a face image acquisition device, a display device, a sensing device, a door lock control device and an alarm expulsion device electrically connected to the control device respectively;

[0009] in,

[0010] The sensing device detects a signal of a person to be identified within a detection range, and generates a start-up working signal of the face image acquisition device according to the signal of the person to be identified detected by the sensing device;

[0011] According to the start-up working signal, the face image acquisition device acquires face image information of the person to be identified and transmits the face image information of the person to be identified to the control device;

[0012] The control device determines whether the face in the face image information is a face in the established face template,

[0013] If so, the control device controls the door lock control device to open the door lock;

[0014] If not, the control device controls the alarm driving device to drive away the alarm.

[0015] Furthermore, it also includes a timing device, and after the sensing device detects the signal of the person to be identified within the detection range, the timing device starts timing;

[0016] The control device controlling the alarm driving device to drive away the alarm further comprises:

[0017] The sensing device measures the distance between the person to be identified and the door;

[0018] The control device receives the distance between the person to be identified and the door, and determines whether the distance between the person to be identified and the door is less than or equal to a first distance.

[0019] If so, the control device controls the alarm driving device to perform a first alarm driving;

[0020] If not, the control device determines whether the distance between the person to be identified and the door is greater than the first distance and less than or equal to the second distance, and the first distance is less than or equal to the second distance;

[0021] If so, when the timing of the timing device is greater than the set time, the sensing device measures the distance between the person to be identified and the door again; the control device determines whether the distance between the person to be identified and the door measured again is greater than the first distance and less than or equal to the second distance;

[0022] If so, the control device (1) controls the alarm driving device to perform a second alarm driving.

[0023] Furthermore, the facial image information of the person to be identified includes the facial image of the person to be identified or processed data information of the facial image of the person to be identified.

[0024] Furthermore, the distance between the person to be identified and the door also includes the distance between the person to be identified and the door lock, the distance between the person to be identified and the door frame, or the distance between the person to be identified and the door (both sides of the wall).

[0025] Furthermore, the alarm and expulsion device (9) comprises a buzzer and / or a speaker.

[0026] The embodiment of the present application also provides an early warning method based on face recognition smart door lock, which is characterized by comprising the following steps:

[0027] Step S1, using a sensing device to detect a signal of a person to be identified within a detection range, and generating a start-up working signal of a face image acquisition device according to the signal of the person to be identified detected by the sensing device;

[0028] Step S2, according to the start working signal, the face image acquisition device acquires face image information of the person to be identified and transmits the face image information of the person to be identified to the control device;

[0029] Step S3, the control device determines whether the face in the face image information is a face in the established face template.

[0030] Step S31, if yes, the control device controls the door lock control device to open the door lock;

[0031] Step S32: If not, the control device (1) controls the alarm dispelling device to perform alarm dispelling.

[0032] 7. The early warning method based on face recognition smart door lock according to claim 6 is characterized in that after the sensing device detects the signal of the person to be identified within the detection range, the timing device starts timing;

[0033] The control device controlling the alarm driving device to drive away the alarm further comprises:

[0034] The sensing device measures the distance between the person to be identified and the door;

[0035] The control device receives the distance between the person to be identified and the door, and determines whether the distance between the person to be identified and the door is less than or equal to a first distance.

[0036] If so, the control device controls the alarm driving device to perform a first alarm driving;

[0037] If not, the control device determines whether the distance between the person to be identified and the door is greater than the first distance and less than or equal to the second distance, and the first distance is less than or equal to the second distance;

[0038] If so, when the timing of the timing device is greater than the set time, the sensing device measures the distance between the person to be identified and the door again; the control device determines whether the distance between the person to be identified and the door measured again is greater than the first distance and less than or equal to the second distance;

[0039] If so, the control device controls the alarm driving device to perform a second alarm driving.

[0040] Furthermore, the facial image information of the person to be identified includes the facial image of the person to be identified or processed data information of the facial image of the person to be identified.

[0041] Furthermore, the distance between the person to be identified and the door also includes the distance between the person to be identified and the door lock, the distance between the person to be identified and the door frame, or the distance between the person to be identified and the walls on both sides of the door.

[0042] Furthermore, the alarm and expulsion device includes a buzzer and / or a speaker.

[0043] Furthermore, it is characterized in that the alarm and expulsion device includes a buzzer and / or a speaker.

[0044] The embodiments provided in this application have at least the following beneficial effects:

[0045] An early warning system based on face recognition smart door locks is established by combining an alarm and expulsion device with a face recognition smart door lock. The control device determines whether the face in the face image information is a face in an established face template. Based on the determination result, an alarm is issued to expel strangers loitering at the door to protect user safety. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0047] Figure 1 A schematic diagram of a module of an early warning system based on face recognition smart door lock provided in an embodiment of the present application;

[0048] Figure 2 This is a flow chart of the early warning method based on face recognition smart door lock of Example 3;

[0049] Figure 3 This is a flow chart of the early warning method based on face recognition smart door lock of Example 4;

[0050] Figure 4 It is a schematic diagram of the installation of the sensor device;

[0051] Figure 1-4 In: 1. Control device; 2. Storage device; 3. Face image acquisition device; 4. Display device; 5. Sensing device; 6. Timing device; 7. Communication device; 8. Door lock control device; 9. Alarm and expulsion device; 10. Door; 11. Wall; 13. Sensor device; 14. Door handle. DETAILED DESCRIPTION

[0052] In order to make the purpose, technical solution and advantages of the present application clearer, the technical solution of the present application will be clearly and completely described below in combination with the specific embodiments of the present application and the corresponding drawings. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present application.

[0053] Example 1

[0054] Please refer to Figure 1 , the present application provides an early warning system based on face recognition smart door lock, including:

[0055] Control device 1; storage device 2, face image acquisition device 3, display device 4, sensing device 5, timing device 6, door lock control device 8 and alarm expulsion device 9 electrically connected to the control device 1; wherein,

[0056] The sensing device 5 detects a signal of a person to be identified within a detection range;

[0057] It should be noted that the person to be identified here can be a stranger or a user, the same below.

[0058] Furthermore, the sensing device 5 includes a radar or infrared detection device or the like.

[0059] After the sensing device 5 detects the signal of the person to be identified within the detection range, the sensing device 5 generates a start-up working signal for the face image acquisition device 3 according to the signal of the person to be identified detected by the sensing device 5; according to the start-up working signal, the face image acquisition device 3 acquires the face image information of the person to be identified and transmits the face image information of the person to be identified to the control device 1;

[0060] It should be noted that, when the radar or infrared detection device senses the signal of the person to be identified, it can directly send the start-up working signal of the facial image acquisition device 3 to the facial image acquisition device 3; it can also send the start-up working signal of the facial image acquisition device 3 to the control device 1, and the control device 1 sends the start-up working signal of the facial image acquisition device 3 to the facial image acquisition device 3 to acquire the facial image; the sensing device 5 can also send the signal of the person to be identified to the control device 1, and the control device 1 generates the start-up working signal of the facial image acquisition device 3, and sends the start-up working signal of the facial image acquisition device 3 to the facial image acquisition device 3 to acquire the facial image. Facial image acquisition is not limited to the above method, and the facial image acquisition device 3 can also have a variety of other start-up methods for acquiring facial images.

[0061] It should be noted that the facial image information of the person to be identified includes the facial image of the person to be identified or data information after the facial image of the person to be identified is processed.

[0062] The control device 1 determines whether the face in the face image information is a face in the established face template.

[0063] If yes, the control device 1 controls the door lock control device 8 to open the door lock;

[0064] It should be noted that the control device 1 includes a data processing unit such as a CPU and a GPU, and the storage device 2 pre-stores a built face template. The face template is pre-collected by the face image acquisition device 3 with all the user's facial features or body features, processed into vector data and stored in the storage device 2 to form a built face template. The control device 1 receives a face image of a person to be recognized, converts the face image value into a vector, calls the built face template vector data pre-stored in the storage device 2, and determines whether the similarity between the face recognition image and the vector data in the built face template is greater than a preset value. If the similarity is greater than the preset value, an unlocking command is issued to the door lock control device 8 to open the door lock.

[0065] The storage device 2 may be any non-volatile storage device 2 or a combination of volatile and non-volatile storage devices 2, including but not limited to ROM, RAM, SRAM, EEPROM, Flash, etc.

[0066] Furthermore, the control device 1 may also include a storage unit (with a built-in storage unit), and the established face template is pre-stored in the storage unit of the control device 1. The control device 1 can directly retrieve the established face template vector data from the storage unit and compare it with the collected face image vector data of the person to be identified. Compared with calling the established face template from the external storage device 2, the processing speed is faster.

[0067] If not, the control device 1 controls the alarm driving device 9 to drive away the alarm.

[0068] It should be noted that the control device 1 determines whether the similarity between the face recognition image and the vector data in the established face template is greater than a preset value. If the similarity is not greater than the preset value, an alarm expulsion instruction is issued to the alarm expulsion device 9 for alarm expulsion.

[0069] It should be noted that the alarm and expulsion device 9 can be a buzzer or a speaker or a combination of the two. The buzzer can emit a harsh buzzing sound to alarm and expel, and the speaker can play an alarm sound and a recording asking the stranger to leave.

[0070] Further, whether the similarity between the face recognition image and the vector data in the established face template is greater than a preset value, if the similarity is not greater than the preset value, the person to be recognized is a stranger, and the picture or video of the stranger staying at the door is recorded in the storage device 2 for the user to view after returning home;

[0071] Furthermore, the communication device 7 will send the image or video of the person to be identified to the user according to the command of the control device 1 or spontaneously for the user to view.

[0072] Furthermore, after the alarm is sounded and the stranger still does not leave, the control device 1 will control the start of releasing tear gas or thick smoke or spraying water to further drive the stranger away.

[0073] Example 2

[0074] Compared with the first embodiment, the second embodiment adopts different alarm and expulsion methods for strangers at different distances from the door 10, which is more scientific and humane. For strangers very close to the door 10, the alarm is immediately triggered to expel them. For strangers not too far away, whether to expel them is determined based on the time the strangers stay. For strangers far away from the door 10, they may be passing strangers and pose little threat to the user's safety, so no alarm is triggered.

[0075] It should be noted that the distance from the door 10 may be the distance from the door lock, the distance from the walls 11 on both sides of the door 10, or the distance directly detected by a sensor on or beside the door.

[0076] Please refer to Figure 2 , this embodiment provides an early warning system based on face recognition smart door lock, including:

[0077] A control device 1, a storage device 2, a face image acquisition device 3, a display device 4, a sensing device 5, a timing device 6, a door lock control device 8 and an alarm expelling device 9 electrically connected to the control device 1;

[0078] in,

[0079] The sensing device 5 detects a signal of a person to be identified within a detection range;

[0080] It should be noted that the sensing device 5 detects the signal of the person to be identified within the detection range in the same manner as in Embodiment 1, and will not be described in detail herein.

[0081] After the sensing device 5 detects the signal of the person to be identified within the detection range, it generates a start-up working signal for the facial image acquisition device 3 according to the signal of the person to be identified detected by the sensing device 5; according to the start-up working signal, the facial image acquisition device 3 acquires the facial image information of the person to be identified and transmits the facial image information of the person to be identified to the control device 1.

[0082] It should be noted that the facial image acquisition device 3 acquires the facial image of the person to be identified according to the signal of the person to be identified within the detection range and transmits it to the control device 1. The parts that are the same as those in Example 1 are not repeated here. The facial image acquisition device 3 can acquire the facial image through multiple image sensors.

[0083] Furthermore, the face image acquisition device 3 also includes a sensor for acquiring a frontal face image, and at least two sensors for acquiring side face images, such as Figure 4 As shown, the sensors for collecting the side images of the left and right faces are part of the sensor device 13. The sensors for collecting the side images of the left and right faces are installed by tracks, rotating devices, etc., and can be adjusted to a suitable height and angle according to the side face position collected by the front face collection sensor image;

[0084] Furthermore, the sensors for collecting the left and right side face images can adjust their height and angle to obtain a side full-body image of the person to be identified. By combining the obtained side full-body image with the front face image to form a stereoscopic image, the obtained portrait is more realistic and it is easier to identify the physical features of the person to be identified.

[0085] Furthermore, the shape of the auricle is an important feature in the biometric characteristics of the face in criminal investigation. The face image acquisition device 3 also includes at least two left and right auricle image acquisition sensors. At least the two left and right auricle image acquisition sensors can be part of the sensor device 13. The two auricle image acquisition sensors are installed using tracks, rotating devices, etc. The left and right auricle image acquisition sensors are adjusted to a suitable height and angle according to the position of the auricle captured by the front face acquisition sensor image; the left and right auricle image acquisition sensors can automatically remove shadows, flashes and other parts according to the captured image to obtain a real auricle image.

[0086] The control device 1 determines whether the face in the face image information is a face in the established face template.

[0087] If yes, the control device 1 controls the door lock control device 8 to open the door lock;

[0088] If not, the timing device 6 starts timing after the sensing device 5 detects the signal of the person to be identified within the detection range;

[0089] It should be noted that the timing device 6 starts timing immediately after the signal of the person to be identified is detected within the detection range, or it can start timing after a period of time has passed since the signal of the person to be identified is detected; the timing device 6 can be a timing device 6 of general accuracy, for example, a built-in electronic timing clock, or a high-precision timing device 6 can be used.

[0090] The sensing device 5 measures the distance between the person to be identified and the door 10;

[0091] The sensing device 5 is as follows Figure 4 The sensor device 13 is a part of the sensor device 13, and the sensor device 13 includes a distance measuring device. The distance measuring device can adopt a distance measuring instrument such as a radar distance measurement and an infrared distance measurement. It can measure the distance between a person's face and a door lock, and can also measure the distance between other parts of a person and the door lock, or the distance between a person and a sensor on or beside the door 10. The distance between a person and a door is not limited to this, and can also be other distances that can be thought of in this field.

[0092] The control device 1 determines whether the distance between the person to be identified and the door lock is less than or equal to the first distance. If so, the control device 1 controls the alarm expulsion device 9 to perform an alarm expulsion;

[0093] It should be noted that after receiving the distance between the person to be identified and the door lock, the control device 1 compares it with the preset first distance. If so, whether the distance between the person to be identified and the door lock is less than or equal to the first distance, the control device 1 controls the alarm and expulsion device 9 to alarm and expel; the purpose of this design is to prevent strangers from approaching the door. The first distance can be set by the user according to his or her own needs. The face recognition intelligent door lock early warning system has a human-machine interface, and the user can input the first distance value through the human-machine interface; 0.5m, 1m and other relatively close distances are all first distance values ​​that can be considered; as the sensor is used for a longer time and its performance ages, the user can also set a first distance compensation value for the first distance.

[0094] If not, the control device 1 determines that the distance between the person to be identified and the door lock is greater than the first distance and less than or equal to the second distance, and the first distance is less than or equal to the second distance;

[0095] If so, the control device 1 determines whether the person's stay time is greater than a set time;

[0096] It should be noted that when the timing of the timing device 6 is greater than the set time, the sensing device 5 measures the distance between the person to be identified and the door 10 again; the control device 1 determines whether the distance between the person to be identified and the door 10 measured again is greater than the first distance and less than or equal to the second distance; if so, this means that the person's stay time is greater than the set time.

[0097] It should be noted that, for a stranger who is more than the first distance from the door 10, there is no urgent need to call the police, and the situation of the stranger needs to be further judged;

[0098] If so, the control device 1 controls the alarm driving device 9 to drive away the alarm.

[0099] For a stranger between the first distance and the second distance from the door lock, if he stays for more than a certain period of time, the stranger may be scouting, eavesdropping or peeping, which poses a certain threat to the user's safety. It is necessary to alarm and drive the stranger away; for a stranger who is greater than the second distance from the door lock, he may be a stranger passing by the user's house. Usually, he poses a smaller threat to the user's safety and no alarm is required.

[0100] It should be noted that the alarm and expulsion device 9 can be a buzzer or a speaker or a combination of the two. The buzzer can emit a harsh buzzing sound, and the speaker can play a recording asking the person to be identified to leave.

[0101] Further, the picture or video of the stranger staying at the door is recorded in the storage device 2 for the user to view after returning home;

[0102] Furthermore, the communication device 7 will send the image or video of the person to be identified to the user according to the command of the control device 1 or spontaneously for the user to view.

[0103] Furthermore, if the person to be identified still does not leave after the alarm is sounded, the control device 1 will control the release of tear gas or thick smoke or water to further drive the person to be identified to leave.

[0104] Furthermore, the door handle 14 and / or the door 10 are covered with flexible sensors. If a stranger takes violent actions, the flexible sensors will be damaged, and the communication device 7 can send the collected information such as the stranger's fingerprint to the user's mobile phone and report to the public security agency.

[0105] Example 3

[0106] Accordingly, the embodiment of the present application provides an early warning method based on face recognition smart door lock, which is characterized by comprising the following steps:

[0107] Step S1, the sensing device 5 detects the signal of the person to be identified within the detection range;

[0108] Furthermore, the sensing device 5 includes a radar or an infrared sensor, etc.; radar reflection waves, infrared reflection ranging, etc. can be used to perform measurements at a distance.

[0109] Step S2, the face image acquisition device 3 acquires the face image of the person to be identified according to the signal of the person to be identified within the detection range and transmits it to the control device 1;

[0110] It should be noted that when the radar or infrared sensor senses the signal of the person to be identified, it can directly send a facial image acquisition command to the facial image acquisition device 3; it can also send the facial image acquisition command to the control device 1, so that the control device 1 will send the facial image acquisition command to the facial image acquisition device 3 for facial image acquisition; the sensing device 5 can also send the signal of sensing the person to be identified to the control device 1, and the control device 1 will send the facial image acquisition command to the facial image acquisition device 3 for facial image acquisition.

[0111] Step S3, the control device 1 determines whether the face in the face image is a face in the established face template.

[0112] Step S31: If yes, the control device 1 controls the door lock control device 8 to open the door lock;

[0113] It should be noted that the control device 1 includes data processing units such as CPU and GPU, and the storage device 2 pre-stores a built face template. The face template is pre-collected by the face image acquisition device 3 with all user facial features to form vector data stored in the storage device 2 to form a built face template.

[0114] The control device 1 receives a facial image of a person to be identified, converts the facial image data value into a vector, calls the storage device 2 which has pre-stored vector data of an established facial template, and determines whether the similarity between the facial recognition image and the vector data in the established facial template is greater than a preset value. If the similarity is greater than the preset value, an unlocking command is issued to the door lock control device 8 to open the door lock.

[0115] The storage device 2 may be various non-volatile storage devices 2 or a combination of volatile and non-volatile storage devices 2, including but not limited to ROM, RAM, SRAM, EEPROM, Flash, etc.

[0116] Furthermore, the control device 1 may also include a storage unit, and the constructed face template is pre-stored in the storage unit of the control device 1. The control device 1 can directly retrieve the constructed face template vector data from the storage unit and compare it with the collected face image vector data of the person to be identified. Compared with calling the constructed face template from the external storage device 2, the speed is faster.

[0117] Furthermore, the control device 1 determines whether the similarity between the face recognition image and the vector data in the established face template is greater than a preset value. If the similarity is not greater than the preset value, an alarm expulsion instruction is issued to the alarm expulsion device 9 for alarm expulsion.

[0118] Step S32: If not, the control device 1 controls the alarm driving device 9 to drive away the alarm.

[0119] It should be noted that the alarm and expulsion device 9 can be a buzzer or a speaker or a combination of the two. The buzzer can emit a harsh buzzing sound, and the speaker can play a recording asking the person to be identified to leave.

[0120] Further, the picture or video of the stranger staying at the door is recorded in the storage device 2 for the user to view after returning home;

[0121] Furthermore, the communication device 7 will send the image or video of the person to be identified to the user according to the command of the control device 1 or spontaneously for the user to view.

[0122] Furthermore, if the person to be identified still does not leave after the alarm is sounded, the control device 1 will control the release of tear gas or thick smoke or water to further drive the person to be identified to leave.

[0123] Example 4

[0124] Accordingly, the embodiment of the present application provides an early warning method based on face recognition smart door lock, which is characterized by comprising the following steps:

[0125] Step S1, using the sensing device 5 to detect the signal of the person to be identified within the detection range;

[0126] It should be noted that the sensing device 5 detects the signal of the person to be identified within the detection range in the same manner as in Embodiment 3, which will not be described in detail herein.

[0127] Step S2, the face image acquisition device 3 acquires the face image of the person to be identified according to the signal of the person to be identified within the detection range and transmits it to the control device 1;

[0128] It should be noted that the face image acquisition device 3 acquires the face image of the person to be identified according to the signal of the person to be identified within the detection range and transmits it to the control device 1. The same parts as those in Example 1 are not repeated here. The face image acquisition device 3 can acquire the face image through multiple image sensors.

[0129] Furthermore, the face image acquisition device 3 also includes a sensor for acquiring a frontal face image and a sensor for acquiring two side face images. The sensors for acquiring two side face images are as follows: Figure 4 A part of the sensor device 13, the sensors for collecting side face images on the left and right sides are adjusted to a suitable height and angle according to the side face position collected by the front face collection sensor;

[0130] Furthermore, the sensors for collecting the left and right side face images can adjust their height and angle to obtain a side full-body image of the person to be identified. By combining the obtained side full-body image with the front face image into a three-dimensional image, the obtained portrait is more realistic.

[0131] Furthermore, the shape of the auricle is an important feature of the human face biometrics. The human face image acquisition device 3 also includes two left and right auricle image acquisition sensors. The left and right auricle image acquisition sensors are as follows: Figure 4 As a part of the sensor device 13, the left and right auricle image acquisition sensors are adjusted to a suitable height and angle according to the auricle position acquired by the front face acquisition sensor; the two auricle image acquisition sensors can automatically remove shadows, flashes and other parts according to the acquired images to obtain real auricle images.

[0132] Step S3, the control device 1 determines whether the face in the face image is a face in the established face template;

[0133] It should be noted that the control device 1 includes data processing units such as CPU and GPU, and the storage device 2 pre-stores a built face template. The face template is pre-collected by the face image acquisition device 3 with all user facial features to form vector data stored in the storage device 2 to form a built face template.

[0134] The control device 1 receives a facial image of a person to be identified, converts the facial image data value into a vector, calls the storage device 2 that has pre-stored vector data of an established facial template, and determines whether the similarity between the facial recognition image and the vector data in the established facial template is greater than a preset value. If the similarity is greater than the preset value, an unlocking command is issued to the door lock control device 8 to open the door lock.

[0135] Step S31: If yes, the control device 1 controls the door lock control device 8 to open the door lock;

[0136] If not, the sensing device 5 measures the distance between the person to be identified and the door lock;

[0137] The sensor device 13 includes a distance measuring device, which can be a distance measuring instrument such as a radar distance measuring device and an infrared distance measuring device, and can measure the distance between a person's face and a door lock, and can also measure the distance between other parts of a person and the door lock.

[0138] In fact, the distance between the person to be identified and the door lock in this embodiment can be further extended to mean the distance between the person to be identified and the door 10 . The same effect can be achieved by measuring the distance between the person to be identified and the door 10 or the doorside sensor.

[0139] It should be noted that the timing device 6 starts timing immediately after the signal of the person to be identified is detected within the detection range, or it can start timing after a period of time has passed since the signal of the person to be identified is detected; the timing device 6 can be a timing device 6 of general accuracy, for example, a timing device with its own electronic timing, or a high-precision timing device 6 can be used.

[0140] The control device 1 determines whether the distance between the person to be identified and the door 10 is less than or equal to the first distance. If so, the control device 1 controls the alarm and expulsion device 9 to perform an alarm and expulsion.

[0141] It should be noted that after receiving the distance between the person to be identified and the door lock, the control device 1 compares it with the preset first distance. If so, whether the distance between the person to be identified and the door lock is less than or equal to the first distance, the control device 1 controls the alarm and expulsion device 9 to alarm and expel; the purpose of this design is to prevent strangers from approaching the door. The first distance can be set by the user according to his or her own needs. The face recognition intelligent door lock early warning system has a human-machine interface, and the user can input the first distance value through the human-machine interface; 0.5m, 1m and other relatively close distances are all first distance values ​​that can be considered; as the sensor is used for a longer time and its performance ages, the user can also set a first distance compensation value for the first distance.

[0142] If not, the control device 1 determines that the distance between the person to be identified and the door 10 is greater than the first distance and less than or equal to the second distance, and the first distance is less than or equal to the second distance;

[0143] For a stranger between the first distance and the second distance from the door lock, if he stays for more than a certain period of time, the stranger may be scouting, eavesdropping or peeping, which poses a certain threat to the user's safety. It is necessary to alarm and drive the stranger away; for a stranger who is greater than the second distance from the door lock, he may be a stranger passing by the user's house. Usually, he poses a smaller threat to the user's safety and no alarm is required.

[0144] If so, the control device 1 determines whether the person's stay time is greater than a set time;

[0145] It should be noted that when the timing of the timing device 6 is greater than the set time, the sensing device 5 measures the distance between the person to be identified and the door 10 again; the control device 1 determines whether the distance between the person to be identified and the door 10 measured again is greater than the first distance and less than or equal to the second distance; if so, this means that the person's stay time is greater than the set time.

[0146] It should be noted that for strangers who are beyond the first distance from the portal, there is no urgent need to call the police, and further judgment is needed based on the stranger's situation;

[0147] If so, the control device 1 controls the alarm driving device 9 to drive away the alarm.

[0148] For a stranger between the first distance and the second distance from the door lock, if he stays for more than a certain period of time, the stranger may be scouting, eavesdropping or peeping, which poses a certain threat to the user's safety. It is necessary to alarm and drive the stranger away; for a stranger who is greater than the second distance from the door lock, he may be a stranger passing by the user's house. Usually, he poses a smaller threat to the user's safety and no alarm is required.

[0149] It should be noted that the alarm and expulsion device 9 can be a buzzer or a speaker or a combination of the two. The buzzer can emit a harsh buzzing sound, and the speaker can play a recording asking the person to be identified to leave.

[0150] Further, the picture or video of the stranger staying at the door is recorded in the storage device 2 for the user to view after returning home;

[0151] Furthermore, the communication device 7 will send the image or video of the person to be identified to the user according to the command of the control device 1 or spontaneously for the user to view.

[0152] Furthermore, if the person to be identified still does not leave after the alarm is sounded, the control device 1 will control the release of tear gas or thick smoke or water to further drive the person to be identified to leave.

[0153] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0154] The above is only an embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. An early warning system based on face recognition smart door lock, characterized in that: include: Control device (1); A storage device (2), a face image acquisition device (3), a display device (4), a sensing device (5), a door lock control device (8) and an alarm expulsion device (9) electrically connected to the control device (1) respectively; in, The sensing device (5) detects a signal of a person to be identified within a detection range, and generates a start-up working signal for the face image acquisition device (3) according to the signal of the person to be identified detected by the sensing device (5); According to the start-up working signal, the facial image acquisition device (3) acquires facial image information of the person to be identified and transmits the facial image information of the person to be identified to the control device (1); The control device (1) determines whether the face in the face image information is a face in a built face template; If so, the control device (1) controls the door lock control device (8) to open the door lock; If not, the control device (1) controls the alarm driving device (9) to drive away the alarm; The early warning system based on face recognition intelligent door lock comprises the early warning system based on face recognition intelligent door lock, and further comprises a timing device (6), wherein after the sensing device (5) detects a signal of a person to be identified within a detection range, the timing device (6) starts timing; The control device (1) controls the alarm driving device (9) to drive away the alarm, and further comprises: The sensing device (5) measures the distance between the person to be identified and the door; The control device (1) receives the distance between the person to be identified and the door, and determines whether the distance between the person to be identified and the door is less than or equal to a first distance. If so, the control device (1) controls the alarm driving device to perform a first alarm driving; If not, the control device (1) determines whether the distance between the person to be identified and the door is greater than the first distance and less than or equal to the second distance, and the first distance is less than or equal to the second distance; If so, when the timing of the timing device is greater than the set time, the sensing device (5) measures the distance between the person to be identified and the door again; the control device (1) determines whether the distance between the person to be identified and the door measured again is greater than the first distance and less than or equal to the second distance; If so, the control device (1) controls the alarm driving device to perform a second alarm driving.

2. The early warning system based on face recognition smart door lock according to claim 1 is characterized in that: The facial image information of the person to be identified includes the facial image of the person to be identified or processed data information of the facial image of the person to be identified.

3. The early warning system based on face recognition smart door lock according to claim 1 is characterized in that: The distance between the person to be identified and the door also includes the distance between the person to be identified and the door lock, the distance between the person to be identified and the door frame, or the distance between the person to be identified and the walls on both sides of the door.

4. The early warning system based on face recognition smart door lock according to claim 1 is characterized in that: The alarm and driving away device (9) comprises a buzzer and / or a speaker.

5. A warning method based on face recognition smart door lock, characterized in that: The following steps are involved: Step S1, using a sensing device (5) to detect a signal of a person to be identified within a detection range, and generating a start-up signal for a facial image acquisition device (3) based on the signal of the person to be identified detected by the sensing device (5); Step S2, according to the start-up working signal, the face image acquisition device (3) acquires face image information of the person to be identified and transmits the face image information of the person to be identified to the control device (1); Step S3, the control device (1) determines whether the face in the face image information is a face in the established face template, Step S31: If yes, the control device (1) controls the door lock control device (8) to open the door lock; Step S32, if not, the control device (1) controls the alarm driving device (9) to drive away the alarm; The early warning method based on face recognition intelligent door lock comprises the following steps: after the sensing device (5) detects a signal of a person to be identified within a detection range, the timing device (6) starts timing; The control device (1) controls the alarm driving device (9) to drive away the alarm, and further comprises: The sensing device (5) measures the distance between the person to be identified and the door; The control device (1) receives the distance between the person to be identified and the door, and determines whether the distance between the person to be identified and the door is less than or equal to a first distance. If so, the control device (1) controls the alarm driving device (9) to perform a first alarm driving; If not, the control device (1) determines whether the distance between the person to be identified and the door is greater than the first distance and less than or equal to the second distance, and the first distance is less than or equal to the second distance; If so, when the timing of the timing device is greater than the set time, the sensing device (5) measures the distance between the person to be identified and the door again; the control device (1) determines whether the distance between the person to be identified and the door measured again is greater than the first distance and less than or equal to the second distance; If so, the control device (1) controls the alarm driving device (9) to perform a second alarm driving.

6. The early warning method based on face recognition smart door lock according to claim 5 is characterized in that: The facial image information of the person to be identified includes the facial image of the person to be identified or processed data information of the facial image of the person to be identified.

7. The early warning method based on face recognition smart door lock according to claim 5 is characterized in that: The distance between the person to be identified and the door also includes the distance between the person to be identified and the door lock, the distance between the person to be identified and the door frame, or the distance between the person to be identified and the walls on both sides of the door.

8. The early warning method based on face recognition smart door lock according to claim 5 is characterized in that: The alarm and driving away device (9) comprises a buzzer and / or a speaker.