Door lock control method and device, door lock, storage medium and program product
By combining sensors and image acquisition modules in smart door locks to determine the type and location of moving objects, the high cost and high power consumption problems caused by multi-sensor detection are solved, achieving higher unlocking accuracy and battery life.
Patent Information
- Application Number
- CN202410330513.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-03-21
- Publication Date
- 2025-09-23
AI Technical Summary
Existing smart door locks require multiple sensors to detect the distance between the moving object and the door lock when making unlocking judgments, resulting in high costs, high power consumption, and low accuracy.
The sensor on the door lock detects the presence of a moving object in the first area, and uses the image acquisition module to capture images to determine the type and location of the moving object. Based on the type and location, it is determined whether to turn on the unlocking module, reducing the number of sensors and improving accuracy.
It reduces the cost of door locks, extends battery life, and improves unlocking accuracy and user experience.
Smart Images
Figure CN120689952A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of smart home technology, and in particular to a door lock control method, device, door lock, storage medium, and program product. Background Art
[0002] With the development of smart home technology, more and more smart home devices have emerged. As one of the smart home devices, smart door locks are a type of lock that combines electronic technology, mechanical technology and network information technology. They have the characteristics of intelligence, convenience and security. Summary of the Invention
[0003] The present disclosure provides a door lock control method, device, door lock, storage medium and program product.
[0004] According to a first aspect of an embodiment of the present disclosure, a door lock control method is provided, comprising: detecting the presence of a moving object in a first area by a sensor on a door lock; wherein, in the first area, the distance between the moving object and the door lock is less than a first distance; turning on an image acquisition module on the door lock and performing image acquisition to obtain a first image; wherein, the first image includes image information of the moving object; determining the type of the moving object according to the first image; wherein, the type includes human and non-human; determining whether the moving object is located in a second area according to the first image; wherein, in the second area, the distance between the moving object and the door lock is less than a second distance; the second distance is less than the first distance; determining whether to turn on an unlocking module according to the type and whether the moving object is located in the second area; wherein, the unlocking module is located on the door lock and is used to unlock.
[0005] Determine whether to enable the unlocking module.
[0006] In one embodiment, determining whether to turn on the unlocking module based on the type and whether the moving object is located in the second area includes: turning on the unlocking module when the type is a human body and the moving object is located in the second area; turning off the unlocking module when the type is non-human body and / or the moving object is not located in the second area.
[0007] In one embodiment, determining whether to turn on the unlocking module based on the type and whether the moving object is located in the second area also includes: when the moving object is located in the second area and the type is a human body, determining the length of time the moving object stays in the second area; when the length of time is greater than a preset length of time, turning on the unlocking module; when the length of time is less than or equal to the preset length of time, turning off the unlocking module.
[0008] In one embodiment, determining whether the moving object is located in the second area includes: determining position information of the moving object in the first image; and determining whether the moving object is located in the second area based on the position information and a reference area in the first image.
[0009] In one embodiment, the method further includes: when the type of the moving object is a human body, detecting the human body features of the moving object; wherein the human body features include at least facial features and body features; and determining whether to turn on the unlocking module based on the human body features and preset features.
[0010] In one embodiment, the method further includes: when the type is non-human body, turning off the image acquisition module.
[0011] In one embodiment, the method further includes: after unlocking is completed by the unlocking module, closing the unlocking module.
[0012] In one embodiment, the unlocking module includes at least one of the following: a biometric information recognition module; a password input module; and an IC door lock card information processing module.
[0013] According to a second aspect of an embodiment of the present disclosure, a door lock control device is provided, comprising: a detection module for detecting the presence of a moving object in a first area through a sensor on the door lock; wherein, in the first area, the distance between the moving object and the door lock is less than a first distance; an image acquisition module for turning on the image acquisition module on the door lock and performing image acquisition to obtain a first image; wherein, the first image includes image information of the moving object; a first determination module for determining the type of the moving object; wherein, the type includes human and non-human; a second determination module for determining whether the moving object is located in a second area; wherein, in the second area, the distance between the moving object and the door lock is less than a second distance; and the second distance is less than the first distance; a third determination module for determining whether to turn on an unlocking module based on the type and whether the moving object is located in the second area; wherein, the unlocking module is located on the door lock and is used to unlock.
[0014] According to a third aspect of the present disclosure, a door lock is provided, comprising:
[0015] A processor and a memory for storing executable instructions that can be run on the processor, wherein: when the processor is used to run the executable instructions, the executable instructions execute the method described in any one of the above embodiments.
[0016] According to a fourth aspect of the embodiments of the present disclosure, a non-temporary computer-readable storage medium is provided, wherein the computer-readable storage medium stores executable instructions, and when the executable instructions are executed by a processor, the method described in any of the above embodiments is implemented.
[0017] According to a fifth aspect of the embodiments of the present disclosure, a program product is provided, including a program or executable instructions. When the program or executable instructions are executed by a processor, the method described in any one of the above embodiments is implemented.
[0018] The technical solutions provided by the embodiments of the present disclosure may have the following beneficial effects:
[0019] The solution of the embodiment of the present disclosure detects the presence of a moving object in a first area through a sensor on the door lock; within the first area, the distance between the moving object and the door lock is less than the first distance, indicating that the moving object may need to be unlocked. The image acquisition module on the door lock is turned on and image acquisition is performed to obtain a first image, which includes image information of the moving object. The type of the moving object and whether the moving object is located in the second area are determined based on the first image. Based on the type of the moving object and whether the moving object is located in the second area, it is determined whether to turn on the unlocking module. Since the door lock has an image acquisition module, the image captured by the image acquisition module is used to further determine whether to turn on the unlocking module. There is no need for another sensor to detect again whether the moving object meets the conditions for turning on the unlocking module, which reduces the use of multiple sensors to detect the distance between the moving object and the door lock, reduces the number of sensors, and thus reduces the cost of the door lock.
[0020] In addition, the first image captured by the image acquisition module further determines whether the moving object meets the conditions for activating the unlocking module, and determines whether to activate the unlocking module based on the type of the moving object and whether the moving object is located in the second area. This also improves the accuracy of activating the unlocking module, reduces the power consumption of the receiving module after it is activated unnecessarily, and reduces the power consumption of the unlocking module, thereby extending the battery life and improving the user experience.
[0021] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.
[0023] Figure 1 is a schematic diagram showing a door lock control method according to an exemplary embodiment;
[0024] Figure 2is a schematic diagram of a first area according to an exemplary embodiment;
[0025] Figure 3 is a schematic diagram of a first area according to an exemplary embodiment;
[0026] Figure 4 is a schematic diagram showing a mobile object located in a second area according to an exemplary embodiment;
[0027] Figure 5 is a schematic diagram showing another method of determining whether to enable an unlocking module according to an exemplary embodiment;
[0028] Figure 6 is a schematic diagram showing another method of determining whether to enable an unlocking module according to an exemplary embodiment;
[0029] Figure 7 is a schematic diagram of a door lock control device according to an exemplary embodiment;
[0030] Figure 8 is a schematic structural diagram of a door lock according to an exemplary embodiment;
[0031] Figure 9 is a schematic diagram showing another door lock control method according to an exemplary embodiment;
[0032] Figure 10 is a block diagram of a door lock according to an exemplary embodiment. DETAILED DESCRIPTION
[0033] Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. In the following description, when referring to the drawings, identical numerals in different figures represent identical or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all embodiments consistent with the present disclosure. Rather, they are merely examples of devices consistent with certain aspects of the present disclosure, as detailed in the appended claims.
[0034] refer to Figure 1 , is a schematic diagram of a door lock control method, the door lock control method comprising:
[0035] S100, detecting the presence of a moving object in a first area through a sensor on the door lock; wherein, in the first area, the distance between the moving object and the door lock is less than a first distance.
[0036] S200, turning on the image acquisition module on the door lock and performing image acquisition to obtain a first image; wherein the first image includes image information of the moving object.
[0037] S300: Determine the type of the moving object according to the first image; wherein the types include human body and non-human body.
[0038] S400, determining whether the moving object is located in a second area based on the first image; wherein, in the second area, the distance between the moving object and the door lock is less than a second distance; and the second distance is less than the first distance.
[0039] S500: Determine whether to activate an unlocking module based on the type and whether the moving object is located in the second area. The unlocking module is located on the door lock and is used to unlock the door.
[0040] The method can be performed at least in a door lock, which can include a smart door lock.
[0041] There is no order between S300 and S400. S300 can be executed first, or S400 can be executed first.
[0042] The door lock may include an image acquisition module and a sensor for detecting distance. The image acquisition module may include one or more image acquisition units. The image acquisition units may be cameras. Different image acquisition units may have different models and parameters. For example, the image acquisition unit may include at least one of the following: a wide-angle camera, a telephoto camera, an ultra-wide-angle camera, a black and white camera, a macro camera, a time-of-flight (ToF) camera, or other cameras with different parameters.
[0043] The sensors used to detect the distance may include: a pyroelectric infrared (PIR) sensor, a microwave radar, an infrared proximity sensor (P-sensor), an ultrasonic sensor, etc., which are used to detect the distance between the moving object and the door lock.
[0044] The position of the sensor on the door lock is not limited, and the model, size and other parameters of the sensor are also not limited, and can be determined according to actual usage requirements.
[0045] The door lock may further include a controller or a processor for executing the above steps.
[0046] For S100, within the first area, the distance between the moving object and the door lock is less than the first distance, and the sensor on the door lock can detect whether there is a moving object in the first area.
[0047] Exemplarily, the first area may include an area in the horizontal direction and in the direction of the sensing surface of the sensor, an area centered on the door lock and formed with the first distance as a radius.
[0048] Exemplarily, the first area may also be an area in the horizontal direction and in the area toward which the sensing surface of the sensor faces, with the door body as the starting point and within a first distance from the door body. In this case, the first area may be a rectangular area.
[0049] For example, at the beginning, the door is usually unlocked outside, so the first area can be the area outside the door. The sensor detects whether there is a moving object in the first area outside the door.
[0050] The size of the first area may be determined according to usage requirements, and the range of the first area determined by different sensors may be different.
[0051] A mobile object can be any type of moving object. The sensor performs multiple distance measurements on the object within the first area, and based on the data from these measurements, it can be determined whether the object is a mobile object. If the distance between the object within the first area and the sensor remains constant, it indicates that the object is a stationary object within the first area and is most likely not a person requiring unlocking. If the distance between the object within the first area and the sensor changes, it indicates that the object is a mobile object within the first area and may be a person requiring unlocking.
[0052] The method for using a sensor to detect whether a moving object is within the first area is not limited. For example, when the sensor is a microwave radar, the presence of a moving object within the first area can be determined based on the time between the microwave radar transmitting a signal and the time between the received signal reflected from the moving object. When the sensor is an ultrasonic sensor, the principle is similar.
[0053] Exemplarily, the door lock further includes a processor, which is connected to the sensor. The processor can determine whether there is a moving object in the first area based on data detected by the sensor.
[0054] refer to Figure 2 , is a schematic diagram of the first area, refer to Figure 3 , which is a schematic diagram of the first area.
[0055] exist Figure 2 In the example, the moving object is the human body, h1 is the first distance, and the first area is outside the door ( Figure 2 The right side shown in FIG is the outside of the door) is an area where the distance between the moving object and the door body on the horizontal plane is less than h1. When the distance between the moving object and the door body is less than h1, it is determined that the moving object is located in the first area, and it is determined that the moving object exists in the first area.
[0056] exist Figure 3 In the figure, the first area is a rectangular area formed by A, A', C and C', the moving object is a human body, and the feet and legs of the human body are located in the first area, indicating that the moving object is located in the first area.
[0057] In S200, when it is determined that a moving object exists in the first area, the image acquisition module on the door lock is turned on and an image is acquired to obtain a first image. When it is determined that no moving object exists in the first area, the image acquisition module on the door lock does not need to be turned on and is in a turned-off state.
[0058] When the image acquisition module is in the closed state, the image acquisition module is in a power-off state and will not consume the power of the door lock power supply. This can save power, extend the battery life, and improve the user experience.
[0059] The first image includes image information of the moving object. After the image is captured, the first image may include image information of the moving object, making it easier to determine whether to open the image capture module on the door lock based on the image information of the moving object.
[0060] For example, the number of the first images is not limited and may be one or more, including multiple consecutive images captured by the image acquisition module, which can be used as the first image.
[0061] After obtaining the first image, determine whether to turn on the unlocking module based on the first image. The unlocking module is located on the door lock and is used to unlock the door. The unlocking module includes at least one of the following: a biometric information recognition module, a password input module, and an information processing module for the IC door lock card. The biometric information recognition module can include a fingerprint recognition module, a palm print recognition module, and a face recognition module, etc. These biometric information recognition modules require electrical energy when unlocking according to biometric information, so they can only detect biometric information when connected to a power source, and they consume power when connected to a power source. The password input module can be any module that has a password input function and consumes power. The information processing module of the IC door lock card can be any module that can identify and detect IC card information, and this module also needs to be connected to a power source.
[0062] In S300, when it is determined that a moving object exists within the first area, the type of the moving object may be determined. The moving object may be a human or a non-human. If the moving object is a human, unlocking may be required. If the moving object is a non-human, unlocking is not required, and the unlocking operation will not be performed for a non-human.
[0063] For example, non-human moving objects may include objects, animals, and the like.
[0064] There is no limitation on the method of determining the type of a moving object. An image detection algorithm may be used to detect whether the object in the image is a human body, such as by segmenting the image, or extracting features of each object in the image, or by using a human body recognition algorithm to determine whether the object in the image is a human body.
[0065] In S400, when it is determined that a mobile object exists within the first area, it may be determined whether the mobile object is located within a second area. The second area is an area between the first area and the door lock, and the distance between the mobile object and the door lock is less than the second distance. If the distance between the mobile object and the door lock is less than the second distance, it indicates that the mobile object is located within the second area.
[0066] Because the distance between the moving object and the door lock within the second area is less than the second distance, and the second distance is less than the first distance, after determining that the moving object is within the first area, the next step is to determine whether the moving object is within the second area, which is closer to the door lock. If the moving object is within the second area, the likelihood of the moving object unlocking the door has increased. If the moving object is not within the second area, the likelihood of the moving object unlocking the door has not increased, and the moving object may be passing through the first area in front of the door and does not need to be unlocked.
[0067] By determining whether the mobile object is located in the second area, the accuracy of determining whether the mobile object is unlocked is improved, thereby improving the accuracy of determining whether to activate the unlocking module.
[0068] Exemplarily, the distance between the moving object and the door lock may be a distance on a horizontal plane.
[0069] refer to Figure 2 The second distance may be h2, which is smaller than h1. When the distance between the moving object and the door lock is smaller than h2, it indicates that the moving object is located within the second area. For example, the second area is an area formed by a range of h2 from the door body.
[0070] refer to Figure 3 , the second region is the region formed by B, B', C and C'.
[0071] In one embodiment, in S400, the method of determining whether the mobile object is located in the second area is not limited and may include:
[0072] The position information of the moving object in the first image is determined, and whether the moving object is located in the second area is determined based on the position information and a reference area in the first image.
[0073] The first image includes a reference area having a boundary line. The position of a moving object in the first image can be determined in the first image, and whether the moving object is located in the second area can be determined based on the position of the moving object in the first image and the boundary line of the reference area.
[0074] The reference area is used as a reference for determining whether the mobile object is located in the second area. The range of the second area can be determined according to usage requirements. For example, the reference area can include the second area.
[0075] refer to Figure 3 , the reference region may be the region formed by B, B', C and C'. Figure 4 , which is a schematic diagram of a mobile object located in the second area.
[0076] In S500, based on the information of the type and whether the mobile object is located in the second area, it is determined whether to enable the unlocking module. For example, if the type is human and the mobile object is located in the second area, the unlocking module is enabled. For another example, if the type is non-human and / or the mobile object is not located in the second area, the unlocking module is disabled.
[0077] Since these unlocking modules need to be connected to a power source, they consume power. If they are always connected to a power source, they will continue to consume power, thereby reducing the power usage time of the door lock. This method can enable the unlocking module when it is determined based on the first image that it needs to be enabled, so that it can receive power, reducing the power consumption of the unlocking module caused by enabling the unlocking module when it is not needed.
[0078] The presence of a moving object in a first area is detected by a sensor on the door lock. Within the first area, the distance between the moving object and the door lock is less than the first distance, indicating that the moving object may need to be unlocked. The image acquisition module on the door lock is activated and image acquisition is performed to obtain a first image. The first image includes image information of the moving object. The type of the moving object and whether the moving object is located in the second area are determined based on the first image. Based on the type of the moving object and whether the moving object is located in the second area, it is determined whether to activate the unlocking module. Because the door lock has an image acquisition module, the image captured by the image acquisition module further determines whether to activate the unlocking module. There is no need for another sensor to re-detect whether the moving object meets the conditions for activating the unlocking module. This reduces the need for multiple sensors to detect the distance between the moving object and the door lock, reduces the number of sensors, and thus reduces the cost of the door lock.
[0079] In addition, the first image captured by the image acquisition module further determines whether the moving object meets the conditions for activating the unlocking module, and determines whether to activate the unlocking module based on the type of the moving object and whether the moving object is located in the second area. This also improves the accuracy of activating the unlocking module, reduces the power consumption of the receiving module after it is activated unnecessarily, and reduces the power consumption of the unlocking module, thereby extending the battery life and improving the user experience.
[0080] In one embodiment, reference Figure 5 , is another schematic diagram of determining whether to enable the unlocking module. S500, determining whether to enable the unlocking module, further comprising:
[0081] S501: When a mobile object is located in a second area and is of human type, determine a stay time of the mobile object in the second area.
[0082] S502: When the dwell time is longer than the preset time, the unlocking module is activated.
[0083] S503: When the dwell time is less than or equal to the preset time, the unlocking module is turned off.
[0084] If the type of the moving object is determined to be a human body in S300 and the moving object is determined to be located in the second area in S400, the duration of the moving object's stay in the second area is determined. If the type of the moving object is a human body but is not located in the second area, it indicates that the moving object may have passed through the first area and does not require unlocking. If the type of the moving object is not a human body but is located in the second area, there is no need to unlock the moving object, so unlocking is also not required. If the moving object is located in the second area and is a human body, then unlocking is more likely.
[0085] If the dwell time is longer than the preset time, it indicates that the moving object is likely to have started moving, and the unlocking module is turned on to facilitate the person to unlock the door through the unlocking module. If the dwell time is not longer than the preset time, it indicates that the moving object is unlikely to have started moving, and may have passed through the second area, and the unlocking module is turned off, thereby reducing the unlocking module's power consumption and extending the life of the door lock's power supply.
[0086] The solution of this embodiment takes into account whether the mobile object is located in the second area, the type of the mobile object, and the length of time the mobile object stays in the second area, thereby improving the accuracy of determining whether to activate the unlocking module, thereby reducing unnecessary activation of the unlocking module, and reducing the power consumption of the unlocking module after it is activated when unlocking is not required, thereby saving power.
[0087] In one embodiment, reference Figure 6 , is another schematic diagram of determining whether to enable the unlocking module. S500, determining whether to enable the unlocking module, further comprising:
[0088] S504: When the type of the moving object is a human body, detect the human body features of the moving object; wherein the human body features at least include facial features and body shape features.
[0089] S505: Determine whether to enable the unlocking module based on the human body characteristics and the preset characteristics.
[0090] If the moving object is determined to be a human, the human features of the moving object, such as facial features and body features, are detected. Based on the preset features and the detected human features, the unlocking module is determined to be enabled. The preset features may be facial features and / or characteristic features of a person who frequently unlocks the door.
[0091] Preset features can be matched with detected human features. When the match reaches a predetermined level, the unlocking module is activated, thereby improving the security and accuracy of unlocking. If the match does not reach the predetermined level, it indicates that the moving object is not a regular unlocker and may be an unknown person. In this case, the unlocking module is not activated. This improves the security of unlocking, reduces the possibility of unlocking by unknown persons, and reduces the power consumption of the unlocking module.
[0092] In one embodiment, the door lock control method further includes:
[0093] If the moving object is not a human, the image acquisition module is disabled. If the moving object is determined to be non-human, the probability of unlocking the door by the moving object is very low, or even non-existent. This reduces unnecessary activation of the image acquisition module. Since the image acquisition module also consumes power, this reduces its power consumption and increases the life of the door lock's power supply.
[0094] In one embodiment, the door lock control method further includes:
[0095] After unlocking is completed through the unlocking module, the unlocking module is turned off, thereby reducing the power consumption of the unlocking module.
[0096] In one embodiment, reference Figure 7 , is a schematic diagram of a door lock control device, the device comprising:
[0097] Detection module 1, configured to detect the presence of a moving object within a first area using a sensor on the door lock; wherein, within the first area, the distance between the moving object and the door lock is less than a first distance;
[0098] Image acquisition module 2, used to open the image acquisition module on the door lock and perform image acquisition to obtain a first image; wherein the first image includes image information of the moving object;
[0099] A first determining module 3 is configured to determine the type of the moving object; wherein the type includes human body and non-human body;
[0100] A second determining module 4 is configured to determine whether the moving object is located within a second area; wherein, within the second area, the distance between the moving object and the door lock is less than a second distance; and the second distance is less than the first distance;
[0101] The third determining module 5 is configured to determine whether to activate an unlocking module according to the type and whether the moving object is located in the second area; wherein the unlocking module is located on the door lock and is configured to unlock the door.
[0102] In one embodiment, the third determining module 5 is further configured to:
[0103] When the type is a human body and the moving object is located in the second area, turning on the unlocking module;
[0104] When the type is non-human body and / or the moving object is not located in the second area, the unlocking module is turned off.
[0105] In one embodiment, the third determining module 5 further includes:
[0106] a first determining unit, configured to determine a stay time of the mobile object in the second area when the mobile object is in the second area and the type is a human body;
[0107] A first opening unit, configured to open the unlocking module when the dwell time is longer than a preset time;
[0108] The first closing unit is configured to close the unlocking module when the dwell time is less than or equal to the preset time.
[0109] In one embodiment, the second determining module 4 includes:
[0110] a second determining unit, configured to determine position information of the moving object in the first image;
[0111] A third determining unit is configured to determine whether the moving object is located in a second area according to the position information and a reference area in the first image.
[0112] In one embodiment, the third determining module 5 further includes:
[0113] a detection unit, configured to detect human features of the moving object when the type of the moving object is a human body; wherein the human features include at least facial features and body features;
[0114] The fourth determining unit is used to determine whether to activate the unlocking module according to the human body characteristics and the preset characteristics.
[0115] In one embodiment, the apparatus further comprises:
[0116] The second closing unit is used to close the image acquisition module when the type is non-human body.
[0117] In one embodiment, the apparatus further comprises:
[0118] The third closing unit is configured to close the unlocking module after the unlocking module is completed.
[0119] In one embodiment, the unlocking module includes at least one of the following:
[0120] Biometric information recognition module;
[0121] Password input module;
[0122] Information processing module of IC door lock card.
[0123] In one embodiment, reference Figure 8 , is a schematic diagram of the structure of a door lock. Figure 9 , which is a schematic diagram of another door lock control method.
[0124] The smart door lock hardware of this solution mainly consists of three parts: front lock panel, rear lock panel, and lock body. Figure 8 .
[0125] The front lock panel is located outside the entrance door and includes an MCU control unit, camera, sensor, biometric module, touch button, RFID, power supply unit, microphone and speaker. Its main functions are image capture of people outside the door, intercom, image processing human figure recognition, biometric recognition, key password authentication and unlocking, etc.
[0126] The rear lock panel is located inside the entrance door and includes an MCU control unit, buttons, a WiFi unit, a battery module, a display screen, a microphone and a speaker. Its main functions are indoor unlocking, camera image viewing, full lock power supply, information uploading, etc.
[0127] The lock body is located in the middle of the entrance door, and its main function is to lock and unlock the door through the rotation of the motor.
[0128] refer to Figure 2 When the sensor detects movement within the area in front of the door (h1), the camera turns on. Simultaneously, the graphics processor processes the captured image to identify whether a human figure is present. It then detects the figure's size and relative position within the image. If a human figure appears within a fixed area within the image, it indicates that the person has entered the biometric module's recognizable area, and the biometric module turns on. If the human figure subsequently leaves the fixed area within the image, the biometric module turns off.
[0129] Figure 2 The positions of the two human bodies, near and far, are displayed in a two-dimensional image. Figure 3 Figure and Figure 4 shown. Figure 2 The three points A, B, and C correspond to Figure 3 and Figure 4 There are three line segments AA', BB', and CC'.
[0130] When a person enters the AA'B'B area, the image acquisition module is already turned on. When the entire human body outline tends to become larger, it means that the person is approaching. When the person enters the BB'C'C area, the biometric recognition module is turned on.
[0131] Smart door locks with cameras and biometric recognition have relatively fixed fields of view for both the camera and the biometric sensor. To achieve optimal capture and recognition accuracy, the door locks are typically installed at a fixed height. Therefore, a horizontal line at a fixed position in a two-dimensional image is projected to a relatively fixed position in three-dimensional space.
[0132] If the error is large, you can use the following solution: The camera's viewing angle is fixed, but the installation height is uncertain. This may cause a difference between the marking line in the image and the actual distance (the distance between BB and CC'). During installation, you need to enter the installation height in the software.
[0133] refer to Figure 9 , the method comprising:
[0134] 1. Turn on the device. Insert the battery module and power on the entire lock.
[0135] 2. Initialization: Initialize each module. The camera and biometric module are initially closed.
[0136] 3. Turn on the sensor and detect the large range in front of the door ( Figure 2 h1) Whether it moves with the personnel.
[0137] 4. If the sensor detects human movement, go to step 5, otherwise return to step 3.
[0138] 5. Turn on the camera and take pictures of the situation in front of the door.
[0139] 6. Start the algorithm to process the captured image and determine whether there is a person in the image.
[0140] 7. If someone enters step 8. If no one continues to shoot for xx seconds, check again whether there is someone. If no one is there, turn off the camera and return to step 4.
[0141] 8. Use image processing to determine whether the person has entered the set area. If so, jump to step 10. Otherwise, return to step 5.
[0142] 9. Turn on the biometric module.
[0143] 10. Enter the biometric identification process, success, failure or timeout without detection.
[0144] 11. Complete the biometric recognition process, close the biometric recognition module, and return to step 6.
[0145] This solution fully utilizes camera image information, uses image processing methods to identify human figures, and determines their position to control the biometric recognition module. Compared with existing solutions, this solution saves a sensor, simplifies the design, reduces costs, and improves detection accuracy.
[0146] It should be noted that the “first” and “second” in the embodiments of the present disclosure are only for the convenience of expression and distinction and have no other specific meanings.
[0147] Figure 10 is a block diagram of a door lock according to an exemplary embodiment.
[0148] Reference Figure 10 The door lock may include one or more of the following components: a processing component 902 , a memory 904 , a power component 906 , a multimedia component 908 , an audio component 910 , an input / output (I / O) interface 912 , a sensor component 914 , and a communication component 916 .
[0149] Processing component 902 generally controls the overall operation of the door lock, such as operations associated with display, data communication, camera operation, and recording. Processing component 902 may include one or more processors 920 to execute instructions to perform all or part of the steps of the above-described method. Furthermore, processing component 902 may include one or more modules to facilitate interaction between processing component 902 and other components. For example, processing component 902 may include a multimedia module to facilitate interaction between multimedia component 908 and processing component 902.
[0150] The memory 904 is configured to store various types of data to support operations on the door lock. Examples of such data include instructions for any application or method used to operate on the door lock, images, videos, etc. The memory 904 can be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.
[0151] The power component 906 provides power to the various components of the door lock. The power component 906 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the door lock.
[0152] The multimedia component 908 includes a screen that provides an output interface between the door lock and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor can not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 908 includes a front camera and / or a rear camera. When the door lock is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.
[0153] The audio component 910 is configured to output and / or input audio signals. For example, the audio component 910 includes a microphone (MIC), which is configured to receive external audio signals when the door lock is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal can be further stored in the memory 904 or transmitted via the communication component 916. In some embodiments, the audio component 910 also includes a speaker for outputting audio signals.
[0154] I / O interface 912 provides an interface between processing component 902 and peripheral interface modules, such as a keyboard, click wheel, buttons, etc. These buttons may include but are not limited to: a home button, volume buttons, a start button, and a lock button.
[0155] The sensor assembly 914 includes one or more sensors for providing various aspects of the door lock's status assessment. For example, the sensor assembly 914 can detect the open / closed state of the door lock, the relative positioning of components, such as the display and keypad of the door lock. The sensor assembly 914 can also detect changes in the position of the door lock or a component of the door lock, the presence or absence of user contact with the door lock, the door lock's orientation or acceleration / deceleration, and temperature changes of the door lock. The sensor assembly 914 can include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 914 can also include a light sensor, such as a complementary metal oxide semiconductor (CMOS) or charge coupled device (CCD) image sensor, for use in imaging applications. In some embodiments, the sensor assembly 914 can also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
[0156] The communication component 916 is configured to facilitate wired or wireless communication between the door lock and other devices. The door lock can access a wireless network based on a communication standard, such as Wi-Fi, 4G or 5G, or a combination thereof. In an exemplary embodiment, the communication component 916 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 916 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra wide band (UWB) technology, Bluetooth (BT) technology and other technologies.
[0157] In an exemplary embodiment, the door lock can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above method.
[0158] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 904 including executable instructions or a computer program. The instructions or computer program can be executed by the processor 920 of the apparatus 900 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a compact disc read-only memory (CD-ROM), a magnetic tape, a floppy disk, an optical data storage device, etc.
[0159] A non-transitory computer-readable storage medium, when the instructions in the storage medium are executed by the processor of a mobile terminal, enables the mobile terminal to execute any one of the above-mentioned door lock control methods of the embodiments of the present disclosure.
[0160] The present disclosure provides a computer program product comprising a computer program or executable instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer program or executable instructions from the computer-readable storage medium and executes the computer program or executable instructions, causing the computer device to perform any of the door lock control methods described above in the present disclosure.
[0161] Other embodiments of the present disclosure will readily occur to those skilled in the art after considering the specification and practicing the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art not disclosed herein. The description and examples are to be considered as exemplary only, with the true scope and spirit of the present disclosure being indicated by the claims.
[0162] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes can be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims
1. A door lock control method, characterized in that: include: Detecting the presence of a moving object in a first area by a sensor on the door lock; wherein, in the first area, the distance between the moving object and the door lock is less than a first distance; Opening the image acquisition module on the door lock and performing image acquisition to obtain a first image; wherein the first image includes image information of the moving object; Determine the type of the moving object according to the first image; wherein the type includes human body and non-human body; determining, based on the first image, whether the moving object is located within a second area; wherein, within the second area, the distance between the moving object and the door lock is less than a second distance; and the second distance is less than the first distance; Whether to activate an unlocking module is determined according to the type and whether the moving object is located in the second area; wherein the unlocking module is located on the door lock and is used to unlock the door.
2. The method according to claim 1, characterized in that The determining whether to activate the unlocking module according to the type and whether the moving object is located in the second area includes: When the type is a human body and the moving object is located in the second area, turning on the unlocking module; When the type is non-human body and / or the moving object is not located in the second area, the unlocking module is turned off.
3. The method according to claim 1 or 2, characterized in that The determining whether to activate the unlocking module according to the type and whether the moving object is located in the second area further includes: When the mobile object is located in the second area and the type is a human body, determining a stay time of the mobile object in the second area; When the dwell time is longer than a preset time, activating the unlocking module; When the stay time is less than or equal to the preset time, the unlocking module is turned off.
4. The method according to claim 1, wherein Determining whether the mobile object is located in the second area includes: determining position information of the moving object in the first image; It is determined whether the moving object is located in a second area according to the position information and a reference area in the first image.
5. The method according to claim 1, wherein The method further comprises: When the type of the moving object is a human body, detecting human body features of the moving object; wherein the human body features include at least facial features and body features; Determine whether to enable the unlocking module based on human body characteristics and preset characteristics.
6. The method according to claim 1, characterized in that The method further comprises: When the type is non-human body, the image acquisition module is turned off.
7. The method according to claim 1, characterized in that The method further comprises: After the unlocking module is completed, the unlocking module is closed.
8. The method according to claim 1, characterized in that The unlocking module includes at least one of the following: Biometric information recognition module; Password input module; Information processing module of IC door lock card.
9. A door lock control device, characterized in that: include: a detection module, configured to detect the presence of a moving object within a first area through a sensor on the door lock; wherein, within the first area, the distance between the moving object and the door lock is less than a first distance; An image acquisition module, configured to activate the image acquisition module on the door lock and acquire an image to obtain a first image; wherein the first image includes image information of the moving object; A first determining module is configured to determine the type of the moving object; wherein the type includes human body and non-human body; a second determining module, configured to determine whether the moving object is located within a second area; wherein, within the second area, the distance between the moving object and the door lock is less than a second distance; and the second distance is less than the first distance; The third determining module is configured to determine whether to activate an unlocking module based on the type and whether the moving object is located within the second area; wherein the unlocking module is located on the door lock and is configured to unlock the door.
10. A door lock, characterized in that: include: A processor and a memory for storing a program or executable instructions capable of running on the processor, wherein: When the processor is used to run the program or the executable instructions, the executable instructions execute the method according to any one of claims 1 to 8.
11. A non-transitory computer-readable storage medium, characterized in that The non-transitory computer-readable storage medium stores a program or computer-executable instructions, and when the program or the computer-executable instructions are executed by a processor, the method according to any one of claims 1 to 8 is implemented.
12. A program product comprising a program or executable instructions, characterized in that: When the program or executable instructions are executed by a processor, the method according to any one of claims 1 to 8 is implemented.