Intelligent door lock resident snapshot method, device and equipment and readable storage medium

Abstract

The invention provides an intelligent door lock residence snapshot method, device and equipment and a readable storage medium, and the method comprises the steps: monitoring a preset region corresponding to an intelligent door lock in real time through a microwave radar, activating an infrared recognition module when the microwave radar detects a moving target, and obtaining a thermal imaging image through the infrared recognition module; when it is judged that the thermal imaging image contains the living body target, a camera module is activated, and a snapshot image is obtained through the camera module; obtaining a first coordinate area, corresponding to the preset area, of the moving target, and obtaining a second coordinate area, corresponding to the thermal imaging image, of the living body target; according to the first coordinate area and the second coordinate area, whether a human-shaped target exists or not is judged, and if the human-shaped target exists, the snapshot image is stored and uploaded; the intelligent door lock is provided with the microwave radar, the infrared recognition module and the camera module.

Description

Technical Field

[0001] The present disclosure relates to the field of intelligent detection technology, and in particular to a method, device, equipment and readable storage medium for resident capture of an intelligent door lock. Background Art

[0002] In the application of smart door locks, it is necessary to detect the presence of people outside the door and capture images. However, if only traditional microwave radar is used for detection, microwave radar can only detect the movement of objects, resulting in frequent image capture and reporting of other non-human objects, resulting in a poor user experience.

[0003] Therefore, in the traditional method, image recognition is further added to perform a secondary judgment of the human shape. However, in the existing image recognition method, objects such as flowers, chairs, and clothes are also easily misjudged as human shapes, and the images are captured and reported, resulting in false alarms, and thus failing to improve the user experience. Summary of the invention

[0004] The purpose of the present disclosure is to provide a smart door lock resident capture method, device, equipment and readable storage medium to improve the above-mentioned problems.

[0005] In order to achieve the above objectives, the present disclosure provides the following technical solutions:

[0006] In a first aspect, the present disclosure provides a smart door lock resident snapshot method, the method comprising:

[0007] The preset area corresponding to the smart door lock is monitored in real time by a microwave radar. When the microwave radar detects a moving target, an infrared recognition module is activated to obtain a thermal imaging image by the infrared recognition module.

[0008] When it is determined that the thermal imaging image contains a living target, the camera module is activated to obtain a captured image through the camera module;

[0009] Acquire a first coordinate area of ​​the moving target corresponding to the preset area, and acquire a second coordinate area of ​​the living target corresponding to the thermal imaging image;

[0010] Determining whether there is a humanoid target according to the first coordinate area and the second coordinate area, and if the humanoid target exists, storing and uploading the captured image;

[0011] The smart door lock is provided with the microwave radar, the infrared recognition module and the camera module.

[0012] In a second aspect, the present disclosure provides a smart door lock, the smart door lock comprising:

[0013] A first activation module is used to monitor the preset area corresponding to the smart door lock in real time through a microwave radar, and when the microwave radar detects a moving target, the infrared recognition module is activated to obtain a thermal imaging image through the infrared recognition module;

[0014] The second activation module is used to activate the camera module when determining that the thermal imaging image contains a living target, and obtain a captured image through the camera module;

[0015] A coordinate acquisition module, used to acquire a first coordinate area of ​​the moving target corresponding to the preset area, and to acquire a second coordinate area of ​​the living target corresponding to the thermal imaging image;

[0016] A coordinate determination module, used for determining whether there is a humanoid target according to the first coordinate area and the second coordinate area, and if the humanoid target exists, storing and uploading the captured image;

[0017] The smart door lock is provided with the microwave radar, the infrared recognition module and the camera module.

[0018] In a third aspect, the present disclosure provides an electronic device, including:

[0019] a memory storing execution instructions; and

[0020] A processor executes the execution instructions stored in the memory, so that the processor executes the smart door lock resident snapshot method described in the first aspect.

[0021] In a fourth aspect, the present disclosure provides a readable storage medium, in which execution instructions are stored. When the execution instructions are executed by a processor, they are used to implement the smart door lock resident snapshot method described in the first aspect.

[0022] The beneficial effects of the present disclosure are:

[0023] 1. The method provided by the present invention detects a moving target outside the door based on the microwave radar of the smart door lock, and then detects whether there is a living target that produces thermal imaging outside the door based on the infrared recognition module, and further judges whether it is an active human-shaped living body based on the overlap degree of the moving target and the living target detected separately in the same coordinate system, so as to avoid the situation where the captured image is reported incorrectly, thereby improving the accuracy of detecting the situation where someone is stationed outside the door.

[0024] 2. The method determines whether a living target is humanoid by using the coordinate area of ​​the thermal imaging image, which not only reduces the judgment requirements, but also solves the problem of misidentifying non-living objects in the form of humanoid as "people" by traditional image recognition methods.

[0025] 3. The method activates subsequent functional modules based on the detection results of the microwave radar to avoid these modules being turned on for a long time and causing the smart lock to increase power consumption. Therefore, the method can meet the low power consumption requirements of the smart door lock. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present disclosure and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0027] Figure 1 It is a flowchart of the smart door lock resident snapshot method provided by the embodiment of the present disclosure;

[0028] Figure 2 It is a schematic diagram of a pixel coordinate system and a camera coordinate system corresponding to a microwave radar of a smart door lock provided in an embodiment of the present disclosure;

[0029] Figure 3 It is a schematic diagram of the structure of the smart door lock provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0030] In order to make the purpose, technical solutions and advantages of the embodiments of the present disclosure clearer, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, rather than all of the embodiments. The components of the embodiments of the present disclosure generally described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present disclosure provided in the drawings is not intended to limit the scope of the present disclosure for protection, but merely represents the selected embodiments of the present disclosure. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present disclosure.

[0031] It should be noted that similar reference numerals or letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in the subsequent drawings. At the same time, in the description of the present disclosure, the terms "first", "second", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.

[0032] Embodiment 1

[0033] The disclosed embodiment provides a smart door lock resident snapshot method.

[0034] Specifically, refer to Figure 1 , the method 100 comprises:

[0035] S102, monitoring a preset area corresponding to the smart door lock in real time through a microwave radar, activating an infrared recognition module when the microwave radar detects a moving target, and acquiring a thermal imaging image through the infrared recognition module.

[0036] S104, when it is determined that the thermal imaging image contains a living target, activating the camera module, and acquiring a captured image through the camera module.

[0037] S106, acquiring a first coordinate area of ​​the moving target corresponding to the preset area, and acquiring a second coordinate area of ​​the living target corresponding to the thermal imaging image.

[0038] S108: Determine whether a humanoid target exists according to the first coordinate area and the second coordinate area, and if the humanoid target exists, store and upload the captured image.

[0039] The smart door lock is provided with the microwave radar, the infrared recognition module and the camera module.

[0040] In step S102 of the method provided by the present invention, based on the requirement of low power consumption for smart door locks, the microwave radar of the smart door lock is used to perform real-time monitoring of a preset area outside the door, while the infrared recognition module and the camera module that realize the human liveness detection function are in a low-power sleep state when not activated, which can reduce the power consumption of the smart door lock.

[0041] However, microwave radar can only detect all moving objects. If a graphic capture is taken every time a moving target is detected, or other functions of the smart door lock are turned on, such as face recognition, not only will the power be discharged in large quantities due to the activation of the corresponding module, affecting its service life, but it will also often generate and upload invalid captured images, causing false alarms to users and a poor user experience.

[0042] Therefore, in step S102, after the microwave radar detects the moving target, the thermal imaging detection of the infrared recognition module is added. At the same time, the infrared recognition module is activated and used only after the microwave radar detects the moving target, which can effectively identify whether the target is a living target while saving power.

[0043] Human liveness detection through thermal imaging can avoid misidentification by image recognition algorithms, which can lead to mistaking objects with similar appearance to humans for humans, thereby improving the success rate of human detection.

[0044] In some embodiments, the infrared recognition module is a functional module of the smart door lock. Specifically, it is a liveness detection camera of the face recognition module. For security reasons, the face recognition module generally includes a liveness detection camera.

[0045] Therefore, the method can perform human liveness detection without increasing costs, and can also save the equipment cost and power consumption cost generated by adding modules to the existing smart door locks to achieve human detection through image recognition.

[0046] In some embodiments, the infrared recognition module includes at least one of an infrared camera or a ToF (Time of Flight) sensor.

[0047] In some embodiments, in step S104, when the microwave radar detects a moving target, activating the infrared recognition module includes:

[0048] Acquire a first distance of the moving target;

[0049] When the first distance does not decrease, the infrared recognition module is not activated.

[0050] The first distance corresponds to the distance between the moving target and the smart door lock.

[0051] Obviously, when the moving object moves toward the door, the first distance decreases, and when it moves away from the door, the first distance increases.

[0052] Therefore, when someone leaves the door, there is no need to alert them. For targets moving in the direction of leaving the door (and possibly staying on the way), there is no need to perform human figure and living body recognition, as well as image capture, so as to avoid adding useless workload to the smart door lock, which not only reports to the user ineffectively, but also wastes the power of the smart door lock.

[0053] Moreover, in the process of the human-shaped living target entering the door, images must have been captured, and the process of storing and uploading the captured images has been carried out.

[0054] In some embodiments, in step S106, when it is determined that the thermal imaging image contains a living target, activating the camera module and acquiring a captured image through the camera module includes:

[0055] When it is determined that a living target is included in the thermal imaging image, the residence time of the moving target in the preset area is obtained by the microwave radar;

[0056] When the dwell time reaches a preset time, the camera module is activated and a captured image is acquired through the camera module.

[0057] The method can set the duration for determining that the moving target is in the stationary state according to the user's alertness level.

[0058] The method uses microwave radar to monitor the preset area outside the door in real time. When the mobile target stays in the preset area for a short time, the image capture and subsequent steps are not performed to avoid overreacting to the situation outside the door, which can reduce the number of reports to users and avoid users from frequently checking information such as captured images and generating nervous emotions, affecting the user's state and mood. At the same time, the storage of invalid information captured images occupies the storage space of the smart door lock.

[0059] Moreover, frequently activating the camera module will also waste power of the smart door lock.

[0060] There is a time difference between the signal emitted and the signal received by the microwave radar when detecting a moving target. In order to prevent the moving target determined to be in a stationary state from leaving the image capture area within the time difference, thereby rendering the captured image invalid, an image can be captured in advance before determining the stationary state of the moving target. After the determination is passed, the image can be used as the basis for storage and upload to increase the probability of detecting suspicious persons.

[0061] Correspondingly, the smart door lock is provided with a timing module.

[0062] In some implementations, in step S106, obtaining a first coordinate area of ​​the moving target corresponding to the preset area includes:

[0063] By calculating the time difference between the signal transmitted and the signal received by the mobile target, the first distance of the mobile target can be determined.

[0064] Furthermore, in step S106, obtaining a first coordinate area of ​​the moving target corresponding to the preset area includes:

[0065] The microwave radar obtains the coordinate area in the pixel coordinate system.

[0066] Specifically, the microwave radar obtains the coordinate area of ​​the entire body of the moving target.

[0067] The pixel coordinate system is a plane coordinate system. The moving object is represented as a pixel plane in the pixel coordinate system.

[0068] Furthermore, in some implementations, a first edge coordinate region of the pixel plane is obtained, and the first edge coordinate region is a first rectangular region, and the first rectangular region is a minimum rectangular region that includes the pixel plane corresponding to the moving target.

[0069] The first rectangular area is the first coordinate area.

[0070] The coordinate area set of the first rectangular area is: a ≤x′≤x b ′,y′ a ≤y′≤y b '. Point P' is a point in the first rectangular area (including edge coordinates), and its coordinates are (x', y').

[0071] In some embodiments, in step S106, obtaining a second coordinate region of the living object corresponding to the thermal imaging image includes:

[0072] The infrared recognition module obtains the coordinate area on the second camera coordinate system.

[0073] Specifically, the infrared recognition module obtains the coordinate area of ​​the whole body of the living target or the coordinate area of ​​a part of the living target according to the detection distance.

[0074] The infrared recognition module cannot directly obtain the second distance of the living target.

[0075] Similarly, the second distance corresponds to the distance between the living target and the smart door lock.

[0076] Therefore, in some embodiments, obtaining the second coordinate area of ​​the living object corresponding to the thermal imaging image includes:

[0077] Acquire a second edge coordinate region of the living object corresponding to the thermal imaging image;

[0078] The target thermal imaging area of ​​the living object is obtained according to the second edge coordinate area.

[0079] The second image coordinate system is a plane coordinate system. The living object is represented as an image plane in the second image coordinate system. That is, the thermal image of the living object is formed in the second image coordinate system.

[0080] The second image coordinate system corresponds to the second camera coordinate system.

[0081] Furthermore, in some implementations, a second edge coordinate region of the image plane is obtained, where the second edge coordinate region is a second rectangular region, and the second rectangular region is a minimum rectangular region that includes the image plane.

[0082] The second rectangular area is the second coordinate area.

[0083] Furthermore, in some embodiments, the imaging of the infrared recognition module for detecting living targets is simplified to a second pinhole imaging model.

[0084] Acquiring a second coordinate area of ​​the living object corresponding to the thermal imaging image includes:

[0085] Acquire a target thermal imaging area of ​​the living target corresponding to the thermal imaging image;

[0086] The second distance of the living target is obtained according to the ratio of the preset thermal imaging area and its corresponding preset distance and the target thermal imaging area.

[0087] For example, when performing face recognition, the distance between the "person" and the liveness detection camera of the face recognition module is 0.8m, and accordingly, the preset distance Z1 can be obtained. The preset thermal imaging area of ​​the "person" in the second camera coordinate system is S1, and the distance coordinate Z' of the detected live target can be converted according to the target thermal imaging area S2 obtained in the same coordinate system. W .

[0088] The conversion of thermal imaging area also has the advantage that if the detected living body is not a human being and has a body shape difference with a human being, the distance coordinate obtained by conversion will deviate from its actual position, so that the distance coordinate Z′ corresponding to the further calculated second distance W The distance coordinate Z corresponding to the first distance W The matching degree will also be inconsistent with the actual value and fail to pass the human detection.

[0089] In some embodiments, in step S106, obtaining a first coordinate area of ​​the moving target corresponding to the preset area, and a second coordinate area of ​​the living target corresponding to the thermal imaging image, includes:

[0090] The first coordinate region is converted into a third coordinate region in the first coordinate system.

[0091] like Figure 2 As shown, the imaging of moving targets detected by microwave radar is simplified to a first pinhole imaging model.

[0092] The first coordinate region of the moving target is converted into a world coordinate system.

[0093] The world coordinate system is the first coordinate system.

[0094] The specific formula is:

[0095]

[0096] The first image coordinate system and the pixel coordinate system are in a translation transformation relationship, the coordinates of the origin of the first image coordinate system in the pixel coordinate system are (x′0, y′0), and dx and dy are the lengths of the unit pixel in the pixel coordinate system in the image coordinate system.

[0097] The first image coordinate system corresponds to the first camera coordinate system.

[0098] like Figure 2 As shown, Z is the distance coordinate of point P in the first camera coordinate system corresponding to the microwave radar. Z can be obtained according to the first distance.

[0099] The optical center O is the origin of the first camera coordinate system. f is the focal length of the camera corresponding to the first camera coordinate system, that is, the distance between the origin O′ of the image space and the optical center O.

[0100] R is the rotation matrix between the world coordinate system and the first camera coordinate system, T is the translation matrix, and point P is the corresponding point of point P′ in the world coordinate system, and its coordinates are (X W ,Y W ,Z W ).

[0101] Among them, Z W is the distance coordinate of the moving target in the world coordinate system.

[0102] The world coordinate system is a second camera coordinate system corresponding to the infrared recognition module.

[0103] Among them, due to the difference in the installation structure of the liveness detection camera and the microwave radar on the smart lock, the microwave radar is generally installed in a flat surface, while the liveness detection camera is installed at a certain angle. Therefore, it involves the conversion of the camera coordinate system of the first pinhole imaging model and the second pinhole imaging model.

[0104] The camera coordinate system of the second pinhole imaging model is used as a unified world coordinate system, that is, the first coordinate system.

[0105] Assume that the coordinates of the optical center of the first pinhole imaging model in the world coordinate system are (l, m, n), and the deflection angles of the camera coordinate system of the first pinhole imaging model relative to the world coordinate system are α, β, and γ, respectively, then:

[0106]

[0107] The third coordinate region includes a coordinate region set of corresponding points P of each point P′ in the first rectangular region in the world coordinate system.

[0108] The second coordinate region is converted into a fourth coordinate region in the first coordinate system.

[0109] The fourth coordinate area includes every point in the second rectangular area.

[0110] The matching degree between the first coordinate area and the second coordinate area is obtained according to the matching degree between the third coordinate area and the fourth coordinate area.

[0111] In some implementations, the degree of matching between the third coordinate region and the fourth coordinate region is the degree of matching between the first distance and the second distance.

[0112] Specifically, the distance coordinate Z corresponding to the first distance W The distance coordinate Z′ corresponding to the second distance W degree of matching.

[0113] Correspondingly, the third coordinate area includes the distance coordinate Z corresponding to the first distance W , is the three-dimensional coordinate area.

[0114] The fourth coordinate area includes the distance coordinate Z′ corresponding to the second distance W .

[0115] From the above analysis, we can see that the distance coordinates are correlated with the coordinate intervals of the rectangular area on the X-axis and the Y-axis. Therefore, the matching degree of the third coordinate area and the fourth coordinate area in the same coordinate system is the distance coordinate matching degree.

[0116] When η is greater than a predetermined threshold, the living object is determined to be a humanoid living object, and the moving object and the living object are the same detection target. That is, it is determined that someone is stationed outside the door. According to laboratory test data, η = 50%.

[0117] In other implementations, the matching degree between the third coordinate region and the fourth coordinate region is the overlap between the two, specifically, the area overlap.

[0118] In some implementations, in step S108, judging whether there is a humanoid target according to the first coordinate area and the second coordinate area includes:

[0119] It is determined whether a humanoid target exists according to the matching degree between the first distance and the second distance.

[0120] The second distance is obtained by converting according to the ratio of a preset thermal imaging area and its corresponding preset distance.

[0121] The preset thermal imaging area is the area of ​​thermal imaging of a "person" at a preset distance. Therefore, the second distance is the converted distance of the preset living target as a "person". If the matching degree fails, part of the possibility is that the converted distance does not match the actual distance, indicating that the living target is a non-human living object, such as a cat or dog.

[0122] The reason why the matching degree fails may also be that the moving target and the living target are different detection targets, so they are not in the same position.

[0123] The method determines whether a moving target and a living target are the same detection target based on the matching degree, so as to avoid misjudgment.

[0124] In the method, the human shape detection of the detection target is combined with the living body detection, so the judgment can be made only based on the coordinate area of ​​the target, and the detection accuracy of the human shape living body is higher than that of the image recognition.

[0125] In some implementations, in step S108, judging whether there is a humanoid target according to the first coordinate area and the second coordinate area includes:

[0126] Whether a humanoid target exists is determined based on a degree of matching between the first coordinate region acquired at a first time and the second coordinate region acquired at a second time, the first time lagging behind the second time.

[0127] Since the detection target of the smart door lock is generally in a moving state, and as mentioned above, the detection of the microwave radar has a lag due to the need to receive the signal, therefore, even in the same world coordinate system, the distance coordinates obtained by the microwave radar and the infrared recognition module at the same time may correspond to detection targets in different positions.

[0128] In order to improve the accuracy of distance matching and thus determine whether a moving target and a living target are the same detection target, the first distance obtained by the microwave radar can be estimated when the infrared recognition module obtains the thermal imaging image. The first distance obtained by the microwave radar with a certain delay is matched with the second distance obtained by the infrared recognition module, so that the positions of the detection targets corresponding to the two distances are closer to the same position, which can avoid the detection target moving too fast and resulting in the target being unable to be detected as the same human target.

[0129] In step S108, if the humanoid target exists, storing and uploading the captured image includes:

[0130] Specifically, the smart door lock reports to the user the information that someone is outside the door.

[0131] Furthermore, the user can be prompted through a display module or voice module located inside the door of the smart door lock, or a corresponding prompt can be given through a terminal that communicates with the smart door lock, so that the user can understand the situation.

[0132] In some embodiments, the method further includes: S110, detecting the moving target by the microwave radar until it leaves the preset area, during which, at every second preset time interval, a captured image is acquired by the camera module, and the captured image is stored and uploaded.

[0133] In some implementations, the method further includes: S112, recording other information indicating that someone is outside the door, and storing and uploading the other information while storing and uploading the captured image.

[0134] Specifically, the other information may be the time when the moving target is detected and / or the time from when the moving target is detected until it leaves the preset area.

[0135] Correspondingly, the smart door lock is provided with a time module. Smart door locks generally have their own time module.

[0136] The other information may also be the moving track of the moving object in the preset area.

[0137] This information can be recorded when the moving target is detected. If the matching degree fails in step S108, the information will be deleted to save the storage space of the smart door lock.

[0138] In some implementations, the method further includes: S114, acquiring a second distance of the living object according to the second coordinate area;

[0139] When the second distance is less than a preset distance value, acquiring facial features according to the captured image;

[0140] According to the facial features, determine whether to store and upload the captured image.

[0141] When the infrared recognition module detects a living target, if the living target is close to it, it may only be able to obtain a partial thermal imaging image, such as the face or a part of the body.

[0142] At this time, the acquired target thermal imaging area is an incomplete thermal imaging area of ​​a living target, and the converted second distance is far away from the door relative to the actual position. Further distance matching cannot pass human figure recognition and position matching, and the living target may be ignored, and its corresponding captured image is not reported to the user, resulting in safety hazards.

[0143] Therefore, when a living target is located in a position where full-body thermal imaging cannot be obtained, face recognition is used to directly judge the living target. If facial features are recognized, the living target is judged to be a "person" and then reported to the user.

[0144] In some implementations, the method further includes: S116, performing face recognition on the captured image to determine the specific identity of the target.

[0145] In some embodiments, the method further includes: S118, after storing and uploading the captured image, after the microwave radar detects that the moving target reaches a certain distance in front of the smart door lock, performing face recognition on the target.

[0146] Specifically, the moving target is determined by the matching degree to be the same target as the living human target detected by the infrared recognition module, that is, the person staying outside the door.

[0147] In some other embodiments, the face recognition module is passively activated from the outside, specifically, by the person staying outside the door.

[0148] Accordingly, the step of human liveness detection can be omitted in the face recognition process performed by the face recognition module.

[0149] Embodiment 2

[0150] An embodiment of the present disclosure provides a smart door lock.

[0151] The device may include a corresponding module for performing each or several steps in the above flowchart. Therefore, each step or several steps in the above flowchart may be performed by a corresponding module, and the device may include one or more modules in these modules. The module may be one or more hardware modules specially configured to perform the corresponding steps, or implemented by a processor configured to perform the corresponding steps, or stored in a computer-readable medium for implementation by a processor, or implemented by some combination.

[0152] Specifically, refer to Figure 2 , the smart door lock 1000 includes:

[0153] The first activation module 1002 is used to monitor the preset area corresponding to the smart door lock in real time through the microwave radar. When the microwave radar detects a moving target, the infrared recognition module is activated to obtain a thermal imaging image through the infrared recognition module;

[0154] The second activation module 1004 is used to activate the camera module when it is determined that the thermal imaging image contains a living target, and obtain a captured image through the camera module;

[0155] A coordinate acquisition module 1006 is used to acquire a first coordinate area of ​​the moving target corresponding to the preset area, and to acquire a second coordinate area of ​​the living target corresponding to the thermal imaging image;

[0156] A coordinate determination module 1008 is used to determine whether there is a humanoid target according to the first coordinate area and the second coordinate area, and if the humanoid target exists, store and upload the captured image;

[0157] The smart door lock is provided with the microwave radar, the infrared recognition module and the camera module.

[0158] The embodiment of the present disclosure also provides an electronic device, including: a memory, the memory storing execution instructions; and a processor or other hardware module, the processor or other hardware module executes the execution instructions stored in the memory, so that the processor or other hardware module executes the above-mentioned smart door lock resident capture method.

[0159] The embodiment of the present disclosure also provides a readable storage medium, in which execution instructions are stored. When the execution instructions are executed by a processor, they are used to implement the above-mentioned smart door lock resident snapshot method.

[0160] Among them, the hardware structure adopted by the smart door lock implemented by the hardware implementation method based on the processor of the present disclosure can be implemented using a bus architecture. The bus architecture can include any number of interconnected buses and bridges, depending on the specific application and overall design constraints of the hardware. The bus connects various circuits including one or more processors, memories and / or hardware modules together. The bus can also connect various other circuits such as peripherals, voltage regulators, power management circuits, external antennas, etc.

[0161] The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Component (EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, only one connecting line is used in this figure, but it does not mean that there is only one bus or one type of bus.

[0162] Any process or method description in the flowchart or otherwise described herein can be understood as a module, fragment or portion of a code representing one or more executable instructions for implementing the steps of a specific logical function or process, and the scope of the preferred embodiments of the present disclosure includes other implementations, in which the functions may not be performed in the order shown or discussed, including performing the functions in a substantially simultaneous manner or in a reverse order according to the functions involved, which should be understood by a person skilled in the art of the present disclosure. The processor performs the various methods and processes described above. For example, the method implementation in the present disclosure can be implemented as a software program, which is tangibly contained in a machine-readable medium, such as a memory. In some embodiments, part or all of the software program can be loaded and / or installed via a memory and / or a communication interface. When the software program is loaded into the memory and executed by the processor, one or more steps in the method described above can be performed. Alternatively, in other embodiments, the processor can be configured to perform one of the above methods in any other appropriate manner (e.g., by means of firmware).

[0163] The logic and / or steps represented in the flowchart or otherwise described herein may be embodied in any readable storage medium for use by an instruction execution system, apparatus, or device (such as a computer-based system, a system including a processor, or other system that can fetch instructions from and execute instructions on an instruction execution system, apparatus, or device), or in combination with such instruction execution systems, apparatuses, or devices.

[0164] For the purposes of this specification, a "readable storage medium" may be any device that can contain, store, communicate, propagate or transmit a program for use with or in conjunction with an instruction execution system, device or apparatus. More specific examples of readable storage media (a non-exhaustive list) include the following: an electrical connection with one or more wirings (electronic device), a portable computer disk case (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and editable read-only memory (EPROM or flash memory), a fiber optic device, and a portable read-only memory (CDROM). In addition, the readable storage medium may even be paper or other suitable medium on which the program can be printed, since the program can be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, deciphering or, if necessary, processing in another suitable manner, and then stored in a memory.

[0165] It should be understood that the various parts of the present disclosure can be implemented in hardware, software, or a combination thereof. In the above-mentioned embodiments, multiple steps or methods can be implemented in software stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0166] A person skilled in the art may understand that all or part of the steps of implementing the above-mentioned implementation method may be completed by instructing related hardware through a program, and the program may be stored in a readable storage medium, which, when executed, includes one or a combination of the steps of the implementation method.

[0167] In addition, each functional unit in each embodiment of the present disclosure may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a readable storage medium. The storage medium may be a read-only memory, a disk or an optical disk, etc.

[0168] Those skilled in the art should understand that the above embodiments are only for the purpose of clearly illustrating the present disclosure, and are not intended to limit the scope of the present disclosure. For those skilled in the art, other changes or modifications may be made based on the above disclosure, and these changes or modifications are still within the scope of the present disclosure.

Claims

1. A method for capturing a smart door lock, characterized in that: The method comprises: The preset area corresponding to the smart door lock is monitored in real time by a microwave radar. When the microwave radar detects a moving target, an infrared recognition module is activated to obtain a thermal imaging image by the infrared recognition module. When it is determined that the thermal imaging image contains a living target, the camera module is activated to obtain a captured image through the camera module; Acquire a first coordinate area of ​​the moving target corresponding to the preset area, and acquire a second coordinate area of ​​the living target corresponding to the thermal imaging image; Determining whether there is a humanoid target according to the first coordinate area and the second coordinate area, and if the humanoid target exists, storing and uploading the captured image; The smart door lock is provided with the microwave radar, the infrared recognition module and the camera module.

2. The method according to claim 1, characterized in that When the microwave radar detects a moving target, the infrared recognition module is activated, including: Acquire a first distance of the moving target; When the first distance does not decrease, the infrared recognition module is not activated.

3. The method according to claim 1, characterized in that When it is determined that a living target is included in the thermal imaging image, the camera module is activated, and a captured image is acquired through the camera module, including: When it is determined that a living target is included in the thermal imaging image, the residence time of the moving target in the preset area is obtained by the microwave radar; When the dwell time reaches a preset time, the camera module is activated and a captured image is acquired through the camera module.

4. The method according to claim 1, characterized in that Acquiring a first coordinate area of ​​the moving target corresponding to the preset area includes: Acquire a first distance of the moving target; Acquiring a second coordinate area of ​​the living object corresponding to the thermal imaging image includes: Acquire a target thermal imaging area of ​​the living target corresponding to the thermal imaging image; Obtaining a second distance of the living target according to a ratio of a preset thermal imaging area and a corresponding preset distance and the target thermal imaging area; Judging whether a humanoid target exists according to the first coordinate area and the second coordinate area includes: It is determined whether a humanoid target exists according to the matching degree between the first distance and the second distance.

5. The method according to claim 1, characterized in that The method further comprises: Acquire a second distance of the living object according to the second coordinate area; When the second distance is less than a preset distance value, acquiring facial features according to the captured image; According to the facial features, determine whether to store and upload the captured image.

6. The method according to claim 1, characterized in that Acquiring a first coordinate area of ​​the moving target corresponding to the preset area, and a second coordinate area of ​​the living target corresponding to the thermal imaging image, comprising: Convert the first coordinate region into a third coordinate region in the first coordinate system; Convert the second coordinate region into a fourth coordinate region in the first coordinate system; The matching degree between the first coordinate area and the second coordinate area is obtained according to the matching degree between the third coordinate area and the fourth coordinate area.

7. The method according to claim 1, characterized in that Judging whether a humanoid target exists according to the first coordinate area and the second coordinate area includes: Whether a humanoid target exists is determined based on a degree of matching between the first coordinate region acquired at a first time and the second coordinate region acquired at a second time, the first time lagging behind the second time.

8. A smart door lock, characterized in that: The smart door lock comprises: A first activation module is used to monitor the preset area corresponding to the smart door lock in real time through a microwave radar, and when the microwave radar detects a moving target, the infrared recognition module is activated to obtain a thermal imaging image through the infrared recognition module; The second activation module is used to activate the camera module when determining that the thermal imaging image contains a living target, and obtain a captured image through the camera module; A coordinate acquisition module, used to acquire a first coordinate area of ​​the moving target corresponding to the preset area, and to acquire a second coordinate area of ​​the living target corresponding to the thermal imaging image; A coordinate determination module, used for determining whether there is a humanoid target according to the first coordinate area and the second coordinate area, and if the humanoid target exists, storing and uploading the captured image; The smart door lock is provided with the microwave radar, the infrared recognition module and the camera module.

9. An electronic device, characterized in that: include: A memory storing execution instructions; as well as A processor, wherein the processor executes the execution instruction stored in the memory so that the processor executes the method according to any one of claims 1 to 7.

10. A readable storage medium, characterized in that: The readable storage medium stores execution instructions, which are used to implement the method according to any one of claims 1 to 7 when executed by a processor.

Images