Door lock double-holder monitoring system and intelligent door lock

Abstract

The invention relates to the technical field of intelligent door locks, and discloses a door lock double-holder monitoring system and an intelligent door lock, the system comprises a main control module and an induction identification module arranged in the door lock, an outdoor holder module arranged outside the door lock, and an indoor holder module arranged inside the door lock; when the induction recognition module recognizes a target object in a preset induction area, position information is obtained and sent to the main control module; the main control module determines the current environment of the target object based on the position information, generates a corresponding control instruction based on the current environment and the position information, and sends the control instruction to the outdoor holder module or the indoor holder module; and the outdoor pan-tilt module or the indoor pan-tilt module executes rotation operation in the horizontal direction and the vertical direction according to the received control instruction so as to monitor the target object in real time. According to the invention, all-directional monitoring of the target is realized through combination of the double holders, satisfactory door lock use experience is provided for a user, the satisfaction degree of the user is improved, and the intelligent use requirement of the door lock is met.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent door locks, and in particular to a door lock dual-pan-tilt monitoring system and an intelligent door lock. Background Art

[0002] At present, more and more smart door locks have face recognition and cat-eye monitoring functions, but their camera modules are mostly fixed and cannot be rotated or adjusted. In addition, existing smart door locks often focus on outdoor monitoring (i.e. monitoring the outside of the door lock), but target objects indoors (i.e. the inside of the door lock), such as the elderly, children, and pets, are often monitored less, and indoor monitoring is only through a built-in camera, which makes it impossible to adjust the monitoring video angle in all directions, so it is impossible to track indoor and outdoor target objects in real time. In addition, when the target object is in a remote or edge position of the door lock, the image recognized by the camera module is often distorted, making it difficult to see or identify the target object. In particular, when the target object is in motion, it is more difficult to quickly track and identify the target object.

[0003] In summary, the existing smart door locks cannot automatically adjust the angle to achieve all-round tracking of the target object due to the fixed indoor and outdoor scene camera modules; and the monitoring function is single, and it is impossible to achieve effective monitoring of different targets such as the elderly, children and pets, full-process monitoring of the target object from outdoor to indoor, and full-house monitoring without blind spots indoors, etc., which seriously affects the user experience and is difficult to meet the multi-functional monitoring needs of door locks. Summary of the invention

[0004] In view of this, the present invention provides a door lock dual pan-tilt monitoring system and an intelligent door lock to solve the problem that the existing door locks have low monitoring accuracy of the target object due to the fixed monitoring angle, making it difficult to achieve multi-functional, all-round and efficient monitoring and tracking of the target object, which seriously affects the user experience and cannot meet the needs of intelligent use of door locks.

[0005] In a first aspect, the present invention provides a door lock dual-pan-tilt monitoring system, the system comprising: A main control module and a sensing and identification module, an outdoor pan-tilt module and an indoor pan-tilt module respectively connected thereto, wherein the main control module and the sensing and identification module are both arranged inside the door lock, the outdoor pan-tilt module is arranged outside the door lock, and the indoor pan-tilt module is arranged inside the door lock; The sensing and recognition module is used to obtain the location information of the target object when the target object is recognized in the preset sensing area, and send the location information to the main control module; A main control module, used to determine the current environment of the target object based on the location information, generate corresponding control instructions based on the current environment and location information, and send the control instructions to the outdoor PTZ module or the indoor PTZ module; The outdoor PTZ module or the indoor PTZ module is used to receive control instructions and perform rotation operations in the horizontal and vertical directions based on the control instructions to monitor the target object in real time.

[0006] The present invention designs a door lock dual PTZ monitoring system including a main control module and a sensing recognition module inside the door lock, an outdoor PTZ module outside the door lock, and an indoor PTZ module inside the door lock. The object is identified by the sensing recognition module, and the position information is obtained and sent to the main control module when the object is identified; the main control module determines the current environment of the target object based on the position information, and generates corresponding control instructions based on the current environment and position information and sends them to the outdoor PTZ module or the indoor PTZ module; the outdoor PTZ module or the indoor PTZ module performs rotation operations in the horizontal and vertical directions according to the received control instructions to monitor the target object in real time. The present invention can realize multifunctional, all-round and efficient object monitoring through the combination of dual PTZs, provides users with a satisfactory door lock use experience, improves user satisfaction, and meets the intelligent use requirements of door locks.

[0007] In an optional implementation, when the current environment is an outdoor environment, the system's monitoring process for the target object includes: A main control module, used for generating a first control instruction according to the outdoor environment and location information, and sending the first control instruction to the outdoor PTZ module; The outdoor PTZ module is used to rotate according to the first control instruction. When the rotated outdoor PTZ module is aligned with the position information, the target object is authenticated and / or tracked, and the corresponding authentication result and / or tracking result are obtained and sent to the main control module; A main control module, for generating a second control instruction when determining that the door lock is opened according to the authentication result and / or the tracking result, and sending the second control instruction to the indoor PTZ module; The indoor pan / tilt module is used to receive the second control instruction and perform rotation operations in the horizontal and vertical directions based on the second control instruction to monitor the target object in real time.

[0008] The present invention designs scene monitoring for outdoor environments, that is, the main control module generates a first control instruction according to the outdoor environment and position information of the target object and sends it to the outdoor pan-tilt module; the outdoor pan-tilt module rotates according to the first control instruction, performs identity authentication and / or target tracking on the target object when aligning with the position information, obtains the authentication result and / or tracking result and sends it to the main control module; when the main control module determines that the door lock is open according to the authentication result and / or tracking result, it generates a second control instruction and sends it to the indoor pan-tilt module, so that the indoor pan-tilt module can realize real-time monitoring of the target object according to the second control instruction, which can realize multi-functional, all-round and efficient object monitoring, and provide users with a satisfactory door lock usage experience.

[0009] In an optional implementation, when the current environment is an indoor environment, the system's monitoring process for the target object includes: A main control module, used for generating a third control instruction according to the indoor environment and position information, and sending the third control instruction to the indoor PTZ module; The indoor pan / tilt module is used to rotate according to the third control instruction. When the rotated indoor pan / tilt module is aligned with the position information, the target object is tracked in real time, and the indoor tracking result is obtained and sent to the main control module; The main control module is used to generate a fourth control instruction when it is determined that there is no target object in the indoor environment according to the indoor tracking result, and send the fourth control instruction to the outdoor PTZ module; The outdoor PTZ module is used to receive a fourth control instruction and perform rotation operations in the horizontal and vertical directions based on the fourth control instruction to monitor the target object in real time.

[0010] The present invention designs scene monitoring for indoor environments, that is, the main control module generates a third control instruction according to the indoor environment and position information of the target object and sends it to the indoor pan-tilt module; the indoor pan-tilt module rotates according to the third control instruction, tracks the target object in real time when aligning with the position information, obtains the indoor tracking result and sends it to the main control module; when the main control module determines that there is no target object in the indoor environment according to the indoor tracking result, it generates a fourth control instruction and sends it to the outdoor pan-tilt module, so that the outdoor pan-tilt module performs rotation operations in the horizontal and vertical directions according to the fourth control instruction, so as to monitor the target object in real time, which can realize multi-functional, all-round and efficient object monitoring and provide users with a satisfactory door lock usage experience.

[0011] In an optional embodiment, the outdoor pan-tilt module and the indoor pan-tilt module both include: a camera unit, a drive unit and a dual stepper motor; wherein the camera unit is used to authenticate and monitor the target object in real time, and synchronously display the monitoring screen; the drive unit responds to the work request of the outdoor pan-tilt module or the indoor pan-tilt module, and controls the corresponding motors in the horizontal and vertical directions to rotate accordingly.

[0012] The present invention designs an outdoor pan-tilt module and an indoor pan-tilt module which include a camera unit, a drive unit and a dual stepper motor. Through the coordinated work of each unit, accurate recognition and real-time tracking of the target object can be achieved, which helps to achieve all-round object monitoring, optimizes the monitoring function of the door lock, and thus greatly improves the user experience and meets the multi-functional monitoring requirements of the door lock.

[0013] In an optional embodiment, the system also includes: a mobile terminal that interacts with the door lock, wherein the mobile terminal is deployed with a client, and the client is used to configure the monitoring mode of the door lock dual pan-tilt monitoring system, and generate a corresponding functional monitoring signal based on the monitoring mode and send it to the main control module of the door lock, so that the main control module controls the sensing and identification module, the outdoor pan-tilt module and the indoor pan-tilt module to perform corresponding monitoring functions based on the functional monitoring signal.

[0014] The present invention also takes into account the monitoring needs of different users, and designs a mobile terminal that interacts with the door lock accordingly. The monitoring mode of the door lock dual pan-tilt monitoring system is customized through the client deployed on the mobile terminal, which greatly meets the multi-functional monitoring needs of the door lock and can provide users with a satisfactory door lock usage experience.

[0015] In an optional implementation, when the monitoring mode is accident monitoring, the process of the system performing accident monitoring includes: The sensing and recognition module is used to identify within a first preset range in the door, and when at least one target object is identified, obtain the motion trajectory of each target object in order from high to low according to the monitoring priority, and send the motion trajectory and / or motion posture of each target object to the main control module; A main control module is used to analyze the motion trajectory and / or motion posture of each target object to determine the target object where the accident occurred, obtain the target position where the accident occurred by using the motion trajectory and / or motion posture, generate a first monitoring instruction based on the target position, and send the first monitoring instruction to the indoor pan / tilt module; The indoor pan-tilt module is used to rotate according to the first monitoring instruction. When the rotated indoor pan-tilt module is aligned with the target position, the target object is monitored in real time, the length of time the target object stays at the target position is obtained, and the length of time the target object stays at the target position is sent to the main control module; The main control module is used to send the current monitoring screen of the target object to the client when the stay time exceeds the preset time; or control the door lock to perform accident broadcast processing, and control the outdoor pan-tilt module to display rescue information and / or temporary unlocking password.

[0016] The present invention takes into account the need for monitoring special groups such as the elderly and children who are prone to accidents such as falls indoors in real life, and accordingly designs a monitoring mode that includes accident monitoring. Specifically, the sensing and recognition module monitors the motion trajectory of each target object in the room in real time based on a monitoring priority set in advance. When the main control module determines the target object where the accident occurs from each motion trajectory, the target position where the accident occurs is obtained and the indoor pan-tilt module is controlled to rotate to align with the target position, thereby realizing real-time monitoring of the target object. By obtaining the length of time the target object stays at the current target position, and by analyzing the relationship between the length of time and the preset length of time for the accident to occur, it is determined whether the target object has an accident, and when an accident occurs, the door lock is controlled to perform corresponding accident processing, thereby providing users with a satisfactory door lock usage experience and ensuring the personal safety of each target object to a great extent.

[0017] In an optional implementation, when the monitoring mode is carried-item monitoring, the process of the system performing carried-item monitoring includes: The sensing and identifying module is used to obtain the object position of the target object when the target object is identified within a first preset range inside the door, and send the object position to the main control module; A main control module, used for generating a second monitoring instruction according to the position of the object, and sending the second monitoring instruction to the indoor PTZ module; The indoor pan-tilt module is used to rotate according to the second monitoring instruction. When the rotated indoor pan-tilt module is aligned with the object position, the object carried by the target object is monitored in real time to obtain the object monitoring information, and the object monitoring information is sent to the main control module; The main control module is used to analyze the object monitoring information and determine whether the target object carries the preset object. If the target object does not carry the preset object, the door lock is controlled to broadcast the preset object reminder information.

[0018] The present invention takes into account the monitoring needs of users who are prone to miss carrying items when going out in real life, and accordingly designs a monitoring mode that includes monitoring of carried items. Specifically, the target object in the room within a certain range of the door lock is identified through the sensing and recognition module. When the target object is identified, the object position is obtained and the indoor pan-tilt module is controlled to rotate to align with the object position, and the item monitoring information is obtained through real-time monitoring of the items carried by the target object; the item monitoring information is analyzed with the preset items carried by the target object to determine whether there is any missing item, and when the carried item is missed, the door lock is controlled to perform corresponding item reminder processing, which greatly meets the demand for intelligent use of the door lock and provides users with a satisfactory door lock use experience.

[0019] In an optional implementation, the system performs a process of carrying item monitoring, further comprising: The sensing and identifying module is used to obtain a first position of the target object when the target object is identified within a second preset range outside the door, and send the first position to the main control module; A main control module, used for generating a third monitoring instruction based on the first position, and sending the third monitoring instruction to the outdoor PTZ module; The outdoor PTZ module is used to rotate according to the third monitoring instruction. When the rotated outdoor PTZ module is aligned with the first position, the target object is monitored in real time to obtain first monitoring information, and the first monitoring information is sent to the main control module; The main control module is used to generate a fourth monitoring instruction when the door lock is opened, and send the fourth monitoring instruction to the indoor PTZ module; An indoor PTZ module, used to perform real-time monitoring of the target object according to the fourth monitoring instruction to obtain second monitoring information, and send the second monitoring information to the main control module; The main control module is used to determine whether the corresponding carried items in the first monitoring information and the second monitoring information are the same, and when the corresponding carried items in the first monitoring information and the second monitoring information are not the same, control the door lock to perform broadcast processing based on the preset item reminder information.

[0020] The monitoring mode of carried items of the present invention not only takes into account the monitoring needs of the user's outing scenarios, but also takes into account whether the user has missed carrying items when entering the room from outside the door. The target object outdoors that is within a certain range of the door lock is identified through the sensing and recognition module. When the target object is identified, the first position of the user is obtained and the outdoor pan-tilt module is controlled to rotate to align with the first position. The first monitoring information is obtained by real-time monitoring of the items carried by the target object through the outdoor pan-tilt module; when the door lock is opened, the indoor pan-tilt module is controlled to track the same target object in real time, and the corresponding second monitoring information is obtained; by analyzing the difference between the first monitoring information and the second monitoring information, it is determined whether there is any missing item, and when the carried item is missed, the door lock is controlled to perform corresponding item reminder processing, which can enrich the function of monitoring carried items, further improve the user experience, and help meet the user's demand for intelligent use of door locks.

[0021] In an optional implementation, when the monitoring mode is out-of-town monitoring, the process of the system performing out-of-town monitoring includes: The main control module is used to record the pop-up time of the lock body latch when detecting that the lock body latch is popped out; when the pop-up time exceeds the preset time threshold, control the door lock to broadcast based on the preset outgoing reminder information, and send the preset outgoing reminder information to the administrator of the door lock; and generate a fifth monitoring instruction and send it to the indoor pan / tilt module at the same time; The indoor PTZ module is used to receive the fifth monitoring instruction, and based on the fifth monitoring instruction, monitor the current indoor environment in real time, and record the indoor monitoring screen and send it to the main control module; The main control module is used to generate a sixth monitoring instruction and send it to the outdoor PTZ module when it is determined that there is no target object in the current indoor environment according to the indoor monitoring picture; The outdoor PTZ module is used to monitor the current outdoor environment in real time according to the sixth monitoring instruction, and record the outdoor monitoring screen and send it to the main control module; The main control module is used to control the sensing and recognition module, the outdoor pan-tilt module and the indoor pan-tilt module to perform corresponding monitoring functions according to the outdoor monitoring screen.

[0022] The present invention takes into account the monitoring needs of children, pets and other target objects in real life who cannot be informed of their going out when they come out of the room, and accordingly designs a monitoring mode including going out monitoring. Specifically, the main control module detects the pop-up of the lock body inclined tongue, and records the pop-up time of the lock body inclined tongue. When the pop-up time exceeds the preset time threshold, the door lock is controlled to perform corresponding going out reminder processing, and a fifth monitoring instruction is generated and sent to the indoor pan-tilt module; the indoor pan-tilt module monitors the current indoor environment in real time based on the fifth monitoring instruction, and records the indoor monitoring screen and sends it to the main control module; when the main control module determines that there is no target object in the current indoor environment according to the indoor monitoring screen, a sixth monitoring instruction is generated and sent to the outdoor pan-tilt module; the outdoor pan-tilt module monitors the current outdoor environment in real time according to the sixth monitoring instruction, and records the outdoor monitoring screen and sends it to the main control module, so that the main control module controls the sensing and recognition module, the outdoor pan-tilt module and the indoor pan-tilt module to perform corresponding monitoring functions according to the outdoor monitoring screen, which can provide users with a satisfactory door lock usage experience and help ensure the safety of the target object outdoors.

[0023] In an optional implementation, when the monitoring mode is whole-house monitoring, the process of the system performing whole-house monitoring includes: The main control module is used to generate a seventh monitoring instruction when receiving at least one indoor monitoring signal, and send the seventh monitoring instruction to the indoor PTZ module; wherein the indoor monitoring signal is generated in response to the configuration operation of the target object on the indoor monitoring device; an indoor PTZ module, for rotating in a preset direction according to a seventh monitoring instruction, determining a first monitoring range and sending it to a main control module; The main control module is used to determine the detection range of each indoor monitoring device based on the corresponding indoor monitoring signal, and determine the second monitoring range based on the detection range of all indoor monitoring devices; determine the repeated monitoring area based on the first monitoring range and the second monitoring range, and filter the repeated monitoring area in the first monitoring range to obtain the corresponding target monitoring range of the indoor pan-tilt module; when any monitored object enters the room, determine the target current area according to the current identification position of the monitored object, and control the indoor monitoring equipment or indoor pan-tilt module in the corresponding monitoring range based on the target current area to monitor the monitored object.

[0024] The present invention takes into account the demand for whole-house monitoring that is linked to indoor smart home devices, and designs a corresponding monitoring mode that includes whole-house monitoring. Specifically, a corresponding indoor monitoring signal is generated through the configuration operation of at least one indoor monitoring device by a target object. The system controls the rotation of the indoor pan-tilt module in response to any indoor monitoring signal, determines a first monitoring range of the indoor pan-tilt, determines a second monitoring range of all indoor monitoring devices according to all indoor monitoring signals, determines a repeated monitoring area based on the first monitoring range and the second monitoring range, and filters the repeated monitoring area in the first monitoring range to obtain a corresponding target monitoring range of the indoor pan-tilt module. When the monitored object is at any position indoors, the indoor monitoring device or the indoor pan-tilt module in the corresponding monitoring range can be quickly controlled to monitor the monitored object. This not only realizes whole-house monitoring without blind spots, and provides users with a satisfactory door lock usage experience, but also helps to save resources, thereby extending the service life of the indoor pan-tilt module.

[0025] In an optional implementation, when the monitoring mode is rental housing monitoring, the process of the system performing rental housing monitoring includes: The main control module is used to control the indoor PTZ module to monitor all indoor home appliances in the rental house in real time, and to control the outdoor PTZ module to monitor the door locks of the rental house in real time; When the indoor pan-tilt module monitors the movement of any indoor home appliance and / or the outdoor pan-tilt module monitors the same indoor home appliance; or when the outdoor pan-tilt module monitors the door lock being disassembled, the main control module controls the door lock to broadcast based on the preset warning information and sends the preset warning information to the administrator of the door lock.

[0026] The present invention takes into account the monitoring needs of the landlord's indoor fixed assets in the rental scenario in actual life, and designs a corresponding monitoring mode including rental house monitoring. Specifically, all indoor household appliances of the rental house are monitored in real time through the indoor pan-tilt module and the outdoor pan-tilt module is monitored in real time on the door lock of the rental house. When the indoor pan-tilt module monitors the movement of any indoor household appliance and / or the outdoor pan-tilt module monitors the same indoor household appliance or the outdoor pan-tilt module monitors the removal of the door lock, corresponding early warning processing is performed, which can meet the needs of intelligent use of door locks, provide landlords with a satisfactory door lock use experience, greatly improve the convenience and safety of rental house management, and thus protect the property safety of landlords.

[0027] In a second aspect, the present invention provides a smart door lock, which includes a door lock body and a door lock dual pan-tilt monitoring system according to the first aspect or any corresponding embodiment thereof.

[0028] The intelligent door lock of the present invention can realize multifunctional, all-round and efficient target monitoring by carrying a door lock dual-pan-tilt monitoring system on the door lock body, thereby providing users with a satisfactory door lock usage experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0030] Figure 1 is a structural block diagram of a door lock dual PTZ monitoring system according to an embodiment of the present invention; Figure 2 This is a schematic diagram of the structure of the door lock with dual pan / tilts installed; Figure 3 is a structural block diagram of another door lock dual-pan-tilt monitoring system according to an embodiment of the present invention; Figure 4 This is a schematic diagram of the structure of another door lock with a double pan / tilt system installed; Figure 5 It is a schematic diagram of the structure of the smart door lock with dual PTZ monitoring; Figure 6 It is a fall monitoring diagram; Figure 7 is a flow chart of the execution of the fall monitoring function; Figure 8 This is a schematic diagram of dual PTZ linkage monitoring; Fig. 9 It is a schematic diagram of the various processes executed by the dual PTZ linkage monitoring function; Fig.10 It is a pet monitoring schematic diagram; Fig.11 It is a flowchart of the execution of the pet monitoring function; Fig.12 It is a schematic diagram of the function execution flow corresponding to the configuration monitoring priority; Fig.13 It is a schematic diagram of whole house monitoring; Fig.14 It is a flowchart of the execution of the whole house monitoring function; Fig.15 This is a monitoring diagram of a rental house; Fig.16 It is a flowchart of the execution of the rental housing monitoring function; Fig.17 is a structural block diagram of a door lock according to an embodiment of the present invention. DETAILED DESCRIPTION

[0031] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0032] In the description of the present invention, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, it can also be the internal connection of two components, it can be a wireless connection, or it can be a wired connection. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0033] In this embodiment, a door lock dual-pan-tilt monitoring system is provided. Figure 1 is a schematic diagram of the structure of a door lock dual PTZ monitoring system according to an embodiment of the present invention. Figure 1 As shown, the system includes: a main control module 1 and a sensing and identification module 2, an outdoor pan-tilt module 3 and an indoor pan-tilt module 4 respectively connected thereto; wherein, the main control module 1 and the sensing and identification module 2 are both arranged inside the door lock, the outdoor pan-tilt module 3 is arranged at the outside part of the door lock, and the indoor pan-tilt module 4 is arranged at the inside part of the door lock; the sensing and identification module 2 is used to obtain the position information of the target object when identifying the target object in a preset sensing area, and send the position information to the main control module 1; the main control module 1 is used to determine the current environment of the target object based on the position information, generate corresponding control instructions based on the current environment and position information, and send the control instructions to the outdoor pan-tilt module 3 or the indoor pan-tilt module 4; the outdoor pan-tilt module 3 or the indoor pan-tilt module 4 is used to receive the control instructions, and perform rotation operations in the horizontal and vertical directions based on the control instructions to monitor the target object in real time.

[0034] It should be noted that the sensing and recognition module 2 in this embodiment mainly senses the target object based on sensing methods such as radar / infrared / sound, and is mainly used to identify the position movement, gait, posture and other information of the target object. Therefore, the specific content of the sensing and recognition module 2 and the specific value of the preset sensing area in this embodiment are not limited here, and can be adaptively set according to actual needs. For example, if the sensing and recognition module 2 is a radar module, the corresponding preset sensing area is set to a range of 5 meters outside the door, which is only for exemplary explanation.

[0035] It should be noted that the pan / tilt is a supporting device for installing and fixing mobile phones, cameras, camcorders, etc. It can be rotated arbitrarily for the convenience of users. In actual applications, since the general structure of the pan / tilt is basically the same, it is necessary to combine the actual structural adaptability design of the smart door lock, that is, to carry out a reasonable layout design within the narrow space structure inside the lock, which can drive the overall rotation left and right, up and down without dead angles, and at the same time make the internal circuit board and other structures not interfere with each other. In this embodiment, the outdoor pan / tilt module 3 and the indoor pan / tilt module 4 are all-round pan / tilts that can rotate left and right as well as up and down. Their specific structures and installation positions are not limited here, and can be adaptively adjusted according to actual needs, such as Figure 2 Schematic diagram of a door lock with dual pan / tilts installed.

[0036] The dual PTZ monitoring system for door locks of the embodiment of the present invention is designed to include a main control module and a sensing recognition module inside the door lock, an outdoor PTZ module outside the door lock, and an indoor PTZ module inside the door lock. The sensing recognition module identifies the object, obtains the position information when the object is identified, and sends it to the main control module; the main control module determines the current environment of the target object based on the position information, and generates corresponding control instructions based on the current environment and position information and sends them to the outdoor PTZ module or the indoor PTZ module; the outdoor PTZ module or the indoor PTZ module performs rotation operations in the horizontal and vertical directions according to the received control instructions to monitor the target object in real time. The present invention can realize multifunctional, all-round, and efficient object monitoring through the combination of dual PTZs, provides users with a satisfactory door lock usage experience, improves user satisfaction, and meets the intelligent usage requirements of door locks.

[0037] It should be noted that the current environment in which the target object is located in this embodiment includes an outdoor environment and an indoor environment. According to the monitoring requirements of objects in different scenes, a corresponding PTZ workflow needs to be designed. Specifically, when the current environment is an outdoor environment, the system's monitoring process for the target object includes: a main control module 1, which is used to generate a first control instruction according to the outdoor environment and position information, and send the first control instruction to the outdoor PTZ module 3; the outdoor PTZ module 3 is used to rotate according to the first control instruction, and when the rotated outdoor PTZ module is aligned with the position information, the target object is authenticated and / or tracked, and the corresponding authentication result and / or tracking result are obtained and sent to the main control module 1; the main control module 1 is used to determine that the door lock is opened according to the authentication result and / or tracking result, and generate a second control instruction, and send the second control instruction to the indoor PTZ module 4; the indoor PTZ module 4 is used to receive the second control instruction, and perform a rotation operation in the horizontal and vertical directions based on the second control instruction to monitor the target object in real time.

[0038] The door lock dual pan-tilt monitoring system of the embodiment of the present invention is designed for scene monitoring of the outdoor environment, that is, the main control module generates a first control instruction according to the outdoor environment and position information of the target object and sends it to the outdoor pan-tilt module; the outdoor pan-tilt module rotates according to the first control instruction, performs identity authentication and / or target tracking on the target object when aligning with the position information, obtains the authentication result and / or tracking result and sends it to the main control module; when the main control module determines that the door lock is open according to the authentication result and / or tracking result, it generates a second control instruction and sends it to the indoor pan-tilt module, so that the indoor pan-tilt module can realize real-time monitoring of the target object according to the second control instruction, which can realize multi-functional, all-round and efficient object monitoring, and provide users with a satisfactory door lock usage experience.

[0039] In this embodiment, when the current environment is an indoor environment, the system's monitoring process for the target object includes: a main control module 1, which is used to generate a third control instruction according to the indoor environment and position information, and send the third control instruction to the indoor pan-tilt module 4; the indoor pan-tilt module 4 is used to rotate according to the third control instruction, and when the rotated indoor pan-tilt module is aligned with the position information, the target object is tracked in real time, and the indoor tracking result is obtained and sent to the main control module 1; the main control module 1 is used to generate a fourth control instruction when it is determined that there is no target object in the indoor environment according to the indoor tracking result, and send the fourth control instruction to the outdoor pan-tilt module 3; the outdoor pan-tilt module 3 is used to receive the fourth control instruction, and perform rotation operations in the horizontal and vertical directions based on the fourth control instruction to monitor the target object in real time.

[0040] The door lock dual pan-tilt monitoring system of the embodiment of the present invention is designed for scene monitoring of indoor environments, that is, the main control module generates a third control instruction according to the indoor environment and position information of the target object and sends it to the indoor pan-tilt module; the indoor pan-tilt module rotates according to the third control instruction, tracks the target object in real time when aligning with the position information, obtains the indoor tracking result and sends it to the main control module; when the main control module determines that there is no target object in the indoor environment according to the indoor tracking result, it generates a fourth control instruction and sends it to the outdoor pan-tilt module, so that the outdoor pan-tilt module performs rotation operations in the horizontal and vertical directions according to the fourth control instruction to monitor the target object in real time, which can realize multi-functional, all-round and efficient object monitoring, and provide users with a satisfactory door lock usage experience.

[0041] In this embodiment, Figure 3 is a structural block diagram of another door lock dual PTZ monitoring system according to an embodiment of the present invention; Figure 3, the outdoor pan-tilt module 3 and the indoor pan-tilt module 4 both include: a camera unit, a drive unit and a dual stepper motor; wherein the camera unit is used to authenticate and monitor the target object in real time, and to display the monitoring screen synchronously; the drive unit responds to the work request of the outdoor pan-tilt module or the indoor pan-tilt module, and controls the motors corresponding to the horizontal and vertical directions to rotate accordingly. Specifically, by designing an outdoor pan-tilt module and an indoor pan-tilt module including a camera unit, a drive unit and a dual stepper motor, the coordinated work of each unit can realize accurate identification and real-time tracking of the target object, which is helpful to realize all-round object monitoring, optimize the monitoring function of the door lock, and thus greatly improve the user experience, and meet the multi-functional monitoring requirements of the door lock.

[0042] In this embodiment, the specific content of the camera unit is not limited here, and it can be adaptively adjusted according to actual needs. For example, the camera unit is a camera for face recognition or a cat's eye for monitoring the situation outside the door, which is only used as an example.

[0043] It should be noted that in this embodiment, the monitoring screen can be synchronously displayed through a display unit, such as a display screen, and the specific installation location of the display screen is not limited. For example, the display screen is set on the operation panel of the door lock or integrated on the pan / tilt, which is only used as an example. Figure 4 This is a schematic diagram of another door lock with dual pan / tilts. Figure 4 It can be seen that the door lock includes a dual pan-tilt structure, one pan-tilt outdoors (i.e. installed outside the door) and one pan-tilt indoors (i.e. installed inside the door). It should be noted that the components of the dual pan-tilts are the same, i.e. the internal mechanical structure of the pan-tilts includes support components, dual stepper motors (i.e. Figure 4 The gimbal also includes an integrated circuit board, which integrates the camera unit and the drive unit (i.e. Figure 4 The camera unit includes a face recognition module and a cat's eye module (i.e. Figure 4 In addition, an LCD screen (i.e. Figure 4 The display screen in the image processing unit can display weather forecasts, emoticons or self-set reminder information, etc., and can also display the monitoring screen of the camera unit. Specifically, the pan-tilt head can drive the camera unit to rotate left and right, up and down, and the pan-tilt head speed (i.e., the corresponding frequency) is adjustable.

[0044] In this embodiment, see Figure 3 The system also includes: a mobile terminal 5 for interacting with the door lock, wherein the mobile terminal 5 is deployed with a client 51, and the client 51 is used to configure the monitoring mode of the door lock dual pan-tilt monitoring system, and generate a corresponding function monitoring signal based on the monitoring mode and send it to the main control module 1 of the door lock, so that the main control module 1 controls the sensing and identification module 2, the outdoor pan-tilt module 3 and the indoor pan-tilt module 4 to perform corresponding monitoring functions based on the function monitoring signal.

[0045] In this embodiment, the mobile terminal 5 is a mobile phone, and the corresponding client 51 is an APP installed on the mobile phone. It should be noted that the APP is provided with function buttons corresponding to various preset monitoring functions, monitoring objects, monitoring priorities, risk thresholds, reminder information, risk handling solutions, and home appliances. Personnel who have entered their identities in the door lock can generate corresponding monitoring function configurations by operating different function buttons. In addition, the results of each monitoring function in this embodiment can also be sent to the APP so that personnel (such as administrators) whose identities have been entered into the door lock can understand the monitoring situation in a timely manner.

[0046] In the embodiment of the present invention, the monitoring needs of different users are taken into consideration, and a mobile terminal that interacts with the door lock is designed accordingly. The monitoring mode of the door lock dual pan-tilt monitoring system is customized through the client deployed on the mobile terminal, which can meet the multi-functional monitoring needs of the door lock and provide users with a satisfactory door lock usage experience.

[0047] It should be noted that the mobile phone in this embodiment can communicate and connect via a communication module inside the door lock, such as a Bluetooth module or a WIFI module. Figure 5 This is a schematic diagram of the structure of a smart door lock with dual PTZ monitoring. Figure 5It can be seen that the smart door lock includes a main control module, a fingerprint module, a button module, a speaker module, a Bluetooth module, a WIFI module, a sensor recognition module, an outdoor pan-tilt module and an indoor pan-tilt module; the indoor and outdoor pan-tilt modules both include a camera unit, a drive unit and a dual stepper motor. It should be noted that the functions of other modules of the smart door lock can be understood by referring to the adaptability of conventional functions in this field, such as the fingerprint module is used for fingerprint recognition, and then the door lock is opened and closed according to the recognition result; the speaker module is used for voice broadcasting, such as making a beeping sound for sound warning. Specifically, the monitoring process of the smart door lock includes: when the sensing and recognition module detects the corresponding target object (this module is mainly used to judge the position, distance, gait, posture, etc. of the target object, such as using radar for object sensing and recognition, the radar can emit electromagnetic waves of a specific frequency, when the electromagnetic waves encounter the human body will be reflected back, by analyzing the characteristics of the reflected waves, the radar module can accurately determine whether there is a human body or a pet approaching the smart door lock), wherein the target object includes a person or a pet, and then the main control module automatically wakes up the pan-tilt module (i.e., the indoor pan-tilt module or the outdoor pan-tilt module), according to the position of the target object detected by the radar, the main control module sends a signal to the pan-tilt module, controls the drive unit to make the dual stepping motors on the pan-tilt rotate to the position corresponding to the target object, and starts the full process monitoring and tracking until the target object leaves the monitoring range.

[0048] In this embodiment, users who have entered their identities into the door lock can generate corresponding monitoring function configurations by operating different function buttons, thereby obtaining different monitoring modes. Specifically, when the user presses the function activation button corresponding to the accident monitoring function in the APP, the mobile terminal generates a monitoring mode for accident monitoring in response to the user's configuration operation on the monitoring function, and sends the monitoring mode to the main control module of the door lock; wherein the accident monitoring mode is configured to include at least one target object and the corresponding monitoring priority and accident handling plan. Therefore, in this embodiment, refer to Figure 3When the monitoring mode is accident monitoring, the process of the system performing accident monitoring includes: the sensing recognition module 2 is used to identify within a first preset range in the door, and when at least one target object is identified, the motion trajectory of each target object is obtained in order from high to low according to the monitoring priority, and the motion trajectory and / or motion posture of each target object is sent to the main control module 1; the main control module 1 is used to analyze the motion trajectory and / or motion posture of each target object to determine the target object where the accident occurs, and use the motion trajectory and / or motion posture to obtain the target position where the accident occurs, and generate a first monitoring instruction based on the target position, and send the first monitoring instruction to the indoor pan-tilt module 4; the indoor pan-tilt module 4 is used to rotate according to the first monitoring instruction, when the rotated indoor pan-tilt module 4 is aligned with the target position, the target object is monitored in real time, the target object stays at the target position, and the stay time is sent to the main control module 1; the main control module 1 is used to send the current monitoring screen of the target object to the client 51 when the stay time exceeds the preset time; or control the door lock to perform accident broadcast processing, and control the outdoor pan-tilt module 3 to display rescue information and / or temporary unlocking password.

[0049] In this embodiment, controlling the outdoor PTZ module 3 to display rescue information and / or a temporary unlocking password can remind outdoor personnel to unlock and rescue the target object.

[0050] It should be noted that, in this embodiment, the specific values ​​of the first preset range and the preset duration, as well as the specific content of the accident and rescue information are not limited here, and can be adaptively set according to actual needs.

[0051] In a specific embodiment, accident monitoring is to monitor the falls of elderly people and children. Figure 6 This is a diagram of fall monitoring. Set it in the mobile phone APP and turn on the fall monitoring function for the elderly and children with one click. Specifically, when the radar module detects that an elderly person or child falls indoors, it will start the indoor pan-tilt module, immediately turn the pan-tilt camera to the fall position, and monitor the timing; when the fall time exceeds the first threshold (the threshold can be set) and the elderly or child does not stand up, an alarm message will be sent to the administrator immediately, and relevant pictures or videos will be uploaded, which will facilitate the administrator to check the corresponding situation and confirm whether the elderly or child really fell and cannot get up. For example, the administrator can click to make a video call to check and inquire about the corresponding situation; when the fall time exceeds the second threshold, the outdoor speaker will send an alarm message to ask neighbors or property for help. At the same time, the outdoor pan-tilt display screen can be linked to display the corresponding emergency situation or temporary password and other information to facilitate outdoor personnel to enter for rescue. The above-mentioned execution process of the fall monitoring function for the elderly and children can be referred to. Figure 7 .

[0052] In the embodiments of the present invention, the monitoring needs for special groups such as the elderly and children who are prone to accidents such as falls indoors are taken into consideration, and a corresponding monitoring mode including accident monitoring is designed. Specifically, the motion trajectory of each target object in the room is monitored in real time based on the monitoring priority set in advance through the sensing and recognition module. When the main control module determines the target object where the accident occurs from each motion trajectory, the target position where the accident occurs is obtained and the indoor pan-tilt module is controlled to rotate to align with the target position, thereby realizing real-time monitoring of the target object. By obtaining the length of time the target object stays at the current target position, and by analyzing the relationship between the length of time and the preset length of time for the accident to occur, it is determined whether the target object has an accident, and when an accident occurs, the door lock is controlled to perform corresponding accident handling, thereby providing users with a satisfactory door lock usage experience and ensuring the personal safety of each target object to a great extent.

[0053] In this embodiment, when the user who has entered his identity into the door lock presses the corresponding function start button of the carried item monitoring in the APP, the mobile terminal generates a monitoring mode of the carried item monitoring in response to the user's configuration operation of the monitoring function, and sends the monitoring mode to the main control module of the door lock; wherein the carried item monitoring mode is configured with preset carried items and corresponding item reminder schemes. Figure 3 When the monitoring mode is the monitoring of carried items, the system performs the process of monitoring carried items including: the sensing and identification module 2 is used to obtain the object position of the target object when identifying the target object within the first preset range in the door, and send the object position to the main control module 1; the main control module 1 is used to generate a second monitoring instruction according to the object position, and send the second monitoring instruction to the indoor pan-tilt module 4; the indoor pan-tilt module 4 is used to rotate according to the second monitoring instruction, when the rotated indoor pan-tilt module is aligned with the object position, the items carried by the target object are monitored in real time, the item monitoring information is obtained, and the item monitoring information is sent to the main control module 1; the main control module 1 is used to analyze the item monitoring information to determine whether the target object carries the preset item, if the target object does not carry the preset item, then the door lock is controlled to broadcast the reminder information based on the preset item.

[0054] In this embodiment, when the target object does not carry the preset item, the target object can be reminded to carry the preset item by broadcasting the preset item reminder information.

[0055] It should be noted that the relevant contents of the first preset range in this embodiment refer to the above text, and will not be repeated here or below. In addition, the specific contents of the preset items and the preset item reminder information are not limited here, and can be adaptively set according to actual needs.

[0056] In the embodiments of the present invention, the monitoring needs of the items carried by users in real life are taken into consideration, and a corresponding monitoring mode including monitoring of the items carried is designed. Specifically, the target object in the room within a certain range of the door lock is identified through the sensing and recognition module. When the target object is identified, the object position is obtained and the indoor pan-tilt module is controlled to rotate to align with the object position, and the item monitoring information is obtained through real-time monitoring of the items carried by the target object; the item monitoring information is analyzed with the preset items carried in advance to determine whether the target object has missed any items, and when the items carried are missed, the door lock is controlled to perform corresponding item reminder processing, which greatly meets the needs of intelligent use of door locks and provides users with a satisfactory door lock use experience.

[0057] It should be noted that the aforementioned monitoring of carried items mainly focuses on the scene of people going out. In addition, the actual application also includes the monitoring needs of whether people forget to carry items when entering the room. Figure 3 The process of carrying items monitoring in the door lock dual PTZ monitoring system of this embodiment also includes: a sensing recognition module 2, which is used to obtain a first position of the target object when the target object is recognized within a second preset range outside the door, and send the first position to the main control module 1; the main control module 1 is used to generate a third monitoring instruction based on the first position, and send the third monitoring instruction to the outdoor PTZ module 3; the outdoor PTZ module 3 is used to rotate according to the third monitoring instruction, and when the rotated outdoor PTZ module 3 is aligned with the first position, the target object is monitored in real time to obtain first monitoring information, and the first monitoring information is sent to the main control module 1; the main control module 1 is used to generate a fourth monitoring instruction when the door lock is opened, and send the fourth monitoring instruction to the indoor PTZ module 4; the indoor PTZ module 4 is used to monitor the target object in real time according to the fourth monitoring instruction to obtain second monitoring information, and send the second monitoring information to the main control module 1; the main control module 1 is used to determine whether the corresponding carrying items in the first monitoring information and the second monitoring information are the same, and when the corresponding carrying items in the first monitoring information and the second monitoring information are not the same, control the door lock to broadcast processing based on the preset item reminder information.

[0058] It should be noted that the relevant content of the second preset range in this embodiment is referred to above, and will not be repeated here or below. In addition, the specific method for determining whether the corresponding carried items in the first monitoring information and the second monitoring information are the same is not limited here, and can be adaptively determined according to conventional image processing methods in the field, such as using a hash algorithm to determine whether the monitored image is repeated, or calculating the similarity between the first monitoring information and the second monitoring information, and adaptively determining according to the similarity calculation result, which is only an exemplary description.

[0059] The monitoring mode for carried items in the embodiment of the present invention not only takes into account the monitoring needs of the user's outing scenarios, but also takes into account whether the user has missed carrying items when entering the room from outside the door. The target object outdoors that is within a certain range of the door lock is identified through the sensing and recognition module. When the target object is identified, the first position of the user is obtained and the outdoor pan-tilt module is controlled to rotate to align with the first position. The first monitoring information is obtained through the real-time monitoring of the items carried by the target object by the outdoor pan-tilt module; when the door lock is opened, the indoor pan-tilt module is controlled to track the same target object in real time, and the corresponding second monitoring information is obtained; by analyzing the difference between the first monitoring information and the second monitoring information, it is determined whether there is any missing item, and when the carried item is missed, the door lock is controlled to perform corresponding item reminder processing, which can enrich the monitoring function of carried items, improve the user experience, and help meet the user's demand for intelligent use of door locks.

[0060] In a specific embodiment, the dual pan-tilt linkage is used to achieve comprehensive monitoring of the carried items. Figure 8 This is a schematic diagram of dual PTZ linkage monitoring. By setting the carried items monitoring function in the mobile phone APP, the full monitoring and tracking of relevant personnel returning home from outside or going in and out of the door can be realized. Fig. 9 It is a schematic diagram of the various processes of the dual PTZ linkage monitoring function. Specifically, Fig. 9 The (a) process in the example mainly focuses on monitoring the items carried by people returning home from outside the door. The monitoring process includes: when a person returns home and the radar detects a target object, the outdoor pan-tilt module is started, the pan-tilt moves to the corresponding position, and the information of the items carried by the person is identified and stored in the corresponding outdoor database; as the person moves, the pan-tilt moves synchronously to record the movement trajectory of the person; when the door lock is opened, the inclined tongue of the lock body pops out, thereby triggering the inclined tongue signal, starting the indoor pan-tilt module, and switching from outdoor to indoor monitoring; after the person walks into the room, the movement trajectory of the target object is synchronized, and the information of the items carried by the target object is identified and stored in the corresponding indoor database; the difference between the indoor and outdoor databases is compared. If there is a difference, a voice broadcast is used to remind whether something is left at the door, and all data is stored in the database of the items carried by the corresponding person today; the difference between the indoor and outdoor databases is compared. If it is always stored, the data is directly stored in the database of the items carried by the corresponding person today; when the person cannot find a bag or other items after returning home, he can check the door lock APP information, and the database will display the information of the items brought home, so that it can be queried whether he brought a bag or other items back.

[0061] In this embodiment, when different persons go in and out of the door, a function for monitoring the items carried by the corresponding persons can be set. Fig. 9In the (b) process in the APP, set up a corresponding person, such as person X, with a daily bag detection reminder when going out (i.e., a monitoring reminder of whether person X carries a bag when going out). Specifically, when the indoor PTZ target object has not identified any information about the bag in the outgoing trajectory, when the latch of the lock body pops out after the door is opened, thereby triggering the latch signal, a voice reminder is given to allow the person to confirm whether he or she has not brought a bag with him or her. In addition, the items carried by people going out and in the door of this embodiment also take into account the settings for special weather conditions, such as monitoring reminders for whether to carry rain gear such as umbrellas, raincoats and rain boots on rainy days. See also Fig. 9 In the (c) process in the APP, set the umbrella reminder function for rainy days. Specifically, the smart door lock obtains weather information from the cloud. When it obtains information from the cloud that it will rain today, and the umbrella information has not been recognized in the indoor PTZ target object's exit trajectory, when the inclined tongue of the lock body pops out after the door is opened, thereby triggering the inclined tongue signal, a voice reminder is given to allow the person to confirm whether he or she has not brought an umbrella with him or her. Through the above process, not only the monitoring of carried items in the scenarios of entering or exiting the door is met, but also the monitoring function of carried items of different people and in special weather conditions can be met, which greatly improves the user's door lock usage experience and meets the intelligent use needs of door locks.

[0062] In this embodiment, when the user who has entered his / her identity into the door lock presses the function activation button corresponding to the outgoing monitoring function in the APP, the mobile terminal generates a monitoring mode for outgoing monitoring in response to the user's configuration operation of the monitoring function, and sends the monitoring mode to the main control module of the door lock; wherein, the outgoing monitoring mode is configured with at least one target object (such as different persons or objects, such as the elderly or pets) and the corresponding monitoring priority and outgoing reminder scheme. Therefore, in this embodiment, refer to Figure 3When the monitoring mode is out-of-town monitoring, the system performs out-of-town monitoring including: the main control module 1 is used to record the pop-up time of the lock body oblique tongue when detecting that the lock body oblique tongue pops up; when the pop-up time exceeds the preset time threshold, the door lock is controlled to broadcast based on the preset out-of-town reminder information, and the preset out-of-town reminder information is sent to the administrator of the door lock; at the same time, a fifth monitoring instruction is generated and sent to the indoor pan-tilt module 4; the indoor pan-tilt module 4 is used to receive the fifth monitoring instruction, and based on the fifth monitoring instruction, the current indoor environment is monitored in real time, and the indoor monitoring screen is recorded and sent to the main control module 1; the main control module 1 is used to determine that there is no target object in the current indoor environment according to the indoor monitoring screen, and generate a sixth monitoring instruction and send it to the outdoor pan-tilt module 3; the outdoor pan-tilt module 3 is used to monitor the current outdoor environment in real time according to the sixth monitoring instruction, and record the outdoor monitoring screen and send it to the main control module 1; the main control module 1 is used to control the sensing recognition module 2, the outdoor pan-tilt module 3 and the indoor pan-tilt module 4 to perform corresponding monitoring functions according to the outdoor monitoring screen.

[0063] It should be noted that in this embodiment, when the pop-up time of the lock body oblique tongue exceeds the preset time threshold, the door lock is controlled to broadcast based on the preset out-of-town reminder information, and the preset out-of-town reminder information is sent to the administrator of the door lock, so as to promptly inform the administrator that the target object is out.

[0064] In this embodiment, when there is no target object in the outdoor monitoring screen, the main control module 1 controls the sensing and identification module 2 to work to identify the target object; if the sensing and identification module 2 senses the target object, the main control module 1 controls the corresponding outdoor pan-tilt module 3 or indoor pan-tilt module 4 to work according to the current position of the target object to achieve monitoring of the target object; if the sensing and identification module 2 does not sense the target object, the main control module 1 controls the outdoor pan-tilt module 3 and the indoor pan-tilt module 4 to work simultaneously for a certain period of time and then stop, which is used for real-time tracking of the target object.

[0065] It should be noted that the specific content of the preset out-of-office reminder information in this embodiment is not limited here and can be adaptively set according to actual needs.

[0066] In a specific embodiment, a pet outing monitoring system is provided to prevent the pet from escaping from the house. Fig.10 is a pet monitoring diagram. Fig.11The execution process of the pet monitoring function includes: making corresponding settings in the mobile phone APP to enable the pet monitoring function. Specifically, when the door is always in a closed state (i.e. the lock body latch does not pop out), the indoor PTZ system monitors the pet information; when the door is opened or in an open state (i.e. the time for the lock body latch to pop out exceeds the set time threshold), an alarm message is issued immediately and the message is pushed to the administrator; when the door is opened or in an open state, and the pet disappears from the indoor PTZ system monitoring, the outdoor PTZ monitoring system is immediately started; if the outdoor PTZ monitoring system detects pet information, the door lock is controlled to issue an alarm message "Your pet has gone out" and other voice reminders, and an alarm message is sent to the administrator.

[0067] It should be noted that in this embodiment, the monitoring priority of the indoor target can be set according to the needs, for example: the monitoring priority of the elderly>children>other people>pets. If the above four types of targets exist at the same time, the high priority is the main monitoring object, that is, the movement trajectory of the elderly is the center position, until the elderly leave the monitoring range, and then the main monitoring right is transferred to the child, and the movement trajectory of the child is the center position for monitoring, and so on. Fig.12 It is a schematic diagram of the function execution flow corresponding to the configuration monitoring priority. It should be noted that the other persons in this embodiment belong to the persons who need special attention set by the door lock administrator, such as the disabled, which is only used as an exemplary explanation and is not limited thereto.

[0068] In the embodiment of the present invention, the monitoring demand for target objects such as children and pets who come out of the room and whose going out cannot be known is taken into consideration, and a corresponding monitoring mode including going out monitoring is designed. Specifically, the main control module detects the pop-up of the lock body inclined tongue, and records the pop-up time of the lock body inclined tongue. When the pop-up time exceeds the preset time threshold, the door lock is controlled to perform corresponding going out reminder processing, and a fifth monitoring instruction is generated and sent to the indoor pan-tilt module; the indoor pan-tilt module monitors the current indoor environment in real time based on the fifth monitoring instruction, and records the indoor monitoring screen and sends it to the main control module; when the main control module determines that there is no target object in the current indoor environment according to the indoor monitoring screen, a sixth monitoring instruction is generated and sent to the outdoor pan-tilt module; the outdoor pan-tilt module monitors the current outdoor environment in real time according to the sixth monitoring instruction, and records the outdoor monitoring screen and sends it to the main control module, so that the main control module controls the sensing and recognition module, the outdoor pan-tilt module and the indoor pan-tilt module to perform corresponding monitoring functions according to the outdoor monitoring screen, which can provide users with a satisfactory door lock usage experience and help ensure the safety of the target object outdoors.

[0069] In this embodiment, when the user who has entered his identity into the door lock presses the function activation button corresponding to the whole-house monitoring function in the APP, the mobile terminal generates a monitoring mode for whole-house monitoring in response to the user's configuration operation of the monitoring function, and sends the monitoring mode to the main control module of the door lock; wherein, at least one indoor monitoring device (its specific type is not limited here, such as a home camera) is configured in the whole-house monitoring mode. Therefore, in this embodiment, refer to Figure 3 When the preset monitoring function is the whole-house monitoring function, the system executes the whole-house monitoring function, and the process includes: the main control module 1 is used to generate a seventh monitoring instruction when receiving at least one indoor monitoring signal, and send the seventh monitoring instruction to the indoor pan-tilt module 4; wherein the indoor monitoring signal is generated in response to the configuration operation of the target object on the indoor monitoring device; the indoor pan-tilt module 4 is used to rotate along the preset direction according to the seventh monitoring instruction, determine the first monitoring range and send it to the main control module 1; the main control module 1 is used to determine the detection range of each indoor monitoring device based on each indoor monitoring signal, and determine the second monitoring range based on the detection range of all indoor monitoring devices; determine the repeated monitoring area based on the first monitoring range and the second monitoring range, and filter the repeated monitoring area in the first monitoring range to obtain the target monitoring range of the indoor pan-tilt module 4; when any monitored object enters the room, the target current area is determined according to the current identification position of the monitored object, and the indoor monitoring device or the indoor pan-tilt module 4 in the corresponding monitoring range is controlled based on the target current area to monitor the monitored object.

[0070] It should be noted that the specific contents of the preset directions in this embodiment are not limited here and can be adaptively set according to actual needs. For example, the preset direction is a clockwise direction from top to bottom and from left to right, which is only used as an exemplary description.

[0071] In a specific embodiment, a whole-house monitoring function is provided to be linked with an indoor smart home camera to realize whole-house monitoring without blind spots. Fig.13This is a schematic diagram of whole-house monitoring. Specifically, turn on the whole-house monitoring function in the mobile phone APP, scan a circle through the outdoor PTZ system (such as scanning in a clockwise direction), record the monitoring range as A, scan a circle through the indoor PTZ system, record the monitoring range as B, search for smart home cameras, and record the monitoring range as C. Analyze the above monitoring ranges to determine the whole-house monitoring range as: A+B+CD (the specific analysis process is: the outdoor PTZ monitoring area, that is, the monitoring range is A; the indoor PTZ monitoring area, that is, the monitoring range is B; the smart home camera setting, that is, the monitoring range is C; the indoor PTZ monitoring area and the smart home camera overlapping area setting The priority monitoring right of area D is taken by the smart home camera; that is, the indoor and outdoor monitoring areas of the whole house are: A+C+[BD]), and the whole house is divided into three areas: A; C and [BD]; when the monitored object enters the monitoring area A and is monitored by the radar, the outdoor PTZ camera is turned on to track its outdoor trajectory in real time; when the monitored object enters the room, it is determined whether it is in area C or [BD]; if it is in area C, the smart home camera is turned on; if it is in area [BD], the indoor PTZ camera is turned on to track and monitor the indoor trajectory of the monitored object in real time. Fig.14 This is a flowchart of the whole house monitoring function. Through the above whole house monitoring function, not only can 180° outdoor monitoring without blind spots be achieved, but also indoor linkage with smart home can be used to achieve monitoring without blind spots in the whole house, that is, when the smart home camera cannot reach a location, the indoor pan-tilt rotation of the camera equipped with the smart door lock can be used to supplement the monitoring area.

[0072] In the embodiment of the present invention, the demand for whole-house monitoring that is linked to indoor smart home devices is taken into consideration, and a corresponding monitoring mode including whole-house monitoring is designed. Specifically, a corresponding indoor monitoring signal is generated through the configuration operation of at least one indoor monitoring device by the target object. The system controls the rotation of the indoor pan-tilt module in response to any indoor monitoring signal, determines the first monitoring range of the indoor pan-tilt, determines the second monitoring range of all indoor monitoring devices according to all indoor monitoring signals, determines the repeated monitoring area based on the first monitoring range and the second monitoring range, and filters the repeated monitoring area in the first monitoring range to obtain the corresponding target monitoring range of the indoor pan-tilt module. When the monitored object is at any position indoors, the indoor monitoring device or the indoor pan-tilt module in the corresponding monitoring range can be quickly controlled to monitor the monitored object. This not only realizes whole-house monitoring without blind spots and provides users with a satisfactory door lock usage experience, but also helps to save resources, thereby extending the service life of the indoor pan-tilt module.

[0073] In this embodiment, when the user who has entered his / her identity into the door lock presses the function start button corresponding to the rental house monitoring function in the APP, the mobile terminal generates a monitoring mode for the rental house monitoring in response to the user's configuration operation of the monitoring function, and sends the monitoring mode to the main control module of the door lock; wherein, the rental house monitoring mode is configured with tenant information, at least one indoor home appliance information (its specific type is not limited here, such as TV, refrigerator, etc.), door lock installation status and corresponding early warning processing plan. Therefore, in this embodiment, refer to Figure 3 When the monitoring mode is rental house monitoring, the system executes the rental house monitoring process including: the main control module 1 is used to control the indoor pan-tilt module 4 to perform real-time monitoring of all indoor home appliances in the rental house, and control the outdoor pan-tilt module 3 to perform real-time monitoring of the door lock of the rental house; when the indoor pan-tilt module 4 monitors that any indoor home appliance has moved and / or the outdoor pan-tilt module 3 monitors the same indoor home appliance; or when the outdoor pan-tilt module 3 monitors that the door lock has been disassembled, the main control module 1 controls the door lock to perform broadcast processing based on the preset warning information, and sends the preset warning information to the administrator of the door lock.

[0074] In this embodiment, the main control module 1 controls the door lock to perform broadcast processing based on the preset warning information and sends the preset warning information to the administrator of the door lock, so that the administrator can be informed of the current housing situation of the rental house in a timely manner.

[0075] It should be noted that the specific content of the preset warning information in this embodiment is not limited here and can be adaptively set according to actual needs.

[0076] In a specific embodiment, a rental housing monitoring and management function is provided. Fig.15It is a diagram of monitoring a rental house. Specifically, the landlord (i.e., the administrator of the door lock) can set the rental management mode with one click in the mobile phone APP; the rental management mode includes: 1) tenant information registration; 2) home management; 3) door lock health management, etc.; after logging in the tenant information, the indoor PTZ can scan around before renting the house, lock the fixed position, quantity, and other information of indoor home furnishings such as refrigerators, TVs, dining tables, sofas, etc., and record the door lock health information (i.e., the door lock installation status, if it is installed properly); when the indoor home position moves and the movement exceeds the set threshold, a prompt alarm is sent (i.e., a voice broadcast alarm is sent and a message is sent to the landlord); when the monitored home is detected by the outdoor camera, that is, it is removed from the outdoors, the door lock sends an alarm message (such as sending a prompt message to the tenant, prohibiting the home from being moved out of the house) and sends a message to the landlord. In addition, for the landlord, the above-mentioned rental house monitoring and management function can facilitate its management of the entry and exit of the rental house, and can avoid problems such as tenants changing the lock cylinder or subletting without permission. At the same time, you can also check the condition of the house when the tenant checks out. For example, when the tenant checks out, you can check whether the home is intact with one click, that is, compare the photos before and after the rental, such as quantity comparison and location comparison, to get a comparison result, which is convenient for the tenant to check the condition of the house when checking out and reduce disputes. Fig.16 It is a flowchart of the execution of the rental housing monitoring function.

[0077] In the embodiment of the present invention, the monitoring needs of the landlord's indoor fixed assets in the rental scenario in real life are taken into consideration, and a corresponding monitoring mode including rental house monitoring is designed. Specifically, all indoor household appliances of the rental house are monitored in real time through the indoor pan-tilt module and the door lock of the rental house is monitored in real time through the outdoor pan-tilt module. When the indoor pan-tilt module monitors the movement of any indoor household appliance and / or the outdoor pan-tilt module monitors the same indoor household appliance or the outdoor pan-tilt module monitors the removal of the door lock, corresponding early warning processing is performed, which can meet the needs of intelligent use of door locks, provide landlords with a satisfactory door lock use experience, greatly improve the convenience and safety of rental house management, and protect the property safety of landlords.

[0078] It should be noted that the above-mentioned monitoring mode of the door lock dual pan-tilt monitoring system of this embodiment is not limited here and can be adaptively expanded according to actual monitoring needs, such as home security, visitor management or personalized configuration (for example, users can customize the working hours of the pan-tilt camera according to their own needs, such as stopping monitoring during the time period when adults are at home to avoid unnecessary monitoring and privacy issues) and other monitoring functions.

[0079] In summary, the door lock dual pan-tilt monitoring system of the embodiment of the present invention realizes all-round monitoring through the combination of dual pan-tilts, can be flexibly applied in a variety of scenarios, provides users with a satisfactory door lock usage experience, greatly improves user satisfaction, and meets the needs of intelligent use of door locks.

[0080] In this embodiment, a smart door lock is also provided. Fig.17 is a structural block diagram of a door lock according to an embodiment of the present invention, such as Fig.17 As shown, the smart door lock includes a door lock body 1701 and a door lock dual-pan-tilt monitoring system 1702 as in any of the above embodiments, wherein the contents of the door lock dual-pan-tilt monitoring system 1702 are referred to in the previous text and will not be repeated here. Specifically, the smart door lock of the embodiment of the present invention can realize multifunctional, all-round and efficient target monitoring by carrying a door lock dual-pan-tilt monitoring system on the door lock body, providing users with a satisfactory door lock use experience and greatly meeting the intelligent use requirements of the door lock.

[0081] Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the present invention, and such modifications and variations are all within the scope defined by the appended claims.

Claims

1. A door lock dual PTZ monitoring system, characterized in that: The system comprises: A main control module and a sensing and identification module, an outdoor pan-tilt module and an indoor pan-tilt module respectively connected thereto, wherein the main control module and the sensing and identification module are both arranged inside the door lock, the outdoor pan-tilt module is arranged outside the door lock, and the indoor pan-tilt module is arranged inside the door lock; The sensing and identifying module is used to obtain the position information of the target object when identifying the target object in the preset sensing area, and send the position information to the main control module; The main control module is used to determine the current environment of the target object based on the location information, generate corresponding control instructions based on the current environment and the location information, and send the control instructions to the outdoor pan-tilt module or the indoor pan-tilt module; The outdoor pan-tilt module or the indoor pan-tilt module is used to receive the control instruction and perform rotation operations in the horizontal and vertical directions based on the control instruction to monitor the target object in real time.

2. The door lock dual PTZ monitoring system according to claim 1, characterized in that: When the current environment is an outdoor environment, the monitoring process of the target object by the system includes: A main control module, used for generating a first control instruction according to the outdoor environment and location information, and sending the first control instruction to the outdoor PTZ module; The outdoor PTZ module is used to rotate according to the first control instruction. When the rotated outdoor PTZ module is aligned with the position information, identity authentication and / or target tracking are performed on the target object, and corresponding authentication results and / or tracking results are obtained and sent to the main control module; The main control module is used to generate a second control instruction when determining that the door lock is opened according to the authentication result and / or the tracking result, and send the second control instruction to the indoor PTZ module; The indoor pan / tilt module is used to receive the second control instruction and perform rotation operations in the horizontal and vertical directions based on the second control instruction to monitor the target object in real time.

3. The door lock dual PTZ monitoring system according to claim 1, characterized in that: When the current environment is an indoor environment, the monitoring process of the target object by the system includes: A main control module, used for generating a third control instruction according to the indoor environment and position information, and sending the third control instruction to the indoor PTZ module; The indoor pan / tilt module is used to rotate according to the third control instruction. When the rotated indoor pan / tilt module is aligned with the position information, the target object is tracked in real time, and the indoor tracking result is obtained and sent to the main control module; The main control module is used to generate a fourth control instruction when it is determined according to the indoor tracking result that there is no target object in the indoor environment, and send the fourth control instruction to the outdoor pan / tilt module; The outdoor PTZ module is used to receive the fourth control instruction and perform rotation operations in the horizontal and vertical directions based on the fourth control instruction to monitor the target object in real time.

4. The door lock dual PTZ monitoring system according to claim 1, characterized in that: The outdoor pan-tilt module and the indoor pan-tilt module both include: a camera unit, a drive unit and dual stepper motors; wherein the camera unit is used to authenticate and monitor the target object in real time, and synchronously display the monitoring screen; the drive unit responds to the working request of the outdoor pan-tilt module or the indoor pan-tilt module, and controls the corresponding motors in the horizontal and vertical directions to rotate accordingly.

5. The door lock dual PTZ monitoring system according to claim 1, characterized in that: The system also includes: a mobile terminal that interacts with the door lock, wherein the mobile terminal is deployed with a client, and the client is used to configure the monitoring mode of the door lock dual pan-tilt monitoring system, and generate a corresponding function monitoring signal based on the monitoring mode and send it to the main control module of the door lock, so that the main control module controls the sensing and identification module, the outdoor pan-tilt module and the indoor pan-tilt module to perform corresponding monitoring functions based on the function monitoring signal.

6. The door lock dual PTZ monitoring system according to claim 5, characterized in that: When the monitoring mode is accident monitoring, the process of the system performing the accident monitoring includes: The sensing and recognition module is used to perform recognition within a first preset range inside the door, and when at least one target object is recognized, obtain the motion trajectory of each target object in order from high to low according to the monitoring priority, and send the motion trajectory and / or motion posture of each target object to the main control module; The main control module is used to analyze the motion trajectory and / or motion posture of each target object to determine the target object where the accident occurred, obtain the target position of the target object where the accident occurred by using the motion trajectory and / or motion posture, and generate a first monitoring instruction based on the target position, and send the first monitoring instruction to the indoor pan / tilt module; The indoor pan-tilt module is used to rotate according to the first monitoring instruction. When the rotated indoor pan-tilt module is aligned with the target position, the target object is monitored in real time, the length of time the target object stays at the target position is obtained, and the length of time the target object stays at the target position is sent to the main control module; The main control module is used to send the current monitoring screen of the target object to the client when the stay time exceeds the preset time; or control the door lock to perform accident broadcast processing, and control the outdoor pan / tilt module to display rescue information and / or a temporary unlocking password.

7. The door lock dual PTZ monitoring system according to claim 5, characterized in that: When the monitoring mode is carried-item monitoring, the process of the system performing the carried-item monitoring includes: The sensing and identifying module is used to obtain the object position of the target object when identifying the target object within the first preset range inside the door, and send the object position to the main control module; The main control module is used to generate a second monitoring instruction according to the position of the object, and send the second monitoring instruction to the indoor PTZ module; The indoor pan-tilt module is used to rotate according to the second monitoring instruction. When the rotated indoor pan-tilt module is aligned with the object position, the object carried by the target object is monitored in real time to obtain object monitoring information, and the object monitoring information is sent to the main control module; The main control module is used to analyze the item monitoring information to determine whether the target object carries a preset item. If the target object does not carry the preset item, the main control module controls the door lock to perform a broadcast based on the preset item reminder information.

8. The door lock dual PTZ monitoring system according to claim 7, characterized in that: The process of the system performing the carried item monitoring further includes: The sensing and identifying module is used to obtain a first position of the target object when identifying the target object within a second preset range outside the door, and send the first position to the main control module; The main control module is used to generate a third monitoring instruction based on the first position, and send the third monitoring instruction to the outdoor PTZ module; The outdoor PTZ module is configured to rotate according to the third monitoring instruction, and when the rotated outdoor PTZ module is aligned with the first position, the target object is monitored in real time to obtain first monitoring information, and the first monitoring information is sent to the main control module; The main control module is used to generate a fourth monitoring instruction when the door lock is opened, and send the fourth monitoring instruction to the indoor PTZ module; The indoor PTZ module is used to monitor the target object in real time according to the fourth monitoring instruction to obtain second monitoring information, and send the second monitoring information to the main control module; The main control module is used to determine whether the corresponding carried items in the first monitoring information and the second monitoring information are the same, and when the corresponding carried items in the first monitoring information and the second monitoring information are not the same, control the door lock to perform broadcast processing based on preset item reminder information.

9. The door lock dual PTZ monitoring system according to claim 5, characterized in that: When the monitoring mode is out-of-town monitoring, the process of the system performing the out-of-town monitoring includes: The main control module is used to record the pop-up time of the lock body inclined tongue when detecting that the lock body inclined tongue pops up; when the pop-up time exceeds the preset time threshold, control the door lock to perform broadcast processing based on the preset outgoing reminder information, and send the preset outgoing reminder information to the administrator of the door lock; and at the same time generate a fifth monitoring instruction and send it to the indoor pan / tilt module; The indoor PTZ module is used to receive the fifth monitoring instruction, and based on the fifth monitoring instruction, monitor the current indoor environment in real time, and record the indoor monitoring screen and send it to the main control module; The main control module is used to generate a sixth monitoring instruction and send it to the outdoor PTZ module when it is determined that there is no target object in the current indoor environment according to the indoor monitoring picture; The outdoor PTZ module is used to monitor the current outdoor environment in real time according to the sixth monitoring instruction, and record the outdoor monitoring screen and send it to the main control module; The main control module is used to control the sensing and recognition module, the outdoor pan-tilt module and the indoor pan-tilt module to perform corresponding monitoring functions according to the outdoor monitoring screen.

10. The door lock dual PTZ monitoring system according to claim 5, characterized in that: When the monitoring mode is whole-house monitoring, the process of the system performing the whole-house monitoring includes: The main control module is used to generate a seventh monitoring instruction when receiving at least one indoor monitoring signal, and send the seventh monitoring instruction to the indoor PTZ module; wherein the indoor monitoring signal is generated in response to the configuration operation of the target object on the indoor monitoring device; The indoor PTZ module is used to rotate along a preset direction according to the seventh monitoring instruction, determine a first monitoring range and send it to the main control module; The main control module is used to determine the detection range of each indoor monitoring device based on the indoor monitoring signals, and determine the second monitoring range based on the detection range of all indoor monitoring devices; determine the repeated monitoring area based on the first monitoring range and the second monitoring range, and filter the repeated monitoring area in the first monitoring range to obtain the target monitoring range of the indoor pan-tilt module; when any monitored object enters the room, determine the target current area according to the current identification position of the monitored object, and control the indoor monitoring equipment or the indoor pan-tilt module in the corresponding monitoring range to monitor the monitored object based on the target current area.

11. The door lock dual PTZ monitoring system according to claim 5, characterized in that: When the monitoring mode is rental housing monitoring, the process of the system performing the rental housing monitoring includes: The main control module is used to control the indoor PTZ module to monitor all indoor home appliances in the rental house in real time, and to control the outdoor PTZ module to monitor the door locks of the rental house in real time; When the indoor pan-tilt module monitors that any indoor household device has moved and / or the outdoor pan-tilt module monitors the same indoor household device; or when the outdoor pan-tilt module monitors that the door lock has been disassembled, the main control module controls the door lock to perform broadcast processing based on the preset warning information, and sends the preset warning information to the administrator of the door lock.

12. A smart door lock, characterized in that: The smart door lock includes a door lock body and a door lock dual pan-tilt monitoring system as described in any one of claims 1 to 11.

Images