Video Recording Method and System Based on Smart Door Lock

Abstract

One or more embodiments of the present application provide a video recording method and system based on an intelligent door lock. The method is applied to the intelligent door lock and includes: the intelligent door lock sends the correspondence between the face information and the first video it captures, starting from the detection of the face information by the intelligent door lock until the intelligent door lock is unlocked, to the video recording device for storage; the neighbor intelligent door lock corresponding to the intelligent door lock sends the correspondence between the face information and the second video it captures, starting from receiving the first message sent by the intelligent door lock until receiving the second message sent by the intelligent door lock, to the video recording device for storage; the camera device deployed in the room corresponding to the intelligent door lock sends the correspondence between the face information and the third video it captures, starting from the detection of the face information by the camera device until the face information is no longer detected by the camera device, to the video recording device for storage. The present application can achieve full-process video recording during the visit of a visitor.

Description

Technical Field

[0001] One or more embodiments of the present application relate to the technical field of smart home, and in particular to a video recording method and system based on a smart lock. Background Art

[0002] The Internet of Things refers to a network that connects various information sensing devices (such as radio frequency identification, infrared sensors, laser scanners, global positioning systems, etc.) to objects (such as home appliances, household appliances, cars, buildings, etc.) through the Internet for communication and information exchange to achieve intelligent identification, positioning, tracking, monitoring, and management. It expands the concept of the Internet, no longer limited to information exchange between people, but also enabling information interaction between things and between things and people. Internet of Things devices refer to those physical objects that can be connected through the Internet and exchange data with other devices or systems. These devices are usually embedded with sensors, software, and other technologies to achieve data collection, data interaction with the Internet or other devices, and automation functions. Common types of Internet of Things devices include smart home devices (such as smart locks, smart cameras, etc.), smart home appliances (such as smart refrigerators, smart air conditioners, etc.), wearable devices (such as smart watches, fitness trackers, etc.), vehicle networking devices (such as in-vehicle units, smart traffic lights, etc.), healthcare Internet of Things devices (such as remote patient monitoring devices, drug management devices, etc.), etc.

[0003] The Internet of Things has become a bridge connecting the physical world and the digital world, greatly promoting the intelligent process of all walks of life. With the rapid development of Internet of Things technology and the in-depth promotion of smart city construction, the application of smart home devices in communities is becoming increasingly popular. Currently, many families have deployed smart locks equipped with cameras and displays at their entrance doors. These smart locks usually have functions such as face recognition, automatic and remote unlocking, and visitor visual intercom, providing users with convenient access management and security protection.

[0004] In practical applications, when someone visits, it is usually desired to record the visit process of the visitor so that the subsequent householders can review the visit process of the visitor through the corresponding video. Therefore, how to achieve convenient and reliable video recording of the visitor's visit process based on a smart lock has become a highly concerned issue. Summary of the Invention

[0005] One or more embodiments of the present application provide the following technical solutions:

[0006] The present application provides a video recording method based on a smart lock, which is applied to a smart lock; the method includes:

[0007] Call the equipped camera to perform video shooting, and perform face detection on the captured video frames;

[0008] When face information is detected from the video frame, a first message containing the face information is sent to a neighboring smart door lock corresponding to the smart door lock, so that the neighboring smart door lock calls the equipped camera to take a video in response to the received first message;

[0009] When it is detected that the smart door lock has been unlocked, a first video taken by the smart door lock is obtained, and the correspondence between the face information and the first video is sent to a video recording device deployed in the room corresponding to the smart door lock for storage; and, a second message is sent to the neighboring smart door lock, so that the neighboring smart door lock obtains a second video taken by the neighboring smart door lock in response to the received first message, and the correspondence between the face information and the second video is sent to the video recording device for storage; and, a third message containing the face information is sent to a camera device deployed in the room, so that the camera device performs face detection on the captured video frame in response to the received third message, obtains a third video taken by the camera device based on the face detection result, and sends the correspondence between the face information and the third video to the video recording device for storage;

[0010] Wherein, the start time of shooting the first video is the time when the smart door lock detects the face information from the video frame, and the end time of shooting the first video is the time when the smart door lock detects that the smart door lock has been unlocked; the start time of shooting the second video is the time when the neighboring smart door lock receives the first message, and the end time of shooting the second video is the time when the neighboring smart door lock receives the second message; the start time of shooting the third video is the time when the camera device detects the face information from the video frame, and the end time of shooting the third video is the time when the camera device does not detect the face information from the video frame.

[0011] The present application further provides a video recording system based on a smart door lock, the system includes a smart door lock, a neighboring smart door lock corresponding to the smart door lock, a camera device and a video recording device deployed in the room corresponding to the smart door lock; wherein:

[0012] The smart door lock calls the equipped camera to take a video and performs face detection on the captured video frame;

[0013] When the smart door lock detects the face information from the video frame, a first message containing the face information is sent to a neighboring smart door lock corresponding to the smart door lock;

[0014] The neighbor intelligent door lock responds to the received first message and calls the equipped camera to take a video;

[0015] When the intelligent door lock detects that the intelligent door lock has been unlocked, it acquires the first video captured by the intelligent door lock, and sends the correspondence between the face information and the first video to the video recording device deployed in the room corresponding to the intelligent door lock for storage; and, sends a second message to the neighbor intelligent door lock; and, sends a third message containing the face information to the camera device deployed in the room;

[0016] The neighbor intelligent door lock responds to the received first message, acquires the second video captured by the neighbor intelligent door lock, and sends the correspondence between the face information and the second video to the video recording device for storage;

[0017] The camera device responds to the received third message, performs face detection on the captured video frames, based on the face detection result, acquires the third video captured by the camera device, and sends the correspondence between the face information and the third video to the video recording device for storage;

[0018] Wherein, the starting moment of shooting the first video is the moment when the intelligent door lock detects the face information from the video frames, and the ending moment of shooting the first video is the moment when the intelligent door lock detects that the intelligent door lock has been unlocked; the starting moment of shooting the second video is the moment when the neighbor intelligent door lock receives the first message, and the ending moment of shooting the second video is the moment when the neighbor intelligent door lock receives the second message; the starting moment of shooting the third video is the moment when the camera device detects the face information from the video frames, and the ending moment of shooting the third video is the moment when the camera device does not detect the face information from the video frames.

[0019] In the above technical solution, the intelligent door lock can call the equipped camera to take a video, and perform face detection on the captured video frames. Based on the face detection result, the first video captured by the intelligent door lock is obtained. The starting time of shooting the first video is the moment when the intelligent door lock detects the face information from the video frames captured by itself, and the ending time of shooting the first video is the moment when the intelligent door lock detects that it has been unlocked. Furthermore, the corresponding relationship between the face information and the first video can be sent to the video recording device deployed in the room corresponding to the intelligent door lock for storage. When the intelligent door lock detects that it has been unlocked, it can also send a third message to the camera device deployed in the room, so that in response to the received third message, the camera device performs face detection on the captured video frames, and based on the face detection result, obtains the third video captured by the camera device. The starting time of shooting the third video is the moment when the camera device receives the third message, and the ending time of shooting the third video is the moment when the camera device does not detect the face information from the video frames captured by itself. Furthermore, the corresponding relationship between the face information and the third video can be sent to the video recording device for storage.

[0020] By adopting the above method, through the linkage between the intelligent door lock, the camera device and the video recording device deployed in the room corresponding to the intelligent door lock, the whole process of the visitor's visit can be recorded. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The following will describe the drawings required for the description of the exemplary embodiments, where:

[0022] Figure 1 is a schematic diagram of an intelligent door lock management system shown in an exemplary embodiment of the present application.

[0023] Figure 2 is a flowchart of a video recording method based on an intelligent door lock shown in an exemplary embodiment of the present application.

[0024] Figure 3 is a schematic diagram of another intelligent door lock management system shown in an exemplary embodiment of the present application.

[0025] Figure 4 is a flowchart of another video recording method based on an intelligent door lock shown in an exemplary embodiment of the present application.

[0026] Figure 5 is a schematic diagram of the structure of a device shown in an exemplary embodiment of the present application.

[0027] Figure 6 is a block diagram of a video recording device based on an intelligent door lock shown in an exemplary embodiment of the present application. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0028] Exemplary embodiments will be described in detail herein, and examples thereof are shown in the accompanying drawings. When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with one or more embodiments of the present application. On the contrary, they are merely examples consistent with some aspects of one or more embodiments of the present application.

[0029] It should be noted that in other embodiments, the steps of the corresponding method are not necessarily executed in the order shown and described in the present application. In some other embodiments, the steps included in the method may be more or fewer than those described in the present application. In addition, a single step described in the present application may be decomposed into multiple steps for description in other embodiments; and multiple steps described in the present application may also be combined into a single step for description in other embodiments.

[0030] For an intelligent door lock, it usually has functions such as face recognition, automatic and remote unlocking, and video intercom for visitors, providing users with convenient access management and security protection.

[0031] In practical applications, when someone visits, it is usually desired to record the visit process of the visitor so that the subsequent householders can review the entire visit process through the corresponding recording. Therefore, how to achieve convenient and reliable video recording of the visit process based on an intelligent door lock has become a highly concerned issue.

[0032] The present application provides a technical solution for video recording based on an intelligent door lock. In this technical solution, the intelligent door lock can call the equipped camera to take a video, and perform face detection on the captured video frames. Based on the face detection results, a first video captured by the intelligent door lock is obtained. The start time of shooting the first video is the moment when the intelligent door lock detects face information from the video frames captured by itself, and the end time of shooting the first video is the moment when the intelligent door lock detects that it has been unlocked. Furthermore, the correspondence between the face information and the first video can be sent to a video recording device deployed in the room corresponding to the intelligent door lock for storage. When the intelligent door lock detects that it has been unlocked, it can also send a third message to the camera device deployed in the room, so that in response to the received third message, the camera device performs face detection on the captured video frames, and based on the face detection results, a third video captured by the camera device is obtained. The start time of shooting the third video is the moment when the camera device receives the third message, and the end time of shooting the third video is the moment when the camera device does not detect the face information from the video frames captured by itself. Furthermore, the correspondence between the face information and the third video can be sent to the video recording device for storage.

[0033] By adopting the above method, the whole process recording of the visitor's visit can be realized through the linkage between the intelligent door lock, the camera device and the video recording device deployed in the room corresponding to the intelligent door lock.

[0034] Reference Figure 1 , Figure 1 is a schematic diagram of an intelligent door lock management system shown in an exemplary embodiment of the present application.

[0035] As Figure 1 shown, in the above intelligent door lock management system, it may include multiple intelligent door locks and a door lock management platform for uniformly managing these intelligent door locks. Each intelligent door lock in a specific area (for example: a community, a building or a unit within a building) can access the Internet through Wi-Fi, cellular network or other wireless network communication technologies. At the same time, the door lock management platform in this area can also access the Internet through wired network communication technology or wireless network communication technology, so that these intelligent door locks and the door lock management platform can be connected through the Internet for communication and information exchange.

[0036] Specifically, each intelligent door lock can register the device on the above door lock management platform to upload its own device information (for example: device communication address, device geographical location, device operating status, etc.) to the door lock management platform for maintenance. Moreover, each intelligent door lock can also periodically synchronize the current device information of the intelligent door lock to the door lock management platform to update the device information of the intelligent door lock maintained by the door lock management platform.

[0037] Taking one of the intelligent door locks as an example, when the intelligent door lock is first started after deployment, it can send a registration message to the above-mentioned door lock management platform. The registration message can include the device unique identifier of the intelligent door lock (e.g., device unique number), communication address (e.g., IP address, port number, MAC address, etc.), geographical location, associated household information, etc. Among them, the geographical location can specifically be data obtained by encoding information such as building number, floor number, and room number in a standard geographical coding format; the associated household information can include the identity information of one or more users using the intelligent door lock (e.g., personal password, face information, fingerprint information, etc., where the face information or fingerprint information can be feature vectors extracted from face images or fingerprint images). After receiving the registration message, the door lock management platform can store the corresponding relationships among various information such as the device unique identifier, communication address, geographical location, and associated household information in the registration message. In addition, the intelligent door lock can periodically send an information update message to the door lock management platform. The information update message can include the updated communication address, updated associated household information, etc. After receiving the information update message, the door lock management platform can update the corresponding stored information according to the updated information in the information update message.

[0038] The device information of each intelligent door lock maintained by the above-mentioned door lock management platform can be as shown in Table 1 below:

[0039] Table 1

[0040]

[0041] In the Figure 1 intelligent door lock management system shown, there can also be multiple camera devices and multiple video recording devices. Among them, the camera devices are used to shoot videos, and the video recording devices are used to store videos and can play the stored videos. The camera devices in this application can be camera devices deployed in the room corresponding to the intelligent door lock to shoot the stage of the visitor in the room. And for the convenience of the original household in the room to view the visiting videos of the visitors, the video recording devices can also be deployed in the room corresponding to the intelligent door lock. The camera devices and video recording devices in a specific area can also be connected to the Internet through wired network communication technology or wireless network communication technology, so as to be connected to the above-mentioned door lock management platform through the Internet for communication and information exchange.

[0042] Similar to the above-mentioned intelligent door lock, each camera device and each video recording device can also upload their own device information to the above-mentioned door lock management platform for maintenance.

[0043] The device information of each camera device and each video recording device maintained by the above-mentioned door lock management platform can be as shown in Table 2 below:

[0044] Table 2

[0045]

[0046] In this application, building numbers, floor numbers, room numbers, etc. can be referred to by information such as building numbers, floor numbers, room numbers, etc. (the information itself or the encoded data of the information).

[0047] In the above intelligent door lock management system, the intelligent door lock, the camera device, and the video recording device can all communicate and exchange information with the door lock management platform. In this case, the door lock management platform can integrate and analyze the information reported by the intelligent door lock, the camera device, and the video recording device, and generate corresponding control instructions to be sent to the intelligent door lock, the camera device, and the video recording device to control them and make them perform corresponding operations.

[0048] Therefore, through the above door lock management platform, the above intelligent door lock, the above camera device, and the above video recording device can be linked to jointly complete video shooting and video playback during the visit of a visitor.

[0049] Based on Figure 1 and referring to Figure 2 , Figure 2 is a flowchart of a video recording method based on an intelligent door lock shown in an exemplary embodiment of the present application.

[0050] As Figure 2 shown, the above video recording method based on an intelligent door lock can be applied to the intelligent door lock shown in Figure 1 . The method can specifically include the following steps:

[0051] Step 201: Call the mounted camera to perform video shooting and perform face detection on the captured video frames.

[0052] In this embodiment, in order to record the process of a visitor's visit, the intelligent door lock can first call the camera mounted on itself to perform video shooting and perform face detection on the video frames captured by itself (i.e., the images used to form the video) to confirm whether there is a visitor. If face information is detected in a certain video frame captured by the intelligent door lock, it can be considered that a visitor has arrived since the shooting moment of this video frame.

[0053] Step 202: When face information is detected in the video frame, send a first message containing the face information to the neighboring intelligent door lock corresponding to the intelligent door lock, so that the neighboring intelligent door lock responds to the received first message and calls the mounted camera to perform video shooting.

[0054] In this embodiment, in order to enhance the diversity of the video recording during the visit of a visitor, when the above-mentioned intelligent door lock detects the above-mentioned face information in the video frames captured by itself (i.e., the starting moment of shooting the above-mentioned first video), it can send a message (which can be called the first message) containing the above-mentioned face information to the neighboring intelligent door lock corresponding to this intelligent door lock.

[0055] The above-mentioned neighboring intelligent door lock can, in response to receiving the above-mentioned first message, call the camera carried by itself to conduct video shooting.

[0056] Step 203: When it is detected that the intelligent door lock has been unlocked, obtain the first video captured by the intelligent door lock, and send the correspondence between the face information and the first video to the video recording device deployed in the room corresponding to the intelligent door lock for storage; wherein, the starting moment of shooting the first video is the moment when the intelligent door lock detects the above-mentioned face information from the video frames, and the ending moment of shooting the first video is the moment when the intelligent door lock detects that the intelligent door lock has been unlocked.

[0057] In this embodiment, based on the face detection result of the video frames captured by the above-mentioned intelligent door lock, the video captured by this intelligent door lock (which can be called the first video) can be obtained.

[0058] Specifically, as described above, generally, it can be considered that a visitor arrives starting from the moment when face information is detected in a certain video frame captured by the above-mentioned intelligent door lock. Therefore, this intelligent door lock can use the moment when face information is detected in this video frame as the starting moment of shooting the above-mentioned first video, and start recording the captured video frames from this starting moment. Correspondingly, after this intelligent door lock is unlocked, the visitor usually enters the room corresponding to this intelligent door lock (for example: the room where this intelligent door lock is deployed on the entrance door), resulting in this intelligent door lock being unable to capture this visitor anymore. Therefore, this intelligent door lock can use the moment when it detects that it has been unlocked as the ending moment of shooting the first video, and stop recording the captured video frames at this ending moment. In this case, the video formed by the video frames captured by this intelligent door lock during the period from this starting moment to this ending moment is the first video. That is to say, the first video captured by this intelligent door lock can be the video captured by this intelligent door lock by calling the camera carried by it during the process from when the user corresponding to the face information enters the shooting range of the camera carried by this intelligent door lock to when this intelligent door lock detects that it has been unlocked.

[0059] For example, assume that the moment when the above intelligent door lock detects the face information from the video frame captured by itself is 16:30 on February 20, 2025, and the moment when the intelligent door lock detects that it has been unlocked is 16:35 on February 20, 2025. Then, the video captured by the intelligent door lock during the period from 16:30 on February 20, 2025 to 16:35 on February 20, 2025 is the above-mentioned first video.

[0060] When the above intelligent door lock obtains the above-mentioned first video, it can determine that the face information detected by the intelligent door lock at the starting moment of shooting the first video corresponds to the first video. Therefore, the intelligent door lock can send the corresponding relationship between the face information and the first video to the video recording device deployed in the room corresponding to the intelligent door lock. Specifically, the intelligent door lock can bind the face information to the first video and send the bound face information and the first video to the video recording device together. When the video recording device receives the corresponding relationship between the face information and the first video, it can store the corresponding relationship, that is, it can obtain the face information and the first video and store them corresponding to each other.

[0061] In some embodiments, when the above intelligent door lock calls the camera carried by itself for video shooting, it can specifically call the camera carried by itself for real-time video shooting.

[0062] Alternatively, in order to reduce the load of the above intelligent door lock and relieve the burden on the intelligent door lock, when the intelligent door lock calls the camera carried by itself for video shooting, it can specifically call the camera carried by itself for video shooting when it detects that a user enters the detection range of the intelligent door lock. Here, the detection range refers to the area or distance within which a device or system can effectively identify, analyze, and respond.

[0063] In some embodiments, the above intelligent door lock can call the camera carried by itself to implement structured light ranging. That is, the intelligent door lock can perform structured light ranging on the user to obtain the distance between the user and the intelligent door lock, and compare the distance with a preset threshold to detect whether the distance between the user and the intelligent door lock is greater than the threshold. If the distance between the user and the intelligent door lock is not greater than the threshold, it can be considered that the user has entered the detection range of the intelligent door lock.

[0064] Structured light ranging is a three-dimensional measurement technique. It projects a specific pattern of light (usually stripes or grids) onto the target object, and then uses a camera to capture the distorted image formed by these lights on the object's surface, thereby calculating the three-dimensional shape and distance information of the object. During the process of structured light ranging, first, the structured light system emits a set of known pattern lights towards the object to be measured. This pattern is usually a set of parallel lines or a complex grid pattern. Then, one or more cameras can capture the light pattern projected onto the object from different angles. Due to the undulations on the object's surface, the originally regular light pattern will be distorted. Finally, by analyzing the differences between these distorted patterns and the original pattern, the three-dimensional contour of the object can be reconstructed, and the specific position and distance of the object relative to the camera can be calculated.

[0065] In some embodiments, the above-mentioned intelligent door lock can detect whether a user has entered the detection range of the intelligent door lock through the sensor carried by it for detecting the movement of an object.

[0066] Specifically, the detection range of the above-mentioned intelligent door lock can be the sensing range of the sensor carried by it for detecting the movement of an object. In this case, when the intelligent door lock detects through the sensor that the user has entered the sensing range of the sensor, it can determine that the user has entered the detection range of the intelligent door lock.

[0067] In some embodiments, the above-mentioned sensor for detecting the movement of an object can specifically be a Passive Infrared (PIR) sensor or a radar sensor. Their main functions are to detect the presence or movement of an object (usually a person or an animal) in a certain area.

[0068] Among them, the PIR sensor senses whether a warm object has entered its sensing range by detecting changes in infrared radiation in the environment. When a warm object moves, it will change the infrared radiation distribution in this area, and the PIR sensor can capture this change. The sensing range of the PIR sensor refers to the maximum distance and angular range within which the sensor can detect changes in infrared radiation.

[0069] The radar sensor detects the presence and movement of an object by emitting microwaves and receiving the reflected signals. According to the Doppler effect, if the frequency of the reflected wave changes, it indicates that an object is in motion. The sensing range of the radar sensor refers to the effective distance within which the sensor emits microwaves and receives the reflected signals.

[0070] In some embodiments, in order to reduce the power consumption of the above-mentioned smart door lock and extend the operable duration of the smart door lock with the same amount of power, the default state of the smart door lock can be the sleep state, that is, it is in a standby mode with low power consumption and low activity by default, temporarily stopping the operation of most functions but retaining basic data and settings.

[0071] For example, when the above-mentioned smart door lock is in the sleep state, its network function can also stop running. When the smart door lock detects that a user enters the detection range of the smart door lock, the network module (such as: WiFi module) in the smart door lock can be awakened to realize the normal operation of the network function.

[0072] In the above situation, the above-mentioned smart door lock can switch from the sleep state to the running state when it detects that a user enters the detection range of the smart door lock, that is, switch to the normal working mode, all functions can be used, and corresponding tasks can be executed, so that the smart door lock can call the camera carried by itself to take a video and perform face detection on the captured video frames.

[0073] After the unlocking operation is completed, the above-mentioned smart door lock can switch back from the running state to the sleep state.

[0074] Step 204: When it is detected that the smart door lock has been unlocked, send a second message to the neighboring smart door lock, so that the neighboring smart door lock, in response to the received first message, obtains a second video captured by the neighboring smart door lock, and sends the correspondence between the face information and the second video to the video recording device for storage; wherein, the start time of shooting the second video is the moment when the neighboring smart door lock receives the first message, and the end time of shooting the second video is the moment when the neighboring smart door lock receives the second message.

[0075] In this embodiment, when the above-mentioned smart door lock detects that it has been unlocked, it can also send a message (which can be called the second message) to the neighboring smart door lock. The second message may or may not include the above-mentioned face information.

[0076] The above-mentioned neighboring smart door lock can, in response to the received second message, obtain a video (which can be called the second video) captured by the neighboring smart door lock.

[0077] Specifically, the above-mentioned neighbor intelligent door lock can use the moment when the above-mentioned first message is received as the starting moment for shooting the above-mentioned second video, and start recording the video frames captured from this shooting starting moment. Correspondingly, the neighbor intelligent door lock can use the moment when the above-mentioned second message is received as the ending moment for shooting the second video, and stop recording the video frames captured at this shooting ending moment. In this case, the video formed by the video frames captured by the neighbor intelligent door lock during the period from this shooting starting moment to this shooting ending moment is the second video. That is to say, the second video captured by the neighbor intelligent door lock can be the video captured by the neighbor intelligent door lock by invoking the on-board camera during the process from when the neighbor intelligent door lock receives the first message to when the neighbor intelligent door lock receives the second message.

[0078] For example, assume that the moment when the above-mentioned neighbor intelligent door lock receives the above-mentioned first message is 16:30 on February 20, 2025, and the moment when the above-mentioned neighbor intelligent door lock receives the above-mentioned second message is 16:35 on February 20, 2025. Then, the video captured by the neighbor intelligent door lock during the period from 16:30 on February 20, 2025 to 16:35 on February 20, 2025 is the above-mentioned second video.

[0079] When the above-mentioned neighbor intelligent door lock obtains the above-mentioned second video, it can determine that the face information in the above-mentioned first message and / or the above-mentioned second message corresponds to the second video. Therefore, the neighbor intelligent door lock can send the corresponding relationship between the face information and the second video to the above-mentioned video recording device. Specifically, the neighbor intelligent door lock can bind the face information to the second video, and send the bound face information and the second video to the video recording device together. When the video recording device receives the corresponding relationship between the face information and the second video, it can store this corresponding relationship, that is, it can obtain the face information and the second video, and store the face information and the second video in a corresponding manner.

[0080] It should be noted that the above-mentioned neighbor intelligent door lock can also send the above-mentioned second video to the above-mentioned intelligent door lock, and the intelligent door lock sends the above-mentioned first video and the second video together to the above-mentioned video recording device for storage.

[0081] In some embodiments, the above-mentioned door lock management platform may determine the neighboring smart door locks of each smart door lock according to the address locations of the smart door locks. For example, the neighboring smart door lock of the smart door lock in Room 501, Unit 2, Building 1 may be the smart door lock in Room 502, Unit 2, Building 1. Among them, the shooting ranges of the cameras installed on a smart door lock and its neighboring smart door lock may be relative, that is, the room corresponding to the smart door lock and the room corresponding to the neighboring smart door lock may be opposite rooms. For a smart door lock, the door lock management platform may send the device information of the neighboring smart door lock of the smart door lock to the smart door lock for maintenance, so that the smart door lock can communicate and exchange information with its neighboring smart door lock according to the device information of its neighboring smart door lock.

[0082] Alternatively, in practical applications, the user may also directly pre-set the device information of the neighboring smart door lock of the above-mentioned smart door lock in the smart door lock for maintenance, so that the smart door lock can communicate and exchange information with its neighboring smart door lock according to the device information of its neighboring smart door lock.

[0083] Step 205: When it is detected that the smart door lock has been unlocked, send a third message containing the face information to the camera device deployed in the room, so that in response to the received third message, the camera device performs face detection on the captured video frames, obtains a third video captured by the camera device based on the face detection result, and sends the correspondence between the face information and the third video to the video recording device for storage; wherein, the starting moment of shooting the third video is the moment when the camera device detects the face information from the video frames, and the ending moment of shooting the third video is the moment when the camera device does not detect the face information from the video frames.

[0084] In this embodiment, when the above-mentioned smart door lock detects that it has been unlocked, it may also send a message (which can be called the third message) containing the above-mentioned face information to the camera device deployed in the room corresponding to the smart door lock.

[0085] When the above-mentioned camera device receives the above-mentioned third message, it can respond. Specifically, it can perform face detection on the video frames captured by itself and obtain a video (which can be called the third video) captured by the camera device based on the face detection result.

[0086] Specifically, the above-mentioned imaging device may use the moment when the above-mentioned third message is received as the starting moment of shooting the above-mentioned third video, and start recording the captured video frames from this starting moment of shooting. Correspondingly, if the above-mentioned face information is not detected in a certain video frame captured by this imaging device, it can be considered that the visitor leaves starting from the shooting moment of this video frame. Therefore, this imaging device may use the moment when the above-mentioned face information is not detected in this video frame as the ending moment of shooting the third video, and stop recording the captured video frames at this ending moment of shooting. In this case, the video formed by the video frames captured by this imaging device during the period from this starting moment of shooting to this ending moment of shooting is the third video.

[0087] For example, assume that the moment when the above-mentioned imaging device receives the above-mentioned third message is 16:35 on February 20, 2025, and the moment when the above-mentioned face information is not detected in the video frames captured by this imaging device itself is 16:55 on February 20, 2025. Then, the video captured by this imaging device during the period from 16:35 on February 20, 2025 to 16:55 on February 20, 2025 is the above-mentioned third video.

[0088] When the above-mentioned imaging device obtains the above-mentioned third video, it can determine that the face information detected by this imaging device during the shooting process of the third video corresponds to the third video. Therefore, this imaging device may send the corresponding relationship between this face information and the third video to the above-mentioned video recording device. Specifically, this imaging device may bind this face information to the third video, and send the bound face information and the third video to this video recording device together. When this video recording device receives the corresponding relationship between this face information and the third video, it may store this corresponding relationship, that is, it can obtain this face information and the third video, and store the corresponding relationship between this face information and the third video.

[0089] It should be noted that in order to ensure the unity of the face information, the above-mentioned third message may include the above-mentioned face information. In this case, on the one hand, this imaging device may match the face information detected in the video frames captured by itself with this face information, and when the two do not match, determine that the above-mentioned face information is not detected in the video frames captured by itself; on the other hand, this imaging device may directly determine that the face information in the third message corresponds to the third video.

[0090] In practical applications, as mentioned above, the face information can be a feature vector extracted from a face image. In this case, for the above-mentioned target face information and the face information of a certain user who can unlock the lock, if the vector similarity between the feature vector as the target face information and the feature vector as the face information of the user who can unlock the lock is not less than a preset threshold, it can be considered that the target face information matches the face information of the user who can unlock the lock.

[0091] In some embodiments, the above-mentioned camera device can be used for real-time video shooting and send the captured video to the above-mentioned video recording device for storage. That is, the video recording device can be used to store the video captured in real time by the camera device.

[0092] In the above case, the above-mentioned camera device can specifically perform face detection on the video frames captured by itself, and based on the face detection result, determine the start time and end time of shooting of the above-mentioned third video. Furthermore, the correspondence between the above-mentioned face information and the start time and end time of shooting of the third video can be sent to the above-mentioned video recording device for storage. In this way, the video recording device can extract the third video from the video captured in real time by the camera device stored by itself according to the start time and end time of shooting of the third video.

[0093] In some embodiments, there can be multiple camera devices deployed in the room corresponding to the above-mentioned intelligent door lock; the shooting ranges of these multiple camera devices are usually different. For example, the shooting range of one camera device may be the area of the room's entrance door, and the shooting range of another camera device may be the area of the living room sofa in the room, and so on. Therefore, the start times of the video frames actually captured by each camera device and containing human figures may be different.

[0094] Based on the above content, when each of the above-mentioned camera devices receives the above-mentioned third message containing the above-mentioned face information, it can perform face detection on the video frames captured by itself in response to the third message. In this case, the camera device that first detects the face information from the video frames captured by it among these camera devices can be called the target camera device. At this time, the target camera device has detected the face information from this video frame, but has not obtained the portrait auxiliary information corresponding to this face information. Therefore, the target camera device can obtain the portrait auxiliary information in this video frame where the face information is detected; for example, the target camera device can perform structured analysis on the portrait area in this video frame to obtain the portrait auxiliary information as the portrait auxiliary information corresponding to the target face information. Among them, the portrait auxiliary information can include the color of the clothes worn by the person, the shape of the accessories worn by the person, etc.

[0095] The above-mentioned target imaging device can obtain a third video captured by the target imaging device based on the face detection result of the video frame captured thereby. The start time of shooting the third video captured by the target imaging device can be the time when the target imaging device detects the above-mentioned face information from the video frames captured by it, and the end time of shooting the third video captured by the target imaging device can be the time when the target imaging device fails to detect the face information from the video frames captured by it. That is to say, the first video captured by the target imaging device can be the video captured by the target imaging device during the process from when the user corresponding to the face information enters the shooting range of the target imaging device to when the user leaves the shooting range of the target imaging device.

[0096] After obtaining the above-mentioned portrait auxiliary information, the above-mentioned target imaging device can also send the portrait auxiliary information to other imaging devices in the above-mentioned imaging device.

[0097] Taking any one of the above-mentioned other imaging devices as an example, in response to the received portrait auxiliary information, the imaging device can, while continuing to perform face detection on the video frames captured by it, perform portrait auxiliary detection on the video frames captured by it, so that the imaging device can obtain a third video captured by the imaging device based on the face detection result and the portrait auxiliary detection result. In practical applications, as long as the imaging device detects any one of the face information and the portrait auxiliary information from the video frames captured by it, it can be considered that the user corresponding to the face information enters the shooting range of the imaging device; and when the imaging device neither detects the face information nor the portrait auxiliary information from the video frames captured by it, it can be considered that the user leaves the shooting range of the imaging device. Therefore, the start time of shooting the third video captured by the imaging device can be the time when the imaging device detects the face information or the portrait auxiliary information from the video frames captured by it, and the end time of shooting the third video captured by the imaging device can be the time when the imaging device fails to detect the face information and the portrait auxiliary information from the video frames captured by it.

[0098] Whether it is the above-mentioned target imaging device or the above-mentioned other imaging devices, these imaging devices can send the corresponding relationship between the above-mentioned face information and the third video captured by themselves to the above-mentioned video recording device, and the video recording device stores the corresponding relationship.

[0099] In some embodiments, the above-mentioned video recording device can obtain a video playback request. For example, a user can initiate a video playback request corresponding to a certain user through the user interface provided by the above-mentioned door lock management platform, and the door lock management platform can convert the video playback request into a video playback request corresponding to the face information according to the stored face information of the user.

[0100] In practical applications, the above-mentioned door lock management platform can serve as a backend system to manage and monitor the functions and services of the front-end application (APP) for users. Among them, the APP usually runs on smartphones, tablets or other mobile devices, provides a user interface and interaction functions, enabling users to perform various operations. The APP can collect and generate user data, and synchronize the data with the door lock management platform through the API interface; the door lock management platform can receive data from the APP, store the data in the database for subsequent analysis and processing, and at the same time, the door lock management platform can also push update information, notifications or configuration changes to the APP.

[0101] When the above-mentioned video recording device obtains the above-mentioned video playback request, it can determine the first video, the second video and the third video corresponding to the face information in the video playback request according to the corresponding relationship between the stored face information and the video, and play the first video and the second video simultaneously. After the first video and the second video are played, the third video can be played continuously.

[0102] In practical applications, when the above-mentioned video recording device plays the above-mentioned first video and the above-mentioned second video simultaneously, it can specifically divide the display screen of the video recording device into two areas, and play the first video and the second video respectively and simultaneously in these two areas.

[0103] When there are multiple third videos, the video frames with the same shooting time can be played simultaneously according to the shooting time of the video frames in each third video. For example, assume that the shooting time of the video frames in the first third video is from 16:35 on February 20, 2025 to 16:55 on February 20, 2025, and the shooting time of the video frames in the second third video is from 16:45 on February 20, 2025 to 17:10 on February 20, 2025. Then the video frames with the same shooting time in these two third videos are the video frames with the shooting time in the period from 16:45 on February 20, 2025 to 16:55 on February 20, 2025. Therefore, the above-mentioned video recording device can divide its own display screen into two areas, play the first third video in one area first, and then play the second third video in the other area 10 minutes after the first third video is played.

[0104] In the above technical solution, the intelligent door lock can call the built-in camera to take a video, and perform face detection on the captured video frames. Based on the face detection results, the first video captured by the intelligent door lock can be obtained. The starting moment of shooting the first video is the moment when the intelligent door lock detects face information from the video frames captured by itself, and the ending moment of shooting the first video is the moment when the intelligent door lock detects that it has been unlocked. Furthermore, the correspondence between the face information and the first video can be sent to the video recording device deployed in the room corresponding to the intelligent door lock for storage. When the intelligent door lock detects that it has been unlocked, it can also send a third message to the camera device deployed in the room, so that in response to the received third message, the camera device performs face detection on the captured video frames, and based on the face detection results, obtains the third video captured by the camera device. The starting moment of shooting the third video is the moment when the camera device receives the third message, and the ending moment of shooting the third video is the moment when the camera device does not detect the face information from the video frames captured by itself. Furthermore, the correspondence between the face information and the third video can be sent to the video recording device for storage.

[0105] By adopting the above method, through the linkage among the intelligent door lock, the camera device and the video recording device deployed in the room corresponding to the intelligent door lock, the whole process of the visitor's visit can be recorded.

[0106] Based on Figure 1 and referring to Figure 3 , Figure 3 is a schematic diagram of another intelligent door lock management system shown in an exemplary embodiment of the present application.

[0107] As Figure 3 shown, in order to distinguish the intelligent door locks, camera devices, video recording devices and other devices (or systems, collectively referred to as devices in the present application) in different regions, avoid unnecessary data transmission between devices in different regions, and facilitate the management of these devices in the same region, the multicast method can be adopted. The access control system and the intelligent door locks in the same region can join the same multicast group. Further, the multicast data between the above-mentioned door lock management platform and each multicast group can be managed and forwarded by a routing device supporting the multicast function (for example: router, layer 3 switch, etc.). This routing device can be directly connected to the door lock management platform and each device in the multicast group respectively.

[0108] In practical applications, in order to reduce the deployment cost of the door lock management platform, the door lock management platform can be directly deployed on the above-mentioned routing device. That is to say, this routing device can not only provide the multicast function, but also realize the unified management of intelligent door locks through the deployed door lock management platform.

[0109] Taking one multicast group as an example, a suitable IP address can be assigned to this multicast group as the communication address of this multicast group, so that the above-mentioned door lock management platform can use this communication address to send multicast data to this multicast group. In practical applications, each device in this multicast group can also use this communication address to send multicast data to other devices in this multicast group. Each intelligent door lock, each camera device or each video recording device that needs to join this multicast group can indicate that the device hopes to join this multicast group by sending an IGMP (Internet Group Management Protocol) join message to the routing device corresponding to this multicast group. This IGMP join message can include the device information of the device (for example: device unique identifier, device geographical location, device type, etc.); after receiving this IGMP join message, the routing device can record the corresponding relationship between the device information of this device and the interface in the multicast forwarding table maintained inside it that is used to forward multicast data to this device (usually the interface used to receive this IGMP join message). And when this device no longer needs to receive multicast data, it can send an IGMP leave message to this routing device, so that this routing device stops forwarding multicast data to this device.

[0110] The corresponding relationship between the device information of each device in the above-mentioned multicast group maintained by the above-mentioned routing device and the interface can be shown in Table 3 below:

[0111] Table 3

[0112]

[0113] It should be noted that although Figure 3 it is shown that there is only one routing device between the above-mentioned door lock management platform and the multicast group joined by the above-mentioned intelligent door lock, in fact, in a multicast network, multiple routing devices can participate in the forwarding of multicast data. These routing devices all support and participate in the multicast routing protocol (such as Protocol Independent Multicast, that is, PIM).

[0114] Specifically, a multicast network can be divided into multiple subnets. For example, assume that the smart door locks corresponding to all rooms in a community (e.g., the smart door locks deployed on the entrance doors of the rooms) join the same multicast group, forming a multicast network. Then, in this multicast network, subnet division can be performed according to the building, that is, the network formed by the smart door locks corresponding to the rooms in the same building is regarded as a subnet. In a subnet, there is at least one local multicast routing device, which is responsible for receiving multicast data from the upstream and forwarding the multicast data to all multicast members in this subnet. It should be noted that if there is only one local multicast routing device in a subnet, this routing device is directly connected to the devices that are multicast members in this subnet. The upstream multicast routing device refers to a multicast routing device that is closer to the multicast source or Rendezvous Point (RP) relative to the local multicast routing device; they are responsible for receiving multicast data from the multicast source or RP and forwarding the multicast data to the downstream multicast routing devices according to the multicast routing protocol.

[0115] In a multicast network, the flow of multicast data generally includes: the multicast source sending data to the multicast routing device, the multicast routing devices forwarding data to each other, reaching the target multicast routing device, and the target multicast routing device sending data to the multicast members. Specifically, the multicast data is first sent by the multicast source to the multicast routing device directly connected to this multicast source; then, through the multicast routing protocol, these multicast data are forwarded to other multicast routing devices that need to receive this multicast stream. In this process, a multicast distribution tree is formed, which can be an Any-Source (*, G) or Source-Specific (S, G) tree, where S represents the multicast source and G represents the communication address of the multicast group; then, the multicast data will be forwarded to the target multicast routing device located at the edge of the target subnet; finally, the target multicast routing device forwards the received multicast data to the multicast members in the target subnet.

[0116] When constructing the Any-Source (*, G) multicast tree, this process allows multicast data from any source to be sent to the multicast address represented by G and dynamically establishes and maintains the multicast distribution path through the PIM protocol. This means that any routing device can send a PIM Join message to indicate that it wishes to join this multicast group, thereby ensuring that the member devices in the subnet where this routing device is located can receive the corresponding multicast data. After receiving the PIM Join message, the upstream multicast routing device will correspondingly update its multicast forwarding table to ensure that the multicast data can be forwarded along the correct path.

[0117] Based on Figure 3 and referring to Figure 4 , Figure 4 is a flowchart of another video recording method based on a smart door lock shown in an exemplary embodiment of the present application.

[0118] As shown Figure 4 in the figure, the above video recording method based on the intelligent door lock can be applied to the intelligent door lock as shown Figure 3 in the figure. The method may specifically include the following steps:

[0119] Step 401: Call the mounted camera to perform video shooting, and perform face detection on the captured video frames.

[0120] Step 402: When the face information is detected from the video frames, send a first IGMP join message to the routing device according to the communication address of the multicast group. The first IGMP join message includes the face information. When the routing device determines that the first IGMP join message also includes indication information for indicating that the intelligent door lock has detected face information, determine the neighbor intelligent door lock corresponding to the intelligent door lock according to the topological relationship, and send the first IGMP join message to the neighbor intelligent door lock through the interface corresponding to the neighbor intelligent door lock, so that the neighbor intelligent door lock responds to the received first IGMP join message and calls the mounted camera to perform video shooting.

[0121] Step 403: When it is detected that the intelligent door lock has been unlocked, obtain the first video captured by the intelligent door lock, and send the correspondence between the face information and the first video to the video recording device deployed in the room corresponding to the intelligent door lock for storage; wherein, the starting moment of shooting the first video is the moment when the intelligent door lock detects the face information from the video frames, and the ending moment of shooting the first video is the moment when the intelligent door lock detects that the intelligent door lock has been unlocked.

[0122] Step 404: When it is detected that the intelligent door lock has been unlocked, send a second IGMP join message to the routing device according to the communication address of the multicast group. The second IGMP join message includes the face information. When the routing device determines that the second IGMP join message also includes indication information for indicating that the intelligent door lock has been unlocked, send the second IGMP join message to the neighbor intelligent door lock through the interface corresponding to the neighbor intelligent door lock, so that the neighbor intelligent door lock responds to the received second IGMP join message, obtains the second video captured by the neighbor intelligent door lock, and sends the correspondence between the face information and the second video to the video recording device for storage; wherein, the starting moment of shooting the second video is the moment when the neighbor intelligent door lock receives the first message, and the ending moment of shooting the second video is the moment when the neighbor intelligent door lock receives the second message.

[0123] Step 405: When it is detected that the intelligent door lock has been unlocked, according to the communication address of the multicast group, send a second IGMP join message to the routing device. The second IGMP join message includes the face information. When the routing device determines that the second IGMP join message also includes indication information for indicating that the intelligent door lock has been unlocked, send the second IGMP join message to the camera device through the interface corresponding to the camera device deployed in the room, so that the camera device, in response to the received second IGMP join message, performs face detection on the captured video frames, obtains a third video captured by the camera device based on the face detection result, and sends the correspondence between the face information and the third video to the video recording device for storage; wherein, the starting moment of shooting the third video is the moment when the camera device detects the face information from the video frames, and the ending moment of shooting the third video is the moment when the camera device does not detect the face information from the video frames.

[0124] In this embodiment, the above intelligent door lock, the above camera device, and the above video recording device can join the same multicast group; the routing device corresponding to this multicast group can maintain the correspondence between the device information of each device in this multicast group and the interface for forwarding multicast data to this device.

[0125] In addition, the above routing device can also maintain the topological relationship between intelligent door locks, so as to facilitate determining the neighbor intelligent door locks of each intelligent door lock and the path intelligent door locks of each intelligent door lock. Specifically, this topological information can be sent by the above door lock management platform to this routing device, or can be collected by this routing device itself when receiving the above registration messages sent by each intelligent door lock to the door lock management platform through this routing device. Among them, the shooting ranges of the cameras mounted on an intelligent door lock and its neighbor intelligent door locks can be relative. The shooting ranges of the cameras mounted on an intelligent door lock and its path intelligent door locks can correspond to the user's travel route. For example, the path intelligent door locks of the intelligent door lock in Room 501, Unit 2, Building 1 can include the intelligent door locks in Room 401, Unit 2, Building 1, the intelligent door locks in Room 301, Unit 2, Building 1, the intelligent door locks in Room 201, Unit 2, Building 1, and the intelligent door locks in Room 101, Unit 2, Building 1.

[0126] When the above intelligent door lock detects face information from the video frames it captures, it can send an IGMP join message (which can be called the first IGMP join message) to the above routing device corresponding to this multicast group according to the communication address of this multicast group. Among them, the first IGMP join message can include this face information and indication information for indicating that this intelligent door lock has detected face information. At this time, the first IGMP join message can be used as the above first message.

[0127] When the above routing device receives the above first IGMP join message, if it determines that the first IGMP join message contains indication information for indicating that the above intelligent door lock has detected face information, it can determine the neighbor intelligent door lock corresponding to the intelligent door lock according to the maintained topological relationship of the intelligent door lock, and determine the interface corresponding to the neighbor intelligent door lock according to the device information of the neighbor intelligent door lock. Thus, the first IGMP join message can be sent to the neighbor intelligent door lock through the interface corresponding to the neighbor intelligent door lock. When the neighbor intelligent door lock receives the first IGMP join message, it can call the mounted camera to take a video.

[0128] When the above intelligent door lock detects that it has been unlocked, it can send an IGMP join message (which can be called the second IGMP join message) to the above routing device according to the communication address of the above multicast group. The second IGMP join message can include the above face information and indication information for indicating that the intelligent door lock has been unlocked. At this time, the second IGMP join message can serve as both the above second message and the above third message.

[0129] When the above routing device receives the above second IGMP join message, if it determines that the second IGMP join message contains indication information for indicating that the above intelligent door lock has been unlocked, on the one hand, it can send the second IGMP join message to the neighbor intelligent door lock through the interface corresponding to the neighbor intelligent door lock, so that the neighbor intelligent door lock can obtain the above second video captured by the neighbor intelligent door lock in response to the received second IGMP join message and send the corresponding relationship between the face information and the second video to the above video recording device for storage; on the other hand, the routing device can determine the interface corresponding to the camera device deployed in the room (specifically, the room corresponding to the intelligent door lock) according to the maintained corresponding relationship between device information and interfaces, and send the second IGMP join message to the camera device through the interface corresponding to the camera device, so that the camera device can perform face detection on the captured video frames, obtain the third video captured by the camera device based on the face detection result, and send the corresponding relationship between the face information and the third video to the above video recording device for storage.

[0130] It should be noted that there may be one and only one or multiple of the above camera devices. The above routing device can determine the interfaces corresponding to all the camera devices deployed in the room according to the maintained corresponding relationship between device information and interfaces, and send the above second IGMP join message to each camera device through these interfaces respectively.

[0131] In some embodiments, when the above-mentioned intelligent door lock detects that it is unlocked from the inside, it usually means that the user needs to leave the room. In this case, the intelligent door lock can send an IGMP join message (which can be referred to as the third IGMP join message) to the above-mentioned routing device according to the communication address of the above-mentioned multicast group. The third IGMP join message may include the above-mentioned face information and indication information for indicating that the intelligent door lock is unlocked from the inside.

[0132] When the above-mentioned routing device receives the above-mentioned third IGMP join message, if it determines that the third IGMP join message contains indication information for indicating that the above-mentioned intelligent door lock is unlocked from the inside, it can determine the path intelligent door lock corresponding to the intelligent door lock according to the topological relationship of the intelligent door lock maintained, and determine the interface corresponding to the path intelligent door lock according to the device information of the path intelligent door lock, so that the third IGMP join message can be sent to the path intelligent door lock through the interface corresponding to the path intelligent door lock. When the path intelligent door lock receives the third IGMP join message, it can store the face information.

[0133] It should be noted that there are usually multiple above-mentioned path intelligent door locks. The above-mentioned routing device can determine the interfaces corresponding to all path intelligent door locks according to the corresponding relationship between the device information and the interfaces maintained, and send the above-mentioned third IGMP join message to each path intelligent door lock through these interfaces respectively.

[0134] When the above-mentioned routing device determines that the third IGMP join message contains indication information for indicating that the above-mentioned intelligent door lock is unlocked from the inside, it can also determine the arrangement order of the above-mentioned path intelligent door locks according to the above-mentioned topological relationship. The arrangement order of the path intelligent door locks corresponds to the user's travel route; for example, after the user leaves the room of Room 501, Unit 2, Building 1, the arrangement order of the path intelligent door locks corresponding to the intelligent door lock of Room 501, Unit 2, Building 1 can be: the intelligent door lock of Room 401, Unit 2, Building 1 → the intelligent door lock of Room 301, Unit 2, Building 1 → the intelligent door lock of Room 201, Unit 2, Building 1 → the intelligent door lock of Room 101, Unit 2, Building 1.

[0135] The above routing device can further send the reminder message containing the above arrangement order to the first path intelligent door lock through the interface corresponding to the first path intelligent door lock (for example, the intelligent door lock in Room 401, Unit 2, Building 1), so that the first path intelligent door lock can, in response to the received reminder message, call the equipped camera to take a video and perform face detection on the captured video frames. On the one hand, the first path intelligent door lock can, based on the face detection result, obtain the video captured by the first path intelligent door lock (which can be called the fourth video), and send the corresponding relationship between the above face information and the fourth video to the above video recording device for storage; on the other hand, when the first path intelligent door lock fails to detect the face information from the captured video frames, it can determine the second path intelligent door lock (i.e., the next path intelligent door lock corresponding to the first path intelligent door lock, for example, the intelligent door lock in Room 301, Unit 2, Building 1) according to the arrangement order in the reminder message, so that it can send the reminder message containing the arrangement order to the second path intelligent door lock. Among them, the starting moment of the fourth video captured by the first path intelligent door lock can be the moment when the first path intelligent door lock detects the face information from the captured video frames, and the ending moment of the fourth video captured by the first path intelligent door lock can be the moment when the first path intelligent door lock fails to detect the face information from the captured video frames; that is to say, the fourth video captured by the first path intelligent door lock can be the video captured by the first path intelligent door lock by calling the equipped camera during the process from when the user corresponding to the face information enters the shooting range of the camera equipped with the first path intelligent door lock to when the user leaves the shooting range of the camera equipped with the first path intelligent door lock.

[0136] Similarly to the first path intelligent door lock described above, the second path intelligent door lock can, in response to the received reminder message containing the above arrangement order, call the equipped camera to take a video, and perform face detection on the captured video frames. On the one hand, the second path intelligent door lock can, based on the face detection result, obtain the fourth video captured by the second path intelligent door lock, and send the corresponding relationship between the above face information and the fourth video to the above video recording device for storage; on the other hand, when the second path intelligent door lock fails to detect the face information from the video frames it captured, it can determine the third path intelligent door lock (i.e., the next path intelligent door lock corresponding to the second path intelligent door lock, for example: the intelligent door lock of Room 201, Unit 2, Building 1) according to the arrangement order in the reminder message, so as to send the reminder message containing the arrangement order to the third path intelligent door lock. Among them, the start time of shooting the fourth video captured by the second path intelligent door lock can be the moment when the second path intelligent door lock detects the face information from the video frames it captured, and the end time of shooting the fourth video captured by the second path intelligent door lock can be the moment when the second path intelligent door lock fails to detect the face information from the video frames it captured; that is to say, the fourth video captured by the second path intelligent door lock can be the video captured by the second path intelligent door lock calling the equipped camera during the process from the moment when the user corresponding to the face information enters the shooting range of the camera equipped with the second path intelligent door lock to the moment when the user leaves the shooting range of the camera equipped with the second path intelligent door lock.

[0137] And so on, until all the path intelligent door locks corresponding to the above intelligent door lock have completed the shooting of the fourth video, and send the corresponding relationship between the above face information and the fourth video captured by each of them to the above video recording device for storage.

[0138] It should be noted that when each path intelligent door lock sends the corresponding relationship between the above face information and the fourth video it captured to the above video recording device for storage, specifically, the path intelligent door lock can bind the face information with the fourth video it captured, and send the bound face information and fourth video together to the video recording device. The video recording device can receive the bound face information and fourth video, that is, receive the corresponding relationship between the face information and the fourth video, so that the video recording device can store the corresponding relationship, that is, the video recording device can obtain the face information and the fourth video, and store the face information and the fourth video correspondingly.

[0139] In some embodiments, in order to reduce the power consumption of the above-mentioned intelligent door lock and extend the operable duration of the intelligent door lock under the same power, each path intelligent door lock can switch from the sleep state to the running state when receiving the above-mentioned reminder message, so as to call the equipped camera for video shooting.

[0140] It should be noted that when the above-mentioned door lock management platform, any intelligent door lock, any camera device or any video recording device needs to send specific data to any one or more devices (which can be called target devices) in the above-mentioned multicast group, it can send the data and the device information of the target device (for example: the floor where it is located, the corresponding room, device type, identification information, etc.) to the routing device corresponding to the multicast group according to the communication address of the multicast group. The routing device determines the interface corresponding to the target device according to the device information, and sends the data to the target device through this interface.

[0141] Such as Figure 4 shown, the specific implementation manner of the embodiment can refer to the embodiment shown in Figure 2 shown, and the present application will not elaborate herein.

[0142] Corresponding to the embodiment of the foregoing method, the present application also provides an embodiment of a device.

[0143] Referring to Figure 5 , Figure 5 is a schematic structural diagram of a device shown in an exemplary embodiment of the present application. At the hardware level, the device includes a processor 501, an internal bus 502, a network interface 503, a memory 504, and a non-volatile memory 505. Of course, other required hardware may also be included. One or more embodiments of the present application can be implemented in a software manner. For example, the processor 501 reads the corresponding computer program from the non-volatile memory 505 into the memory 504 and then runs it. Of course, in addition to the software implementation manner, one or more embodiments of the present application do not exclude other implementation manners, such as a logic device or a combination of software and hardware, etc. That is to say, the execution subject of the following processing flow is not limited to each logic module, and can also be hardware or a logic device.

[0144] Referring to Figure 6 , Figure 6 is a block diagram of a video recording device based on an intelligent door lock shown in an exemplary embodiment of the present application.

[0145] The above-mentioned video recording device based on an intelligent door lock can be applied to Figure 5 the device shown, and the device can be an intelligent door lock to implement the technical solution of the present application.

[0146] Such as Figure 6 shown, the above-mentioned video recording device based on an intelligent door lock may specifically include:

[0147] The detection module 601 is configured to call the mounted camera to perform video shooting and perform face detection on the captured video frames;

[0148] The first video recording module 602 is configured to, when face information is detected from the video frames, send a first message including the face information to the neighboring intelligent door lock corresponding to the intelligent door lock, so that the neighboring intelligent door lock, in response to the received first message, calls the mounted camera to perform video shooting;

[0149] The second video recording module 603 is configured to, when it is detected that the intelligent door lock has been unlocked, obtain a first video captured by the intelligent door lock, and send the correspondence between the face information and the first video to the video recording device deployed in the room corresponding to the intelligent door lock for storage; and send a second message to the neighboring intelligent door lock, so that the neighboring intelligent door lock, in response to the received first message, obtains a second video captured by the neighboring intelligent door lock, and sends the correspondence between the face information and the second video to the video recording device for storage; and send a third message including the face information to the camera device deployed in the room, so that the camera device, in response to the received third message, performs face detection on the captured video frames, and based on the face detection result, obtains a third video captured by the camera device, and sends the correspondence between the face information and the third video to the video recording device for storage;

[0150] Wherein, the start time of shooting the first video is the time when the intelligent door lock detects the face information from the video frames, and the end time of shooting the first video is the time when the intelligent door lock detects that the intelligent door lock has been unlocked; the start time of shooting the second video is the time when the neighboring intelligent door lock receives the first message, and the end time of shooting the second video is the time when the neighboring intelligent door lock receives the second message; the start time of shooting the third video is the time when the camera device detects the face information from the video frames, and the end time of shooting the third video is the time when the camera device does not detect the face information from the video frames.

[0151] In some embodiments, the video recording device is configured to, when a video playback request is obtained, determine the first video, the second video, and the third video stored corresponding to the face information in the video playback request, and play the first video and the second video simultaneously, and after the playing is completed, continue to play the third video.

[0152] In some embodiments, the calling the mounted camera to perform video shooting includes:

[0153] Call the on-board camera to perform real-time video shooting; or,

[0154] When it is detected that a user enters the detection range of the smart door lock, call the on-board camera to perform video shooting.

[0155] In some embodiments, the step of, when it is detected that a user enters the detection range of the smart door lock, calling the on-board camera to perform video shooting includes:

[0156] When it is detected that a user enters the detection range of the smart door lock, switch from the sleep state to the running state to call the on-board camera to perform video shooting.

[0157] In some embodiments, the imaging device is used for real-time video shooting and sends the captured video to the video recording device for storage;

[0158] The step of sending a third message containing the face information to the imaging device deployed in the room corresponding to the smart door lock, so that the imaging device, in response to the received third message, performs face detection on the captured video frames, and based on the face detection result, obtains a third video captured by the imaging device, and sends the correspondence between the face information and the third video to the video recording device for storage, includes:

[0159] Send a third message containing the face information to the imaging device deployed in the room corresponding to the smart door lock, so that the imaging device, in response to the received third message, performs face detection on the captured video frames, and based on the face detection result, determines the start time and end time of shooting of the third video captured by the imaging device, and sends the correspondence between the face information and the start time and end time of shooting of the third video to the video recording device for storage.

[0160] In some embodiments, the step of sending a third message containing the face information to the imaging device deployed in the room, so that the imaging device, in response to the received third message, performs face detection on the captured video frames, and based on the face detection result, obtains a third video captured by the imaging device, and sends the correspondence between the face information and the third video to the video recording device for storage, includes:

[0161] Send a third message containing the face information to the camera device deployed in the room, so that in response to the received third message, the camera device performs face detection on the captured video frames. When the target camera device in the camera device detects the face information from the video frames and fails to obtain the portrait auxiliary information corresponding to the face information, the target camera device obtains the portrait auxiliary information in the video frames, and sends the portrait auxiliary information to other camera devices in the camera device, and based on the face detection result, obtains the third video captured by the target camera device, and sends the correspondence between the face information and the third video to the video recording device for storage. The other camera devices perform portrait auxiliary detection on the captured video frames in response to the received portrait auxiliary information, and based on the face detection result and the portrait auxiliary detection result, obtain the third video captured by the other camera devices, and send the correspondence between the face information and the third video to the video recording device for storage;

[0162] Among them, the shooting start time of the third video captured by the target camera device is the time when the target camera device detects the face information from the video frames, and the shooting end time of the third video is the time when the target camera device fails to detect the face information from the video frames; the shooting start time of the third video captured by the other camera devices is the time when the other camera devices detect the face information or the portrait auxiliary information from the video frames, and the shooting end time of the third video is the time when the other camera devices fail to detect the face information and the portrait auxiliary information from the video frames.

[0163] In some embodiments, the intelligent door lock, the camera device and the video recording device join the same multicast group; the routing device corresponding to the multicast group maintains the correspondence between the identification information of the devices and the interfaces; the routing device also maintains the topological relationship between the intelligent door locks;

[0164] When detecting the face information from the video frames, sending a first message containing the face information to the neighboring intelligent door lock corresponding to the intelligent door lock, so that in response to the received first message, the neighboring intelligent door lock calls the mounted camera for video shooting, including:

[0165] When the face information is detected from the video frame, a first IGMP join message is sent to the routing device according to the communication address of the multicast group. The first IGMP join message includes the face information. When the routing device determines that the first IGMP join message also includes indication information for indicating that the intelligent door lock has detected face information, the neighbor intelligent door lock corresponding to the intelligent door lock is determined according to the topological relationship, and the first IGMP join message is sent to the neighbor intelligent door lock through the interface corresponding to the neighbor intelligent door lock, so that the neighbor intelligent door lock responds to the received first IGMP join message and calls the mounted camera to perform video shooting;

[0166] When it is detected that the intelligent door lock has been unlocked, a second message is sent to the neighbor intelligent door lock, so that the neighbor intelligent door lock responds to the received first message, obtains a second video captured by the neighbor intelligent door lock, and sends the correspondence between the face information and the second video to the video recording device for storage; and, a third message including the face information is sent to the camera device deployed in the room, so that the camera device responds to the received third message, performs face detection on the captured video frame, obtains a third video captured by the camera device based on the face detection result, and sends the correspondence between the face information and the third video to the video recording device for storage, including:

[0167] When it is detected that the intelligent door lock has been unlocked, a second IGMP join message is sent to the routing device according to the communication address of the multicast group. The second IGMP join message includes the face information. When the routing device determines that the second IGMP join message also includes indication information for indicating that the intelligent door lock has been unlocked, the second IGMP join message is sent to the neighbor intelligent door lock through the interface corresponding to the neighbor intelligent door lock, so that the neighbor intelligent door lock responds to the received second IGMP join message, obtains a second video captured by the neighbor intelligent door lock, and sends the correspondence between the face information and the second video to the video recording device for storage; and, when the routing device determines that the second IGMP join message also includes indication information for indicating that the intelligent door lock has been unlocked, the second IGMP join message is sent to the camera device through the interface corresponding to the camera device deployed in the room, so that the camera device responds to the received second IGMP join message, performs face detection on the captured video frame, obtains a third video captured by the camera device based on the face detection result, and sends the correspondence between the face information and the third video to the video recording device for storage.

[0168] In some embodiments, the device further comprises:

[0169] A third video recording module, configured to, when detecting that the intelligent door lock is unlocked from the inside, send a third IGMP join message to the routing device according to the communication address of the multicast group, where the third IGMP join message includes the face information. When the routing device determines that the third IGMP join message further includes indication information for indicating that the intelligent door lock is unlocked from the inside, the routing device determines a path intelligent door lock corresponding to the intelligent door lock according to the topological relationship, and sends the third IGMP message to the path intelligent door lock through an interface corresponding to the path intelligent door lock, so that the path intelligent door lock stores the face information. And when the routing device determines that the third IGMP join message further includes indication information for indicating that the intelligent door lock is unlocked from the inside, the routing device determines the arrangement order of the path intelligent door locks corresponding to the intelligent door lock according to the topological relationship, and sends a reminder message including the arrangement order to the first path intelligent door lock through an interface corresponding to the first path intelligent door lock, so that the first path intelligent door lock, in response to the received reminder message, calls the mounted camera to perform video shooting, performs face detection on the captured video frames, obtains a fourth video captured by the first path intelligent door lock based on the face detection result, and sends the correspondence between the face information and the fourth video to the video recording device for storage. When the face information is not detected from the video frames, the reminder message is sent to the next intelligent door lock corresponding to the first path intelligent door lock;

[0170] Wherein, the start time of shooting the fourth video is the time when the first path intelligent door lock detects the face information from the video frames, and the end time of shooting the fourth video is the time when the first path intelligent door lock does not detect the face information from the video frames.

[0171] In some embodiments, when receiving the reminder message, the path intelligent door lock switches from the sleep state to the running state to call the mounted camera to perform video shooting.

[0172] In some embodiments, the correspondence between the device information and the interface is created by the routing device according to the device information of each device included in the IGMP join messages sent by the devices in the multicast group and the interfaces in the routing device for receiving the IGMP join messages.

[0173] Corresponding to the embodiments of the foregoing method, the present application further provides embodiments of a system.

[0174] A video recording system based on an intelligent door lock, the system comprising an intelligent door lock, a neighbor intelligent door lock corresponding to the intelligent door lock, a camera device and a video recording device deployed in a room corresponding to the intelligent door lock; wherein:

[0175] The intelligent door lock calls the camera carried thereon to perform video shooting, and performs face detection on the captured video frames;

[0176] When the intelligent door lock detects the face information from the video frames, it sends a first message containing the face information to the neighbor intelligent door lock corresponding to the intelligent door lock;

[0177] The neighbor intelligent door lock responds to the received first message and calls the camera carried thereon to perform video shooting;

[0178] When the intelligent door lock detects that the intelligent door lock has been unlocked, it acquires a first video captured by the intelligent door lock, and sends the correspondence between the face information and the first video to the video recording device deployed in the room corresponding to the intelligent door lock for storage; and, sends a second message to the neighbor intelligent door lock; and, sends a third message containing the face information to the camera device deployed in the room;

[0179] The neighbor intelligent door lock responds to the received first message, acquires a second video captured by the neighbor intelligent door lock, and sends the correspondence between the face information and the second video to the video recording device for storage;

[0180] The camera device responds to the received third message, performs face detection on the captured video frames, based on the face detection result, acquires a third video captured by the camera device, and sends the correspondence between the face information and the third video to the video recording device for storage;

[0181] Wherein, the starting moment of shooting the first video is the moment when the intelligent door lock detects the face information from the video frames, and the ending moment of shooting the first video is the moment when the intelligent door lock detects that the intelligent door lock has been unlocked; the starting moment of shooting the second video is the moment when the neighbor intelligent door lock receives the first message, and the ending moment of shooting the second video is the moment when the neighbor intelligent door lock receives the second message; the starting moment of shooting the third video is the moment when the camera device detects the face information from the video frames, and the ending moment of shooting the third video is the moment when the camera device does not detect the face information from the video frames.

[0182] In some embodiments, the video recording device is configured to, when receiving a video playback request, determine the first video, the second video, and the third video stored corresponding to the face information in the video playback request, play the first video and the second video simultaneously, and continue to play the third video after the playback is completed.

[0183] In some embodiments, the intelligent door lock specifically performs:

[0184] Invoke the built-in camera to perform real-time video shooting; or,

[0185] In some embodiments, the intelligent door lock specifically performs:

[0186] When detecting that a user enters the detection range of the intelligent door lock, switch from the sleep state to the running state to invoke the built-in camera to perform video shooting.

[0187] In some embodiments, the camera device is configured to perform real-time video shooting and send the captured video to the video recording device for storage;

[0188] The camera device specifically performs:

[0189] Send a third message containing the face information to the camera device deployed in the room corresponding to the intelligent door lock, so that the camera device, in response to the received third message, performs face detection on the captured video frames, determines the shooting start time and the shooting end time of the third video captured by the camera device based on the face detection result, and sends the correspondence between the face information and the shooting start time and the shooting end time of the third video to the video recording device for storage.

[0190] In some embodiments, the camera device specifically performs:

[0191] In response to the received third message, perform face detection on the captured video frame. When the target camera device in the camera device detects the face information from the video frame and fails to obtain the portrait auxiliary information corresponding to the face information, obtain the portrait auxiliary information in the video frame, and send the portrait auxiliary information to other camera devices in the camera device. And based on the face detection result, obtain the third video captured by the target camera device, and send the correspondence between the face information and the third video to the video recording device for storage. The other camera devices perform portrait auxiliary detection on the captured video frame in response to the received portrait auxiliary information, and based on the face detection result and the portrait auxiliary detection result, obtain the third video captured by the other camera devices, and send the correspondence between the face information and the third video to the video recording device for storage;

[0192] Among them, the shooting start time of the third video captured by the target camera device is the time when the target camera device detects the face information from the video frame, and the shooting end time of the third video is the time when the target camera device fails to detect the face information from the video frame; the shooting start time of the third video captured by the other camera devices is the time when the other camera devices detect the face information or the portrait auxiliary information from the video frame, and the shooting end time of the third video is the time when the other camera devices fail to detect the face information and the portrait auxiliary information from the video frame.

[0193] In some embodiments, the intelligent door lock, the camera device and the video recording device join the same multicast group; the routing device corresponding to the multicast group maintains the correspondence between the identification information of the device and the interface; the routing device also maintains the topological relationship between the intelligent door locks;

[0194] The intelligent door lock specifically executes:

[0195] When detecting the face information from the video frame, send a first IGMP join message to the routing device according to the communication address of the multicast group, and the first IGMP join message includes the face information;

[0196] The routing device executes:

[0197] When determining that the first IGMP join message also includes indication information for indicating that the intelligent door lock has detected face information, determine the neighbor intelligent door lock corresponding to the intelligent door lock according to the topological relationship, and send the first IGMP join message to the neighbor intelligent door lock through the interface corresponding to the neighbor intelligent door lock;

[0198] The neighbor intelligent door lock specifically performs:

[0199] In response to the received first IGMP join message, call the onboard camera to take a video;

[0200] The intelligent door lock specifically performs:

[0201] When it is detected that the intelligent door lock has been unlocked, send a second IGMP join message to the routing device according to the communication address of the multicast group, and the second IGMP join message includes the face information;

[0202] The routing device also performs:

[0203] When it is determined that the second IGMP join message also includes indication information for indicating that the intelligent door lock has been unlocked, send the second IGMP join message to the neighbor intelligent door lock through the interface corresponding to the neighbor intelligent door lock; and send the second IGMP join message to the camera device through the interface corresponding to the camera device deployed in the room.

[0204] The neighbor intelligent door lock specifically performs:

[0205] In response to the received second IGMP join message, obtain the second video captured by the neighbor intelligent door lock, and send the correspondence between the face information and the second video to the video recording device for storage;

[0206] The camera device specifically performs:

[0207] In response to the received second IGMP join message, perform face detection on the captured video frames, and based on the face detection result, obtain the third video captured by the camera device, and send the correspondence between the face information and the third video to the video recording device for storage.

[0208] In some embodiments, the intelligent door lock also performs:

[0209] When it is detected that the intelligent door lock is unlocked from the inside, send a third IGMP join message to the routing device according to the communication address of the multicast group, and the third IGMP join message includes the face information;

[0210] The routing device also performs:

[0211] When it is determined that the third IGMP join message further includes indication information for instructing the smart door lock to unlock from the inside, according to the topological relationship, determine the path smart door lock corresponding to the smart door lock, and send the third IGMP message to the path smart door lock through the interface corresponding to the path smart door lock; and determine the arrangement order of the path smart door locks corresponding to the smart door lock, and send a reminder message including the arrangement order to the first path smart door lock through the interface corresponding to the first path smart door lock;

[0212] The path smart door lock executes:

[0213] Store the face information;

[0214] The first path smart door lock executes:

[0215] In response to the received reminder message, call the mounted camera to take a video, perform face detection on the captured video frames, based on the face detection result, obtain the fourth video captured by the first path smart door lock, and send the correspondence between the face information and the fourth video to the video recording device for storage. When the face information is not detected from the video frames, send the reminder message to the next smart door lock corresponding to the first path smart door lock;

[0216] Wherein, the start time of shooting the fourth video is the time when the first path smart door lock detects the face information from the video frames, and the end time of shooting the fourth video is the time when the first path smart door lock does not detect the face information from the video frames.

[0217] In some embodiments, when the path smart door lock receives the reminder message, it switches from the sleep state to the running state to call the mounted camera to take a video.

[0218] In some embodiments, the correspondence between the device information and the interface is created by the routing device according to the device information of the devices included in the IGMP join messages sent by the devices in the multicast group and the interfaces in the routing device for receiving the IGMP join messages.

[0219] For the device embodiments and system embodiments, they basically correspond to the method embodiments. Therefore, for the relevant parts, please refer to the partial descriptions of the method embodiments. The device embodiments and system embodiments described above are merely illustrative. The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical modules, that is, they may be located in one place or distributed to multiple network modules. Some or all of the modules can be selected according to actual needs to achieve the purpose of the technical solution of this application.

[0220] The systems, devices, modules or units illustrated in the above embodiments can be specifically implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer, and the specific form of the computer can be a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email transceiver device, a game console, a tablet computer, a wearable device or a combination of any several of these devices.

[0221] In a typical configuration, a computer includes one or more processors (CPUs), an input / output interface, a network interface, and memory.

[0222] The memory may include non-permanent memory in the computer-readable medium, in the form of random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash memory (flash RAM). The memory is an example of a computer-readable medium.

[0223] The computer-readable medium includes permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. The information can be computer-readable instructions, data structures, program modules or other data. Examples of the storage media of a computer include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette tapes, disk storage, quantum memory, graphene-based storage media or other magnetic storage devices, or any other non-transmission media that can be used to store information accessible by a computing device. As defined herein, the computer-readable medium does not include transitory computer-readable media, such as modulated data signals and carrier waves.

[0224] It should be noted that the term "comprise", "include" or any other variant thereof is intended to cover non-exclusive inclusion, such that a process, method, commodity or device comprising a series of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, commodity or device. Without further limitation, an element defined by the phrase "comprising an..." does not exclude the presence of additional identical elements in the process, method, commodity or device comprising said element.

[0225] The above describes specific embodiments of the present application. Other embodiments are within the scope of the present application. In some cases, the actions or steps recited in the present application may be performed in a different order than in the embodiments and still achieve the desired result. Additionally, the processes depicted in the drawings do not necessarily require the specific order or sequential order shown to achieve the desired result. In certain embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0226] The terms used in one or more embodiments of the present application are for the purpose of describing specific embodiments only and are not intended to limit one or more embodiments of the present application. The singular forms "a", "the" and "said" are also intended to include the plural forms unless the context clearly dictates otherwise. The term "and / or" refers to and encompasses any and all possible combinations of one or more of the associated listed items.

[0227] The description of the terms "an embodiment", "some embodiments", "example", "specific example" or "a mode of implementation" etc. used in one or more embodiments of the present application means that the specific features or characteristics described in connection with the embodiment are included in at least one embodiment of the present application. The schematic descriptions of these terms do not necessarily refer to the same embodiment. Moreover, the specific features or characteristics described can be combined in a suitable manner in one or more embodiments of the present application. In addition, different embodiments and the specific features or characteristics in different embodiments can be combined without contradiction.

[0228] It should be understood that although the terms first, second, third, etc. may be used in one or more embodiments of the present application to describe various information, such information should not be limited to these terms. These terms are only used to distinguish information of the same type from each other. For example, without departing from the scope of one or more embodiments of the present application, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "when" or "upon" or "in response to determining".

[0229] The above are only the preferred embodiments of one or more embodiments of the present application, and are not intended to limit one or more embodiments of the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of one or more embodiments of the present application shall be included within the scope of protection of one or more embodiments of the present application.

[0230] The user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the present application are all information and data authorized by the user or fully authorized by all parties. The collection, use, and processing of relevant data need to comply with the relevant laws, regulations, and standards of relevant countries and regions, and corresponding operation entrances are provided for users to choose to authorize or refuse.

Claims

1. A video recording method based on an intelligent door lock, which is applied to the intelligent door lock; the intelligent door lock, the camera device and the video recording device are joined to the same multicast group; the routing device corresponding to the multicast group maintains the corresponding relationship between the identification information of the device and the interface; The routing device also maintains the topological relationship between smart door locks; the method includes: Invoking the onboard camera to perform video shooting and performing face detection on the captured video frames; When face information is detected from the video frames, sending a first message containing the face information to a neighboring smart door lock corresponding to the smart door lock, so that the neighboring smart door lock invokes the onboard camera to perform video shooting in response to the received first message; When it is detected that the smart door lock has been unlocked, obtaining a first video captured by the smart door lock and sending the correspondence between the face information and the first video to a video recording device deployed in the room corresponding to the smart door lock for storage; and sending a second message to the neighboring smart door lock, so that the neighboring smart door lock obtains a second video captured by the neighboring smart door lock in response to the received first message and sends the correspondence between the face information and the second video to the video recording device for storage; and sending a third message containing the face information to a camera device deployed in the room, so that the camera device performs face detection on the captured video frames in response to the received third message, obtains a third video captured by the camera device based on the face detection result, and sends the correspondence between the face information and the third video to the video recording device for storage; wherein, the starting moment of shooting the first video is the moment when the smart door lock detects the face information from the video frames, and the ending moment of shooting the first video is the moment when the smart door lock detects that the smart door lock has been unlocked; the starting moment of shooting the second video is the moment when the neighboring smart door lock receives the first message, and the ending moment of shooting the second video is the moment when the neighboring smart door lock receives the second message; the starting moment of shooting the third video is the moment when the camera device detects the face information from the video frames, and the ending moment of shooting the third video is the moment when the camera device does not detect the face information from the video frames; When it is detected that the intelligent door lock is unlocked from the inside, a third IGMP join message is sent to the routing device according to the communication address of the multicast group. The third IGMP join message includes the face information. When the routing device determines that the third IGMP join message also includes indication information for indicating that the intelligent door lock is unlocked from the inside, according to the topological relationship, a path intelligent door lock corresponding to the intelligent door lock is determined, and the third IGMP message is sent to the path intelligent door lock through the interface corresponding to the path intelligent door lock, so that the path intelligent door lock stores the face information; and when the routing device determines that the third IGMP join message also includes indication information for indicating that the intelligent door lock is unlocked from the inside, according to the topological relationship, the arrangement order of the path intelligent door locks corresponding to the intelligent door lock is determined, and a reminder message including the arrangement order is sent to the first path intelligent door lock through the interface corresponding to the first path intelligent door lock. In response to the received reminder message, the first path intelligent door lock calls the mounted camera to perform video shooting, performs face detection on the captured video frames, obtains a fourth video captured by the first path intelligent door lock based on the face detection result, and sends the correspondence between the face information and the fourth video to the video recording device for storage. When the face information is not detected from the video frames, a reminder message including the arrangement order is sent to the second path intelligent door lock corresponding to the first path intelligent door lock. In response to the received reminder message, the second path intelligent door lock calls the mounted camera to perform video shooting, performs face detection on the captured video frames, obtains a fourth video captured by the second path intelligent door lock based on the face detection result, and sends the correspondence between the face information and the fourth video to the video recording device for storage. When the face information is not detected from the video frames, a reminder message including the arrangement order is sent to the third intelligent door lock corresponding to the second path intelligent door lock, and so on, until all the path intelligent door locks corresponding to the intelligent door lock have completed the shooting of the fourth video; wherein, for the fourth video captured by each path intelligent door lock, the shooting start time is the time when the face information is detected from the video frames by the path intelligent door lock, and the shooting end time is the time when the face information is not detected from the video frames by the path intelligent door lock.

2. The method according to claim 1, wherein the video recording device is configured to determine the first video, the second video and the third video stored corresponding to the face information in the video playback request when a video playback request is obtained, and play the first video and the second video simultaneously, and after the playing is completed, continue to play the third video.

3. The method according to claim 1, wherein the calling the mounted camera to perform video shooting includes: Calling the mounted camera to perform real-time video shooting; Alternatively, when it is detected that the user enters the detection range of the smart door lock, call the onboard camera to take a video.

4. The method according to claim 1, wherein the imaging device is used for real-time video shooting and sends the captured video to the recording device for storage; Sending a third message containing the face information to an imaging device deployed in the room corresponding to the smart door lock, so that in response to the received third message, the imaging device performs face detection on the captured video frames, and based on the face detection result, obtains a third video captured by the imaging device, and sends the correspondence between the face information and the third video to the recording device for storage, includes: Sending a third message containing the face information to an imaging device deployed in the room corresponding to the smart door lock, so that in response to the received third message, the imaging device performs face detection on the captured video frames, and based on the face detection result, determines the start time and end time of shooting of the third video captured by the imaging device, and sends the correspondence between the face information and the start time and end time of shooting of the third video to the recording device for storage.

5. The method according to claim 1, wherein sending a third message containing the face information to an imaging device deployed in the room, so that in response to the received third message, the imaging device performs face detection on the captured video frames, and based on the face detection result, obtains a third video captured by the imaging device, and sends the correspondence between the face information and the third video to the recording device for storage, includes: Sending a third message containing the face information to an imaging device deployed in the room, so that in response to the received third message, the imaging device performs face detection on the captured video frames. When the target imaging device in the imaging device detects the face information from the video frames and does not obtain the portrait auxiliary information corresponding to the face information, obtain the portrait auxiliary information in the video frames, and send the portrait auxiliary information to other imaging devices in the imaging device, and based on the face detection result, obtain a third video captured by the target imaging device, and send the correspondence between the face information and the third video to the recording device for storage. The other imaging devices perform portrait auxiliary detection on the captured video frames in response to the received portrait auxiliary information, and based on the face detection result and the portrait auxiliary detection result, obtain a third video captured by the other imaging devices, and send the correspondence between the face information and the third video to the recording device for storage; Among them, the starting moment of shooting the third video captured by the target camera device is the moment when the target camera device detects the face information from the video frame, and the ending moment of shooting the third video is the moment when the target camera device fails to detect the face information from the video frame; the starting moment of shooting the third video captured by the other camera device is the moment when the other camera device detects the face information or the portrait auxiliary information from the video frame, and the ending moment of shooting the third video is the moment when the other camera device fails to detect the face information and the portrait auxiliary information from the video frame.

6. The method according to claim 1, when detecting face information from the video frame, sending a first message including the face information to a neighbor smart lock corresponding to the smart lock, so that the neighbor smart lock, in response to the received first message, calls the mounted camera for video shooting, includes: When detecting the face information from the video frame, according to the communication address of the multicast group, sending a first IGMP join message to the routing device, the first IGMP join message including the face information, and when the routing device determines that the first IGMP join message further includes indication information for indicating that the smart lock detects face information, determining, according to the topology relationship, the neighbor smart lock corresponding to the smart lock, and sending the first IGMP join message to the neighbor smart lock through the interface corresponding to the neighbor smart lock, so that the neighbor smart lock, in response to the received first IGMP join message, calls the mounted camera for video shooting; When detecting that the smart lock has been unlocked, sending a second message to the neighbor smart lock, so that the neighbor smart lock, in response to the received first message, obtains the second video captured by the neighbor smart lock, and sends the correspondence between the face information and the second video to the video recording device for storage; and, sending a third message including the face information to the camera device deployed in the room, so that the camera device, in response to the received third message, performs face detection on the captured video frame, obtains the third video captured by the camera device based on the face detection result, and sends the correspondence between the face information and the third video to the video recording device for storage, includes: When it is detected that the intelligent door lock has been unlocked, according to the communication address of the multicast group, a second IGMP join message is sent to the routing device, and the second IGMP join message includes the face information. When the routing device determines that the second IGMP join message also includes indication information for indicating that the intelligent door lock has been unlocked, the second IGMP join message is sent to the neighboring intelligent door lock through the interface corresponding to the neighboring intelligent door lock, so that the neighboring intelligent door lock, in response to the received second IGMP join message, acquires a second video captured by the neighboring intelligent door lock, and sends the correspondence between the face information and the second video to the video recording device for storage; and when the routing device determines that the second IGMP join message also includes indication information for indicating that the intelligent door lock has been unlocked, the second IGMP join message is sent to the camera device deployed in the room through the interface corresponding to the camera device, so that the camera device, in response to the received second IGMP join message, performs face detection on the captured video frames, based on the face detection result, acquires a third video captured by the camera device, and sends the correspondence between the face information and the third video to the video recording device for storage.

7. The method according to claim 1, when the path intelligent door lock receives the reminder message, it switches from the sleep state to the running state to call the equipped camera for video shooting.

8. A video system based on an intelligent door lock, the system comprising an intelligent door lock, a neighbor intelligent door lock and a path intelligent door lock corresponding to the intelligent door lock, a camera device and a video recording device deployed in a room corresponding to the intelligent door lock; the intelligent door lock, the camera device and the video recording device are joined to the same multicast group; a routing device corresponding to the multicast group maintains a correspondence between the identification information of the devices and the interfaces; The routing device also maintains the topological relationship between intelligent door locks; wherein: The intelligent door lock calls the equipped camera for video shooting and performs face detection on the captured video frames; When the intelligent door lock detects face information from the video frames, it sends a first message including the face information to the neighboring intelligent door lock corresponding to the intelligent door lock; The neighboring intelligent door lock, in response to the received first message, calls the equipped camera for video shooting; When the intelligent door lock detects that the intelligent door lock has been unlocked, it acquires a first video captured by the intelligent door lock, and sends the correspondence between the face information and the first video to the video recording device deployed in the room corresponding to the intelligent door lock for storage; and sends a second message to the neighboring intelligent door lock; and sends a third message including the face information to the camera device deployed in the room; The neighboring intelligent door lock, in response to the received first message, acquires a second video captured by the neighboring intelligent door lock, and sends the correspondence between the face information and the second video to the video recording device for storage; The camera device, in response to the received third message, performs face detection on the captured video frames, based on the face detection result, acquires a third video captured by the camera device, and sends the correspondence between the face information and the third video to the video recording device for storage; Among them, the starting moment of shooting the first video is the moment when the intelligent door lock detects the face information from the video frame, and the ending moment of shooting the first video is the moment when the intelligent door lock detects that the intelligent door lock has been unlocked; the starting moment of shooting the second video is the moment when the neighbor intelligent door lock receives the first message, and the ending moment of shooting the second video is the moment when the neighbor intelligent door lock receives the second message; the starting moment of shooting the third video is the moment when the camera device detects the face information from the video frame, and the ending moment of shooting the third video is the moment when the camera device does not detect the face information from the video frame; When the intelligent door lock detects that the intelligent door lock is unlocked from the inside, according to the communication address of the multicast group, it sends a third IGMP join message to the routing device, and the third IGMP join message includes the face information; When the routing device determines that the third IGMP join message also includes indication information for indicating that the intelligent door lock is unlocked from the inside, according to the topological relationship, it determines the path intelligent door lock corresponding to the intelligent door lock, and sends the third IGMP message to the path intelligent door lock through the interface corresponding to the path intelligent door lock; and, determines the arrangement order of the path intelligent door locks corresponding to the intelligent door lock, and sends a reminder message including the arrangement order to the first path intelligent door lock through the interface corresponding to the first path intelligent door lock; The path intelligent door lock stores the face information; In response to the received reminder message, the first path intelligent door lock calls the mounted camera to take a video, performs face detection on the captured video frame, based on the face detection result, obtains the fourth video captured by the first path intelligent door lock, and sends the correspondence between the face information and the fourth video to the video recording device for storage. When the face information is not detected from the video frame, it sends a reminder message including the arrangement order to the second path intelligent door lock corresponding to the first path intelligent door lock; In response to the received reminder message, the second path intelligent door lock calls the mounted camera to take a video, performs face detection on the captured video frame, based on the face detection result, obtains the fourth video captured by the second path intelligent door lock, and sends the correspondence between the face information and the fourth video to the video recording device for storage. When the face information is not detected from the video frame, it sends a reminder message including the arrangement order to the third intelligent door lock corresponding to the second path intelligent door lock; And so on, until all the path intelligent door locks corresponding to the intelligent door lock have completed the shooting of the fourth video; Among them, for the fourth video captured by each path intelligent door lock, the starting moment of shooting is the moment when the path intelligent door lock detects the face information from the video frame, and the ending moment of shooting is the moment when the path intelligent door lock fails to detect the face information from the video frame.

9. The system according to claim 8, when the intelligent door lock detects face information from the video frame, sending a first message including the face information to a neighbor intelligent door lock corresponding to the intelligent door lock, includes: When the intelligent door lock detects the face information from the video frame, according to the communication address of the multicast group, sending a first IGMP join message to the routing device, the first IGMP join message including the face information; When the routing device determines that the first IGMP join message further includes indication information for indicating that the intelligent door lock has detected face information, according to the topological relationship, determining a neighbor intelligent door lock corresponding to the intelligent door lock, and sending the first IGMP join message to the neighbor intelligent door lock through an interface corresponding to the neighbor intelligent door lock; When the intelligent door lock detects that the intelligent door lock has been unlocked, sending a second message to the neighbor intelligent door lock; And, sending a third message including the face information to a camera device deployed in the room, includes: When the intelligent door lock detects that the intelligent door lock has been unlocked, according to the communication address of the multicast group, sending a second IGMP join message to the routing device, the second IGMP join message including the face information; When the routing device determines that the second IGMP join message further includes indication information for indicating that the intelligent door lock has been unlocked, sending the second IGMP join message to the neighbor intelligent door lock through an interface corresponding to the neighbor intelligent door lock; and sending the second IGMP join message to the camera device through an interface corresponding to the camera device deployed in the room.

Images