A low-power video linkage recording device for a door lock

Abstract

The application provides a door lock low-power consumption video linkage recording device, and belongs to the technical field of smart home. The device comprises a door lock main body and a door lock companion. Through the linkage of a heterogeneous control module, a layered wake-up mechanism and a three-level storage unit, and the design of business sharing, the energy consumption of the door lock main body is significantly reduced under the premise of guaranteeing the video recording quality and transmission efficiency. The device has a reasonable structure design, realizes the balance between the door lock endurance and the video monitoring function, and is suitable for various battery-powered smart door lock scenes.

Description

Technical Field

[0001] This invention relates to the field of smart home technology, and in particular to a low-power video linkage recording device for door locks. Background Technology

[0002] With the popularization of smart homes, smart door locks with video recording functions have been widely used. However, since smart door locks are usually battery-powered, and the size of batteries is limited by the door lock structure, battery life has become a key issue restricting their development.

[0003] In the existing technology, the low power optimization solutions in the industry mostly focus on the selection of WiFi modules and main control chips, attempting to reduce energy consumption by selecting low power devices. However, they do not fundamentally change the power generation logic of door lock operation. That is, video recording involves multiple high power consumption links such as image acquisition, data processing, and WiFi transmission, which leads to a continuous reduction in door lock battery life.

[0004] Other solutions propose WiFi relay systems to achieve low-power wake-up through the linkage between the indoor and outdoor units. However, these solutions only address signal transmission distance and basic wake-up issues, without optimizing for video recording scenarios. On the one hand, they do not control the number of wake-ups and transmission duration of the WiFi module, and frequent wake-ups and long transmission times still consume a lot of power. On the other hand, they do not solve the power consumption problem caused by the high load operation of the main control chip during video processing, and cannot meet the low-power requirements of smart door lock video recording scenarios.

[0005] Therefore, this invention proposes a low-power video linkage recording device for door locks. Summary of the Invention

[0006] This invention provides a low-power video linkage recording device for door locks to solve the aforementioned technical problems.

[0007] This invention provides a low-power video linkage recording device for door locks, comprising: a door lock body and a door lock companion wirelessly connected to the door lock body;

[0008] The door lock body includes:

[0009] Heterogeneous control module: includes a main control unit, an auxiliary control unit, and a low-power control unit. The main control unit integrates a low-power storage medium to support fast startup and fast recovery mechanisms. The low-power control unit is integrated into the communication module for signal detection and wake-up control in low-power mode. The communication module includes a first dual-band WiFi module and a first Bluetooth module.

[0010] Sensing module: includes at least one motion sensor for detecting motion signals of objects around the door lock;

[0011] A first storage unit and a second storage unit, wherein the first storage unit is a low-power storage medium used to temporarily store unprocessed image data; and the second storage unit is used to store optimized and encoded video data.

[0012] First dual-band WiFi module: used to establish wireless connection with door lock companion and router;

[0013] First Bluetooth module: used to establish a connection with the door lock companion, and when the door lock body establishes a connection with the door lock companion, the connection priority of the first Bluetooth module is higher than the connection priority of the first dual-band WiFi module;

[0014] Door magnetic sensor: Used to detect the open / closed status of the door;

[0015] The door lock companion includes:

[0016] The second dual-band WiFi module is used to establish a wireless connection with the door lock body and the router.

[0017] Second Bluetooth module: used to establish a low-power connection with the door lock body and keep heartbeat active;

[0018] Third storage unit: used to back up the video data transmitted by the main body of the door lock;

[0019] Data forwarding module: used to realize signaling interaction and video data relay between the door lock body and the cloud;

[0020] Voice broadcast module: Used to execute message broadcasting services triggered by the APP;

[0021] After powering on, both the door lock body and the door lock companion automatically connect to the router. The door lock body prioritizes establishing a heartbeat keep-alive connection with the door lock companion through the first Bluetooth module and the second Bluetooth module. When Bluetooth is unavailable, it switches to WiFi connection.

[0022] The low-power control unit reads the motion signal from the sensing module in real time. After triggering the wake-up mechanism, the main body of the door lock completes image data acquisition, temporary storage, processing, encoding and transmission according to preset logic, while the door lock companion shares the cloud keep-alive, video backup and message broadcast services.

[0023] Preferably, the low-power storage medium includes low-power DDR or PSRAM.

[0024] Preferably, the motion sensor includes at least one of an image sensor, a TOF sensor, a radar sensor, or a PIR sensor; if it is an image sensor, it only performs power-on detection on a preset area in the vertical direction of the image, wherein the preset area in the vertical direction of the image is n times the vertical direction, and n is a value greater than 0 and less than or equal to 1.

[0025] Preferably, both the first dual-band WiFi module and the second dual-band WiFi module support the 802.11a / b / g / n / ac protocol, and the door lock companion uses 2T2R WiFi, 2.4G frequency band and / or 5G frequency band to communicate with the door lock body and the router.

[0026] Preferably, when the router cannot connect to the external network, the video data is temporarily stored in the third storage unit and can be retrieved through the APP after the network is restored.

[0027] Preferably, the auxiliary control unit of the door lock body is further used to determine the target recognition confidence weight based on the high frame rate image data of the image sensor after being woken up by the low power control unit, combined with the historical target recognition results and the current motion sensor association state.

[0028] The auxiliary control unit of the door lock body is also used to activate the computing unit of its own part only as needed, accelerate image feature convergence by using high frame rate data, correct the target recognition calculation result by the confidence weight, and confirm the existence of a target object when the confidence of the result exceeds a preset threshold.

[0029] The auxiliary control unit of the door lock body is also used to dynamically adjust the preset frame rate according to the motion characteristics of the target object and the remaining capacity of the first storage unit, and directly store the high frame rate image data into the first storage unit according to the dynamically adjusted preset frame rate. After each frame of data is stored, the auxiliary control unit immediately enters a deep sleep state, and the first storage unit keeps low power consumption to maintain data integrity.

[0030] When the first storage unit is full, the main control unit processes the image, compresses it, and saves it to the second storage unit. When the second storage unit is full, the image is then transferred to the third storage unit for storage.

[0031] Preferably, after the door lock body and the door lock companion are powered on, they are automatically connected to the router. The door lock body initiates a Bluetooth connection request first and establishes a heartbeat keep-alive connection with the door lock companion. At the same time, the door lock body establishes a sleep connection channel with the second dual-band WiFi module of the door lock companion through the first dual-band WiFi module, and completes WiFi connection key pre-negotiation, link parameter configuration and authentication. After the configuration is completed, the WiFi channel enters a low-power sleep state.

[0032] The door lock body monitors the Bluetooth connection status in real time and simultaneously collects the Bluetooth signal strength RSSI and the packet loss rate Dx of three consecutive heartbeat signals;

[0033] When RSSI < -80dBm and Dx ≥ 0.3, it is determined that the Bluetooth connection is about to become unavailable, triggering the WiFi connection early activation process; the door lock body wakes up the dormant WiFi channel, quickly completes link activation based on the pre-negotiated key and parameters, and simultaneously verifies the WiFi connection stability;

[0034] If the Bluetooth connection is completely lost, the door lock body will directly switch to the activated and verified WiFi connection to continue maintaining heartbeat and data transmission without having to re-execute the WiFi connection negotiation and authentication process; if the Bluetooth connection is restored, it will switch back to the Bluetooth connection and the WiFi channel will re-enter the sleep state.

[0035] During the entire switching process, the auxiliary control unit of the door lock body only activates 1 / 5 of the computing unit to process connection status monitoring and switching control. After the switching is completed, it is powered down immediately. The first dual-band WiFi module only maintains the necessary transmission power consumption after activation.

[0036] Preferably, the door lock companion is also used to store shared services. When the door lock body detects an external trigger command related to the shared service, it sends a reminder based on the service result matching the external trigger command retrieved from the stored content by the door lock companion.

[0037] Specifically, when the external trigger command is a command to view local videos, the system controls the viewing of only the companion's videos;

[0038] When the door lock companion is awakened, the speaker controlling the main door lock body goes into sleep mode;

[0039] The door lock companion is also used to store data related to hardware-sharing operations.

[0040] Preferably, the door lock companion is also used to store hardware-shared services. When the main door lock detects an external trigger command related to the shared service, the door lock companion retrieves the service result matching the external trigger command from the stored content and issues a reminder. Specifically, when the external trigger command is a command to view local video, the system controls the viewing of only the companion video. When the door lock companion is woken up, the system controls the main door lock's speaker to go into sleep mode, and the door lock companion's speaker takes over the function.

[0041] Compared with the prior art, the beneficial effects of this application are as follows:

[0042] By constructing a linkage architecture between the main lock body and the long-term lock companion, and using heterogeneous control modules to achieve layered low-power operation, combined with multi-module collaboration and business sharing mechanisms, the core power consumption of the main lock body is effectively reduced, while ensuring the stability and reliability of video recording and data transmission. Compared with the existing single lock solution, the standby power consumption of the main lock body is reduced to ≤50μA, the battery life is improved by more than 60%, and efficient interaction between signaling and data is achieved, avoiding the battery life loss caused by the main lock body independently bearing high-power business.

[0043] Other features and advantages of the invention will be set forth in the following description, and will be apparent in part from the description, or may be learned by practicing the invention. The objects and other advantages of the invention may be realized and obtained by means of the structures particularly pointed out in the written description and the accompanying drawings.

[0044] The technical solution of the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. Attached Figure Description

[0045] The accompanying drawings are provided to further illustrate the invention and form part of the specification. They are used in conjunction with embodiments of the invention to explain the invention and do not constitute a limitation thereof. In the drawings:

[0046] Figure 1 This is a flowchart of a low-power video linkage recording device for door locks according to an embodiment of the present invention. Detailed Implementation

[0047] The preferred embodiments of the present invention will be described below with reference to the accompanying drawings. It should be understood that the preferred embodiments described herein are for illustration and explanation only and are not intended to limit the present invention.

[0048] This invention provides a low-power video linkage recording device for door locks, comprising: a door lock body and a door lock companion wirelessly connected to the door lock body;

[0049] The door lock body includes:

[0050] Heterogeneous control module: includes a main control unit, an auxiliary control unit, and a low-power control unit. The main control unit integrates a low-power storage medium to support fast startup and fast recovery mechanisms. The low-power control unit is integrated into the communication module for signal detection and wake-up control in low-power mode. The communication module includes a first dual-band WiFi module and a first Bluetooth module.

[0051] Sensing module: includes at least one motion sensor for detecting motion signals of objects around the door lock;

[0052] A first storage unit and a second storage unit, wherein the first storage unit is a low-power storage medium used to temporarily store unprocessed image data; and the second storage unit is used to store optimized and encoded video data.

[0053] First dual-band WiFi module: used to establish wireless connection with door lock companion and router;

[0054] First Bluetooth module: used to establish a connection with the door lock companion, and when the door lock body establishes a connection with the door lock companion, the connection priority of the first Bluetooth module is higher than the connection priority of the first dual-band WiFi module;

[0055] Door magnetic sensor: Used to detect the open / closed status of the door;

[0056] The door lock companion includes:

[0057] The second dual-band WiFi module is used to establish a wireless connection with the door lock body and the router.

[0058] Second Bluetooth module: used to establish a low-power connection with the door lock body and keep heartbeat active;

[0059] Third storage unit: used to back up the video data transmitted by the main body of the door lock;

[0060] Data forwarding module: used to realize signaling interaction and video data relay between the door lock body and the cloud;

[0061] Voice broadcast module: Used to execute message broadcasting services triggered by the APP;

[0062] After powering on, both the door lock body and the door lock companion automatically connect to the router. The door lock body prioritizes establishing a heartbeat keep-alive connection with the door lock companion through the first Bluetooth module and the second Bluetooth module. When Bluetooth is unavailable, it switches to WiFi connection.

[0063] The low-power control unit reads the motion signal from the sensing module in real time. After triggering the wake-up mechanism, the main body of the door lock completes image data acquisition, temporary storage, processing, encoding and transmission according to preset logic, while the door lock companion shares the cloud keep-alive, video backup and message broadcast services.

[0064] Preferably, the low-power storage medium includes low-power DDR or PSRAM.

[0065] Preferably, the motion sensor includes at least one of an image sensor, a TOF sensor, a radar sensor, or a PIR sensor; if it is an image sensor, it only performs power-on detection on a preset area in the vertical direction of the image, wherein the preset area in the vertical direction of the image is n times the vertical direction, and n is a value greater than 0 and less than or equal to 1.

[0066] Preferably, both the first dual-band WiFi module and the second dual-band WiFi module support the 802.11a / b / g / n / ac protocol, and the door lock companion uses 2T2R WiFi, 2.4G frequency band and / or 5G frequency band to communicate with the door lock body and the router.

[0067] Preferably, when the router cannot connect to the external network, the video data is temporarily stored in the third storage unit and can be retrieved through the APP after the network is restored.

[0068] Preferably, the door lock companion is also used to store shared services. When the door lock body detects an external trigger command related to the shared service, it sends a reminder based on the service result matching the external trigger command retrieved from the stored content by the door lock companion.

[0069] Specifically, when the external trigger command is a command to view local videos, the system controls the viewing of only the companion's videos;

[0070] When the door lock companion is awakened, the speaker controlling the main door lock body goes into sleep mode;

[0071] The door lock companion is also used to store data related to hardware-sharing operations.

[0072] In this embodiment, the main body of the door lock refers to the core hardware of a smart door lock with video acquisition, data processing, and low-power control functions. It integrates heterogeneous control, sensing, storage, and communication modules, is battery powered, and is suitable for home door lock installation scenarios. For example, a lock body structure with dimensions of 300mm×80mm×50mm is selected, with a built-in 5000mAh lithium polymer battery, supporting standby and working mode switching, and a standby current ≤50μA.

[0073] A door lock companion refers to a long-powered auxiliary device that wirelessly communicates with the main door lock. It performs data backup, workload sharing, and data forwarding functions, providing low-power linkage support for the main door lock. For example, a cuboid device with dimensions of 120mm × 80mm × 30mm, powered by a 5V / 2A DC power supply, operates continuously online with a standby power consumption ≤100μA.

[0074] In this embodiment, if a heterogeneous multi-core chip integrating ARM Cortex-A53 (main control unit), ARM Cortex-M4 (auxiliary control unit), and ESP32-C3 (low-power control unit) is selected, the main control unit is responsible for high-intensity data processing, the auxiliary control unit is responsible for low-load identification and storage control, and the low-power control unit is responsible for signal detection and wake-up triggering. The three communicate through an internal bus and support sleep-wake-up coordination.

[0075] The main control unit is the core computing unit in the heterogeneous control module. It integrates low-power storage media and supports fast startup and fast recovery mechanisms. It is used to perform high-intensity calculations such as image optimization and video encoding. For example, the ARM Cortex-A53 main control unit integrates 1GB of low-power storage media, has a fast wake-up time of ≤10ms, and its operating frequency can be dynamically adjusted (500MHz-1.2GHz). The frequency is 1.2GHz under high load and automatically drops to 500MHz under low load.

[0076] The auxiliary control unit is a low-computing-power unit in the heterogeneous control module, used for low-load target recognition, parameter acquisition, storage, and control. It can start up and go into sleep mode quickly to reduce power consumption. For example, the ARM Cortex-M4 auxiliary control unit has an operating frequency of 80MHz, a startup time of ≤2ms, and a sleep current of ≤5μA. It only wakes up when target recognition or parameter acquisition is required.

[0077] The low-power control unit is an ultra-low-power control unit integrated within the dual-band WiFi module. It is used for signal detection and wake-up command triggering in standby mode, ensuring continuous low-power operation. For example, the ESP32-C3 low-power control unit, integrated into the first dual-band WiFi module, has a standby current of ≤19μA, supports real-time reading of sensor data, and has a current of ≤50μA when triggering wake-up logic.

[0078] Low-power storage media refers to low-power data storage carriers adapted to the main control unit, supporting fast read / write and low standby power consumption, providing support for data temporary storage and processing. 1GB of low-power PSRAM is selected, with standby power consumption ≤10μA and read / write speed ≥100MB / s, meeting the requirements for fast temporary storage of image data.

[0079] The sensing module, for example, uses a combination of a 1080P image sensor, a PIR sensor, and a TOF sensor. The image sensor is responsible for collecting visual data, the PIR sensor detects infrared signals from the human body, and the TOF sensor measures the distance to the target. The data from these three sensors are transmitted to a low-power control unit via an I2C bus.

[0080] The first storage unit can be a 1GB low-power PSRAM integrated with the main control unit, with 800MB of space specifically allocated as the first storage unit, used only to temporarily store unprocessed raw image data, avoiding frequent read and write of high-power storage.

[0081] The second storage unit can be a 16GBeMMCFlash chip with a read / write speed of ≥200MB / s, a standby power consumption of ≤5μA, and can store approximately 10 hours of 1080P encoded video data.

[0082] The first dual-band WiFi module uses the RTL8822CS dual-band WiFi module, which supports the 802.11a / b / g / n / ac protocol, with a 2.4G band speed of ≤300Mbps, a 5G band speed of ≤867Mbps, a standby current of ≤19μA, and an operating current of ≤200mA.

[0083] The door magnetic sensor uses the REED-16 reed switch door magnetic sensor, with an operating voltage of 3.3V and a standby current of ≤1μA. It outputs a high-level signal when the door is open and a low-level signal when the door is closed. The signal is transmitted to the auxiliary control unit through the GPIO port.

[0084] The second dual-band WiFi module uses the MT7921K dual-band WiFi module, which supports 802.11a / b / g / n / ac / ax protocols, 2T2R concurrent capability, 2.4G band speed ≤300Mbps, 5G band speed ≤2400Mbps, and continuous operating current ≤300mA.

[0085] The Bluetooth module used is the nRF52840 Bluetooth 5.2 module, with a standby current ≤2μA, a communication distance ≤10m, and supports the BLE protocol for transmitting heartbeat signals and short-range control commands.

[0086] The third storage unit uses a 64GB NVMe SSD with a read / write speed of ≥500MB / s, a continuous power consumption of ≤500mW, and can store approximately 40 hours of 1080P encoded video data.

[0087] The data forwarding module uses an ARM Cortex-A72 data forwarding module with an operating frequency of 1.5GHz. It supports the conversion between proprietary protocols and RTSP protocols and can simultaneously handle signaling forwarding and video relay with a forwarding latency of ≤100ms.

[0088] The voice broadcast module uses an ES8388 audio codec chip and a 4Ω / 3W speaker combination. It supports MP3 audio playback, has a playback power consumption of ≤300mW, and the volume can be adjusted via the APP. The broadcast distance is ≤5m.

[0089] Heartbeat keep-alive connection refers to the periodic low-power communication connection established between the door lock body and the door lock companion, used to confirm the online status of both parties and avoid frequent reconnection. For example, the door lock body first establishes heartbeat keep-alive with the door lock companion via Bluetooth module, sending a heartbeat data packet every 30 seconds. After receiving the data, the door lock companion replies with an acknowledgment signal. The power consumption of a single heartbeat communication is ≤5μA. If no heartbeat response is received for 3 consecutive times, the Bluetooth connection is determined to be unavailable, and the connection switches to WiFi heartbeat keep-alive.

[0090] The wake-up mechanism refers to the logic by which the low-power control unit triggers subsequent data acquisition and processing flows by reading motion signals from the sensing module. For example, the low-power control unit reads data from the PIR sensor and the image sensor in real time. When the PIR sensor detects a human infrared signal and the image sensor detects a moving area for two consecutive frames, a wake-up command is triggered. First, the first dual-band WiFi module is woken up for secondary confirmation. After confirming the existence of valid motion, the auxiliary control unit is then woken up. The wake-up process takes ≤500ms.

[0091] like Figure 1 As shown, the working principle is as follows:

[0092] When devices 1 and 2 are powered on sequentially, they will simultaneously connect to the router for network configuration. Device 1 will then detect device 2 on the network and automatically connect to its Wi-Fi network. Device 1 will prioritize attempting a 5G connection; if the signal strength is sufficient, it will not switch to 2.4G. If the signal strength is insufficient, it will switch to 2.4G and continue attempting to connect.

[0093] When someone approaches the door, CPU2 reads data from motion sensors, including but not limited to image sensors, TOF, radar, PIR, and other motion-detecting sensors, to distinguish whether an object has triggered the motion. Specifically, if an image sensor is used for motion detection, the image is divided into four parts from top to bottom, and only the middle two parts are powered on for detection to reduce power consumption and decrease false detections of motion from the ceiling and floor in the image.

[0094] If motion is triggered, the WIFI is woken up. The WIFI reads the sensor data for judgment, generally based on two consecutive frames. If a moving object is confirmed, CPU2 first configures the image sensor parameters to increase the frame rate, and then wakes up CPU1.

[0095] When CPU1 starts up, the high frame rate accelerates image convergence. A small part of the computing unit is called to determine whether there is a target object. If there is a moving object, the data is stored in the low-power storage unit 1 at a certain frame rate. Only storing without processing can reduce power consumption. After each frame of data is stored, the CPU is powered off, but the storage medium is not powered off.

[0096] When storage unit 1 is full, the CPU is woken up to perform one-time image data processing on the images in the storage unit, optimize the image effect, and perform video encoding. During video encoding, for scenes without motion, frame skipping is used to reduce the amount of encoded data. After video encoding is completed, the data is stored in storage unit 2.

[0097] When storage unit 2 is full or the object stays for a certain period of time, CPU1 / CPU is woken up to perform Wi-Fi data transmission. The data is transmitted first through a private protocol to establish a storage channel with device 2 and then transmitted to device 2 via the local area network. This implementation scheme has a faster transmission speed, thereby better reducing power consumption.

[0098] On the network, the door lock device prioritizes checking for the presence of a companion device. If a companion device is present, it attempts to establish a connection via Bluetooth and periodically performs heartbeats to keep the device alive. This reduces power consumption. If Bluetooth fails, it establishes a connection via Wi-Fi. This strategy is because Bluetooth consumes less power than Wi-Fi. Through this heartbeat mechanism, device 2 can report device 1's online information to the server more frequently and for longer periods, ensuring the device remains in normal working order. Furthermore, device 2 establishes a video channel with the cloud upon startup and maintains continuous liveness, allowing for the transmission of video data at any time, thus reducing the keep-alive workload of device 1 and further lowering its power consumption.

[0099] When a user views the video from Device 1 via a mobile app, because the door lock companion is always online, the signaling goes directly to Device 2, and Device 2 quickly wakes up Device 1. Device 1 does not need to establish a device path with the cloud; it sends video data directly to the cloud through Device 2 via real-time video data protocols such as RTSP, greatly reducing the latency of video appearing on the app.

[0100] Furthermore, Device 2 uses dual-band Wi-Fi with a concurrent connection capacity of 2T2R or higher. It can connect to both the door lock and the router via 2.4G / 5G. When connecting to the router, Device 2 will prioritize a 5G connection. If the signal strength is sufficient, it will not switch to 2.4G. If the signal strength is insufficient, it will switch to 2.4G and continue trying to connect. Prioritizing the speed of the local area network and the stable transmission of Device 2.

[0101] Device 2, the door lock companion, has a built-in storage unit 3. All door lock videos are stored internally within the door lock companion. Since the speed of a local area network is much faster than cloud storage, the data transmission time between Device 1 and Device 2 is significantly reduced. The reliable UDP protocol is chosen to ensure transmission speed, thus reducing the time Device 1 spends waking up to transmit via Wi-Fi. The combined use of storage units 1, 2, and 3 effectively reduces the time required for CPU and Wi-Fi transmission, thereby greatly reducing power consumption. This is because the main power consumption of low-power devices is in CPU and Wi-Fi transmission. Furthermore, if the home router cannot connect to the external network, the videos in the door lock companion can be viewed when the network is restored, ensuring no data loss.

[0102] Furthermore, the app can also set up message functionality, which is triggered when the door opens or closes. The original message playback solution involved the door lock playing the message, which meant the CPU would play it, increasing the door lock's power consumption. This new solution uses a companion player, reducing the time the door lock is used as a low-power device and thus lowering power consumption.

[0103] It should be noted that the main control unit is CPU0, the auxiliary control unit is CPU1, and the low-power control unit is CPU2.

[0104] In this embodiment, when the external trigger command is to view the local video, the system controls the viewing of only the companion video, which reduces power consumption. When the door lock companion is awakened, the door lock main body's speaker is put into sleep mode, and the companion replaces the bell, which further reduces power consumption.

[0105] The beneficial effects of the above technical solution are as follows: by constructing a linkage architecture between the main lock body and the long-term lock companion, and using heterogeneous control modules to achieve layered low-power operation, combined with multi-module collaboration and business sharing mechanisms, the core power consumption of the main lock body is effectively reduced, while ensuring the stability and reliability of video recording and data transmission. Compared with the existing single lock solution, the standby power consumption of the main lock body is reduced to ≤50μA, the battery life is improved by more than 60%, and efficient interaction between signaling and data is achieved, avoiding the battery life loss caused by the main lock body independently bearing high-power business.

[0106] The present invention provides a low-power video linkage recording device for a door lock. The auxiliary control unit of the door lock body is also used to determine the target recognition confidence weight based on the high frame rate image data of the image sensor after being woken up by the low-power control unit, combined with the historical target recognition results and the current motion sensor association state.

[0107] The auxiliary control unit of the door lock body is also used to activate the computing unit of its own part only as needed, accelerate image feature convergence by using high frame rate data, correct the target recognition calculation result by the confidence weight, and confirm the existence of a target object when the confidence of the result exceeds a preset threshold.

[0108] The auxiliary control unit of the door lock body is also used to dynamically adjust the preset frame rate according to the motion characteristics of the target object and the remaining capacity of the first storage unit, and directly store the high frame rate image data into the first storage unit according to the dynamically adjusted preset frame rate. After each frame of data is stored, the auxiliary control unit immediately enters a deep sleep state, and the first storage unit keeps low power consumption to maintain data integrity.

[0109] When the first storage unit is full, the main control unit processes the image, compresses it, and saves it to the second storage unit. When the second storage unit is full, the image is then transferred to the third storage unit for storage.

[0110] In this embodiment, high frame rate image data refers to image data obtained by increasing the acquisition frame rate after the image sensor is configured by the low-power control unit, which is used to accelerate feature convergence for target recognition. For example, if the default standby frame rate of the image sensor is 5fps, after the low-power control unit is triggered to wake up, the frame rate is increased to 30fps through the configuration register. The acquired 30fps image data is the high frame rate image data, which contains richer target motion details and can shorten the feature convergence time for target recognition.

[0111] Historical target recognition results refer to the results (correct or incorrect) of the auxiliary control unit's last three target recognition operations. These results are used to evaluate the reliability of the recognition and correct the current recognition results. For example, if the auxiliary control unit correctly recognized a person twice (detected a real person) and incorrectly recognized a leaf in the last three target recognition operations, the historical recognition results would be recorded as: 2 correct, 1 incorrect.

[0112] The current association status of the motion sensors refers to whether the detection data of each motion sensor is consistent, and is used to verify the validity of the motion signal. For example, if the current image sensor detects a moving area, the PIR sensor detects a human infrared signal, and the TOF sensor detects a target distance of 1.5m (within the effective detection range of 0.3-5m), then the association status of the three is "consistent"; if only the image sensor detects a moving area, and the PIR and TOF sensors have no valid signals, then the association status is "inconsistent".

[0113] The target recognition confidence weight refers to the quantization coefficient used to correct the initial recognition result by comprehensively considering the historical recognition results and the current sensor association state. The value range is [0,1].

[0114] Activating only a portion of the computing units as needed means that after the auxiliary control unit starts up, it does not activate all the computing cores, but only activates a portion of the computing units to perform target recognition calculations, thereby reducing power consumption. For example, the ARM Cortex-M4 auxiliary control unit contains 4 computing cores. When performing target recognition, only 2 cores are activated, while the other 2 cores remain dormant. The activated cores are responsible for extracting image features and matching target templates. The dormant cores do not consume computing power, resulting in a 50% reduction in power consumption compared to activating all cores.

[0115] The conditions for image feature convergence are: in 10 consecutive high frame rate images, the overlap of the target contour is ≥85%, and the fluctuation amplitude of the motion vector is ≤5 pixels / frame; after the convergence determination is completed, the auxiliary control unit immediately enters deep sleep, and the processing time per frame is ≤67ms. For example, in high frame rate 30fps image data, if the contour features of the target (real person) remain stable within 10 consecutive frames without obvious distortion, it is considered that the image feature has converged. At this time, target recognition can be performed to improve the accuracy, and the feature convergence time is ≤300ms, which is 60% shorter than that of low frame rate 5fps data.

[0116] The initial recognition confidence level refers to the uncorrected recognition reliability output by the auxiliary control unit after calling some computing units to perform target recognition. The value range is [0,1]. For example, if the auxiliary control unit performs target recognition on high frame rate image data and extracts features such as human body contours and motion trajectories, the output initial recognition confidence level is 0.85, indicating that it is initially determined to be a valid target (real person).

[0117] The corrected confidence score is the final recognition reliability obtained by multiplying the initial recognition confidence score by the target recognition confidence score weight, used to determine whether a target object exists. For example, if the initial recognition confidence score is 0.85 and the target recognition confidence score weight is 0.75, the corrected confidence score = 0.85 × 0.75 = 0.6375. If the preset threshold is 0.7, then it is determined that no valid target exists. If the initial recognition confidence score is 0.95 and the weight is 0.75, the corrected confidence score = 0.95 × 0.75 = 0.7125, exceeding the threshold of 0.7, then a valid target exists.

[0118] The preset threshold refers to the corrected confidence threshold used to determine the presence of a target object. It is calibrated through factory testing to balance recognition accuracy and false detection rate. After 100 sets of scene tests (daytime / nighttime, indoor / outdoor), the preset threshold was calibrated to 0.7. At this point, the recognition accuracy is ≥90% and the false detection rate is ≤8%, which meets the requirements of door lock scenarios.

[0119] The motion characteristics of a target object refer to its speed, trajectory, and stability, which are used to dynamically adjust the video recording frame rate. For example, if a target object (a real person) slowly approaches a door lock at a speed of 10 pixels per frame (the distance between the center pixels of the target in two consecutive frames), and its trajectory is stable without violent shaking, then its motion characteristics are considered smooth. If the target object moves quickly at a speed of 40 pixels per frame, and its trajectory is unstable, then its motion characteristics are considered violent.

[0120] The percentage of remaining capacity in the first storage unit refers to the ratio of the current remaining available capacity of the first storage unit to the total capacity. It is used to assess the storage resource status and dynamically adjust the frame rate. For example, if the total capacity of the first storage unit is 800MB and the current remaining available capacity is 320MB, the percentage of remaining capacity = 320MB / 800MB = 0.4 (40%). If the percentage of remaining capacity is lower than 30%, a frame rate throttling is triggered to avoid storage overflow.

[0121] The dynamically adjusted preset frame rate refers to the video recording frame rate adjusted by the auxiliary control unit based on the motion characteristics of the target object and the remaining capacity ratio of the first storage unit, so as to ensure that power consumption and storage occupation are reduced while meeting the recognition requirements.

[0122] Deep sleep state refers to a low-power state where, after the auxiliary control unit completes single-frame data storage, most of the computing circuits and peripherals are shut down, with only the necessary wake-up circuits remaining operational. The sleep current is ≤ For example, if the auxiliary control unit stores image data at a frame rate of 15fps, it will immediately enter a deep sleep state after storing each frame of data (which takes about 67ms) until it is awakened for the next frame storage cycle (about 67ms later). During a single sleep cycle, the power consumption is reduced by more than 90%.

[0123] The beneficial effects of the above technical solution are as follows: By designing a target recognition confidence weight correction mechanism and dynamic frame rate adjustment logic, combined with the activation of some computing units and deep sleep strategies of the auxiliary control unit, the target recognition accuracy is improved and the false detection rate is reduced, while the operating power consumption and storage resource occupation of the auxiliary control unit are significantly reduced. Compared with fixed frame rate and full-core recognition schemes, the power consumption of the auxiliary control unit is reduced by more than 60%, the target recognition false detection rate is reduced by 40%, and the storage efficiency of the first storage unit is improved by 30%. Furthermore, by constructing a low-loss function that integrates multi-scale features, combined with parameter acquisition and optimal frame rate solution logic, the frame rate and power consumption are accurately matched. Compared with the traditional fixed frame rate scheme, the video recording power consumption of the door lock body is reduced by more than 40%. At the same time, through constraint terms and storage state correction, the target recognition accuracy in different scenarios is ensured, the frame rate adjustment is more in line with the actual application requirements, and the battery life of the door lock body is further extended.

[0124] This invention provides a low-power video linkage recording device for door locks. After the door lock body and door lock companion are powered on, they are automatically connected to the router. The door lock body first initiates a Bluetooth connection request and establishes a heartbeat keep-alive connection with the door lock companion. At the same time, the door lock body pre-establishes a sleep connection channel with the second dual-band WiFi module of the door lock companion through the first dual-band WiFi module, and completes WiFi connection key pre-negotiation, link parameter configuration and authentication. After the configuration is completed, the WiFi channel enters a low-power sleep state.

[0125] The door lock body monitors the Bluetooth connection status in real time and simultaneously collects the Bluetooth signal strength RSSI and the packet loss rate Dx of three consecutive heartbeat signals;

[0126] When RSSI < -80dBm and Dx ≥ 0.3, it is determined that the Bluetooth connection is about to become unavailable, triggering the WiFi connection early activation process; the door lock body wakes up the dormant WiFi channel, quickly completes link activation based on the pre-negotiated key and parameters, and simultaneously verifies the WiFi connection stability;

[0127] If the Bluetooth connection is completely lost, the door lock body will directly switch to the activated and verified WiFi connection to continue maintaining heartbeat and data transmission without having to re-execute the WiFi connection negotiation and authentication process; if the Bluetooth connection is restored, it will switch back to the Bluetooth connection and the WiFi channel will re-enter the sleep state.

[0128] During the entire switching process, the auxiliary control unit of the door lock body only activates 1 / 5 of the computing unit to process connection status monitoring and switching control. After the switching is completed, it is powered down immediately. The first dual-band WiFi module only maintains the necessary transmission power consumption after activation.

[0129] In this embodiment, the pre-established sleep connection channel refers to the process where, after the door lock body and the door lock companion are powered on, while establishing a Bluetooth heartbeat keep-alive connection, the first dual-band WiFi module and the second dual-band WiFi module complete WiFi connection key pre-negotiation, link parameter configuration, and authentication. Afterward, the WiFi channel enters a low-power sleep state, maintaining only the link-ready flag and not transmitting data. For example, after the first dual-band WiFi module of the door lock body and the second dual-band WiFi module of the door lock companion are powered on, they complete WPA2-PSK key exchange through the WPS fast negotiation function, configure link parameters (such as channel, bandwidth, and transmission power), and complete authentication. Then, the WiFi module shuts down the RF transmission circuit, retaining only the baseband circuit, and enters a sleep state. The sleep power consumption is... .

[0130] WiFi connection key pre-negotiation refers to the process where the WiFi modules of the main lock and the lock companion complete the exchange and negotiation of encryption keys before going into sleep mode. This avoids repeated negotiation during subsequent activation, shortening connection time. Using WPA2-PSK encryption, the main lock's WiFi module generates a random number A and sends it to the lock companion's WiFi module. The lock companion's WiFi module generates a random number B, calculates the session key using the WiFi password, and sends it to the main lock's WiFi module. After both parties verify that the session keys match, the pre-negotiation is complete. The pre-negotiation time is specified. 500ms.

[0131] Link parameter configuration refers to configuring parameters such as channel, bandwidth, and transmission power required for communication during the WiFi module pre-negotiation process to ensure a fast and stable connection can be established after activation. For example, if the door lock companion WiFi module selects channel 36 of the 5GHz band, with a bandwidth of 80MHz and a transmission power of 15dBm, it sends these parameters to the main door lock WiFi module. After receiving the parameters, the main door lock WiFi module configures the same parameters, completing the link parameter synchronization.

[0132] Authentication refers to the process during WiFi module pre-negotiation where the session key and device identifier are verified to confirm the legitimate identities of both parties and prevent unauthorized connections. For example, if both the main door lock and its companion WiFi modules have pre-stored unique device identifiers (MAC addresses), they will send MAC addresses and session key verification information to each other during pre-negotiation. The receiving party verifies that the MAC address is in the trusted list and the session key matches, thus the authentication is successful.

[0133] Low-power sleep mode refers to the state where, after the WiFi channel is pre-established, the RF transmitting and receiving circuits are shut down, with only the necessary control circuits remaining operational to maintain the link ready state and reduce power consumption. For example, when the WiFi module enters sleep mode, the RF circuit is powered off, and the baseband circuit is in a low-power mode, with current... Compared to the operating state (current) (200mA), power consumption reduced by 99.6%.

[0134] Bluetooth Signal Strength Index (RSSI) refers to the signal strength received by the door lock from the Bluetooth module. It is used to evaluate the quality of the Bluetooth connection and is measured in dBm. The higher the value (closer to 0), the stronger the signal. For example, if the door lock receives the Bluetooth signal from the door lock companion via the Bluetooth module and the measured RSSI is -70dBm, it indicates a strong signal; if the measured RSSI is -85dBm, it indicates a weak signal.

[0135] The packet loss rate (Dx) for three consecutive heartbeat signals refers to the ratio of the number of signals that the door lock sends three consecutive heartbeat signals without receiving a confirmation reply from the door lock companion to the total number of signals sent. It is used to evaluate the stability of the Bluetooth connection and is dimensionless. If the door lock sends three consecutive heartbeat signals and only receives two replies, the packet loss rate Dx = (3-2) / 3; if all three replies are received, then Dx = 0.

[0136] The Bluetooth connection is about to become unavailable when the Bluetooth signal strength and packet loss rate reach preset thresholds, indicating that the Bluetooth connection may be interrupted and the WiFi connection needs to be activated in advance. For example, if the preset Bluetooth signal strength threshold is -80dBm and the packet loss rate threshold is 0.3, when RSSI is measured to be -82dBm and Dx is measured to be 0.3, the Bluetooth connection is determined to become unavailable, triggering the WiFi connection early activation process.

[0137] The WiFi connection pre-activation process refers to the process of waking up the dormant WiFi channel after determining that the Bluetooth connection is about to become unavailable, quickly establishing a connection based on the pre-negotiated key and parameters, and verifying the connection stability. For example, if the auxiliary control unit of the door lock sends a wake-up command to the first dual-band WiFi module, the WiFi module will start its radio frequency circuit (start-up time ≤ 10ms), quickly establish a connection with the WiFi module of the door lock companion based on the pre-negotiated key and link parameters, and send 10 frames of test data (100 bytes per frame). If the reception success rate is ≥ 95%, the connection stability is verified.

[0138] Link activation refers to the process of waking up a dormant WiFi channel from a low-power sleep state, activating the radio frequency circuit, and establishing an actual data transmission link based on pre-configured parameters. For example, after the WiFi module receives a wake-up command, the baseband circuit activates the radio frequency transmitting and receiving circuits, starts communication according to the pre-configured channel, bandwidth, and transmission power, and establishes a data link with the door lock companion WiFi module. The activation time is ≤40ms, which is 98% shorter than re-establishing the connection (≤2 seconds).

[0139] WiFi connection stability verification refers to the process of sending test data and checking the reception success rate after the WiFi link is activated to evaluate whether the connection quality meets the data transmission requirements. For example, the main WiFi module of the door lock sends 10 frames of test data to the door lock companion WiFi module. The data content is a fixed checksum. After receiving the data, the door lock companion WiFi module replies with the verification result. If 9 out of the 10 frames are received correctly (90% success rate), the connection is considered stable; if the success rate is less than 80%, the link is reactivated.

[0140] A complete Bluetooth connection interruption occurs when the door lock sends a heartbeat signal three times consecutively without receiving a response from the door lock companion, indicating a Bluetooth connection loss. If the door lock sends a heartbeat signal every 30 seconds and receives no response for three consecutive times (90 seconds in total), the Bluetooth connection is considered completely interrupted, and the system immediately switches to an activated and verified Wi-Fi connection.

[0141] Activating only 1 / 5 of the computing units means that when the auxiliary control unit handles connection status monitoring and switching control, it only activates 1 / 5 of its own computing units, while the remaining computing units remain dormant to reduce power consumption. For example, if the auxiliary control unit (ARM Cortex-M4) contains 5 computing cores, it will only activate 1 core when handling connection-related logic. This core is responsible for monitoring Bluetooth signal strength and packet loss rate, triggering WiFi activation and switching, while the other 4 cores remain dormant, thus reducing power consumption. Compared to full core activation (power consumption) (Power consumption reduced by 80%).

[0142] The beneficial effects of the above technical solution are as follows: by designing a WiFi pre-establishment sleep connection and early activation mechanism, combined with Bluetooth connection status monitoring and precise switching logic, the problem of long connection switching time and high power consumption of repeated verification is effectively solved. The connection switching time is shortened from ≥2 seconds to ≤50ms, and the power consumption during the switching process is reduced by more than 90%. At the same time, the stability and continuity of the connection are ensured, data transmission interruption is avoided during the switching process, the user experience is improved, and the low power consumption performance of the door lock body is further optimized.

[0143] Obviously, those skilled in the art can make various modifications and variations to this invention without departing from its spirit and scope. Therefore, if these modifications and variations fall within the scope of the claims of this invention and their equivalents, this invention also intends to include these modifications and variations.

Claims

1. A low-power video linkage recording device for door locks, characterized in that, include: A door lock body and a door lock companion wirelessly connected to the door lock body; The door lock body includes: Heterogeneous control module: includes a main control unit, an auxiliary control unit, and a low-power control unit. The main control unit integrates a low-power storage medium to support fast startup and fast recovery mechanisms. The low-power control unit is integrated into the communication module for signal detection and wake-up control in low-power mode. The communication module includes a first dual-band WiFi module and a first Bluetooth module. Sensing module: includes at least one motion sensor for detecting motion signals of objects around the door lock; A first storage unit and a second storage unit, wherein the first storage unit is a low-power storage medium used to temporarily store unprocessed image data; and the second storage unit is used to store optimized and encoded video data. First dual-band WiFi module: used to establish wireless connection with door lock companion and router; First Bluetooth module: used to establish a connection with the door lock companion, and when the door lock body establishes a connection with the door lock companion, the connection priority of the first Bluetooth module is higher than the connection priority of the first dual-band WiFi module; Door magnetic sensor: Used to detect the open / closed status of the door; The door lock companion includes: The second dual-band WiFi module is used to establish a wireless connection with the door lock body and the router. Second Bluetooth module: used to establish a low-power connection with the door lock body and keep heartbeat active; Third storage unit: used to back up the video data transmitted by the main body of the door lock; Data forwarding module: used to realize signaling interaction and video data relay between the door lock body and the cloud; Voice broadcast module: Used to execute message broadcasting services triggered by the APP; After powering on, both the door lock body and the door lock companion automatically connect to the router. The door lock body prioritizes establishing a heartbeat keep-alive connection with the door lock companion through the first Bluetooth module and the second Bluetooth module. When Bluetooth is unavailable, it switches to WiFi connection. The low-power control unit reads the motion signal from the sensing module in real time. After triggering the wake-up mechanism, the main body of the door lock completes image data acquisition, temporary storage, processing, encoding and transmission according to preset logic, while the door lock companion shares the cloud keep-alive, video backup and message broadcast services.

2. The low-power video linkage recording device for door locks according to claim 1, characterized in that, The low-power storage medium includes low-power DDR or PSRAM.

3. The low-power video linkage recording device for door locks according to claim 1, characterized in that, The motion sensor includes at least one of an image sensor, a TOF sensor, a radar sensor, or a PIR sensor; if it is an image sensor, it only performs power-on detection on a preset area in the vertical direction of the image, wherein the preset area in the vertical direction of the image is n times the vertical direction, and n is a value greater than 0 and less than or equal to 1.

4. The low-power video linkage recording device for door locks according to claim 1, characterized in that, Both the first and second dual-band WiFi modules support the 802.11a / b / g / n / ac protocol. The door lock companion uses 2T2R WiFi, 2.4G frequency band and / or 5G frequency band to communicate with the door lock body and the router.

5. The low-power video linkage recording device for door locks according to claim 1, characterized in that, When the router cannot connect to the external network, the video data is temporarily stored in the third storage unit and can be retrieved through the APP after the network is restored.

6. The low-power video linkage recording device for door locks according to claim 1, characterized in that, The auxiliary control unit of the door lock body is also used to determine the target recognition confidence weight based on the high frame rate image data of the image sensor after being woken up by the low power control unit, combined with the historical target recognition results and the current motion sensor association state. The auxiliary control unit of the door lock body is also used to activate the computing unit of its own part only as needed, accelerate image feature convergence by using high frame rate data, correct the target recognition calculation result by the confidence weight, and confirm the existence of a target object when the confidence of the result exceeds a preset threshold. The auxiliary control unit of the door lock body is also used to dynamically adjust the preset frame rate according to the motion characteristics of the target object and the remaining capacity of the first storage unit, and directly store the high frame rate image data into the first storage unit according to the dynamically adjusted preset frame rate. After each frame of data is stored, the auxiliary control unit immediately enters a deep sleep state, and the first storage unit keeps low power consumption to maintain data integrity. When the first storage unit is full, the main control unit processes the image, compresses it, and saves it to the second storage unit. When the second storage unit is full, the image is then transferred to the third storage unit for storage.

7. The low-power video linkage recording device for door locks according to claim 1, characterized in that, After powering on, both the door lock body and the door lock companion automatically connect to the router. The door lock body initiates a Bluetooth connection request first and establishes a heartbeat keep-alive connection with the door lock companion. At the same time, the door lock body establishes a sleep connection channel with the second dual-band WiFi module of the door lock companion through the first dual-band WiFi module, and completes WiFi connection key pre-negotiation, link parameter configuration and authentication. After the configuration is completed, the WiFi channel enters a low-power sleep state. The door lock body monitors the Bluetooth connection status in real time and simultaneously collects the Bluetooth signal strength RSSI and the packet loss rate Dx of three consecutive heartbeat signals; When RSSI < -80dBm and Dx ≥ 0.3, it is determined that the Bluetooth connection is about to become unavailable, triggering the WiFi connection early activation process; the door lock body wakes up the dormant WiFi channel, quickly completes link activation based on the pre-negotiated key and parameters, and simultaneously verifies the WiFi connection stability; If the Bluetooth connection is completely interrupted, the door lock body will directly switch to the activated and verified WiFi connection to continue to maintain heartbeat and data transmission without having to re-execute the WiFi connection negotiation and authentication process; If the Bluetooth connection is restored, switch back to the Bluetooth connection, and the WiFi channel will re-enter sleep mode; During the entire switching process, the auxiliary control unit of the door lock body only activates 1 / 5 of the computing unit to process connection status monitoring and switching control. After the switching is completed, it is powered down immediately. The first dual-band WiFi module only maintains the necessary transmission power consumption after activation.

8. The low-power video linkage recording device for door locks according to claim 1, characterized in that, The door lock companion is also used to store shared services. When the door lock body detects an external trigger command related to the shared service, it retrieves the service result that matches the external trigger command from the stored content based on the door lock companion and sends a reminder. Specifically, when the external trigger command is a command to view local videos, the system controls the viewing of only the companion's videos; When the door lock companion is awakened, the speaker controlling the main door lock body goes into sleep mode; The door lock companion is also used to store data related to hardware-sharing operations.

9. The low-power video linkage recording device for door locks according to claim 1, characterized in that, The door lock companion is also used to store and share hardware services. When the main door lock detects an external trigger command related to the shared service, the door lock companion retrieves the service result matching the external trigger command from the stored content and sends a reminder. When the external trigger command is to view local video, the system controls the viewing of only the companion video. When the door lock companion is woken up, the system controls the main door lock's speaker to go into sleep mode, and the door lock companion's speaker takes over the function.

Images