Full-time video recording intelligent door lock based on a cat eye and full-time video recording method thereof

Abstract

The application provides a full-time video recording intelligent door lock based on a cat eye and a full-time video recording method thereof. The door lock uses a chip with a fast start standby technology based on an ultra-low power memory and an image sensor with a Pre-roll recording and intelligent movement detection function, so that the intelligent door lock can realize the full-time video recording function only with one cat eye. The door lock can replace the existing intelligent door lock using PIR infrared or radar as the human body detection mode outside the door. In the case of meeting the full-time video recording of the intelligent door lock, the manufacturing cost of the door lock is further reduced and the use experience of the user is improved. The problem that the intelligent door lock on the market needs to use two cat eyes to realize full-time video recording and the replacement of the radar as the human body detection mode are solved.

Description

Technical Field

[0001] This invention belongs to the field of smart door lock technology, and specifically relates to a smart door lock with real-time video recording based on a single peephole and its real-time video recording method. Background Technology

[0002] With technological advancements and increasing demands for home security, traditional door locks are no longer sufficient to meet the security needs of modern families. Smart door locks, with their advantages of convenience, security, and intelligent management, are gradually becoming an important part of modern homes, bringing great convenience and security to people's lives. However, current smart door locks on the market generally only start recording when they detect a person or animal lingering at the door, and there is a 2-6 second startup time before recording. These few seconds may seem brief, but when it comes to retrieving surveillance evidence, this delay could easily lead to missed crucial footage, giving criminals an opportunity. Therefore, developing a smart door lock system with extremely low power consumption and 24 / 7 recording capability is of great significance.

[0003] In the door lock industry, 24 / 7 video recording technology has become an important means of improving home security. Taking the Deshman Q5MPro as an example, this smart door lock is equipped with the exclusively developed SHOTAX Sentinel Peephole System, which innovatively uses a dual peephole design to achieve round-the-clock, comprehensive monitoring. One peephole is an AI smart peephole, while the other is dedicated to 24 / 7 recording. The two peepholes work together to effectively solve the problem of missed recordings caused by the delayed start-up time of traditional smart locks.

[0004] However, the shortcomings of existing technologies are:

[0005] Due to the battery life requirements of smart locks, very few locks on the market currently offer true 24 / 7 video recording. Aside from the DESSMANN Q5MPro lock, which uses a dual-peephole design for comprehensive 24 / 7 monitoring, no other locks support this feature. Locks with similar 24-hour sentry mode systems rely on different sensors to detect and analyze abnormal behavior at the door, triggering the lock to capture images. However, this doesn't achieve truly comprehensive 24 / 7 monitoring. As for the Deshman Q5MPro door lock, which adopts a dual peephole design, firstly, while the dual peephole design effectively solves the problem of missed detection caused by the startup delay of traditional smart locks, the dual peephole design means that the lock body structure cannot be shared with traditional smart locks with a single peephole. This requires redesigning the mold, which increases the cost of the door lock. In addition, the dual peepholes themselves also increase material costs. Secondly, even if 24-hour full-time recording is achieved, the detection of people in front of the door lock still uses radar, just like traditional smart door locks. This method is costly and has the potential for false alarms and missed detections.

[0006] In addition, the terminology commonly used in this technology includes:

[0007] Pre-roll: A feature in video recording that refers to a segment of video content that the image sensor begins recording before the actual recording begins.

[0008] Always-on Video (AOV): This technology enables cameras to record 24 / 7 using fast startup and standby technology based on ultra-low power memory. Unlike full-frame-rate recording methods such as all-day recording and event recording, AOV only needs to start recording one frame of image data every second or every few seconds, and compresses one hour of video recording into about one minute of video through video encoding.

[0009] Radar: A radar sensor that uses electromagnetic waves to detect targets. By emitting electromagnetic waves and receiving their echoes, it obtains information such as the distance from the target to the electromagnetic wave emission point, the rate of change of distance, azimuth, and angle. Summary of the Invention

[0010] To address the aforementioned issues, the purpose of this application is to provide a smart door lock with real-time video recording based on a single peephole. This door lock utilizes the Beijing Junzheng T41 ZM chip with fast startup standby technology based on ultra-low power memory and the Chuangshi Semiconductor CV4003IoT image sensor with pre-roll recording and smart motion detection functions, enabling the smart door lock to achieve real-time video recording with just one peephole.

[0011] Specifically, the present invention provides a smart door lock based on a peephole camera with real-time video recording. The smart door lock includes: a peephole camera module (10), a touch display panel (20), a fingerprint recognition module (40), and a control processor module (30). The control processor module (30) is connected to the peephole camera module (10), the touch display panel (20), and the fingerprint recognition module (40) respectively.

[0012] The peephole camera module (10) is located above the touch display panel (20), the control processor module (30) is located behind the touch display panel (20), and the fingerprint recognition module (40) is located below the touch display panel (20). The peephole camera module (10) includes: a lens (11), which is located at the top of the touch display panel (20) and is used to capture images outside the door lock; an image sensor (12), which is used to receive and process the images captured by the lens to generate image information; the image sensor (12) is connected to the lens (11). The smart door lock also includes:

[0013] The image sensor (12) supports Pre-roll recording and Smart Motion Detect function. When the image sensor (12) is in the normal recording mode, it will take pictures and videos of the user's door lock to obtain image information. The control processor module (30) receives the image information, processes it, and provides it to the user. When the image sensor (12) is in Pre-roll recording and Smart Motion Detect is enabled, it can be set to take pictures of the user's door lock at a frequency of 5 times per second and perform motion detection analysis. When the motion detection result is that the image shows movement, the image sensor (12) will send an interrupt signal to the control processor module (30). The built-in algorithm of the image sensor (12) can minimize false alarms.

[0014] The control processor module (30) includes a main control module (31), an MCU module (33), a WIFI module (32), and an LCD display module (34). The main control module (31) is connected to the MCU module (33), the WIFI module (32), and the LCD display module (34), respectively. The MCU module (33) is connected to the WIFI module (32).

[0015] The main control module (31) includes:

[0016] The main control chip receives image information captured by the image sensor and is an AI video processor with ultra-low power consumption and fast startup performance. It has a maximum video encoding capability of 3840x2160@20fps, 3A functions (AE, AWB, AF) and an ISP including sharpening function, and supports 1.2TOPs@int8 AI computing power and algorithm support.

[0017] A microphone and a speaker, the microphone and speaker being used for recording audio during video recording and for recording and playing audio during voice interaction;

[0018] A local storage unit, wherein the local storage unit is used for local storage of audio and video;

[0019] The MCU module (33) is used to receive motion detection interrupt signals from the image sensor, detect the door lock status, detect the fingerprint recognition module, and control the opening or closing of the door lock.

[0020] The MCU module (33) also interacts with the WIFI module (32) to enable users to remotely view the door lock status and wake up the main control module to view locally stored audio and video or real-time audio and video using the smart door lock APP.

[0021] The smart door lock also includes an infrared fill light, which is used to provide infrared fill light for the image sensor (12) at night or in low light conditions to improve night vision.

[0022] The main control module (31) receives the image information from the cat-eye camera module (10) and processes it, and allows the user to view it via the network cloud through the WIFI module (32) or in real time through the LCD display module (34).

[0023] The main control chip is based on a fast startup and standby technology using ultra-low power memory. This technology saves the system state to RAM when the system is in hibernation and waits for external events or internal timers to wake up the entire system to achieve fast startup. It also reduces power consumption by shutting down other unnecessary hardware devices when the main control chip is in hibernation.

[0024] The main control chip has a built-in DDR module, which supports saving system status and image data when the main control chip is in sleep mode; the main control chip has a built-in RTC module, which supports internal timed wake-up and external signal wake-up.

[0025] The image sensor (12) reduces false alarms including tree swaying, changes in light, and normal routine movements.

[0026] The image sensor (12) is a Creality Semiconductor CV4003IoT image sensor.

[0027] The main control chip supports the Beijing Junzheng T41 ZM model chip.

[0028] A real-time recording method for a smart door lock based on a single peephole camera, applicable to any of the aforementioned smart door locks, wherein...

[0029] S1, main control chip wake-up;

[0030] S2, the main control chip is configured with an image sensor to enter normal recording mode;

[0031] S3, the main control chip determines whether it is an external wake-up. If yes, proceed to step S4; otherwise, proceed to step S5.

[0032] S4, the image sensor records video at a normal rate of 30 frames per second;

[0033] S5, image sensor records 1 frame;

[0034] S6. Based on steps S4 and S5, the main control chip's built-in algorithm determines whether a human figure has been detected. If so, it returns to S4; otherwise, it proceeds to step S7.

[0035] S7, the main control chip is configured with an image sensor and enters Pre-roll mode;

[0036] S8, the main control chip is in sleep mode; waiting to return to S1.

[0037] Step S7 further includes: the process of enabling motion detection function in the pre-roll mode of the cat's eye camera module:

[0038] S7.1, enter Pre_roll mode;

[0039] S7.2, constant frame rate motion detection;

[0040] S7.3, Determine if a movement has occurred. If no, return to the previous step S7.2; if yes, proceed to step S7.4.

[0041] S7.4, the image sensor outputs an interrupt signal and exits Pre-roll.

[0042] Therefore, the advantage of this application is:

[0043] The proposed smart door lock, based on a single peephole for continuous video recording, replaces existing smart door locks that rely on PIR infrared or radar for human detection. While still achieving continuous video recording, it further reduces manufacturing costs and enhances the user experience. This solution addresses the issue of current smart door locks requiring two peepholes for continuous recording and replaces radar as the primary method of human detection. Attached Figure Description

[0044] The accompanying drawings, which are provided to further illustrate the invention and form part of this application, are not intended to limit the scope of the invention.

[0045] Figure 1 This is a schematic diagram of the structure of the smart door lock based on a peephole for real-time video recording, which is the subject of this application.

[0046] Figure 2 This is a schematic diagram of the control processor module in the real-time video recording smart door lock based on a single peephole, as described in this application.

[0047] Figure 3 This is a schematic diagram of the core functional framework of the main control module in the control processor module of the smart door lock based on a peephole camera, which is the subject of this application.

[0048] Figure 4 This is a simplified flowchart of the real-time recording mode of the smart door lock based on a single peephole, as described in this application.

[0049] Figure 5This is a schematic diagram of the structure of the peephole camera module in the smart door lock based on a peephole camera for real-time recording, as described in this application.

[0050] Figure 6 A simplified flowchart for enabling motion detection function in the pre-roll mode of the peephole camera module in a smart door lock based on a peephole camera for real-time recording, as described in this application;

[0051] Explanation of reference numerals in the attached diagram: 10 for the cat-eye camera module, 20 for the touch display panel, 30 for the control processor module, 40 for the fingerprint recognition module, 31 for the main control module, 32 for the WIFI module, 33 for the MCU module, 34 for the LCD display module, 11 for the lens, and 12 for the image sensor. Detailed Implementation

[0052] To better understand the technical content and advantages of the present invention, the present invention will now be described in further detail with reference to the accompanying drawings.

[0053] To address the issue that existing smart lock technology requires two peepholes (one AI smart peephole + one 24-hour recording peephole) to achieve 24-hour recording, this application provides a smart lock with full-time recording based on a single peephole, such as... Figure 1 As shown, the specific technical solution includes: a cat-eye camera module, a touch display panel 20, a fingerprint recognition module 40, and a control processor module 30, wherein the control processor module 30 is connected to the cat-eye camera module, the touch display panel 20, and the fingerprint recognition module 40, respectively.

[0054] The cat-eye camera module is located above the touch display panel 20, the control processor module 30 is located behind the touch display panel 20, and the fingerprint recognition module 40 is located below the touch display panel 20.

[0055] Furthermore, such as Figure 5 As shown, the cat-eye camera module 10 includes:

[0056] A lens, located at the top of the touch display panel 20, is used to capture the view outside the door lock. An image sensor receives and processes the images captured by the lens to generate image information. The image sensor is a Creality Semiconductor CV4003IoT image sensor, which supports pre-roll recording and Smart Motion Detection. When the image sensor is in normal recording mode, it captures images of the view outside the door lock. The control processor module 30 receives and processes this image information before displaying it to the user. When the image sensor is in pre-roll recording mode and Smart Motion Detection is enabled, it can be set to capture images of the view outside the door lock five times per second and perform motion detection analysis. When the motion detection result indicates movement in the image, the image sensor sends an interrupt signal to the control processor module 30. The image sensor's built-in algorithm minimizes false alarms caused by factors such as swaying trees, changes in lighting, and normal movements. The image sensor is connected to the lens.

[0057] An infrared fill light is used to provide infrared illumination for the image sensor at night or in low light conditions, thereby improving night vision performance.

[0058] Furthermore, such as Figure 2 As shown, the control processor module 30 includes a main control module 31, an MCU module 33, a WIFI module 32, and an LCD display module 34. The main control module 31 is connected to the MCU module 33, the WIFI module 32, and the LCD display module 34. The MCU module 33 is connected to the WIFI module 32. The main control module 31 receives and processes the image information from the cat-eye camera module and allows users to view it via the network cloud or in real time via the LCD display module 34 through the WIFI module 32.

[0059] like Figure 3 As shown, the main control module 31 includes:

[0060] The main control chip receives image information captured by the image sensor and is an AI video processor with ultra-low power consumption and fast startup performance. It is the Beijing Junzheng T41 ZM chip, featuring efficient video encoding and processing capabilities, powerful ISP functions, AI computing power, and algorithm support. It boasts a maximum video encoding capability of 3840x2160@20fps, 3A (AE, AWB, AF) functions, an ISP including sharpening, and supports 1.2TOPs@int8 AI computing power and algorithm support. The main control chip utilizes ultra-low power memory-based fast startup and standby technology. This technology saves the system state to RAM during system hibernation, waiting for external events or internal timers to wake the entire system for rapid startup. Furthermore, it reduces power consumption by shutting down other unnecessary hardware devices during main control chip hibernation. The T41 ZM main control chip has a built-in DDR module, supporting the saving of system state and image data during main control chip hibernation. It also has a built-in RTC module, supporting internal timer wake-up and external signal wake-up.

[0061] A microphone and a speaker, the microphone and speaker being used for recording audio during video recording and for receiving and playing audio during voice interaction.

[0062] A local storage unit, which is used for local storage of audio and video.

[0063] The MCU module 33 is used to receive motion detection interrupt signals from the image sensor, detect the door lock status, detect the fingerprint recognition module 40, and control the opening or closing of the door lock. The MCU module 33 also interacts with the WIFI module 32 to enable users to remotely view the door lock status using the smart door lock APP and wake up the main control module 31 to view locally stored audio and video or real-time audio and video.

[0064] like Figure 4 The following is a simplified process for the real-time recording mode of a smart door lock based on a single peephole camera:

[0065] S1, main control chip wake-up;

[0066] S2, the main control chip is configured with an image sensor to enter normal recording mode;

[0067] S3, the main control chip determines whether it is an external wake-up. If yes, proceed to step S4; otherwise, proceed to step S5.

[0068] S4, the image sensor records video at a normal rate of 30 frames per second;

[0069] S5, image sensor records 1 frame;

[0070] S6. Based on steps S4 and S5, the main control chip's built-in algorithm determines whether a human figure has been detected. If so, it returns to S4; otherwise, it proceeds to step S7.

[0071] S7, the main control chip is configured with the image sensor of the cat's eye camera module to enter Pre-roll mode;

[0072] S8, the main control chip is in sleep mode; waiting to return to S1.

[0073] like Figure 6 The following is a simplified process for enabling motion detection in the pre-roll mode of a peephole camera module in a smart door lock with real-time video recording based on a peephole:

[0074] S7.1, enter Pre_roll mode;

[0075] S7.2, constant frame rate motion detection;

[0076] S7.3, Determine if a movement has occurred. If no, return to the previous step S7.2; if yes, proceed to step S7.4.

[0077] S7.4, the image sensor outputs an interrupt signal and exits Pre-roll.

[0078] In summary, this application provides a smart door lock with real-time video recording based on a single peephole. It utilizes the Beijing Junzheng T41 ZM chip, which features fast startup and standby technology based on ultra-low power memory, to achieve real-time video recording. It also employs the Crevision Semiconductor CV4003IoT image sensor, which features pre-roll recording and Smart Motion Detection, to replace existing smart door locks that rely on PIR infrared or radar for detecting people outside the door. This further reduces the manufacturing cost of the door lock and improves the user experience.

[0079] The smart door lock includes at least one of the following technical effects:

[0080] (1) By adopting the Beijing Junzheng T41 ZM chip with fast startup standby technology based on ultra-low power memory, the smart door lock can support full-time recording function with only one peephole; compared with the smart door locks on the market that require two peepholes to achieve full-time recording function, the manufacturing cost of the door lock is further reduced.

[0081] (2) By adopting the CV4003IoT image sensor from Crescent Semiconductor, which has the functions of pre-roll recording and smart motion detection, the existing smart door locks can replace the PIR infrared or radar as the method of detecting people outside the door, thus solving the false alarms and missed alarms caused by the PIR infrared or radar detection method, further reducing the manufacturing cost of the door lock and improving the user experience.

[0082] The above description is merely a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, various modifications and variations can be made to the embodiments of the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the protection scope of the present invention.

Claims

1. A smart door lock based on a peephole for real-time video recording, the smart door lock comprising: The system includes a cat-eye camera module (10), a touch display panel (20), a fingerprint recognition module (40), and a control processor module (30), wherein the control processor module (30) is connected to the cat-eye camera module (10), the touch display panel (20), and the fingerprint recognition module (40), respectively. The peephole camera module (10) is located above the touch display panel (20), the control processor module (30) is located behind the touch display panel (20), and the fingerprint recognition module (40) is located below the touch display panel (20); the peephole camera module (10) includes: Lens (11), the lens (10) is located at the top of the touch display panel (20) and is used to capture the image outside the door lock; image sensor (12), the image sensor is used to receive and process the image captured by the lens to generate image information; the image sensor (12) is connected to the lens (11); characterized in that the smart door lock further includes: The image sensor (12) supports Pre-roll recording and Smart Motion Detect function. When the image sensor (12) is in the normal recording mode, it will take pictures and videos of the user's door lock to obtain image information. The control processor module (30) receives the image information, processes it, and provides it to the user. When the image sensor (12) is in Pre-roll recording and Smart Motion Detect is enabled, it can be set to take pictures of the user's door lock at a frequency of 5 times per second and perform motion detection analysis. When the motion detection result is that the image shows movement, the image sensor (12) will send an interrupt signal to the control processor module (30). The built-in algorithm of the image sensor (12) can minimize false alarms. The control processor module (30) includes a main control module (31), an MCU module (33), a WIFI module (32), and an LCD display module (34). The main control module (31) is connected to the MCU module (33), the WIFI module (32), and the LCD display module (34), respectively. The MCU module (33) is connected to the WIFI module (32). The main control module (31) includes: The main control chip receives image information captured by the image sensor. The main control chip is an AI video processor with ultra-low power consumption and fast startup performance. It has a video encoding capability of up to 3840x2160@20fps, 3A functions (AE, AWB, AF) and an ISP including sharpening function, and supports 1.2TOPs@int8 AI computing power and algorithm support. A microphone and a speaker, the microphone and speaker being used for recording audio during video recording and for recording and playing audio during voice interaction; A local storage unit, wherein the local storage unit is used for local storage of audio and video; The MCU module (33) is used to receive motion detection interrupt signals from the image sensor, detect the door lock status, detect the fingerprint recognition module, and control the opening or closing of the door lock; The MCU module (33) also interacts with the WIFI module (32) to enable users to remotely view the door lock status and wake up the main control module to view locally stored audio and video or real-time audio and video using the smart door lock APP.

2. The smart door lock based on a single peephole for real-time video recording according to claim 1, characterized in that, The smart door lock also includes an infrared fill light, which is used to provide infrared fill light for the image sensor (12) at night or in low light conditions to improve night vision.

3. The smart door lock based on a single peephole for real-time video recording according to claim 1, characterized in that, The main control module (31) receives the image information from the cat-eye camera module (10) and processes it, and allows the user to view it via the network cloud through the WIFI module (32) or in real time through the LCD display module (34).

4. The smart door lock based on a single peephole for real-time video recording according to claim 1, characterized in that, The main control chip is based on a fast startup and standby technology using ultra-low power memory. This technology saves the system state to RAM when the system is in hibernation and waits for external events or internal timers to wake up the entire system to achieve fast startup. It also shuts down other unnecessary hardware devices to reduce power consumption when the main control chip is in hibernation. The main control chip has a built-in DDR module, which supports saving system status and image data when the main control chip is in sleep mode; the main control chip has a built-in RTC module, which supports internal timed wake-up and external signal wake-up.

5. The smart door lock based on a single peephole for real-time video recording according to claim 1, characterized in that, The image sensor (12) reduces false alarms including tree swaying, changes in light, and normal routine movements.

6. The smart door lock based on a single peephole for real-time video recording according to claim 1, characterized in that, The image sensor (12) is a Creality Semiconductor CV4003IoT image sensor.

7. The smart door lock based on a single peephole for real-time video recording according to claim 1, characterized in that, The main control chip supports the Beijing Junzheng T41 ZM model chip.

8. A real-time recording method for a smart door lock based on a single peephole camera, characterized in that: The method is applicable to any of the smart door locks described in claims 1-7 above, wherein... S1, main control chip wake-up; S2, the main control chip is configured with an image sensor to enter normal recording mode; S3, the main control chip determines whether it is an external wake-up. If yes, proceed to step S4; otherwise, proceed to step S5. S4, the image sensor records normally at 30 frames per second; S5, image sensor records 1 frame; S6. Based on steps S4 and S5, the main control chip's built-in algorithm determines whether a human figure has been detected. If so, it returns to S4; otherwise, it proceeds to step S7. S7, the main control chip is configured with an image sensor and enters Pre-roll mode; S8, main control chip in sleep mode; Waiting to return to S1.

9. The working method of a smart door lock based on a single peephole for real-time video recording according to claim 8, characterized in that, Step S7 further includes: the process of enabling motion detection function in the pre-roll mode of the cat's eye camera module: S7.1, enter Pre_roll mode; S7.2, constant frame rate motion detection; S7.3, Determine if a movement has occurred. If no, return to the previous step S7.2; if yes, proceed to step S7.

4. S7.4, the image sensor outputs an interrupt signal and exits Pre-roll.

Images