Intelligent door lock event video pre-recording system and application method thereof

Abstract

The application provides a kind of intelligent door lock event video pre-recording system and its application method, at least including: PSRAM;AO SENSOR in standby state gathers image and outputs AO data;T23SOC processes image data and generates video recording;PIR sensor;In standby state, AO SENSOR continuously gathers image and outputs AO data, AO data is stored to PSRAM;Until someone passes through PIR and wakes up the system, at this time, AO SENSOR switches to Full mode, Full data is transferred to T23SOC, T23SOC processes Full data into normal event video recording, then AO SENSOR takes out AO data existing in PSRAM and sends to T23SOC for image processing, outputs pre-recording video recording, finally, pre-recording video and normal event video recording are spliced together to capture effective information when each door lock wakes up.

Description

Technical Field

[0001] This invention belongs to the field of smart door lock technology, and specifically relates to a smart door lock event video pre-recording system and its application method. Background Technology

[0002] In existing technologies, event video pre-recording systems for door lock products are mainly used in smart door locks. Smart door locks are also low-power products. To save power and extend product life, they are in standby mode most of the time, only waking up to record the scene in front of the door when someone actually passes by. However, because the entire wake-up process takes some time, the scene in front of the door recorded by the smart door lock may not actually show anyone. A video pre-recording system, on the other hand, can record valid footage of people passing by every time while ensuring power saving. This improves battery utilization and greatly enhances the security features of the door lock.

[0003] Secondly, with the continuous development of electronic devices, especially the rise of mobile devices, embedded systems, and IoT devices, the market has placed new demands on memory. These devices typically require memory with the following characteristics:

[0004] 1. Low power consumption: to extend battery life.

[0005] 2. High density: Provides greater storage capacity within a limited space.

[0006] 3. Simple interface: easy to integrate into existing systems, reducing design complexity.

[0007] 4. Low cost: It has a cost advantage compared to traditional SRAM.

[0008] Currently, the commonly used SRAM and DRAM on the market can only meet one aspect of the requirements and cannot fully meet the product needs.

[0009] PSRAM was designed based on the need for higher density, lower power consumption, simpler interfaces, and more cost-effective storage solutions. By combining the simple interface of SRAM with the high-density storage advantages of DRAM, it successfully meets the needs of various application scenarios. As technology continues to evolve and develop, PSRAM is being widely used in more fields.

[0010] Furthermore, AO (Analog-Only) sensors have emerged. With the growth of markets such as the Internet of Things (IoT), smart homes, and wearable devices, there is a growing demand for devices that can operate for extended periods without frequent charging or battery replacements. These devices require a technology that can continuously monitor environmental changes without consuming excessive power, while users expect devices to react quickly to changes in their surroundings, such as facial recognition unlocking, gesture control, or security alarms. This necessitates sensors remaining active even when the main processor is asleep, enabling real-time data processing and feedback. Driven by these market demands, sensor manufacturing processes and pixel technology have further improved, enabling the production of sensors with better performance while maintaining lower power consumption.

[0011] Currently, smart locks bring great convenience to people's daily lives, and as a result, their structures have become increasingly complex. The common structure of a smart lock is as follows:

[0012] Front panel structure:

[0013] 1. Touchscreen panel,

[0014] 2. Fingerprint recognition module,

[0015] 3. Face recognition module,

[0016] 4. Cat's eye camera,

[0017] 5. Display screen,

[0018] 6. Front locking control module;

[0019] Rear panel structure:

[0020] 1. Battery compartment,

[0021] 2. Network module,

[0022] 3. Motor

[0023] 4. Rear display screen,

[0024] 5. Rear locking control module.

[0025] Because smart locks are battery-powered, they need to conserve power and extend their lifespan to avoid requiring frequent battery charging. Therefore, smart locks spend most of the day in standby mode, only waking up to perform functions when certain conditions are met. These conditions typically include:

[0026] 1. When someone passes by, the PRI detects it and wakes the door lock to record the event.

[0027] 2. Wake up the door lock when remotely viewing the live view of the door lock on the mobile app.

[0028] There are some time-consuming steps involved in a smart door lock going from standby to actually waking up and starting recording. The normal steps in existing technology are as follows:

[0029] Someone passes by -> PIR detects -> Power is supplied to the peephole camera -> The peephole camera system starts up -> Image data collection begins;

[0030] There are two main time-consuming aspects:

[0031] 1. PRI detection time;

[0032] 2. Startup time of the cat-eye camera system.

[0033] These two processes take approximately 800 milliseconds to 1.5 seconds before the door lock actually starts capturing the image in front of the door. However, by this time, the person may have already disappeared, resulting in the door lock not actually capturing any image of the person passing by. The smart door lock records only static images in front of the door, which wastes power and fails to capture any useful information, leading to a very poor user experience.

[0034] In other words, the shortcomings of existing technology are:

[0035] Currently, smart lock systems are designed to achieve extremely low power consumption and thus longer operating time. In this design, the peephole camera is typically powered off and inactive most of the time. However, the peephole camera module is the most complex part of the entire lock system, both in hardware and software. Each startup takes a considerable amount of time to acquire images, significantly impacting the timely capture of relevant footage from the doorway. On the other hand, keeping the peephole camera constantly operational to capture relevant footage would consume excessive battery power, greatly increasing the frequency of charging. Furthermore, since most scenes at the door are static, continuous recording would be largely meaningless. Therefore, the need for timely recording of relevant information about events at the door and the desire to extend battery life are inherently contradictory. Finding a way to reconcile these two needs and achieve optimal performance is a pressing issue.

[0036] In addition, the technical terms in this field include:

[0037] PIR stands for "Passive Infrared." A PIR sensor is a commonly used motion detection sensor, widely applied in security systems, automatic doors, lighting control, and other fields. It determines whether movement is occurring by detecting infrared radiation emitted by the human body or other heat sources.

[0038] Image sensor: An image sensor is an electronic device that converts light signals into electrical signals, typically used to capture and record images or videos. Image sensors are key components in many modern devices such as digital cameras, smartphone cameras, surveillance cameras, and medical imaging equipment.

[0039] Smart peephole module: It is an important component of smart door lock, which can monitor the front of the door in real time and record video footage of people passing by. It specifically includes an image sensor, lens, SOC main control, etc.

[0040] The T23 SOC is a high-performance, low-power processor designed specifically for intelligent vision applications. It possesses multimedia data processing capabilities and is widely used in security monitoring and consumer products, such as smart door locks. The T23 SOC is a chip from Ingenic Semiconductor, and in this application, it is primarily used to process AO data and Full data, encoding them into a video stream.

[0041] Low-power products refer to electronic devices or systems that are designed and manufactured with a focus on reducing energy consumption. These products typically consume less power in standby mode, operating mode, or throughout their entire lifespan, thus achieving energy conservation and emission reduction. Smart door locks, in order to reduce power consumption and extend usage time, are often in standby mode, only switching to normal mode and recording the event when someone passes by.

[0042] Pre-recording function: Pre-saves the scene in front of the door before the door lock is activated after the PIR detects a person, in order to complete the recorded video.

[0043] PSRAM (Pseudo Static Random Access Memory): In video pre-recording systems, smart locks can record valid footage of people passing by each time while maintaining power efficiency. This improves battery utilization and significantly enhances the security of the lock. This application only utilizes its storage capacity to implement the function of caching preview images. AO Image Sensor (SENSOR): Refers to an image sensor with Always-On functionality. This type of sensor is designed to operate continuously in low-power mode, remaining operational even when other parts of the device are in sleep mode. The main purpose of AO image sensors is to achieve certain specific application scenarios.

[0044] AO data: The acquired data output by the AO image sensor in low-power operation mode. Generally, in order to reduce power consumption, the resolution and frame rate of the acquired images are very low.

[0045] Full data: The data acquired by the AO image sensor in normal mode, where the output image has high resolution and frame rate.

[0046] Image resolution: Image resolution refers to the amount of information stored in an image. It is usually used to measure the clarity of details in an image. The higher the resolution, the clearer the image.

[0047] Video frame rate: Image capture frame rate refers to the number of images captured per unit of time, usually expressed in frames per second (FPS). It is an important indicator of the performance of an image sensor or camera device, directly affecting the smoothness of video and the ability to capture dynamic scenes. The higher the frame rate, the smoother the video. Summary of the Invention

[0048] To address the aforementioned issues, the purpose of this application is to provide a video pre-recording system that, while ensuring power efficiency, allows smart door locks to record valid footage of people passing by each time, thus improving battery utilization and significantly enhancing the security features of the door lock. This pre-recording system solution primarily combines the storage function of PSRAM, the image acquisition function of AO SENSOR, and the fast image processing capabilities of T23SOC. The key aspects lie in the hardware design and supporting implementation methods used in this system solution.

[0049] Specifically, the present invention provides a smart door lock event video pre-recording system, the system comprising at least:

[0050] One PSRAM storage unit is used to store video data;

[0051] An AO sensor image acquisition unit is used to acquire images and output AO data in standby mode;

[0052] A T23 SOC image processing unit is used to process image data and generate video recordings;

[0053] A PIR sensor is used to detect whether there is a human body in front of the door in real time. When someone passes by, the PRI will wake up the door lock, peephole camera and other system.

[0054] In standby mode, the AO SENSOR continuously acquires images and outputs AO data, which is stored in PSRAM. When someone passes by, the door lock peephole camera and the system are awakened by PIR. At this time, the AO SENSOR switches to Full mode and first transmits the Full data to the T23 SOC. The T23 SOC processes the Full data into a normal event video recording. Then, the AO SENSOR retrieves the AO data stored in PSRAM and sends it to the T23 SOC for image processing, similar to image processing in a camera, including exposure brightness, color reproduction, and noise suppression, to make the image more realistic. The pre-recorded video is then output, and finally, the pre-recorded video and the normal event video are stitched together to form a complete event video record.

[0055] The PSRAM is designed to store 3-5 seconds of video data; if the PSRAM is full, it will cyclically overwrite the previous AO data.

[0056] When the PSRAM is full, the system will cyclically overwrite the oldest AO data to ensure that the storage unit always contains the latest video data.

[0057] The AO SENSO is included in the peephole camera module of the smart door lock.

[0058] The specific models used in the system design include:

[0059] The PSRAM model can be either APS6404L-SQRH or APS6404L-SQR; either one is fine, the difference is the capacity.

[0060] The AO SENSOR model is CV4003. The CV4003 can control the AO data to be stored in the PSRAM by itself.

[0061] 3. T23 SOC chip model: Chips with ISP module and encoding module, including Ingenic T series chips such as T23DN. Ingenic chips are not required, any Ingenic chip will do, but they must have ISP module and encoding module.

[0062] The hardware relationships of the system include: PSRAM connected to AO SENSOR, and AO SENSOR connected to T23 SOC; the pre-recording system combines the storage function of PSRAM, the image acquisition function of AO SENSOR, and the fast image processing capability of T23 SOC.

[0063] The splicing function is a feature that the APP program processes when a user wants to view a playback video to capture valid information each time the door lock is woken up. This allows the user to view the video by simply playing the AO data first and then the Full data.

[0064] The method also relates to an application method for a smart door lock event video pre-recording system, which is applicable to any of the systems described above, and includes the following steps:

[0065] S1. Dormant state:

[0066] When the system is in sleep mode, the AO SENSOR will store the collected AO data in PSRAM;

[0067] S2. Someone has been detected passing by:

[0068] When the PIR sensor detects someone passing by, it will trigger the system to wake up from sleep mode;

[0069] S3. Video Output:

[0070] After the T23 SOC is woken up, it will receive and process the AO data and Full data transmitted by the AO SENSOR in a time-division manner.

[0071] The AO data refers to video based on activity detection, used for pre-recorded video.

[0072] The Full data refers to complete event recordings, used for recording normal events.

[0073] S4. The output AO data and Full data are concatenated to capture valid information.

[0074] Step S3 further includes:

[0075] S3.1, the AO SENSOR switches to Full mode and first transmits the Full data to the T23 SOC. The T23 SOC processes the Full data into normal event video recording.

[0076] S3.2 Then the AO SENSOR retrieves the AO data stored in the PSRAM and sends it to the T23SOC for image processing. The output at this time is the pre-recorded video recording.

[0077] S3.3 Finally, the pre-recorded video is spliced ​​into the normal event video recording.

[0078] Step S4 is handled by the user's APP program, which only requires playing the AO data first and then the Full data, so that the user perceives it as a video.

[0079] Therefore, the advantage of this application lies in the following: Current common smart lock system designs keep the peephole camera module powered off most of the time to reduce power consumption and extend product lifespan. However, the pre-recording system, by utilizing the characteristics of the AO SENSOR and PSRAM, solves the problem of conventional systems failing to capture valid image information after startup without significantly increasing power consumption. In other words, existing technologies require a separate MCU to access the PSRAM, while the AO SENSOR (CV4003) in this application, through some custom circuitry, can operate the PSRAM data access itself without an MCU. It achieves the same performance with a simpler design structure. Attached Figure Description

[0080] The accompanying drawings, which are provided to further illustrate the invention and form part of this application, are not intended to limit the scope of the invention.

[0081] Figure 1 This is a schematic diagram of the hardware architecture of this application.

[0082] Figure 2 This is a schematic diagram of the system structure of this application.

[0083] Figure 3 This is a flowchart illustrating the method described in this application. Detailed Implementation

[0084] To better understand the technical content and advantages of the present invention, the present invention will now be described in further detail with reference to the accompanying drawings.

[0085] This application proposes a smart door lock event video pre-recording system and its application method. In a specific embodiment, the smart door lock event video pre-recording system mainly consists of PSRAM, AO SENDOR, and Junzheng T23 SOC chip. The specific models of each component are listed below:

[0086] 1. PSRAM models: APS6404L-SQRH and APS6404L-SQR;

[0087] 2. AO SENSOR model: CV4003;

[0088] 3. T23 SOC chip model: T23DN.

[0089] like Figure 1 As shown: PSRAM is connected to AO SENSOR, and AO SENSOR is connected to T23 SOC.

[0090] The pre-recording system combines the storage function of PSRAM, the image acquisition function of AO SENSOR, and the fast image processing capability of T23 SOC.

[0091] like Figure 2 As shown, the system involved in this application includes at least:

[0092] One PSRAM storage unit is used to store video data;

[0093] An AO sensor image acquisition unit is used to acquire images and output AO data in standby mode;

[0094] A T23 SOC image processing unit is used to process image data and generate video recordings;

[0095] A PIR sensor is used to detect whether there is a human body in front of the door in real time. When someone passes by, the PRI will wake up the door lock, peephole camera and other system.

[0096] In standby mode, the AO sensor continuously acquires images and outputs AO data, which is stored in the PSRAM. When someone passes by, the door lock's peephole camera (the system) is activated by the PIR sensor. At this time, the AO sensor switches to Full mode and first transmits the Full data to the T23 SOC. The T23 SOC processes the Full data into a normal event video recording. Then, the AO sensor retrieves the AO data from the PSRAM and sends it to the T23 SOC for image processing, similar to camera image processing, including exposure, brightness adjustment, color reproduction, and noise suppression, to make the image more realistic. A pre-recorded video is then output. Finally, the pre-recorded video and the normal event video are stitched together to form a complete event video record. This stitching function is handled by the APP program when the user wants to view the playback recording. It captures valid information from each door lock activation, allowing the user to view only the AO data first, followed by the Full data, resulting in a single video for the user's viewing experience.

[0097] In other words, this system is a video surveillance system based on PSRAM and time-division data transmission, and includes at least:

[0098] PSRAM storage units are used to store video data; including:

[0099] Sleep mode, used to store AO data into PSRAM when no one is using it;

[0100] Person status is used to read AO data from PSRAM when a person's presence is detected;

[0101] PSRAM is used to temporarily store and retrieve data, thereby reducing system power consumption;

[0102] The AO SENSOR unit is used for time-division multiplexing of AO data and Full data;

[0103] The AOSENSOR time-division transmission includes alternating transmission of AO data and Full data to optimize data transmission efficiency;

[0104] The T23 SOC unit is used to process video data and output the following:

[0105] AO video based on AO data;

[0106] Full video based on Full data;

[0107] Pre-recorded video;

[0108] Normal event video recording;

[0109] That is, the pre-recorded video output by the T23SOC unit is a combination of AO data and real-time data stored in PSRAM.

[0110] The system also includes an event triggering mechanism, which switches to the occupied state module and starts generating normal event recording video when a person is detected.

[0111] When the smart lock is in standby mode, the AO sensor in the peephole camera module remains active, outputting AO data to the PSRAM. If the PSRAM is full, it continuously overwrites previous AO data. Typically, the PSRAM can store 3-5 seconds of video data. When someone passes by, the PIR sensor wakes up the peephole camera (the system). At this point, the AO sensor switches to Full mode, first sending the Full data to the T23 SOC. The T23 SOC processes the Full data into normal event video recording. Then, the AO sensor retrieves the AO data from the PSRAM and sends it to the T23 SOC for image processing. There is a specific order to this process: generally, Full data is output first, followed by AO data. The output is the pre-recorded video recording. Finally, the pre-recorded video is stitched together with the normal event video recording. This ensures that valid information is captured every time the lock is woken up.

[0112] The PSRAM model can be either APS6404L-SQRH or APS6404L-SQR; either one is fine, the difference is the capacity.

[0113] The AO SENSOR model is CV4003. The CV4003 can control the AO data to be stored in the PSRAM by itself.

[0114] T23 SOC chip model: Chips with ISP module and encoding module, including Ingenic T series chips such as T23DN. Ingenic chips are not required, any Ingenic chip will do, but they must have ISP module and encoding module.

[0115] like Figure 3 As shown, the specific process of the application method involved in this application is as follows:

[0116] S1. Dormant state:

[0117] When the system is in sleep mode, the AO SENSOR will store the collected AO data in PSRAM;

[0118] S2. Someone has been detected passing by:

[0119] When the PIR sensor detects someone passing by, it will trigger the system to wake up from sleep mode;

[0120] S3. Video Output:

[0121] After the T23 SOC is woken up, it will receive and process the AO data and Full data transmitted by the AO SENSOR in a time-division manner.

[0122] The AO data refers to video based on activity detection, used for pre-recorded video.

[0123] The Full data refers to complete event recordings, used for recording normal events.

[0124] Step S3 further includes:

[0125] S3.1, the AO SENSOR switches to Full mode and first transmits the Full data to the T23 SOC. The T23 SOC processes the Full data into normal event video recording.

[0126] S3.2 Then the AO SENSOR retrieves the AO data stored in the PSRAM and sends it to the T23SOC for image processing. The output at this time is the pre-recorded video recording.

[0127] S3.3 Finally, the pre-recorded video is spliced ​​into the normal event video recording;

[0128] S4. The output AO data and Full data are concatenated to capture valid information.

[0129] The chips involved in this technical solution can be applied to all series of Ingenic chips and similar chips.

[0130] The above description is merely a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, various modifications and variations can be made to the embodiments of the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the protection scope of the present invention.

Claims

1. A smart door lock event video pre-recording system, characterized in that, The system includes at least one PSRAM storage unit for storing video data; An AO sensor image acquisition unit is used to acquire images and output AO data in standby mode; A T23 SOC image processing unit is used to process image data and generate video recordings; A PIR sensor is used to detect whether there is a human body in front of the door in real time. When someone passes by, the PRI will wake up the door lock, peephole camera and other system. In standby mode, the AO SENSOR continuously acquires images and outputs AO data, which is stored in PSRAM. When someone passes by, the door lock peephole camera and the system are awakened by PIR. At this time, the AO SENSOR switches to Full mode and first transmits the Full data to the T23 SOC. The T23 SOC processes the Full data into normal event video recording. Then, the AO SENSOR retrieves the AO data stored in PSRAM and sends it to the T23 SOC for image processing, including exposure brightness, color restoration, and noise suppression, and outputs pre-recorded video recording. Finally, the pre-recorded video and the normal event video recording are stitched together to form a complete event video record.

2. The intelligent door lock event video pre-recording system according to claim 1, characterized in that, The PSRAM is designed to store 3-5 seconds of video data; if the PSRAM is full, it will cyclically overwrite the previous AO data.

3. The intelligent door lock event video pre-recording system according to claim 2, characterized in that, When the PSRAM is full, the system will cyclically overwrite the oldest AO data to ensure that the storage unit always contains the latest video data.

4. The intelligent door lock event video pre-recording system according to claim 1, characterized in that, The AO SENSO is included in the peephole camera module of the smart door lock.

5. The intelligent door lock event video pre-recording system according to claim 1, characterized in that, The specific models used in the system design include: The PSRAM model is: APS6404L-SQRH or APS6404L-SQR; The AO SENSOR model is CV4003. The CV4003 can control the AO data to be stored in the PSRAM by itself.

3. T23 SOC chip model: A chip with an ISP module and an encoding module.

6. The intelligent door lock event video pre-recording system according to claim 1, characterized in that, The hardware relationships of the system include: PSRAM connected to AO SENSOR, and AO SENSOR connected to T23 SOC; the pre-recording system combines the storage function of PSRAM, the image acquisition function of AO SENSOR, and the fast image processing capability of T23 SOC.

7. The intelligent door lock event video pre-recording system according to claim 1, characterized in that, The splicing function is a feature that the APP program processes when a user wants to view a playback video to capture valid information each time the door lock is woken up. This allows the user to view the video by simply playing the AO data first and then the Full data.

8. An application method for a smart door lock event video pre-recording system, characterized in that, The method is applicable to the system described in any one of claims 1-7, and the method includes the following steps: S1. Dormant state: When the system is in sleep mode, the AO SENSOR will store the collected AO data in PSRAM; S2. Someone has been detected passing by: When the PIR sensor detects someone passing by, it will trigger the system to wake up from sleep mode; S3. Video Output: After the T23 SOC is woken up, it will receive and process the AO data and Full data transmitted by the AO SENSOR in a time-division manner. The AO data refers to video based on activity detection, used for pre-recorded video. The Full data refers to complete event recordings, used for recording normal events. S4. The output AO data and Full data are concatenated to capture valid information.

9. The application method of the intelligent door lock event video pre-recording system according to claim 8, characterized in that, Step S3 further includes: S3.1, the AO SENSOR switches to Full mode and first transmits the Full data to the T23 SOC. The T23 SOC processes the Full data into normal event video recording. S3.2 Then the AO SENSOR retrieves the AO data stored in the PSRAM and sends it to the T23SOC for image processing. The output at this time is the pre-recorded video recording. S3.3 Finally, the pre-recorded video is spliced ​​into the normal event video recording.

10. The application method of the intelligent door lock event video pre-recording system according to claim 8, characterized in that, Step S4 is handled by the user's APP program, which only requires playing the AO data first and then the Full data, so that the user perceives it as a video.

Images