All-weather energy-saving monitoring method

Abstract

The invention relates to an all-weather energy-saving monitoring method which comprises the following steps: step 1, when equipment is cold-started for the first time, a master control system sets a high frame rate mode by default, and if a target is not detected, a medium is notified to enter a low frame rate mode; step 2, when the whole machine works in a low-power-consumption state, a business layer controls a light state, and when a target is not recognized, a starting device is awakened at fixed time, and a medium is notified to enter a low-frame-rate mode; step 3, outputting a frame of image data after the starting equipment is awakened at regular time, and notifying the media to enter a high frame rate mode after the current frame recognizes a target; after the master control system is awakened, a service layer continuously detects whether the sleep logic is met, and if the sleep logic is not met, the master control system always works in a high frame rate mode; if sleep logic is satisfied, a low frame rate mode is configured. According to the invention, the problem that equipment cannot work for a long time due to insufficient power supply in continuous cloudy and rainy weather in an existing monitoring method can be solved, and high-definition video recording in a low-illumination environment can be realized.

Description

Technical Field

[0001] The invention belongs to the technical field of video monitoring, and relates to an all-weather energy-saving monitoring method, in particular to an all-weather energy-saving monitoring method. Background Art

[0002] With the development of digital information technology, all walks of life have attached more importance to comprehensive monitoring, and are paying more and more attention to all-round coverage and multi-area monitoring. Video surveillance equipment is used in every corner of the world and is playing an increasingly important role in emerging fields such as smart cities and smart homes.

[0003] The technology in the monitoring industry is constantly changing and innovating, and comprehensive monitoring solutions are pursuing higher performance and higher requirements.

[0004] Video surveillance equipment is widely used in various fields. Ordinary cameras usually need to be installed in an environment with sufficient power supply and grid supply, and the ambient brightness of the monitoring site is also relatively high. However, there are not many types of monitoring equipment that can be used in simple conditions, remote areas, and inadequate infrastructure. In addition, the existing monitoring solutions equipped with solar panels have low photoelectric conversion efficiency in rainy weather and cannot maintain long-term operation of the equipment.

[0005] Therefore, in order to solve the above problems, the present invention proposes an all-weather energy-saving monitoring method.

[0006] After searching, no public documents of the prior art that are identical or similar to the present invention were found. Summary of the Invention

[0007] The purpose of the present invention is to overcome the shortcomings of the existing technology and provide an all-weather energy-saving monitoring method, which can solve the problem of the existing monitoring method being unable to work for a long time due to insufficient power supply of the equipment in continuous rainy weather, and can realize high-definition recording in low-light environment.

[0008] The present invention solves the practical problem by adopting the following technical solutions:

[0009] A 24 / 7 energy-saving monitoring method comprises the following steps:

[0010] Step 1: When the device is cold-started for the first time, the main control system sets the high frame rate mode by default. If no target is detected, the media is notified to enter the low frame rate mode, and the entire device works in a low power consumption state.

[0011] Step 2: When the whole device is working in low power consumption state, the business layer controls the lighting state and, if no target is recognized, wakes up the device at a fixed time and notifies the media to enter low frame rate mode. The whole device works in low power consumption state.

[0012] Step 3: After waking up the device regularly, it outputs a frame of image data. After the current frame recognizes the target, it notifies the media to enter the high frame rate mode. After the main control system is awakened, the business layer will continue to check whether the sleep logic is met. If the sleep logic is not met, the main control system will continue to work in the high frame rate mode. If the sleep logic is met, the low frame rate mode will be configured.

[0013] Moreover, the specific steps of step 1 include:

[0014] (1) When the device is cold-started for the first time, the microcontroller powers on the main control system and each module begins to initialize;

[0015] (2) During cold start, the main control system defaults to high frame rate mode, and TDISP linkage sets high frame rate effect parameters;

[0016] (3) The business layer checks whether the dormancy logic is satisfied;

[0017] (4) Before entering sleep mode, the business layer will save the video recording. At the same time, the media triggers the main control system to enter STR sleep mode, the sensor enters soft sleep state, and then the business notifies the microcontroller to power off the main control chip, and the entire machine works in a low power state.

[0018] Moreover, the specific method of step 1 (1) is:

[0019] When the device is cold-started for the first time, the MCU powers on the main control system and each module begins initialization, including BSP driver initialization, sensor initialization, media creation, data stream pipeline supporting AOV mode, and algorithm initialization.

[0020] Moreover, the specific method of step (3) of step 1 is:

[0021] If the algorithm does not detect the target and continues for a period of time, the media will be notified to enter low frame rate mode. The media will record the low frame rate state and transmit it to TDISP. Before sleeping, ISP will set the low frame rate effect parameters.

[0022] Moreover, the specific steps of step 2 include:

[0023] (1) When the whole machine is working in low power mode, the business layer first queries the real-time brightness of the previous frame through TDISP, and then controls the status of the filter and light. When the brightness is greater than the set light-on threshold, the filter will be switched accordingly and the light will be turned off; otherwise, the light will be turned on;

[0024] (2) When the device is started up at a scheduled wake-up time, the service layer configures the low frame rate mode. The sensor outputs one frame of data, the algorithm uses one frame for target detection, and the service queries the target detection result. If no target is identified, the media is notified to enter the low frame rate mode. The media records the low frame rate status and transmits it to TDISP. Before the device goes into sleep mode, the ISP will jointly set the low frame rate effect parameters.

[0025] (3) Before sleep, the media calls back the service interface to send a frame of image data, and the service saves the AOV frame data. At the same time, the media triggers the main control system to enter STR sleep mode, and the sensor enters soft sleep state. Then the service layer notifies the microcontroller to power off the main control chip, and the entire machine works in a low-power state.

[0026] Furthermore, the method for controlling the light off in step 2 (1) is as follows:

[0027] Use the frame control mode to control the timing of turning on the light. When the video access module VI of the main controller detects the end of the frame, it turns off the light.

[0028] Moreover, the specific steps of step 3 include:

[0029] (1) During scheduled wake-up, the service configures the low frame rate mode, the sensor outputs one frame of data, the algorithm uses one frame for target detection, and the service queries the target detection result. If the target is recognized, the service sets the video preview mode, and the media triggers the main control system to enter the high frame rate wake-up mode, records the high frame rate status and transmits it to TDISP, and the ISP cooperates to set the high frame rate effect parameters;

[0030] (2) After the main control system is awakened, the sensor is in the awake state, and the media callback business module sends real-time frame data. The business captures the target image, records the alarm information and saves the video. Then the business layer will continue to check whether the sleep logic is met. If the sleep logic is not met, the main control will always work in high frame rate mode. If the sleep logic is met, the low frame rate mode will be configured and the main control will enter the sleep state, and the microcontroller will perform timed wake-up.

[0031] Advantages and beneficial effects of the present invention:

[0032] 1. The present invention proposes an all-weather energy-saving monitoring method that can eliminate the need for external power supply and wired network, and the device can quickly wake up to record, which is suitable for complex low-light scenes.

[0033] 2. The present invention adopts a timed wake-up device to save more power.

[0034] 3. The present invention uses a frame control mode to control the timing of turning on the light, saving the time of turning on the light and further reducing power consumption.

[0035] 4. The present invention links different ISP parameters in high frame rate and low frame rate modes respectively to ensure better image effects in different modes.

[0036] 5. The present invention is different from the DualOS low-power solution. The PureLinux system is simpler and more reproducible.

[0037] 6. The present invention does not require additional human body sensing sensors, saving hardware costs and reducing false alarm rates. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Figure 1 This is a flow chart of the first cold start of the device of the present invention;

[0039] Figure 2 Flowchart of the device timed wake-up startup of the present invention (no target is identified);

[0040] Figure 3 Flowchart of the timed wake-up startup of the device of the present invention (target is identified). DETAILED DESCRIPTION

[0041] The embodiments of the present invention are further described below in conjunction with the accompanying drawings:

[0042] A 24 / 7 energy-saving monitoring method, such as Figures 1 to 3 As shown, the following steps are included:

[0043] Step 1: When the device is cold-started for the first time, the main control system sets the high frame rate mode by default. If no target is detected, the media is notified to enter the low frame rate mode, and the entire device works in a low power consumption state.

[0044] The specific steps of step 1 include:

[0045] (1) When the device is cold-started for the first time, the microcontroller powers on the main control system and each module begins to initialize;

[0046] The specific method of step (1) of step 1 is:

[0047] When the device is cold-started for the first time, the MCU powers on the main control system and each module begins initialization, including BSP driver initialization, sensor initialization, media creation, data stream pipeline supporting AOV mode, and algorithm initialization.

[0048] (2) During cold start, the main control system defaults to high frame rate mode, and TDISP linkage sets high frame rate effect parameters; such as AE adjustment speed and time domain noise reduction parameters;

[0049] (3) Determine whether the business layer detection satisfies the dormancy logic;

[0050] The specific method of step (3) of step 1 is:

[0051] If no target is detected and it lasts for a period of time, the media will be notified to enter low frame rate mode. The media will record the low frame rate state and transmit it to TDISP. Before sleeping, ISP will set the low frame rate effect parameters, such as AE adjustment speed and time domain noise reduction parameters.

[0052] (4) Before entering sleep mode, the business layer will save the video recording. At the same time, the media triggers the main control system to enter STR sleep mode, the sensor enters soft sleep state, and then the business notifies the microcontroller to power off the main control chip, and the entire machine works in a low power state.

[0053] The working principle of step 1 is:

[0054] 1. During the device's first cold start, the MCU powers up the main control system, and each module begins initialization, primarily including initializing the BSP driver (Board Support Package), sensor initialization, media creation of a data stream pipeline supporting AOV mode, and algorithm initialization. During a cold start, the main control system defaults to high frame rate mode, and TDISP (TiandyISP) collaborates to set high frame rate effect parameters.

[0055] 2. The business layer detects whether the sleep logic is met: If the algorithm does not detect the target and continues for a period of time, the media will be notified to enter low frame rate mode. The media will record the low frame rate status and transmit it to TDISP. Before sleep, the ISP will set the low frame rate effect parameters.

[0056] 3. Before sleep, the service will save the video recording. At the same time, the media triggers the main control system to enter STR sleep mode, the sensor enters soft sleep state, and then the service notifies the microcontroller to power off the main control chip, and the entire device works in a low-power state.

[0057] Since the time-domain noise reduction in the ISP noise reduction module requires multiple frames to converge, the time difference between each frame data in high frame rate mode is very small, and the displacement of moving objects is relatively small. In order to reduce noise, the time-domain noise reduction intensity can be appropriately increased. However, the time difference between each frame data in low frame rate mode is larger than that in high frame rate mode, so the time-domain noise reduction intensity should be appropriately reduced to reduce motion tailing. Therefore, high frame rate mode and low frame rate mode use two different sets of ISP effect parameters to ensure clearer image effects in different working modes. Different ISP parameters are linked to ensure that the image effect in different modes can be better.

[0058] Step 2: When the whole device is working in low power consumption state, the business layer controls the lighting state and, if no target is recognized, wakes up the device at a fixed time and notifies the media to enter low frame rate mode. The whole device works in low power consumption state.

[0059] The specific steps of step 2 include:

[0060] (1) When the whole machine is working in low power mode, the business layer first queries the real-time brightness of the previous frame through TDISP, and then controls the status of the filter and light. When the brightness is greater than the set light-on threshold, the filter will be switched accordingly and the light will be turned off; otherwise, the light will be turned on;

[0061] The method for controlling the light off in step 2 (1) is as follows:

[0062] Use the frame control mode to control the timing of turning on the light. When the video access module VI of the main controller detects the end of the frame, it turns off the light.

[0063] (2) When the device is started up at a scheduled wake-up time, the service layer configures the low frame rate mode. The sensor outputs one frame of data, the algorithm uses one frame for target detection, and the service queries the target detection result. If no target is identified, the media is notified to enter the low frame rate mode. The media records the low frame rate status and transmits it to TDISP. Before the device goes into sleep mode, the ISP will jointly set the low frame rate effect parameters.

[0064] (3) Before sleep, the media calls back the service interface to send a frame of image data, and the service saves the AOV frame data. At the same time, the media triggers the main control system to enter STR sleep mode, and the sensor enters soft sleep state. Then the service layer notifies the microcontroller to power off the main control chip, and the entire machine works in a low-power state.

[0065] The working principle of step 2 is:

[0066] 1. When the whole machine is working in low power mode, the MCU will regularly power on the main control system through the timer. The business layer first queries the real-time brightness of the previous frame through TDISP, and then controls the status of the filter and light. When the brightness is lower than the set light-on threshold, the filter will be switched accordingly and the light will be turned on; otherwise, the light will not be turned on.

[0067] Among them, this solution uses the frame control mode to control the timing of turning on the lights. When the video access module VI (videoinput) of the main control detects the end of the frame, it turns off the lights, instead of waiting until the main control system goes into sleep mode. This reduces the lighting time and power consumption.

[0068] 2. During scheduled wake-up, the service configures low frame rate mode. The sensor outputs one frame of data, the algorithm uses one frame for target detection, and the service queries the target detection result. If no target is recognized, the media records the low frame rate status and transmits it to TDISP. Before sleep, the ISP will jointly set the low frame rate effect parameters.

[0069] 3. Before sleep, the media callback service interface sends a frame of image data, the service saves the AOV frame data, and at the same time, the media triggers the main control system to enter STR sleep mode, the sensor enters soft sleep state, and then the service notifies the microcontroller to power off the main control chip, and the entire machine works in a low power state.

[0070] Step 3: After waking up the device regularly, it outputs a frame of image data. After the current frame recognizes the target, it notifies the media to enter the high frame rate mode. After the main control system is awakened, the business layer will continue to check whether the sleep logic is met. If the sleep logic is not met, the main control system will continue to work in the high frame rate mode. If the sleep logic is met, the low frame rate mode will be configured.

[0071] The specific steps of step 3 include:

[0072] (1) During scheduled wake-up, the service configures the low frame rate mode, the sensor outputs one frame of data, the algorithm uses one frame for target detection, and the service queries the target detection result. If the target is recognized, the service sets the video preview mode, and the media triggers the main control system to enter the high frame rate wake-up mode, records the high frame rate status and transmits it to TDISP, and the ISP cooperates to set the high frame rate effect parameters;

[0073] (2) After the main control system is awakened, the sensor is in the awake state, and the media callback business module sends real-time frame data. The business captures the target image, records the alarm information and saves the video. Then the business layer will continue to check whether the sleep logic is met. If the sleep logic is not met, the main control will always work in high frame rate mode. If the sleep logic is met, the low frame rate mode will be configured and the main control will enter the sleep state, and the microcontroller will perform timed wake-up.

[0074] The working principle of step 3 is:

[0075] 1. When the whole device is working in low power mode, the MCU will power on the main control system regularly through the timer. The service first queries the real-time brightness of the previous frame through TDISP, and then controls the status of the filter and light. When the brightness is lower than the set light-on threshold, the filter will be switched accordingly and the light will be turned on; otherwise, the light will not be turned on.

[0076] Among them, the present invention uses a frame control mode to control the timing of turning on the lights. When the video access module VI (videoinput) of the main control detects the end of the frame, the lights are turned off, instead of waiting until the main control system is in sleep mode. This reduces the light-on time and reduces power consumption (the same as the first step of the timed wake-up when the target is not recognized).

[0077] 2. During scheduled wake-up, the service configures low frame rate mode, the sensor outputs one frame of data, the algorithm uses one frame for target detection, and the service queries the target detection result. If the target is recognized, the service sets the video preview mode, and the media triggers the main control system to enter high frame rate wake-up mode. The high frame rate status is recorded and transmitted to TDISP, and the ISP cooperates to set the high frame rate effect parameters.

[0078] 3. After the main control system is awakened, the sensor also wakes up. The media callback service module sends real-time frame data, and the service captures the target image, records alarm information, and saves the video. The service layer then continuously checks whether the sleep logic is met. If not, the main control system continues to operate in high frame rate mode. If the sleep logic is met, a low frame rate mode is configured and the main control system enters sleep mode, with the microcontroller performing a timed wake-up.

[0079] The working principle of the present invention is:

[0080] AOV (Always On Video) is a video surveillance solution designed to provide continuous recording around the clock without interruption or excessive power consumption. This scenario is often used in outdoor environments, such as scenic spots, rural areas, and areas such as agriculture, animal husbandry, forestry, and livestock farming, where there may be no grid power or network connectivity. In these environments, traditional surveillance solutions require frequent battery replacement or power connection, increasing maintenance and labor costs. Therefore, the emergence of AOV products fills this gap in demand.

[0081] During the day, the monitoring device is charged by solar energy, which is stored in a smart battery. At night or in rainy weather, the battery provides power, ensuring continuous power year-round without the need for an external power source. Furthermore, the product achieves extremely low power consumption through sleep and wake-up actions, and uses algorithms to implement target recognition. This allows for continuous environmental monitoring without interruption of power supply, providing a more convenient and reliable solution for outdoor surveillance.

[0082] Based on the Pure Linux system solution, it incorporates Suspend to RAM (STR) technology, which saves the program's running state to RAM before entering hibernation and then powers down all components except the RAM to reduce power consumption. Furthermore, resuming from this low-power state takes less time than restarting the system, meeting system startup or wake-up requirements.

[0083] The present invention employs a Pure Linux master control solution. A single-chip microcontroller (MCU) controls the power on and off of the master control chip. When the MCU is in a constant-power state, the MCU periodically powers the MCU on and off to wake the device, restoring the state before the power failure. The algorithmic target detection results are used to control the master control chip's sleep or wake-up. If the MCU algorithm detects a target, each module switches to a high-frame-rate state and enters constant-power mode. If the MCU algorithm fails to detect a target, the MCU powers off the MCU, causing each module to switch to a low-frame-rate state and enter a power-saving mode.

[0084] In low frame rate mode, when the main control uses STR technology to enter sleep mode, the main control system program enters a paused state, the sensor goes into hibernation and stops outputting image data streams, operates in a low-power state, and maintains the current register values. When the MCU uses the timer to power on the main control chip, the main control program quickly resumes operation, the sensor exits hibernation and outputs a single-frame image, and the algorithm performs target detection on the single-frame image. If no target is recognized, the main control enters sleep mode again, and the single-frame image is saved before sleep. This cycle is repeated to form AOV recording, allowing users to view real-time recording of the entire day during playback.

[0085] When no targets enter the surveillance scene, the device operates in low frame rate mode, significantly saving power and increasing device operating time. Since the main control and sensor are not reinitialized upon wakeup, they are restored directly to the state they were in before the previous sleep state. Furthermore, the scheduled wakeup interval is in seconds, and the difference in ambient brightness between two consecutive wakeup times is minimal, ensuring that the first frame after wakeup is essentially normal, thus ensuring excellent image quality after each quick start. Furthermore, with multiple scheduled wakeups, the ISP algorithm iteratively optimizes its parameters to ensure high-definition recording throughout the day.

[0086] It should be emphasized that the embodiments described in the present invention are illustrative rather than restrictive. Therefore, the present invention includes but is not limited to the embodiments described in the specific embodiments. Any other embodiments derived by those skilled in the art based on the technical solutions of the present invention also fall within the scope of protection of the present invention.

Claims

1. An all-weather energy-saving monitoring method, characterized by: The following steps are involved: Step 1: When the device is cold-started for the first time, the main control system sets the high frame rate mode by default. If no target is detected, the media is notified to enter the low frame rate mode, and the entire device works in a low power consumption state. Step 2: When the whole device is working in low power consumption state, the business layer controls the lighting state and, if no target is recognized, wakes up the device at a fixed time and notifies the media to enter low frame rate mode. The whole device works in low power consumption state. Step 3: After waking up the device regularly, it outputs a frame of image data. After the current frame recognizes the target, it notifies the media to enter the high frame rate mode. After the main control system is awakened, the business layer will continue to check whether the sleep logic is met. If the sleep logic is not met, the main control system will continue to work in the high frame rate mode. If the sleep logic is met, the low frame rate mode will be configured.

2. The all-weather energy-saving monitoring method according to claim 1, characterized in that: The specific steps of step 1 include: (1) When the device is cold-started for the first time, the microcontroller powers on the main control system and each module begins to initialize; (2) During cold start, the main control system defaults to high frame rate mode, and TDISP linkage sets high frame rate effect parameters; (3) The business layer checks whether the dormancy logic is satisfied; (4) Before entering sleep mode, the business layer will save the video recording. At the same time, the media triggers the main control system to enter STR sleep mode, the sensor enters soft sleep state, and then the business notifies the microcontroller to power off the main control chip, and the entire machine works in a low power state.

3. The all-weather energy-saving monitoring method according to claim 2, characterized in that: The specific method of step (1) of step 1 is: When the device is cold-started for the first time, the MCU powers on the main control system and each module begins to initialize, including BSP driver initialization, sensor initialization, media creation, data stream pipeline supporting AOV mode, and algorithm initialization.

4. The all-weather energy-saving monitoring method according to claim 2, characterized in that: The specific method of step (3) of step 1 is: If the algorithm does not detect the target and continues for a period of time, the media will be notified to enter low frame rate mode. The media will record the low frame rate state and transmit it to TDISP. Before sleeping, ISP will set the low frame rate effect parameters.

5. The all-weather energy-saving monitoring method according to claim 1 or 2, characterized in that: The specific steps of step 2 include: (1) When the whole machine is working in low power mode, the business layer first queries the real-time brightness of the previous frame through TDISP, and then controls the status of the filter and light. When the brightness is greater than the set light-on threshold, the filter will be switched accordingly and the light will be turned off; otherwise, the light will be turned on; (2) When the device is started up at a scheduled wake-up time, the service layer configures the low frame rate mode. The sensor outputs one frame of data, the algorithm uses one frame for target detection, and the service queries the target detection result. If no target is identified, the media is notified to enter the low frame rate mode. The media records the low frame rate status and transmits it to TDISP. Before the device goes into sleep mode, the ISP will jointly set the low frame rate effect parameters. (3) Before sleep, the media calls back the service interface to send a frame of image data, and the service saves the AOV frame data. At the same time, the media triggers the main control system to enter STR sleep mode, and the sensor enters soft sleep state. Then the service layer notifies the microcontroller to power off the main control chip, and the entire machine works in a low-power state.

6. The all-weather energy-saving monitoring method according to claim 5, characterized in that: The method for controlling the light off in step 2 (1) is as follows: Use the frame control mode to control the timing of turning on the light. When the video access module of the main control detects the end of the frame, it turns off the light.

7. The all-weather energy-saving monitoring method according to claim 1 or 2, characterized in that: The specific steps of step 3 include: (1) During scheduled wake-up, the service configures the low frame rate mode, the sensor outputs one frame of data, the algorithm uses one frame for target detection, and the service queries the target detection result. If the target is recognized, the service sets the video preview mode, and the media triggers the main control system to enter the high frame rate wake-up mode, records the high frame rate status and transmits it to TDISP, and the ISP cooperates to set the high frame rate effect parameters; (2) After the main control system is awakened, the sensor is in the awake state, and the media callback business module sends real-time frame data. The business captures the target image, records the alarm information and saves the video. Then the business layer will continue to check whether the sleep logic is met. If the sleep logic is not met, the main control will always work in high frame rate mode. If the sleep logic is met, the low frame rate mode will be configured and the main control will enter the sleep state, and the microcontroller will perform timed wake-up.

Images