A vehicle sentry mode energy saving control method, device and computer program product

Abstract

The application discloses a vehicle sentry mode energy-saving control method, device and computer program product, wherein the method comprises the following steps: when a vehicle enters a sentry mode, controlling a vehicle-mounted camera to collect an environment video stream in a first collection mode; performing activity target detection based on the environment video stream, and dynamically adjusting a working mode according to a detection result; wherein when no valid activity target is detected, controlling the vehicle-mounted camera to collect the environment video stream in a second collection mode, and controlling the whole vehicle to turn into a low-voltage power supply state, the image pixels and frame rate of the second collection mode are lower than those of the first collection mode; when a valid activity target is detected, if a real-time distance between the valid activity target and the vehicle is less than a preset alert distance threshold, controlling the vehicle-mounted camera to collect the environment video stream in the first collection mode. The application can effectively save the whole vehicle electric energy and the running computing power of an intelligent cabin domain controller when the vehicle is in the sentry mode.

Description

Technical Field

[0001] This invention relates to the field of intelligent connected vehicle technology, specifically to a vehicle sentinel mode energy-saving control method, device, and computer program product. Background Technology

[0002] Currently, intelligent vehicles face challenges in system performance degradation and hardware reliability when activating Sentinel Security Mode, issues that urgently need to be addressed. Specifically, existing technical solutions exhibit significant technical deficiencies in the following three dimensions: First, regarding high-voltage system maintenance, the continuous activation of Sentinel Mode requires the vehicle's High Voltage Distribution System (HVDS) to maintain uninterrupted power supply. This necessitates the Battery Management System (BMS) continuously powering high-energy-consuming modules such as the sensing system, computing units, and storage devices, resulting in an abnormally high static power consumption for the entire vehicle. Second, at the image processing architecture level, existing solutions force the onboard surround-view camera module to transmit raw video streams to the Intelligent Domain Controller (IDC) with high-definition, high-frame-rate parameters. This forces the IDC to continuously run computationally intensive tasks such as color space conversion and real-time encoding, significantly increasing heat dissipation and shortening the lifespan of the computing units. Third, regarding data storage mechanisms, existing loop recording functions employ a continuous overwrite strategy, causing excessive full-capacity erase and write operations on the eMMC or UFS embedded memory, reducing its lifespan. The synergistic effect of the aforementioned technical defects not only exacerbates the energy consumption of the entire vehicle, but also poses an irreversible risk of performance degradation to the onboard computing platform and storage system, severely restricting the sustainable development of intelligent vehicle safety protection systems. Summary of the Invention

[0003] The technical problem to be solved by the embodiments of the present invention is to provide a vehicle sentry mode energy-saving control method, device and computer program product to reduce the power consumption of the vehicle when it is working in sentry mode.

[0004] To solve the above-mentioned technical problems, the present invention provides a vehicle sentry mode energy-saving control method, comprising the following steps:

[0005] When the vehicle enters sentry mode, the onboard camera is controlled to capture environmental video streams in the first acquisition mode.

[0006] Active target detection is performed based on the environmental video stream, and the working mode is dynamically adjusted according to the detection results;

[0007] When no valid moving target is detected, the vehicle camera is controlled to acquire environmental video stream in the second acquisition mode, and the vehicle is controlled to switch to low-voltage power supply. The image pixels and frame rate of the second acquisition mode are lower than those of the first acquisition mode.

[0008] When a valid moving target is detected, if the real-time distance between the valid moving target and the vehicle is less than a preset warning distance threshold, the vehicle-mounted camera is controlled to collect environmental video streams in the first acquisition mode.

[0009] Preferably, when a valid moving target is detected, if the real-time distance between the valid moving target and the vehicle is less than a preset warning distance threshold, and the dwell time is greater than or equal to a preset warning duration threshold, then the vehicle-mounted camera is controlled to collect environmental video streams in a first acquisition mode.

[0010] Preferably, the method further includes a power protection step:

[0011] Monitor the low-voltage battery voltage, and when the voltage is lower than the set voltage threshold, start the high-voltage battery to charge the low-voltage battery;

[0012] Monitor the remaining power of the high-voltage battery, and turn off the sentry mode when the remaining power is lower than the set power threshold.

[0013] Preferably, after controlling the vehicle-mounted camera to acquire environmental video streams in the first acquisition mode, the method further includes triggering an alarm operation, wherein the alarm operation includes at least one of the following:

[0014] Vehicle light warning;

[0015] Upload the environmental video stream containing the effective active targets to the cloud server;

[0016] Send alarm notifications to the vehicle owner's terminal.

[0017] Preferably, the image pixel count of the first acquisition mode is not less than 2MP and the frame rate is not less than 25fps; the image pixel count of the second acquisition mode is not more than 0.3MP and the frame rate is not more than 1fps.

[0018] The present invention also provides a vehicle sentry mode energy-saving control device, including an in-vehicle camera and an intelligent cockpit domain controller;

[0019] The intelligent cockpit domain controller is used to control the on-board camera to acquire environmental video streams in a first acquisition mode when the vehicle enters sentry mode; and to perform moving target detection based on the environmental video streams, and dynamically adjust the working mode according to the detection results.

[0020] When no valid active target is detected, the intelligent cockpit domain controller controls the vehicle camera to acquire environmental video streams in a second acquisition mode and controls the vehicle to switch to a low-voltage power supply state. The image pixels and frame rate of the second acquisition mode are lower than those of the first acquisition mode.

[0021] When a valid moving target is detected, if the real-time distance between the valid moving target and the vehicle is less than a preset warning distance threshold, the intelligent cockpit domain controller controls the vehicle-mounted camera to collect environmental video streams in a first acquisition mode; otherwise, environmental video streams are not collected.

[0022] Preferably, the intelligent cockpit domain controller is used to control the vehicle camera to collect environmental video stream in a first acquisition mode when a valid moving target is detected, if the real-time distance between the valid moving target and the vehicle is less than a preset warning distance threshold and the dwell time is greater than or equal to a preset warning duration threshold.

[0023] Preferably, the device further includes a power protection module for monitoring the low-voltage battery voltage, and activating the high-voltage battery to charge the low-voltage battery when the voltage is lower than a set voltage threshold; and monitoring the remaining power of the high-voltage battery, and deactivating the sentry mode when the remaining power is lower than a set power threshold.

[0024] The present invention also provides a vehicle sentry mode energy-saving control device, comprising:

[0025] One or more processors;

[0026] Memory;

[0027] One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, and the one or more applications are configured to perform the vehicle sentry mode energy-saving control method.

[0028] The present invention also provides a computer program product, including computer instructions that instruct a computer device to perform an operation corresponding to the method.

[0029] Implementing this invention offers the following advantages: By constructing a multi-dimensional energy-saving control scheme based on visual perception, this invention achieves efficient energy consumption management in vehicle sentry mode. While ensuring the accuracy of safety monitoring, it significantly reduces system energy consumption, significantly extends the lifespan of USB flash drives and eMMC storage chips, and reduces storage media wear caused by frequent read / write operations. This invention achieves a three-dimensional balance between energy consumption management, computing power allocation, and storage optimization while ensuring the reliability of safety monitoring, providing an innovative solution for the efficient integration of intelligent vehicle electronic architecture. Attached Figure Description

[0030] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0031] Figure 1 This is a flowchart illustrating a vehicle sentinel mode energy-saving control method according to an embodiment of the present invention.

[0032] Figure 2 This is a schematic diagram of the specific process of a vehicle sentry mode energy-saving control method according to an embodiment of the present invention. Detailed Implementation

[0033] The following description of the embodiments is taken with reference to the accompanying drawings, which illustrate specific embodiments in which the invention can be implemented.

[0034] Please refer to Figure 1 As shown, Embodiment 1 of the present invention provides a vehicle sentry mode energy-saving control method, including the following steps:

[0035] When the vehicle enters sentry mode, the onboard camera is controlled to capture environmental video streams in the first acquisition mode.

[0036] Active target detection is performed based on the environmental video stream, and the working mode is dynamically adjusted according to the detection results;

[0037] When no valid moving target is detected, the vehicle camera is controlled to acquire environmental video stream in the second acquisition mode, and the vehicle is controlled to switch to low-voltage power supply. The image pixels and frame rate of the second acquisition mode are lower than those of the first acquisition mode.

[0038] When a valid moving target is detected, if the real-time distance between the valid moving target and the vehicle is less than a preset warning distance threshold, the vehicle-mounted camera is controlled to collect environmental video streams in the first acquisition mode.

[0039] As can be seen from the above steps, this embodiment of the invention significantly extends vehicle battery life and storage media lifespan while ensuring security monitoring efficiency by dynamically adjusting the working state of the sentry mode: when no valid moving target is detected, a low-resolution, low-frame-rate second acquisition mode is adopted and switched to a low-voltage power supply state, which can reduce camera power consumption and vehicle energy consumption; when a valid moving target is detected and its distance is less than a preset warning distance threshold, it immediately switches to a high-resolution, high-frame-rate first acquisition mode to ensure the integrity and legal validity of key evidence; and when the target distance exceeds the warning distance threshold, it maintains a non-acquisition state to avoid storing invalid video data and reduce the number of times the storage media is erased and rewritten.

[0040] Specifically, please combine Figure 2 As shown, in this embodiment of the invention, the vehicle-mounted camera collects environmental video streams around the vehicle and inputs the surrounding environmental information into the intelligent cockpit domain controller (IDC). The IDC is equipped with a visual perception algorithm module, which continuously analyzes the environmental video stream based on a deep learning object detection algorithm to identify valid moving targets in real time. The remote communication module T-Box is responsible for uploading vehicle information, voice, and cockpit images to the cloud. It is understood that valid moving targets refer to dynamic objects determined by the visual perception algorithm as potentially having a direct impact on vehicle safety or driving scenarios, including but not limited to pedestrians, vehicles, and non-motorized vehicles. When the vehicle enters sentry mode, the vehicle's high-voltage power supply system is activated, and the vehicle-mounted camera collects environmental video streams in real time using a first acquisition mode, transmitting the data via a high-speed bus to the visual perception algorithm module of the IDC. As an example, the image resolution in the first acquisition mode is no less than 2MP and the frame rate is no less than 25fps. The vehicle-mounted camera is specifically a surround-view camera; this embodiment has four cameras.

[0041] If the visual perception algorithm module fails to detect a valid moving target within a continuous monitoring period of n minutes, it will first send a control command to the onboard camera to switch its operating mode to a second acquisition mode. As an example, in the second acquisition mode, the image pixel count is no higher than 0.3Mp and the frame rate is no higher than 1fps. This reduces front-end power consumption by decreasing the data throughput of the image sensor. The vehicle's power supply system simultaneously switches to a low-voltage mode, maintaining only the power required for basic perception functions. The monitoring period n can be set according to actual conditions, typically 3-5 minutes.

[0042] It should be noted that the computing power of the intelligent cockpit domain controller (IDC), including its CPU, GPU, and NPU, is limited. If the sentry mode consumes too much of the IDC's computing power, other applications running in the parking scenario (such as 3D car models, desktop applications, and navigation) may suspend operation and become unusable. When the user starts the vehicle again, these applications need to be restarted, increasing the time required for the IDC to fully function, significantly impacting the user experience. In this embodiment, after the vehicle switches to low-voltage power supply, the IDC also enters low-power mode. Low-pixel and low-frame-rate environmental video streams are input to the IDC's visual perception algorithm module, reducing the CPU, GPU, and NPU's computing power consumption within the IDC by 5%-10%. This avoids the problem of applications running in the parking scenario failing due to excessive computing power consumption.

[0043] When a valid moving target is detected, this embodiment of the invention will execute a differentiated response based on the real-time distance between the valid moving target and the vehicle.

[0044] The visual perception algorithm module of the IDC detects that an active target is approaching the vehicle, that is:

[0045] S < L

[0046] where S is the real-time distance between the effective active target and the vehicle, and L is the preset warning distance threshold.

[0047] The on-vehicle camera is controlled to collect the environmental video stream in the first acquisition mode, and the collected environmental video stream is saved to the memory storage chip or USB flash drive of the IDC. At the same time, a safety warning is triggered, including warning the intruder by flashing the vehicle lights, uploading the video of the intruder to the cloud through the T-BOX, and sending a text message notification to the vehicle owner to achieve remote monitoring and timely response. The IDC maintains the normal power consumption mode at this time to support video recording, target recognition and warning operations.

[0048] It can be understood that starting to collect the environmental video stream when S < L, that is, controlling the trigger condition of the collection through the preset warning distance threshold L, can avoid the storage medium being covered by invalid videos, extend the service life of the storage chip or USB flash drive. At the same time, it also avoids the continuous high load operation of the IDC and storage resources. The preset warning distance threshold L can be optimized according to the actual scenario (such as parking lot, road, etc.), environmental complexity (such as day / night, pedestrian density, etc.).

[0049] If S ≥ L, it indicates that the active target is far from the vehicle and does not pose a direct threat to the vehicle, so the collection of the environmental video stream is not started to avoid the storage medium being covered by invalid videos, thereby reducing the number of erasures and the risk of scrapping of the storage chip or USB flash drive. It can be understood that when the active target is far from the vehicle, its behavior trajectory has a large uncertainty. If the environmental video stream is started at this time (even in the second acquisition mode with low power consumption), a large amount of low-value video data will be generated, resulting in invalid erasure of the storage medium.

[0050] As a further improvement of the embodiment of the present invention, in addition to the preset warning distance threshold, a warning duration threshold T is also set. That is, in addition to satisfying that the real-time distance S between the effective active target and the vehicle is less than the preset warning distance threshold L (S < L), it is also necessary to satisfy that the residence duration t of the effective active target is greater than or equal to the preset warning duration threshold T (t ≥ T) to start collecting the environmental video stream, that is, to control the on-vehicle camera to collect the environmental video stream in the first acquisition mode.

[0051] It is understood that the preset warning distance threshold L delineates a warning area for vehicles. When the real-time distance S between a valid moving target (such as a pedestrian, other vehicles, etc.) and the vehicle is less than the preset warning distance threshold L, the valid moving target is considered to have entered the warning area. The preset warning duration threshold T is a time value set in this embodiment of the invention. When the duration t of a valid moving target's stay within the warning area is greater than or equal to the preset warning duration threshold T, it is determined that the valid moving target's stay within the warning area is long enough, and there may be a potential safety risk.

[0052] The vehicle-mounted camera will only be activated to collect environmental video streams in the first acquisition mode when both of the above conditions are met simultaneously. That is, this embodiment of the invention not only focuses on whether a valid moving target enters the warning area, but also on the time it stays in the warning area. It can filter out targets that briefly enter the warning area but leave quickly, reduce unnecessary video acquisition and storage, improve the accuracy and efficiency of vehicle safety monitoring, and reduce false alarms and unnecessary resource consumption.

[0053] In the implementation of the vehicle sentry mode energy-saving control method of this invention, the low-voltage battery voltage is also monitored in real time. When it is below 12V, the high-voltage battery is activated to intelligently charge the low-voltage battery. A low-voltage battery voltage below 12V indicates insufficient low-voltage battery power, which may affect the normal operation of the sentry mode. When the remaining power of the high-voltage battery is below a preset power threshold (e.g., ≤10%), the sentry mode is forcibly shut down to prevent over-discharge of the high-voltage battery and protect battery life.

[0054] Corresponding to the vehicle sentry mode energy-saving control method described in Embodiment 1 of the present invention, Embodiment 2 of the present invention also provides a vehicle sentry mode energy-saving control device, including an in-vehicle camera and an intelligent cockpit domain controller;

[0055] The intelligent cockpit domain controller is used to control the on-board camera to acquire environmental video streams in a first acquisition mode when the vehicle enters sentry mode; and to perform moving target detection based on the environmental video streams, and dynamically adjust the working mode according to the detection results.

[0056] When no valid active target is detected, the intelligent cockpit domain controller controls the vehicle camera to acquire environmental video streams in a second acquisition mode and controls the vehicle to switch to a low-voltage power supply state. The image pixels and frame rate of the second acquisition mode are lower than those of the first acquisition mode.

[0057] When a valid moving target is detected, if the real-time distance between the valid moving target and the vehicle is less than a preset warning distance threshold, the intelligent cockpit domain controller controls the vehicle-mounted camera to collect environmental video streams in a first acquisition mode; otherwise, environmental video streams are not collected.

[0058] Preferably, the intelligent cockpit domain controller is used to control the vehicle camera to collect environmental video stream in a first acquisition mode when a valid moving target is detected, if the real-time distance between the valid moving target and the vehicle is less than a preset warning distance threshold and the dwell time is greater than or equal to a preset warning duration threshold.

[0059] Preferably, the device further includes a power protection module for monitoring the low-voltage battery voltage, and activating the high-voltage battery to charge the low-voltage battery when the voltage is lower than a set voltage threshold; and monitoring the remaining power of the high-voltage battery, and deactivating the sentry mode when the remaining power is lower than a set power threshold.

[0060] Corresponding to the vehicle sentry mode energy-saving control method described in Embodiment 1 of the present invention, Embodiment 3 of the present invention also provides a vehicle sentry mode energy-saving control device, comprising:

[0061] One or more processors;

[0062] Memory;

[0063] One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, and the one or more applications are configured to perform the vehicle sentinel mode energy-saving control method described in Embodiment 1 of the present invention.

[0064] Corresponding to the vehicle sentinel mode energy-saving control method described in Embodiment 1 of the present invention, Embodiment 4 of the present invention also provides a computer program product, including computer instructions, which instruct a computer device to perform the operation corresponding to the vehicle sentinel mode energy-saving control method described in Embodiment 1 of the present invention.

[0065] Preferably, the processor can be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor, or the processor can be any conventional processor. The processor is the control center of the device, connecting various parts of the device through various interfaces and lines.

[0066] The memory mainly includes a program storage area and a data storage area. The program storage area can store the operating system, applications required for at least one function, etc., while the data storage area can store related data, etc. Furthermore, the memory can be a high-speed random access memory, or a non-volatile memory, such as a plug-in hard drive, a SmartMedia Card (SMC), a Secure Digital (SD) card, and a Flash Card, or other volatile solid-state storage devices.

[0067] It should be noted that the above-mentioned devices may include, but are not limited to, processors and memory, as will be understood by those skilled in the art.

[0068] For the working principle and process of the above embodiments, please refer to the description of Embodiment 1 of the present invention, which will not be repeated here.

[0069] As can be seen from the above description, compared with the prior art, the beneficial effects of the present invention are as follows: The present invention achieves efficient energy consumption management in vehicle sentry mode by constructing a multi-dimensional energy-saving control scheme based on visual perception. While ensuring the accuracy of safety monitoring, it significantly reduces system energy consumption, significantly extends the lifespan of USB flash drives and eMMC storage chips, and reduces storage media wear caused by frequent read / write operations. The present invention achieves a three-dimensional balance between energy consumption management, computing power allocation, and storage optimization while ensuring the reliability of safety monitoring, providing an innovative solution for the efficient integration of intelligent vehicle electronic architecture.

[0070] The above description is merely a preferred embodiment of the present invention and should not be construed as limiting the scope of the invention. Therefore, any equivalent variations made in accordance with the claims of the present invention are still within the scope of the present invention.

Claims

1. A vehicle sentry mode energy-saving control method, characterized in that, Includes the following steps: When the vehicle enters sentry mode, the onboard camera is controlled to capture environmental video streams in the first acquisition mode. Active target detection is performed based on the environmental video stream, and the working mode is dynamically adjusted according to the detection results; When no valid moving target is detected, the vehicle camera is controlled to acquire environmental video stream in the second acquisition mode, and the vehicle is controlled to switch to low-voltage power supply. The image pixels and frame rate of the second acquisition mode are lower than those of the first acquisition mode. When a valid moving target is detected, if the real-time distance between the valid moving target and the vehicle is less than a preset warning distance threshold, the vehicle-mounted camera is controlled to collect environmental video streams in the first acquisition mode.

2. The method according to claim 1, characterized in that, When a valid moving target is detected, if the real-time distance between the valid moving target and the vehicle is less than a preset warning distance threshold, and the dwell time is greater than or equal to a preset warning duration threshold, then the vehicle-mounted camera is controlled to collect environmental video streams in the first acquisition mode.

3. The method according to claim 1, characterized in that, It also includes power protection steps: Monitor the low-voltage battery voltage, and when the voltage is lower than the set voltage threshold, start the high-voltage battery to charge the low-voltage battery; Monitor the remaining power of the high-voltage battery, and turn off the sentry mode when the remaining power is lower than the set power threshold.

4. The method according to claim 1, characterized in that, After controlling the vehicle-mounted camera to acquire environmental video streams in the first acquisition mode, the process also includes triggering an alarm operation, which includes at least one of the following: Vehicle light warning; Upload the environmental video stream containing the effective active targets to the cloud server; Send alarm notifications to the vehicle owner's terminal.

5. The method according to claim 1, characterized in that, The first acquisition mode has an image pixel count of no less than 2MP and a frame rate of no less than 25fps; the second acquisition mode has an image pixel count of no more than 0.3MP and a frame rate of no more than 1fps.

6. A vehicle sentry mode energy-saving control device, characterized in that, Including in-vehicle cameras and smart cockpit domain controllers; The intelligent cockpit domain controller is used to control the on-board camera to acquire environmental video streams in a first acquisition mode when the vehicle enters sentry mode; and to perform moving target detection based on the environmental video streams, and dynamically adjust the working mode according to the detection results. When no valid active target is detected, the intelligent cockpit domain controller controls the vehicle camera to acquire environmental video streams in a second acquisition mode and controls the vehicle to switch to a low-voltage power supply state. The image pixels and frame rate of the second acquisition mode are lower than those of the first acquisition mode. When a valid moving target is detected, if the real-time distance between the valid moving target and the vehicle is less than a preset warning distance threshold, the intelligent cockpit domain controller controls the vehicle-mounted camera to collect environmental video streams in a first acquisition mode.

7. The apparatus according to claim 6, characterized in that, The intelligent cockpit domain controller is used to control the vehicle camera to collect environmental video streams in a first acquisition mode when a valid moving target is detected, if the real-time distance between the valid moving target and the vehicle is less than a preset warning distance threshold and the dwell time is greater than or equal to a preset warning duration threshold.

8. The apparatus according to claim 6, characterized in that, It also includes a power protection module for monitoring the low-voltage battery voltage and, when the voltage is lower than a set voltage threshold, activating the high-voltage battery to charge the low-voltage battery; and for monitoring the remaining power of the high-voltage battery and, when the remaining power is lower than a set power threshold, disabling the sentry mode.

9. A vehicle sentry mode energy-saving control device, characterized in that, include: One or more processors; Memory; One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more applications being configured to perform the vehicle sentry mode energy-saving control method as described in any one of claims 1 to 5.

10. A computer program product, characterized in that, Includes computer instructions that instruct a computer device to perform an operation corresponding to the method as described in any one of claims 1 to 5.

Images