Vehicle sentry mode energy-saving control method and device and computer program product

Abstract

The invention discloses a vehicle sentry mode energy-saving control method and device and a computer program product, and the method comprises the steps: controlling a vehicle-mounted camera to collect an environment video stream in a first collection mode when a vehicle enters a sentry mode; performing moving target detection based on the environment video stream, and dynamically adjusting a working mode according to a detection result; wherein when the effective moving target is not detected, the vehicle-mounted camera is controlled to collect the environment video stream in a second collection mode, the whole vehicle is controlled to be in a low-voltage power supply state, and the image pixel and the frame rate of the second collection mode are both lower than those of the first collection mode; and when the effective moving target is detected, if the real-time distance between the effective moving target and the vehicle is smaller than a preset warning distance threshold value, controlling a vehicle-mounted camera to collect an environment video stream in a first collection mode. According to the invention, the electric energy of the whole vehicle when the sentry mode of the vehicle is started and the operation computing power of the intelligent cabin area controller can be effectively saved.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent connected vehicles, and particularly to an energy-saving control method, device and computer program product for a vehicle sentry mode. Background Art

[0002] When the current intelligent vehicle enables the sentry security mode, there are problems of system performance energy loss and hardware reliability that need to be solved urgently. Specifically, the existing technical solutions have significant technical defects in the following three dimensions: First, in terms of maintaining the high-voltage system, the continuous activation of the sentry mode requires the vehicle's high-voltage distribution system (HVDS) to maintain an uninterrupted power supply state, resulting in the battery management system (BMS) continuously supplying power to high-energy-consuming modules such as the perception system, computing unit, and storage device, causing an abnormal increase in the vehicle's static power consumption. Second, at the image processing architecture level, the existing solutions force the in-vehicle surround camera module to transmit the original video stream to the intelligent cockpit domain controller (IDC) with high-definition and high-frame-rate parameters, resulting in the IDC needing to continuously run computationally intensive tasks such as color space conversion and real-time encoding, significantly increasing the thermal power consumption and shortening the service life of the computing unit. Third, in terms of the data storage mechanism, the existing loop recording function adopts a continuous overwrite write strategy, resulting in the eMMC or UFS embedded memory performing too many full-capacity erase and write operations, reducing the service life. The synergistic effect of the above technical defects not only exacerbates the vehicle's energy consumption, but also poses an irreversible risk of performance degradation to the in-vehicle computing platform and storage system, seriously restricting the sustainable development of the intelligent vehicle safety protection system. Summary of the Invention

[0003] The technical problem to be solved by the embodiments of the present invention is to provide an energy-saving control method, device and computer program product for a vehicle sentry mode to reduce the power consumption of the vehicle when working in the sentry mode.

[0004] To solve the above technical problem, the present invention provides an energy-saving control method for a vehicle sentry mode, including the following steps:

[0005] When the vehicle enters the sentry mode, control the in-vehicle camera to collect the environmental video stream in the first acquisition mode;

[0006] Perform moving target detection based on the environmental video stream, and dynamically adjust the working mode according to the detection result;

[0007] Wherein, when no valid active target is detected, the on-vehicle camera is controlled to collect an environmental video stream in a second acquisition mode, and the whole vehicle is controlled to enter a low-voltage power supply state. The image pixels and frame rate of the second acquisition mode are both lower than those of the first acquisition mode;

[0008] When a valid active target is detected, if the real-time distance between the valid active target and the vehicle is less than a preset warning distance threshold, the on-vehicle camera is controlled to collect an environmental video stream in the first acquisition mode.

[0009] Preferably, when a valid active target is detected, if the real-time distance between the valid active target and the vehicle is less than a preset warning distance threshold, and the stay duration is greater than or equal to a preset warning duration threshold, the on-vehicle camera is controlled to collect an environmental video stream in the first acquisition mode.

[0010] Preferably, the method further includes a power protection step:

[0011] Monitor the voltage of the low-voltage battery. When the voltage is lower than the set voltage threshold, start the high-voltage battery to charge the low-voltage battery;

[0012] Monitor the remaining power of the high-voltage battery. When the remaining power is lower than the set power threshold, turn off the sentry mode.

[0013] Preferably, after controlling the on-vehicle camera to collect an environmental video stream in the first acquisition mode, a warning operation is further included. The warning operation includes at least one of the following:

[0014] Vehicle light warning;

[0015] Upload the environmental video stream containing the valid active target to the cloud server;

[0016] Send a warning notice to the vehicle owner's terminal.

[0017] Preferably, the image pixels of the first acquisition mode are not less than 2Mp and the frame rate is not less than 25fps; the image pixels of the second acquisition mode are not higher than 0.3Mp and the frame rate is not higher than 1fps.

[0018] The present invention also provides a vehicle sentry mode energy-saving control device, including an on-vehicle camera and an intelligent cockpit domain controller;

[0019] The intelligent cockpit domain controller is used to, when the vehicle enters the sentry mode, control the on-vehicle camera to collect an environmental video stream in the first acquisition mode; and perform active target detection based on the environmental video stream, and dynamically adjust the working mode according to the detection result;

[0020] Among them, when no valid moving target is detected, the intelligent cockpit domain controller is used to control the in-vehicle camera to collect the environmental video stream in the second acquisition mode, and control the whole vehicle to enter the low-voltage power supply state. The image pixels and frame rate of the second acquisition mode are both lower than those of the first acquisition mode;

[0021] When a valid moving target is detected, if the real-time distance between the valid moving target and the vehicle is less than the preset warning distance threshold, the intelligent cockpit domain controller is used to control the in-vehicle camera to collect the environmental video stream in the first acquisition mode; otherwise, the environmental video stream is not collected.

[0022] Preferably, when a valid moving target is detected, if the real-time distance between the valid moving target and the vehicle is less than the preset warning distance threshold and the staying duration is greater than or equal to the preset warning duration threshold, the intelligent cockpit domain controller is used to control the in-vehicle camera to collect the environmental video stream in the first acquisition mode.

[0023] Preferably, the device further includes a power protection module, which is used to monitor the voltage of the low-voltage battery and start the high-voltage battery to charge the low-voltage battery when the voltage is lower than the set voltage threshold; and monitor the remaining power of the high-voltage battery and turn off the sentry mode when the remaining power is lower than the set power threshold.

[0024] The present invention also provides a vehicle sentry mode energy-saving control device, including:

[0025] One or more processors;

[0026] A memory;

[0027] One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, and the one or more applications are configured to execute the vehicle sentry mode energy-saving control method described above.

[0028] The present invention also provides a computer program product, including computer instructions, and the computer instructions direct the computer device to execute the corresponding operations of the method.

[0029] Implementing the present invention has the following beneficial effects: By constructing a multi-dimensional energy-saving control scheme based on visual perception, the present invention realizes efficient energy consumption management in the vehicle sentry mode, significantly reduces system energy consumption while ensuring the safety monitoring accuracy, significantly extends the service life of the U disk and eMMC storage chips, and at the same time reduces the storage medium loss caused by frequent reading and writing. On the premise of ensuring the reliability of safety monitoring, the present invention realizes the three-dimensional balance of energy consumption management, computing power allocation and storage optimization, and provides an innovative solution for the efficient integration of the intelligent vehicle electronic architecture. Description of the Drawings

[0030] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the accompanying drawings required for the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other accompanying drawings can be obtained based on these drawings.

[0031] Figure 1 It is a schematic flowchart of an energy-saving control method for a vehicle sentry mode in Embodiment 1 of the present invention.

[0032] Figure 2 It is a specific schematic flowchart of an energy-saving control method for a vehicle sentry mode in Embodiment 1 of the present invention. Specific embodiments

[0033] The following descriptions of the embodiments refer to the accompanying drawings to exemplify specific embodiments in which the present invention can be implemented.

[0034] Please refer to Figure 1 As shown, Embodiment 1 of the present invention provides an energy-saving control method for a vehicle sentry mode, including the following steps:

[0035] When the vehicle enters the sentry mode, control the in-vehicle camera to collect the environmental video stream in the first acquisition mode;

[0036] Perform active target detection based on the environmental video stream, and dynamically adjust the working mode according to the detection result;

[0037] Among them, when no valid active target is detected, control the in-vehicle camera to collect the environmental video stream in the second acquisition mode, and control the whole vehicle to switch to the low-voltage power supply state. The image pixels and frame rate of the second acquisition mode are both lower than those of the first acquisition mode;

[0038] When a valid active target is detected, if the real-time distance between the valid active target and the vehicle is less than the preset warning distance threshold, control the in-vehicle camera to collect the environmental video stream in the first acquisition mode.

[0039] Through the above steps, it can be seen that in the embodiment of the present invention, by dynamically adjusting the working state of the sentry mode, while ensuring the safety monitoring efficiency, the vehicle battery life and the service life of the storage medium are significantly extended: when no valid active target is detected, the second acquisition mode with low resolution and low frame rate is adopted and switched to the low-voltage power supply state, which can reduce the power consumption of the camera and the energy consumption of the whole vehicle; when a valid active target is detected and its distance is less than the preset warning distance threshold, immediately switch to the first acquisition mode with high resolution and high frame rate to ensure the integrity and legal effect of key evidence; and when the target distance exceeds the warning distance threshold, maintain the non-acquisition state to avoid the storage of invalid video data and reduce the number of write / erase operations of the storage medium.

[0040] Specifically, please combine with Figure 2 As shown, in the embodiment of the present invention, the in-vehicle camera collects the environmental video stream around the vehicle and inputs the surrounding environmental information into the intelligent cockpit domain controller IDC. The intelligent cockpit domain controller IDC is provided with a visual perception algorithm module, which continuously analyzes the environmental video stream based on the deep learning object detection algorithm to identify effective moving targets in real time. The remote communication module T-Box is responsible for uploading vehicle information / voice / cockpit pictures, etc. to the cloud. It can be understood that the effective moving target refers to a dynamic object that is determined by the visual perception algorithm to potentially have a direct impact on vehicle safety or the driving scenario, including but not limited to pedestrians, vehicles, non-motor vehicles, etc. When the vehicle enters the sentry mode, the vehicle's high-voltage power supply system is activated, and the in-vehicle camera collects the environmental video stream in the first acquisition mode in real time and transmits it to the visual perception algorithm module of the intelligent cockpit domain controller IDC through a high-speed bus. As an example, the image pixels of the first acquisition mode are not less than 2Mp and the frame rate is not less than 25fps. The in-vehicle camera is specifically a surround-view camera, and 4 are provided in this embodiment.

[0041] If the visual perception algorithm module does not detect an effective moving target within a continuous monitoring period of n minutes, it will first send a control instruction to the in-vehicle camera to switch its working mode to the second acquisition mode. As an example, the image pixels of the second acquisition mode are not higher than 0.3Mp and the frame rate is not higher than 1fps. The front-end power consumption is reduced by reducing the data throughput of the image sensor. The vehicle power supply system is synchronously switched to the low-voltage mode, and only the electric energy required for basic perception functions is maintained. The monitoring period n can be set according to the actual situation, usually 3-5 minutes.

[0042] It should be noted that the computing power of the CPU / GPU / NPU, etc. of the intelligent cockpit domain controller IDC is limited. If starting the sentry mode occupies too much of the IDC's computing power, other applications (such as 3D car models, desktops, navigation, etc.) that are also running in the parking scenario may pause and their functions may fail. When the user starts driving the vehicle next time, applications such as 3D car models, desktops, and navigation need to be restarted, and the time required for the IDC to start with full functions will be extended, greatly affecting the user experience. In the embodiment of the present invention, after the vehicle switches to the low-voltage power supply state, the IDC is also in the low-power mode. The environmental video stream with low pixels and low frame rate is input into the visual perception algorithm module of the IDC, and the occupation of the computing power of the CPU / GPU / NPU, etc. in the IDC will be reduced by 5%-10%, thus avoiding the problem that applications running in the parking scenario may not be able to run due to excessive occupation of computing power.

[0043] When an effective moving target is detected, the embodiment of the present invention will perform a differentiated response according to the real-time distance between the effective moving target and the vehicle.

[0044] The visual perception algorithm module of the IDC detects that an active target is approaching the vehicle, i.e.:

[0045] S < L

[0046] where S is the real-time distance between the effective active target and the vehicle, and L is the preset warning distance threshold.

[0047] The on-vehicle camera will be controlled to collect the environmental video stream in the first acquisition mode, and the collected environmental video stream will be saved to the memory storage chip or USB flash drive of the IDC. At the same time, a safety warning will be triggered: including warning the intruder by flashing the vehicle lights, uploading the video of the intruder to the cloud through the T-BOX, and sending a text message notification to the vehicle owner to achieve remote monitoring and timely response. The IDC will maintain the normal power consumption mode at this time to support video recording, target recognition, and warning operations.

[0048] It can be understood that starting to collect the environmental video stream when S < L, that is, controlling the trigger condition of the collection through the preset warning distance threshold L, can avoid the storage medium being covered by invalid videos, extend the service life of the storage chip or USB flash drive. At the same time, it also avoids the continuous high load operation of the IDC and storage resources. The preset warning distance threshold L can be optimized according to the actual scenario (such as parking lot, road, etc.), environmental complexity (such as day / night, population density, etc.).

[0049] If S ≥ L, it indicates that the active target is far from the vehicle and will not pose a direct threat to the vehicle. Then, the collection of the environmental video stream will not be started to avoid the storage medium being covered by invalid videos, thereby reducing the number of erasures and the scrapping risk of the storage chip or USB flash drive. It can be understood that when the active target is far from the vehicle, its behavior trajectory has a large uncertainty. If the environmental video stream collection is started at this time (even in the second acquisition mode with low power consumption), a large amount of low-value video data will be generated, resulting in invalid erasure of the storage medium.

[0050] As a further improvement of the embodiment of the present invention, in addition to the preset warning distance threshold, a warning duration threshold T is also set. That is, in addition to satisfying that the real-time distance S between the effective active target and the vehicle is less than the preset warning distance threshold L (S < L), it is also necessary to satisfy that the staying duration t of the effective active target is greater than or equal to the preset warning duration threshold T (t ≥ T) to start collecting the environmental video stream, that is, to control the on-vehicle camera to collect the environmental video stream in the first acquisition mode.

[0051] It can be understood that the preset warning distance threshold L delimits a warning area for the vehicle. When the real-time distance S between an effective moving target (such as a pedestrian, another vehicle, etc.) and the vehicle is less than the preset warning distance threshold L, it is considered that the effective moving target has entered the warning area. The preset warning duration threshold T is a time value set in the embodiments of the present invention. When the staying duration t of the effective moving target in the warning area is greater than or equal to the preset warning duration threshold T, it is determined that the staying time of the effective moving target in the warning area is long enough and there may be potential safety risks.

[0052] Only when the above two conditions are simultaneously satisfied, the on-vehicle camera will be activated to collect the environmental video stream in the first acquisition mode. That is, the embodiments of the present invention not only focus on whether the effective moving target enters the warning area, but also on its staying time in the warning area, which can filter out those targets that briefly enter the warning area but quickly leave, reduce unnecessary video acquisition and storage, improve the accuracy and efficiency of vehicle safety monitoring, and reduce false alarms and unnecessary resource consumption.

[0053] During the implementation of the vehicle sentry mode energy-saving control method in the embodiments of the present invention, the voltage of the low-voltage battery is also monitored in real time. When it is lower than 12V, the high-voltage battery is activated to intelligently charge the low-voltage battery. The low voltage of the low-voltage battery below 12V indicates that the power of the low-voltage battery is insufficient, which may affect the normal operation of the sentry mode. When the remaining power of the high-voltage battery is lower than the preset power threshold (for example, ≤10%), the sentry mode is forcibly turned off to avoid over-discharging of the high-voltage battery and protect the battery life.

[0054] Corresponding to the vehicle sentry mode energy-saving control method described in the foregoing Embodiment 1 of the present invention, Embodiment 2 of the present invention further provides a vehicle sentry mode energy-saving control device, including an on-vehicle camera and an intelligent cockpit domain controller;

[0055] The intelligent cockpit domain controller is used to control the on-vehicle camera to collect the environmental video stream in the first acquisition mode when the vehicle enters the sentry mode; and perform moving target detection based on the environmental video stream and dynamically adjust the working mode according to the detection result;

[0056] Wherein, when no effective moving target is detected, the intelligent cockpit domain controller is used to control the on-vehicle camera to collect the environmental video stream in the second acquisition mode and control the whole vehicle to enter the low-voltage power supply state. The image pixels and frame rate of the second acquisition mode are both lower than those of the first acquisition mode;

[0057] When an effective moving target is detected, if the real-time distance between the effective moving target and the vehicle is less than the preset warning distance threshold, the intelligent cockpit domain controller is used to control the on-vehicle camera to collect the environmental video stream in the first acquisition mode; otherwise, the environmental video stream is not collected.

[0058] Preferably, when the intelligent cockpit domain controller detects a valid moving target, if the real-time distance between the valid moving target and the vehicle is less than a preset warning distance threshold and the staying duration is greater than or equal to a preset warning duration threshold, it controls the in-vehicle camera to collect an environmental video stream in a first acquisition mode.

[0059] Preferably, the device further includes a power protection module, which is configured to monitor the voltage of the low-voltage battery and start the high-voltage battery to charge the low-voltage battery when the voltage is lower than a set voltage threshold; and monitor the remaining power of the high-voltage battery and turn off the sentry mode when the remaining power is lower than a set power threshold.

[0060] Corresponding to the vehicle sentry mode energy-saving control method described in the foregoing Embodiment 1 of the present invention, Embodiment 3 of the present invention further provides a vehicle sentry mode energy-saving control device, including:

[0061] One or more processors;

[0062] A memory;

[0063] One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, and the one or more applications are configured to execute the vehicle sentry mode energy-saving control method described in the foregoing Embodiment 1 of the present invention.

[0064] Corresponding to the vehicle sentry mode energy-saving control method described in the foregoing Embodiment 1 of the present invention, Embodiment 4 of the present invention further provides a computer program product, including computer instructions, and the computer instructions direct a computer device to perform operations corresponding to the vehicle sentry mode energy-saving control method described in the foregoing Embodiment 1 of the present invention.

[0065] Preferably, the processor may be a Central Processing Unit (CPU), or may also be other general-purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field-Programmable Gate Arrays (FPGAs) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor, or the processor may also be any conventional processor. The processor is the control center of the device and connects various parts of the device through various interfaces and lines.

[0066] The memory mainly includes a program storage area and a data storage area. Among them, the program storage area can store an operating system, application programs required for at least one function, etc., and the data storage area can store relevant data, etc. In addition, the memory can be a high-speed random access memory, or a non-volatile memory, such as a plug-in hard disk, a SmartMedia Card (SMC), a Secure Digital (SD) card, a Flash Card, etc., or the memory can also be other volatile solid-state storage devices.

[0067] It should be noted that the above device may include but is not limited to a processor and a memory, which can be understood by those skilled in the art.

[0068] Regarding the working principle and process of the above embodiments, refer to the description of Embodiment 1 of the present invention above, and details will not be repeated here.

[0069] From the above description, it can be seen that compared with the prior art, the beneficial effects of the present invention are as follows: By constructing a multi-dimensional energy-saving control scheme based on visual perception, the present invention realizes efficient energy consumption management in the vehicle sentry mode, significantly reduces system energy consumption while ensuring the accuracy of security monitoring, significantly extends the service life of the U disk and the eMMC storage chip, and at the same time reduces the storage medium loss caused by frequent reading and writing. On the premise of ensuring the reliability of security monitoring, the present invention realizes a three-dimensional balance of energy consumption management, computing power allocation and storage optimization, providing an innovative solution for the efficient integration of the intelligent vehicle electronic architecture.

[0070] The above-disclosed are only the preferred embodiments of the present invention, and of course, the scope of the rights of the present invention cannot be limited thereby. Therefore, equivalent changes made according to the claims of the present invention still fall within the scope covered by the present invention.

Claims

1. A vehicle sentry mode energy-saving control method, characterized in that: The following steps are involved: When the vehicle enters the sentry mode, the vehicle-mounted camera is controlled to collect the environment video stream in the first collection mode; Performing active target detection based on the environmental video stream, and dynamically adjusting the working mode according to the detection result; When no valid active target is detected, the vehicle-mounted camera is controlled to collect the environmental video stream in the second acquisition mode, and the whole vehicle is controlled to switch to a low-voltage power supply state. The image pixels and frame rate of the second acquisition mode are lower than those of the first acquisition mode. When a valid moving target is detected, if the real-time distance between the valid moving target and the vehicle is less than a preset warning distance threshold, the vehicle-mounted camera is controlled to collect the environment video stream in the first collection mode.

2. The method according to claim 1, characterized in that When a valid moving target is detected, if the real-time distance between the valid moving target and the vehicle is less than the preset warning distance threshold, and the stay time is greater than or equal to the preset warning time threshold, the vehicle-mounted camera is controlled to collect the environmental video stream in the first collection mode.

3. The method according to claim 1, characterized in that Also includes power protection steps: Monitor the voltage of the low-voltage battery, and when the voltage is lower than the set voltage threshold, start the high-voltage battery to charge the low-voltage battery; Monitor the remaining power of the high-voltage battery and turn off the Sentinel Mode when the remaining power falls below the set power threshold.

4. The method according to claim 1, characterized in that: After controlling the vehicle-mounted camera to collect the environment video stream in the first collection mode, the method further includes triggering an alarm operation, where the alarm operation includes at least one of the following: Vehicle light warning; Uploading the environment video stream containing the valid activity target to the cloud server; Send an alarm notification to the vehicle owner's terminal.

5. The method according to claim 1, characterized in that The image pixel of the first acquisition mode is not less than 2Mp and the frame rate is not less than 25fps; the image pixel of the second acquisition mode is not higher than 0.3Mp and the frame rate is not higher than 1fps.

6. A vehicle sentry mode energy-saving control device, characterized in that: Including on-board cameras and smart cockpit domain controllers; The smart cockpit domain controller is used to control the vehicle-mounted camera to collect the environment video stream in the first collection mode when the vehicle enters the sentinel mode; and to detect active targets based on the environment video stream, and dynamically adjust the working mode according to the detection result; Among them, when no valid active target is detected, the intelligent cockpit domain controller is used to control the on-board camera to collect the environmental video stream in the second acquisition mode, and control the whole vehicle to enter the low-voltage power supply state. The image pixels and frame rate of the second acquisition mode are lower than those of the first acquisition mode; When a valid moving target is detected, if the real-time distance between the valid moving target and the vehicle is less than a preset warning distance threshold, the smart cockpit domain controller is used to control the on-board camera to collect the environmental video stream in the first collection mode.

7. The device according to claim 6, characterized in that The smart cockpit domain controller is used to control the vehicle-mounted camera to collect the environmental video stream in the first collection mode when a valid active target is detected, if the real-time distance between the valid active target and the vehicle is less than a preset warning distance threshold, and the stay time is greater than or equal to the preset warning time threshold.

8. The device according to claim 6, characterized in that It also includes a power protection module for monitoring the low-voltage battery voltage, starting the high-voltage battery to charge the low-voltage battery when the voltage is lower than a set voltage threshold; and monitoring the remaining power of the high-voltage battery, and turning off the sentinel mode when the remaining power is lower than a set power threshold.

9. A vehicle sentry mode energy-saving control device, characterized in that: include: one or more processors; Memory; One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, and the one or more applications are configured to execute the vehicle sentry mode energy-saving control method as described in any one of claims 1 to 5.

10. A computer program product, characterized in that The method comprises computer instructions, wherein the computer instructions instruct a computer device to execute operations corresponding to the method according to any one of claims 1 to 5.

Images