Auxiliary reversing method, system and equipment and medium

Abstract

The invention provides an auxiliary reversing method, system and device and a medium, and the method comprises the steps: obtaining the driving mode of a vehicle, the current vehicle speed and the external environment brightness of the vehicle, determining the auxiliary brightness based on the mapping relation between the preset environment brightness and the auxiliary brightness when the vehicle enters a reversing mode and the current vehicle speed is greater than a preset vehicle speed threshold value, the behavior of the driver is recognized, if the driver has the behavior of observing the rear portion of the vehicle through a rearview mirror, a vehicle window of the vehicle is controlled to descend, the brightness of a backup lamp of the vehicle is adjusted to the auxiliary light brightness, the running mode of the vehicle is continuously monitored till the vehicle enters a parking mode, and the backup lamp and the vehicle window are turned off; according to the method, the car backing experience of a driver under different light conditions is improved by intelligently adjusting the brightness of the car backing lamp and the opening and closing state of the car window, and therefore the car backing safety is improved.

Description

Technical Field

[0001] The present application relates to the field of intelligent control technology, and in particular to an auxiliary reversing method, system, device and medium. Background Art

[0002] With the development of modern society, vehicles have become an indispensable part of people's daily lives, and with it comes an increasing demand for parking spaces. However, despite the continuous improvement of parking facilities, many parking spaces still have poor lighting problems, especially in some old or remote parking lots. These places have poor lighting conditions or even no lighting facilities at all, which poses a challenge to drivers.

[0003] Even in modern vehicles equipped with advanced assistance systems, such as reversing camera systems and automatic parking functions, drivers may encounter difficulties in low light conditions. Among them, the reversing camera system can provide the driver with a real-time view behind the vehicle, but when the light conditions are poor, the image quality will be affected and become blurry, making it difficult to accurately identify obstacles or pedestrians behind. As for the automatic parking function, although it can reduce the burden on the driver to a certain extent, the automatic parking system needs to rely on sensors and cameras installed on the vehicle to perceive the surrounding environment, and these devices may not work properly in dark or complex environments.

[0004] It can be seen that under the existing technical framework, when the lighting conditions in the reversing environment are poor, it will limit the ability to recognize the surrounding environment, thereby increasing the safety hazards during the reversing process. Summary of the invention

[0005] In view of the above-mentioned shortcomings of the prior art, the present application provides an auxiliary reversing method, system, device and medium to solve the above-mentioned technical problems.

[0006] The present application provides an assisted reversing method, the method comprising: obtaining a vehicle's driving mode, current vehicle speed, and vehicle external ambient light brightness, the driving mode comprising at least a reversing mode and a parking mode; when the vehicle enters the reversing mode and the current vehicle speed is greater than a preset vehicle speed threshold, determining the auxiliary light brightness corresponding to the vehicle external ambient light brightness in the current state based on a preset mapping relationship between ambient light brightness and auxiliary light brightness; identifying the driver's behavior, and if the driver observes the rear of the vehicle through a rearview mirror, controlling the vehicle's windows to lower and adjusting the brightness of the vehicle's reversing lights to the auxiliary light brightness; and continuously monitoring the vehicle's driving mode until the vehicle enters the parking mode, and turning off the reversing lights and windows.

[0007] In one embodiment of the present application, after determining the auxiliary light brightness corresponding to the vehicle's external ambient light brightness in the current state, it also includes: adjusting the color temperature of the interior ambient light and the brightness of the on-board electronic display screen in the vehicle based on the auxiliary light brightness, specifically including: if the auxiliary light brightness is higher than a preset brightness threshold, adjusting the color temperature of the interior ambient light to a warm tone; adjusting the brightness of the on-board electronic display screen according to a preset relationship between the auxiliary light brightness and the display screen brightness.

[0008] In one embodiment of the present application, after adjusting the brightness of the vehicle's reversing lights to the auxiliary light brightness, the method also includes: determining the reversing duration and counting down based on the reversing duration, wherein the reversing duration is used to control the lighting duration of the reversing lights; monitoring the vehicle's driving mode; if a driving mode switch is detected, clearing the countdown, and restarting the countdown when the new driving mode is switched to the reversing mode; if no driving mode switch is detected, turning off the reversing lights after the countdown ends.

[0009] In one embodiment of the present application, after setting the reversing time, the method also includes: displaying countdown information on an on-board display screen in the vehicle, the countdown information being used to represent the remaining time information of the countdown; generating a corresponding countdown prompt based on the countdown information, the countdown prompt including a sound prompt and / or a vibration prompt; during the countdown, displaying the remaining countdown time through the on-board display screen, and issuing a countdown warning to the driver through a sound prompt or vibration.

[0010] In one embodiment of the present application, the driver's behavior is identified, including: obtaining image information of the cockpit of the vehicle; performing image recognition on the image information, and the image recognition includes: locating the driver's face in the image, and counting the angle changes of the driver's face in consecutive frame images to identify the driver's line of sight direction; judging the driver's behavioral intention based on the image recognition result, and if the driver's line of sight is towards the rearview mirror, it is determined that the driver is observing the rear of the vehicle through the rearview mirror.

[0011] In one embodiment of the present application, before controlling the vehicle's windows to lower, it also includes: acquiring environmental information outside the vehicle; detecting the environmental information, the detection including: detecting whether there is rain based on a rain sensor, detecting air humidity based on a humidity sensor, and detecting wind speed based on a wind speed sensor; judging whether there is windy and rainy conditions in the external environment based on the detection results, if the rain sensor detects rain and the humidity sensor detects that the air humidity is higher than a preset threshold, it is determined that there is rain in the external environment; if the wind speed sensor detects that the wind speed is higher than a preset threshold, it is determined that there is wind in the external environment; if the detection result shows that there is wind or rain in the external environment, the window lowering function is disabled.

[0012] In one embodiment of the present application, when the driving mode is switched to the parking mode and the reversing lights and the windows are turned on, it also includes: collecting user feedback, wherein the user feedback is feedback information of the user based on the auxiliary light brightness adjustment result; if the satisfaction of the user feedback is lower than a preset satisfaction threshold, the mapping relationship between the auxiliary light brightness and the ambient light brightness is adjusted based on the user feedback.

[0013] The present application provides an assisted backing up system, the system comprising: an information acquisition module, used to obtain a vehicle's driving mode, current vehicle speed, and vehicle external ambient light brightness; an auxiliary light brightness determination module, used to determine, when the vehicle enters a backing up mode and the current vehicle speed is greater than a preset vehicle speed threshold, the auxiliary light brightness corresponding to the vehicle's external ambient light brightness in the current state based on a preset mapping relationship between ambient light brightness and auxiliary light brightness; an auxiliary control module, used to identify the driver's behavior, and if the driver observes the rear of the vehicle through a rearview mirror, control the vehicle's windows to drop and adjust the brightness of the vehicle's backing lights to the auxiliary light brightness; a parking monitoring and management module, used to continuously monitor the vehicle's driving mode until the vehicle enters a parking mode, and turn off the backing lights and windows.

[0014] The present application provides an electronic device, characterized in that it includes a processor, a memory and a communication bus; the communication bus is used to connect the processor and the memory; the processor is used to execute a computer program stored in the memory to implement the assisted reversing method as described above.

[0015] The present application provides a computer-readable storage medium, characterized in that a computer program is stored thereon, and the computer program is used to enable a computer to execute the auxiliary reversing method as described above.

[0016] Beneficial effects of the present application: The assisted reversing method in the present application obtains the vehicle's driving mode, current vehicle speed, and external environment brightness information in real time. When the vehicle enters the reversing mode and the vehicle speed exceeds a preset threshold, the brightness of the reversing lights is automatically adjusted according to the mapping relationship between the preset ambient light brightness and the auxiliary light brightness to adapt to the current ambient light conditions, and the vehicle is controlled based on the driver's behavior to provide the driver with better vision conditions. The problem of the traditional reversing assistance system's performance degradation in low-light environments and the problem of the windows blocking the driver's vision to a certain extent are overcome. By intelligently adjusting the brightness of the reversing lights and windows, the driver's recognition of the surrounding environment is enhanced, a clearer vision condition is provided, and safety hazards are reduced.

[0017] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The drawings herein are incorporated into the specification and constitute a part of the specification, showing embodiments consistent with the present application, and together with the specification, are used to explain the principles of the present application. Obviously, the drawings described below are only some embodiments of the present application, and for those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work. In the drawings:

[0019] Figure 1 is a schematic diagram of an implementation environment of an auxiliary backing method shown in an exemplary embodiment of the present application;

[0020] Figure 2 is a flow chart of an auxiliary backing method shown in an exemplary embodiment of the present application;

[0021] Figure 3 is a schematic diagram of the overall steps of an auxiliary reversing method shown in an exemplary embodiment of the present application;

[0022] Figure 4 is a block diagram of an auxiliary backing system shown in an exemplary embodiment of the present application;

[0023] Figure 5 A schematic diagram of the structure of a computer system suitable for implementing an electronic device of an embodiment of the present application is shown. DETAILED DESCRIPTION

[0024] The following will describe the implementation methods of the present application with reference to the accompanying drawings and preferred embodiments. Those skilled in the art can easily understand other advantages and effects of the present application from the contents disclosed in this specification. The present application can also be implemented or applied through other different specific implementation methods, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present application. It should be understood that the preferred embodiments are only for illustrating the present application, not for limiting the scope of protection of the present application.

[0025] It should be noted that the illustrations provided in the following embodiments are only schematic illustrations of the basic concept of the present application, and thus the drawings only show components related to the present application rather than being drawn according to the number, shape and size of components in actual implementation. In actual implementation, the type, quantity and proportion of each component may be changed at will, and the component layout may also be more complicated.

[0026] In the following description, a large number of details are discussed to provide a more thorough explanation of the embodiments of the present application. However, it is obvious to those skilled in the art that the embodiments of the present application can be implemented without these specific details. In other embodiments, well-known structures and devices are shown in the form of block diagrams rather than in detail to avoid making the embodiments of the present application difficult to understand.

[0027] Figure 1 It is a schematic diagram of an implementation environment of an auxiliary reversing method shown in an exemplary embodiment of the present application.

[0028] like Figure 1 As shown, the implementation environment of the assisted reversing method includes a data acquisition module 101 and a computer device 102. Among them, the data acquisition module 101 is responsible for collecting relevant data of the vehicle during the reversing process, and these data mainly include information such as the vehicle's driving mode, current vehicle speed, and brightness of the vehicle's external environment. The vehicle's driving mode (such as reversing mode, parking mode, etc.) is provided by the vehicle control system; the current vehicle speed information is obtained by real-time monitoring by the vehicle speed sensor or the on-board ECU; the brightness of the external environment is detected by the ambient light sensor installed on the vehicle. Therefore, the data acquisition module can be a variety of sensors integrated in the vehicle (such as vehicle speed sensors, ambient light sensors, etc.), or it can be other devices connected through the vehicle network. This application does not impose any restrictions on the specific implementation form of the data acquisition module.

[0029] In addition, the computer device 102 is used to process the data collected by the data acquisition module 101. Specifically, the computer device can obtain and analyze the vehicle's driving mode information and ambient light brightness data in real time, and intelligently determine a suitable auxiliary light brightness based on this information. After determining the auxiliary light brightness corresponding to the current ambient light brightness, the computer device will generate corresponding control instructions to adjust the brightness of the reversing lights to ensure that under different lighting conditions, the reversing lights can provide the driver with the best visual assistance effect. In addition, by identifying the driver's behavior, intelligent control of the windows is achieved to provide the driver with better visual conditions. Therefore, the computer device 102 can be a high-performance central processing unit, a dedicated on-board computing unit, or an embedded system integrated in the vehicle control system. This application also does not impose any restrictions on the specific type of computer devices.

[0030] Figure 2 It is a flow chart of an assisted backing method shown in an exemplary embodiment of the present application.

[0031] like Figure 2 As shown, in an exemplary embodiment, the auxiliary backing method includes at least steps S210 to S240, which are described in detail as follows:

[0032] Step S210, obtaining the driving mode of the vehicle, the current speed of the vehicle, and the brightness of the ambient light outside the vehicle, wherein the driving mode includes at least a reverse mode and a parking mode.

[0033] In one embodiment of the present application, a sensor is installed inside the vehicle or an existing driving computer data interface is used to monitor the driving status of the vehicle, and its driving modes mainly include but are not limited to reverse mode (i.e., shifting into R gear) and parking mode (i.e., shifting into P gear). The actual driving speed of the vehicle is obtained by using an on-board speed sensor. When the vehicle enters reverse mode, the system starts to record the speed and compares it with a preset safety threshold. Only when the speed exceeds this threshold will the subsequent auxiliary light brightness adjustment be initiated. An ambient light sensor is installed at an appropriate position of the vehicle (usually the rear of the vehicle) to measure the brightness level of the environment behind the vehicle. These sensors should be able to feedback light intensity data in real time for system analysis.

[0034] It is understandable that when the vehicle switches from other modes to the reverse mode and the current vehicle speed is higher than the preset threshold, the system starts to collect ambient light brightness data. This series of data collection and status detection constitutes the basic steps of the entire assisted reverse method and provides necessary information support for subsequent brightness adjustment. In this way, the system can respond to the driver's operation in a timely manner and take corresponding auxiliary measures according to the actual environmental conditions.

[0035] Step S220, when the vehicle enters the reverse mode and the current vehicle speed is greater than a preset vehicle speed threshold, based on a preset mapping relationship between the ambient light brightness and the auxiliary light brightness, the auxiliary light brightness corresponding to the vehicle's external ambient light brightness in the current state is determined.

[0036] In one embodiment of the present application, after determining the auxiliary light brightness corresponding to the vehicle's external ambient light brightness in the current state, it also includes: adjusting the color temperature of the interior ambient light and the brightness of the vehicle's electronic display based on the auxiliary light brightness, specifically including: if the auxiliary light brightness is higher than a preset brightness threshold, adjusting the color temperature of the interior ambient light to a warm tone; adjusting the brightness of the vehicle's electronic display according to a preset relationship between the auxiliary light brightness and the display brightness, so that it maintains a preset visibility under different auxiliary light brightnesses.

[0037] In a specific embodiment of the present application, it is assumed that the unit of the ambient light brightness and the auxiliary light brightness is lux, and the preset brightness threshold is 50lux. When the auxiliary light brightness is higher than the preset brightness threshold (50lux), it indicates that the current ambient light is sufficient. In order to create a more comfortable in-car atmosphere, the system will automatically adjust the color temperature of the in-car atmosphere light to a warm tone. Specifically, when the auxiliary light brightness>50lux, the system adjusts the color temperature of the in-car atmosphere light to a warm white color of 2700K~3000K; if the auxiliary light brightness is ≤50lux, the current color temperature of the atmosphere light is maintained unchanged, or it is set to a cool tone (for example, 6500K) according to the driver's preference to enhance visibility.

[0038] In addition, the brightness of the on-board electronic display screen can be adjusted according to the preset relationship between the auxiliary light brightness and the display screen brightness to ensure that the display screen can maintain the preset visibility under different auxiliary light brightness. Specifically, assume that the adjustment range of the display screen brightness is 0% to 100%, where 0% represents the darkest and 100% represents the brightest. When the auxiliary light brightness is <50lux, the display screen brightness is set to 100%; when the auxiliary light brightness is between 50lux and 200lux, the display screen brightness decreases linearly, that is, the brightness decreases by 20% for every 50lux increase; when the auxiliary light brightness is >200lux, the display screen brightness is maintained at 40%.

[0039] The specific methods for adjusting the brightness of the ambient light and electronic display are as follows:

[0040] The system reads the current ambient light brightness value and the current auxiliary light brightness, taking the current ambient light brightness value and the current auxiliary light brightness as 120 lux as an example. Since the auxiliary light brightness is > 50 lux, the system adjusts the color temperature of the interior ambient light to a warm white color of 2700K to 3000K. In addition, since the auxiliary light brightness is between 50 lux and 200 lux, according to the linear reduction rule, the display brightness is adjusted to 100% - (120 ÷ 50 × 20%) = 64%.

[0041] It can be understood that based on the above embodiments, the system can dynamically adjust the color temperature of the interior ambient light and the brightness of the vehicle electronic display according to the actual ambient light brightness to ensure that the driver can get the best visual experience under various lighting conditions, thereby improving the safety and convenience of reversing.

[0042] Step S230, identifying the driver's behavior, if the driver observes the rear of the vehicle through the rearview mirror, controlling the vehicle's windows to be lowered, and adjusting the brightness of the vehicle's reversing lights to the auxiliary light brightness.

[0043] In one embodiment of the present application, the driver's behavior is identified, including: obtaining image information of the vehicle's cockpit; performing image recognition on the image information, the image recognition including: locating the driver's face in the image, counting the angle changes of the driver's face in consecutive frame images to identify the driver's line of sight direction; judging the driver's behavioral intention based on the image recognition result, if the driver's line of sight is towards the rearview mirror, it is determined that the driver is observing the rear of the vehicle through the rearview mirror.

[0044] In a specific embodiment of the present application, in order to further improve the intelligence level of the reversing assistance system, after determining the auxiliary light brightness of the vehicle reversing, the driver's behavioral intention can also be judged by obtaining the image information of the cockpit and identifying the image, and based on this, it is decided whether to control the window to drop, so as to enhance the safety and convenience when reversing. When the vehicle enters the reversing mode and the brightness of the reversing light has been adjusted to the required auxiliary light brightness, a camera installed in the vehicle cockpit is used to capture a real-time image of the driver and his surroundings, and the driver's face in the image is located, and the key points of the face, such as the position of the eyes, nose and mouth, are identified, and then the angle changes of the driver's face in the continuous frame images are counted, and the direction and angle of the driver's head are analyzed by comparing the facial positions in the previous and next frame images. The direction of the driver's sight is then inferred based on the change in the facial angle. For example, if the head turns to the left, it can be considered that the driver is looking at the situation on the left; and vice versa. Finally, the system determines whether the driver is observing the situation behind the vehicle through the rearview mirror based on the image recognition results. If the image recognition results show that the driver's line of sight is toward the rearview mirror, the system will determine that the driver has the intention to observe the rear of the vehicle through the rearview mirror, and will control the window on one side of the vehicle to drop a certain distance (for example, to half the height) to reduce the window's obstruction to the driver's line of sight, allowing the driver to see the situation behind more clearly.

[0045] The specific way it recognizes the driver's intention and controls the windows is as follows:

[0046] After the system has adjusted the brightness of the reversing lights to the appropriate auxiliary light brightness according to the ambient light brightness, the camera in the cockpit starts to capture images and transmits the image information to the image processing module, which locates the face in the captured images and counts the changes in facial angles in consecutive frames to identify the driver's line of sight. When the image recognition result shows that the driver is looking at the rearview mirror, it is determined that the driver is observing the situation behind the vehicle through the rearview mirror, and then the window on one side of the vehicle is controlled to drop to a preset height (for example, half) to help the driver better observe the rear environment.

[0047] It can be understood that the method proposed based on the above embodiment can intelligently identify the driver's behavioral intention and take appropriate measures accordingly to improve the safety and convenience of the reversing process.

[0048] In addition, in the aforementioned embodiment, if the driver observes the rear of the vehicle through the rearview mirror, the window is controlled to be lowered and the brightness of the vehicle's reversing lights is adjusted to the auxiliary light brightness; in specific implementation scenarios, given the different driving habits of different drivers, some drivers are not used to reversing by observing the information in the rearview mirror, but instead perform reversing operations by observing the display information of the reversing radar. For drivers with this type of driving habits, they usually do not observe the rear of the vehicle through the rearview mirror, so there is no need to control the window, and the brightness of the vehicle's reversing lights can be directly adjusted to the auxiliary light brightness.

[0049] In a specific embodiment of the present application, before controlling the window to be lowered, the method also includes: obtaining environmental information outside the vehicle; detecting the environmental information, the detection including: detecting whether there is rain based on a rain sensor, detecting air humidity based on a humidity sensor, and detecting wind speed based on a wind speed sensor; judging whether there is windy and rainy conditions in the external environment based on the detection results, if the rain sensor detects rain and the humidity sensor detects that the air humidity is higher than a preset threshold, then it is determined that there is rain in the external environment; if the wind speed sensor detects that the wind speed is higher than a preset threshold, then it is determined that there is wind in the external environment; if the detection result shows that there is wind or rain in the external environment, then the window lowering function is disabled.

[0050] In a specific embodiment of the present application, in order to further improve the function of the reversing assistance system and ensure that the influence of the external environment is taken into account before controlling the window to be lowered, after adjusting the brightness of the vehicle's reversing lights to the auxiliary light brightness, the external environment information of the vehicle is obtained and detected to determine whether the external environment is suitable for the window to be lowered. Before deciding whether to control the window to be lowered, a rain sensor, a humidity sensor, and a wind speed sensor installed on the outside of the vehicle are used to collect environmental information, and based on the collected environmental information, a detection is performed to determine whether there is wind and rain in the external environment. If the rain sensor detects rain and the humidity sensor detects that the air humidity is higher than a preset threshold, the system determines that there is rain in the external environment; if the wind speed sensor detects that the wind speed is higher than a preset threshold, the system determines that there is wind in the external environment. If the detection result shows that there is wind or rain in the external environment, the window lowering function is disabled to prevent rain from entering the vehicle or to avoid the influence of strong wind on the vehicle environment.

[0051] The specific method for identifying the conditions before the window is lowered is as follows:

[0052] After adjusting the brightness of the reversing lights to the appropriate auxiliary light brightness according to the ambient light brightness, the rain sensor, humidity sensor and wind speed sensor are activated to obtain the current external environment information. The sensor detection results show that the rain sensor detects rain, the humidity sensor detects that the air humidity is higher than the preset threshold (80%), and the wind speed sensor detects that the wind speed is lower than the preset threshold (5 meters / second). Based on the detection results, the system determines that there is rain in the external environment, and disables the window lowering function, and does not perform the window lowering operation.

[0053] It can be understood that the method proposed based on the above embodiment can intelligently decide whether to allow the window to be lowered according to external environmental conditions, thereby ensuring the safety and comfort of the reversing operation while protecting the interior environment of the vehicle.

[0054] In one embodiment of the present application, after adjusting the brightness of the vehicle's reversing lights to the auxiliary light brightness, the method also includes: setting a reversing time and counting down based on the reversing time, the reversing time being used to control the lighting time of the reversing lights; monitoring the vehicle's driving mode; if a driving mode switch is detected, clearing the countdown, and restarting the countdown when the new driving mode is switched to the reversing mode; if no driving mode switch is detected, turning off the reversing lights after the countdown ends.

[0055] In a specific embodiment of the present application, first, the system presets a reasonable reversing time based on experience or user settings, for example, the default setting is 30 seconds, and this time will serve as the benchmark for the reversing light lighting time. When the vehicle enters the reversing mode and the system has adjusted the brightness of the reversing lights according to the current ambient light brightness, the system starts the countdown, at which time the countdown timer starts counting down from the preset reversing time (such as 30 seconds). Then, the system will continue to monitor the vehicle's driving mode to determine whether the vehicle is still in the reversing mode. If the vehicle switches from the reversing mode to other modes (such as the forward mode or the parking mode), the system will immediately stop the countdown and clear the timer. When it is detected that the driving mode switches from the reversing mode to other modes, the system will clear the countdown timer. Once the vehicle switches back to the reversing mode again, the system will reset the reversing time and start a new countdown. If the switching of driving modes is not detected during the entire reversing process and the reversing mode is not exited after the countdown ends, the system will automatically turn off the reversing lights after the countdown ends. This can prevent the reversing lights from being on for a long time when not needed, saving energy and extending the life of the lamps.

[0056] The specific control method of the reversing light is as follows:

[0057] Assuming that the system has adjusted the brightness of the reversing lights to the appropriate auxiliary light brightness according to the ambient light brightness, when the vehicle enters the reversing mode, the system starts the countdown timer, sets the reversing time to 30 seconds, and continuously monitors the vehicle's driving mode. If no mode switch occurs during this period, that is, when the countdown reaches 30 seconds, if the vehicle is still in the reversing mode, the system will automatically turn off the reversing lights; if the vehicle switches from the reversing mode to the parking mode during the countdown, the system will clear the countdown timer, and when the vehicle switches from the parking mode to the reversing mode again, it will reset the reversing time to 30 seconds and start the countdown.

[0058] It can be understood that, based on the reversing light control mechanism proposed in the above embodiment, the system can intelligently control the turning on and off of the reversing lights to ensure sufficient lighting during the reversing process while avoiding unnecessary energy waste.

[0059] In one embodiment of the present application, after setting the reversing time, the method also includes: displaying the countdown information on the vehicle display screen; generating a corresponding countdown prompt based on the countdown information, the countdown prompt including a sound prompt and / or a vibration prompt; during the countdown period, displaying the remaining countdown time through the vehicle display screen, and issuing a countdown warning to the driver through a sound prompt or vibration.

[0060] In a specific embodiment of the present application, in order to further improve the user experience of the reversing assistance system, after setting the reversing time, the countdown information is displayed through the vehicle display screen, and a sound prompt and / or a vibration prompt is generated based on the countdown information to remind the driver to pay attention to the time of the reversing operation during the countdown. Assume that the system has preset a reasonable reversing time according to actual needs, such as 60 seconds, as a benchmark for the duration of the reversing light. When the vehicle enters the reversing mode and the system has started the countdown, the vehicle display screen will display the countdown information. For example, when the countdown starts, "60 seconds" is displayed on the display screen, and it decreases to "0 seconds" in sequence as time goes by. In addition, in addition to displaying the countdown information on the display screen, the system will also generate a sound prompt and / or a vibration prompt based on the countdown information, specifically including that the system can be configured with a variety of prompt modes, including sound prompts and vibration prompts. For example, after a certain time interval (such as every 10 seconds), the system will play a prompt tone through a speaker, or remind the driver through seat vibration. Or, when the countdown time is running out (e.g., the last 10 seconds), the system will remind the driver through more frequent sound prompts (e.g., once per second) or stronger vibrations. This ensures that the driver is aware that the reversing maneuver is about to be completed or that other actions need to be taken.

[0061] The countdown reminder method is as follows:

[0062] When the vehicle enters reverse mode, the system starts the countdown timer, sets the reverse time to 60 seconds, and controls the on-board display screen to start displaying the remaining countdown time, starting from "60 seconds". In addition, every 10 seconds, the system plays a reminder sound through the on-board audio: "Countdown 50 seconds", "Countdown 40 seconds", and so on; at the same time, every 10 seconds, the seat vibrates slightly once to remind the driver in a tactile form. Finally, when the countdown time is not much (such as the last 10 seconds), the reminder frequency increases to once per second, and the sound prompt becomes: "Countdown 10 seconds", "Countdown 9 seconds", until "Countdown 0 seconds", and the seat vibration frequency also increases accordingly.

[0063] It can be understood that through the above-mentioned specific implementation steps, the system can not only visually display the countdown information through the vehicle-mounted display screen, but also remind the driver of the reversing time in a multi-sensory way through various means such as sound prompts and vibration prompts, thereby improving the safety and convenience of the reversing process.

[0064] Step S240, continuously monitor the driving mode of the vehicle until the vehicle enters the parking mode and turns off the reversing lights and windows.

[0065] In one embodiment of the present application, after the driving mode is switched to the parking mode and the reversing lights and windows are closed, the method further includes: collecting user feedback, the user feedback being feedback information of the user based on the auxiliary light brightness adjustment result; if the satisfaction of the user feedback is lower than a preset satisfaction threshold, adjusting the mapping relationship between the auxiliary light brightness and the ambient light brightness based on the user feedback.

[0066] In a specific embodiment of the present application, in order to further optimize the auxiliary reversing function and ensure that the auxiliary light brightness adjustment strategy of the system can better meet the needs of users, after the vehicle switches from the reversing mode to the parking mode and turns off the reversing lights, the system collects user feedback to adjust the mapping relationship between the auxiliary light brightness and the ambient light brightness. When the vehicle stops reversing, the system asks the user about the satisfaction of the auxiliary light brightness adjustment effect during the reversing process through the vehicle display or voice prompt. For example, the system will display a message on the screen: "Please rate your satisfaction with the auxiliary light brightness of this reversing." The user can submit feedback through a slider, button or voice command on the touch screen, and select a level from 1 (very dissatisfied) to 5 (very satisfied) to express his satisfaction. The system receives and records the satisfaction score submitted by the user and stores it in a database. Assume that the preset satisfaction threshold is 3 points (i.e., medium satisfaction). If the user's satisfaction score is lower than this threshold, the system will adjust the mapping relationship between the auxiliary light brightness and the ambient light brightness based on the feedback, in order to provide an auxiliary light brightness that better meets the user's expectations in the future. Specifically, if the user's satisfaction feedback is low (such as a score of 2 points), the system will re-evaluate the mapping relationship between the current ambient light brightness and the auxiliary light brightness and make corresponding adjustments. For example, if the user thinks the brightness is insufficient, the system may increase the auxiliary light brightness by a certain percentage at the same ambient light brightness; on the contrary, if the user thinks the brightness is too high, the system may reduce the auxiliary light brightness. Finally, the updated mapping relationship will be saved and applied to all future reversing auxiliary light brightness adjustments.

[0067] Figure 3 It is a schematic diagram of the overall steps of an assisted reversing method shown in an exemplary embodiment of the present application.

[0068] like Figure 3 As shown, in the assisted reversing system proposed in the present application, its specific implementation method is as follows: First, the system will obtain the basic information of the vehicle to determine whether it has entered the reversing mode. If the vehicle has not entered the reversing mode, this solution is not applicable; if it has entered, the auxiliary light brightness of the reversing light is determined according to the ambient light brightness. At the same time, the system can further control the lifting and lowering of the windows according to the driver's behavior, and adjust the interior lighting according to the auxiliary light brightness, including adjusting the color temperature of the atmosphere light and the brightness of the display. It should be noted that the implementation of the above scheme relies on a variety of sensors to collect relevant data, so as to realize the corresponding judgment and intelligent control functions. Due to the differences in the configuration of different vehicles, if a vehicle lacks the necessary sensors, the function corresponding to the sensor will not be realized, but this will not affect the normal use of other functions.

[0069] In a specific embodiment of the present application, a mini van is used as an example. The system designs an intelligent reversing light control system, which monitors the light conditions of the surrounding environment through a photosensitive sensor installed at the rear of the vehicle. When the vehicle enters the reversing mode (i.e., the R gear is engaged), the system will first turn on the reversing lights at standard brightness. Then, after one second, the photosensitive sensor will measure the ambient light again and send the data to the body control unit (BCM).

[0070] The BCM will evaluate whether the brightness of the reversing lights needs to be adjusted based on the preset light intensity threshold. The brightness of the reversing lights is divided into three levels: standard brightness, 100% brightness increase, and 100% brightness increase with fog lights turned on at the same time. Among them, the third level is particularly suitable for conditions of complete lack of light or extremely dim light. Specifically, when the ambient illumination is in the range of 0.1lux to 4lux, the system will automatically switch to the second brightness level; and when the ambient illumination is lower than 0.1lux, the third level will be enabled.

[0071] To ensure that the driver can clearly see what is behind the vehicle, the three brightness levels are designed to adapt to the needs of different lighting environments. Once the brightness of the reversing lights is enhanced, if the vehicle speed exceeds the stationary state (i.e. greater than 0 km / h), the enhanced brightness will remain unchanged for 30 seconds. If the vehicle is shifted from R gear to D gear or N gear during this period, then when the R gear is put back, the brightness of the reversing lights will be restored to the state before the enhancement, and the duration of 30 seconds will be recalculated. It is worth noting that the system will only be fully reset when the vehicle stops completely and is put into P gear, and the reversing lights will start at standard brightness the next time the R gear is put into R gear.

[0072] It should be understood that this system not only focuses on the effective management of resources, but also allows users to activate or deactivate this function through simple manual operation, which greatly improves the flexibility of use. In summary, this solution is particularly suitable for economical models such as minivans, and effectively improves the safety and convenience of reversing operations without significantly increasing costs.

[0073] In another specific embodiment of the present application, a high-end new energy vehicle is taken as an example. Considering that many car owners will affix heat insulation film or privacy film to the vehicle after purchasing the vehicle, resulting in reduced light transmittance of the car windows, especially at night or in low light conditions, the line of sight when reversing will be affected. Therefore, the adaptive reversing light assist system is linked with the driver monitoring system (DMS) and the ambient light in the cabin to improve the line of sight when reversing. Specifically:

[0074] The system uses a photosensitive sensor installed at the rear of the vehicle to detect the lighting conditions of the surrounding environment and adaptively adjust the brightness of the reversing lights according to the ambient lighting conditions. Specifically, when the ambient illumination is lower than 0.1lux, the reversing lights will be adjusted to maximum brightness; when the illumination is between 0.1lux and 4lux, the brightness of the reversing lights will be increased to 50% higher than the standard brightness. At the same time, the body controller (BCM) will also adjust the color temperature of the interior ambient light to a warm tone below 3300K to reduce visual fatigue and glare, making it more comfortable for the driver to view the reversing image or observe the situation behind the vehicle through the rearview mirror. In this case, if the DMS system recognizes that the driver is using the rearview mirror, it will automatically lower the window (except in special weather such as rainy days) to help the driver better complete the parking action.

[0075] The system's control options are located in the "Body Control-Lighting Control" menu of the vehicle's infotainment system, under "Adaptive Reversing Light Assist", and are accompanied by a touch switch, which is turned on by default. In addition, there is a submenu called "Driver and Passenger Window Lift Assist" under this function, which is used to manage the automatic lifting of the windows.

[0076] In order to ensure the normal operation of the system, functions such as "Adaptive Reversing Light Assist", "DMS System", and "Driver and Passenger Driver Window Lift Assist" must be turned on. When the vehicle is first put into R gear, the reversing image is activated, the interior ambient light changes to warm light, and the reversing light brightness is set to standard brightness. One second later, the photosensitive sensor feeds back the ambient light conditions to the BCM, and the BCM adjusts the reversing light brightness according to the preset threshold. After the driver observes the rearview mirror for about two seconds, the window will automatically drop. When the brightness of the reversing light changes and the vehicle speed is greater than zero, the system starts a 30-second countdown and displays it on the reversing image interface. If the gear changes during reversing, the 30-second countdown will restart. When the vehicle is put into P gear, the window will automatically rise and the interior ambient light will return to the state previously set by the driver.

[0077] Understandably, the system makes full use of the characteristics of high-end new energy vehicles: these models are usually equipped with DMS systems, with variable color temperature ambient light strips in the cabin, and the system control switch is integrated into the car interface. The photosensitive sensor communicates with the vehicle control unit (VCU) via the CAN bus and transmits data in real time. When reversing, the photosensitive sensor activates and monitors the ambient light, and the changes in the brightness of the reversing lights and the color temperature of the ambient light are controlled by the BCM. When the DMS system detects the driver's action of using the rearview mirror, the BCM will execute the corresponding window lifting command.

[0078] In summary, the system significantly improves the safety and convenience of reversing through intelligent adjustment of the brightness of the reversing lights and change of the color temperature of the interior ambient light. It is very suitable for high-end new energy vehicles that have been affixed with heat insulation film or privacy film.

[0079] Figure 4 is a block diagram of an auxiliary backing system shown in an exemplary embodiment of the present application. The system can be applied to Figure 1 The system can also be applied to other exemplary implementation environments and specifically configured in other devices. This embodiment does not limit the implementation environment to which the system is applied.

[0080] like Figure 4 As shown, the exemplary auxiliary backing system includes: an information collection module 410 , an auxiliary light brightness determination module 420 , an auxiliary control module 430 , and a parking monitoring and management module 440 .

[0081] Among them, the information acquisition module 410 is used to obtain the vehicle's driving mode, current vehicle speed, and the brightness of the vehicle's external ambient light; the auxiliary light brightness determination module 420 is used to determine the auxiliary light brightness corresponding to the vehicle's external ambient light brightness in the current state based on the preset mapping relationship between ambient light brightness and auxiliary light brightness when the vehicle enters the reversing mode and the current vehicle speed is greater than the preset speed threshold; the auxiliary control module 430 is used to identify the driver's behavior. If the driver observes the rear of the vehicle through the rearview mirror, the vehicle's windows are controlled to be lowered and the brightness of the vehicle's reversing lights is adjusted to the auxiliary light brightness; the parking monitoring and management module 440 is used to continuously monitor the vehicle's driving mode until the vehicle enters the parking mode and turns off the reversing lights and windows.

[0082] It should be noted that the auxiliary backing system provided in the above embodiment and the auxiliary backing method provided in the above embodiment belong to the same concept, wherein the specific manner in which each module and unit performs the operation has been described in detail in the method embodiment, and will not be repeated here. In actual application, the auxiliary backing system provided in the above embodiment can distribute the above functions to different functional modules as needed, that is, divide the internal structure of the system into different functional modules to complete all or part of the functions described above, and this is not limited here.

[0083] An embodiment of the present application also provides an electronic device, comprising: one or more processors; a storage device for storing one or more programs, and when the one or more programs are executed by the one or more processors, the electronic device implements the assisted reversing method provided in the above-mentioned embodiments.

[0084] Figure 5The structure diagram of the computer system suitable for implementing the electronic device of the embodiment of the present application is shown. It should be noted that: Figure 5 The computer system 500 of the electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0085] like Figure 5 As shown, the computer system 500 includes a central processing unit (CPU) 501, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 502 or the program loaded from the storage part 508 to the random access memory (RAM) 503, such as executing the method described in the above embodiment. In the RAM 503, various programs and data required for system operation are also stored. The CPU 501, the ROM 502 and the RAM 503 are connected to each other through the bus 504. The input / output (I / O) interface 505 is also connected to the bus 504.

[0086] The following components are connected to the I / O interface 505: an input section 506 including a keyboard, a mouse, etc.; an output section 507 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker; a storage section 508 including a hard disk, etc.; and a communication section 509 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 509 performs communication processing via a network such as the Internet. A drive 510 is also connected to the I / O interface 505 as needed. A removable medium 511, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 510 as needed so that a computer program read therefrom is installed into the storage section 508 as needed.

[0087] In particular, according to an embodiment of the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a computer program for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication section 509, and / or installed from a removable medium 511. When the computer program is executed by a central processing unit (CPU) 501, various functions defined in the system of the present application are executed.

[0088] It should be noted that the computer-readable medium shown in the embodiment of the present application can be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium can be, for example, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media can include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, wherein a computer-readable computer program is carried. This propagated data signal can take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. A computer program contained on a computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0089] The flowchart and block diagram in the accompanying drawings illustrate the possible architecture, functions and operations of the system, method and computer program product according to various embodiments of the present application. Wherein, each box in the flowchart or block diagram can represent a module, a program segment, or a part of the code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0090] The units involved in the embodiments described in this application may be implemented by software or hardware, and the units described may also be set in a processor. The names of these units do not, in some cases, constitute limitations on the units themselves.

[0091] Another aspect of the present application further provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor of a computer, the computer executes the auxiliary backing method as described above. The computer-readable storage medium may be included in the electronic device described in the above embodiment, or may exist independently without being assembled into the electronic device.

[0092] Another aspect of the present application also provides a computer program product or a computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the auxiliary reversing method provided in each of the above embodiments.

[0093] The above embodiments are merely illustrative of the principles and effects of the present application, and are not intended to limit the present application. Anyone familiar with the technology may modify or change the above embodiments without violating the spirit and scope of the present application. Therefore, all equivalent modifications or changes made by a person of ordinary skill in the art without departing from the spirit and technical ideas disclosed in the present application shall still be covered by the claims of the present application.

Claims

1. A method for assisting reverse driving, characterized in that: The method comprises: Acquire the driving mode of the vehicle, the current speed, and the brightness of the ambient light outside the vehicle, wherein the driving mode includes at least a reverse mode and a parking mode; When the vehicle enters the reverse mode and the current vehicle speed is greater than a preset vehicle speed threshold, the auxiliary light brightness corresponding to the vehicle external ambient light brightness in the current state is determined based on a preset mapping relationship between ambient light brightness and auxiliary light brightness; Identifying the driver's behavior, if the driver observes the rear of the vehicle through the rearview mirror, controlling the vehicle's window to drop, and adjusting the brightness of the vehicle's reversing lights to the auxiliary light brightness; The driving mode of the vehicle is continuously monitored until the vehicle enters a parking mode, and the reversing lights and the windows are turned off.

2. The auxiliary backing method according to claim 1, characterized in that: After determining the auxiliary light brightness corresponding to the vehicle's external ambient light brightness in the current state, it also includes: Adjusting the color temperature of the interior ambient light and the brightness of the on-board electronic display screen in the vehicle based on the auxiliary light brightness specifically includes: If the auxiliary light brightness is higher than the preset brightness threshold, the color temperature of the interior ambient light is adjusted to a warm tone; The brightness of the vehicle-mounted electronic display screen is adjusted according to a preset relationship between the brightness of the auxiliary light and the brightness of the display screen.

3. The auxiliary backing method according to claim 1, characterized in that: After adjusting the brightness of the vehicle's reversing lights to the auxiliary light brightness, the method further includes: Determine a reversing time, and count down based on the reversing time, wherein the reversing time is used to control the lighting time of the reversing lights; Monitor vehicle driving patterns; If a driving mode switch is detected, the countdown is reset, and the countdown is restarted when the new driving mode is switched to the reverse mode; If the driving mode switch is not detected, the reversing light is turned off after the countdown ends.

4. The auxiliary backing method according to claim 3, characterized in that: After setting the reversing time, the method further includes: Displaying countdown information on a vehicle-mounted display screen in the vehicle, the countdown information being used to represent the remaining time information of the countdown; Generate a corresponding countdown prompt based on the countdown information, the countdown prompt including a sound prompt and / or a vibration prompt; During the countdown, the remaining countdown time is displayed on the vehicle-mounted display screen, and a countdown warning is issued to the driver through sound prompts or vibrations.

5. The auxiliary backing method according to claim 1, characterized in that: Identify the driver's behavior, including: Acquiring image information of the cockpit of the vehicle; Performing image recognition on the image information, the image recognition comprising: locating the driver's face in the image, counting the angle changes of the driver's face in consecutive frame images to identify the driver's sight direction; The driver's behavioral intention is judged based on the image recognition result. If the driver's line of sight is towards the rearview mirror, it is determined that the driver is observing the rear of the vehicle through the rearview mirror.

6. The auxiliary backing method according to claim 5, characterized in that: Before controlling the window of the vehicle to be lowered, the method further includes: Acquire environmental information outside the vehicle; Detecting the environmental information, the detection comprising: detecting whether there is rain based on a rain sensor, detecting air humidity based on a humidity sensor, and detecting wind speed based on a wind speed sensor; Based on the detection results, it is determined whether there is wind and rain in the external environment. If the rain sensor detects that there is rain, and the humidity sensor detects that the air humidity is higher than a preset threshold, it is determined that there is rain in the external environment; if the wind speed sensor detects that the wind speed is higher than a preset threshold, it is determined that there is wind in the external environment; If the detection results show that the external environment is windy or rainy, the window lowering function will be disabled.

7. The auxiliary backing method according to any one of claims 1 to 6, characterized in that: After the driving mode is switched to the parking mode and the reversing lights and the vehicle windows are turned off, the method further includes: Collecting user feedback, where the user feedback is feedback information from the user based on the auxiliary light brightness adjustment result; If the satisfaction level of the user feedback is lower than a preset satisfaction level threshold, the mapping relationship between the auxiliary light brightness and the ambient light brightness is adjusted based on the user feedback.

8. An auxiliary reversing system, characterized in that: The system comprises: The information collection module is used to obtain the vehicle's driving mode, current speed, and the brightness of the vehicle's external environment; The auxiliary light brightness determination module is used to determine the auxiliary light brightness corresponding to the vehicle's external ambient light brightness in the current state based on a preset mapping relationship between ambient light brightness and auxiliary light brightness when the vehicle enters a reverse mode and the current vehicle speed is greater than a preset vehicle speed threshold; The auxiliary control module is used to identify the driver's behavior, and if the driver observes the rear of the vehicle through the rearview mirror, control the vehicle's window to be lowered, and adjust the brightness of the vehicle's reversing lights to the auxiliary light brightness; The parking monitoring and management module is used to continuously monitor the driving mode of the vehicle until the vehicle enters the parking mode and turns off the reversing lights and the windows.

9. An electronic device, characterized in that: It comprises a processor, a memory and a communication bus; the communication bus is used to connect the processor and the memory; the processor is used to execute the computer program stored in the memory to implement the assisted reversing method as described in any one of claims 1-7.

10. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and the computer program is used to enable a computer to execute the assisted reversing method as described in any one of claims 1-7.

Images