Automobile intelligent safety auxiliary driving control system and method

Abstract

The invention discloses an automobile intelligent safety auxiliary driving control system and method. The system comprises a control unit, a sensing system, a man-machine interaction device and a state detection system. The sensing system is used for collecting vehicle surrounding data, and the output end of the sensing system is connected to the control unit; the state detection system is used for detecting vehicle internal data, and the output end of the state detection system is connected to the control unit; the output end of the control unit is connected to the man-machine interaction device, an auxiliary driving accompanying mode is set in the control unit, and after the auxiliary driving accompanying mode is activated, the control unit sends a reminding signal to the man-machine interaction device according to data transmitted by the state detection system and the sensing system. The method has the advantages that the auxiliary driving accompanying mode of the green driver is matched to assist the green driver in driving the vehicle, and the auxiliary driving safety of the vehicle is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of automobile safety and auxiliary driving, and in particular to an intelligent safety auxiliary driving control system and method with a driving accompanying mode. BACKGROUND

[0002] Safe driving of a vehicle is very important for a user, and when a driver is a novice, the driving proficiency of the driver and the like cannot reach the level of a mature driver, so many traffic accidents are caused by misoperation or misjudgment of the novice driver who cannot understand the driving state data of the vehicle. Therefore, it is very important for a novice driver to know how to assist safe driving.

[0003] For novice drivers or drivers who are not very skilled, some mature auxiliary technologies are applied to the vehicle end in the prior art to assist the driver in driving and controlling the vehicle. For example, a 360-degree view system has been maturely applied. When reversing or low-speed turning, the 360-degree view system is started, and then the current driving environment is displayed through a video to show the surrounding environment, thereby assisting the driver in reversing or turning. The novice driver can observe the current driving environment through the video, thereby reducing traffic accidents of the novice driver in the case of reversing or turning, and improving the safety of driving.

[0004] However, the common 360-degree view system is closed when the vehicle speed is greater than 30 km / h. For driving at a speed greater than 30 km / h and driving in non-turning conditions, there is no auxiliary function to help the novice driver to provide support for the external environment of the vehicle, resulting in that the automobile driving auxiliary technology of the prior art is insufficient to support the novice driver, and cannot meet the demand of the user for the auxiliary function of the vehicle. SUMMARY

[0005] The present application aims to overcome the deficiencies of the prior art, and provides an automobile intelligent safety auxiliary driving control system and method, and designs an auxiliary driving accompanying mode. In the mode, the demand of the novice driver is matched, the novice driver is assisted in driving the vehicle, and the safety of auxiliary driving of the vehicle is improved.

[0006] To achieve the above-mentioned purpose, the technical scheme adopted by the present application is as follows:

[0007] The application discloses an intelligent safety auxiliary driving control system for a vehicle, which comprises a control unit, a sensing system, a man-machine interaction device and a state detection system; the sensing system is used for collecting data around the vehicle, and an output end of the sensing system is connected to the control unit; the state detection system is used for detecting data inside the vehicle, and an output end of the state detection system is connected to the control unit; an output end of the control unit is connected to the man-machine interaction device, and an auxiliary accompanying driving mode is arranged in the control unit; after the auxiliary accompanying driving mode is activated, the control unit sends a reminding signal to the man-machine interaction device according to data transmitted by the state detection system and the sensing system.

[0008] The control system further comprises a vehicle speed control unit and a throttle response adjustment module, and output ends of the control unit are connected to the vehicle speed control unit and the throttle response adjustment module respectively, so that the vehicle speed and the throttle response can be controlled by the vehicle speed control unit and the throttle response adjustment module in the auxiliary accompanying driving mode.

[0009] The sensing system comprises a 360-degree surround view camera, a millimeter wave radar, an ultrasonic sensor and a seat belt wearing detection sensor.

[0010] The man-machine interaction device comprises a central control display screen, a warning and prompting system and a mode switching control panel; the central control display screen is used for displaying a 360-degree surround view picture and a system state, the warning and prompting system comprises an audible and visual warning device, and the mode switching control panel is used for controlling the opening and closing of the accompanying driving mode.

[0011] The state detection system is used for monitoring the internal state of the vehicle, and the internal state of the vehicle comprises a driver seat belt state and passenger state information.

[0012] A control method of the intelligent safety auxiliary driving control system for the vehicle comprises the following steps: after the auxiliary accompanying driving mode is activated, the 360-degree surround view system is controlled to continuously work and display real-time vehicle surrounding video on a vehicle-mounted display screen; the vehicle-mounted display screen comprises a central control screen, an in-vehicle co-driver screen and a passenger screen; and the 360-degree surround view function is continuously activated in the mode activation state.

[0013] After the auxiliary accompanying driving mode is activated, the maximum vehicle speed is limited within a set speed threshold, the current vehicle speed is monitored in real time, the electronic throttle opening degree and the power output are limited when the vehicle speed approaches the maximum speed threshold, the greater the vehicle speed, the greater the electronic throttle opening degree and the power output limitation, the electronic throttle is closed or the power output limitation is 0 when the vehicle speed reaches the maximum speed threshold, and the driver is informed of the reason for the limited power output through an instrument.

[0014] When the auxiliary driving mode is activated, the state of the front vehicle is monitored in real time through the sensors of the vehicle's perception system, and the speed, acceleration and radar echo characteristics of the front vehicle are analyzed to determine whether the front vehicle has braking behavior. When the deceleration trend of the vehicle is monitored and the calculated safety distance between vehicles is lower than the set threshold, the vehicle power output is adjusted to control the vehicle speed to maintain the set safety distance threshold, and a reminder is sent to the driver through the instrument panel.

[0015] In the driving mode, the vehicle continuously judges the distance and relative speed and relative distance between itself and surrounding vehicles through sensors, and evaluates the risk coefficient in real time. When the risk coefficient C exceeds the preset value, the potential risk is reminded through the instrument panel or buzzer, and the vehicle acceleration is inhibited by limiting the electronic throttle opening or adjusting the power output strategy.

[0016] In the auxiliary driving mode, the seat belt sensor and / or in-vehicle camera are combined with deep learning recognition algorithm to monitor whether the main driver wears a seat belt in real time. When it is detected that the main driver does not wear a seat belt and the accelerator is pressed, the electronic throttle or power system is controlled to limit the power output to limit the vehicle acceleration and / or limit the vehicle speed.

[0017] The advantages of the present application are that the auxiliary driving mode of the novice driver is matched to assist the novice driver to drive the vehicle, and the safety of the vehicle is improved. After the driving mode is started, the running state of the vehicle is monitored by various means and assisted control or intervention control is performed, so as to improve the driving safety of the novice driver and reduce the occurrence of accidents. BRIEF DESCRIPTION OF DRAWINGS

[0018] The contents expressed by each figure in the specification of the present application and the marks in the figures are briefly described as follows:

[0019] Figure 1 The whole flow chart of the driving mode of the present application is shown in the figure.

[0020] Figure 2 The vehicle state detection flow chart in the driving mode of the present application is shown in the figure.

[0021] Figure 3 The control system architecture block diagram involved in the driving mode of the present application is shown in the figure.

[0022] Figure 4 The working flow chart of the control system in the driving mode of the present application is shown in the figure. DETAILED DESCRIPTION

[0023] The specific embodiments of the present application are further described in detail by comparing the figures and describing the optimal embodiments.

[0024] The application relates to the field of automobile safety and driving assistance technology, and mainly aims at function expansion and optimization of a 360-degree view system of an automobile, introduces an accompanying driving mode, integrates a plurality of functions suitable for novice driving scenes such as breaking through speed limit, automatic speed limit, brake warning, and aims at providing comprehensive and intelligent driving assistance support for novice drivers. The application introduces the accompanying driving mode on the basis of the existing 360-degree view system, breaks through the limitation that the traditional 360-degree view function is closed when the speed is greater than 30km / h. At the same time, the accompanying driving mode has the functions of automatically limiting the speed to 0-80km / h, building a brake warning mechanism, real-time evaluating a dangerous coefficient and adjusting the throttle response, safety belt warning and throttle response limitation and the like according to the dangerous coefficient. The application solves the problems of insufficient perception of the surrounding environment of the vehicle, improper speed control and lack of ability to deal with emergency situations in the process of novice driving, improves the safety and convenience of novice driving, and provides a new solution for automobile driving assistance technology.

[0025] The automobile intelligent safety auxiliary driving control scheme of the embodiment is realized by relying on sensors and controllers of the vehicle, and the hardware in the vehicle is reused in combination with the control strategy designed according to the scheme, so that the demand of the novice driver for the auxiliary safety driving of the vehicle can be effectively met, and the safety and reliability of the vehicle driving are improved.

[0026] A core of the auxiliary safety driving control scheme of the embodiment is to keep the 360-degree view function continuously activated, because the novice driver may not use the rearview mirror and the like to perceive the environment around the vehicle when driving the vehicle, so the 360-degree view function also needs to be started in the case that the speed is greater than the conventional 30KM / h. Therefore, the driver can still judge the surrounding environment through the view video in the case that the speed is 40-50km / h or the like, and the scheme can also display the video to the copilot or the passenger through the auxiliary screen of the vehicle, so that the copilot or the passenger can watch and judge the vehicle or the obstacle around the vehicle, thereby realizing the accompanying driving function.

[0027] The auxiliary accompanying driving mode is newly added in the embodiment, and the accompanying driving mode is introduced on the basis of the existing driving mode. The driver can select to start or stop the accompanying driving mode on the vehicle setting APP interface of the central control screen. When the mode is started, the 360-degree view function can still run in the case that the speed is greater than 30km / h, that is, the mode keeps the 360-degree view system function, and the video collected by the 360-degree view system is displayed on a plurality of screens such as the central control screen, the copilot screen and the passenger screen, so that the accompanying driver can observe the information around the vehicle and play a certain accompanying driving role.

[0028] Since the accompanying driving mode is started, it is defaulted that the driver is not a novice driver at this time, the novice driver cannot control the vehicle speed, therefore the maximum vehicle speed is limited in the accompanying driving mode, such as being limited between 60-80km / h, and the embodiment is developed taking the maximum vehicle speed being automatically limited within 80km / h as an example. The embodiment is further provided with a safety belt warning function in the auxiliary accompanying driving mode; the power output is automatically adjusted to realize smooth deceleration; the electronic throttle opening is limited or the power output strategy is adjusted to suppress the acceleration of the vehicle; the brake pedal function is additionally provided in the co-driver position. After the auxiliary accompanying driving mode is activated, the maximum vehicle speed is limited within the set speed threshold, the current vehicle speed is monitored in real time, when the vehicle speed approaches the maximum speed threshold, the electronic throttle opening and the power output are limited, and the greater the speed, the greater the limitation of the electronic throttle opening and the power output, when the vehicle speed reaches the maximum speed threshold, the electronic throttle is closed or the power output is limited to 0, and at this time the driver is prompted by the instrument about the reason of the limited power output. When the auxiliary accompanying driving mode is activated, the sensor of the perception system of the vehicle monitors the state of the front vehicle in real time, the speed, acceleration and radar echo characteristics of the front vehicle are analyzed to determine whether the front vehicle has braking behavior, when the deceleration trend of the vehicle is monitored and the calculated safety distance between vehicles is lower than the set threshold, the power output of the vehicle is adjusted to control the speed of the vehicle to maintain the set safety distance threshold, and the driver is reminded by the instrument.

[0029] When the accompanying driving mode is started, the traditional vehicle speed limit is broken, and the 360-degree view function can still work when the vehicle speed is greater than 30km / h. The accompanying driver assists the co-driver to view the panoramic view around the vehicle, including but not limited to vehicles, pedestrians, obstacles, traffic lights, etc., to assist the driving of the accompanying driver. When the accompanying driving mode is started, the automatic vehicle speed limiting function is added, and the speed of the vehicle is automatically limited to 0-80km / h, which ensures the safety of driving in the accompanying driving mode.

[0030] In the accompanying driving mode, a brake warning mechanism is constructed. With the help of sensors (including but not limited to cameras, millimeter wave radars, etc.), the state of the front vehicle is monitored in real time, the speed, acceleration and radar echo characteristics of the front vehicle are analyzed in combination with historical driving data and real-time sensing information to determine whether the front vehicle has braking behavior, when the deceleration trend of the vehicle is monitored and the calculated safety distance between vehicles is lower than the set threshold, the system automatically adjusts the power output to realize smooth deceleration.

[0031] In the accompanying mode, the vehicle continuously judges the distance and relative speed, relative distance between itself and surrounding vehicles through sensors (including but not limited to cameras, millimeter wave radars, etc.), and evaluates the danger coefficient C in real time according to the algorithm. When the danger coefficient C exceeds the preset value, the vehicle reminds the existence of potential risks through the instrument panel or buzzer on the one hand, and on the other hand, even if the driver steps on the accelerator pedal deeply, the system will limit the electronic throttle opening or adjust the power output strategy to inhibit the acceleration of the vehicle.

[0032] The accompanying mode adds a seat belt warning function, which monitors whether the main driver wears a seat belt in real time through a seat belt sensor or an in-vehicle camera combined with deep learning technology. When it is detected that the main driver does not wear a seat belt and steps on the accelerator, the system controls the electronic throttle or the power system, and the vehicle cannot accelerate.

[0033] The vehicle "accompanying mode" of the embodiment is set to be turned on or off through the central control screen. After being turned on, the vehicle speed is limited to within 80 km / h, the 360-degree surround view function can still run when the vehicle speed is greater than 30 km / h, and the seat belt warning function is newly added, so that the vehicle cannot accelerate when the seat belt is not worn. The system monitors the state of the front vehicle and the surrounding environment in real time with the help of sensors, and when there is a collision risk or the danger coefficient exceeds the standard, it automatically adjusts the power output to achieve smooth deceleration and inhibit the acceleration of the vehicle.

[0034] As shown in FIG. 1, it is a control system architecture diagram of the auxiliary accompanying mode of the embodiment. The intelligent cabin accompanying mode system mainly consists of the following components. Figure 3

[0035] 1. The perception system includes 360-degree surround view cameras, millimeter wave radars, ultrasonic sensors, and seat belt wearing detection sensors. The surround view cameras are composed of four wide-angle cameras, which are installed on the front, rear, and both sides of the vehicle, respectively, for real-time image acquisition of the surrounding environment of the vehicle. The millimeter wave radar is installed at the front of the vehicle to measure the distance and relative speed of the front vehicle. The ultrasonic sensors are distributed around the vehicle for close-range obstacle detection. The seat belt wearing detection sensor is used to detect whether the driver wears a seat belt.

[0036] 2. The control system includes a central processor, a vehicle speed control unit, and a throttle response adjustment module. The central processor is responsible for overall system control and data processing. The vehicle speed control unit is used to realize the vehicle speed limiting function. The throttle response adjustment module can adjust the throttle pedal response according to the danger coefficient.

[0037] 3. The human-computer interaction device includes a central control display screen, a warning prompt system, and a mode switching control panel. The central control display screen is used to display the 360-degree surround view image and the system status. The warning prompt system includes an audible and visual warning device. The mode switching control panel is used to control the opening and closing of the accompanying mode.

[0038] ​4. The state detection system is used to monitor the state of the vehicle interior, such as whether the driver has fastened the seat belt, the state of the passengers, etc. The relevant information is collected by the state sensor and sent to the IVI host through the CAN bus.

[0039] As Figure 1 , 2 , 4, which is a flowchart of the working process in the auxiliary driving mode of the present embodiment. The method flow involved in the auxiliary mode includes:

[0040] Activation process of the driving mode: the vehicle needs to be in a stopped state to ensure the safety of the activation process; at the same time, the driver must be properly seated, which is confirmed by the system through relevant detection; in addition, the system self-test needs to pass comprehensively, covering all types of sensors, actuators and software functions, etc. The driver can select to enter the driving mode through the central control screen or a special button. Then, the system automatically checks all functions, including the 360-degree view, safety control and other subsystems. After confirming that all subsystems are normal, the driving mode is activated.

[0041] Extension implementation of the 360-degree view function: the system monitors the vehicle speed in real time, and when the vehicle speed exceeds 30 km / h, the 360-degree view system is maintained in the working state, and the picture refresh frequency is automatically adjusted according to the vehicle speed to ensure that the driver can obtain real-time environmental information at different vehicle speeds. The system automatically switches to the optimal viewing angle according to the vehicle speed and driving state, such as straight line, turning, etc. At the same time, a manual viewing angle adjustment function is provided to meet the individual needs of the driver.

[0042] Safety control mechanism implementation: the vehicle safety system has the functions of speed limit, dangerous coefficient calculation and application, and brake warning. The system monitors the vehicle speed signal in real time, and when the vehicle speed approaches 80km / h, the speed limit control will be started, and the engine output power will be adjusted through the ECU to limit the vehicle speed within the safe range. At the same time, the dangerous coefficient is calculated by the formula C = w1*D + w2*V + w3*A, where D is the distance factor from the surrounding vehicles, V is the relative speed factor, A is the acceleration factor, and w1, w2, w3 are weight coefficients. The calculation result is used to trigger the corresponding safety measures. When C<first threshold, the risk level is safe; when the first threshold<C<second threshold, the risk level is risk resistance; when the second threshold<C<third threshold, the risk level is medium risk; when C>third threshold, the risk level is high risk; in addition, the system also continuously monitors the state of the preceding vehicle, and when a medium or high risk is detected, such as an emergency brake of the preceding vehicle and a too close distance, a sound and light warning will be issued first, and the brake system will be preloaded, and if necessary, automatic intervention will be made. The first, second and third thresholds can be set according to actual needs. When in medium or high risk, the vehicle will remind the driver of the potential risk through the instrument panel or buzzer, and at the same time, even if the driver steps on the accelerator pedal, the system will limit the electronic throttle opening or adjust the power output strategy to suppress the vehicle acceleration, thereby improving the driving safety.

[0043] Obviously, the specific implementation of the present application is not limited by the above-mentioned manner, and various non-essential improvements made by adopting the method concept and technical scheme of the present application are within the protection scope of the present application.

Claims

1. An intelligent safety assistant driving control system for a vehicle, characterized by: The system comprises a control unit, a sensing system, a human-machine interaction device, and a state detection system; the sensing system is used to collect data around the vehicle, and its output is connected to the control unit; the state detection system is used to detect data inside the vehicle, and its output is connected to the control unit; the output of the control unit is connected to the human-machine interaction device, and an auxiliary accompanying driving mode is set in the control unit; after the auxiliary accompanying driving mode is activated, the control unit sends a reminder signal to the human-machine interaction device according to the data from the state detection system and the sensing system.

2. The intelligent safety auxiliary driving control system of a vehicle as claimed in claim 1, wherein: The control system further comprises a vehicle speed control unit and a throttle response adjustment module, and the output of the control unit is connected to the vehicle speed control unit and the throttle response adjustment module, so as to control the vehicle speed and the throttle response through the vehicle speed control unit and the throttle response adjustment module in the auxiliary accompanying driving mode.

3. The intelligent safety auxiliary driving control system of a vehicle according to claim 1 or 2, characterized in that: The sensing system comprises a 360-degree surround view camera, a millimeter wave radar, an ultrasonic sensor, and a seat belt wearing detection sensor.

4. The intelligent safety auxiliary driving control system of a vehicle as claimed in claim 1 or 2, characterized in that: The human-machine interaction device comprises a central control display screen, a warning and prompting system, and a mode switching control panel; the central control display screen is used to display a 360-degree surround view and system status, the warning and prompting system comprises an audible and visual warning device, and the mode switching control panel is used to control the opening and closing of the accompanying driving mode.

5. The intelligent safety auxiliary driving control system of a vehicle as claimed in claim 1 or 2, characterized in that: The state detection system is used to monitor the internal state of the vehicle, including the driver's seat belt state and the passenger state information.

6. A control method of the intelligent safety auxiliary driving control system according to any one of claims 1-5, characterized in that: After the auxiliary accompanying driving mode is activated, the 360-degree surround view system is controlled to continuously work and display the video around the vehicle in real time through the vehicle display screen, the vehicle display screen comprises a central control screen, an in-vehicle co-pilot screen, and a passenger screen, and the 360-degree surround view function is kept continuously activated in the mode activation state.

7. The control method of the intelligent safety auxiliary driving control system of an automobile according to claim 6, characterized in that: After the auxiliary accompanying driving mode is activated, the maximum vehicle speed is limited within a set speed threshold, the current vehicle speed is monitored in real time, when the vehicle speed approaches the maximum speed threshold, the electronic throttle opening and the power output are limited, the greater the speed, the greater the electronic throttle opening and the power output limitation, when the vehicle speed reaches the maximum speed threshold, the electronic throttle is closed or the power output is limited to 0, and at this time, the driver is reminded of the reason for the limited power output through the instrument.

8. The control method of the intelligent safety auxiliary driving control system of an automobile according to claim 7, characterized in that: When the auxiliary accompanying driving mode is activated, the state of the vehicle in front is monitored in real time through the sensors of the sensing system of the vehicle, the speed, acceleration, and radar echo characteristics of the vehicle in front are analyzed to determine whether the vehicle in front has a braking behavior, when the deceleration trend of the vehicle is monitored and the calculated safety distance between vehicles is lower than the set threshold, the vehicle power output is adjusted to control the vehicle speed to maintain the set safety distance threshold, and the driver is reminded through the instrument.

9. The control method of the intelligent safety auxiliary driving control system of an automobile according to claim 7 or 8, characterized in that: In the accompanying driving mode, the vehicle continuously judges the distance and relative speed and relative distance between the vehicle and the surrounding vehicles through the sensors, and evaluates the risk coefficient in real time; when the risk coefficient C exceeds the preset value, the instrument panel or buzzer reminds of the potential risk, the electronic throttle opening is limited or the power output strategy is adjusted to inhibit the acceleration of the vehicle.

10. The control method of the intelligent safety auxiliary driving control system of an automobile according to claim 7 or 8, characterized in that: In the auxiliary driving mode, the seat belt sensor and / or the in-vehicle camera are combined with a deep learning recognition algorithm to monitor whether the main driver wears a seat belt in real time; when it is detected that the main driver does not wear a seat belt and the accelerator is stepped on, the electronic throttle or the power system is controlled to limit the power output to limit the acceleration of the vehicle and / or limit the speed of the vehicle.

Images