Intelligent driving assistance method and system

Abstract

An intelligent driving assistance method comprises the steps that driver operation information, vehicle continuous driving duration, driver behavior information and driver physiological state information are collected in real time through a vehicle control module and a face recognition module; and the vehicle control module accurately judges whether the driver is in fatigue driving or road rage driving under the condition of not interfering the driving operation of the driver, and correspondingly reminds or pacifies the driver through light, music and voice, so that traffic accidents are prevented. An intelligent driving auxiliary system comprises a vehicle control module, and the vehicle control module is connected with a face recognition module, a memory, a steering wheel angle sensor, a horn switch on a steering wheel, an accelerator pedal sensor and a brake sensor and controls a loudspeaker and an atmosphere lamp.

Description

Technical Field

[0001] The present invention relates to the field of automobile technology, and in particular to an intelligent driving assistance method and system. Background Art

[0002] With the rapid growth of the number of cars and the popularization of transportation, the number and severity of traffic accidents are gradually increasing. Many of these accidents are caused by driver fatigue and road rage. In order to improve traffic safety, how to avoid fatigue and road rage driving has become the focus of current attention.

[0003] At present, in order to monitor the driver's driving status, the main method is to collect and analyze the driver's operation information and the driver's physiological information for comprehensive evaluation and identification.

[0004] Among them, fatigue monitoring of physiological signals is currently the most widely used technology for collecting physiological information of drivers. This technology collects physiological signals of drivers, such as heart rate, brain waves, etc., to determine whether the driver is in a state of fatigue and anger. The advantage of this technology is high accuracy, but it requires contact sensors and is easily interfered by the external environment, and may also interfere with the driver's driving operation. Summary of the invention

[0005] The purpose of the present invention is to provide an intelligent driving assistance method and system, which can accurately identify the driver's driving status without interfering with the driver's driving operation, and give corresponding reminders or comforts, thereby reducing the incidence of traffic accidents.

[0006] The key of the intelligent driving assistance method is that it includes the following steps:

[0007] S1: The vehicle is unlocked, the face module recognizes the driver's identity and sends it to the vehicle control module;

[0008] S2: The vehicle control module matches the preset personalized data package according to the driver's identity, and controls the in-vehicle lighting and music playback through the successfully matched personalized data package;

[0009] S3: The vehicle control module and the face module respectively collect the driver's operation information, the vehicle's continuous driving time, the driver's behavior information and the driver's physiological state information in real time;

[0010] S4: The vehicle control module determines the driving state according to the driver operation information, the continuous driving time of the vehicle, the driver behavior information and the driver physiological state information;

[0011] When driving fatigued, the vehicle control module reminds the driver through lights, music, and voice;

[0012] When driving in road rage, the vehicle control module calms the driver through lights, music, and voice;

[0013] When driving normally, continue to judge.

[0014] The vehicle control module and face recognition module respectively collect driver operation information, vehicle continuous driving time, driver behavior information and driver physiological status information in real time. The vehicle control module can accurately determine whether the driver is driving fatigued or driving in road rage without interfering with the driver's driving operation, and give corresponding reminders or comfort to the driver through lights, music and voice, thereby preventing traffic accidents.

[0015] Further, the driver operation information includes turning the steering wheel, honking the horn, braking, and accelerating;

[0016] The driver behavior information includes lowering the head, turning the head, and mumbling something;

[0017] The driver's physiological state information includes blinking, yawning, eye closing time, blushing, frowning eyebrows, and wide eyes.

[0018] Furthermore, the fatigue driving judgment includes the following steps:

[0019] A1: Determine that the driver has closed his eyes for more than 2 seconds;

[0020] Yes, the driver was driving while fatigued;

[0021] No, the driver drove normally;

[0022] A2: Determine whether the driver's blinking frequency in one minute is greater than the normal blinking frequency, which is 15-20 times;

[0023] Yes, the driver was driving while fatigued;

[0024] No, the driver drove normally;

[0025] A3: Determine whether the driver lowers his head or yawns;

[0026] Yes, the driver was driving while fatigued;

[0027] No, the driver was driving normally.

[0028] A4: Determine that the vehicle has been running continuously for more than 2 hours;

[0029] Yes, the driver was driving while fatigued;

[0030] No, the driver was driving normally.

[0031] The vehicle control module determines fatigue driving from multiple angles based on the vehicle's continuous driving duration or the driver's behavior information or the driver's physiological status information, preventing the missed judgment of fatigue driving and effectively preventing traffic accidents.

[0032] Furthermore, when the driver is driving fatigued, the vehicle control module controls the ambient light to flash, and controls the speaker to play fatigue driving reminder voice prompts and refreshing music.

[0033] Ambient lighting and speakers are used to warn and alert the driver, thus avoiding traffic accidents caused by fatigue.

[0034] Furthermore, the road rage driving judgment comprises the following steps:

[0035] B1: Determine whether the driver brakes more than 3 times within 10 seconds;

[0036] Yes, the road rage index is increased by 1;

[0037] No, the road rage index is increased by 0;

[0038] B2: determining whether the driver steps on the accelerator more than 3 times within 10 seconds;

[0039] Yes, the road rage index is increased by 1;

[0040] No, the road rage index is increased by 0;

[0041] B3: Determine whether the driver honks the horn more than twice within 5 seconds or honks the horn for more than 1 second;

[0042] Yes, the road rage index is increased by 1;

[0043] No, the road rage index is increased by 0;

[0044] B4: Determine whether the driver has turned the steering wheel by an angle greater than 5° and more than 2 times within 5 seconds;

[0045] Yes, the road rage index is increased by 1;

[0046] No, the road rage index is increased by 0;

[0047] B5: determining whether the driver's line of sight is consistent with the vehicle's driving direction when turning the steering wheel;

[0048] Yes, the road rage index is increased by 0;

[0049] No, the road rage index is increased by 1;

[0050] B6: If the driver's line of sight is consistent with the vehicle's travel direction for less than 4 seconds within 5 seconds, the road rage index increases by 1;

[0051] B7: If the driver turns his head more than 2 times within 5 seconds, the road rage index increases by 2;

[0052] B8: Determine whether the driver is in a physiological state of blushing, frowning eyebrows, or widening eyes;

[0053] Yes, the road rage index is increased by 1;

[0054] No, the road rage index is increased by 0;

[0055] B9: Determine whether the driver is mumbling something;

[0056] Yes, the road rage index is increased by 1;

[0057] No, the road rage index is increased by 0;

[0058] B10: Add the road rage indexes in steps B1-B9 to calculate a total road rage index, and determine whether the total road rage index is greater than 5:

[0059] Yes, the driver was driving in road rage;

[0060] No, the driver was driving normally.

[0061] The road rage index comprehensively evaluates the driver's driving status from multiple aspects, which greatly improves the accuracy of road rage judgment, prevents misjudgment and omission of road rage, and effectively prevents traffic accidents.

[0062] Furthermore, when the driver is driving in road rage, the vehicle control module controls the ambient light to change color to a soothing color, and controls the speaker to play soothing voice and soothing music.

[0063] The driver is comforted through ambient lighting, soothing voices and soothing music, and is reminded to pay attention to driving safety, thus avoiding traffic accidents caused by emotional excitement.

[0064] Furthermore, the soothing voice includes family soothing voice and system soothing voice;

[0065] The vehicle control module controls the speaker to play the soothing voice of family members first.

[0066] The soothing voice of family members can calm the driver's emotions more effectively, thereby speeding up the driver's emotional recovery and preventing the driver from being in a state of road rage for a long time.

[0067] The key of the intelligent driving assistance system is that it includes a vehicle control module, which is connected to the face recognition module, the memory, the steering wheel angle sensor, the horn switch on the steering wheel, the accelerator pedal sensor, the brake sensor, and controls the speaker and the ambient light;

[0068] The face recognition module faces the driver and collects driver behavior information and driver physiological state information of the driver;

[0069] The memory is used to store personalized data packets, prompt voices, soothing voices and music.

[0070] The vehicle control module collects the steering wheel rotation angle and number of times through the steering wheel angle sensor;

[0071] The vehicle control module collects the number of times the horn switch is turned on and off and the duration of the turning on and off;

[0072] The vehicle control module is used to collect the throttle opening and response times through the throttle pedal sensor;

[0073] The vehicle control module collects brake opening and response times through the brake sensor, and the brake sensor is a Hall sensor or a wheel speed sensor.

[0074] Beneficial effects: 1. The present invention can accurately identify the driver's driving status without interfering with the driver's driving operation, and give corresponding reminders or comfort to the driver through lights, music, and voice, thereby reducing the incidence of traffic accidents.

[0075] 2. The vehicle control module determines fatigue driving from multiple angles based on the vehicle's continuous driving time, driver behavior information, or driver physiological status information, preventing missed fatigue driving judgments and effectively preventing traffic accidents.

[0076] 3. The road rage index comprehensively evaluates the driver's driving status from multiple aspects, which greatly improves the accuracy of road rage judgment, prevents misjudgment and omission of road rage, and effectively prevents traffic accidents.

[0077] 4. The soothing voice of family members can calm the driver's emotions more effectively, thereby speeding up the driver's emotional recovery and preventing the driver from being in a state of road rage for a long time. BRIEF DESCRIPTION OF THE DRAWINGS

[0078] Figure 1 It is a flow chart of the intelligent driving assistance method;

[0079] Figure 2 Schematic diagram of the intelligent driving assistance system. DETAILED DESCRIPTION

[0080] The specific implementation manner and working principle of the present invention are further described in detail below with reference to the accompanying drawings.

[0081] like Figure 1 As shown, the intelligent driving assistance method includes the following steps:

[0082] S1: The vehicle is unlocked, the face module recognizes the driver's identity and sends it to the vehicle control module;

[0083] S2: The vehicle control module matches the preset personalized data package according to the driver's identity, and controls the in-vehicle lighting and music playback through the successfully matched personalized data package;

[0084] The personalized data package includes the driver's identity information, preferred lighting information and favorite playlists;

[0085] The vehicle control module controls the ambient light to light up and change according to the preferred lighting information, and the speaker plays according to the favorite song list.

[0086] S3: The vehicle control module and the face module respectively collect the driver's operation information, the vehicle's continuous driving time, the driver's behavior information and the driver's physiological state information in real time;

[0087] The driver operation information includes turning the steering wheel, honking the horn, braking, and accelerating;

[0088] The driver behavior information includes lowering the head, turning the head, and mumbling something;

[0089] The driver's physiological state information includes blinking, yawning, eye closing time, blushing, frowning eyebrows, and wide eyes.

[0090] S4: The vehicle control module determines the driving state according to the driver operation information, the continuous driving time of the vehicle, the driver behavior information and the driver physiological state information;

[0091] Fatigue driving judgment includes the following steps:

[0092] A1: Determine that the driver has closed his eyes for more than 2 seconds;

[0093] Yes, the driver was driving while fatigued;

[0094] No, the driver drove normally;

[0095] A2: Determine whether the driver's blinking frequency in one minute is greater than the normal blinking frequency, which is 15-20 times;

[0096] Yes, the driver was driving while fatigued;

[0097] No, the driver drove normally;

[0098] A3: Determine whether the driver lowers his head or yawns;

[0099] Yes, the driver was driving while fatigued;

[0100] No, the driver was driving normally.

[0101] A4: Determine that the vehicle has been running continuously for more than 2 hours;

[0102] Yes, the driver was driving while fatigued;

[0103] No, the driver was driving normally.

[0104] When the driver is driving fatigued, the vehicle control module controls the ambient light to flash, and controls the speaker to play a voice prompt of fatigue driving and refreshing music;

[0105] Road rage driving judgment includes the following steps:

[0106] B1: Determine whether the driver brakes more than 3 times within 10 seconds;

[0107] Yes, the road rage index is increased by 1;

[0108] No, the road rage index is increased by 0;

[0109] B2: determining whether the driver steps on the accelerator more than 3 times within 10 seconds;

[0110] Yes, the road rage index is increased by 1;

[0111] No, the road rage index is increased by 0;

[0112] B3: Determine whether the driver honks the horn more than twice within 5 seconds or honks the horn for more than 1 second;

[0113] Yes, the road rage index is increased by 1;

[0114] No, the road rage index is increased by 0;

[0115] B4: Determine whether the driver has turned the steering wheel by an angle greater than 5° and more than 2 times within 5 seconds;

[0116] Yes, the road rage index is increased by 1;

[0117] No, the road rage index is increased by 0;

[0118] B5: determining whether the driver's line of sight is consistent with the vehicle's driving direction when turning the steering wheel;

[0119] Yes, the road rage index is increased by 0;

[0120] No, the road rage index is increased by 1;

[0121] B6: If the driver's line of sight is consistent with the vehicle's travel direction for less than 4 seconds within 5 seconds, the road rage index increases by 1;

[0122] B7: If the driver turns his head more than 2 times within 5 seconds, the road rage index is increased by 2;

[0123] B8: Determine whether the driver is in a physiological state of blushing, frowning eyebrows, or widening eyes;

[0124] Yes, the road rage index is increased by 1;

[0125] No, the road rage index is increased by 0;

[0126] B9: Determine whether the driver is mumbling something;

[0127] Yes, the road rage index is increased by 1;

[0128] No, the road rage index is increased by 0;

[0129] B10: The road rage indexes in steps B1-B9 are added together to calculate a total road rage index, and it is determined whether the total road rage index is greater than 5:

[0130] Yes, the driver was driving in road rage;

[0131] No, the driver was driving normally.

[0132] When the driver is driving in road rage, the vehicle control module controls the ambient light to change color to soothing colors such as blue and green, and controls the speaker to play soothing voices of family members or soothing voices of the system and soothing music to soothe the driver.

[0133] like Figure 2 As shown, the intelligent driving assistance system includes a vehicle control module, which is connected to a face recognition module, a memory, a steering wheel angle sensor, a horn switch on the steering wheel, an accelerator pedal sensor, and a brake sensor, and controls a speaker and an ambient light;

[0134] The face recognition module faces the driver and collects driver behavior information and driver physiological state information of the driver;

[0135] The memory is used to store personalized data packets, prompt voices, soothing voices and music.

[0136] The vehicle control module collects the steering wheel rotation angle and number of times through the steering wheel angle sensor;

[0137] The vehicle control module collects the number of times the horn switch is turned on and off and the duration of the turning on and off;

[0138] The vehicle control module is used to collect the throttle opening and response times through the throttle pedal sensor;

[0139] The vehicle control module collects brake opening and response times through the brake sensor, and the brake sensor is a Hall sensor or a wheel speed sensor.

Claims

1. An intelligent driving assistance method, characterized in that: The following steps are involved: S1: The vehicle is unlocked, the face module recognizes the driver's identity and sends it to the vehicle control module; S2: The vehicle control module matches the preset personalized data package according to the driver's identity, and controls the in-vehicle lighting and music playback through the successfully matched personalized data package; S3: The vehicle control module and the face module respectively collect the driver's operation information, the vehicle's continuous driving time, the driver's behavior information and the driver's physiological state information in real time; S4: The vehicle control module determines the driving state according to the driver operation information, the continuous driving time of the vehicle, the driver behavior information and the driver physiological state information; When driving fatigued, the vehicle control module reminds the driver through lights, music, and voice; When driving in road rage, the vehicle control module calms the driver through lights, music, and voice; When driving normally, continue to judge.

2. The intelligent driving assistance method according to claim 1, characterized in that: The driver operation information includes turning the steering wheel, honking the horn, braking, and accelerating; The driver behavior information includes lowering the head, turning the head, and mumbling something; The driver's physiological state information includes blinking, yawning, eye closing time, blushing, frowning eyebrows, and wide eyes.

3. The intelligent driving assistance method according to claim 2, characterized in that: The fatigue driving judgment comprises the following steps: A1: Determine that the driver has closed his eyes for more than 2 seconds; Yes, the driver was driving while fatigued; No, the driver drove normally; A2: Determine whether the driver's blinking frequency in one minute is greater than the normal blinking frequency, which is 15-20 times; Yes, the driver was driving while fatigued; No, the driver drove normally; A3: Determine whether the driver lowers his head or yawns; Yes, the driver was driving while fatigued; No, the driver was driving normally. A4: Determine that the vehicle has been running continuously for more than 2 hours; Yes, the driver was driving while fatigued; No, the driver was driving normally.

4. The intelligent driving assistance method according to claim 3, characterized in that: When the driver is driving fatigued, the vehicle control module controls the ambient light to flash, and controls the speaker to play fatigue driving reminder voice prompts and refreshing music.

5. The intelligent driving assistance method according to claim 2, characterized in that: The road rage driving judgment comprises the following steps: B1: Determine whether the driver brakes more than 3 times within 10 seconds; Yes, the road rage index is increased by 1; No, the road rage index is increased by 0; B2: determining whether the driver steps on the accelerator more than 3 times within 10 seconds; Yes, the road rage index is increased by 1; No, the road rage index is increased by 0; B3: Determine whether the driver honks the horn more than twice within 5 seconds or honks the horn for more than 1 second; Yes, the road rage index is increased by 1; No, the road rage index is increased by 0; B4: Determine whether the driver has turned the steering wheel by an angle greater than 5° and more than 2 times within 5 seconds; Yes, the road rage index is increased by 1; No, the road rage index is increased by 0; B5: determining whether the driver's line of sight is consistent with the vehicle's driving direction when turning the steering wheel; Yes, the road rage index is increased by 0; No, the road rage index is increased by 1; B6: If the driver's line of sight is consistent with the vehicle's travel direction for less than 4 seconds within 5 seconds, the road rage index increases by 1; B7: If the driver turns his head more than 2 times within 5 seconds, the road rage index is increased by 2; B8: Determine whether the driver is in a physiological state of blushing, frowning eyebrows, or widening eyes; Yes, the road rage index is increased by 1; No, the road rage index is increased by 0; B9: Determine whether the driver is mumbling something; Yes, the road rage index is increased by 1; No, the road rage index is increased by 0; B10: The road rage indexes in steps B1-B9 are added together to calculate a total road rage index, and it is determined whether the total road rage index is greater than 5: Yes, the driver was driving in road rage; No, the driver was driving normally.

6. The intelligent driving assistance method according to claim 5, characterized in that: When the driver is driving in road rage, the vehicle control module controls the ambient light to change color to a soothing color, and controls the speaker to play soothing voice and soothing music.

7. The intelligent driving assistance method according to claim 6, characterized in that: The soothing voice includes family soothing voice and system soothing voice; The vehicle control module controls the speaker to play the soothing voice of family members first.

8. An intelligent driving assistance system, characterized in that: The vehicle control module includes a face recognition module, a memory, a steering wheel angle sensor, a horn switch on the steering wheel, an accelerator pedal sensor, and a brake sensor, and controls a speaker and an ambient light; The face recognition module faces the driver and collects driver behavior information and driver physiological state information of the driver; The memory is used to store personalized data packets, prompt voices, soothing voices and music. The vehicle control module collects the steering wheel rotation angle and number of times through the steering wheel angle sensor; The vehicle control module collects the number of times the horn switch is turned on and off and the duration of the turning on and off; The vehicle control module is used to collect the throttle opening and response times through the throttle pedal sensor; The vehicle control module collects brake opening and response times through the brake sensor, and the brake sensor is a Hall sensor or a wheel speed sensor.

Images