Vehicle driving processing method and device, electronic equipment and vehicle
By obtaining driver fatigue detection information and turning on assisted driving mode, including speed limit and driver replacement prompts, the problem of major safety hazards in the prior art when drivers are tired is solved, and the vehicle driving safety is improved.
Patent Information
- Application Number
- CN202310505903.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-06
- Publication Date
- 2024-11-08
AI Technical Summary
The existing vehicle driving treatment methods cannot effectively solve safety hazards when the driver is tired, resulting in an increase in the risk of traffic accidents.
By obtaining the driver's fatigue detection information, if it is determined that the driver is in a fatigue state, turn on the assisted driving mode to limit the vehicle speed, and identify whether there are other passengers in the cockpit. If so, it is prompted to change the driver. The assisted driving mode includes speed limit and vehicle Measures such as flashing external lights, fragrance release, air conditioning temperature adjustment and voice prompts.
Improve vehicle safety in fatigued driving, reduce the chance of traffic accidents, and through various scenario processing such as sound, fragrance refreshing, slowing down and assisted driving, it effectively reminds and improves the driver's Driving status.
Smart Images

Figure CN118907114A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of vehicle technology, and in particular to a vehicle driving processing method, device, electronic equipment and vehicle. Background Art
[0002] With the improvement of social safety awareness, the safety of vehicle driving has also become a key issue of concern. During the driving process of the vehicle, the driver will be affected by fatigue after driving continuously for a long time, which will affect the safety of vehicle driving and cause physiological and psychological disorders, which can easily cause traffic accidents. Therefore, it is very necessary to warn and control the driver's vehicle driving in a fatigued driving state.
[0003] At present, the current driving time of the vehicle is calculated during the driving process. If it is determined that the vehicle has been driven for a long time, a voice prompt of fatigue driving will be issued. However, this way of handling vehicle driving is not effective in solving safety hazards when the driver is tired but needs to continue driving. Summary of the invention
[0004] In view of this, the present application provides a vehicle driving processing method, device, electronic device and vehicle, the main purpose of which is to improve the current vehicle driving processing method and solve the technical problem of poor effect in solving safety hazards when the driver is tired but needs to continue driving.
[0005] In a first aspect, the present application provides a method for processing vehicle driving, comprising:
[0006] Obtain driver fatigue detection information;
[0007] If it is determined according to the fatigue detection information that the driver is in a fatigue state, an assisted driving mode of the vehicle is turned on, and whether there are other passengers other than the driver in the cabin of the vehicle, wherein the assisted driving mode includes limiting the speed of the vehicle;
[0008] If it is determined that there are other passengers in the cabin of the vehicle, a prompt is given to replace the driver.
[0009] Optionally, the obtaining of driver fatigue detection information includes:
[0010] Acquire first image information of the driver captured by an in-vehicle camera, and acquire driving behavior information of the driver;
[0011] Obtaining the driver's head state information and pupil state information by identifying the first image information;
[0012] If the head state information matches the head state information of the user in a fatigue state, and the pupil state information matches the head state information of the user in a fatigue state, and the driving behavior information matches the driving behavior information of the user in a fatigue state, it is determined that the driver is in a fatigue state.
[0013] Optionally, the driving behavior information includes information on the driver's use of the accelerator and brake of the vehicle within a preset time period.
[0014] Optionally, after the prompting to change the driver, the method further includes:
[0015] Acquire second image information captured by an in-vehicle camera of the driving position of the vehicle;
[0016] By identifying the second image information, determining whether the driver has been changed within a preset time period;
[0017] If the driver does not change within the preset time period, the fragrance unit is controlled to release fragrance; and / or, the air-conditioning temperature in the car is controlled to be lowered to a preset temperature threshold; and / or, the voice unit in the car is controlled to play preset sound waves; and / or, the voice unit in the car is controlled to give voice prompts.
[0018] Optionally, the identifying whether there are other passengers besides the driver in the cabin of the vehicle includes:
[0019] Acquiring third image information captured by an in-vehicle camera of the cabin of the vehicle;
[0020] By identifying the third image information, it is determined whether the other passenger exists in the cabin of the vehicle.
[0021] Optionally, if it is determined that the driver is in a fatigue state according to the fatigue detection information, the method further includes:
[0022] The exterior lights of the vehicle are turned on to flash.
[0023] In a second aspect, the present application provides a vehicle driving processing device, comprising:
[0024] An acquisition module is configured to acquire driver fatigue detection information;
[0025] a processing module configured to, if it is determined according to the fatigue detection information that the driver is in a fatigue state, activate an assisted driving mode of the vehicle and identify whether there are other passengers other than the driver in the cabin of the vehicle, wherein the assisted driving mode includes limiting the speed of the vehicle;
[0026] The prompt module is configured to prompt to replace the driver if it is determined that there are other passengers in the cabin of the vehicle.
[0027] In a third aspect, the present application provides a computer-readable storage medium having a computer program stored thereon, characterized in that when the computer program is executed by a processor, the vehicle driving processing method described in the first aspect is implemented.
[0028] In a fourth aspect, the present application provides an electronic device comprising a storage medium, a processor, and a computer program stored on the storage medium and executable on the processor, wherein the processor implements the vehicle driving processing method described in the first aspect when executing the computer program.
[0029] In a fifth aspect, the present application provides a vehicle, comprising: the device as described in the second aspect or the electronic device as described in the fourth aspect.
[0030] By means of the above technical scheme, a method, device, electronic device and vehicle for handling vehicle driving are provided. Compared with the current handling method of vehicle driving, the present application can turn on the assisted driving mode when the driver is in a fatigued state, and prompt to change the driver, thereby improving the current handling method of vehicle driving, and solving the technical problem of poor effect of safety hazards when the driver is tired but needs to continue driving. Specifically, firstly, the fatigue detection information of the driver is obtained; then, if it is determined that the driver is in a fatigued state based on the fatigue detection information, the assisted driving mode of the vehicle is turned on, and it is identified whether there are other passengers in the cabin of the vehicle except the driver, wherein the assisted driving mode includes limiting the speed of the vehicle; if it is determined that there are other passengers in the cabin of the vehicle, a prompt to change the driver is given. By applying the technical scheme of the present application, reasonable suggestions can be prompted in a fatigue driving state, thereby improving vehicle driving safety.
[0031] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS
[0032] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.
[0033] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0034] Figure 1 A schematic flow chart of a vehicle driving processing method provided in an embodiment of the present application is shown;
[0035] Figure 2 A schematic flow chart of another vehicle driving processing method provided in an embodiment of the present application is shown;
[0036] Figure 3 A schematic diagram of the structure of a vehicle driving processing device provided in an embodiment of the present application is shown. DETAILED DESCRIPTION
[0037] In order to more clearly understand the above-mentioned purposes, features and advantages of the present application, the scheme of the present application will be further described below. It should be noted that the embodiments of the present application and the features in the embodiments can be combined with each other without conflict.
[0038] In order to improve the current vehicle driving processing method, the technical problem of poor effect in solving safety hazards when the driver is tired but needs to continue driving is solved. This embodiment provides a vehicle driving processing method, such as Figure 1 As shown, the method includes:
[0039] Step 101: Obtain driver fatigue detection information.
[0040] The driver's fatigue detection information may include: the driver is in a fatigue state and the driver is not in a fatigue state.
[0041] According to an embodiment of the present application, when obtaining fatigue detection information of the driver, the driver's current driving state can be obtained, and the driver's current driving state can be analyzed to obtain fatigue detection information of the driver.
[0042] Step 102: If it is determined that the driver is in a fatigue state based on the fatigue detection information, the vehicle's assisted driving mode is turned on, and it is identified whether there are other passengers in the vehicle cabin besides the driver.
[0043] Among them, the assisted driving mode includes limiting the vehicle's speed.
[0044] For the embodiment of the present application, other passengers except the driver may include: no other passengers, one other passenger, or multiple other passengers.
[0045] In some examples, identifying whether there are passengers other than the driver in the cabin of a vehicle may include: using the vehicle's sensors to obtain seat belt usage information for seat positions other than the driver's seat in the cabin of the vehicle, and based on obtaining the seat belt usage information for seat positions other than the driver's seat in the cabin of the vehicle, determining whether there are passengers other than the driver in the cabin of the vehicle.
[0046] For example, the seat sensor is used to obtain the usage of seat belts in other seat positions in the vehicle's cabin except the driver's seat: the usage of seat belts AQ-02, seat belts AQ-03, seat belts AQ-04, and seat belts AQ-05. If at least one of the seat positions among seat belts AQ-02, seat belts AQ-03, seat belts AQ-04, and seat belts AQ-05 is in a state of being used, it is recognized that there is at least one passenger other than the driver in the vehicle's cabin.
[0047] Step 103: If it is determined that there are other passengers in the cabin of the vehicle, a prompt is given to change the driver.
[0048] According to an embodiment of the present application, when prompting to change the driver, the vehicle's on-board display screen can be used to prompt the current driver and / or other passengers to change the driver, and at the same time, the voice system can be used to issue a voice prompt with the same content as the prompt on the on-board display screen to change the driver.
[0049] Compared with the current existing technology, the embodiment of the present application can turn on the assisted driving mode when the driver is in a fatigued state, and prompt the driver to change, thereby improving the current handling method of vehicle driving and solving the technical problem of poor effect on safety hazards when the driver is tired but needs to continue driving. By applying the technical solution of this embodiment, reasonable suggestions can be prompted in the fatigue driving state, thereby improving vehicle driving safety.
[0050] Further, as a refinement and extension of the above embodiment, in order to fully illustrate the specific implementation process of the method of this embodiment, this embodiment provides the following Figure 2 The specific method shown includes:
[0051] Step 201: Acquire first image information of a driver captured by an in-vehicle camera, and acquire driving behavior information of the driver.
[0052] In the embodiment of the present application, the first image information may include: the driver's facial information, the driver's head information, the driver's eye information, the driver's nose information, the driver's mouth information and the driver's ear information. The driving behavior information may include: the driver's observation behavior of the vehicle road, the observation behavior of the vehicle facilities, the vehicle throttle control behavior, the vehicle brake control behavior, and the vehicle steering wheel control behavior during the vehicle driving process, and this embodiment does not limit this.
[0053] Exemplarily, the first image information of the driver is DYTX-01, and the first image information DYTX-01 may include: the driver's head information TXX-95, the driver's eye information YXX-95, the driver's nose information BXX-95, the driver's mouth information KXX-95, and the driver's ear information EXX-95.
[0054] In order to improve the accuracy of the information used to determine whether the driver is in a fatigued driving state based on the driver's pupil characteristics and behavioral characteristics, the driving behavior information may also include information on the driver's use of the vehicle's accelerator and brakes within a preset time period.
[0055] For the embodiment of the present application, when obtaining the information on the driver's use of the vehicle's throttle and brake within a preset time period, it may include: the vehicle computer obtains the current use of the vehicle's throttle and brake within the preset time period. For example, the number of times the vehicle's throttle and brake are used, and then based on the number of times the vehicle's throttle and brake are used and the number of times the driver uses the vehicle's throttle and brake when in a fatigued state, the driver's use of the vehicle's throttle and brake within the preset time period is analyzed to determine the driver's use of the vehicle's throttle and brake within the preset time period, and then determine the driver's driving behavior information.
[0056] In some examples, the vehicle computer obtains that the vehicle's accelerator is used 4 times and the vehicle's brake is used 3 times within 10 minutes. The driver's driving behavior information is that the driver uses the vehicle's accelerator 4 times and the vehicle's brake is used 3 times within the preset 10 minutes.
[0057] Through the specific implementation of the above embodiment, the current image information of the driver can be obtained, and the image information can be used to analyze the driving state of the driver in embodiment step 202 and embodiment step 203 to determine whether the driver is in a fatigue state.
[0058] Step 202: Obtain the driver's head state information and pupil state information by identifying the first image information.
[0059] Optionally, the first image information is parsed to obtain the driver's facial position information and motion information, the driver's head position information and motion information, the driver's eye position information and motion information, the driver's nose position information and motion information, the driver's mouth position information and motion information, and the driver's ear position information and motion information. Then the driver's head position information and motion information and the driver's eye position information and motion information are extracted, and the driver's head position information and motion information are analyzed to obtain the driver's head state information; the driver's eye position information and motion information are analyzed to obtain the driver's pupil state information.
[0060] For example, by identifying the first image information DYTX-XX-08, the driver's facial position information MBWZ-XX-08 and motion information MBDZ-XX-08, the driver's head position information TBWZ-XX-08 and motion information TBDZ-XX-08, the driver's eye position information YBWZ-XX-08 and motion information YBDZ-XX-08, the driver's nose position information BBWZ-XX-08 and motion information BBDZ-XX-08, the driver's mouth position information KBWZ-XX-08 and motion information KBDZ-XX-08, and the driver's ear position information EBWZ-XX-08 and motion information EBDZ-XX-08 are obtained. The above-mentioned driver's head position information TBWZ-XX-08 and motion information TBDZ-XX-08, driver's eye position information YBWZ-XX-08 and motion information YBDZ-XX-08 are extracted, and the driver's head state information TBZT-XX-08 is obtained by analyzing the driver's head position information TBWZ-XX-08 and motion information TBDZ-XX-08; the driver's pupil state information TKZT-XX-08 is obtained by analyzing the driver's eye position information YBWZ-XX-08 and motion information YBDZ-XX-08. Then, by identifying the first image information DYTX-XX-08, the driver's head state information TBZT-XX-08 and pupil state information TKZT-XX-08 are obtained.
[0061] Through the specific implementation of the above embodiment, the driver's head status information and pupil status information can be used as input data to analyze whether the passenger is in a fatigue state.
[0062] Step 203: If the head state information matches the head state information of the user in a fatigue state, and the pupil state information matches the pupil state information of the user in a fatigue state, and the driving behavior information matches the driving behavior information of the user in a fatigue state, it is determined that the driver is in a fatigue state.
[0063] According to an embodiment of the present application, when determining that the head state information matches the head state information of the user in a fatigue state, and the pupil state information matches the pupil state information of the user in a fatigue state, and the driving behavior information matches the driving behavior information of the user in a fatigue state, it may include: comparing the head state information with the head state information of the user in a fatigue state, if the comparison result is less than or equal to the standard range, then determining that the head state information is not in a fatigue state; if the comparison result is greater than the standard range, then determining that the head state information is in a fatigue state. Comparing the pupil state information with the pupil state information of the user in a fatigue state, if the comparison result is less than or equal to the standard range, then determining that the pupil state information is not in a fatigue state; if the comparison result is greater than the standard range, then determining that the pupil state information is in a fatigue state. Comparing the driving behavior information with the driving behavior information of the user in a fatigue state, if the comparison result is less than or equal to the standard range, then determining that the driving behavior information is not in a fatigue state; if the comparison result is greater than the standard range, then determining that the driving behavior information is in a fatigue state.
[0064] In some examples, through step 202 of the above embodiment, the head state information TB-01 and the pupil state information TK-01 are obtained; and through step 201 of the above embodiment, the driving behavior information JS-01 is obtained. If the head state information PLTB-00 in the user fatigue state, the pupil state information PLTK-00 in the user fatigue state and the driving behavior information PLJS-00 in the user fatigue state are known, the head state information TB-01 is compared with the head state information PLTB-00 in the user fatigue state to obtain head comparison result information TBDB-01, and the head comparison result information TBDB-01 is the head state information in the user fatigue state; the pupil state information TB-01 is compared with the pupil state information PLTK-00 in the user fatigue state to obtain pupil comparison result information TKDB-01, and the pupil comparison result information TKDB-01 is the pupil state information in the user fatigue state; the driving behavior information TB-01 is compared with the driving behavior information PLJS-00 in the user fatigue state to obtain driving behavior comparison result information JSDB-01, and the driving behavior comparison result information JSDB-01 is the driving behavior information in the user fatigue state. Then, based on the head comparison result information TBDB-01, the pupil comparison result information TKDB-01 and the driving behavior comparison result information JSDB-0, it is determined that the driver is in a fatigued state.
[0065] Through the specific implementation methods of the above embodiments, fatigue driving status detection can be performed in combination with the driver's head status information, pupil status information and driving behavior information, thereby improving the accuracy of fatigue driving status detection.
[0066] Step 204: If it is determined that the driver is in a fatigue state based on the fatigue detection information, the vehicle's assisted driving mode is turned on.
[0067] Among them, the assisted driving mode includes limiting the vehicle speed, controlling the vehicle to actively avoid obstacles or other vehicles, limiting the vehicle's overtaking, limiting the vehicle's unnecessary lane changes, etc., which are not limited in this embodiment.
[0068] For example, if the current speed of vehicle F1 is 100km / h, the speed limit of the current road L is 60km / h-120km / h, and it is divided into L-1 fast lane, L-2 middle lane and L-3 slow lane, among which the speed limit of L-1 fast lane is 100km / h-120km / h, the speed limit of L-2 middle lane is 90km / h-100km / h, and the speed limit of L-3 slow lane is 60km / h-90km / h. Then the vehicle's current speed of 100km / h is decelerated to the minimum speed limit of 60km / h on the current road, and the lane is changed to the L-3 slow lane at a safe distance. At the same time, vehicle F1 is restricted from overtaking, unnecessary lane change, etc.
[0069] Through the specific implementation of the above embodiment, when the driver is in a fatigued state, the vehicle can be decelerated and driving behaviors with greater safety hazards can be restricted, thereby improving the safety of vehicle driving and reducing the probability of accidents.
[0070] Step 205: Acquire third image information captured by the in-vehicle camera of the vehicle cabin.
[0071] Among them, the third image information may be image information inside the vehicle cabin taken by using an in-vehicle camera, including image information of whether there is a user sitting on the seat in the vehicle.
[0072] Step 206: Determine whether there are other passengers in the cabin of the vehicle by identifying the third image information.
[0073] According to an embodiment of the present application, when determining whether there are other passengers in the cabin of the vehicle by identifying the third image information, it can be implemented by but not limited to the following method, which includes: parsing the third image information to obtain seat image information in the vehicle's cabin, and then using a visual algorithm to analyze the image information of each seat in the vehicle's cabin to determine whether there are other passengers in the vehicle's cabin.
[0074] In some examples, the third image information P-three is parsed to obtain the driver's seat information P-three-01 in the vehicle's seat compartment, the co-driver's seat information P-three-02 in the vehicle's seat compartment, the left rear passenger seat information P-three-03 in the vehicle's seat compartment, the middle rear passenger seat information P-three-04 in the vehicle's seat compartment, and the right rear passenger seat information P-three-05 in the vehicle's seat compartment. Then, the visual algorithm is used to analyze the driver's seat information P-three-01, the co-driver's seat information P-three-02, the left rear passenger seat information P-three-03, the middle rear passenger seat information P-three-04, and the right rear passenger seat information P-three-05. The information P-three-04 and the right rear passenger seat information P-three-05 are analyzed to obtain the driver's seat information P-three-01 that there is a driver, the co-pilot seat information P-three-02 that there is a passenger, the left rear passenger seat information P-three-03 that there is no passenger, the middle rear passenger seat information P-three-04 that there is no passenger and the right rear passenger seat information P-three-05 that there is a passenger. The driver's seat information P-three-01, the co-pilot seat information P-three-02 and the right rear passenger seat information P-three-05 indicate that there are passengers, thereby determining that there are other passengers in the vehicle cabin.
[0075] Optionally, whether there are other passengers in the cabin of the vehicle may also be obtained by utilizing a seat sensor of the vehicle.
[0076] For example, the driver's seat sensor CGQ-01 is used to obtain the driver's seat information X-CGQ-01, the co-driver's seat sensor CGQ-02 is used to obtain the co-driver's seat information X-CGQ-02, the left rear passenger seat sensor CGQ-03 is used to obtain the left rear passenger seat information X-CGQ-03, the middle rear passenger seat sensor CGQ-04 is used to obtain the middle rear passenger seat information X-CGQ-04, and the right rear passenger seat sensor CGQ-05 is used to obtain the right rear passenger seat information X-CGQ-05. Then extract the passenger seating information from the driver's seat information X-CGQ-01, the co-driver's seat information X-CGQ-02, the left rear passenger seat information X-CGQ-03, the middle rear passenger seat information X-CGQ-04 and the right rear passenger seat information X-CGQ-05, among which, the passenger seating information in the driver's seat information X-CGQ-01, the co-driver's seat information X-CGQ-02, the left rear passenger seat information X-CGQ-03 shows that there are people, while the passenger seating information in the middle rear passenger seat information X-CGQ-04 and the right rear passenger seat information X-CGQ-05 shows that there are no people, thereby determining that there are other passengers in the vehicle's cabin.
[0077] Through the specific implementation of the above embodiment, it can be determined whether there are other drivers, so that the prompt for changing the driver in step 207 of the embodiment is performed based on whether there are other passengers in the cabin of the vehicle.
[0078] Step 207: If it is determined that there are other passengers in the cabin of the vehicle, a prompt to change the driver is given.
[0079] Optionally, if there are other passengers in the cabin of the vehicle, the age of the other passengers is analyzed based on the visual algorithm to determine whether the other passengers are adults. If the other passengers are adults, a prompt to change the driver is given.
[0080] If the other passengers mentioned above are adults and meet the basic driving requirements, a prompt can be given to change the driver, and the driver can operate and drive based on whether the other adult passengers currently meet the driving conditions.
[0081] Step 208: Acquire second image information captured by the in-vehicle camera of the driving position of the vehicle.
[0082] Among them, the second image information is the second image information captured by the in-vehicle camera at the driving seat of the vehicle after analyzing the third image information and determining to change the driver prompt based on the preset time period of step 209 of the embodiment.
[0083] Step 209: Determine whether the driver has been changed within a preset time period by identifying the second image information.
[0084] According to an embodiment of the present application, when determining whether the driver has been changed within a preset time period by identifying the second image information, it may include: parsing the second image information to obtain the driving seat image information of the vehicle, and then using a visual algorithm to compare and analyze the driving seat image information of the vehicle with the driver image information before prompting the driver to be replaced, to determine whether the driver has been changed within the preset time period.
[0085] In some examples, the second image information P-two is parsed to obtain the driving seat image information P-two-01 in the vehicle's seat compartment, and then a visual algorithm is used to analyze the driving seat image information P-two-01 and the driver image information P-JS-01 before the prompt to change the driver, and the driver corresponding to the driving seat image information P-two-01 is the same as the driver corresponding to the driver image information P-JS-01 before the prompt to change the driver. Then, it is determined that the driver has not been changed within the preset time period.
[0086] The execution of a mode such as the assisted driving mode may be determined based on whether a driver change occurs within a preset time period.
[0087] Step 210: If the driver does not change within the preset time period, control the fragrance unit to release fragrance; and / or control the air conditioning temperature in the car to drop to a preset temperature threshold; and / or control the voice unit in the car to play preset sound waves; and / or control the voice unit in the car to give voice prompts.
[0088] According to the embodiments of the present application, the fragrance may be mint or other spices, which can be used to refresh the driver's sense of smell when the driver is tired; the preset temperature threshold of the air conditioner in the car may be 10 degrees Celsius, etc., which can stimulate the human body through temperature when the driver is tired, thereby relieving the driver's fatigue state, and the above-mentioned preset temperature threshold is adjusted according to the season and the climate of the current geographical location, which is not limited in this embodiment; the voice unit in the car is controlled to play a preset sound wave of 90 decibels or above, which can wake up the driver when the driver is tired; the voice unit in the car is controlled to give voice prompts, which can give voice prompts when the driver's fatigue state is detected, for example, you are driving fatigued, please pay attention to safety, which is not limited in this embodiment.
[0089] Through the specific implementation methods of the above embodiments, the fragrance unit can be controlled to release fragrance; and / or, the air-conditioning temperature in the car is controlled to be lowered to a preset temperature threshold; and / or, the voice unit in the car is controlled to play preset sound waves; and / or, the voice unit in the car is controlled to give voice prompts, etc., so as to utilize the driver's sense of smell, hearing, temperature perception, etc. to wake up the driver in a fatigued state, thereby reducing the probability of accidents. When the driver is tired but needs to continue driving, the effect of solving safety hazards can be improved.
[0090] In some examples, if it is determined that the driver is in a fatigued state based on fatigue detection information, the vehicle's exterior lights are turned on and flashed.
[0091] When the driver is tired but needs to continue driving, the recognition of the vehicle can be effectively improved, external vehicles can be warned, accidents can be reduced, and the effect of solving safety hazards can be improved.
[0092] Compared with the existing technical solutions, the technical solutions provided by the embodiments of the present application can detect the fatigue driving state in combination with the overall environment in the vehicle, and use multi-scene processing such as sound and fragrance refreshing, speed reduction, vehicle lights and the activation of assisted driving to improve the current vehicle driving processing method, and solve the technical problem of poor effect on safety hazards when the driver is tired but needs to continue driving. By applying the technical solutions of the embodiments of the present application, reasonable suggestions can be prompted in the fatigue driving state, thereby improving vehicle driving safety.
[0093] Further, as Figure 1 and Figure 2 The specific implementation of the method shown in the embodiment provides a vehicle driving processing device, such as Figure 3 As shown, the device includes: an acquisition module 31, a processing module 32, and a prompt module 33.
[0094] An acquisition module 31 is configured to acquire driver fatigue detection information;
[0095] The processing module 32 is configured to, if it is determined according to the fatigue detection information that the driver is in a fatigue state, activate an assisted driving mode of the vehicle and identify whether there are other passengers other than the driver in the cabin of the vehicle, wherein the assisted driving mode includes limiting the speed of the vehicle;
[0096] The prompt module 33 is configured to prompt to replace the driver if it is determined that there are other passengers in the cabin of the vehicle.
[0097] In a specific application scenario, the acquisition module 31 is specifically configured to acquire the first image information captured by the in-vehicle camera of the driver, and to acquire the driving behavior information of the driver; by identifying the first image information, the head state information and pupil state information of the driver are obtained; if the head state information matches the head state information of the user in a fatigue state, and the pupil state information matches the head state information of the user in a fatigue state, and the driving behavior information matches the driving behavior information of the user in a fatigue state, then it is determined that the driver is in a fatigue state.
[0098] In a specific application scenario, the acquisition module 31 is further configured so that the driving behavior information includes information on the driver's use of the accelerator and brake of the vehicle within a preset time period.
[0099] In a specific application scenario, the acquisition module 31 is further configured to obtain second image information captured by the in-vehicle camera of the driving seat of the vehicle after the prompt to change the driver; determine whether the driver has been changed within a preset time period by identifying the second image information; if the driver has not been changed within the preset time period, control the fragrance unit to release fragrance; and / or control the in-vehicle air-conditioning temperature to be lowered to a preset temperature threshold; and / or control the in-vehicle voice unit to play preset sound waves; and / or control the in-vehicle voice unit to give voice prompts.
[0100] In a specific application scenario, the processing module 32 is specifically configured to obtain third image information captured by the in-vehicle camera of the cabin of the vehicle; and determine whether the other passengers are in the cabin of the vehicle by identifying the third image information.
[0101] In a specific application scenario, the processing module 32 is further configured to turn on the flashing of the exterior lights of the vehicle if it is determined that the driver is in a fatigue state based on the fatigue detection information.
[0102] It should be noted that for other corresponding descriptions of the functional units involved in the vehicle driving processing device provided in this embodiment, reference can be made to Figure 1 and Figure 2 The corresponding description in will not be repeated here.
[0103] Based on the above Figure 1 and Figure 2 The method shown in the embodiment also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the above-mentioned Figure 1 and Figure 2 The method shown.
[0104] Based on this understanding, the technical solution of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, USB flash drive, mobile hard disk, etc.), including a number of instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute the methods of various implementation scenarios of the present application.
[0105] Based on the above Figure 1 and Figure 2 The method shown, and Figure 3 In order to achieve the above-mentioned purpose, the embodiment of the present application further provides an electronic device, which can be configured on a computer side or a vehicle side, etc. The device includes a storage medium and a processor; the storage medium is used to store a computer program; the processor is used to execute the computer program to achieve the above-mentioned Figure 1 and Figure 2 The method shown.
[0106] Optionally, the above-mentioned physical device may also include a user interface, a network interface, a camera, a radio frequency (RF) circuit, a sensor, an audio circuit, a WI-FI module, etc. The user interface may include a display, an input unit such as a keyboard, etc., and the optional user interface may also include a USB interface, a card reader interface, etc. The network interface may optionally include a standard wired interface, a wireless interface (such as a WI-FI interface), etc.
[0107] Those skilled in the art will appreciate that the above-mentioned physical device structure provided in this embodiment does not constitute a limitation on the physical device, and may include more or fewer components, or a combination of certain components, or different arrangements of components.
[0108] The storage medium may also include an operating system and a network communication module. The operating system is a program that manages the hardware and software resources of the above-mentioned physical device, and supports the operation of the information processing program and other software and / or programs. The network communication module is used to realize the communication between the components inside the storage medium, and the communication with other hardware and software in the information processing physical device.
[0109] Through the description of the above implementation methods, the technicians in this field can clearly understand that the present application can be implemented by means of software plus the necessary general hardware platform, or by hardware. By applying the technical solution provided by the embodiment of the present application, compared with the current existing vehicle driving processing method, the embodiment of the present application can be combined with the overall environment in the car to detect the fatigue driving state, and use multi-scene processing such as sound and fragrance refreshing, speed reduction, vehicle lights and assisted driving to improve the current existing vehicle driving processing method, and solve the technical problem of poor effect of safety hazards when the driver is tired and needs to continue driving. Specifically, first obtain the fatigue detection information of the driver; then if the driver is determined to be in a fatigue state based on the fatigue detection information, turn on the assisted driving mode of the vehicle, and identify whether there are other passengers other than the driver in the cabin of the vehicle, wherein the assisted driving mode includes limiting the speed of the vehicle; if it is determined that there are other passengers in the cabin of the vehicle, prompt to replace the driver. By applying the technical solution of the embodiment of the present application, reasonable suggestions can be prompted in the fatigue driving state, thereby improving the driving safety of the vehicle.
[0110] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the term "comprises" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.
[0111] The above is only a specific implementation of the present application, so that those skilled in the art can understand or implement the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments described herein, but will conform to the widest scope consistent with the principles and novel features applied for herein.
Claims
1. A method for processing vehicle driving, characterized in that: include: Obtain driver fatigue detection information; If it is determined according to the fatigue detection information that the driver is in a fatigue state, an assisted driving mode of the vehicle is turned on, and whether there are other passengers other than the driver in the cabin of the vehicle, wherein the assisted driving mode includes limiting the speed of the vehicle; If it is determined that there are other passengers in the cabin of the vehicle, a prompt is given to replace the driver.
2. The method according to claim 1, characterized in that The step of obtaining driver fatigue detection information includes: Acquire first image information of the driver captured by an in-vehicle camera, and acquire driving behavior information of the driver, wherein the driving behavior information includes information on the use of the accelerator and brake of the vehicle by the driver within a preset time period; Obtaining the driver's head state information and pupil state information by identifying the first image information; If the head state information matches the head state information of the user in a fatigue state, and the pupil state information matches the pupil state information of the user in a fatigue state, and the driving behavior information matches the driving behavior information of the user in a fatigue state, it is determined that the driver is in a fatigue state.
3. The method according to claim 1, characterized in that After the prompting to change the driver, the method further includes: Acquire second image information captured by an in-vehicle camera of the driving position of the vehicle; By identifying the second image information, determining whether the driver has been changed within a preset time period; If the driver does not change within the preset time period, the fragrance unit is controlled to release fragrance; and / or, the air-conditioning temperature in the car is controlled to be lowered to a preset temperature threshold; and / or, the voice unit in the car is controlled to play preset sound waves; and / or, the voice unit in the car is controlled to give voice prompts.
4. The method according to claim 1, characterized in that: The identifying whether there are other passengers besides the driver in the cabin of the vehicle includes: Acquiring third image information captured by an in-vehicle camera of the cabin of the vehicle; By identifying the third image information, it is determined whether the other passenger exists in the cabin of the vehicle.
5. The method according to any one of claims 1 to 4, characterized in that If it is determined that the driver is in a fatigue state according to the fatigue detection information, the method further includes: The exterior lights of the vehicle are turned on to flash.
6. A vehicle driving processing device, characterized in that: include: An acquisition module is configured to acquire driver fatigue detection information; a processing module configured to, if it is determined according to the fatigue detection information that the driver is in a fatigue state, activate an assisted driving mode of the vehicle and identify whether there are other passengers other than the driver in the cabin of the vehicle, wherein the assisted driving mode includes limiting the speed of the vehicle; The prompt module is configured to prompt to replace the driver if it is determined that there are other passengers in the cabin of the vehicle.
7. The device according to claim 6, characterized in that The acquisition module is specifically configured to acquire first image information of the driver captured by an in-vehicle camera, and to acquire driving behavior information of the driver, wherein the driving behavior information includes information on the use of the accelerator and brake of the vehicle by the driver within a preset time period; Obtaining the driver's head state information and pupil state information by identifying the first image information; If the head state information matches the head state information of the user in a fatigue state, and the pupil state information matches the pupil state information of the user in a fatigue state, and the driving behavior information matches the driving behavior information of the user in a fatigue state, it is determined that the driver is in a fatigue state.
8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 5 is implemented.
9. An electronic device comprising a storage medium, a processor, and a computer program stored in the storage medium and executable on the processor, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 5 is implemented.
10. A vehicle, characterized in that: include: The device as claimed in any one of claims 6 to 7, or the electronic device as claimed in claim 9.
Citation Information
Cited By
Driver fatigue driving monitoring system and method, terminal and storage medium
CN119705460A
