Emergency state response method and device based on driver health state

Abstract

The invention provides an emergency state response method and device based on the health state of a driver. The method comprises the following steps: collecting facial behavior data and health data of a driver; according to the face behavior data or the combination of the face behavior data and the health data, the health state of the driver is evaluated, and a current health state evaluation result of the driver is obtained; according to the health state evaluation result, an emergency state response matched with the health state evaluation result is triggered, and the emergency state response comprises the steps that an early warning signal is sent to a driver, an auxiliary driving function of the vehicle is started, and health data of the driver and vehicle driving data are recorded and uploaded to a cloud server; and when it is detected that the driver closes the emergency state response and confirms continuous driving, the vehicle is controlled to continue driving according to the current driving state according to the driver instruction. According to the method, the health problem of the driver can be automatically responded under the emergency condition, and the safety and the intelligent level of the vehicle are improved.

Description

Technical Field

[0001] The present application relates to the field of new energy vehicle technology, and in particular to an emergency response method and device based on the health status of a driver. Background Art

[0002] With the development of autonomous driving technology, L2 autonomous driving functions have been widely used in modern vehicles. L2 autonomous driving systems can reduce the burden on drivers and improve driving safety through a series of driving assistance functions (such as forward collision warning, automatic emergency braking, adaptive cruise control, etc.). However, L2 autonomous driving functions still require the driver to maintain control of the vehicle in an emergency and cannot fully address the risks caused by driver health problems or fatigue.

[0003] Driver monitoring systems (DMS) are also gradually developing. Through machine vision technology, DMS systems can monitor the driver's facial behavior in real time to detect fatigue driving, distracted driving, and other situations, and issue warnings to the driver. However, existing DMS systems mainly rely on the analysis of the driver's facial behavior and cannot effectively deal with sudden health problems of the driver (such as heart attack or hypoglycemia), which may cause the driver to lose control of the vehicle and cause serious traffic accidents.

[0004] In the existing technology, the driver's health status is not organically combined with the L2 autonomous driving system, and the vehicle cannot automatically make driving decisions based on the driver's real-time health status. Although the DMS system can detect fatigue driving or distracted driving behaviors, it cannot effectively respond to sudden health problems of the driver and lacks comprehensive monitoring and analysis of the driver's physiological state. Lack of active emergency response mechanism: When the driver has a sudden health crisis, the existing system mainly relies on the driver to take emergency measures, and cannot automatically activate the assisted driving function when the driver loses control, which leads to driving safety hazards. Summary of the invention

[0005] In view of this, the embodiments of the present application provide an emergency response method and device based on the driver's health status to solve the problems existing in the prior art, such as insufficient integration of health monitoring and autonomous driving functions, lack of comprehensive monitoring and analysis of the driver's physiological state, lack of active emergency response mechanism, resulting in inability to automatically respond to the driver's health problems in emergency situations, and reduced safety and intelligence level of the vehicle.

[0006] In a first aspect of an embodiment of the present application, a method for responding to an emergency situation based on the driver's health status is provided, comprising: collecting facial behavior data of the driver using a driver monitoring system, and collecting health data of the driver using a wearable device; evaluating the driver's health status based on the facial behavior data or a combination of the facial behavior data and the health data, and obtaining an evaluation result of the driver's current health status, wherein the health status evaluation result includes the type of abnormal health status and the degree of abnormal health status; triggering an emergency response that matches the health status evaluation result based on the health status evaluation result, wherein the emergency response includes sending a warning signal to the driver, starting the vehicle's assisted driving function, and recording and uploading the driver's health data and vehicle driving data to a cloud server; when it is detected that the driver has turned off the emergency response and confirms to continue driving, controlling the vehicle to continue driving in the current driving state according to the driver's instructions.

[0007] According to a second aspect of an embodiment of the present application, there is provided an emergency response device based on the driver's health status, comprising: a collection module configured to collect the driver's facial behavior data using a driver monitoring system, and to collect the driver's health data using a wearable device; an evaluation module configured to evaluate the driver's health status based on the facial behavior data or a combination of the facial behavior data and the health data, and obtain an evaluation result of the driver's current health status, wherein the health status evaluation result includes the type of abnormal health status and the degree of abnormal health status; a response module configured to trigger an emergency response matching the health status evaluation result based on the health status evaluation result, wherein the emergency response includes sending a warning signal to the driver, starting the vehicle's assisted driving function, and recording and uploading the driver's health data and vehicle driving data to a cloud server; a control module configured to control the vehicle to continue driving in the current driving state according to the driver's instructions when it is detected that the driver has turned off the emergency response and confirms to continue driving.

[0008] According to a third aspect of an embodiment of the present application, an electronic device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the steps of the above method are implemented when the processor executes the computer program.

[0009] According to a fourth aspect of an embodiment of the present application, a computer-readable storage medium is provided, which stores a computer program, and when the computer program is executed by a processor, the steps of the above method are implemented.

[0010] At least one of the above technical solutions adopted in the embodiments of the present application can achieve the following beneficial effects:

[0011] The driver's facial behavior data is collected by using a driver monitoring system, and the driver's health data is collected by using a wearable device; the driver's health status is evaluated based on the facial behavior data or a combination of facial behavior data and health data to obtain the driver's current health status evaluation result, wherein the health status evaluation result includes the abnormal health status type and the abnormal health status degree; according to the health status evaluation result, an emergency response matching the health status evaluation result is triggered, wherein the emergency response includes sending a warning signal to the driver, starting the vehicle's assisted driving function, and recording and uploading the driver's health data and vehicle driving data to a cloud server; when it is detected that the driver has turned off the emergency response and confirmed to continue driving, the vehicle is controlled to continue driving according to the driver's instructions in the current driving state. This application can automatically respond to the driver's health problems in emergency situations and improve the safety and intelligence level of the vehicle. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0013] Figure 1 It is a flowchart of an emergency response method based on the driver's health status provided in an embodiment of the present application;

[0014] Figure 2 It is a schematic diagram of the principle of the emergency state response method under the operating condition 1 (fatigue driving condition) provided in the embodiment of the present application;

[0015] Figure 3 It is a schematic diagram of the principle of the emergency state response method under the second operating condition (emergency health state condition) provided in the embodiment of the present application;

[0016] Figure 4 It is a schematic diagram of the principle of the emergency state response method for different blood pressure data under emergency health state conditions provided by an embodiment of the present application;

[0017] Figure 5 is a structural schematic diagram of an emergency state response device based on a driver's health state provided in an embodiment of the present application;

[0018] Figure 6 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0019] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0020] Level 2 autonomous driving system: Level 2 autonomous driving functions include a series of advanced driver assistance functions, such as forward collision warning (FCW), automatic emergency braking (AEB), adaptive cruise control (ACC), lane departure warning (LDW), etc. These functions are designed to assist drivers through automated technology and improve driving safety.

[0021] Driver Monitoring System (DMS): The DMS system is used to monitor the driver's status, especially when driving fatigued, distracted or in poor health, by detecting the driver's face, line of sight, movement and other information to determine their status. If the system detects an abnormality (such as the driver closing his eyes or yawning), it will remind or take measures to prevent danger.

[0022] Health status monitoring equipment: including Bluetooth watches, blood glucose monitors, sports bracelets, etc. These devices can monitor the driver's health data in real time, such as heart rate, blood pressure, blood oxygen, blood sugar, etc. The data is transmitted to the on-board host (MPC) through the cockpit system.

[0023] Integration of cockpit system and MPC: The cockpit system is responsible for receiving the user's health data and periodically transmitting this data to MPC. MPC is responsible for integrating various driving assistance functions and arbitrating and operating when abnormal conditions are detected.

[0024] The existing L2 autonomous driving system and DMS system mainly work independently. Although the DMS can monitor the driver's fatigue or distraction, and the L2 autonomous driving function can take over the driving under appropriate conditions, these systems have not been effectively integrated with the driver's health status detection equipment. The specific shortcomings are as follows:

[0025] 1. Insufficient use of health data: Although modern vehicles can be connected to users' health monitoring devices, these data are usually only displayed and recorded, and are not deeply integrated with the vehicle's autonomous driving functions. For example, changes in the driver's heart rate, blood sugar, blood pressure, etc. may cause health risks during driving, but existing technologies do not fully utilize these data to directly affect the activation or operation of autonomous driving functions.

[0026] 2. Limitations of DMS: DMS mainly relies on the driver's facial and behavioral monitoring (such as closing eyes, yawning, etc.) to judge fatigue or distraction. It is difficult to make effective judgments and responses to non-visual health problems (such as sudden changes in heart rate, abnormal blood pressure, etc.).

[0027] 3. Lack of active intervention mechanism: Even if DMS detects a problem with the driver, existing technology is limited to reminding the driver and rarely takes active assisted driving measures. For health crises that may suddenly occur, such as a driver's heart attack or fainting due to hypoglycemia, the existing system cannot provide timely and effective responses.

[0028] Therefore, in view of the above-mentioned defects of the prior art, the main technical problems existing in the prior art include:

[0029] 1. How to effectively integrate the driver’s health data (such as heart rate, blood sugar, blood pressure, etc.) with the vehicle’s autonomous driving function (MPC) so that appropriate safety measures can be automatically initiated when health abnormalities are detected.

[0030] 2. How to use the linkage between the DMS system and health monitoring equipment to enable assisted driving or automatic driving functions in a timely manner to ensure driving safety when the driver is in health crisis or fatigue state.

[0031] 3. How to design a reasonable early warning and emergency mechanism, and take different response measures such as reminders, assisted driving takeover, lane change parking, data uploading, etc. when different degrees of health risks are detected.

[0032] In summary, although the existing technology has certain autonomous driving functions and driver status monitoring capabilities, it has not yet achieved deep integration with driver health status detection equipment, and lacks an automatic intervention mechanism under emergency health conditions. This makes it impossible for the vehicle to respond quickly when the driver's health is abnormal, which may lead to driving safety hazards. By integrating health monitoring equipment, DMS and MPC functions, the safety and intelligence of the autonomous driving system can be better improved, especially to deal with sudden health risks.

[0033] In view of the problems existing in the above-mentioned prior art, this application proposes an assisted driving system based on the driver's health status by deeply integrating the driver monitoring system (DMS), the vehicle main control unit (MPC) and the user's wearable health monitoring device. The system can dynamically monitor the driver's facial behavior and health data during driving, realize real-time status assessment, and trigger an emergency response adapted to the driver's current status based on the assessment results. In this way, this application improves driving safety and user experience without significantly increasing costs, especially when the driver has an emergency health condition, it can effectively protect the driver's life and property safety.

[0034] The technical solution of this application forms a highly coordinated intelligent driving system by integrating DMS, MPC all-in-one machine and the user's wearable device. Specifically, DMS is mainly responsible for collecting the driver's facial behavior data and analyzing his fatigue, distraction or abnormal health; and the MPC all-in-one machine, as an on-board control unit, not only receives data transmitted by DMS, but also receives the driver's health data from wearable devices through the cockpit system, such as heart rate, blood sugar, blood pressure, etc. The wearable device monitors the driver's physiological state in real time, transmits this data to the cockpit via Bluetooth, and then the cockpit system sends the data to MPC.

[0035] When health data is abnormal (such as a sudden increase in heart rate, low blood sugar, high blood pressure, etc.), the system can not only prompt the driver, but also automatically trigger the corresponding driving assistance function according to the severity of the health status. Specific response steps include sending a warning signal to the driver, starting the vehicle's automatic driving assistance function to change lanes or pull over, and uploading health data and driving data to the cloud server for recording and analysis. This intelligent health data response mechanism significantly improves the system's response speed and accuracy when dealing with sudden health conditions of the driver, avoiding the potential risk of the driver losing control.

[0036] This application integrates and optimizes existing technologies to expand functions while avoiding significant increases in costs. By making full use of existing on-board sensors (such as DMS cameras), wearable devices, and MPC all-in-ones, cross-domain integration of intelligent driving and cockpit systems is achieved. The existing L2 autonomous driving technology, based on functions such as forward collision warning, adaptive cruise control, and lane keeping, further improves safety and driving experience by integrating health monitoring and driver behavior analysis. Without significantly increasing hardware investment, the safety and reliability of the system can be effectively improved.

[0037] If the driver's health is detected to be abnormal and he is unable to continue driving safely, the system of this application can automatically initiate a series of protective measures. Through the data fusion of DMS and wearable devices, the system can quickly assess the driver's health status. When the evaluation results show that the driver has obvious health risks (such as dizziness caused by high heart rate or hypoglycemia), the system will automatically start the vehicle's assisted driving function, take over vehicle control, and perform operations such as changing lanes, slowing down, or pulling over. At the same time, the vehicle's driving data and driver health data will be recorded in real time and uploaded to the cloud for subsequent analysis or emergency rescue.

[0038] In more serious emergency situations, such as a heart attack or fainting caused by a sudden drop in blood sugar, the system will not only perform the above-mentioned autonomous driving functions, but also call the driver's address book through the cockpit system to automatically call emergency contacts or rescue calls, further enhancing the driver's life protection capabilities. This type of automated intervention mechanism in emergency situations greatly enhances the safety performance of the system, especially when the driver loses control, and can effectively avoid traffic accidents.

[0039] This application realizes intelligent assisted driving function based on the driver's health status by closely integrating the driver monitoring system (DMS), the vehicle control unit (MPC) and wearable devices. This technical solution not only improves the functional scalability and user experience of the system, but also protects the driver's life and property safety through an automated response mechanism in an emergency. Without significantly increasing the system cost, it achieves an effective balance between driving safety, intelligence and user experience, and promotes the deep integration and development of autonomous driving and cockpit systems.

[0040] The contents of the technical solution of the present application are described in detail below with reference to the accompanying drawings and specific embodiments.

[0041] Figure 1 FIG. 1 is a flow chart of an emergency response method based on the driver's health status provided in an embodiment of the present application. Figure 1 As shown, the emergency state response method based on the driver's health state may specifically include:

[0042] S101, collecting the driver's facial behavior data using a driver monitoring system, and collecting the driver's health data using a wearable device;

[0043] S102, evaluating the health status of the driver according to the facial behavior data or a combination of the facial behavior data and the health data, and obtaining a current health status evaluation result of the driver, wherein the health status evaluation result includes a health status abnormality type and a health status abnormality degree;

[0044] S103, triggering an emergency response that matches the health status assessment result according to the health status assessment result, wherein the emergency response includes sending a warning signal to the driver, activating the vehicle's assisted driving function, and recording and uploading the driver's health data and vehicle driving data to a cloud server;

[0045] S104, when it is detected that the driver has turned off the emergency response and confirmed to continue driving, the vehicle is controlled to continue driving in the current driving state according to the driver's instructions.

[0046] In some embodiments, the health status of the driver is evaluated based on the facial behavior data to obtain the current health status evaluation result of the driver, including:

[0047] Using the vehicle-mounted control unit to perform face state recognition based on the facial behavior data, the driver's facial behavior characteristics are obtained;

[0048] When it is detected that the facial behavior characteristics meet the preset facial behavior characteristics of fatigue driving, it is determined that the driver is in a fatigue driving state, and the abnormal type of the driver's current health state is determined to be fatigue driving.

[0049] Specifically, the embodiment of the present application describes a method for health status assessment and fatigue driving detection based on driver facial behavior data. In particular, this embodiment detects and responds to the driver's fatigue driving state, and combines the driver monitoring system (DMS) and the vehicle master control unit (MPC) for linkage.

[0050] Figure 2 Schematic diagram of the principle of the emergency state response method under the operating condition 1 (fatigue driving condition) provided in the embodiment of the present application. Figure 2 As shown, the emergency state response method under operating condition 1 (fatigue driving condition) in the embodiment of the present application includes the following contents:

[0051] DMS camera collects facial data: The DMS system in the car is equipped with a camera that can collect the driver's facial image data in real time. The camera continuously monitors the driver's facial behavior and determines the driver's status by capturing the driver's eye movements (such as eye closing time, yawning, etc.).

[0052] The MPC controller performs face recognition and status detection: The facial image data captured by the DMS camera is transmitted to the MPC controller, which is equipped with a face recognition module, which analyzes the driver's expression, eye movement, etc. through a preset facial behavior model. For example, if the driver is detected to yawn frequently, close his eyes, etc., the MPC controller will determine that the driver is in a fatigued driving state.

[0053] Judgment and feedback of fatigue driving status: When the MPC controller detects that the driver's facial behavior characteristics meet the preset fatigue driving behavior characteristics (such as closing eyes for too long or yawning frequently), MPC will evaluate whether the behavior indicates that the driver is in a fatigue driving state. If MPC determines that the driver is at risk of fatigue driving, MPC will send a reminder signal of fatigue driving to the user through the vehicle network (public CAN bus).

[0054] Cockpit system reminder function: The public CAN bus sends the user fatigue reminder signal to the cockpit system. After receiving the signal, the cockpit system automatically generates a driver reminder signal. The reminder signal prompts the driver in the following ways:

[0055] Car screen display: A fatigue driving warning will be displayed on the car screen, suggesting that the driver take a rest or turn on the automatic driving assistance function.

[0056] Voice broadcast: The voice assistant of the cockpit system will make real-time broadcasts to remind the driver that there is a risk of fatigue driving and recommends starting the assisted driving function to ensure driving safety.

[0057] Driver response and control: When the driver receives the prompt, he can choose whether to turn on the vehicle's assisted driving function. If the driver does not respond or ignores the prompt, the system will not forcefully intervene in the driving behavior, and the process ends here.

[0058] Through the method of the above embodiment, the present application can realize fatigue driving detection based on the driver's facial behavior data, and timely remind the driver through the vehicle system to ensure driving safety. This function effectively improves the vehicle's perception and response capabilities to the driver's health status by combining the linkage of DMS and MPC all-in-one.

[0059] In some embodiments, triggering an emergency response matching the health status assessment result according to the health status assessment result includes:

[0060] When it is detected that the driver is in a fatigue driving state, the on-board control unit is used to send a fatigue driving signal to the vehicle's CAN bus, so that the cockpit system can generate a driver reminder signal after receiving the fatigue driving signal transmitted by the CAN bus, and the driver reminder signal is displayed and voice broadcast through the vehicle screen, and a prompt message to turn on the assisted driving function is sent to the driver.

[0061] Specifically, the embodiment of the present application provides an emergency response method based on the health status assessment result, especially an emergency response process triggered by the vehicle system when the driver is detected to be in a fatigue driving state. The process involves the coordinated work of the driver monitoring system (DMS), the vehicle control unit (MPC) and the cockpit system.

[0062] First, the driver's facial behavior data is collected in real time through the DMS camera, and the data is processed by the MPC control unit to analyze the driver's behavioral characteristics, such as yawning, closing eyes, etc.

[0063] When MPC detects fatigue driving behaviors such as frequent yawning or closing eyes, it will determine that the driver is in a fatigue driving state based on the preset fatigue driving judgment criteria and generate a health status assessment result.

[0064] Furthermore, after the MPC control unit generates the evaluation result of fatigue driving, the MPC sends a fatigue driving signal through the vehicle's CAN bus. The signal is intended to trigger the vehicle's cockpit system to perform corresponding driver reminder operations.

[0065] Furthermore, the cockpit system continuously monitors the signals transmitted by the CAN bus. When receiving the fatigue driving signal sent by the MPC, the user health judgment module inside the cockpit system will process the signal and generate a corresponding driver reminder signal based on the signal. The cockpit system can remind the driver in a variety of ways to ensure that he is aware of the risks of fatigue driving and recommend appropriate measures.

[0066] Furthermore, the driver reminder signal is forwarded to the car screen, which displays a clear fatigue driving reminder message, which includes reminding the driver that he is currently in a fatigue driving state and suggesting that he take a rest or turn on the automatic driving assistance function.

[0067] At the same time, the cockpit system plays voice prompts through the voice broadcast function of the car computer to inform the driver of his current fatigue state and recommends that the driver enable the automatic driving assistance function to ensure driving safety.

[0068] Furthermore, during the car screen and voice broadcast, the system will send a prompt message to turn on the automatic driving assistance function. If the driver responds to the prompt, the assisted driving function can be manually enabled, so that the vehicle can take over part or all of the driving task, helping the driver to cope with driving tasks in a fatigued state.

[0069] Furthermore, if the driver chooses to ignore the prompt and continue driving, the system will not forcibly take over the driving task, and the driving control is still in the hands of the driver. However, if the driver chooses to turn on the assisted driving function, the system will activate the automatic driving assistance function according to the specific road and driving conditions to ensure the safe driving of the vehicle.

[0070] Through the method of the above embodiment, the present application can generate a fatigue reminder signal in time through the synergy of MPC and the cockpit system when the driver is driving fatigued, and remind the driver through the car screen and voice to ensure driving safety. The system can not only detect the fatigue driving state, but also provide automatic driving assistance functions according to the driver's choice, effectively improving the driving experience and safety.

[0071] In some embodiments, the driver's health status is evaluated based on the combination of facial behavior data and health data to obtain the driver's current health status evaluation result, including:

[0072] The driver's facial behavior data and health data are analyzed using the on-board control unit. When an abnormal health signal is detected in the driver's health data and the driver's facial behavior characteristics meet the preset abnormal facial behavior characteristics, it is determined that the driver is in an emergency health state, and the driver's current health state abnormality type is determined to be an emergency health state; wherein the health data includes heart rate data, blood sugar data and blood pressure data.

[0073] Specifically, an embodiment of the present application provides an emergency response method based on the driver's health data and facial behavior data. In particular, when the driver has an emergency health condition (such as abnormal heart rate or low blood sugar), the system automatically performs a health assessment and triggers corresponding emergency driving control measures.

[0074] Figure 3 Schematic diagram of the principle of the emergency response method under the second operating condition (emergency health condition) provided in the embodiment of the present application. Figure 3 As shown, the emergency state response method under operating condition 2 (emergency health state condition, including abnormal heart rate, abnormal blood sugar and abnormal blood pressure) in the embodiment of the present application includes the following contents:

[0075] First, the health monitoring device worn by the user (such as a heart rate monitoring device or a blood sugar monitoring device) monitors the driver's physiological state in real time, and continuously transmits the heart rate data or blood sugar data to the vehicle's cockpit system via Bluetooth connection.

[0076] Furthermore, the cockpit system receives heart rate or blood sugar data from the wearable device and processes the data. Subsequently, the cockpit system sends the health data to the MPC control unit via the vehicle's public CAN bus for further analysis.

[0077] Furthermore, the MPC control unit receives the heart rate or blood sugar data forwarded by the cockpit system by monitoring the signals in the public CAN bus. When it detects that the driver's heart rate data or blood sugar data is abnormal (such as a sudden increase in heart rate or blood sugar below the normal threshold), the MPC will begin to further analyze the driver's health status.

[0078] Furthermore, the MPC control unit transmits abnormal heart rate or blood sugar data to the DMS system, which collects the driver's facial behavior data through the in-car camera and uses the face recognition module to analyze the driver's facial expression. At this time, the system will focus on detecting whether the driver shows abnormal facial behavior such as pain, struggle, long-term eye closure or convulsion.

[0079] Furthermore, MPC combines the facial behavior data and health data of the DMS system to comprehensively evaluate the driver's health status. If the system determines that the driver's facial behavior and health data both show that the driver is in a bad state (such as a sudden increase in heart rate accompanied by a painful expression or long-term eye closure), MPC determines that the driver is in an emergency health state.

[0080] Furthermore, once it is determined that the driver is in an emergency health state, the MPC will send an emergency health state signal through the public CAN bus and trigger the vehicle's assisted driving function. The specific steps are as follows:

[0081] Automatic driving takeover: The system automatically activates the vehicle's assisted driving function, controls the vehicle to change lanes, and pulls over to the side of the road to ensure that the driver maintains driving safety in the event of a driver loss of driving ability.

[0082] Safe parking of the vehicle: After the vehicle completes the parking operation, the system automatically turns on the hazard lights to remind the drivers of surrounding vehicles that the vehicle is in an emergency state.

[0083] Data upload and recording: At the same time, MPC uploads the driver's health data (such as heart rate, blood sugar, etc.) and driving data to the cloud server for further processing or emergency rescue.

[0084] For example, in one example, taking the abnormal heart rate of the driver as an example, when MPC detects abnormal fluctuations in the driver's heart rate, such as a sudden increase in heartbeat, unstable heart rate, and combined with the driver's abnormal behaviors such as painful facial expressions or convulsions, the system will regard it as an emergency health situation. At this time, DMS will notify MPC to automatically turn on the assisted driving function, the vehicle will start to change lanes, pull over, and the driving data and health data will be reported to the cloud at the same time. The system can also automatically contact the driver's emergency contact or rescue service through the cockpit system.

[0085] Through the method of the embodiment of the present application, the present application can quickly trigger the vehicle's automatic driving function and take safety measures when the driver has an emergency health condition such as abnormal heart rate or hypoglycemia, so as to ensure the driver's driving safety in the event of sudden health problems. At the same time, the system can provide support for subsequent health intervention or rescue through real-time data analysis and upload.

[0086] In some embodiments, triggering an emergency response matching the health status assessment result according to the health status assessment result includes:

[0087] When it is detected that the driver is in an emergency health state, the vehicle control unit is used to start the function switch module, and the state management module is controlled to switch and manage the process group, start the processes of the planning control module and the driving perception module, and automatically turn on the assisted driving function, control the vehicle to park on the side of the road, and report the driver's health data and vehicle driving data to the cloud server.

[0088] Specifically, when it is detected that the driver is in an emergency health state, the vehicle performs safety intervention through the automatic driving function. This embodiment focuses on describing that when the driver has an emergency health condition, the system automatically performs assisted driving and parking operations of the vehicle through the coordinated action of the planning control module and the driving perception module.

[0089] First, the driver's health status is comprehensively evaluated by the vehicle control unit (MPC) by analyzing facial behavior data collected from wearable devices (such as heart rate monitoring devices, blood sugar monitoring devices) and DMS cameras. When the system detects abnormalities in the driver's health data, such as a sudden increase in heart rate, low blood sugar or other health crises, combined with the driver's facial expression (such as long-term eye closure, painful expression, etc.), the evaluation results show that the driver is in an emergency health state.

[0090] Furthermore, once the MPC determines that the driver is in an emergency health state, the MPC starts the emergency response process through the function switch module. The function switch module will notify the state management module and instruct it to perform a response process.

[0091] Further, after receiving the notification from the function switch module, the state management module switches and manages the process group of the vehicle. Specifically, the state management module activates the control process related to the automatic driving, including the planning control module and the driving perception module.

[0092] The planning control module is responsible for planning the vehicle's driving path and ensuring appropriate lane changes or side parking operations in emergency situations.

[0093] The driving perception module monitors the road environment in real time through front sensors, on-board radar and other equipment to ensure that the vehicle can safely execute lane changes and parking operations.

[0094] Furthermore, when the planning control module and the driving perception module are started, the vehicle's assisted driving function enters the normal operation state. At this stage, the vehicle will automatically perform driving operations based on the planned path and perception results.

[0095] Furthermore, the system will automatically control the vehicle, which may include the following operations:

[0096] Lane change operation: The vehicle automatically changes lanes according to the planned path in order to select a suitable parking location.

[0097] Pull over: After finding a safe parking location, the vehicle will automatically slow down and pull over to ensure that the driver does not continue driving if his health condition is abnormal.

[0098] Double flash lights are on: In order to alert other vehicle drivers, the system will automatically turn on the vehicle's double flash lights after parking, indicating that the vehicle is in an emergency state.

[0099] Furthermore, while the assisted driving function is being executed, the MPC control unit reports the driver's health data and the vehicle's driving data to the cloud server through the vehicle network. The upload of this data helps to provide key reference information for subsequent medical rescue or accident handling in emergency situations.

[0100] The uploaded data may include the driver's real-time health status (such as heart rate, blood sugar, etc.) as well as the vehicle's location information, driving status, etc. This data synchronization mechanism ensures that when the driver is unable to save himself, relevant emergency rescue personnel can obtain key information in time and take action.

[0101] Furthermore, after completing the lane change and parking operations, the vehicle maintains the standby state of the assisted driving function until the driver's health status recovers or external rescue forces intervene. When it is detected that the driver's health status has returned to normal, the system can prompt the driver to continue driving, or keep the assisted driving function activated until the vehicle is restarted.

[0102] Through the above-mentioned method of the embodiment of the present application, the system can timely determine whether the driver is in an emergency health state through the analysis of the driver's health data and facial behavior data by the vehicle control unit (MPC). Once the emergency state is confirmed, the system will automatically start the assisted driving function through the state management module, and the planning control module and the driving perception module will work together to ensure the vehicle's safe lane change and side parking. At the same time, the driver's health data and the vehicle's driving data are uploaded to the cloud for subsequent rescue.

[0103] In some embodiments, triggering an emergency response matching the health status assessment result according to the health status assessment result includes:

[0104] When it is detected that the driver's blood pressure is higher than the first blood pressure threshold, a health warning signal is sent to the vehicle's CAN bus by using the vehicle control unit, so that after receiving the health warning signal transmitted by the CAN bus, the cockpit system sends a prompt message to the driver to stop the car for a rest and turn on the auxiliary driving function;

[0105] When the driver's blood pressure is detected to be higher than the second blood pressure threshold, the vehicle control unit is used to send a health warning signal to the vehicle's CAN bus, so that after receiving the health warning signal transmitted by the CAN bus, the cockpit system sends a prompt message to the driver to stop and rest and turn on the auxiliary driving function, and reports the driver's health data and vehicle driving data to the cloud server;

[0106] When it is detected that the driver's blood pressure is higher than the third blood pressure threshold, the on-board control unit is used to send a health warning signal to the vehicle's CAN bus, so that after receiving the health warning signal transmitted by the CAN bus, the cockpit system will send a reminder message to the driver to stop and rest and notify emergency contacts, and automatically turn on the assisted driving function, control the vehicle to pull over, and report the driver's health data and vehicle driving data to the cloud server.

[0107] Specifically, the embodiment of the present application provides an emergency response method based on the driver's blood pressure status, especially when the driver's blood pressure is detected to exceed different thresholds, the system takes corresponding safety response measures. Through real-time monitoring of the driver's health data, the system can automatically determine whether the driver is in a dangerous state, and ensure the driver's life safety through functions such as automatic driving, safe parking, and data reporting.

[0108] Figure 4 Schematic diagram of the principle of the emergency response method for different blood pressure data under emergency health conditions provided by the embodiment of the present application. Figure 4 As shown, in the embodiment of the present application, the emergency state response method for different blood pressure data under the emergency health state working condition includes the following contents:

[0109] First, the Bluetooth blood pressure monitoring device worn by the user can monitor the driver's blood pressure data in real time. The device continuously transmits the blood pressure data to the vehicle's cockpit system via Bluetooth.

[0110] After receiving the data from the blood pressure monitoring device, the cockpit system transmits it to the vehicle control unit (MPC) through the vehicle's public CAN bus. The MPC control unit periodically monitors and analyzes the blood pressure data.

[0111] The blood pressure data transmitted via the public CAN is forwarded to the face recognition module and combined with the driver's facial behavior characteristics (such as painful expression, abnormal behavior) for comprehensive analysis. If the driver's blood pressure is abnormal and the facial expression is abnormal, the system will take further response measures.

[0112] Further, the first blood pressure threshold response (blood pressure greater than 140 mmHg):

[0113] When the MPC detects that the driver's blood pressure exceeds the first blood pressure threshold (140 mmHg), the MPC sends a health warning signal via the public CAN to inform the driver that his blood pressure has slightly increased.

[0114] After receiving the warning signal, the cockpit system displays information on the car screen and broadcasts it through voice, reminding the driver that his blood pressure is high and suggesting that the driver pull over to rest. If the driver confirms to continue driving, the system prompts him to choose to turn on the assisted driving function to ensure driving safety.

[0115] Further, the second blood pressure threshold response (blood pressure greater than 160 mmHg):

[0116] When MPC detects that the driver's blood pressure exceeds the second blood pressure threshold (160 mmHg), it indicates that the driver's blood pressure is moderately elevated and there may be risks such as dizziness.

[0117] In this case, MPC sends a health warning signal to the public CAN bus. After receiving the signal, the cockpit system will remind the driver to stop and rest through the car screen and voice broadcast, and suggest that he start the assisted driving function.

[0118] At this point, the system starts recording the driver's driving and health data, and uploads this data to the cloud server in real time to provide information support for subsequent emergency response. If the driver decides to continue driving, the system will continue to monitor the driver's status and provide continuous prompts.

[0119] Further, the third blood pressure threshold response (blood pressure greater than 180 mmHg):

[0120] When MPC detects that the driver's blood pressure exceeds the third blood pressure threshold (180 mmHg), it indicates that the driver may be in a very dangerous health condition, such as dizziness, blurred vision and other symptoms, which may very likely cause the driver to lose control.

[0121] In this case, MPC immediately sends an emergency health warning signal to the public CAN. After receiving the signal, the cockpit system prompts the driver to pull over immediately, and informs the driver through the car screen and voice that his health condition has seriously deteriorated, and advises him not to continue driving. In addition, the cockpit system automatically calls the driver's preset emergency contact number to notify family members or relevant rescue personnel.

[0122] In this emergency state, MPC will automatically start the assisted driving function, the vehicle will automatically change lanes, and choose a suitable location to park safely. At the same time, the vehicle will turn on the double flash lights to warn other drivers of vehicles around.

[0123] Furthermore, while the assisted driving function is being executed, the MPC control unit uploads the driver's blood pressure data, vehicle driving data, location information, etc. to the cloud server in real time, making it easier for subsequent emergency rescue personnel to obtain relevant information.

[0124] Furthermore, after the vehicle successfully pulls over and the prompt is completed, the assisted driving function remains activated until the driver's health condition recovers or external rescue personnel intervene. The system decides whether to continue starting the vehicle or keep the assisted driving function activated based on the driver's feedback.

[0125] This embodiment triggers corresponding emergency response measures through multi-level threshold judgment of the driver's blood pressure data. When the driver's blood pressure exceeds the preset threshold, the system coordinates the cockpit system, assisted driving function and external communication function through the vehicle control unit (MPC) to ensure the protection of the driver's life safety in an emergency, and automatically takes over the vehicle driving task when necessary. This technical solution can effectively deal with the potential health crisis caused by high blood pressure of the driver, and ensure the timely transmission of relevant information through data upload.

[0126] In some embodiments, triggering an emergency response matching the health status assessment result according to the health status assessment result includes:

[0127] When it is detected that the abnormality of health status reaches the preset serious abnormality, the emergency communication module is automatically activated, the driver's address book is called by the cockpit system, and a call is automatically made to the preset emergency contact, or a notification is sent to the preset emergency service system.

[0128] Specifically, when it is detected that the driver's health condition reaches a preset serious abnormality, the system will automatically activate the emergency communication module and send a notification to the emergency contact or emergency service system through the cockpit system.

[0129] First, the driver's health data is monitored in real time through wearable devices (such as heart rate monitors and blood pressure monitoring devices). These data include but are not limited to physiological parameters such as heart rate, blood pressure, and blood sugar. The device transmits the data to the cockpit system via Bluetooth.

[0130] Furthermore, after receiving the health data, the cockpit system transmits it to the vehicle control unit (MPC) through the vehicle's CAN bus. The MPC analyzes the health data through a preset algorithm and combines the driver's facial behavior data (such as facial expressions and eye movements collected by the DMS system) to assess the health status.

[0131] Furthermore, when MPC analyzes that the driver's health status exceeds the normal range and reaches the preset severe abnormality threshold, such as a sudden increase in heart rate, a sharp increase in blood pressure, or the driver showing obvious pain, MPC defines the health status as a severe abnormal health status.

[0132] Furthermore, when the driver's health status is detected to be seriously abnormal, the MPC automatically triggers the emergency communication module. The emergency communication module is responsible for handling the driver's communication needs with the outside world, ensuring that the driver can establish contact with his emergency contact or rescue service system in a timely manner if he loses his ability to move.

[0133] Furthermore, the cockpit system accesses the driver's address book preset in the vehicle system through the emergency communication module. The address book includes the phone information of the driver's emergency contacts (such as family members or relatives and friends), as well as the preset emergency service system contact information (such as road rescue service or emergency medical service).

[0134] Furthermore, the cockpit system automatically calls the driver's emergency contact based on the information in the address book. After the call is connected, the system will inform the emergency contact of the driver's current abnormal health status through a preset voice prompt, and explain the vehicle's real-time location information and the driver's health data. If the driver has preset multiple emergency contacts, the system can call different contacts in priority order until a response is received.

[0135] As another emergency measure, the cockpit system can also send a notification to a preset emergency service system (such as medical emergency or road rescue service). The notification contains the driver's health data (such as heart rate, blood pressure, etc.) and the vehicle's real-time location information, which is convenient for rescue personnel to quickly locate and handle.

[0136] Furthermore, after the emergency communication module is activated, MPC synchronizes the driver's health data, vehicle driving data and location data to the cloud server through the vehicle network to ensure that the data can be saved in real time and provide a basis for subsequent processing.

[0137] Furthermore, when the system successfully establishes communication with the emergency contact, the cockpit system can confirm through voice whether the driver or the emergency contact needs to continue with further driving assistance functions, or directly request emergency service intervention.

[0138] Furthermore, if the driver is in a serious condition and cannot continue driving, the cockpit system can further trigger the vehicle's automatic driving assistance function, causing the vehicle to safely pull over and automatically turn on the double flash lights to alert other vehicles. This operation buys the driver more time to wait for rescue, while ensuring that he does not continue driving and avoids potential danger.

[0139] This embodiment monitors and analyzes the driver's health status in real time. When the driver's health status reaches a serious abnormality, the system automatically activates the emergency communication module and sends a notification to the emergency contact or emergency service system through the cockpit system. This emergency communication mechanism can ensure that in the event that the driver loses the ability to drive, they can quickly establish contact with the outside world and provide necessary assistance. This function, combined with the automatic driving assistance function, further ensures the safety of the driver.

[0140] The following is an embodiment of the device of the present application, which can be used to execute the embodiment of the method of the present application. For details not disclosed in the embodiment of the device of the present application, please refer to the embodiment of the method of the present application.

[0141] Figure 5 Schematic diagram of the structure of the emergency response device based on the driver's health status provided in the embodiment of the present application. Figure 5 As shown, the emergency response device based on the driver's health status includes:

[0142] The collection module 501 is configured to collect the driver's facial behavior data using the driver monitoring system and collect the driver's health data using the wearable device;

[0143] An evaluation module 502 is configured to evaluate the health status of the driver according to the facial behavior data or a combination of the facial behavior data and the health data, and obtain a current health status evaluation result of the driver, wherein the health status evaluation result includes a health status abnormality type and a health status abnormality degree;

[0144] The response module 503 is configured to trigger an emergency response that matches the health status assessment result according to the health status assessment result, wherein the emergency response includes sending a warning signal to the driver, activating the vehicle's assisted driving function, and recording and uploading the driver's health data and vehicle driving data to the cloud server;

[0145] The control module 504 is configured to control the vehicle to continue driving in the current driving state according to the driver's instructions when it is detected that the driver has turned off the emergency response and confirmed to continue driving.

[0146] In some embodiments, Figure 5 The evaluation module 502 utilizes the vehicle-mounted control unit to perform facial state recognition based on the facial behavior data to obtain the driver's facial behavior characteristics; when it is detected that the facial behavior characteristics meet the preset facial behavior characteristics of fatigue driving, it is determined that the driver is in a fatigue driving state, and the driver's current health status abnormality type is determined to be fatigue driving.

[0147] In some embodiments, Figure 5When the response module 503 detects that the driver is in a fatigue driving state, it uses the on-board control unit to send a fatigue driving signal to the vehicle's CAN bus, so that the cockpit system generates a driver reminder signal after receiving the fatigue driving signal transmitted by the CAN bus, displays the driver reminder signal through the vehicle screen and voice broadcast, and sends a prompt message to the driver to turn on the assisted driving function.

[0148] In some embodiments, Figure 5 The evaluation module 502 uses the on-board control unit to analyze the driver's facial behavior data and health data. When an abnormal health signal is detected in the driver's health data and the driver's facial behavior characteristics meet the preset abnormal facial behavior characteristics, it is determined that the driver is in an emergency health state, and the driver's current health state abnormality type is determined to be an emergency health state; wherein the health data includes heart rate data, blood sugar data and blood pressure data.

[0149] In some embodiments, Figure 5 When the response module 503 detects that the driver is in an emergency health state, it uses the on-board control unit to start the function switch module, and controls the state management module to switch and manage the process group, pulls up the processes of the planning control module and the driving perception module, and automatically turns on the assisted driving function, controls the vehicle to park on the side of the road, and reports the driver's health data and vehicle driving data to the cloud server.

[0150] In some embodiments, Figure 5 The response module 503 uses the on-board control unit to send a health warning signal to the CAN bus of the vehicle when it is detected that the driver's blood pressure is higher than the first blood pressure threshold, so that the cockpit system sends a prompt message to the driver to stop and rest and turn on the assisted driving function after receiving the health warning signal transmitted by the CAN bus; when it is detected that the driver's blood pressure is higher than the second blood pressure threshold, the on-board control unit sends a health warning signal to the CAN bus of the vehicle, so that the cockpit system sends a prompt message to the driver to stop and rest and turn on the assisted driving function after receiving the health warning signal transmitted by the CAN bus, and reports the driver's health data and vehicle driving data to the cloud server; when it is detected that the driver's blood pressure is higher than the third blood pressure threshold, the on-board control unit sends a health warning signal to the CAN bus of the vehicle, so that the cockpit system sends a prompt message to the driver to stop and rest and notify the emergency contact after receiving the health warning signal transmitted by the CAN bus, and automatically turns on the assisted driving function, controls the vehicle to park by the side of the road, and reports the driver's health data and vehicle driving data to the cloud server.

[0151] In some embodiments, Figure 5When the response module 503 detects that the abnormality of the health status reaches a preset serious abnormality, it automatically activates the emergency communication module, uses the cockpit system to call the driver's address book, and automatically calls the preset emergency contact, or sends a notification to the preset emergency service system.

[0152] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0153] Figure 6 Schematic diagram of the structure of the electronic device 6 provided in the embodiment of the present application. Figure 6 As shown, the electronic device 6 of this embodiment includes: a processor 601, a memory 602, and a computer program 603 stored in the memory 602 and executable on the processor 601. When the processor 601 executes the computer program 603, the steps in the above-mentioned various method embodiments are implemented. Alternatively, when the processor 601 executes the computer program 603, the functions of each module / unit in the above-mentioned various device embodiments are implemented.

[0154] Exemplarily, the computer program 603 may be divided into one or more modules / units, which are stored in the memory 602 and executed by the processor 601 to complete the present application. The one or more modules / units may be a series of computer program instruction segments capable of completing specific functions, which are used to describe the execution process of the computer program 603 in the electronic device 6.

[0155] The electronic device 6 may be a desktop computer, a notebook, a PDA, a cloud server, or other electronic device. The electronic device 6 may include, but is not limited to, a processor 601 and a memory 602. Those skilled in the art will appreciate that Figure 6 It is only an example of the electronic device 6 and does not constitute a limitation of the electronic device 6. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the electronic device may also include input and output devices, network access devices, buses, etc.

[0156] The processor 601 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc.

[0157] The memory 602 may be an internal storage unit of the electronic device 6, for example, a hard disk or memory of the electronic device 6. The memory 602 may also be an external storage device of the electronic device 6, for example, a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the electronic device 6. Further, the memory 602 may also include both an internal storage unit of the electronic device 6 and an external storage device. The memory 602 is used to store computer programs and other programs and data required by the electronic device. The memory 602 may also be used to temporarily store data that has been output or is to be output.

[0158] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0159] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0160] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0161] In the embodiments provided in the present application, it should be understood that the disclosed devices / computer equipment and methods can be implemented in other ways. For example, the device / computer equipment embodiments described above are only schematic. For example, the division of modules or units is only a logical function division. There may be other division methods in actual implementation. Multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0162] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0163] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0164] If the integrated module / unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. The computer program may include computer program code, which may be in source code form, object code form, executable file or some intermediate form. Computer-readable media may include: any entity or device capable of carrying computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium, etc.

[0165] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. An emergency response method based on driver health status, It is characterized in that include: Use the driver monitoring system to collect the driver's facial behavior data, and use wearable devices to collect the driver's health data; According to the facial behavior data or a combination of the facial behavior data and the health data, the health status of the driver is evaluated to obtain a current health status evaluation result of the driver, wherein the health status evaluation result includes a health status abnormality type and a health status abnormality degree; According to the health status assessment result, triggering an emergency response that matches the health status assessment result, wherein the emergency response includes sending a warning signal to the driver, activating the vehicle's assisted driving function, and recording and uploading the driver's health data and vehicle driving data to a cloud server; When it is detected that the driver has turned off the emergency response and confirmed to continue driving, the vehicle is controlled to continue driving in the current driving state according to the driver's instructions.

2. The method according to claim 1, It is characterized in that The health status of the driver is evaluated according to the facial behavior data to obtain a current health status evaluation result of the driver, including: Using an on-board control unit to perform facial state recognition based on the facial behavior data to obtain facial behavior features of the driver; When it is detected that the facial behavior feature meets the preset facial behavior feature of fatigue driving, it is determined that the driver is in a fatigue driving state, and the abnormal type of the driver's current health status is determined to be fatigue driving.

3. The method according to claim 2, It is characterized in that The triggering, according to the health status assessment result, an emergency status response matching the health status assessment result includes: When it is detected that the driver is in a fatigue driving state, the on-board control unit is used to send a fatigue driving signal to the vehicle's CAN bus, so that the cockpit system generates a driver reminder signal after receiving the fatigue driving signal transmitted by the CAN bus, and the driver reminder signal is displayed and voice broadcast through the vehicle screen, and a prompt message for turning on the assisted driving function is sent to the driver.

4. The method according to claim 1, It is characterized in that According to the combination of the facial behavior data and the health data, the health status of the driver is evaluated to obtain the current health status evaluation result of the driver, including: The facial behavior data and health data of the driver are analyzed using an on-board control unit. When an abnormal health signal is detected in the driver's health data and the driver's facial behavior characteristics meet preset abnormal facial behavior characteristics, it is determined that the driver is in an emergency health state, and the abnormal type of the driver's current health state is determined to be an emergency health state; wherein the health data includes heart rate data, blood sugar data and blood pressure data.

5. The method according to claim 4, It is characterized in that The triggering, according to the health status assessment result, an emergency status response matching the health status assessment result includes: When it is detected that the driver is in an emergency health state, the vehicle-mounted control unit is used to start the function switch module, and the state management module is controlled to switch and manage the process group, the processes of the planning control module and the driving perception module are pulled up, and the assisted driving function is automatically turned on, the vehicle is controlled to park by the side of the road, and the driver's health data and the vehicle driving data are reported to the cloud server.

6. The method according to claim 4, It is characterized in that The triggering, according to the health status assessment result, an emergency status response matching the health status assessment result includes: When it is detected that the driver's blood pressure is higher than a first blood pressure threshold, the vehicle-mounted control unit is used to send a health warning signal to the CAN bus of the vehicle, so that after receiving the health warning signal transmitted by the CAN bus, the cockpit system sends a prompt message to the driver to stop for a rest and turn on the auxiliary driving function; When it is detected that the driver's blood pressure is higher than a second blood pressure threshold, the vehicle-mounted control unit is used to send a health warning signal to the CAN bus of the vehicle, so that after receiving the health warning signal transmitted by the CAN bus, the cockpit system sends a prompt message to the driver to stop and rest and turn on the auxiliary driving function, and reports the driver's health data and the vehicle driving data to the cloud server; When it is detected that the driver's blood pressure is higher than the third blood pressure threshold, the on-board control unit is used to send a health warning signal to the vehicle's CAN bus, so that after receiving the health warning signal transmitted by the CAN bus, the cockpit system sends a reminder message to the driver to stop and rest and notify emergency contacts, and automatically turns on the assisted driving function, controls the vehicle to park on the side of the road, and reports the driver's health data and the vehicle's driving data to the cloud server.

7. The method according to claim 1, It is characterized in that The triggering, according to the health status assessment result, an emergency status response matching the health status assessment result includes: When it is detected that the abnormality of the health status reaches a preset serious abnormality, the emergency communication module is automatically activated, the driver's address book is called by the cockpit system, and a call is automatically made to the preset emergency contact, or a notification is sent to the preset emergency service system.

8. An emergency response device based on the driver's health status, It is characterized in that include: A collection module is configured to collect the driver's facial behavior data using a driver monitoring system and collect the driver's health data using a wearable device; an evaluation module, configured to evaluate the health status of the driver according to the facial behavior data or a combination of the facial behavior data and the health data, and obtain a current health status evaluation result of the driver, wherein the health status evaluation result includes a health status abnormality type and a health status abnormality degree; a response module configured to trigger an emergency response that matches the health status assessment result according to the health status assessment result, wherein the emergency response includes sending a warning signal to the driver, activating the vehicle's assisted driving function, and recording and uploading the driver's health data and vehicle driving data to a cloud server; The control module is configured to control the vehicle to continue driving in the current driving state according to the driver's instructions when it is detected that the driver has turned off the emergency response and confirmed to continue driving.

9. An electronic device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, It is characterized in that When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium storing a computer program. It is characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images