Procedures for monitoring a health condition in a vehicle

Abstract

The invention relates to a method for monitoring the health status of a driver (2) during the operation of a vehicle (1), wherein, based on signals acquired from a plurality of sensors (S1 to Sn) integrated into a steering wheel (4) of the vehicle (1) and based on image signals acquired from at least one camera (6), health and well-being data of the driver (2) are determined in real time by a processing unit (7) that evaluates the acquired signals and image signals. According to the invention, it is provided that - additionally, the driver's body movement, posture and facial expression (2) are analyzed using captured image signals to determine driver fatigue and / or stress and / or distraction (2) and - depending on the driver's (2) determined level of fatigue and / or stress and / or distraction, a recommendation and / or a suggestion to improve the driver's (2) well-being in the vehicle (1) will be issued or will be issued.

Description

[0001] The invention relates to a method for monitoring the health status of a driver during the operation of a vehicle, wherein health and well-being data of the driver are determined by a processing unit evaluating the recorded signals and image signals based on signals acquired from a plurality of sensors integrated into a steering wheel of the vehicle and on image signals acquired from at least one camera.

[0002] From IN 202421073008 A, a steering wheel for a vehicle is known. The steering wheel includes an integrated electrocardiogram (ECG) sensor, which monitors the driver's heart activity and detects abnormal conditions. The ECG sensor is connected to a central processing unit and an SOS system. The SOS system automatically sends alerts to emergency contacts and services as soon as critical cardiac conditions are detected. A photoplethysmogram (PPG) sensor integrated into the steering wheel monitors the driver's pulse rate, blood pressure, and circulation. The PPG sensor is connected to the central processing unit and the SOS system. The SOS system sends alerts when the PPG sensor detects irregularities in the driver's vital functions. An alcohol sensor integrated into the steering wheel measures the driver's breath alcohol concentration, with the alcohol sensor being connected to the central processing unit.The central processing unit is configured to lock the steering wheel to prevent vehicle operation if the blood alcohol content exceeds a predefined threshold. A camera positioned next to the alcohol sensor monitors the driver's facial expressions and detects signs of fatigue; the camera is connected to the central processing unit. The central processing unit is configured to trigger an alarm system to wake the driver upon detecting fatigue. A pressure sensor integrated into the steering wheel is configured to detect abnormal pressure applied by the driver to the steering wheel. This pressure sensor is connected to the central processing unit. The central processing unit interprets this pressure as an indicator of driver fatigue or an emergency situation and activates the SOS system accordingly.The central unit processes the data from each sensor in real time, integrates the results, and triggers vehicle safety mechanisms and warnings based on the sensor data. The SOS system is configured to automatically send alerts, including the vehicle's GPS location, to pre-configured emergency contacts and services as soon as it receives critical data from any of the sensors indicating an emergency or potential accident.

[0003] The invention is based on the objective of providing a method for monitoring the health status of a driver of a vehicle.

[0004] The problem is solved according to the invention by a method which has the features specified in claim 1.

[0005] Advantageous embodiments of the invention are the subject of the dependent claims.

[0006] A method for monitoring a driver's health status during vehicle operation involves using signals from multiple sensors integrated into the vehicle's steering wheel and image signals from at least one camera to determine the driver's health and well-being data in real time. This data is then evaluated by a processing unit. According to the invention, the system also analyzes the driver's body movements, posture, and facial expressions using the captured image signals to determine fatigue, stress, and / or distraction. Based on the determined level of fatigue, stress, and / or distraction, a recommendation or suggestion for improving the driver's well-being in the vehicle is then issued.

[0007] By applying this method, it is possible to determine the health status of a driver of the vehicle while the vehicle is in operation without a data collection unit worn on the driver's body, in particular in the form of a fitness tracker or smartwatch, and without requiring a visit to a doctor.

[0008] Exemplary embodiments of the invention are explained in more detail below with reference to a drawing.

[0009] This shows: Fig. 1. Schematic perspective view of a section of a vehicle with a driver in a driver's seat.

[0010] The single figure shows a perspective view of a section of a vehicle 1 with a driver 2 in a driver's seat 3.

[0011] Various sensors S1 to Sn for signal acquisition are arranged in the steering wheel 4 of vehicle 1. One sensor S1 is designed as a photoplethysmogram sensor, another sensor S2 as a heart rate and electrocardiogram sensor, and yet another sensor S3 as a blood oxygen sensor. Furthermore, a camera 6, in particular a driver observation camera, is arranged in the area of ​​an instrument panel 5, within whose field of view the driver 2 is located, so that, particularly during the operation of vehicle 1, image signals of the driver 2 are continuously acquired.

[0012] The captured signals and image signals are fed to a processing unit 7 for evaluation, in which at least one artificial intelligence-based algorithm is stored, which is used to evaluate the captured signals and image signals.

[0013] In particular, sensors S1 to Sn, camera 6, and processing unit 7 form a vehicle-integrated health monitoring system that detects and analyzes the health status of driver 2 in vehicle 1. The health monitoring system provides a comprehensive overview of driver 2's health and well-being, thus increasing comfort and convenience without the need for a portable device.

[0014] The sensors S1 to Sn integrated into the steering wheel 4 are so-called biosignal sensors, and the camera 6 represents a contactless monitoring technology. Based on the signals recorded by the sensors S1 to Sn and the image signals recorded by the camera 6, health and well-being data of the driver 2 are determined, in particular pulse, blood pressure, heart rate, electrical activity of the heart muscle fibers, blood oxygen saturation, respiratory rate, body movement, posture and facial expression of the driver 2.

[0015] It is generally known that, given the increasing importance of health monitoring, many people use wearables, i.e., fitness trackers and / or smartwatches, to collect their health data. However, some people are hesitant to wear such a device because they find it uncomfortable and / or feel their privacy is compromised.

[0016] Sensors S1 to Sn, integrated into the steering wheel 4 and designed as pulse and blood pressure sensors, utilize a combination of pressure-sensitive materials and an optical sensing unit. The pressure-sensitive materials react to pressure changes caused by a pulse, while the optical sensing unit detects changes in light absorption in the driver's blood vessels. The signals from both sensor types are then processed to determine the driver's heart rate and blood pressure.

[0017] Heart rate and ECG sensors are designed to record heart rate and ECG data. Electrodes are positioned on the steering wheel 4 and make contact with the driver's hands 2.1. The electrical activity of the heart is recorded via these electrodes. The recorded signals are then forwarded to the processing unit 7, which amplifies, filters, and converts the analog signals into digital signals. At least one artificial intelligence-based algorithm analyzes this data to determine the heart rate and generate an electrocardiogram, which provides information about the driver's cardiac function.

[0018] Blood oxygen sensors use optical technology to non-invasively measure the proportion of oxygen-saturated hemoglobin in the blood. The blood oxygen sensor emits light of specific wavelengths into a finger or the palm of the driver's hand 2 and detects light absorption. The amount of absorbed light varies depending on the blood oxygen saturation. Subsequently, a blood oxygen saturation value is determined from the detected signals using the processing unit 7.

[0019] As described above, the camera 6 is integrated into the instrument panel 5, whereby an analysis of the captured image signals carried out by the processing unit 7 is used for non-invasive health monitoring.

[0020] The camera 6 captures high-resolution image signals of the driver 2. The camera 6 is positioned relative to the driver 2 in such a way as to ensure an optimized view of the driver 2's face and upper body, thus enabling a detailed analysis of various health indicators. In particular, the camera 6 provides real-time image signal data for health monitoring.

[0021] Sophisticated algorithms, particularly those based on artificial intelligence, are used to process the image signals, especially video signals, captured by camera 6. A key technique is remote photoplethysmography. This analyzes subtle changes in skin tone within the image signals that are related to blood flow. From these changes, processing unit 7 can derive important health data such as heart rate, respiratory rate, and blood oxygen saturation without requiring physical contact with driver 2.

[0022] The driver's body movements and posture are also monitored using the captured image signals. By analyzing these movements and angles, the processing unit 7 detects signs of fatigue, discomfort, or unusual behavior. This information is then used to provide guidance and / or recommendations for improving the driving experience and the driver's overall well-being.

[0023] Furthermore, processing unit 7 analyzes the driver's facial expressions based on the captured image signals to determine the driver's emotional state. By capturing and interpreting facial expressions such as smiles, frowns, or raised eyebrows, signs of stress, fatigue, or distraction can be identified. This information can be used to provide the driver with personalized feedback and / or to support the driver in promoting safer and more comfortable operation of the vehicle.

[0024] The sensors S1 to Sn integrated into the steering wheel 4 continuously record health-related signals from the driver 2. Specifically, the driver 2's pulse, blood pressure, heart rate, electrical activity of the heart, and blood oxygen saturation are monitored based on these signals. The signals are recorded in real time, ensuring that health monitoring is always based on the driver 2's essentially current physiological state.

[0025] Simultaneously, the camera 6 in the instrument panel 5 captures image signals, which are evaluated using at least one artificial intelligence-based image analysis algorithm. This algorithm analyzes subtle changes in skin tone, body movements, and facial expressions to extract important health data without requiring physical contact with the driver 2.

[0026] Using at least one algorithm stored in processing unit 7, the signals recorded by sensors S1 to Sn and the image signals from the contactless monitoring system are analyzed. This analysis provides real-time insights into the health status of driver 2, in particular detailed information on heart rate, respiratory rate, blood oxygen saturation, physical activity, posture, and facial expression. Furthermore, processing unit 7 contains algorithms for interpreting the recorded data, enabling the detection of deviations from driver 2's baseline and / or expected values ​​largely in real time. For example, processing unit 7 stores relevant data, particularly personal data such as age, height, and weight, which are then compared with the currently recorded measurements.

[0027] The processed health data and analyses are displayed to the occupant via a display unit of processing unit 7 in vehicle 1. This provides an overview of the driver's current health status, highlighting key indicators and trends for comparison. Furthermore, processing unit 7 generates alerts and recommendations, issuing a warning message if abnormal measurements are detected or if potential health problems are identified based on these measurements. The driver is then prompted to take appropriate action, such as taking a break or seeking medical assistance.

[0028] The method described above enables comprehensive health monitoring without requiring any additional equipment. This method allows for continuous monitoring of the vital functions and health data of driver 2 without any impairment of driver 2, particularly with regard to driving. This enables consistent and long-term health monitoring of driver 2.

[0029] By combining contact-based and contactless technologies, the health monitoring system enables a comprehensive and differentiated assessment of the driver's health and well-being. The contact-based sensors S1 to Sn in the steering wheel 4 provide highly accurate measurements of physiological parameters, while the contactless technology, using the camera 6, captures additional information about the driver's emotional state, posture, and activity level. This holistic approach allows for a more comprehensive evaluation of the driver's overall health.

[0030] The health monitoring system is essentially fully integrated into the instrument panel 5 of vehicle 1 and enables seamless health monitoring while the vehicle 1 is in operation, thus eliminating the need to wear a fitness tracker and / or smartwatch. The health monitoring system automatically collects and analyzes health data during driving, providing valuable insights into the driver's health status without interrupting the journey. This increased convenience can promote proactive health management and the early detection of potential health problems.

Images