Method for detecting vehicle occupant disability, method for controlling vehicle, data processing apparatus, computer program, computer readable storage medium, system for detecting vehicle occupant disability, and vehicle

Abstract

The present disclosure relates to a method for detecting a disability of an occupant (18) of a vehicle (10). The method comprises obtaining first data (D1) indicative of a pressure distribution on a seat (12) of the vehicle, wherein the seat (12) is occupied by an occupant (18). The method further comprises obtaining second data (D2) indicative of a position and / or orientation of at least one body part (52, 53, 54, 55) of the occupant (18). Further, the method comprises providing third data (D3) indicative of a disability of the occupant (18) based on the first data (D1) and based on the second data (D2). Furthermore, the present disclosure relates to a method for controlling a vehicle (10). The disclosure also relates to a data processing device (32), a computer program (40) and a computer readable storage medium (38) for performing the method. Furthermore, the present disclosure relates to a system (44) for detecting a disability of an occupant (18) of a vehicle (10), and to a vehicle (10) comprising the system (44).

Description

Technical Field

[0001] This disclosure relates to a method for detecting vehicle occupant incapacity and a method for controlling a vehicle.

[0002] This disclosure also relates to corresponding data processing equipment, computer programs, and computer-readable storage media.

[0003] Furthermore, this disclosure relates to a system for detecting vehicle occupant incapacitation and a vehicle including said system. Background Technology

[0004] Incapacity of vehicle occupants may occur during vehicle use. In this case, incapacity can be understood as a medical abnormality that deviates from the normal or expected medical condition. The normal or expected medical condition may be associated, for example, with the medical condition at the start of a driving cycle or at the start of vehicle use. Therefore, if the medical condition changes during vehicle use, a medical abnormality will occur. Additionally or alternatively, incapacity can be understood as an occupant's sleep state and / or drowsiness.

[0005] If the driver of a vehicle becomes incapacitated, this could impair their ability to control the vehicle. If the incapacitated occupant (especially with a medical condition) is a passenger, the medical condition could distract the driver. From a road safety perspective, both situations are problematic. Summary of the Invention

[0006] Therefore, one object of this disclosure is to improve the detection of vehicle occupant incapacity.

[0007] According to a first aspect, a method for detecting the incapacity of a vehicle occupant is provided. The method includes: - Obtain first data indicating the pressure distribution on the seats of the vehicle, wherein the seats are occupied by the occupant. - Obtain second data indicating the position and / or orientation of at least one body part of the occupant within the interior of the vehicle. - Provide third data indicating the occupant's incapacity based on the first data and the second data.

[0008] In this document, obtaining first data includes receiving or determining first data indicating the pressure distribution on a vehicle seat. The pressure distribution is generated by the weight of an occupant occupying the seat. The first data may include the pressure distribution on the seating surface of the seat. Additionally or alternatively, the first data may cover the pressure distribution on the seat back. Further additionally or alternatively, the first data may include the pressure distribution on the seat headrest. The first data may be provided and / or received from any sensor configured to indicate the pressure distribution on or a portion of a seat in the vehicle. Thus, first data can be provided and / or received from a pressure sensor. According to one example, such a sensor may form part of a pressure-sensing pad that may be arranged in a portion of the seat, such as in the seating surface, backrest, or headrest. According to another example, the first data may also be received from another data processing device, such as a server. The server may be a cloud server. Obtaining second data includes receiving or determining second data indicating the position and / or orientation of at least one body part of an occupant within the interior of the vehicle. In one example, the second data includes image data, radar data, and / or lidar (also known as a light detection and ranging system) data. Therefore, in such an example, second data can be provided and / or received from an optical camera, radar unit, and / or lidar unit. According to another example, second data can also be received from another data processing device, such as a server. The server could be a cloud server. The pressure distribution on the vehicle's seats and the position and / or orientation of at least one body part of the occupant indicate the occupant's posture, more precisely, different aspects of the posture. It should be emphasized that the term occupant can include both the vehicle's driver and the vehicle's passengers. Third data indicative of occupant disability is provided based on the first data and based on the second data. This means that both types of data contribute to the determination and provision of the third data. Due to the complementary nature of the first and second data, the third data can be provided in an accurate and reliable manner. The first data may specifically indicate even small muscle tensions in the occupant's lower limbs, which may not be clearly indicated by the overall position and / or orientation of the occupant's body parts. The second data may specifically indicate the position and / or orientation of the occupant's upper limbs, which may not be discernible from the pressure distribution on the seats. In other words, because both the first and second data are taken into account, it is possible to distinguish between the combination of pressure distribution on the seat caused by the occupant's normal movement and the position and / or orientation of at least one body part, and the combination of pressure distribution on the seat caused by disability (e.g., medical abnormality, change in medical condition, or change in consciousness) and the position and / or orientation of at least one body part.

[0009] According to one example, providing third data indicating occupant disability based on first data and second data includes comparing the first data with predefined and / or stored first data. Additionally or alternatively, the second data may be compared with predefined and / or stored second data. The predefined and / or stored first data and the predefined and / or stored second data may relate to known disabilities, such as known medical abnormalities, known drowsiness of the occupant, and / or known sleep states of the occupant. In other words, the predefined and / or stored first data and the predefined and / or stored second data are generated already in the case that the occupant has a known medical abnormality, a known drowsiness state, or is asleep. Therefore, by comparing the first data with the predefined and / or stored first data, it can be determined whether the first data resembles the predefined and / or stored first data associated with a known medical abnormality (a known drowsy state where the occupant is sleeping). Similarly, by comparing the second data with the predefined and / or stored second data, it can be determined whether the second data resembles the predefined and / or stored second data associated with a known medical abnormality, a known drowsiness state, or when the occupant is sleeping. When the first data is compared with predefined and / or stored first data, and the second data is compared with predefined and / or stored second data, occupant medical abnormalities, drowsiness, or sleep can be reliably detected. In other words, third data indicating occupant incapacity can be reliably provided.

[0010] In one example, the pressure distribution on a vehicle seat can be determined by one or more pressure sensors and / or by at least one pressure-sensing pad. The one or more pressure sensors and / or pressure-sensing pads can be attached to the surface of the seat, or integrated into the seat cushion and / or backrest cushion and / or headrest cushion. The sensors are capable of providing initial data reliably. Attaching the sensors to the surface of the seat is a simple way to provide sensors to the seat with minimal additional manufacturing work. Integrating the sensors into the seat cushion and / or backrest cushion and / or headrest cushion is a sophisticated technique that can provide a visually invariant seat for the occupant compared to a seat without any sensors.

[0011] In one example, the first data indicates the temporal evolution of the pressure distribution on the vehicle seat. Temporal evolution should be understood as the change in pressure distribution on the vehicle seat over time. This has the effect of capturing occupant movement through the first data. In particular, even small movements of the occupant's lower limbs can be identified in the first data. In this paper, occupant movement and / or lower limb movement is understood as the change in position and / or orientation of the occupant and / or lower limbs from one point in time to another. The first data indicating the temporal evolution of pressure distribution has the effect of further increasing the accuracy and reliability of the third data indicating occupant disability.

[0012] In one example, the at least one body part includes at least one of the occupant's torso, arms, legs, and head. This allows for the identification of signs of general muscle relaxation, such as during unconsciousness due to a heart attack, stroke, or sleep / drowsiness, or signs of muscle spasms, such as during a seizure. For example, a healthy and attentive occupant (i.e., an occupant without an acute medical condition and who is conscious) is expected to keep his or her head and torso upright. The arms are expected to remain near the torso and / or the steering wheel, at least for most of the time. The thighs, which are part of the occupant's legs, are expected to be in contact with the seat cushion, at least for most of the time. Only occasionally, such as when the vehicle's pedals are actuated, may the thighs be slightly lifted from the seat cushion. A torso tilted to the side or a head tilted to the side, or a head and torso tilted to the side, may be a sign that the occupant has lost the ability to maintain muscle health. Other signs of lost muscle health may include a head tilted downwards, causing the occupant to stare at the ground of the vehicle, a torso and head tilted backwards, causing the occupant to stare at the vehicle's roof liner, or closed eyelids. When unconscious, an occupant may even slam his or her head or torso onto the steering wheel. During a muscle spasm, the occupant's torso may bend, the head may turn upwards, and / or the occupant's arms may move asymmetrically away from the torso. Furthermore, the occupant's legs may become abnormally stretched during a muscle spasm, which is not expected behavior while driving, as the pedals will no longer be able to be properly actuated.

[0013] In one example, the second data includes image data, radar data, and / or lidar data. Image data may be acquired by at least one optical camera arranged inside the vehicle to observe the vehicle occupants. Radar or lidar data may be acquired by a radar unit or lidar unit facing the vehicle occupants. It is important to emphasize that the second data may also include any combination of image data, radar data, and lidar data. Image data, radar data, or lidar data are particularly suitable for indicating the position and / or orientation of the occupants' upper limbs relative to each other. In other words, image data, radar data, or lidar data are particularly suitable for indicating the posture of the vehicle occupants. Providing second data suitable for indicating the posture of the vehicle occupants allows for the reliable generation of third data indicating occupant disability based on the second data.

[0014] In one example, the second data also indicates the occupant's movement inside the vehicle. This movement can be described by multiple positions ordered chronologically. Positions and therefore movement can be represented in three dimensions. The occupant's three-dimensional position and / or three-dimensional movement can be obtained by at least two optical cameras working together as stereo cameras. The occupant's three-dimensional position and / or three-dimensional movement can also be obtained by radar and / or lidar units, both of which provide depth information of the detected object inherent in the generated data type. The occupant's three-dimensional position and / or three-dimensional movement inside the vehicle helps improve and enhance the accuracy of the provided third data indicating occupant disability. For example, the driver's torso may be tilted to one side, which could indicate muscle health loss due to unconsciousness. However, three-dimensional position and / or three-dimensional movement data could indicate that the driver is reaching for something from the rear seat of the vehicle. It is highly unlikely that an unconscious driver is in a position reaching for the rear seat. Conversely, it is highly likely that a conscious and healthy driver without any acute medical condition is attempting to reach the rear seat. Thus, the accuracy of the third data indicating disability is improved. The accuracy of third-party data can be further improved when considering the three-dimensional motion of the occupants.

[0015] In one example, the second data also indicates the velocity and / or acceleration of the occupant's movement. Velocity of movement is understood as the degree of change in position and / or orientation of at least one body part of the occupant per unit of time. Acceleration of movement is understood as the degree of change in velocity of movement per unit of time. In the example of an occupant reaching for something from the back seat of a vehicle, rapid and targeted three-dimensional movement could indicate that the driver intends to quickly grab the desired object so as to refocus on the traffic event only after a brief period of inattention. In contrast, if the driver's torso simply tilts slowly to the side, this could indicate a loss of muscle health due to unconsciousness, thus leading to disability.

[0016] In one example, the second data also indicates the magnitude of the occupant's movement. The magnitude of movement is understood as the absolute degree of change in the position and / or orientation of at least one part of the occupant's body. For example, a slight tilt of the occupant's torso to the side, such as 3°, may not be considered an indication of occupant disability. However, a strong tilt of the occupant's torso to the side, such as 10°, can indeed be considered an indication of occupant disability.

[0017] According to one example, providing third data indicating occupant disability is based on first data, second data, and a data model. The data model can be, for example, a trained data model using artificial intelligence. In this document, the data model may have been trained using training data indicating the pressure distribution on the vehicle seat, the position and / or orientation of at least one body part of the occupant, and the presence or absence of occupant disability. Therefore, during training, the data model learns which combinations of pressure distribution on the vehicle seat and the position and / or orientation of at least one body part of the occupant are associated with occupant disability, and which combinations are not associated with occupant disability. Thus, when used in the method of the first aspect, the data model can accurately and reliably provide third data indicating occupant disability based on the first data and the second data.

[0018] According to a second aspect, a method for controlling a vehicle is provided. The method includes: - Detecting the incapacity of the vehicle's occupants using the method according to the first aspect, and - The vehicle's safety measures are triggered based on the third data.

[0019] Therefore, if third-party data indicates occupant incapacity, such as if the occupant has a medical condition or is asleep / drowsy, safety measures are triggered. If no incapacity is detected, this approach is abandoned, i.e., safety measures are not triggered. Despite occupant incapacity, safety measures help maintain a high level of road safety. It is important to emphasize that occupants include both the vehicle's driver and passengers. Of course, road safety also involves other vehicles, or more generally, other road users. Specifically, safety measures aim to prevent accidents.

[0020] In examples where the vehicle's driver may be unconscious, asleep, or suffering from muscle spasms due to a medical condition (e.g., heart attack, stroke, and / or epileptic seizure), the risk of collision with other vehicles, nearby people, or infrastructure components may increase due to the driver's inability to control the vehicle. Using safety measures can significantly reduce this collision risk. In another example where a vehicle's passenger suffers a medical abnormality, the vehicle's driver may be distracted by the traffic event, and therefore, the likelihood of the vehicle being involved in a traffic accident may increase. Again, this likelihood can be reduced through safety measures.

[0021] In one example, safety measures include at least one of the following: triggering an optical warning, triggering an acoustic warning, triggering a tactile warning, activating the vehicle's hazard lights, triggering an emergency call, requesting the vehicle to slow down, requesting the vehicle to stop, requesting the vehicle to pull over to the side of the road on which the vehicle is traveling, and requesting the vehicle to be driven to a medical facility. Optical, acoustic, and / or tactile warnings can help awaken the driver of the vehicle from sleep and / or drowsiness so that he or she can regain full attention to the traffic event. If any occupant of the vehicle suffers from a medical malfunction, the optical, acoustic, and / or tactile warnings can draw the attention of the driver or other passengers to the occupant suffering from the medical malfunction. Therefore, the driver or other passengers can quickly seek medical assistance for the occupant with the medical malfunction. Activating the vehicle's hazard lights can inform other road users of the potential danger the vehicle may pose to them and / or the fact that the vehicle has a problem. In the event of occupant incapacity, the vehicle may unexpectedly and suddenly turn or stop. Other road users, especially while driving, can maintain a distance from the vehicle if warned by the hazard lights, thereby reducing the likelihood of an accident caused by the incapacity of the vehicle's occupants. Triggering an emergency call can be particularly helpful if the disabled occupant suffers a medical malfunction and is the only occupant in the vehicle. Due to his or her medical malfunction, the driver may be unable to call for medical assistance themselves. This is accomplished through a second approach, which reduces the time it takes for medical personnel to arrive at the scene of the occupant's medical malfunction. This can prevent or at least reduce the medical consequences of the medical malfunction. In the event of a disabled driver, requests can be made to slow down the vehicle, stop the vehicle, pull over to the side of the road the vehicle is traveling on, and / or request all possible response measures. These response measures can be taken, especially if the driver cannot be awakened by optical, acoustic, and / or tactile warnings. Requesting to be driven to a medical facility is a specific response measure that can be introduced if the driver suffers a medical malfunction. Control of the vehicle's movement, particularly its lateral and longitudinal movements, transforms the vehicle into a state where the likelihood of an accident involving the vehicle and other vehicles, nearby people, or infrastructure components is significantly reduced. Therefore, road safety is enhanced even in the event of a driver suffering a medical malfunction such as a heart attack, stroke, and / or seizure.

[0022] The methods of the first and / or second aspects can be implemented at least in part by a computer, and can be implemented in software or hardware, or both. Furthermore, the method can be executed by computer program instructions running on a device providing data processing capabilities. The data processing device can be a suitable computing device, such as an electronic control module, or it can be a distributed computer system. The data processing device or computer can each include one or more of a processor, memory, data interface, etc.

[0023] According to a third aspect, a data processing device is provided, comprising means for performing the method according to the first aspect and / or the method according to the second aspect. Using such a data processing device, incapacity of a vehicle occupant can be detected and / or the vehicle can be reliably controlled. Specifically, the third data indicating occupant incapacity is accurate and can be relied upon when the data processing device needs to determine whether to trigger safety measures. This is due to the complementary nature of the first and second data. The first data can specifically indicate even small muscle tension in the occupant's lower limbs, which may not clearly express itself in the overall position and / or orientation of the occupant's body parts. The second data can specifically indicate the position and / or orientation of the occupant's upper limbs, which may not be discernible from the pressure distribution on the seat. In other words, due to the fact that both the first and second data are taken into account, it is possible to distinguish between the combination of pressure distribution on the seat caused by the occupant's normal movement and the position and / or orientation of at least one body part, and the combination of pressure distribution on the seat caused by incapacity (e.g., medical abnormality, change in medical condition, or change in consciousness) and the position and / or orientation of at least one body part.

[0024] According to a fourth aspect, a computer program is provided, comprising instructions that, when executed by a computer, cause the computer to perform the method according to the first aspect and / or the method according to the second aspect. Using such a computer program, incapacity of a vehicle occupant can be detected and / or the vehicle can be reliably controlled. In particular, third data indicating occupant incapacity is particularly accurate and can be relied upon when the computer program needs to determine whether to trigger safety measures. This is due to the complementary nature of the first and second data. The first data can specifically indicate even small muscle tension in the occupant's lower limbs, which may not clearly express itself in the overall position and / or orientation of the occupant's body parts. The second data can specifically indicate the position and / or orientation of the occupant's upper limbs, which may not be discernible from the pressure distribution on the seat. In other words, due to the fact that both the first and second data are taken into account, it is possible to distinguish between the combination of pressure distribution on the seat caused by the occupant's normal movement and the position and / or orientation of at least one body part, and the combination of pressure distribution on the seat caused by incapacity (e.g., medical abnormality, change in medical condition, or change in consciousness) and the position and / or orientation of at least one body part.

[0025] According to a fifth aspect, a computer-readable storage medium is provided, comprising instructions that, when executed by a computer, cause the computer to perform the method according to the first aspect and / or the method according to the second aspect. Using such a computer-readable storage medium, incapacity of a vehicle occupant can be detected and / or the vehicle can be controlled reliably. In particular, third data indicating occupant incapacity is particularly accurate and can be relied upon when a computer program on the computer-readable storage medium needs to determine whether to trigger safety measures. This is due to the complementary nature of the first and second data. The first data can specifically indicate even small muscle tension in the occupant's lower limbs, which may not clearly express itself in the overall position and / or orientation of the occupant's body parts. The second data can specifically indicate the position and / or orientation of the occupant's upper limbs, which may not be discernible from the pressure distribution on the seat. In other words, due to the fact that both the first and second data are taken into account, it is possible to distinguish between a combination of pressure distribution on the seat caused by the occupant's normal movement and the position and / or orientation of at least one body part, and a combination of pressure distribution on the seat caused by incapacity (e.g., medical abnormality, change in medical condition, or change in consciousness) and the position and / or orientation of at least one body part.

[0026] According to a sixth aspect, a system for detecting vehicle occupant incapacitation is provided. The system includes: - A first sensing element, which generates first data indicating the pressure distribution on the seat of the vehicle. - A second sensing element for generating at least a portion of second data indicating the position and / or orientation of at least one body part of the occupant within the interior of the vehicle, and - According to the data processing equipment of the third party.

[0027] The first sensing element and the second sensing element are communicatively connected to the data processing device. The data processing device includes a communication interface for providing third data indicating occupant incapacitation based on the first data and the second data.

[0028] The pressure distribution is generated by the weight of the occupant occupying the seat. First data may include the pressure distribution on the seat's seating surface. Additionally or alternatively, the first data may cover the pressure distribution on the seat back. Further additionally or alternatively, the first data may include the pressure distribution on the seat's headrest. Second data indicates the position and / or orientation of at least one body part of the occupant within the vehicle's interior. The pressure distribution on the vehicle's seats and the position and / or orientation of at least one body part of the occupant indicate the occupant's posture, more precisely, different aspects of posture. It should be emphasized that the term occupant can include both the vehicle's driver and the vehicle's passengers. Third data indicative of occupant disability is provided based on the first data and based on the second data. This means that both types of data contribute to the determination and provision of the third data. Due to the complementary nature of the first and second data, the third data can be provided in an accurate and reliable manner. First data may specifically indicate even small muscle tensions in the occupant's lower limbs, which may not be clearly expressed in the overall position and / or orientation of the occupant's body parts. Second data may specifically indicate the position and / or orientation of the occupant's upper limbs, which may not be discernible from the pressure distribution on the seat. In other words, since both the first and second data are taken into account, it is possible to distinguish between the combination of pressure distribution on the seat caused by the occupant's normal movement and the position and / or orientation of at least one body part, and the combination of pressure distribution on the seat caused by disability (e.g., medical abnormality, change in medical condition, or change in consciousness) and the position and / or orientation of at least one body part.

[0029] In one example, the first sensing element includes a pressure sensor and / or pressure-sensing pad that can be disposed in or on a vehicle seat. The pressure distribution on the vehicle seat can also be determined by multiple pressure sensors. One or more pressure sensors and / or pressure-sensing pads can be attached to the surface of the seat or integrated into the seat cushion and / or backrest and / or headrest cushion. The sensors are capable of providing first data reliably. Attaching the sensors to the surface of the seat is a simple way to provide sensors to the seat with minimal additional manufacturing work. Integrating the sensors into the seat cushion and / or backrest and / or headrest cushion is a sophisticated technique that can provide a visually invariant seat for the occupant compared to a seat without any sensors.

[0030] In one example, the system further includes a third sensing element for generating at least a portion of second data indicating the position and / or orientation of at least one body part of an occupant within the vehicle interior. Therefore, the system includes at least two sensing elements for generating at least a portion of the second data. Compared to a single sensing element for generating the second data, at least two sensing elements for generating at least a portion of the second data have the effect of providing more comprehensive second data. Therefore, the accuracy of the third data, based on the first data and provided based on the second data, can be improved. The at least two sensing elements, namely the second and third sensing elements, can be of the same type or can be of different types. If at least two sensing elements of the same type sense the position and / or orientation of at least one body part of an occupant from different perspectives, they can particularly provide more comprehensive second data than a single sensing element. Of course, if at least two sensing elements of different types sense the position and / or orientation of at least one body part of an occupant from different perspectives, they can also provide more comprehensive second data than a single sensing element. Furthermore, if at least two sensing elements of different types sense the position and / or orientation of at least one body part of an occupant from the same perspective due to the different characteristics of their sensing principles and the different kinds of data provided by the different types of sensing elements, they can still provide more comprehensive second data than a single sensing element.

[0031] In one example, the second and / or third sensing elements include an optical camera, a radar unit, and / or a lidar unit configured to capture at least one of the occupant's torso, arms, legs, and head. An optical camera positioned inside the vehicle to observe the vehicle occupant can acquire image data of the occupant's posture. A radar unit or lidar unit oriented towards the occupant can provide radar data or lidar data of the occupant's posture, respectively. The image data, radar data, and / or lidar data are particularly suitable for indicating the position and / or orientation of the vehicle occupant's upper limbs relative to each other. In other words, the image data, radar data, or lidar data are particularly suitable for indicating the posture of the vehicle occupant. Providing second data suitable for indicating the posture of the vehicle occupant allows for the reliable generation of third data indicating occupant incapacity based on the second data. The reliability of the third data is further enhanced by the combination of the first and second data, thereby by the combination of pressure distribution on the seat, image data, radar data, and / or lidar data.

[0032] In one example, an optical camera acting as a second sensing element and another optical camera acting as a third sensing element can provide at least a portion of the second data. The two cameras can work together as stereo cameras. Therefore, the two cameras can provide a three-dimensional representation of the occupant's posture.

[0033] In one example, at least two sensing elements for generating at least a portion of second data indicating the position and / or orientation of at least one body part of an occupant inside the vehicle may include at least two sensing elements for each occupant of the vehicle. In an example with five seats in the vehicle, the system may include five times the number of at least two sensing elements for generating at least a portion of the second data. In one example, the system may include at least one optical camera for each occupant. In another example, the system may include two cameras and two radar sensors for each occupant. In yet another example, the system may include three to seven sensors for generating at least a portion of the second data for each occupant.

[0034] According to a seventh aspect, a vehicle is provided that includes a system according to a sixth aspect for detecting incapacity of vehicle occupants. Such a vehicle allows for the detection of incapacity of vehicle occupants. Furthermore, such a vehicle can be controlled in a manner that executes safety measures upon detection of incapacity of vehicle occupants.

[0035] It should be noted that the above examples can be combined with each other, regardless of the aspects involved.

[0036] These and other aspects of this disclosure will become apparent from the examples described below and will be illustrated with reference to the examples described below. Attached Figure Description

[0037] Examples of this disclosure will now be described with reference to the following figures.

[0038] Figure 1 A vehicle according to the present disclosure is shown, the vehicle including data processing according to the present disclosure, the data processing being used to perform a method according to the present disclosure for detecting incapacity of a vehicle occupant and a method according to the present disclosure for controlling the vehicle. Figure 2 The partially transparent view shows the product including the integrated pressure-sensing pad. Figure 1 The seat cushions of the vehicle's seats, Figure 3 It shows the result of Figure 2 Pressure sensing pads provided by Figure 1 An example of the pressure distribution generated by the occupants of a vehicle. Figure 4 It shows the result of Figure 1 Another example of the pressure distribution generated by the occupants of a vehicle, which is integrated into Figure 1 Pressure-sensing pads are provided inside the surface of the seat back of the vehicle or attached to that surface. Figure 5 It schematically shows that it has fallen to Figure 1 On the steering wheel of the vehicle Figure 1 The occupants of the vehicle. Figure 6 It schematically shows someone gazing downwards. Figure 1 The occupants of the vehicle. Figure 7 schematically shown Figure 1 The occupants of the vehicle leaned back and looked upwards. Figure 8 schematically shown Figure 1 The heads of the vehicle's occupants are tilted. Figure 9 schematically shown Figure 1 The torsos of the vehicle's occupants were tilted. Figure 10 schematically shown Figure 1 The occupants of the vehicle tilted their heads and torsos to the side. Figure 11 schematically shown Figure 1 The occupant of the vehicle bent his or her torso and turned his or her head upward. Figure 12 schematically shown Figure 1 The occupant of the vehicle arches his or her body, causing the bottom of the occupant to rise from the seat, and Figure 13 The steps of a method for detecting vehicle occupant incapacity according to the present disclosure and the steps of a method for controlling a vehicle according to the present disclosure are shown. Detailed Implementation

[0039] The accompanying drawings are merely schematic representations and are intended to illustrate this disclosure only. In principle, identical or equivalent elements have the same reference numerals.

[0040] Figure 1 Vehicle 10 is shown.

[0041] Vehicle 10 includes seat 12.

[0042] The seat 12 includes a pressure sensing pad 14, which is also designated as a first sensing element 16.

[0043] Occupant 18 of the vehicle is seated in seat 12. In this example, occupant 18 is the driver 20 of vehicle 10. Therefore, Figure 1 The seat 12 shown is the driver's seat 12 of the vehicle 10.

[0044] Due to his or her weight, the occupant 18 of vehicle 10 applies pressure to the pressure sensing pad 14 of seat 12.

[0045] The vehicle 10 also includes a camera 22, which is also designated as a second sensing element 24, and a radar unit 26, which is also designated as a third sensing element 28.

[0046] Camera 22 and radar unit 26 form part of a driver monitoring system. Therefore, camera 22 and radar unit 26 observe the occupant 18 of vehicle 10. More precisely, camera 22 and radar unit 26 observe the position and / or orientation of at least one body part of the occupant 18 of vehicle 10.

[0047] Note that the position and / or orientation of at least one body part of the occupant 18 of vehicle 10 can also be observed by the lidar (Light Detection and Ranging) unit. However, this is in Figure 1 Not shown in the image.

[0048] In addition, vehicle 10 includes a steering wheel 30. In this example, the steering wheel 30 is capable of vibration.

[0049] In addition, vehicle 10 includes data processing equipment 32.

[0050] The pressure sensing pad 14, camera 22, radar unit 26 and steering wheel 30 are communicatively connected to the data processing device 32.

[0051] The data processing device 32 includes a data storage unit 34 and a data processing unit 36.

[0052] The data storage unit 34 includes a computer-readable storage medium 38.

[0053] A computer program 40 is provided on a computer-readable storage medium 38.

[0054] The computer program 40, and therefore also the computer-readable storage medium 38, includes instructions that, when executed by the data processing unit 36 ​​or more generally the computer, cause the computer or data processing unit 36 ​​to perform a method for detecting vehicle occupant incapacitation. This method may be referred to as the first method.

[0055] The computer program 40, and therefore the computer-readable storage medium 38, also includes instructions that, when executed by the data processing unit 36 ​​or more generally the computer, cause the computer or data processing unit 36 ​​to perform a method for controlling the vehicle 10. This method may be referred to as a second method.

[0056] Therefore, the data storage unit 34 and the data processing unit 36 ​​form an apparatus 42 for performing the first method and the second method.

[0057] The pressure sensing pad 14, camera 22, radar unit 26 and data processing device 32 form a system 44 for detecting the incapacity of the occupant 18 of the vehicle 10.

[0058] exist Figure 13 The steps of the second method are illustrated in the figure.

[0059] The second method, which is used to control the vehicle, consists of two steps.

[0060] In step S1 of the second method, the incapacity of the occupant 18 of the vehicle 10 is detected.

[0061] This is achieved by performing a first method, which is a method for detecting vehicle occupant incapacitation, including... Figure 13 The three steps are illustrated in the diagram.

[0062] The first step S11 of the first method includes obtaining first data D1 indicating the pressure distribution on the seat 12 of the vehicle 10.

[0063] This is achieved through a pressure-sensing pad 14 integrated into the seat 12 of the vehicle 10. Figure 2 The diagram shows a pressure sensing pad 14 integrated into the seat 12 of the vehicle 10.

[0064] When occupant 18 is seated in seat 12, such as Figure 3 and Figure 4 The pressure distribution shown can be provided by the pressure sensing pad 14.

[0065] Figure 3 The pressure distribution shown is obtained from the pressure sensing pad 14 in the seat cushion 46 of the seat 12 attached to the vehicle 10. It shows a similar pressure distribution in its left and right halves.

[0066] Figure 4 The pressure distribution shown is obtained from the pressure sensing pad 14 in the backrest 48 of the seat 12 attached to the vehicle 10. Figure 4 The pressure distribution shows that more pressure is applied to the left half of the backrest 48 of the seat 12 compared to the right half.

[0067] Additionally or alternatively, the pressure sensing pad 14 may also be incorporated into the headrest 50 of the seat 12 of the vehicle 10 in which the occupant 18 sits. This pressure sensing pad 14 indicates the pressure exerted by the head 52 of the occupant 18 on the headrest 50.

[0068] The sensed pressure distribution and its time evolution are received by data processing device 32.

[0069] This allows the data processing device 32 to detect even small changes in the occupant 18's sitting posture, muscle tension, and small movements of the occupant 18's lower limbs.

[0070] In the second step S12 of the second method, second data D2 is obtained indicating the position and / or orientation of at least one body part of the occupant 18 within the interior of the vehicle 10.

[0071] This is achieved using camera 22 and radar unit 26.

[0072] Camera 22 detects the orientation and position of at least one of the occupant's torso 54, arms 55, legs 53, and head 52. Therefore, camera 22 detects the orientation and position of the occupant's limbs (especially the upper limbs).

[0073] Radar unit 26 detects the three-dimensional position and three-dimensional movement of occupant 18 inside vehicle 10.

[0074] exist Figures 5 to 11 An example of the posture of occupant 18 that can be detected by camera 22 and radar unit 26 is shown.

[0075] exist Figure 5 In the middle, the driver 20 of vehicle 10 tilts his torso 54 forward and his head 52 has fallen onto the steering wheel 30.

[0076] Based on the second data D2 provided by the camera 22, it can be detected that the driver 20's head 52 is in contact with the steering wheel 30.

[0077] In this case, the pressure sensing pad 14 integrated into the backrest 48 of the driver's seat 12 can sense the decompression in the upper area of ​​the backrest 48.

[0078] Therefore, the driver 20 of vehicle 10 may suffer a sudden loss of muscle health, such as due to a heart attack, stroke, or because the driver 20 has fallen asleep. Based on the first data D1 and the second data D2, the computer program 40 on the data processing device 32 can identify, for example... Figure 5 Based on the posture shown, it is inferred that the driver 20 is incapacitated.

[0079] exist Figure 6 In this position, the torso 54 of the driver 20 of vehicle 10 remains upright. However, his or her head 52 is tilted forward, so that the driver 20's face is oriented towards the floor 56 of vehicle 10. In addition, the driver 20's eyes (i.e., eyelids) are closed. This can be a continuous or sustained posture.

[0080] Based on the second data D2 provided by the camera 22, it can be detected that the driver 20's head 52 is facing downwards and the driver 20's eyes are closed.

[0081] An additional pressure sensing pad 14 incorporated into the headrest 50 of the driver's seat 12 can detect the pressure loss exerted on the headrest 50 by the driver's head 52 of the driver 20.

[0082] Driver 20 may suffer a sudden loss of muscle health due to unconsciousness, possibly stemming from a medical malpractice. Similarly, based on first data D1 and second data D2, the computer program 40 on the data processing device 32 can identify, for example... Figure 6 Based on the posture shown, it is inferred that the driver 20 is incapacitated.

[0083] Note the explanation above. Figure 5 and Figure 6 The posture of someone who falls ill may not only be due to unconsciousness and the resulting loss of muscle health. A similar posture, the second data point, would also be caused by abdominal pain, abdominal cramps, or vomiting. However, the first data point D1, specifically obtained from the pressure sensing pad 14 in the seat cushion 46, will indicate muscle contraction from localized pressure spikes, rather than a more uniform pressure distribution in the case of muscle relaxation.

[0084] exist Figure 7 In the middle, the driver 20's torso 54 is leaning backward. In addition, the driver appears to be staring at the roof lining 58 of the vehicle 10.

[0085] Based on the second data D2 provided by the camera 22, the orientation of the driver 20's head 52 can be detected, especially the orientation of the face toward the roof liner 58 of the vehicle 10.

[0086] Additionally, the pressure sensing pad 14 integrated into the backrest 48 and / or headrest 50 of the driver's seat 12 can detect the increased pressure exerted on the backrest 48 and / or headrest 50 of the driver's seat 12 by an unconscious driver compared to the pressure exerted on the backrest 48 and / or headrest 50 of the driver's seat 12 by a conscious driver 20 in a posture of paying attention to a traffic event.

[0087] Therefore, in the same situation, driver 20 may have lost consciousness due to a medical malpractice or may have fallen asleep. Based on the first data D1 and the second data D2, the computer program 40 on the data processing device 32 can identify, for example... Figure 7 Based on the posture shown, it is inferred that the driver 20 is incapacitated.

[0088] Note that the most common posture for disabled occupant 18 can be as described above. Figures 5 to 7 The posture shown.

[0089] Figure 8 The image shows the head 52 of the occupant 18 of vehicle 10 tilted relative to the upright torso 54 of the occupant 18 of vehicle 10. This can be a continuous or sustained posture.

[0090] Based on the second data D2 provided by the camera 22, the head 52 tilted relative to the torso 54 of the occupant 18 can be detected.

[0091] Additionally, when from such Figure 8 When viewed from the perspective shown, the pressure sensing pad 14 in the seat cushion 46 of the seat 12 integrated into the occupant 18 detects increased pressure on the right half of the seat cushion 46.

[0092] Therefore, occupant 18 is asleep and unaware of the traffic incident. Based on the first data D1 and the second data D2, the computer program 40 on the data processing device 32 can identify, for example... Figure 8 The posture shown suggests that crew member 18 is incapacitated.

[0093] exist Figure 9 In the vehicle 10, the torso 54 of occupant 18 is tilted to the right. However, occupant 18's head 52 remains upright. This can be a continuous or sustained posture. This could indicate that occupant 18 has just become unconscious due to a medical malfunction or because occupant 18 is fatigued and about to fall asleep. However, it could also indicate that occupant 18 is simply trying to reach something from the back seat of vehicle 10 while keeping his eyes on the road.

[0094] Based on the second data D2 provided by camera 22, the tilted torso 54 of occupant 18 can be detected.

[0095] Additionally, when along as Figure 9 When viewed in the indicated direction, the pressure sensing pad 14 integrated into the backrest 48 of the occupant seat 12 detects the temporal evolution from a symmetrical pressure distribution to an asymmetrical pressure distribution, wherein the pressure detected on the right half of the backrest 48 of the occupant seat 12 is greater than the pressure detected on the left half of the backrest 48 of the occupant seat 12.

[0096] Furthermore, based on the second data D2 provided by radar unit 26, the three-dimensional position and three-dimensional movement of the torso 54 of the occupant 18 of vehicle 10 can be detected. According to the three-dimensional data, it is obvious that the torso 54 of occupant 18 does not lean backward as would be in the case of an occupant attempting to touch something on the rear seat of vehicle 10.

[0097] Conversely, based on the second data D2 provided by radar unit 26, it can be detected that the torso 54 of occupant 18 has moved from a straight orientation to a tilted orientation in motion parallel to the plane of the backrest 48 of occupant seat 12.

[0098] This indicates that occupant 18 was actually on the verge of unconsciousness due to a medical abnormality, or on the verge of falling asleep due to fatigue.

[0099] Therefore, based on the first data D1 and the second data D2, the computer program 40 on the data processing device 32 can identify, for example... Figure 9 The posture shown suggests that the driver 20 has lost his ability to work.

[0100] exist Figure 10 In the middle, the head 52 and torso 54 of the occupant 18 are both tilted to the right. This can be a continuous or sustained posture.

[0101] Based on the second data D2 provided by camera 22, the tilted head 52 and tilted torso 54 of occupant 18 can be detected.

[0102] Additionally, when in such Figure 10 When viewed in the indicated direction, the pressure sensing pad 14 integrated into the backrest 48 of the occupant's seat 12 and the pressure sensing pad 14 integrated into the headrest 50 of the occupant's seat 12 can detect an asymmetrical pressure distribution in the right half than in the left half.

[0103] Therefore, it can be concluded that occupant 18 has completely lost consciousness or has fallen asleep due to a medical malpractice. Based on the first data D1 and the second data D2, the computer program 40 on the data processing device 32 can identify, for example... Figure 10 The posture shown suggests that crew member 18 is incapacitated.

[0104] exist Figure 11 In the middle, the driver 20's torso 54 is bent, and his or her head 52 and face are turned toward the roof liner 58 of the vehicle 10.

[0105] Based on the second data D2 provided by camera 22, it can be detected that the driver 20's head 52 is tilted backward.

[0106] Additionally, the pressure sensing pad 14 integrated into the backrest 48 of the driver's seat detects a decrease in pressure in the upper region of the backrest 48.

[0107] Therefore, it can be concluded that the driver 20's posture is due to sudden muscle spasm, such as due to an epileptic seizure. In other words, it can be concluded that occupant 18 is experiencing a medical abnormality. Based on the first data D1 and the second data D2, the computer program 40 on the data processing device 32 can identify, for example, Figure 10 The posture shown suggests that crew member 18 is incapacitated.

[0108] exist Figure 12In this configuration, the driver 20's bottom 60 is raised from the seat 12. Therefore, the driver 20 contacts the seat 12 at a first point of contact with his or her legs 53 in the front of the seat cushion 46, and at a second point of contact with the seat 12 with his or her upper torso 54 in the upper part of the backrest 48. Additionally, the driver 20's head 52 is thrown back and contacts the headrest 50 at a third point of contact. In other words, the driver 20's body can be described as rigid and arched, as the body forms an arch between the first and second points of contact.

[0109] First data D1 provided by the pressure sensing pad 14 integrated into the seat cushion 46, backrest 48 and headrest 50 indicates strong local pressure concentration in the front of the seat cushion 46, the upper part of the backrest 48 and the headrest 50.

[0110] The second data D2 provided by camera 22 and / or radar unit 26 reflects the arched posture of driver 20. In addition, the second data D2 can indicate repetitive movements of driver 20's arms 55, legs 53 and / or torso.

[0111] Repetitive movements may specifically include rapid shaking movements of the arm 55 or the leg 53. Both arms 55 and / or both legs 53 may be subjected to rapid shaking movements. Additionally or alternatively, at least one arm 55 on one side (left or right) of the torso 54 and at least one leg 53 on the corresponding other side (right or left) of the torso may be subjected to rapid shaking movements.

[0112] Repetitive movements may also include a series of involuntary muscle contractions, followed by slow, repetitive movements of the arm 55, leg 53, head 52, and / or trunk 54. These may be followed by rhythmic movements of the limbs. In summary, such a series of movements can be perceived as abnormal movement.

[0113] Furthermore, the second data D2 can indicate the stiffness of the driver 20's body during the time interval between repetitive movements. The second data D2 can also indicate a straight arm 55, a straight leg 53 and pointed toes, a clenched fist, or a bent arm 55 to hold the hands on the driver 20's chest.

[0114] Therefore, it can be concluded that the driver 20's posture and abnormal movements are due to a medical abnormality caused by a medical episode (more specifically, an epileptic seizure). Based on the first data D1 and the second data D2, the computer program 40 on the data processing device 32 can identify, for example... Figure 12 Based on the posture shown, it is inferred that the driver 20 is incapacitated.

[0115] In the third step S13 of the second method, a conclusion regarding the medical condition or sleep / drowsiness state of the occupant 18 of the vehicle 10 is provided as third data D3 indicating occupant incapacity. Since the conclusion regarding occupant incapacity is based on the first data D1 and the second data D2, the third data D3 is also based on the first data D1 and the second data D2.

[0116] It is advantageous to consider both the first data D1 and the second data D2 to provide accurate and relatively early detection of medical abnormalities in occupant 18. This is especially true compared to using only the first data D1 or only the second data D2.

[0117] The high accuracy of the disability detection ensures that the response to the detection results is appropriate to the actual disability status of the occupant 18 of vehicle 10.

[0118] The response to the detection result is provided in the second step S2 of the first method.

[0119] The second step S2 of the first method includes triggering the safety measure SAM.

[0120] exist Figure 1 In the example, the safety measure SAM includes providing a tactile warning to the driver 20 of vehicle 10. This is achieved by activating a rocker motor built into the steering wheel 30 of vehicle 10 so that the steering wheel 30 begins to vibrate.

[0121] This helps to wake the driver 20 of the vehicle if he or she is drowsy, so as not to fall asleep or already asleep.

[0122] Therefore, driver 20's attention to traffic incidents can be restored through the safety measure SAM.

[0123] Other alternatives to safety measure SAM include providing optical and / or acoustic warnings to the occupants 18 of vehicle 10.

[0124] Another alternative to safety measure SAM may include triggering the activation of the vehicle's hazard lights to warn other road users of potential unintended driving behavior.

[0125] In the event of a serious medical emergency of occupant 18, especially if occupant 18 is the driver 20 of vehicle 10, vehicle 10 may be triggered to make an emergency call and / or reduce its speed and / or stop and / or pull over to the side of the road on which the vehicle is traveling and / or drive to the medical facility in autonomous driving mode.

[0126] This can mitigate potentially dangerous traffic situations and ensure road safety. Furthermore, the rapid provision of medical assistance can prevent or at least reduce permanent damage to occupants' bodies caused by medical conditions.

[0127] It should be noted that the above explanation revolves around the fact that the occupant 18 of vehicle 10 is the driver. Of course, the method described above can also be implemented in conjunction with other occupants (i.e., passengers of vehicle 10).

[0128] As used herein, the phrase “at least one” in relation to a list of one or more entities should be understood to mean at least one entity selected from any one or more entities in the entity list, but not necessarily at least one of each entity specifically listed in the entity list, and does not exclude any combination of entities in the entity list. This definition also allows for the optional presence of entities other than those specifically identified in the entity list referred to by the phrase “at least one,” whether related to or unrelated to those specifically identified entities. Thus, as a non-limiting example, “at least one of A and B” (or equivalently, “at least one of A or B”, or equivalently, “at least one of A and / or B”) could in one example mean at least one (optionally including more than one) A, without B (and optionally including entities other than B); in another example, at least one (optionally including more than one) B, without A (and optionally including entities other than A); and in yet another example, at least one (optionally including more than one) A and at least one (optionally including more than one) B (and optionally including other entities). In other words, the phrases “at least one,” “one or more,” and “and / or” are open-ended expressions that are both connected and separate in operation. For example, each of the expressions “at least one of A, B, and C,” “at least one of A, B, or C,” “one or more of A, B, and C,” “one or more of A, B, or C,” and “A, B, and / or C” can mean a single A, a single B, a single C, A and B together, A and C together, B and C together, A, B, and C together, and optionally, any of the above combined with at least one other entity.

[0129] By studying the accompanying drawings, the disclosure, and the appended claims, those skilled in the art can understand and implement other variations of the disclosed examples in practice with respect to the claimed disclosure. In the claims, the word "comprising" does not exclude other elements or steps, and the indefinite articles "a" or "an" do not exclude multiple. A single processor or other unit can perform the function of several items or steps recited in the claims. The fact that certain measures are recited in mutually different dependent claims does not mean that a combination of these measures cannot be used advantageously. Computer programs can be stored / distributed on suitable media, such as optical storage media or solid-state media provided with or as part of other hardware, but can also be distributed in other forms, such as via the Internet or other wired or wireless telecommunications systems. Any reference numerals in the claims should not be construed as limiting the scope of the claims.

[0130] List of reference numerals 10 vehicles 12 seats 14 Pressure Sensing Pad 16 First sensing element 18 crew members 20 drivers 22 cameras 24 Second sensing element 26 radar units 28 Third sensing element 30 Steering Wheel 32 Data processing equipment 34 data storage units 36 Data Processing Units 38 Computer-readable storage media 40 Computer Programs 42. Apparatus for performing the first method and the second method 44 System 46 Seat Cushions 48 Backrest 50 headrests 52 heads 53 legs 54. Torso 55 arms 56 Floor 58. Car roof lining 60 Bottom SAM Safety Measures D1 First Data D2 Second Data D3 Third Data

Claims

1. A method for detecting disability of an occupant (18) of a vehicle (10), the method comprising: - Obtain first data (D1) indicating the pressure distribution on the seat (12) of the vehicle (10), wherein the seat (12) is occupied by the occupant (18). - Obtain second data (D2) indicating the position and / or orientation of at least one body part (52, 53, 54, 55) of the occupant (18) within the interior of the vehicle (10). - Provide third data (D3) indicating the incapacity of the occupant (18) based on the first data (D1) and the second data (D2).

2. The method according to claim 1, wherein, The first data (D1) indicates the temporal evolution of the pressure distribution on the seat (12) of the vehicle (10).

3. The method according to claim 1 or 2, wherein, The at least one body part (52, 53, 54, 55) includes at least one of the torso (54), arm (55), leg (53) and head (52) of the occupant (18).

4. The method according to any one of the preceding claims, wherein, The second data (D2) includes image data, radar data, and / or lidar data.

5. The method according to any one of the preceding claims, wherein, The second data (D2) also indicates the movement of the occupant (18) within the interior of the vehicle (10).

6. A method for controlling a vehicle (10), the method comprising: - Detect the incapacity of the occupant (18) of the vehicle (10) using the method according to any one of the preceding claims, and - The safety measures (SAM) of the vehicle (10) are triggered based on the third data (D3).

7. The method according to claim 6, wherein, The safety measures (SAM) include at least one of the following: triggering an optical warning, triggering an acoustic warning, triggering a tactile warning, triggering the activation of the hazard lights of the vehicle (10), triggering an emergency call, requesting the vehicle (10) to slow down, requesting the vehicle (10) to stop, requesting the vehicle (10) to be pulled over to the side of the road on which the vehicle (10) is traveling, and requesting the vehicle (10) to be driven to a medical facility.

8. A data processing apparatus (32) comprising means (42) for performing the method according to any one of claims 1 to 5 and / or the method according to claim 6 or 7.

9. A computer program (40) comprising instructions that, when executed by a computer, cause the computer to perform the method according to any one of claims 1 to 5 and / or the method according to claim 6 or 7.

10. A computer-readable storage medium (38) comprising instructions that, when executed by a computer, cause the computer to perform the method according to any one of claims 1 to 5 and / or the method according to claim 6 or 7.

11. A system (44) for detecting disability of an occupant (18) of a vehicle (10), the system (44) comprising: - A first sensing element (16) is used to generate first data (D1) indicating the pressure distribution on the seat (12) of the vehicle (10). - A second sensing element (24) for generating at least a portion of second data (D2) indicating the position and / or orientation of at least one body part (52, 53, 54, 55) of the occupant (18) within the interior of the vehicle (10), and - The data processing device (32) according to claim 8. The first sensing element (16) and the second sensing element (24) are communicatively connected to the data processing device (32), and The data processing device (32) includes a communication interface for providing third data (D3) indicating the incapacity of the occupant (18) based on the first data (D1) and the second data (D2).

12. The system (44) according to claim 11, wherein, The first sensing element (16) includes a pressure sensor and / or a pressure sensing pad (14) that can be disposed in or on the seat (12) of the vehicle (10).

13. The system (44) according to claim 11 or 12 further includes a third sensing element (28) for generating at least a portion of the second data (D2) indicating the position and / or orientation of at least one body part (52, 53, 54, 55) of the occupant (18) within the interior of the vehicle (10).

14. The system (44) according to any one of claims 11 to 13, wherein, The second sensing element (24) and / or the third sensing element (28) include an optical camera (22), a radar unit (26) and / or a lidar unit configured to capture at least one of the torso (54), arm (55), leg (53) and head (52) of the occupant (18).

15. A vehicle (10) comprising a system (44) for detecting incapacity of an occupant (18) of the vehicle (10) according to any one of claims 11 to 14.

Images