Apparatus and associated method for analyzing a vehicle driver's perception of risk

JP7578832B2Active Publication Date: 2024-11-06VALEO COMFORT & DRIVING ASSISTANCE
11 Cites 0 Cited by

Patent Information

Application Number
JP2023540102
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-12-31
Filing Date
2021-12-29
Publication Date
2024-11-06
Estimated Expiration
2041-12-29

AI Technical Summary

Technical Problem

Existing driving assistance devices struggle to determine if a driver has perceived a hazard, leading to unnecessary warnings that can be ignored by the driver, reducing their effectiveness and causing frustration.

Method used

A device that analyzes a driver's heart rate for deceleration phases following a detected hazard, determining if the driver has perceived the danger through a processing unit that receives indications from vehicle sensors, measures heart rate variations, and adjusts interventions by the driving assistance system accordingly.

Benefits of technology

The solution reliably determines if a driver has perceived a hazard, allowing timely and appropriate interventions without causing discomfort, thereby enhancing the effectiveness and acceptance of driving assistance systems.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007578832000002
    Figure 0007578832000002
  • Figure 0007578832000003
    Figure 0007578832000003
  • Figure 0007578832000004
    Figure 0007578832000004
Patent Text Reader

Abstract

The device (1) for analysing a vehicle driver's perception of danger comprises: a heart rate sensor (10) designed to measure the driver's heart rate over time; and a processing unit (40) designed to a) receive an indication (D) of a danger present in the vehicle's environment, b) analyse the driver's heart rate measured by the heart rate sensor over a time interval starting when the indication is received by the processing unit, and c) determine whether a danger has been perceived by the driver depending on whether the driver's heart rate analysed in step b) includes a deceleration phase during the time interval.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to the technical field of driving assistance in vehicles, and more particularly to an apparatus and associated method for analysing a vehicle driver's perception of danger. [Background technology]

[0002] Currently, it is difficult to know whether a driver has perceived a danger present in his or her surroundings. The driver may, for example, look in the direction of a danger without realizing that it is a danger, or, conversely, perceive a danger without seeing it directly, seeing it only in the peripheral vision. It is also possible that the driver does not see the danger at all, for example because it is outside the driver's field of vision.

[0003] Driving assistance devices are already known that are installed in vehicles and are capable of analyzing the surroundings of the vehicle in which they are installed and of intervening, typically in the form of a visual, audible, tactile and / or olfactory warning, to warn the driver that dangers are likely to enter the area or path of the drive.

[0004] Known driver assistance devices send a large number of warnings without guaranteeing that these warnings will reach the driver. However, not knowing whether the driver correctly perceives a danger means not knowing whether the driver is prepared to react appropriately to this danger, which hampers the design of suitable safety solutions.

[0005] Conversely, when a warning from the driving assistance device reaches the driver, the driver may consider it confusing or bothersome, especially if the driver already perceives the danger associated with the warning, for example, because the driver has already been warned of this danger or because the driver has already seen and analyzed this danger himself. Therefore, the driver often prefers to stop the warning from the driving assistance device, even if it means taking the risk of not being warned of a danger that the driver cannot see.

[0006] It is therefore necessary to make driving assistance devices more relevant so that they are better accepted by the driver, for example by only warning the driver when it is actually useful and by ensuring that the warning actually reaches the driver. Summary of the Invention

[0007] In this context, the invention proposes a device for analyzing a vehicle driver's perception of danger, said device comprising: a heart rate sensor designed to measure the driver's heart rate over time; a processing unit, a) receiving an indication of the presence of dangers in the vicinity of the vehicle; b) analyzing the driver's heart rate as measured by the heart rate sensor over a time interval beginning upon receipt of the indication by the processing unit; c) determining whether a danger is perceived by the driver depending on whether the driver's heart rate analyzed in step b) includes or does not include a deceleration phase within said time interval; a processing unit, Equipped with.

[0008] As a result, the device according to the invention allows the processing unit to determine whether the driver is aware of a danger by analyzing the driver's heartbeat immediately after the danger is recognized. More specifically, the processing unit of the device according to the invention considers that the danger is perceived by the driver when the driver's heartbeat includes a deceleration phase during a time interval in which the analysis is performed, for example, 3 seconds after the occurrence of the danger. The deceleration phase can extend over the entire time interval (i.e., here, over more than 3 seconds) or over only a part of the time interval (i.e., here, over a duration of less than 3 seconds). Research has shown that such a cardiac deceleration phase occurs when the heart slows down so that the brain can process the information received. Depending on the complexity of the information that the brain has to receive and process, the duration of the cardiac deceleration phase may be more or less long, the cardiac deceleration phase being at least partially included within a time interval with a duration of 1 second to 5 seconds, in particular with a duration of 3 seconds after the information is received by the brain.

[0009] The determination of the driver's perception of danger by the device according to the invention is very reliable and rapid, without confusing or annoying the driver.

[0010] Other non-limiting and advantageous characteristics of the device according to the invention, taken individually or in any technically conceivable combination, are: in step b), the analyzed heartbeats are those of the time interval during which measurements are made, starting from the reception of the indication, having a duration between 1 and 5 seconds, preferably between 1 and 3 seconds, the device comprises an eye sensor designed to detect the direction in which the driver is looking, and the processing unit determines in step c) that a danger is perceived by the driver if the driver's heart rate analyzed in step b) includes a deceleration phase and if the driver is also looking into the driving field, the device comprises a breathing sensor for sensing the breathing of the driver, the breathing sensor being designed to measure the breathing rate of the driver, the processing unit being designed to correct the heart rate of the driver analyzed in step b) depending on said measured breathing rate, the processing unit determines that the driver's heart rate comprises a deceleration phase if the analysis of the heart rate in step b) indicates that the variability of the driver's heart rate at the instant t has a value lower than the average of the values ​​adopted by the variability of the heart rate (ΔFC) at the two instants preceding the instant t, - The variability of the driver's heart rate is calculated from a reference heart rate selected from the driver's heart rate measured by the heart rate sensor at the moment the indication is received by the processing unit in step a) and an average heart rate of the driver measured by the heart rate sensor, the average heart rate of the driver being preferably measured when no danger is perceived.

[0011] According to a particularly advantageous feature of the invention, the processing unit of the device according to the invention is designed to carry out a step d) of commanding a driving assistance device installed in the vehicle to intervene with the driver depending on at least one of the following: the driver's perception or lack of perception of the danger determined in step c), the moment at which the danger is perceived by the driver, the duration of a possible phase of heart rate deceleration analyzed in step b), the amplitude of a possible phase of heart rate deceleration analyzed in step b).Of course, in order to command the driving assistance device to intervene, the processing unit 40 is designed to take into account the indication of danger received in step a), in particular the distance of the danger from the vehicle and the severity of said danger, in addition to at least one of the aforementioned elements.

[0012] The fact that the processing unit "commands the driving assistance device to intervene" should be understood to mean that the driving assistance device controls whether, when and how (in what form) it should intervene with the driver. In particular, the driving assistance device intervenes with the driver regarding a danger if the driver is not yet aware of the danger, in which case the intervention is performed at the best possible time and in the most optimal form to avoid the danger. Therefore, the device according to the present invention is very useful for a driving assistance device installed in a vehicle.

[0013] Interventions made by the driving assistance device to the driver include the driving assistance device sending a signal to the driver, which signal may possibly take the form of a warning intended to warn the driver of a danger or advice intended to guide the driver facing a danger, or the driving assistance device optionally forcing the driver to take charge of the vehicle, for example by forcing the driver to switch the vehicle into an automated driving mode or into remote assisted driving of the vehicle.

[0014] For example, if the device according to the invention determines that the driver does not perceive a danger, the processing unit commands that the driving assistance device must intervene with the driver and controls whether the intervention should take the form of a warning sent to warn the driver of this danger and / or advice sent to guide the driver facing the danger and / or driving assistance imposed on the driver. When driving assistance is imposed on the driver by the driving assistance device, the driving assistance device is considered to be in charge of the vehicle insofar as the vehicle's components are directly actuated by the driving assistance device to avoid the danger. Conversely, if the device according to the invention determines that the driver is already aware of the danger, the driving assistance device silences the warning related to this danger so that the driver is not bothered by the transmission of unnecessary warnings.

[0015] Other non-limiting advantageous characteristics of the device according to the invention, taken individually or in any technically conceivable combination, are: the device according to the invention comprises a driving assistance device, and the indication of the danger received by the processing unit in step a) is transmitted by the driving assistance device, the processing unit is further designed to identify the driver and to customize the analysis of the heart rate performed in step b) depending on said identification, the processing unit is further designed to customise the instructions in step d) depending on said identification.

[0016] The invention finally relates to a method for analyzing the perception of danger of a vehicle driver, according to which the following steps are carried out: - measuring the driver's heart rate; - receiving an indication of a danger present in the vicinity of the vehicle; - analyzing the measured heart rate of the driver over a time interval starting upon receipt of an indication of danger; - determining whether a danger is perceived by the driver depending on whether the analyzed driver's heart rate includes or does not include a deceleration phase within said time interval; The following will be implemented.

[0017] Moreover, various other features of the invention will become apparent from the accompanying description given in conjunction with the drawings, which illustrate non-limiting embodiments of the invention. [Brief description of the drawings]

[0018] [Figure 1] 1 is a schematic diagram of a device for analyzing the perception of danger according to the invention; [Diagram 2] 1 is a graph showing two curves FC1 and FC2 giving the variation ΔFC of the heart rate (beats per minute, or bpm) over time (seconds, or s) for one and the same driver in two different driving situations. [Diagram 3] 3 is a graph showing two curves V1 and V2 giving the change in the variation of the vehicle's speed (in kilometers per hour, or km / h) over time (in seconds, or s) for the driver in the two situations of FIG. 2. [Figure 4] FIG. 2 is a schematic diagram of the main steps of the method according to the invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] It should be noted that in these figures, structural and / or functional elements that are shared by different variants may have the same reference numbers.

[0020] Fig. 1 shows diagrammatically the main elements of a device 1 for analysing the risk perception of a vehicle driver. The device 1 is particularly suitable for analysing the risk perception in motor vehicles. The remainder of the description will explain this scenario in detail. However, it is entirely conceivable to use the device 1 according to the invention to analyse the risk perception in other types of vehicles, for example a boat, an aircraft or a train.

[0021] In this case, the device 1 is mounted on a motor vehicle. However, it is entirely conceivable that at least some of the elements that the device comprises are remote from the vehicle.

[0022] The device 1 comprises at least a heart rate sensor 10 designed to measure the driver's heart rate over time; a processing unit 40, a) receiving an indication of the presence of dangers in the vicinity of the vehicle; b) analysing the driver's heart rate as measured by the heart rate sensor 10 over a time interval beginning upon receipt by the processing unit 40 of the indication in step a); c) determining whether a danger has been perceived by the driver depending on whether the driver's heart rate analyzed in step b) includes or does not include a deceleration phase within said time interval; A processing unit 40 designed to Equipped with.

[0023] A sensor 10 for sensing the driver's heartbeat is mounted on the vehicle and comprises a sensor for sensing the electrical activity of the heart and / or a sensor for sensing the mechanical activity of the heart.

[0024] According to a first example, the heart rate sensor 10 comprises an electrical activity sensor in the form of one or more electrodes, which are placed in direct contact with the skin of the driver in order to record electrical signals generated by cardiac activity. In this first example, the heart rate sensor 10 is placed, for example, on the steering wheel, where the driver places his or her hands on the steering wheel.

[0025] According to another example, the heart rate sensor 10 comprises a mechanical activity sensor in the form of a blood flow camera or radar capable of recording a ballistic signal of the driver's cardiac activity, the ballistic signal being directly related to the mechanical activity generated by the heartbeat. In this second example, the heart rate sensor 10 measures the heart rate through the driver's clothing without the need for contact with said driver. The heart rate sensor 10 can be placed, for example, on the driver's seat, behind the steering wheel (i.e. between the steering wheel and the windshield of the vehicle), on the driver's seat belt, or a combination of these locations.

[0026] According to a third example, the heart rate sensor 10 comprises both an electrical activity sensor and a mechanical activity sensor (in this case ballistic activity), which sensors are positioned, for example, in one or more of the locations mentioned above.

[0027] Regardless of the assumed example, the heart rate sensor 10 operates continuously to record the driver's heart rate FC over time while the driver is traveling. The heart rate sensor measures the instantaneous heart rate, i.e. the heart rate per minute (given in beats per minute or bpm). Here, the heart rate sensor 10 provides the driver's instantaneous heart rate FC(t) at regular intervals, for example every 0.5 seconds (s). Of course, the heart rate sensor can provide the instantaneous heart rate at shorter, possibly irregular, intervals. It is preferable that the heart rate sensor 10 has operated for at least one minute before its first measurement can be taken.

[0028] In practice, to be able to provide the instantaneous heart rate of the driver, the heart rate sensor 10 performs the following steps: The heartbeat sensor acquires the duration between two heartbeats (or heartbeat pairs) coming from the driver for a number of heartbeat pairs; a heart rate sensor establishing a heart rate in the driver based on the duration and the measured heart rate; -The heart rate sensor performs an interpolation to obtain the driver's heart rate every 0.5 seconds.

[0029] The processing unit 40, for its part, is designed to communicate with the heart rate sensor 10. In this case, the processing unit has a memory 41 for storing the driver's heart rate as a function of time measured by the heart rate sensor 10. More specifically, the memory 41 stores the driver's instantaneous heart rate FC(t) at the time of each measurement made by the heart rate sensor 10, in particular every 0.5 seconds (s) in this example.

[0030] In step a), the processing unit 40 receives an indication that a danger is present in the vicinity of the vehicle. This indication comes from a driving assistance device 2 that is installed in the motor vehicle and with which the processing unit 40 is designed to communicate. Here, the driving assistance device 2 is considered to be included in the device 1 according to the invention. However, it is entirely conceivable that the driving assistance device is separate from the device 1 according to the invention, although it is still designed to communicate with the processing unit 40 of the device 1.

[0031] The driving assistance device 2 is known per se and therefore will not be described in detail. Essentially, the driving assistance device 2 comprises a number of sensors arranged inside and / or outside the vehicle, by means of which it is able to explore the surroundings of the vehicle, whether close by or further away, and determine dangerous situations (or dangers) in these surroundings, such as pedestrians likely to pass in front of the vehicle, vehicles traveling on the wrong road, sudden braking of another vehicle in front of the vehicle, accidents in front of the vehicle, etc.

[0032] The danger detected by the driving assistance device 2 is in this case defined as a function of its severity and / or distance from the vehicle. The display D therefore contains information regarding the severity (or degree of danger) and / or distance of the danger from the vehicle.

[0033] The driving assistance device 2 is in particular designed to transmit an indication D to the processing unit 40, according to which the processing unit determines that a danger is present in the vicinity of the vehicle as soon as the processing unit determines said danger. When the driving assistance device transmits such an indication D to the processing unit 40 (step a), the processing unit 40 determines that the moment of reception of indication D from the driving assistance device 2 corresponds to the first moment for the analysis of step b), i.e. the moment t=0s.

[0034] As shown in Fig. 1, the driving assistance device 2 may also intervene with the driver, in particular by sending the driver a warning A to warn him of a hazard. This warning A may be sent in different forms, using audible (e.g. a beep or verbal notification), visual (e.g. a message displayed on the dashboard), haptic (e.g. a vibration felt on the steering wheel or in the seat), olfactory (e.g. a burning smell released into the vehicle cabin), or a combination of these different forms.

[0035] In step b), the processing unit 40 analyses the driver's heartbeat measured by the heartbeat sensor 10 over a time interval starting from the first moment of reception (t=0s) of the indication D. Preferably, the heartbeat FC analyzed in step b) has been measured over a time interval having a duration between 1 and 5 seconds, even more preferably between 1 and 3 seconds, starting from the reception of the indication D. For example, the time interval starts upon reception of the indication D of danger and extends up to 3 seconds after said reception of the indication D.

[0036] To carry out this analysis, the processing unit 40 in this case comprises a calculator 42 designed to carry out said heart rate analysis, which in particular involves the calculation of the driver's heart rate variability ΔFC(t) at a given instant in time according to the following formula: ΔFC(t)=FC(t)-FCref

[0037] where FC(t) is the instantaneous heart rate of the driver measured by the heart rate sensor 10 at the instant t and FCref is the reference heart rate associated with the driver.

[0038] In this case, the reference heart rate FCref associated with the driver is selected from the following list: the instantaneous heart rate FC(t=0s) of the driver measured by the heart rate sensor 10 at the moment t=0s when the indication D is received by the processing unit 40 in step a), and - Driver's average heart rate is selected from. Preferably, the reference heart rate FCref associated with the driver is selected as the instantaneous heart rate FC(t=0 s) of the driver measured by the heart rate sensor 10 at the instant t=0 s. If the reference heart rate is selected as the average heart rate of the driver, the reference heart rate FCref is considered to be a specific average heart rate of the driver calculated by the calculator 42 from measurements of the driver's heart rate over a period of at least one minute, preferably a period without any surrounding danger. The average heart rate of the driver is then preferably recalculated and periodically re-stored in the memory 41 of the processing unit 10. It is also entirely conceivable to consider the average heart rate of the driver to be the driver's resting heart rate. In this case, the average heart rate originates from a phase of initializing the device 1 according to the invention, during which the driver's heart rate is recorded with the vehicle stationary.

[0039] In practice, the calculator 42 calculates the value ΔFC(t) adopted by the variation of the heart rate at each subsequent instant t from the first instant (t=0 s) when the heart rate sensor 10 measures the instantaneous heart rate FC(t).

[0040] From the calculated values, for example, a curve giving the change in the heart rate variability ΔFC over time can be shown on a graph. FIG. 2 shows, for example, a graph with two curves FC1 and FC2 representing the change in the heart rate variability ΔFC over time for one and the same driver in two different driving situations. In this case, each curve FC1, FC2 is surrounded by a zone representing the error related to the value shown at the instant t. The error zone is shown hatched for each curve FC1, FC2. In a first situation, related to the curve FC1, the processing unit 40 has received, at the first instant (t=0s), symbolized by an arrow in FIG. 2, an indication D of a vehicle traveling in the opposite direction in the path of the vehicle driven by the driver. In a second situation, related to the curve FC2, the processing unit 40 has received, at the first instant (t=0s), an indication D of a likely danger on the path of the vehicle driven by the driver.

[0041] In step c), the processing unit 40 finally determines, depending on the analysis of step b), whether the driver has or has not perceived the danger.

[0042] More specifically, if the driver's heart rate analyzed in step b) comprises a deceleration phase (also called "cardiac deceleration") within said time interval in which measurements are made, preferably within a time interval [0;3 s] of 3 seconds duration, processing unit 40 determines that the driver has perceived a danger. Conversely, if the driver's heart rate analyzed in step b) comprises no cardiac deceleration phase within said time interval in which measurements are made, preferably within [0;3 s], processing unit 40 determines that the driver has not perceived a danger.

[0043] To determine whether the heartbeat includes a cardiac deceleration phase, the processing unit 40 examines whether the variation ΔFC of the driver's heartbeat resulting from the analysis in step b) includes a phase in which it decreases over time. More specifically, the computer 42 compares the successive values adopted by the variation ΔFC of the heartbeat within the time interval during which the measurement is made, for example between 0 seconds and 3 seconds. The processing unit 40 determines that the variation ΔFC of the driver's heartbeat includes a decreasing phase if the variation ΔFC(t) of the heartbeat at instant t has a value lower than the arithmetic mean of the values adopted by said variation of the heartbeat at two instants preceding instant t. In other words, for each measurement instant t, the computer 42 calculates the arithmetic mean MOY of the two values adopted by the variation of the heartbeat at two instants (t - 1) and (t - 2) preceding that instant t, according to the following formula.

Number

[0044] The computer 42 then compares the value ΔFC(t) adopted by the variation of the heartbeat at instant t with said mean MOY. If the variation of the heartbeat at instant t is less than the mean, i.e., ΔFC(t) < MOY, the processing unit 40 determines that the heartbeat includes a deceleration phase over the three instants t - 2, t - 1, and t.

[0045] As a result, in the example of Figure 2, the processing unit 40 determines that the curve FC1 giving the change in the variation of the heartbeat over time includes a decreasing phase within the interval extending here between 0 seconds and 2 seconds after the processing unit 40 receives the display D. The processing unit 40 then concludes that in the first situation, the driver perceived the risk that the vehicle was moving in the wrong direction 2 seconds after receiving the display D by the processing unit 40. The driver's perception can be associated with the fact that the driver saw the vehicle moving in the wrong direction from afar, or with the fact that the driving assistance device 2 warned the driver by means of warning A at the same time as the driving assistance device 2 sent the display D to the processing unit 40.

[0046] Conversely, in figure 2, the curve FC2 does not include a decrease step within the measurement interval extending between 0 and 5 seconds after the processing unit 40 receives the indication D. The processing unit 40 concludes that the driver in the second situation does not perceive a danger. In particular, it may be assumed that the driver does not see for himself the danger in this second situation, or that the driver does not perceive a warning A that may have been sent by the driving assistance device 2, or that the driving assistance device 2 did not send a warning A.

[0047] Figure 3 shows a graph with two curves V1 and V2 representing the variation of the speed variation ΔV over time for a vehicle driven by a driver in the two aforementioned situations. In this case, the curves V1, V2 are each surrounded by a zone representing the error associated with the value shown at the instant t. The error zone is here indicated by hatching for the curves V1 and V2. The speed variation of the vehicle is calculated by the following formula: ΔV(t)=V(t)-Vref

[0048] where V(t) is the instantaneous speed of the driver at the instant t and Vref is the reference speed of the vehicle, which in this case is chosen as the instantaneous speed of the vehicle at the initial instant (t=0s).

[0049] The conclusion of the processing unit 40 of the device 1 according to the invention regarding the driver's perception of danger is confirmed by the different reactions of the driver, which can be seen in Fig. 3, in the two situations. In particular, after the driver perceives the danger in the first situation, he slows down the vehicle he is driving to pay attention to the danger, so that the curve V1 slopes downwards after 2 seconds, which is the time it takes the driver to analyze the information about the danger received by the brain. Conversely, the curve V2 shows zero variation of the speed over time, which means that the driver keeps the speed constant in the second situation. This confirms that the driver does not perceive any danger in this second situation.

[0050] The device 1 described above can include various advantageous refinements which can be combined with one another by any means.

[0051] According to a first possible advantageous improvement, the device 1 is able to measure the driver's heart rate with greater accuracy.

[0052] For that purpose, the device 1 according to the first improvement comprises a breathing sensor 20 for sensing the breathing of the driver, designed to measure the breathing rate of the driver over time. The breathing sensor 20 is arranged, for example, behind the steering wheel and facing the driver's seat. It is conceivable that the breathing sensor coincides with the heart rate sensor 10, in particular if the heart rate sensor 10 comprises a sensor for sensing the mechanical activity of the heart. The breathing sensor 20 is synchronized with the heart rate sensor 10 so as to measure the breathing rate of the driver at the same instant when the driver's instantaneous heart rate is measured. The breathing sensor 20 is designed to measure the breathing rate of the driver, i.e. the number of "breath in + breath out" cycles performed by the driver within a time interval of one minute. As with the heart rate sensor 10, the breathing rate sensor 20 (or breathing frequency sensor) should preferably be operational for at least one minute before making its first measurement.

[0053] According to this first improvement, the processing unit 40 is designed to communicate with the respiration sensor 20 and store the driver's respiration rate over time in the memory 41. More specifically, the memory 41 stores the driver's respiration rate at each measurement made by the respiration sensor 20, in particular every 0.5 seconds (s) in this example.

[0054] The processing unit 40 is then designed, by its calculator 42, to correct the instantaneous heart rate FC(t) of the driver depending on said measured breathing rate. The correction consists of removing the signals for the heart rate measured by the heart rate sensor 10 and for the breathing rate measured by the breathing sensor 20, so that the instantaneous heart rate of the driver is not influenced by the driver's inhalation and exhalation, which necessarily fluctuates said heart rate.

[0055] According to a second advantageous refinement, the device 1 according to the invention comprises means for avoiding false positive detections, i.e. for avoiding a decision that the driver has perceived a danger when this is not the case.

[0056] More specifically, the device 1 according to the invention comprises an eye sensor 30 designed to detect the direction in which the driver is looking. The eye sensor 30 takes the form of, for example, a camera arranged behind the steering wheel. The eye sensor 30 is designed to determine whether the driver is looking at the driving field or whether the driver is looking at driving-related elements or whether the driver is looking at auxiliary elements that distract the driver from driving. Here, "driving field" is understood to mean the road that the driver can see when he is driving the vehicle. "Driving-related elements" include, for example, the rear-view mirror, the navigation system or the dashboard that can emit information about the vehicle (speed, illuminated indicator lights, etc.). Auxiliary elements are considered to include all other elements present in the vehicle that are not involved in driving, such as the driver's mobile phone, the radio station, passengers in the vehicle. For example, the eye sensor 30 is designed to detect whether the driver has lowered his head to look at his mobile phone or whether the driver has turned to observe a passenger on the rear bench seat or a passenger sitting next to him, in which case the driver is not looking at the driving field or driving-related elements.

[0057] The eye sensor 30 allows the processing unit 40 to utilize an additional criterion for determining whether the driver has perceived a danger, i.e. the direction in which the driver is looking. This additional criterion avoids the processing unit 40 determining that the driver has perceived a danger only because the driver's heartbeat has a heart deceleration phase within the observed time interval. In particular, the driver's heart deceleration is not necessarily caused by the perception of a danger in the driving field, but may be caused by another event, such as for example reading an SMS, or by a pesky indicator light illuminating on the dashboard. As a result, with the eye sensor 30, the processing unit 40 utilizes two criteria to determine that a danger has been perceived by the driver, namely the fact that their heartbeat includes a deceleration phase and the fact that they are looking at the driving field. In other words, the processing unit 40 determines in step c) that a danger has been perceived by the driver if the driver's heartbeat analyzed in step b) includes a deceleration phase and further the driver is looking at the driving field. However, as long as the driver's heart rate analysed in step b) does not have a deceleration phase, the processing unit 40 directly concludes that no danger has been perceived, without having to check the direction in which the driver is looking.

[0058] As a result, according to this second advantageous improvement, the device according to the invention becomes more accurate in determining the driver's perception of danger by making it possible to estimate the cause of the heart rate modulation, said cause may arise, for example, from the road, or from the passenger compartment (a suspicious indicator light is lit), or from a text received on the driver's mobile phone.

[0059] According to a third advantageous refinement, the processing unit 40 of the device 1 is designed to command the driving assistance device 2 and in particular to control whether, when and how to intervene with the driver. By means of this command, the driving assistance device 2 disturbs the driver less when it intervenes with the driver and possible driver interventions made by the driving assistance device 2 are more relevant, since they are made at the right time and in the right form.

[0060] As mentioned above, the driving assistance device 2 in this case can intervene, for example by sending the driver a warning A (having an audible, visual, tactile and / or olfactory form) to warn him of a danger it detects around the vehicle. The manner in which the respective warnings A are sent may be combined or uncombined. The sending of the warnings A may be done once or may be repeated over time, for example at regular time intervals.

[0061] In this case, the driving assistance device 2 can also intervene with the driver by sending advice C to the driver to help him react to the danger. Such advice C sent by the driving assistance device 2 can be, for example, requesting the driver to slow down, to return to a specific lane, to get off the road, etc. Advice C aimed at guiding the driver to react optimally to the danger is generally sent in a visual form (displayed on the dashboard) or in an audible form (advice spoken inside the vehicle cabin). The forms of sending the respective advice C can be combined or not. The sending of the advice C can be done once or can be repeated over time, for example at regular time intervals.

[0062] The driving assistance device 2 can also intervene in the driver's operation by imposing driving assistance I on the driver. Such driving assistance I is intended to relieve the driver from driving, for example, by imposing remote-assisted driving on the driver or by forcing the driver to switch to an automatic driving mode of the vehicle. As a result, the driving assistance imposed by the driving device 2 takes charge of and operates each component of the vehicle on behalf of the driver.

[0063] In this context, the processing unit 40 of the device 1 according to the invention is designed to carry out step d), during which it commands the driver's intervention to the driving assistance device 2. In particular, the processing unit 40 controls at what point in time, in what form and with what frequency the driving assistance device 2 should or should not send or resend a warning A to warn the driver of a danger, or at what point in time, in what form and with what frequency it should or should not send one or more driving advices C to guide the driver facing a danger, and / or at what point in time driving assistance I should or should not be imposed on the driver in order to avoid the danger.

[0064] More specifically, the processing unit 40 carries out the instructions of step d) depending on at least one of the following factors: the driver's perception or lack of perception of danger determined in step c), the moment at which the danger is perceived by the driver, the duration of the possible phase of heart rate deceleration analyzed in step b), the amplitude of the possible phase of heart rate deceleration analyzed in step b).

[0065] The analysis of the heartbeat in step b) allows the processing unit 40 to know not only whether the driver has perceived the danger or not, but also whether the driver has perceived it early, i.e. whether the cardiac deceleration has just ended at the beginning of an interval in which the analysis is performed over, for example, the first 2 seconds of the interval [0-3s], or late, i.e. whether the cardiac deceleration has just started at the end of an interval in which the analysis is performed over, for example, the last half second of the interval [0-3s]. Thus, the analysis of the heartbeat in step b) allows the processing unit 40 to determine the best time for the driving assistance device 2 to interact with the driver. For example, the best time is determined by the processing unit 40 depending on the rate of decrease of the heart rate variability in the decrease phase. More specifically, if the rate of decrease is greater than a predefined threshold (i.e. if the rate of decrease is rapid), the processing unit 40 commands the driving assistance device 2 not to intervene or to mute the warning. Conversely, if the rate of decrease is less than said predefined threshold (i.e. if the rate of decrease is slow), the processing unit 40 commands the driving assistance device 2 to intervene in order to warn and / or advise the driver, or even to intervene in the driving. In practice, the processing unit 40 commands the driving assistance device 2 to intervene with the driver if, after the indication of danger D has been received, the processing unit 40 does not reveal any cardiac deceleration over the time interval in which the analysis is carried out [0;3 seconds]. In other words, if the processing unit 40 analyzes that the cardiac deceleration starts with a delay, i.e. more than 3 seconds, after the indication of danger D has been received, or that the cardiac deceleration ends more than 3 seconds after this indication D has been received, it commands the driving assistance device 2 to intervene with the driver in order to warn and / or assist the driver.

[0066] Furthermore, the analysis of the heart rate in step b) enables the processing unit 40 to know whether the perception of the danger makes the driver a little or a lot worried. The driver's worry is evident if the deceleration continues for a long time and / or if the heart rate variability is high, i.e. if it is significantly below a predefined threshold. The analysis of the heart rate in step b) therefore enables the processing unit 40 to determine whether the danger has been perceived in all its severity, which allows the processing unit 40 to improve the control of the driving assistance device 2.

[0067] Of course, in order to control the driving assistance device to intervene, the processing unit 40 is designed to take into account, in addition to at least one of the aforementioned elements, the indication D of the danger received in step a), in particular the distance of the danger from the vehicle and the severity of said danger.

[0068] The processing unit 40 of the device 1 according to the third improvement is therefore designed to receive as input various information about the danger and the way this danger is perceived by the driver and to send as output instructions indicating how the driving device 2 should intervene to the driver. The processing unit 40 therefore ensures that the driving assistance device 2 intervenes at the appropriate time and in the manner most suitable to enable the driver to adopt an appropriate behavioural response.

[0069] According to a fourth advantageous improvement of the device 1 according to the invention, the device 1 is able to identify the driver so as to provide a customized analysis of the heart rate in step b) and / or a customized control of the driving device 2 in step d).

[0070] More specifically, the device 1 according to the invention comprises an identification system 50, for example a face recognition system or a fingerprint recognition system. The processing unit 40 is designed to communicate with this identification system 50 in order to identify the driver and to retrieve information about this driver in a memory.

[0071] The processing unit 40 is then designed to customise the analysis of the heartbeat carried out in step b) and / or the instructions of step d) depending on said identification.

[0072] Thanks to the identification system 50, the interventions made by the driving assistance device 2 are able to distinguish between novice and experienced drivers and thus are best suited to the driver. Furthermore, the driving assistance device 2 prefers to send the warning A in a preferred format depending on the driver's sensitivity to a certain format of warning A rather than other formats. For example, the driving assistance device does not send a visual warning to a farsighted driver. It sends a warning in a composite format with a certain urgency to an elderly driver, whereas it sends a warning in a single format to an experienced driver.

[0073] According to the same principle, by means of the identification system 50, the advice C sent by the driving assistance device 2 is more or less prescriptive and the form in which it is sent is also adapted to the driver. The driving assistance I is also activated more or less rapidly depending on the driver at the steering wheel.

[0074] Furthermore, by the identification system 50 the parameters defining the cardiac deceleration (threshold and duration) are adapted depending on the identified driver so as to increase the accuracy of the analysis of step b) by the processing unit 40 .

[0075] As a result, thanks to the device 1 according to the invention, with or without improvements, it is known whether the driver correctly perceives the danger and it is possible to design appropriate safety solutions. Furthermore, thanks to the device according to the invention, the driving assistance device 2 intervenes with the driver not only according to the danger but also according to the driver at the wheel and his cardiac reaction, so that the vehicle cabin is not polluted with untimely or inappropriate warnings or advice for the situation and the driver. The driving assistance device 2 thereby improves the driver's tolerance.

[0076] The invention also relates to a method for analysing a vehicle driver's risk perception, as shown in FIG.

[0077] According to the method of the present invention, the following steps are performed: - measuring the driver's heart rate FC (represented by block E1 in FIG. 4 ); - receiving an indication D of a danger present in the vicinity of the vehicle (represented by block E2 in FIG. 4), - analyzing the measured heart rate FC of the driver over a time interval starting from the reception of the indication D (represented by block E3 of FIG. 4 ); - determining whether or not a danger is perceived by the driver depending on whether the analyzed driver's heart rate includes or does not include a deceleration phase within said time interval (represented by block E4 of FIG. 4); The following will be implemented.

[0078] The device 1 according to the invention is for example designed to implement the method according to the invention, the step of receiving the indication D corresponding to the above-mentioned step a), the step of analysing the driver's heart rate corresponding to the above-mentioned step b) and the step of determining whether the driver has perceived a danger corresponding to the above-mentioned step c).

[0079] As shown in Fig. 4, upon receipt of the indication D by the processing unit 40 of the device 1 (block E2 in Fig. 4), measurements of the driver's instantaneous heart rate FC(t) are collected (block E1 in Fig. 4) and an analysis of the driver's heart rate is carried out (block E3 in Fig. 4). To do this, the processing unit 40 establishes the moment when the indication D is received as an initial moment t = 0s and calculates the heart rate variation ΔFC(t) from the driver's instantaneous heart rate FC(t) and a reference heart rate FCref. Depending on this analysis, the processing unit 40 decides whether the driver has perceived a danger (block E4 in Fig. 4).

[0080] Once this decision has been made, the processing unit 40 can optionally (this is shown in dashed lines in FIG. 4) perform the aforementioned step d) represented by block E5 in FIG. 4. As a consequence, the processing unit 40 can possibly command the driving assistance device 2 to intervene with the driver (block E5 in FIG. 4). This optional step (block E5) corresponds to the aforementioned step d). The command of interventions A, C, I by the processing unit 40 includes both sending a warning A and / or advice C and not sending said warning A and / or advice (for example by muting them) or imposing or not imposing a driving assistance I on the driver. This optional step (block E5) is performed both when the processing unit 40 determines in the decision step (block E4) that the driver has perceived a danger (yes) and when it determines that the driver has not perceived a danger (no).

[0081] Of course, various other modifications can be made to the invention within the scope of the appended claims.

Claims

1. A device (1) for analyzing a vehicle driver's risk perception, comprising: a heartbeat sensor (10) designed to measure the driver's heartbeat (FC) over time (t); a processing unit (40), a) receiving an indication (D) of a danger present in the vicinity of the vehicle; b) analysing the driver's heart rate (FC) measured by said heart rate sensor (10) over a time interval starting upon receipt of said indication (D) by said processing unit; c) determining whether a danger is perceived by the driver depending on whether the driver's heart rate analyzed in step b) includes or does not include a deceleration phase within said time interval; a processing unit (40) designed to An apparatus (1) comprising:

2. 2. The device (1) according to claim 1, wherein in step b), the analyzed heartbeat (FC) is the heartbeat (FC) of the time interval during which the measurement is made, starting from the reception of the indication (D) and having a duration between 1 second and 5 seconds.

3. 3. The device (1) according to claim 1 or 2, further comprising an eye sensor (30) designed to detect the direction in which the driver is looking, and wherein the processing unit (40) determines in step c) that a danger is perceived by the driver if the driver's heart rate analysed in step b) comprises a deceleration phase and further if the driver is looking towards the driving field.

4. 4. The device (1) according to claim 1, further comprising a breathing sensor (20) for sensing the breathing of the driver, designed to measure the breathing rate of the driver, and wherein the processing unit (40) is designed to correct the heart rate of the driver analysed in step b) depending on the measured breathing rate.

5. 5. The device (1) according to claim 1, wherein the processing unit (40) determines that the driver's heart rate comprises a deceleration phase if the analysis of the heart rate in step b) indicates that the variability (ΔF C ) of the driver's heart rate at a moment t has a value lower than the average of the values ​​adopted by the variability (ΔF C ) of the heart rate at two moments preceding said moment t.

6. 6. The device (1) according to claim 5, wherein the variability (ΔFC) of the driver's heart rate is calculated from a reference heart rate (FCref) selected from the driver's heart rate measured by the heart rate sensor at the moment the indication is received by the processing unit in step a) and an average heart rate of the driver measured by the heart rate sensor.

7. 7. The device (1) according to any one of claims 1 to 6, wherein the heart rate sensor (10) comprises a sensor for sensing electrical activity of the heart or a sensor for sensing mechanical activity of the heart, the heart rate sensor (10) being arranged on the steering wheel and / or on the driver's seat and / or on the driver's seat belt and / or remote from the driver.

8. The processing unit (40) d) commanding a driving assistance device (2) installed in the vehicle to intervene with the driver depending on at least one of the following factors: the driver's perception or lack of perception of the danger determined in step c), the moment the danger is perceived by the driver, the duration of a possible heart rate deceleration phase analyzed in step b), the amplitude of a possible heart rate deceleration phase analyzed in step b), 8. An apparatus (1) according to any one of claims 1 to 7, designed to:

9. 9. The apparatus (1) of claim 8, further comprising a driving assistance device (2), wherein the indication received by the processing unit in step a) is transmitted by the driving assistance device (2).

10. 10. The device (1) according to claim 8 or 9, wherein the processing unit (40) is further designed to identify the driver and to customize the analysis of the heart rate performed in step b) depending on said identification.

11. The apparatus (1) according to claim 10, wherein the processing unit (40) is further designed to customize the instructions in step d) in response to the identification.

12. A method for analyzing the risk perception of a vehicle driver, according to which the method comprises the following steps: - said heart rate sensor (10) measuring the driver's heart rate (FC); - said processing unit (40) receiving an indication (D) of a danger present in the vicinity of the vehicle; - said processing unit (40) analysing the measured driver's heart rate (FC) over a time interval starting from the reception of said indication (D) of danger; - said processing unit (40) deciding whether or not a danger is perceived by the driver depending on whether the analyzed driver's heart rate includes or does not include a deceleration phase within said time interval; A method for implementing the above.

Citation Information

Patent Citations

  • Information presentation apparatus

    CN107428299A

  • Information presenting device for vehicle

    JP1999245683A

  • Drive supporting information providing device and method

    JP2006040119A

  • Doze detector

    JP2009018091A

  • Sleep onset determination system

    JP2010273752A