DEVICE FOR ANALYZING A VEHICLE DRIVER'S PERCEPTION OF INFORMATION AND ASSOCIATED METHOD

Abstract

Title: DEVICE FOR ANALYZING A VEHICLE DRIVER'S PERCEPTION OF INFORMATION AND ASSOCIATED METHOD A system for analyzing a driver's perception of a situation present in a vehicle's environment, comprising: At least one physiological sensor, At least one sensory sensor, At least one environmental sensor, A processing unit arranged to: Receive environmental data, Analyze the physiological data within a time interval beginning upon receipt of the environmental data, Analyze the sensory data to identify whether one of the driver's senses is oriented towards the situation, Determine whether the situation has been perceived by the driver based on whether the physiological data includes a deceleration phase and whether at least one of the driver's senses is oriented towards the situation within the same time interval, Control the emission of a signal by a driver assistance device.being a function of the driver's perception of the situation and the environmental data. Abbreviated figure: Fig. 1,

Description

Title of the invention: DEVICE FOR ANALYZING THE PERCEPTION OF INFORMATION BY A VEHICLE DRIVER AND ASSOCIATED METHOD

[0001] The present invention relates to the technical field of driver assistance in a vehicle. More specifically, it relates to a device for analyzing a driver's perception of information and an associated method.

[0002] Currently, it is difficult to know whether a driver has perceived information from their environment. It is possible for a driver to look in the direction of relevant information without perceiving it (which may not necessarily be a hazard), for example, a pedestrian walking on the sidewalk near a crosswalk, a vehicle parking in front of them, a traffic sign, etc. It is also possible for the driver not to look in the direction of this information, or not to have their attention on it, and therefore not to perceive it. In such cases, it may be necessary to draw the driver's attention to this relevant information without disrupting their driving.

[0003] It is also possible that the driver will perceive this relevant information. In this case, it is unnecessary, and may even be counterproductive, to alert them to said information. In any case, if the alert is given when it is not necessary, or if it is necessary to attract the driver's attention but is not appropriate (too long, too intrusive, etc.), then this risks leading to the driver rejecting the alert, either not perceiving it or preferring to deactivate it.

[0004] The present invention aims to provide a driving assistance device that is more relevant and more adapted to the environment in which the vehicle is traveling and to the driver himself and his driving.

[0005] The invention relates to a system for analyzing the perception of a situation present in the environment of a vehicle, by a driver, the system comprising: - At least one physiological sensor arranged to provide physiological data from the driver, - At least one sensor arranged to provide sensory data representative of at least one of the driver's senses, - At least one environmental sensor arranged to detect the situation in the vehicle's environment and provide environmental data representative of said situation present in the vehicle's environment, - A processing unit arranged to: • Receive environmental data, • Analyze the driver's physiological data within a time interval beginning upon receipt of the environmental data, • Analyze the sensory data, particularly data representative of at least one of the driver's senses, to identify whether at least one of the driver's senses is oriented towards the situation present in the environment detected by the environmental sensor. • Determine whether the situation detected by the environmental sensor was perceived by the driver based on whether the driver's physiological data includes a deceleration phase within said time interval and whether at least one of the driver's senses is oriented towards the situation present in the environment within the same time interval, • To control the emission of a signal by a driving assistance device, said signal being a function of the driver's perception of the situation detected by the environmental sensor and of the environmental data.

[0006] In the present invention, the situation present in the environment of the vehicle is a situation that takes place in the environment, for example the approach of a road sign, a pedestrian walking on the sidewalk, a speed bump on the road...

[0007] The physiological data is representative of the heart rate provided by a heart rate sensor and / or the respiratory rate provided by the respiratory rate sensor.

[0008] In one aspect of the invention, the physiological sensor includes a respiratory rate sensor or a heart rate sensor arranged to provide physiological data representative of the respiratory rate or heart rate of the driver.

[0009] In one aspect of the invention, the processing unit is arranged to receive said physiological data representative of heart rate and analyze whether said physiological data representative of heart rate in the time interval begins upon receipt of environmental data representative of the situation present in the environment.

[0010] In one aspect of the invention, the processing unit is arranged to receive said physiological data representative of respiratory rate and analyze whether said physiological data representative of respiratory rate in the time interval begins upon receipt of environmental data representative of the situation present in the environment.

[0011] In one aspect of the invention, the processing unit is arranged to determine whether the situation present in the environment detected by the environmental sensor has been perceived and taken into account by the driver on the basis of said physiological data, in particular heart rate and / or respiratory rate.

[0012] In one aspect of the invention, the processing unit is arranged to control the emission of a signal by the driver assistance device based on at least one of the following: - The perception, or lack thereof, of the situation, - The moment of perception of the situation, - The triggering moment of the deceleration phase of physiological data, particularly heart rate and / or respiratory rate, - The duration of the deceleration phase of physiological data, particularly heart rate and / or possibly respiratory rate, - The amplitude of any potential deceleration phase of physiological data, particularly heart rate and / or possibly respiratory rate, - The characteristics of the situation present in the environment detected by the environmental sensor.

[0013] In one aspect of the invention, when the situation present in the environment detected by the environmental sensor is perceived by the driver, the processing unit is arranged to prevent the emission of a signal by the driving assistance device or to silence said signal.

[0014] In one aspect of the invention, the situation present in the environment detected by the environmental sensor is not perceived by the driver: - When at least one of the driver's senses is oriented towards said situation but the physiological data, in particular heart rate and / or possibly respiratory rate, does not decelerate, - When neither of the driver's senses is directed towards said situation and the physiological data, in particular their heart rate and / or possibly their respiratory rate, does not decelerate, - when the physiological data, in particular the heart rate and / or possibly the respiratory rate, of the driver decelerates but none of the driver's senses are directed towards said situation present in the environment.

[0015] In one aspect of the invention, when the driver has not perceived the situation present in the environment detected by the environmental sensor, the driving assistance device is arranged to emit a signal aimed at making the driver perceive said situation, said signal being adapted to the situation detected by the environmental sensor, to the physiological data and to the sensory data provided by the sensory sensor.

[0016] In one aspect of the invention, the environmental data representing the information present in the environment is characterized by a type of situation generating said environmental data, for example a pedestrian walking on the sidewalk, a traffic sign, a speed bump... and the distance at which the vehicle's situation is located.

[0017] In one aspect of the invention, when the driver has perceived a situation other than the situation detected by the environmental sensor, in other words when the physiological data, in particular the heart rate provided by the heart rate sensor and / or possibly the respiratory rate provided by the respiratory rate sensor, decelerates but none of the driver's senses points towards the situation detected by at least one environmental sensor, the processing unit is arranged to identify the situation perceived by the driver and to control the emission of an appropriate signal by the driving assistance device.In this way, if the driver needs to quickly perceive the situation detected by the environmental sensor, the processing unit is arranged to control the emission of a signal with a higher frequency and / or intensity than in the case where the driver needs to perceive the situation detected by the environmental sensor less quickly, for example if it is preferable for the driver to finish what he is doing before paying attention to the situation detected by the environmental sensor.

[0018] In one aspect of the invention, the system comprises a plurality of environmental sensors, said sensors being arranged to provide at least one environmental data representative of information present in the environment of the vehicle, in particular in the interior environment of the vehicle, i.e. in the passenger compartment of the vehicle, or in the exterior environment of the vehicle, i.e. the environment in which the vehicle travels.

[0019] In one aspect of the invention, the driving assistance device is arranged to emit at least one sensory signal, in particular a signal selected from an auditory signal (for example, a beep), a visual signal, a haptic signal, or an olfactory signal. For example, it could be a sound signal in the form of sound pulses whose frequency and intensity depend on the elements mentioned above, or a sound signal consisting of a change in music. in the vehicle, or by activating a musical alert, increasing or decreasing the music volume, or by providing driving advice. It can be a visual signal, such as a light signal in the form of a pulse or flashing light whose intensity and frequency depend on the elements mentioned above, or a visual signal consisting of the emission of different colors in various elements of the passenger compartment, or a visual signal consisting of the representation of information in the vehicle as an avatar, or the display of driving advice on a display device, such as the dashboard. It can also be a haptic signal, such as vibrations in the steering wheel or seat, or a change in the temperature of the passenger compartment.This could be an olfactory signal, such as the emission of a stimulating odor or an odor related to the current situation in the environment detected by the environmental sensor.

[0020] By the fact that the processing unit "controls the emission of a signal by the driving assistance device", it is understood that it controls whether said driving assistance device should intervene with the driver or not, when it should intervene with the driver, how it should intervene (in what form) and for how long.

[0021] For example, the present invention makes it possible to provide a driver assistance device that is better suited to the driver's abilities. For example, if the driver has hearing impairments, the audible alarm is not prioritized, or the volume level or frequency of the alarm is carefully adjusted so that it is clearly heard and perceived by the driver in question. This allows for adaptive personalization of the assistance device according to the driver.

[0022] In one aspect of the invention, the physiological data analyzed, in the form of heart or respiratory rate, is that of the measurement time interval. For example, the measurement time interval has a duration of between 1 second and 5 seconds, preferably between 1 second and 3 seconds, from the receipt of the environmental data representative of the situation present in the environment detected by the environmental sensor.

[0023] In one aspect of the invention, the heart rate measurement is done by a radar present in the vehicle.

[0024] Alternatively, the heart rate measurement is done by an electrocardiograph sensor or a photo-plethysmograph sensor in contact with the skin such as for example a watch.

[0025] In one aspect of the invention, the heart rate is analyzed by cubic spline interpolation by the processing unit so as to measure a heart rate value every two milliseconds, which amounts to a frequency of 500 Hz.

[0026] In one aspect of the invention, the sensor includes an eye sensor adapted to detect the direction of the driver's gaze, and the processing unit is arranged to determine whether the situation detected by the environmental sensor is perceived by the driver, in other words whether the heart rate and / or possibly the respiratory rate of the driver analyzed by the processing unit includes a deceleration phase and whether, in addition, the driver's gaze is directed towards the situation detected by the environmental sensor.

[0027] In another example, the sensory sensor includes an auditory sensor arranged to detect the orientation of the driver's hearing and the processing unit is arranged to determine whether the situation detected by the environmental sensor is perceived by the driver, in other words whether the heart rate and / or possibly the respiratory rate of the driver analyzed by the processing unit includes a deceleration phase and whether, in addition, the driver's hearing is oriented towards the situation detected by the environmental sensor.

[0028] In one aspect of the invention, the processing unit determines that the driver's heart rate includes a deceleration phase when the heart rate analysis shows that the variation in the driver's heart rate at time t has a value lower than the average of the values ​​taken by the variation in heart rate at the two times preceding time t.

[0029] In one aspect of the invention, the variation in the driver's heart rate is calculated from a reference heart rate, chosen from: the driver's heart rate measured by the heart rate sensor at the moment when the environmental data is received by the processing unit, and an average heart rate of the driver measured by the heart rate sensor, the average heart rate of the driver preferably being measured outside of any perception of the situation in the vehicle's environment.

[0030] In one aspect of the invention, the processing unit determines that the driver's respiratory rate includes a deceleration phase when the respiratory rate analysis shows that the variation in the driver's respiratory rate at time t has a value lower than the average of the values ​​taken by the variation in respiratory rate at the two times preceding time t.

[0031] In one aspect of the invention, the driver's respiratory rate variation is calculated from a reference respiratory rate, chosen from: the driver's respiratory rate measured by the respiratory rate sensor at the moment when the environmental data is received by the processing unit, and an average respiratory rate of the driver measured by the respiratory rate sensor, the average respiratory rate of the driver preferably being measured outside of any perception of the situation in the vehicle's environment.

[0032] In one aspect of the invention, the processing unit is adapted to identify the driver and to personalize, according to said identification, the analysis of physiological data, in particular heart rate and / or respiratory rate.

[0033] In one aspect of the invention, the processing unit is arranged to personalize the control to the driver assistance device according to the driver identification.

[0034] In one aspect of the invention, the heart rate sensor comprises an electrical activity sensor in the form of one or more electrodes, placed directly in contact with the driver's skin, to record the electrical signal generated by cardiac activity. In this first example, the sensor is placed, for instance, on the steering wheel, where the driver places their hands on the steering wheel.

[0035] According to another example, the heart rate sensor includes a mechanical activity sensor in the form of a blood-flow camera or radar capable of recording the ballistic signal of the driver's cardiac activity, the ballistic signal being directly related to the mechanical activity generated by the heartbeats. In this second example, the heart rate sensor measures the heart rate through the driver's clothing, without needing to be in contact with the driver. The heart rate sensor can, for example, be placed in the driver's seat, behind the steering wheel (i.e., between the steering wheel and the windshield of the vehicle), in the driver's seatbelt, or a combination of these locations.

[0036] According to a third example, the heart rate sensor includes both an electrical activity sensor and a mechanical activity sensor (here ballistic), for example located on one or more of the places mentioned above.

[0037] In one aspect of the invention, the physiological sensor is arranged to continuously record physiological data over time.

[0038] In one aspect of the invention, the heart rate sensor is arranged to continuously record the driver's heart rate over time.

[0039] In one aspect of the invention, the respiratory rate sensor includes a mechanical activity sensor. The respiratory rate can be determined using radar and also using the mechanical respiratory sensor located in the seatbelt and / or seat so as to capture respiratory movements in contact with the driver. Using a camera, and optionally an accelerometer (placed in the seatbelt and / or seat), it is possible to distinguish the detection of a movement related to a change in posture from a movement related to breathing. The movement related to inhalation and the movement related to exhalation are not necessarily symmetrical in amplitude and time, this captured variability of movement makes it possible to detect a return of attention or vigilance.

[0040] For example, the system can be configured to perceive a situation consisting of the presence of a traffic sign in the environment. In this example: - At least one heart rate or respiratory rate sensor is arranged to provide representative physiological data on the driver's heart rate, - At least one sensor is arranged to provide sensory data representative of at least one of the driver's senses; this may include, in particular, an eye sensor arranged to provide sensory data representative of the driver's gaze. - At least one environmental sensor is arranged to detect the road sign in the vehicle's environment and provide environmental data representative of the presence of this road sign in the vehicle's environment, - A processing unit is arranged to: • Receive environmental data representative of the presence of the road sign in the driver's path, for example using GPS data or road sign detection, or using a sensor located outside the vehicle such as a LiDAR (whose acronym stands for "Light Detection And Ranging"), a distance sensor or a radar, • Analyze the representative physiological data of heart rate and / or possibly respiratory rate of the driver within a time interval beginning upon receipt of said environmental data, • Analyze the sensory data representative of at least one of the driver's senses, in this case the driver's gaze, to identify whether at least the driver's gaze is directed towards the road sign detected by the environmental sensor. • Determine whether the traffic sign detected by the environmental sensor was perceived by the driver based on whether the driver's heart rate and / or respiratory rate includes a deceleration phase within said time interval and whether the driver's gaze is directed towards the traffic sign detected by the environmental sensor within the same time interval, • To control the emission of a signal by a driving aid device, said signal being a function of the perception of the sign detected by the environmental sensor by the driver and of the environmental data representative of the presence of the traffic sign.

[0041] The processing unit is arranged to control the emission of a signal by the driving assistance device based on at least one of the following: - Whether or not the traffic sign is perceived, - The moment the traffic sign is perceived, - The starting point of the data deceleration phase physiological factors, including heart rate and / or possibly respiratory rate - The duration of the deceleration phase of physiological data, particularly heart rate and / or possibly respiratory rate, - The amplitude of any potential deceleration phase of physiological data, particularly heart rate and / or possibly respiratory rate, - The characteristics of the situation present in the environment detected by the environmental sensor, including the distance to the vehicle's traffic sign.

[0042] If the traffic sign detected by the environmental sensor is perceived by the driver, the processing unit is arranged to prevent the emission of a signal by the driving assistance device or to silence said signal.

[0043] If the driver has not perceived the sign detected by the environmental sensor, the driving assistance device is arranged to emit a signal aimed at making the driver perceive said sign, said signal being adapted to the situation detected by the environmental sensor, to the physiological data representative of the heart rate provided by the heart rate sensor and / or the physiological data representative of the respiratory rate provided by the respiratory rate sensor and to the sensory data provided by the sensory sensor.

[0044] For example, when the driver has perceived a situation other than the traffic sign detected by the environmental sensor, in particular a situation corresponding to a sick passenger in the vehicle, in other words when the physiological heart rate data provided by the heart rate sensor and / or possibly the representative physiological respiratory rate data provided by the respiratory rate sensor decelerates but no sense of the If the driver is not looking at the road sign, but rather at the sick passenger, the processing unit is configured to identify the situation perceived by the driver—namely, a sick passenger in the vehicle—and to trigger the driver assistance system to emit an appropriate signal. Thus, if the driver needs to quickly perceive the road sign detected by the environmental sensor, the processing unit is configured to emit a signal with a higher frequency and / or intensity than if the driver needs to perceive the road sign detected by the environmental sensor less quickly, for example, if it is preferable for the driver to finish what they are doing (e.g., helping the sick passenger) before focusing their attention on the road sign detected by the environmental sensor.

[0045] The invention further relates to a method for analyzing a driver's perception of a situation in the environment of a vehicle, according to which the following steps are planned: - Measurement of physiological data, including the driver's heart rate and / or respiratory rate, - Reception of sensory data representative of at least one of the driver's senses, - Detection of a situation present in the environment and reception of environmental data representative of said situation by a processing unit, - Analysis by a processing unit of physiological data, including heart and / or respiratory rate, of the driver measured over a time interval starting from the receipt of environmental data, - Analysis by the sensory data processing unit to determine if at least one of the driver's senses is focused on the situation, - Determination of the driver's perception based on whether the analyzed physiological data, including heart rate and / or respiratory rate, includes a deceleration phase within said time interval and whether at least one of the driver's senses is focused on the situation, - Control of signal emission based on the driver's perception of the situation and the detected situation.

[0046] According to one aspect of the invention, the method includes a step of emitting the signal by a driving aid device.

[0047] Other features and advantages of the present invention will become more apparent upon reading the following description, provided by way of illustration and not limitation, and the accompanying drawings in which:

[0048] [Fig. 1] Fig. 1 is a schematic representation of the perception analysis system according to the invention,

[0049] [Fig.2] Fig.2 is a schematic representation of the perception analysis method measured by the system according to the invention,

[0050] [Fig.3] Fig.3 is a graph representing the variation of heart rate over time as measured by the system according to the invention,

[0051] [Fig.4] Fig.4 represents a C3 curve and a C4 curve of heart rate variation of the driver, in a case of perception and a case of non-perception of the information.

[0052] Figure 1 schematically represents a vehicle 10 comprising a perception analysis system 100 for a situation present in the environment of this vehicle 10, as perceived by a driver 7. The situation present in the environment of the vehicle 10 is, for example, the approach of a road sign, a pedestrian walking on the sidewalk, a speed bump on the road...

[0053] In the case where the situation present in the environment of the vehicle 10 is an approach to a traffic sign 1, the system 100 includes an environmental sensor 2 arranged to detect the traffic sign 1 in the environment of the vehicle 10. The environmental sensor 2 is also arranged to provide an environmental data 20 representative of the presence of the traffic sign 1 in the environment of the vehicle 10, called traffic sign data.

[0054] The system 100 includes a physiological sensor 6 arranged to provide physiological data 60. The physiological sensor 6 is, for example, a heart rate sensor that provides physiological data 60 representative of the heart rate 3 of the driver 7, referred to as heart rate data. The heart rate sensor continuously records the heart rate 3 of the driver 7 over time.

[0055] The heart rate sensor includes an electrical activity sensor in the form of one or more electrodes, placed directly in contact with the skin of conductor 7, to record the electrical signal generated by cardiac activity.

[0056] The heart rate sensor is, for example, placed on the steering wheel, at the spot where the driver 7 places his hands on the steering wheel.

[0057] According to a second example, the heart rate sensor includes a mechanical activity sensor in the form of a blood flow camera or radar capable of recording the ballistic signal of the driver's cardiac activity 7. The ballistic signal is directly related to the mechanical activity generated by the heartbeats. The heart rate sensor measures the heart rate 3 through the driver's clothing 7, and without needing to be in contact with said clothing. driver 7. The heart rate sensor is for example placed in the driver's seat 7, behind the steering wheel (i.e. between the steering wheel and the windshield of the vehicle 10), in the driver's seatbelt 7, or a combination of these locations.

[0058] According to a third example, the heart rate sensor includes both an electrical activity sensor and a mechanical activity sensor, i.e. ballistic, for example, located on one or more of the places mentioned above.

[0059] According to a final example, the heart rate sensor is an electrocardiograph sensor or a photo-plethysmograph sensor in contact with the skin such as, for example, a watch.

[0060] Alternatively, the physiological sensor 6 is a respiratory rate sensor that provides physiological data 60 representative of the respiratory rate of the driver 7, referred to as respiratory rate data. The respiratory rate sensor continuously records the respiratory rate of the driver 7 over time. This respiratory sensor is used instead of, or in addition to, the heart rate sensor.

[0061] The respiratory rate sensor includes a radar or a mechanical respiratory sensor which is located in the belt and / or in the seat so as to capture respiratory movements in contact with the driver 7. Using a camera, or an accelerometer (placed in the belt and / or in the seat), it is possible to discriminate the capture of a movement related to a change of posture, from a movement related to breathing.

[0062] The system 100 also includes a sensory sensor 8 which is an eye sensor arranged to capture the gaze 4 of the driver 7 and to provide sensory data 80 representative of the gaze 4 of the driver 7, called gaze data.

[0063] Alternatively, system 100 includes an auditory sensor (not shown) arranged to detect the orientation of the driver's hearing 7.

[0064] The system 100 includes a processing unit 12 which is arranged to receive data from the traffic sign, for example using GPS data or by detecting the traffic sign 1.

[0065] Figure 2 shows that the processing unit 12 measures the heart rate 3 of the driver 7 (Step 11). It is possible, in this Step 11, for the processing unit 12 to measure the respiratory rate of the driver 7 by means of a respiratory rate sensor, instead of the heart rate, or in addition to the heart rate.

[0066] For example, the processing unit 12 is arranged to analyze the heart rate data 3 within a time interval that begins upon receipt of the data from the traffic sign. The heart rate 3 is analyzed by cubic spline interpolation by the processing unit 12 so as to measure a value heart rate 3 every two milliseconds, resulting in a frequency of 500 Hz.

[0067] The processing unit 12 is arranged to analyze the gaze data, to identify whether the gaze 4 of the driver 7 is directed towards the signpost 1. To do this, the processing unit 12 receives the gaze data (Step E2).

[0068] The processing unit 12 detects the traffic sign 1 and receives the data from the traffic sign (Step E3).

[0069] The processing unit 12 analyzes the heart rate 3 and / or respiratory rate of the driver 7 within a time interval that begins upon receipt of the data from the traffic sign. Furthermore, the processing unit 12 analyzes the gaze data to identify whether the driver 7's gaze 4 is directed towards the traffic sign 1 detected by the environmental sensor 2 (Step E4).

[0070] The processing unit 12 is arranged to determine whether the traffic sign 1 detected by the environmental sensor 2 has been perceived by the driver 7 depending on whether the heart rate 3 and / or the respiratory rate of the driver 7 includes a deceleration phase in said time interval and whether the gaze 4 of the driver 7 is directed towards the traffic sign 1 detected by the environmental sensor 2 in the same time interval.

[0071] The processing unit 12 is arranged to control the emission of a signal 18 by a driver assistance device 16 (Step E7, Step E8). The signal 18 is a function of the perception of the traffic sign 1 detected by the environmental sensor 2 by the driver 7 and the data from the traffic sign.

[0072] By the fact that the processing unit 12 "controls the emission of a signal 18 by the driving aid device 16", it is understood that it controls whether said driving aid device 16 should intervene with the driver 7 or not, when it should intervene with the driver 7, how it should intervene (in what form) and for how long.

[0073] The road sign 1 detected by the environmental sensor 2 is perceived by the driver 7 (Step E5) when the driver 7's gaze 4 is directed towards the road sign 1 and their heart rate 3 and / or respiratory rate decelerates (Step 40). In this case, the processing unit 12 is arranged to prevent the emission of the signal 18 by the driver assistance device 16 or to silence said signal 18 (Step E8).

[0074] The traffic sign 1 detected by the environmental sensor 2 is not perceived by the driver 7 (Step E6): - When the driver's gaze 4 is directed towards the sign 1 but their heart rate 3 and / or respiratory rate does not decelerate (Step 41), - When the driver's gaze 4 is not directed towards the sign 1 and their heart rate 3 and / or respiratory rate does not decelerate (Step 42), - when the heart rate 3 and / or respiratory rate of the driver 7 decelerates but the gaze 4 of the driver 7 is not directed towards the signpost present in the environment (Step 43).

[0075] If the driver 7 has not perceived the signpost 1 detected by the environmental sensor 2 (Step E6), the driving aid device 16 is arranged to emit the signal 18 (Step E9) which aims to make the said signpost 1 perceived by the driver 7. The signal 18 is adapted to the signpost 1 detected by the environmental sensor 2, to the heart rate data 3 and / or respiratory rate provided respectively by the heart rate sensor or the respiratory rate sensor and to the gaze data provided by the eye sensor.

[0076] If the driver 7 perceives a situation other than the traffic sign 1 detected by the environmental sensor 2 (Step 43), for example, a situation corresponding to a sick passenger in the vehicle 10. In other words, when the heart rate 3 and / or respiratory rate data provided respectively by the heart rate sensor or respiratory rate sensor decelerates, but the driver 7's gaze 4 is not directed towards the traffic sign 1, but rather, for example, towards the sick passenger (Step E43). In this case, the processing unit 12 is configured to identify the situation perceived by the driver 7, namely, in this case, a sick passenger in the vehicle 10, and to trigger the transmission of the appropriate signal 18 by the driver assistance device 16 (Step E7).

[0077] Processing unit 12 is configured to determine if:

[0078] - the driver can assist the sick passenger because the detection of the sign Signage 1 does not conclude that there is a significant or imminent danger, or

[0079] - the driver cannot immediately help the passenger because the sign detection signal 1 concludes that there is an imminent or urgent danger.

[0080] In this way, if the driver 7 needs to perceive the traffic sign 1 detected by the environmental sensor 2 quickly, the processing unit 12 is arranged to control the emission of the signal 18 (Step E7) whose frequency and / or intensity is higher than in the case where the driver 7 needs to perceive the traffic sign 1 detected by the environmental sensor 2 less quickly.

[0081] The driver assistance device 16 emits the signal (Step E9), which is audible in the form of sound pulses whose frequency and intensity depend on the elements mentioned above, or the audible signal 18, which consists of a change of music in the vehicle 10 or the activation of a musical alert or increasing or decreasing the volume of the music, or issuing driving advice.

[0082] The processing unit 12 is adapted to identify the driver 7 and to personalize, according to said identification, the analysis of the heart rate 3 and / or respiratory rate.

[0083] The processing unit 12 is arranged to personalize the control to the driving aid device 16 (Step E7, Step E8) according to the identification of the driver 7.

[0084] The graph shown in [Fig.3] shows, in the case of using a heart rate sensor, the variation of heart rate 3 in beats per minute (bpm), captured, as a function of time in seconds.

[0085] When an event, in our case a signpost 1, is detected by the vehicle 10 at time t=0, the heart rate 3 in question shows that the driver 7 has seen and processed the information attentively (perceived).

[0086] The heart rate 3 analyzed is that of the measurement time interval. The measurement time interval has, for example, a duration of between 1 second and 5 seconds, preferably between 1 second and 3 seconds from the reception of the data from the traffic sign detected by the environmental sensor 2.

[0087] A decrease in heart rate (DEC) can be observed at the beginning of the reactivity window. The same is true for the heart rate variation illustrated by curve C2. Within curve C1, we observe a significant increase in heart rate (INC1) compared to the increase in heart rate (INC2) in curve C2, following information processing. The significant increase in heart rate (INC1) illustrated in curve C1 indicates a person who is more surprised and stressed by the processed information than the person illustrated by curve C2.

[0088] The processing unit 12 determines that the heart rate 3 of driver 7 includes a deceleration phase when the analysis of heart rate 3 shows that the variation in heart rate 3 of driver 7 at a time t has a value lower than the average of the values ​​taken by the variation in heart rate 3 at the two times preceding time t.

[0089] The heart rate variation 3 of driver 7 is calculated from a reference heart rate 3, chosen from: the heart rate 3 of driver 7 measured by the heart rate sensor at the moment when the data from the traffic sign is received by the processing unit 12 and an average heart rate of driver 7 measured by the heart rate sensor, the average heart rate of driver 7 is measured outside of any perception of situation in the environment of the vehicle 10.

[0090] Fig. 3 thus shows a cardiac deceleration upon perception of an important stimulus.

[0091] Figure 4 shows a C3 curve and a C4 curve of heart rate variation 3 of driver 7. Curve C3 shows a deceleration of heart rate, which means that the individual is processing the information, whereas curve C4 does not show a decrease in heart rate, which means that the individual has not perceived the information and is therefore not processing it.

[0092] The control of the emission of signal 18 by the driving aid device 16 (Step E7) depends on the following elements: - Whether or not the traffic sign 1 is perceived, - The moment of perception of the traffic sign 1, - The triggering moment of the heart rate deceleration phase 3, - The duration of the heart rate deceleration phase 3, - The amplitude of the possible heart rate deceleration phase 3 - The characteristics of the situation present in the environment detected by the environmental sensor 2, in particular the distance to the signpost 1 from the vehicle 10.

Claims

1. Demands A perception analysis system (100) of a situation present in the environment of a vehicle (10), by a driver (7), the system (100) comprising: - At least one physiological sensor (6) arranged to provide physiological data (60) from the driver (7), - At least one sensory sensor (8) arranged to provide sensory data (80) representative of at least one sense of the driver (7), - At least one environmental sensor (2) arranged to detect the situation in the environment of the vehicle (10) and provide environmental data (20) representative of said situation present in the environment of the vehicle (10), - A processing unit (12) arranged for: • Receive environmental data (20), • Analyze the physiological data (60) of the driver (7) in a time interval starting from the reception of the environmental data (20), • Analyze the sensory data (80), in particular to identify whether at least one of the driver's senses (7) is oriented towards the situation present in the environment detected by the environmental sensor (2), • Determine whether the situation detected by the environmental sensor (2) was perceived by the driver (7) depending on whether the physiological data (60) includes a deceleration phase in said time interval and whether at least one sense of the driver (7) is oriented towards the situation present in the environment in the same time interval, • To control the emission of a signal (18) by a driver assistance device (16), said signal (18) being a function of the perception of the situation detected by the environmental sensor (2) by the driver (7) and environmental data (20).

2. System (100) according to claim 1, wherein the physiological sensor (6) comprises a respiratory rate sensor or a heart rate sensor arranged to provide physiological data (60) representative of the respiratory rate or heart rate (3) of the driver (7).

3. System (100) according to any one of the preceding claims, wherein the processing unit (12) is arranged to determine whether the situation present in the environment detected by the environmental sensor (2) has been perceived and taken into account by the driver (7) on the basis of said physiological data (60), in particular heart rate and / or respiratory rate.

4. System (100) according to any one of the preceding claims, wherein when the situation present in the environment detected by the environmental sensor (2) is perceived by the driver (7), the processing unit (12) is arranged to prevent the emission of the signal (18) by the driving assistance device (16) or to silence said signal (18).

5. System (100) according to any one of the preceding claims, wherein the situation present in the environment detected by the environmental sensor (2) is not perceived by the driver (7): - When at least one sense of the driver (7) is oriented towards said situation but the physiological data (60) does not decelerate, - when no sense of the driver (7) is oriented towards said situation and the physiological data (60) does not decelerate, - when the physiological data (60) decelerates but no sense of the driver (7) is oriented towards said situation present in the environment.

6. A system (100) according to the preceding claim, wherein when the driver (7) has not perceived the situation present in the environment detected by the environmental sensor (2), the driver assistance device (16) is arranged to emit the signal (18) intended to make the driver (7) perceive said situation, said signal (18) being adapted to the situation detected by the sensor environmental (2), physiological data (60) and sensory data (80) provided by the sensory sensor.

7. System (100) according to any one of the preceding claims, wherein the environmental data (20) is characterized by a type of situation generating said environmental data (20), for example a pedestrian walking on the sidewalk, a traffic sign (1), a speed bump and the distance to which the situation of the vehicle (10) is located.

8. System (100) according to any one of the preceding claims, wherein the physiological sensor (6) is arranged to record physiological data (60) continuously over time.

9. A method for analyzing the perception of a situation in the environment of a vehicle (10) by a driver (7) of a vehicle (10), wherein it is planned to implement the steps of: - Measurement (E1) of the physiological data (60) of the driver (7), - Reception (E2) of sensory data (80) representative of at least one sense of the driver (7), - Detection (E3) of a situation present in the environment and reception of environmental data (20) representative of said situation by a processing unit (12), - Analysis (E4) by the processing unit (12) of the physiological data (60) measured in a time interval beginning upon receipt of the environmental data (20), - Analysis (E4) by the processing unit (12) of the sensory data (80) to determine whether at least one sense of the driver (7) is focused on the situation, - Determination (E5,E6) of the perception by the driver (7) depending on whether the physiological data (60) of the driver (7) analyzed (E4) includes a deceleration phase in said time interval and whether at least one sense of the driver (7) is focused on the situation,

10. - Control (E7, E8) of the emission of a signal (18) according to the perception of the situation by the driver (7) and the detected situation. Method according to claim 9, comprising a step of emitting (E9) the signal (18) by a driving aid device (16).

Images