Method and device for controlling the attention of a vehicle driver

Abstract

The present invention relates to a method and a device for controlling the attention of a driver of a vehicle. For this purpose, first data representative of an interior and exterior environment of the vehicle are received (41). A value representative of a state of highway hypnosis of the driver is predicted (42) by feeding a hypnosis score prediction model with the first data. Second data representative of a set of actions to be implemented to prevent the state of hypnosis are determined (43) as a function of the value. A set of on-board systems of the vehicle is controlled (44) as a function of the second data for an implementation of the set of actions. Figure for abstract: Figure 4

Description

Title of the invention: Method and device for monitoring the attention of a vehicle driver Technical field

[0001] The present invention relates to methods and devices for controlling the attention of a driver of a vehicle, in particular but not exclusively a motor vehicle. The present invention also relates to a method and a device for predicting a hypnosis or highway trance score of the driver. The present invention also relates to a method and a device for controlling a set of on-board systems of a vehicle to prevent a risk of hypnosis or highway trance. Technological background

[0002] The phenomenon of highway hypnosis, also known as "highway trance", refers to a state of inattention that can occur during long journeys in a vehicle, mainly on highways. This phenomenon is most evident during monotonous journeys with long straight stretches during which uniform and repetitive landscapes follow one another. In such conditions, a driver is likely to temporarily lose awareness of the environment in which he is traveling, to feel hypnotized by the road and lose contact with the reality present around him. Rather than concentrating on the road, the driver's mind wanders and the driver's attention and alertness are greatly reduced, which represents a danger to the driver of the vehicle and any passengers, as well as to all road users.

[0003] Methods for detecting a state of highway trance of a driver are known and based for example on the analysis of a gaze model, such as the method described in the document “Research on recognition of road hypnosis in the typical monotonous scene”, by Huili Shi et al., published on February 3, 2023, or based on electrocardiograms and electromyograms of the driver, such as in the method described in the document “A recognition method for road hypnosis based on physiological characteristics”, by Bin Wang et al., published on March 23, 2023.

[0004] Such methods, however, require specific equipment with invasive measurements of the driver's physiological characteristics, which may hinder driver acceptance for the implementation of hypnosis or highway trance state monitoring. Summary of the present invention

[0005] An object of the present invention is to solve at least one of the problems of the technological background described above.

[0006] Another object of the present invention is to improve the prevention of risks associated with a state of highway hypnosis of a vehicle driver.

[0007] According to a first aspect, the present invention relates to a method for controlling the attention of a driver of a vehicle, the method being implemented by at least one processor embedded in the vehicle, the method comprising the following steps: - receiving first data representative of an interior environment and an exterior environment of the vehicle from a set of devices embedded in the vehicle; - prediction of a value representative of a state of highway hypnosis of the driver from a highway hypnosis score prediction model fed by the first data; - determination of second data representative of a set of actions to be implemented to prevent the state of highway hypnosis depending on the value; and - control of a set of on-board systems of the vehicle according to the second data for an implementation of the set of actions, the set of on-board systems comprising a human-machine interaction system by voice synthesis.

[0008] Such a method makes it possible to determine a score representing the level of hypnosis or highway trance of the driver of a vehicle from data from the interior and exterior environment of the vehicle, that is to say without requiring the measurement of physiological characteristics of the driver by sensors or methods deemed too invasive. Determining the score via a determined model, for example implementing a set of determined rules, makes it possible to select or determine a set of actions to be implemented by one or more on-board systems of the vehicle to reduce or prevent the state of highway hypnosis.

[0009] This thus increases the safety of the driver and his vehicle.

[0010] According to a variant, the set of devices on board the vehicle comprises at least one of the following devices: - a microphone arranged in a vehicle compartment; - a camera configured to acquire images of the external environment located in front of the vehicle in the direction of travel of the vehicle; - a seat occupancy detection sensor; - an air conditioning system for a vehicle passenger compartment; - an on-board navigation system; - a multimedia system; - a driving control device; - a clock.

[0011] According to another variant, the set of on-board systems further comprises at least one of the following systems: - a driving assistance system, known as the AD AS system; - a multimedia system; - an air conditioning system for a vehicle passenger compartment; - a motorized seat adjustment system; - a display system comprising at least one display device.

[0012] According to another variant, the set of actions comprises an action corresponding to a generation of a set of questions determined from third data representative of an experience of the driver in the vehicle obtained from at least part of the set of on-board systems and / or from at least one wireless communication device connected in communication to the vehicle, the set of questions being rendered by voice synthesis to the driver via a conversational agent on board the vehicle.

[0013] According to an additional variant, the method further comprises a step of receiving fourth data representative of a road environment in which the vehicle is traveling from a navigation system on board the vehicle, the prediction step only being implemented when the fourth data are representative of a motorway environment and when a driving time in the road environment is greater than a determined threshold.

[0014] According to an additional variant, the prediction model implements a set of determined rules for predicting the value.

[0015] According to another variant, the method further comprises a step of adjusting a set of parameters of the set of determined prediction rules as a function of fifth data representative of driver reactions detected following the implementation of the set of actions.

[0016] According to a second aspect, the present invention relates to a device for controlling the attention of a driver of a vehicle, the device comprising a memory associated with a processor configured for implementing the steps of the method according to the first aspect of the present invention.

[0017] According to a third aspect, the present invention relates to a vehicle, for example of the automobile type, comprising a device as described above according to the second aspect of the present invention.

[0018] According to a fourth aspect, the present invention relates to a computer program which comprises instructions adapted for executing the steps of the method according to the first aspect of the present invention, in particular when the computer program is executed by at least one processor.

[0019] Such a computer program may use any programming language, and be in the form of source code, object code, or intermediate code between source code and object code, such as in a partially compiled form, or in any other desirable form.

[0020] According to a fifth aspect, the present invention relates to a computer-readable recording medium on which is recorded a computer program comprising instructions for carrying out the steps of the method according to the first aspect of the present invention.

[0021] On the one hand, the recording medium may be any entity or device capable of storing the program. For example, the medium may comprise a storage means, such as a ROM memory, a CD-ROM or a microelectronic circuit type ROM memory, or a magnetic recording means or a hard disk.

[0022] Furthermore, this recording medium may also be a transmissible medium such as an electrical or optical signal, such a signal being able to be conveyed via an electrical or optical cable, by conventional or hertzian radio or by self-directed laser beam or by other means. The computer program according to the present invention may in particular be downloaded from an Internet-type network.

[0023] Alternatively, the recording medium may be an integrated circuit in which the computer program is incorporated, the integrated circuit being adapted to perform or to be used in performing the method in question. Brief description of the figures

[0024] Other characteristics and advantages of the present invention will emerge from the description of the particular and non-limiting exemplary embodiments of the present invention below, with reference to the appended figures 1 to 4, in which:

[0025] [Fig-1] schematically illustrates the front part of a vehicle passenger compartment, according to a particular and non-limiting example of embodiment of the present invention;

[0026] [Fig.2] illustrates a flowchart of the different operations of a process of attention control of a driver of the vehicle of [Fig.l], according to a first particular and non-limiting exemplary embodiment of the present invention;

[0027] [Fig.3] schematically illustrates a device configured for attention control of the driver of the vehicle of [Fig.l], according to a particular and non-limiting exemplary embodiment of the present invention;

[0028] [Fig.4] illustrates a flowchart of the different stages of a control process attention of a driver of the vehicle of [Fig.l], according to a particular and non-limiting exemplary embodiment of the present invention. Description of examples of implementation

[0029] A method and a device for controlling the attention of a driver of a vehicle will now be described in the following with joint reference to Figures 1 to 4. The same elements are identified with the same reference signs throughout the description which follows.

[0030] The terms "first(s)", "second(s)" (or "first(s)", "second(s)"), etc. are used in this document by arbitrary convention to enable different elements (such as operations, means, etc.) implemented in the embodiments described below to be identified and distinguished. Such elements may be distinct or correspond to a single element, depending on the embodiment.

[0031] According to a particular and non-limiting example of embodiment of the present invention, the control of the attention of a driver of a vehicle is for example implemented by one or more computers of the vehicle, for example via one or more processors. The control of the attention of the driver advantageously comprises the determination of a value or a score representing the level or state of highway hypnosis in which the driver is, such a value being for example between 0 and 1 (with 0 corresponding to a maximum level of attention, that is to say that the driver is vigilant and is not in a state of highway hypnosis, and 1 corresponding to a minimum level of attention, that is to say that the driver is in a maximum state or level of highway hypnosis).Such a value is determined or predicted by feeding a previously generated prediction model with first data representative of the interior and exterior environment of the vehicle, these first data being received from devices embedded in the vehicle (for example a camera whose field of vision is oriented towards the exterior of the vehicle for the acquisition of images of the scene in front of the vehicle, one or more microphones arranged in the passenger compartment of the vehicle, seat occupancy detection sensors, a navigation system, a multimedia system, etc.). The value representing the level of highway hypnosis is used to determine second data representative of a set of actions to be implemented to prevent or reduce the level of highway hypnosis, these actions having for example been decided beforehand.A set of on-board vehicle systems including at least one human-machine interaction system using voice synthesis is controlled by the computer(s), for example via the transmission of requests or instructions, for the implementation of the set of actions.

[0032] [Fig.l] schematically illustrates a part of the passenger compartment of a vehicle 10, according to a particular and non-limiting exemplary embodiment of the present invention.

[0033] The vehicle 10 corresponds for example to a vehicle with a thermal engine, with electric motor(s) or even a hybrid vehicle with a thermal engine and a or several electric motors. The vehicle 10 thus corresponds, for example, to a land vehicle comprising a passenger compartment or at least equipped with a display screen, for example an automobile, a truck, a bus, a motorcycle.

[0034] The vehicle 10 advantageously carries one or more cameras 18 configured for the acquisition of image data of the environment of the vehicle 10, in particular the external environment of the vehicle 10.

[0035] The vehicle 10 for example carries a camera 18, called a front camera. Such a camera 18 is advantageously arranged in the passenger compartment of the vehicle 10 under the windshield and at the top and in the middle of this windshield. Such a front camera 18 has a field of vision corresponding to the space located in front of the vehicle 10 according to the direction of travel of the vehicle 10.

[0036] The camera 18 comprises for example the following elements: - a photosensitive sensor corresponding for example to a matrix of photoreceptors associated for example with a Bayer filter; - an optical assembly arranged in front of the sensor with respect to the scene to be acquired by the sensor, the optical assembly comprising for example an arrangement of one or more lenses; and - optionally one or more calculators associated with memory and configured for processing images acquired by the sensor.

[0037] According to another example, the vehicle 10 has a camera arranged at the level of the front grille or at the level of the front bumper, such a camera having in its field of vision the portion of road passing in front of the vehicle 10. Such a camera is for example used for the detection and recognition of road markings (lines drawn on the road).

[0038] The vehicle 10 for example furthermore carries one or more microphones 17 each configured for the acquisition of sound data, for example speech, occurring in the interior environment of the vehicle 10, i.e. in the passenger compartment of the vehicle 10.

[0039] The camera(s) and / or the microphone(s) belong to a set of devices for acquiring or obtaining first data representative of the external and internal environment of the vehicle 10.

[0040] The first data received or obtained via the camera 18 are thus representative of one or more images, these first data corresponding for example to data representative of a matrix of pixels, color values ​​being for example associated with each pixel, for example according to one or more color channels; for example, the pixel data are coded in the form of RGB values ​​(from the English “Red, Green, Blue” or “Red, green, blue” in French).

[0041] The first data received or obtained from the microphone(s) 17 are represented signals of sounds appearing in the passenger compartment of the vehicle 10, these first data corresponding for example to digital data obtained from an analog-digital converter converting the analog data acquired by the microphone(s) 17. Such data are representative of any sound content perceived in the interior environment of the vehicle 10, whether these sound contents come from inside the passenger compartment of the vehicle 10 (speech, music, etc.) or from outside the vehicle 10 (for example traffic noise, noise generated by the rolling of tires on the road, engine noise, the noise of natural events such as rain, thunder, etc.)

[0042] The vehicle 10 further includes a display system comprising one or more display devices. The display device(s) correspond, for example, to one or more of the following display devices, in any combination: - one or more screens such as for example a screen 13 with a touch interface and a computer configured to control the display of content(s) of a graphical HMI on the touch screen 13; and / or - a display screen 12 corresponding for example to a transparent or semi-transparent blade 12, for example arranged on top of the dashboard 11 in front of the windshield of the electric vehicle 10. The transparent blade 12 is for example arranged behind the steering wheel 14, according to the point of view of a driver installed in the driver's seat 15, in such a way that the driver sees the content displayed or projected on the transparent blade 12 when the driver is driving the electric vehicle 10. The transparent blade 12 thus corresponds to an element of a device or system called a head-up display. Such a display system comprises for example one or more projectors integrated for example in the dashboard 11.Such a system for projecting images or graphic content corresponds, for example, to a so-called augmented reality system, called AR (from the English "Augmented Reality"), for example a Head-Up Display system, called VTH or HUD (from the English "Head Up Display" or in French "Display Head High"), which allows the incrustation of virtual objects in the driver's field of vision by projecting the images onto the blade 12, so as to superimpose the virtual objects of the projected images on the real road scene. The projection of the images of the graphic object is for example controlled by one or more computers of the on-board system of the vehicle 10, for example by the IVI computer. The connection between the computer and the head-up display device corresponds, for example, to a connection of the LVDS type (from the English "Low Voltage Differential Signaling" or in French "Low Voltage Differential Transmission"); and / or. - a display screen called a cluster or dashboard and generally arranged in an area 141 behind the steering wheel in the dashboard 11; and / or - an arrangement of LEDs comprising for example several LEDs arranged in the form of a matrix of LEDs and / or in the form of one or more lines or strips of LEDs; and / or - one or more projectors configured to project one or more images or visual content onto a surface, for example onto a part of the windshield, onto the dashboard 11, onto the ceiling of the passenger compartment of the vehicle 10, etc.

[0043] The vehicle 10 for example furthermore has one or more loudspeakers 16 arranged in the passenger compartment, for example at the front and rear of the passenger compartment for rendering sound content with any sound effect using the spatial distribution of the loudspeakers in the passenger compartment of the vehicle 10.

[0044] The loudspeakers 16 belong to an audio and / or multimedia system of the vehicle 10 configured for the rendering of sound content, for example music or ambient sound.

[0045] An audio system on board a vehicle comprises for example: - a head unit, generally placed on the dashboard; a head unit combines several functions, such as controlling the overall volume of the system and controlling different audio sources in a vehicle: car radio, multimedia player such as an MP3 player or a smartphone (or in French "intelligent telephone"), USB reader (from the English "Universal Serial Bus" or "Universal Serial Bus" in French), data storage device integrated into the audio system, etc.; control is advantageously carried out via a user interface, for example via a touch screen and / or by issuing voice commands; - an audio amplifier corresponding to an electronic amplifier configured to amplify an audio electrical signal in order to obtain sufficient power to vibrate one or more loudspeakers and generate sounds corresponding to the audio or sound signal to be reproduced; and - the speaker(s) 16.

[0046] the audio system of the vehicle 10 is configured to render any type of audio or sound content, for example content received by radio waves, content received in a continuous broadcast mode, audio content recorded in a memory in any known coding format, content generated by algorithmic composition (such content being called algorithmic music, generative music or procedural music), content composed from a set of audio samples (called "samples" in English) by assembly or composition of these samples (or "sampling" in English), content generated by voice synthesis, for example by a conversational agent (or "chatbot" in English).

[0047] The computers controlling the display system(s) (such as the computer of the infotainment system, called IVI calculator (from the English “In-Vehicle Info-tainment” or in French “Infodivertissement monté”)), the audio system and / or the device(s) for acquiring the first data form for example a multiplexed architecture for the realization of different services useful for the proper functioning of the vehicle and for the generation of a visual (in particular luminous) and / or sound ambiance in the vehicle 10.The computers communicate and exchange data with each other via one or more computer buses, for example a communication bus of the data bus type CAN (from the English "Controller Area Network" or in French "Réseau de contrôles"), CAN FD (from the English "Controller Area Network Flexible Data-Rate" or in French "Réseau de contrôles à débit de données flexible"), FlexRay (according to the ISO 17458 standard), LIN (from the English "Local Interconnect Network" or in French "Réseau interconnecté local") or Ethernet (according to the ISO / IEC 802-3 standard).

[0048] The vehicle 10 also incorporates, for example, a set of driving assistance systems, called AD AS systems (from the English “Advanced Driver-Assistance System” or in French “Advanced Driving Assistance System”).

[0049] The AD AS system(s) on board the vehicle 10 correspond for example to one or more of the AD AS systems in the following list, this list being non-exhaustive and provided for illustration purposes: - navigation and geolocation system, also called GNSS system (Geolocation and Navigation by a Satellite System), for example a GPS type system (from the English "Global Positioning System" or in French "Geo-positioning system by satellites"), for example a GPS type system (from the English "Global Positioning System" or in French "Geo-positioning system by satellites") or Galileo, a navigation system being configured to calculate a route based on start and end of journey data, to generate guidance instructions to assist the driver in following the journey, such guidance instructions being for example displayed on one or more screens of the display system of the vehicle 10, as known to those skilled in the art; - a cruise control system, for example an adaptive cruise control system, known as an ACC system (from the English “Adaptive Cruise Control”); - a lane keeping assistance system, known as the LKA system (from the English “Lane Keeping Assist”); - an involuntary lane departure warning system, known as the AFIL system; and / or - a road marking detection and recognition system.

[0050] A process of attention control (or monitoring of the state of attention or the state of hypnosis) of a driver of the vehicle 10 is advantageously implemented by one or more devices on board the vehicle 10, for example by one or several calculators of the on-board network of the vehicle 10. Examples of implementation of such a process are described with regard to [Fig.2] below.

[0051] [Fig.2] illustrates a flowchart of the different operations of a process for controlling or monitoring the attention or state of hypnosis of a driver of the vehicle 10, according to particular and non-limiting exemplary embodiments of the present invention.

[0052] In an operation 201, data, called fourth data, representative of the road environment in which the vehicle 10 is traveling are received. This data is for example received from the navigation system of the vehicle 10. The fourth data is for example representative of a type of road on which the vehicle 10 is traveling at any time, the type of road being for example obtained from mapping data used by the navigation system as a function of the geographical position of the vehicle 10 obtained from the receiver of the GNSS system.

[0053] According to an alternative embodiment, these fourth data are received from the camera 18.

[0054] In an operation 202, the fourth data are analyzed to determine in which road environment the vehicle 10 is traveling, for example depending on the type of road.

[0055] When the fourth data are representative of a motorway environment (the vehicle 10 traveling on a motorway), the duration of the journey on the motorway is determined and compared to a threshold. The duration is for example calculated via a clock or a counter of the vehicle, the measurement of the duration starting when the computer detects that the vehicle 10 is traveling on a motorway.

[0056] The threshold corresponds for example to a determined parameter of the system and the value of which is fixed or frozen. According to a variant, the value of the threshold is an adjustable parameter, for example by the driver of the vehicle 10 via a human-machine interface (HMI).

[0057] When the result of the comparison indicates that the vehicle 10 is traveling on a highway for a duration exceeding the threshold value (for example for more than 1, 2 or 3 hours), then the process continues with operation 203. Otherwise, the process loops back with operations 201 and 202 as long as the duration of the journey on a highway is less than the threshold.

[0058] According to an alternative embodiment, only the criterion relating to a journey on a motorway is taken into account for the implementation of operations 203 and following, without duration criterion.

[0059] In an operation 203, the computer in charge of the process monitors and analyzes the first data received, that is to say the data representative of the interior and exterior environment of the vehicle 10 obtained from a set of on-board devices including for example one or more of the following devices: - one or more microphones 17 arranged in a passenger compartment of the vehicle 10 to monitor the sounds perceived in the passenger compartment; - one or more cameras 18 configured for acquiring images of the external environment located in front of the vehicle 10 according to a direction of travel of the vehicle; - a seat occupancy detection sensor, for example one sensor per seat, to determine the number of occupants in the vehicle 10 (for example to determine whether the driver is alone or accompanied by one or more passengers in the vehicle 10); - an air conditioning system to obtain the temperature in the passenger compartment; - an on-board navigation system; - a multimedia system; - driving control sensors, devices or systems such as a steering wheel angle sensor, a steering wheel pressure sensor, steering wheel buttons, steering wheel control levers, etc.; - a clock.

[0060] In an operation 204, a value (or a score) representing the state or level of highway hypnosis of the driver is predicted by feeding one or more prediction models with the first data. The prediction model(s) 213 comprise for example a set of rules generated to determine the score, these rules or the parameters of the model(s) having been defined in a learning or design phase of the driver attention control system.

[0061] These rules or model parameters are for example stored in a memory of the computer implementing the process.

[0062] Some examples of rules for predicting a highway hypnosis score and the associated score are provided as illustrative examples in the list below; this list is not exhaustive: - Rule 1: vehicle 10 is traveling on a highway AND the road is straight and monotonous for a duration greater than a threshold (for example equal to 20 min), the associated score being 0.8 when the conditions of rule 1 are met; - Rule 2: vehicle 10 is traveling on a highway AND there is more than one passenger in the car AND no conversation detected for a duration greater than a threshold (for example equal to 30 min), the associated score being 0.9 when the conditions of rule 2 are met; - Rule 3: Vehicle 10 is traveling on a highway AND the road is essentially straight for a distance greater than a threshold (e.g. 10 km) AND no music or radio playing in the cabin, the associated score being 0.95 when the conditions of rule 3 are met; - Rule 4: Vehicle 10 is traveling on a highway AND the time associated with the journey is one hour after lunch AND the road is essentially straight for a distance greater than a threshold (e.g. 10 km) AND no music or radio is playing in the cabin, the associated score being 0.95 when the conditions of Rule 4 are met; and - Rule 5: vehicle 10 is traveling on a highway AND no action on the steering wheel or a button on the steering wheel has been detected for a duration greater than a threshold (for example equal to 30 min) AND there is more than one passenger in the car AND no conversation detected for a duration greater than a threshold (for example equal to 30 min), the associated score being greater than 0.95 when the conditions of rule 5 are met.

[0063] The rules and / or prediction models are for example defined and generated according to feedback, for example from drivers who have experienced motorway hypnosis.

[0064] According to another example, the rules and / or the prediction models are learned according to any machine learning method in a learning phase from learning data, the learning method being supervised or unsupervised.

[0065] In an optional operation 205, the score is compared to a determined threshold, which corresponds to a fixed or adjustable parameter of the driver attention control system.

[0066] When the result of the comparison indicates that the score is greater than the threshold, the process continues with operation 206.

[0067] When the result of the comparison indicates that the score is lower than the threshold, the process continues with operation 211.

[0068] In an operation 211, it is checked whether the attention control function or the highway hypnosis state is active or not. When it is not active, the process loops back to operation 203. When it is active, this function is deactivated at operation 212 and the process ends.

[0069] In an operation 206, the driver's highway hypnosis state is confirmed with the value or score representing the hypnosis level determined in operation 204.

[0070] In an operation 207, second data representative of a set of actions to be implemented to prevent the highway trance state are determined as a function of the value or score predicted in operation 204.

[0071] One or more actions are for example associated with different levels of highway hypnosis, each level corresponding to an interval of values.

[0072] For example, the first level of highway hypnosis corresponding to the lowest level presenting a risk for the driver, the vehicle 10 and the other road users corresponds to an interval of values ​​between 0.7 and 0.8 for example. Thus, when a value predicted at operation 204 is included in this interval, the set of actions to be implemented corresponds to the set of actions associated with this first level. The second level of highway hypnosis corresponding to the level higher than the first level with an increased risk for the driver, the vehicle 10 and the other road users corresponds to an interval of values ​​between 0.8 and 0.85 for example. The third level higher than the second level corresponds to an interval of values ​​between 0.85 and 0.9 for example and the fourth level higher than the third level corresponds to an interval of values ​​between 0.9 and 1 for example.The number of levels is not limited to this example but extends to any number, for example 3, 5, 7 or 10 levels.

[0073] Each level of highway hypnosis is associated with a set of actions to be implemented and the on-board system(s) or device(s) of the vehicle 10 to be controlled for the implementation of this set of actions. Each action is for example defined by a set of parameters and / or instructions intended for the system to be controlled to implement this action.

[0074] The correspondence between the hypnosis levels and the second data representative of the actions and the identifiers of the systems to be controlled for their implementation are for example stored in the memory of the vehicle 10 in one or more correspondence tables, called LUT (from the English “Look-Up Table”).

[0075] The actions are for example defined during a design phase of the driver attention control system, for example empirically with test and validation phases.

[0076] According to another example, the actions are generated automatically by implementing a so-called artificial intelligence method, for example by machine learning implemented by a neural network.

[0077] Some examples of association between different levels of hypnosis, the associated actions to be implemented and the system(s) to be controlled for their implementation are provided below by way of illustration, in a non-exhaustive manner.

[0078] For a first level of hypnosis corresponding to the interval of values ​​[0.7; 0.8[, the action to be implemented corresponds to the initiation of a dialogue with the driver by voice synthesis of questions for example, such as: "Hello David, it seems that the journey is long, can I start your list of favorite songs?" or "Would you like me to start your favorite podcast?". The on-board system to be controlled for the implementation of the action corresponds to a system for generating dialogue by voice synthesis, for example a conversational agent associated with a voice synthesis system.

[0079] For a second level of hypnosis corresponding to the value interval [0.8; 0.85[, the actions to be implemented begin with the action of the first level, then if the hypnosis value determined following the implementation of the action of the first level remains within the value interval [0.8; 0.85[, the following action is initiated: implementation of a game based on anecdotes determined by analysis of the driver's experience in the vehicle over a determined period preceding the determination of the hypnosis value, the game consisting of asking the driver questions relating to these anecdotes (for example which cities were crossed during the journey, the people the driver called on the telephone, etc.). The systems to be controlled once again comprise a system for generating dialogue by voice synthesis, for example a conversational agent associated with a voice synthesis system.The systems or devices queried to obtain the anecdotes include, for example, the driver's smartphone, the vehicle's navigation system, a set of mobile applications in the vehicle or phone, etc.

[0080] For a third level of hypnosis corresponding to the value interval [0.85; 0.9[, the actions to be implemented begin with the action of the first level followed by the action of the second level, then if the hypnosis value determined following the implementation of the action of the second level remains within the value interval [0.85; 0.9[, the following actions are initiated: recommendation to deactivate the ACC system and encourage the driver to regain control of the vehicle on the vehicle 10 was until then in a semi-autonomous mode, reduction of the temperature in the passenger compartment and adjustment of the driver's seat to straighten the backrest. The associated systems for the implementation include for example the systems of the actions of the first level and the second level to which are added the air conditioning system and the driver's seat adjustment system.

[0081] For a fourth level of hypnosis corresponding to the value interval [0.9; 1], the actions to be implemented begin with the action of the first level followed by the action of the second level, followed by the actions of the third level, then if the hypnosis value determined following the implementation of the action of the second level remains within the value interval [0.9; 1], the following actions are initiated: determining a route to reach the nearest rest area and asking a question such as "Would you like to call someone close to you?". The associated systems for implementation include, for example, the systems of the actions of the first level and the second level, to which the on-board telephone system is added.

[0082] Other actions include for example: - the display of graphic content on one or more screens and / or the projection of augmented reality content in the driver's field of vision; - the generation of haptic effects, for example the generation of vibrations in the driver's seat or in the steering wheel with haptic actuators provided for this purpose; - the generation of light animation via LED strips provided in the passenger compartment; - etc.

[0083] In an operation 208, the system(s) associated with the hypnosis level(s) corresponding to the predicted hypnosis value(s) are controlled so as to implement the associated action(s).

[0084] The control of a system comprises for example the transmission of instructions (comprising for example a set of control parameters) by the computer implementing the process to the computer in charge of the on-board system to be controlled via one or more data buses.

[0085] The sequence of actions to be implemented depends on the driver's responses and / or reactions to the action(s) implemented. Thus, the computer monitors the driver's activity (for example, responses to questions asked) to determine whether the driver's hypnosis level must again be determined as described with regard to operations 203 to 207.

[0086] In an operation 209, the parameters of the rules and / or prediction models are refined according to the different responses or reactions of the driver to the different actions implemented in operation 208.

[0087] Finally, in an operation 210, the driver attention control function is deactivated when all of the actions have been implemented, the last action corresponding for example to guiding the vehicle 10 towards a rest area with stopping of the vehicle 10.

[0088] [Fig. 3] schematically illustrates a device 3 configured for controlling the attention of a driver of a vehicle, for example of the vehicle 10, according to a particular and non-limiting exemplary embodiment of the present invention. The device 3 corresponds for example to a device on board the vehicle 10, for example a computer, or to a device or unit of a mobile communication device.

[0089] The device 3 is for example configured for the implementation of the operations described with regard to figures 1 to 2 and / or the steps of the method described with regard to [Fig.4]. Examples of such a device 3 include, but are not limited to, on-board electronic equipment such as an on-board computer of a vehicle, an electronic calculator such as an ECU (“Electronic Control Unit”), a smartphone, a tablet, a laptop. The elements of the device 3, individually or in combination, can be integrated into a single circuit integrated, in several integrated circuits, and / or in discrete components. The device 3 can be produced in the form of electronic circuits or software (or computer) modules or even a combination of electronic circuits and software modules.

[0090] The device 3 comprises one (or more) processor(s) 30 configured to execute instructions for carrying out the steps of the method and / or for executing the instructions of the software(s) embedded in the device 3. The processor 30 may include integrated memory, an input / output interface, and various circuits known to those skilled in the art. The device 3 further comprises at least one memory 31 corresponding for example to a volatile and / or non-volatile memory and / or comprises a memory storage device which may comprise volatile and / or non-volatile memory, such as EEPROM, ROM, PROM, RAM, DRAM, SRAM, flash, magnetic or optical disk.

[0091] The computer code of the embedded software(s) comprising the instructions to be loaded and executed by the processor is for example stored in the memory 31.

[0092] According to various particular and non-limiting embodiments, the device 3 is coupled in communication with other similar devices or systems and / or with communication devices, for example a TCU (from the English “Telematic Control Unit” or in French “Telematic Control Unit”), for example via a communication bus or through dedicated input / output ports.

[0093] According to a particular and non-limiting exemplary embodiment, the device 3 comprises a block 32 of interface elements for communicating with external devices. The interface elements of the block 32 comprise one or more of the following interfaces: - RF radio frequency interface, for example Wi-Fi® type (according to IEEE 802.11), for example in the 2.4 or 5 GHz frequency bands, or Bluetooth® type (according to IEEE 802.15.1), in the 2.4 GHz frequency band, or Sigfox type using UBN (Ultra Narrow Band) radio technology, or LoRa in the 868 MHz frequency band, LTE (Long-Term Evolution), LTE-Advanced; - USB interface (from the English “Universal Serial Bus” or “Universal Serial Bus” in French); - HDMI interface (from the English “High Definition Multimedia Interface” or “High Definition Multimedia Interface” in French); - LIN interface (from the English “Local Interconnect Network”).

[0094] According to another particular and non-limiting exemplary embodiment, the device 3 comprises a communication interface 33 which makes it possible to establish communication with other devices (such as other computers of the on-board system) via a communication channel 330. The communication interface 33 corresponds for example to a transmitter configured to transmit and receive information and / or data via the communication channel 330. The communication interface 33 corresponds for example to a wired network of the CAN (Controller Area Network) type, CAN FD (Controller Area Network Flexible Data-Rate), FlexRay (standardized by the ISO 17458 standard) or Ethernet (standardized by the ISO / IEC 802-3 standard).

[0095] According to a particular and non-limiting exemplary embodiment, the device 3 can provide output signals to one or more external devices, such as a display screen 340, touch-sensitive or not, one or more speakers 350 and / or other peripherals 360 (projection system) via output interfaces 34, 35 and 36 respectively. According to a variant, one or other of the external devices is integrated into the device 3.

[0096] [Fig.4] illustrates a flowchart of the different steps of a method for controlling the attention of a driver of a vehicle, for example of the vehicle 10, according to a particular and non-limiting exemplary embodiment of the present invention. The method is for example implemented by a device on board the vehicle 10 or by the device 3 of [Fig.3].

[0097] In a first step 41, first data representative of an interior environment and an exterior environment of the vehicle are received from a set of devices on board the vehicle.

[0098] In a second step 42, a value representative of a state of highway hypnosis of the driver is predicted from a highway hypnosis score prediction model supplied by the first data.

[0099] In a third step 43, second data representative of a set of actions to be implemented to prevent the highway trance state are determined as a function of the value.

[0100] In a fourth step 44, a set of on-board systems of the vehicle is controlled according to the second data for an implementation of the set of actions, the set of on-board systems comprising a human-machine interaction system by voice synthesis.

[0101] According to a variant, the variants and examples of the operations described in relation to one of figures 1 and 2 apply to the steps of the method of [Fig.4].

Claims

Claims

1. Method for controlling the attention of a driver of a vehicle (10), said method being implemented by at least one processor embedded in said vehicle (10), said method comprising the following steps: - receiving (41) first data representative of an interior environment and an exterior environment of the vehicle (10) from a set of devices (17, 18) embedded in said vehicle (10); - predicting (42) a value representative of a state of highway hypnosis of the driver from a highway hypnosis score prediction model supplied by said first data; - determining (43) second data representative of a set of actions to be implemented to prevent said state of highway hypnosis as a function of said value;and - control (44) of a set of on-board systems of said vehicle as a function of said second data for an implementation of said set of actions, said set of on-board systems comprising a human-machine interaction system by voice synthesis.;

2. Method according to claim 1, for which the set of devices on board said vehicle comprises at least one of the following devices: - a microphone (17) arranged in a passenger compartment of said vehicle (10); - a camera (18) configured for acquiring images of said external environment located in front of said vehicle (10) according to a direction of travel of said vehicle (10); - a seat occupancy detection sensor (15); - an air conditioning system for a passenger compartment of the vehicle (10); - an on-board navigation system; - a multimedia system; - a driving control device of the vehicle (10); - a clock.

3. Method according to claim 1, for which said set of on-board systems further comprises at least one of the following systems: - a driving assistance system, called AD AS system; - a multimedia system; - an air conditioning system for a passenger compartment of the vehicle (10); - a motorized seat adjustment system; - a display system comprising at least one display device (12, 13).

4. Method according to one of claims 1 to 3, for which said set of actions comprises an action corresponding to a generation of a set of questions determined from third data representative of an experience of said driver in said vehicle (10) obtained from at least part of said set of on-board systems and / or at least one wireless communication device connected in communication to said vehicle, said set of questions being rendered by voice synthesis to said driver via a conversational agent on board said vehicle (10).

5. Method according to one of claims 1, further comprising a step of receiving fourth data representative of a road environment in which said vehicle (10) is traveling from a navigation system on board the vehicle (10), said prediction step only being implemented when said fourth data are representative of a motorway environment and when a driving time in said road environment is greater than a determined threshold.

6. Method according to one of claims 1 to 5, for which said prediction model implements a set of determined rules for predicting said value.

7. Method according to claim 6, further comprising a step of adjusting a set of parameters of said set of determined prediction rules as a function of fifth data representative of reactions of said driver detected following the implementation of said set of actions.

8. Computer program comprising instructions for implementing the method according to any one of the preceding claims, when these instructions are executed by a processor.

9. Device (3) for controlling the attention of a driver of a vehicle, said device (3) comprising a memory (31) associated with at least one processor (30) configured for implementing the steps of the method according to any one of claims 1 to 7.

10. Vehicle (10) comprising the device (3) according to claim 9.

Images