Method and device for processing driver training data for a vehicle
The method and device leverage vehicle sensors to assess and improve driving skills by analyzing driver behavior and environment, addressing the cost and reliability issues of traditional training methods, and offering personalized feedback for effective learning.
Patent Information
- Application Number
- FR2023005179
- Authority / Receiving Office
- FR · FR
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-25
- Publication Date
- 2024-11-29
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing vehicle driving training methods, including driving schools and driving simulators, are expensive and lack reliability in assessing a learner's driving level, with subjective evaluations by accompanying persons being common.
A method and device that utilize vehicle sensors to collect data on driver behavior and environment, determine driving situations, select target controls, evaluate driving levels, and provide feedback for learning improvement, using a system that includes GPS, obstacle detection, cameras, and communication with remote devices.
Provides a reliable and cost-effective tool for assessing driving skills and progress, offering personalized feedback and historical comparisons to enhance learning efficiency.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
Title of the invention: Method and device for processing driving learning data for a vehicle Technical field
[0001] The invention relates to a method and device for processing driver training data for a vehicle, particularly a car. The invention also relates to a method and device for teaching a user how to drive a vehicle. Technological background
[0002] Driver training is generally provided by driving schools. Certified instructors teach learner drivers the rules of the road and guide them through driving sessions to train them in real-life situations. They then analyze the learner's behavior in different driving situations and advise them so they can progress and become independent.
[0003] Such training courses are expensive, requiring the presence of an approved instructor and the use of a specific vehicle.
[0004] Other tools can be used to support a future driver in their learning, such as driving simulators. However, such a tool lacks realism compared to real-life driving situations.
[0005] To complement these training programs, learning methods such as supervised driving are also offered. This allows young people to gain experience and greater confidence behind the wheel before taking their driving test. There are three types of supervised driving: early driving apprenticeship (AAC), supervised driving, and guided driving.
[0006] Applications make it possible to automate certain tasks such as recording the different journeys made by the future driver, thanks in particular to satellite geopositioning, called GPS from the English "Global Positioning System" (in French: "Système mondial de emplacement" or "Géo-positionnement par satellite") of a smart phone (in English "smartphone").
[0007] However, supervised driving training has the disadvantage of not allowing a reliable assessment of the future driver's driving level, as the accompanying person sometimes has a subjective opinion and does not have the level of experience of an approved instructor. Summary of the present invention
[0008] An object of the present invention is to solve at least one of the problems of the technological background described above.
[0009] Another object of the present invention is to assist a user during a phase of learning to drive a vehicle using a reliable and inexpensive tool.
[0010] According to a first aspect, the invention relates to a method for processing driving learning data for a vehicle, the method comprising the following steps: - receiving initial data representing the behavior of a vehicle driver and second data representing the vehicle environment from a set of sensors onboard the vehicle; - determination of third data points representative of a driving situation based on the first and second data points; - selection of fourth data points representative of a set of target vehicle controls based on third data points; - determination of at least one first representative value of a level of conduct by comparing the first data with the fourth data; - determination of an evolution of a current driving level by comparing at least one first value to a set of second values representative of historical driving levels; - transmission of data representative of an assessment of a learning session based on at least one initial value and / or based on the evolution of a current driving level.
[0011] Such a method makes it possible to assess the driving level of a vehicle driver and / or to assess their progress in driving a vehicle.
[0012] According to one variant, the second representative values of historical driving levels are obtained from a step of identifying the vehicle driver.
[0013] The assessment of driving level and progress is then associated with a driver profile of the vehicle.
[0014] According to another variant, data representative of a set of instructions are transmitted to the driver according to the fourth data.
[0015] The instructions given to the driver allow the driver to receive guidance and progress during the learning process of driving the vehicle.
[0016] According to yet another variant, the first data belong to a first dataset comprising: - data representing vehicle speed control, - data representing vehicle trajectory control, - data representing driver attention, and - data representing driver visual checks.
[0017] According to yet another variant, the second set of data belongs to a second set of data comprising: - representative data for a type of road, - representative data of a ground marking, - representative data of a signal, and - representative data of the positions of other vehicles, users and / or obstacles.
[0018] According to a further variant, representative data of a summary of a learning session are transmitted to a remote device via a wireless connection.
[0019] This data from a learning session can then be stored and / or analyzed by an approved instructor.
[0020] According to another variant, the data representing an assessment of a learning session are rendered in the form of a graph.
[0021] A presentation of this data in graphical form allows a user to easily understand a level of conduct and its evolution.
[0022] According to a second aspect, the invention relates to a device for processing driving learning data for a vehicle, the device comprising a memory associated with at least one processor configured for the implementation of the steps of the process as described according to the first aspect of the invention.
[0023] According to a third aspect, the invention relates to a vehicle comprising a device as described above according to the second aspect of the invention.
[0024] According to a fourth aspect, the invention relates to a system comprising the vehicle as described above according to the third aspect of the invention and a remote device, for example a mobile communication device, connected to the vehicle via a wireless link.
[0025] According to a fifth aspect, the invention relates to a computer program which includes instructions adapted for the execution of the steps of the process according to the first aspect of the invention, in particular when the computer program is executed by at least one processor.
[0026] Such a computer program may use any programming language, and be in the form of source code, object code, or an intermediate code between source code and object code, such as in a partially compiled form, or in any other desirable form.
[0027] According to a sixth aspect, the invention relates to a computer-readable recording medium on which is recorded a computer program comprising instructions for carrying out the steps of the process according to the first aspect of the invention.
[0028] On the one hand, the recording medium can be any entity or device capable of storing the program. For example, the medium may include a means of storage, such as a ROM, CD-ROM or microelectronic circuit type ROM, or a magnetic recording medium or hard disk drive.
[0029] On the other hand, this recording medium can also be a transmissible medium such as an electrical or optical signal, such a signal being able to be transmitted via an electrical or optical cable, by conventional or radio frequency, by self-directing laser beam, or by other means. The computer program according to the invention can, in particular, be downloaded onto an Internet-type network.
[0030] Alternatively, the recording medium may be an integrated circuit in which the computer program is incorporated, the integrated circuit being adapted to execute or to be used in the execution of the process in question. Brief description of the figures
[0031] Other features and advantages of the invention will become apparent from the description of the non-limiting embodiments of the invention below, with reference to the attached Figures 1 to 4, in which:
[0032] [Fig-1] schematically illustrates a vehicle seen from above, according to an example of a a particular and non-limiting interpretation of the present invention, according to a particular embodiment of the present invention;
[0033] [Fig.2] schematically illustrates a vehicle driving learning data processing device of [Fig.1], according to a particular embodiment of the present invention;
[0034] [Fig.3] illustrates a flowchart of the different stages of processing driver training data for the vehicle of [Fig.1], according to a particular embodiment of the present invention; and
[0035] [Fig.4] schematically illustrates a passenger compartment of the vehicle of [Fig.1], according to a particular embodiment of the present invention. Description of the implementation methods
[0036] A method and device for processing driving learning data of a vehicle will now be described in what follows with joint reference to Figures 1 to 4. The same elements are identified with the same reference signs throughout the description that follows.
[0037] According to a particular and non-limiting example of an embodiment of the invention, a method for processing driving learning data for a vehicle includes a first step of receiving first data representing a driver's behavior of the vehicle and second data representing a vehicle environment from a set of sensors on board the vehicle.
[0038] Third data points representative of a driving situation are determined based on the first and second data points and the fourth data point representing a set of target vehicle controls are selected based on the third data point.
[0039] At least a first representative value of a driving level is determined by comparing the first data to the fourth data and an evolution of a current driving level is determined by comparing the at least a first value to a set of second values representative of historical driving levels.
[0040] Data representative of an assessment of a learning session are then transmitted according to at least one first value and / or according to the evolution of a current driving level.
[0041] Figure 1 schematically illustrates a vehicle 10 viewed from above, according to a particular and non-limiting embodiment of the present invention. In this example, the vehicle 10 corresponds to a vehicle with an internal combustion engine, with electric motor(s), or a hybrid vehicle with an internal combustion engine and one or more electric motors. The vehicle 10 thus corresponds, for example, to a land vehicle such as a car, a truck, a bus, or a motorcycle.
[0042] According to a particular embodiment, the vehicle 10 also carries a satellite geolocation system configured to determine the current position of the vehicle 10, the vehicle 10 carrying for this purpose a receiver of a system of the type GPS (from the English "Global Positioning System" or in French "Système mondial de emplacement") or Galileo for example in communication with a computer of the on-board system of the vehicle 10. According to a variant, the receiver of the geolocation system is embedded in a mobile communication device, such as a smart phone (from the English "Smartphone").According to this variant, the mobile communication device is connected in communication with the vehicle 10, for example wirelessly (via Bluetooth® or Wifi® for example) via a telematic control unit, called a TCU (from the English "Telematic Control Unit"), itself connected to one or more computers of the vehicle 10's on-board system. According to this variant, the vehicle 10 is able to determine its position or geographical location from data received from the mobile communication device.
[0043] The vehicle 10 carries one or more on-board systems, for example, an obstacle detection system, known as an ODS (Obstacle Detection System), of a vehicle. An ODS is advantageously configured to detect a set of obstacles in an area around the vehicle using a set of vehicle parking sensors, such as millimeter-wave radars located at the front of the vehicle, at the rear of the vehicle, and sometimes on the sides of the vehicle as well.
[0044] Such an ODS system is configured to indicate to the driver of the vehicle 10 the presence or absence of an obstacle or object around the vehicle. The presence of an object is indicated, for example, by a visual alert at the object's location relative to the vehicle, for example, by highlighting the detection zone around the vehicle. The presence of a detected obstacle is further indicated, for example, by a graphical representation of the object's distance from the vehicle.
[0045] The ODS system thus relies, for example, on data received from one or more sensors of the vehicle 10 configured for object detection, such as, for example: - one or more millimeter-wave radars arranged on the vehicle 10, for example at the front of the vehicle 10; each radar is adapted to emit electromagnetic waves and to receive the echoes of these waves reflected by one or more objects, in order to detect obstacles and their distances from the vehicle 10; and / or - one or more LIDAR(s) (from the English "Light Detection And Ranging", or "Detection and estimation of distance by light" in French), a LIDAR sensor corresponding to an optoelectronic system composed of a laser emitting device, a receiving device including a light collector (to collect the part of the light radiation emitted by the emitter and reflected by any object located on the path of the light rays emitted by the emitter) and a photodetector which transforms the collected light into an electrical signal; a LIDAR sensor thus makes it possible to detect the presence of objects located in the emitted light beam and to measure the distance between the sensor and each detected object.
[0046] According to another particular embodiment, the vehicle 10 further carries a camera 11b having in its field of vision a part of the external environment of the vehicle 10, for example the environment located in front of the vehicle 10 with reference to the direction of travel of the vehicle 10. The camera 11b corresponds for example to a windshield camera or to a camera mounted at the front of the vehicle 10, for example at the level of the front grille of the vehicle 10. According to a variant, the vehicle 10 is equipped with several cameras, for example, 2, 3 or 4 cameras (for example a camera 11c having in its field of vision the rear external environment of the vehicle 10 and a camera 11b having in its field of vision the front external environment of the vehicle 10 and / or side cameras 1la of the vehicle 10 having in their field of vision the left / right external environment of the vehicle 10).Each camera is configured to acquire data representative of the vehicle's external environment within its field of vision. These... The data correspond, for example, to the acquisition data from a grid of photosensitive sensors, such as grayscale data for each RGB color channel (Red, Green, Blue). These cameras 1la, 11b, 1le, or some of them, correspond, for example, to cameras of one or more vehicle driver assistance systems 10, known as ADAS (Advanced Driver-Assistance System).
[0047] According to a particular embodiment, the vehicle 10 also carries a radar 12 located at the front of the vehicle 10 to measure, for example, distances separating the vehicle 10 from other users or from obstacles located in an environment close to the vehicle 10.
[0048] The vehicle 10 also carries, for example, a computer 102 communicating with the vision systems and / or the ODS systems. According to a particular embodiment, the cameras 11a, 11b, 11c, the radar 12, and the computer 13 are advantageously connected via a wired network, for example, a CAN (Controller Area Network), CAN FD (Controller Area Network Flexible Data-Rate), FlexRay (according to ISO 17458), or Ethernet (according to ISO / IEC 802.3) type network. According to an alternative embodiment, the cameras 11a, 11b, 11e, and the radar 12 are connected via the wired network through the computer 102.
[0049] The vehicle 10 also carries, for example, a communication unit 103, corresponding to a communication box of the type telematic control unit TCU (from the English "Telematic Control Unit"), BTA box ("Autonomous Telematic Box") or BSRF box ("Radio Frequency Servicing Box"). Such a unit 103 is advantageously connected to one or more antennas to, for example, transmit and / or receive data to and / or from a remote device, for example a remote "cloud" server, or a mobile communication device, such as a smartphone or a tablet, via a wireless link, according to OTA (Over The Air) technology, for example.Wireless communication between vehicle 10 and the remote device is established, for example, via a network infrastructure comprising one or more relay antennas or base stations, or via a direct communication method (for example, when the mobile communication device is within a distance of vehicle 10 that allows for such a communication method, for example, a distance of less than 10, 20, or 50 m). The wireless link is based, for example, on one or more wireless communication protocols such as Bluetooth®, Wi-Fi® (based on IEEE 802.11), LTE (from . the English "Long-Term Evolution" or in French "Evolution à long terme"), LTE-Advanced (or in French LTE-avancé), 3GPP (from the English "3rd Generation Partnership Project" or in French "Projet de partenariat de 3ème génération") of fourth generation or fifth generation, called 3GPP 4G or 5G.
[0050] Fig. 4 illustrates a passenger compartment of the vehicle of Fig. 1, according to a particular embodiment of the present invention.
[0051] The vehicle's interior 10 includes, in particular, a steering wheel 41 equipped with two levers 42 arranged on either side of the steering wheel 4L. These levers 42 are also called stalks and control some of the devices fitted to the vehicle 10, such as the horn, turn signals, windshield wipers, and lights. The interior 4 also includes a set of pedals 43 controlling, for example, a clutch, one or more motors propelling the vehicle, or a braking system. All of these devices together constitute the controls of the vehicle 10.
[0052] A central rearview mirror is also located in the passenger compartment 4. According to one embodiment, the display screen 44a is connected to the rear camera 1, thus displaying the rear exterior environment of the vehicle 10.
[0053] The passenger compartment 4 also includes a dashboard incorporating various displays such as a central display 44b and a head-up display 44c. The display 44b is, for example, a touchscreen and integrated into the dashboard of the vehicle 10. The display 44b is, for example, an LCD (Liquid Crystal Display), a TFT (Thin-Film Transistor), or an OLED (Organic Light-Emitting Diode). The display 44b is, for example, arranged in the center of the dashboard, for example above a central panel. Of course, the position of the 44b display screen is not limited to this example; the 44b display screen can be arranged in any position, for example on the central front panel.
[0054] The display screen 44b allows content to be displayed for the driver and passengers of the vehicle 10. The screen 44b is also configured to allow the driver and / or passengers of the vehicle 10 to interact with one or more systems embedded in the vehicle via a human-machine interface (HMI) displayed on the screen. For example, the screen 44b allows control of the infotainment system, also called the IVI (In-Vehicle Infotainment) system of the vehicle 10, as well as, for example, the system in charge of processing driver learning data for a vehicle, as described in more detail with reference to [Fig. 3] below.
[0055] According to one embodiment, the display screen 44b is not integrated into the vehicle 10 but corresponds to a screen of a mobile communication device, such as a smartphone or tablet, connected in communication, for example wirelessly, with the vehicle's on-board system 10
[0056] Vehicle 10 also includes an audio system comprising, for example, speakers 45.
[0057] The driver of the vehicle 10 is seated in a seat 46, called the driver's seat.
[0058] The vehicle 10 also advantageously incorporates means for monitoring the direction or orientation of the driver's gaze or head. Such means advantageously correspond to a DMS, a DMS being a safety system responsible for monitoring the driver's attention. Such a system is known as a Driver Monitoring System (DMS) and is also called a driver attention monitor or driver fatigue alert system. This system monitors the driver's attention and alerts the driver when drowsiness or a decrease in attention is detected. The DMS includes one or more cameras 47 that detect the orientation of the driver's head and / or gaze to deduce whether the driver is attentive, i.e., whether they are looking in a given direction, and / or whether the driver is falling asleep by detecting eye closures or blinks.Such a DMS system is becoming standard equipment on an increasing number of vehicles and is tending to become widespread, with the European Commission also planning to mandate the integration of such a system in vehicles circulating in Europe.
[0059] The DMS 101 system includes, for example, one or more cameras 47 configured for acquiring data representative of the face of a passenger in the vehicle 10, for example, the driver sitting in the driver's seat 46, for example, images of the face, data relating to certain points on the face, data relating to certain parts of the face (for example, the eyes, eyelids). The camera(s) 47 correspond, for example, to one or more of the following acquisition devices: - infrared camera; - RGB type image acquisition camera (from the English "Red, Green, Blue" or in French "Rouge, vert, bleu"); - image acquisition camera associated with one or more devices (for example one or more LEDs (Light-Emitting Diode) emitting light in the infrared or near-infrared band.
[0060] The DMS 101 system implements a set of primary functions ensuring, for example, the tracking of the driver's gaze (from the English "gaze tracking"), the determination mination or the tracking of the driver's head posture (from the English "head pose" or "head gaze") and / or the tracking of the face (from the English "face tracking").
[0061] Such functions rely on data obtained from the camera(s) 47 for, for example: - detect eyes in the face and determine the direction associated with the driver's gaze (inattention detection); - determine the frequency of eyelid closure and the duration for which the eyelids are closed (drowsiness detection); - determine the posture of the head and thus determine in which direction the driver is looking: forward through the windscreen, towards a rearview mirror or laterally through the vehicle windows 10.
[0062] Figure 2 schematically illustrates a device for processing driving learning data for the vehicle of Figure 1, according to a particular embodiment of the present invention. Device 2 corresponds, for example, to a computer 102 of the electric vehicle 10.
[0063] Device 2 is, for example, configured to carry out the steps of the process described opposite [Fig. 3]. Examples of such a device 2 include, but are not limited to, embedded electronic equipment such as a vehicle's on-board computer, an electronic control unit such as an ECU (Electronic Control Unit), a smartphone, a tablet, or a laptop computer. The elements of device 2, individually or in combination, can be integrated into a single integrated circuit, into several integrated circuits, and / or into discrete components. Device 2 can be implemented in the form of electronic circuits or software (or computer) modules, or a combination of electronic circuits and software modules.
[0064] The device 2 comprises one (or more) processor(s) 20 configured to execute instructions for carrying out the steps of the process and / or for executing instructions from the software embedded in the device 2. The processor 20 may include integrated memory, an input / output interface, and various circuits known to those skilled in the art. The device 2 further comprises at least one memory 21, for example, volatile and / or non-volatile memory, and / or includes a memory storage device that may include volatile and / or non-volatile memory, such as EEPROM, ROM, PROM, RAM, DRAM, SRAM, flash, magnetic disk, or optical disk.
[0065] The computer code of the embedded software(s) including the instructions to be loaded and executed by the processor is for example stored on memory 21.
[0066] According to various specific embodiments, the device 2 is coupled in communication with other similar devices or systems and / or with devices communication, for example a TCU (from the English "Telematic Control Unit" or in French "Unité de Contrôle Télématique"), for example via a communication bus or through dedicated input / output ports.
[0067] According to a particular and non-limiting embodiment, the device 2 comprises a block 22 of interface elements for communicating with external devices, for example a remote server or the cloud, other nodes of the ad hoc network. The interface elements of the block 22 comprise one or more of the following interfaces - RF radio frequency interface, for example of type Bluetooth® or Wi-Fi®, LTE (from the English "Long-Term Evolution" or in French "Evolution à long terme"), LTE-Advanced (or in French LTE-avancé); - USB interface (from the English “Universal Serial Bus” or “Universal Serial Bus” in French); - HDMI interface (from the English "High Definition Multimedia Interface", or "High Definition Multimedia Interface" in French); - LIN interface (from the English "Local Interconnect Network", or in French "Réseau interconnecté local").
[0068] According to another particular embodiment, the device 2 includes a communication interface 23 which allows communication to be established with other devices (such as other computers of the embedded system) via a communication channel 230. The communication interface 23 corresponds, for example, to a transmitter configured to transmit and receive information and / or data via the communication channel 230. The communication interface 23 corresponds, for example, to a wired network of the CAN (Controller Area Network) type, CAN FD (Controller Area Network Flexible Data-Rate), FlexRay (standardized by ISO 17458) or Ethernet (standardized by ISO / IEC 802-3).
[0069] According to a further particular embodiment, the device 2 can provide output signals to one or more external devices, such as a display screen 240, one or more loudspeakers 250 and / or other peripherals 260 (projection system) via output interfaces 24, 25 and 26 respectively. According to a variant, one or more of the external devices is integrated into the device 2.
[0070] Figure 3 illustrates a flowchart of the different stages of a method for processing driver training data for the vehicle 10, according to a particular and non-limiting embodiment of the present invention. The method is advantageously implemented in the vehicle 10, for example implemented by device 2 of Figure 2.
[0071] In a first step 31, first data representing the behavior of a driver of the vehicle 10 and second data representing the environment of the vehicle 10 are received from a set of sensors on board the vehicle 10.
[0072] The first data belong to a first dataset comprising: - representative data from a vehicle speed check 10, - representative data of vehicle trajectory control 10, - representative data of driver attention in vehicle 10, and - representative data of visual checks by the driver of vehicle 10.
[0073] Data representative of a speed check of vehicle 10 are obtained, for example, from an odometer, from GPS data, or from sensors placed on the pedals 43 that the driver of vehicle 10 operates when he wishes to brake or accelerate. Such data correspond to speeds and accelerations.
[0074] Data representing a trajectory of the vehicle 10 are obtained for example from a sensor on the steering wheel 41 or on a steering kinematic chain, between the steering wheel and the steering wheels of the vehicle 10. Such data correspond to an angle or a turning radius.
[0075] Data representing attention and / or visual checks of the driver of vehicle 10 are obtained for example from the DMS system comprising for example one or more cameras 47.
[0076] According to a particular embodiment, other data belong to this first set of data such as the activation or deactivation of the right or left turn signals, the switching on or off of lights such as position lights, dipped headlights, main beam headlights, front or rear fog lights, the selection of a speed or the use of the horn.
[0077] The second set of data belongs to a second set of data comprising: - representative data for a type of road, - representative data of a ground marking, - representative data of a signal, and - representative data of the positions of other vehicles, users and / or obstacles
[0078] Representative data of a road type, road markings and / or signage are obtained, for example, from image processing from all cameras 1a, 11b, 1le. From these images, the vision system comprising all cameras determines, for example, a number of lanes, for example a single lane as on some country roads, one lane for each direction of traffic separated by a continuous or broken line, two lanes per direction of traffic separated by a continuous line or by a central reservation.
[0079] According to a particular embodiment, this data also represents types of intersections and their configurations, for example, an intersection without road markings indicating priority to the right, an intersection with a stop sign or a yield sign where vehicle 10 does not have priority and the associated road markings, or a roundabout. This second set of data includes, for example, distances separating vehicle 10 from a stopping point associated with a solid line marking a stop sign or a broken line defining a yield sign.
[0080] The second data includes, for example, information relating to previously encountered road signs, for example a sign indicating a priority road positioned upstream of an intersection, or a sign indicating an intersection with traffic lights positioned 50 meters or 150 meters before an intersection.
[0081] These second data are, according to another particular embodiment, obtained from a GPS system having a map including information relating to the type of road on which the vehicle 10 is traveling and the associated priority regimes.
[0082] The representative data of the positions of other vehicles, users and / or obstacles are obtained from images of a vision system comprising the set of cameras of the vehicle 10 or from the ODS system comprising a radar or a lidar.
[0083] For example, the second data includes information obtained by an ODS system relating to the position of another vehicle in the environment of vehicle 10. This data specifies, for example, the position of the other vehicle and its relative speed with respect to vehicle 10.
[0084] Thus, the first data represents a set of actions performed by the driver of vehicle 10 during a predetermined driving situation, while the second data represents the vehicle and its environment during the same period. This data is, for example, received from various sensors over a predetermined period, such as 5, 10, 20, or 30 seconds. This data is then stored in the memory of a vehicle learning data processing device for vehicle 10, for example, in memory 21 of device 2. This period is determined in such a way that the received data allows for the analysis of a driving situation from its beginning to its end.
[0085] In a step 32, third data representative of a driving situation are determined as a function of the first and second data.
[0086] Following a first example of a driving situation, the first data For example, vehicle 10 is approaching a right-of-way intersection in a built-up area at a speed of 45 km / h. Second data points indicate that a second vehicle is approaching the same intersection from a right-hand lane at a speed of 35 km / h. The driving situation determined by the driver learning data processing system 2 for vehicle 10 is as follows: the second vehicle is approaching the next intersection and will be present at that intersection at the same time as vehicle 10. Since the intersection is a right-of-way intersection, the second vehicle has priority.
[0087] Following a second example of a driving situation, the first data defines, for example, that vehicle 10 is traveling on a two-lane road in its direction of travel, for example, a motorway or a restricted-access road. Vehicle 10 is in the right-hand lane. The second data indicates that a second vehicle is traveling in front of vehicle 10 at a distance of 50 meters in the same lane as vehicle 10 and at a lower speed than vehicle 10. The driver of vehicle 10 is then preparing to overtake the second vehicle.
[0088] In step 33, fourth data points representing a set of target controls of the vehicle 10 are then selected based on the third data points. These data points come, for example, from a database, each set of target controls of the vehicle 10 being defined for a specific driving situation. The target controls performed in a specific sequence allow the driver of the vehicle 10 to approach a driving situation safely while complying with the rules of the road.
[0089] Following the first example of a driving situation, the fourth data points represent, for example, the following target controls: - visually check that a third vehicle is not following vehicle 10 too closely, i.e. at a distance less than a predetermined threshold, - gradually slow down until the vehicle comes to a complete stop 10 at a predetermined distance from the intersection, for example 1m or 2m, - to bring the vehicle to a complete stop for 10 minutes until the second vehicle has passed, - visually check that there are no more vehicles approaching the intersection from the right-hand lane before moving vehicle forward again 10.
[0090] Following the second example of a driving situation, the fourth data points represent, for example, the following target controls: - visually check that a third vehicle is not following vehicle 10 too closely, i.e. at a distance less than a predetermined threshold, and check a left-hand rearview mirror and a blind spot on the left side of vehicle 10, - maintain vehicle speed 10, - Activate the left indicator of vehicle 10, - Position vehicle 10 in the left lane, - Once the second vehicle has been passed, visually check that a sufficient distance separates vehicle 10 from the second vehicle and that there are no obstacles to the right of vehicle 10 or in a blind spot on the right side of vehicle 10. - turn off the left turn signal of vehicle 10 and activate the right turn signal of vehicle 10, - place vehicle 10 in the right lane, - turn off the right indicator of vehicle 10.
[0091] According to one embodiment, data representing a set of instructions are transmitted to the driver of the vehicle 10 based on the fourth set of data. These instructions are, for example, displayed on a screen 44a, 44b, 44c or announced via a voice message transmitted through the loudspeakers 45 of the audio system installed in the vehicle 10. These instructions allow, for example, the driver to be reminded of the actions he must take to safely navigate a previously defined driving situation.
[0092] In a step 34, at least a first representative value of a driving level is determined by comparing the first data with the fourth data.
[0093] Following the first example of a driving situation, a first representative value of a driving level of the driver of vehicle 10 is determined, for example, by comparing the actions performed by the driver when approaching the intersection, this information being contained in the first data point, with the target controls previously determined and contained in the fourth data point. Thus, for each target control, the driver's actions are compared: - validation of a visual check in the central rearview mirror or its screen 44a, - validation of an action on pedals 43 causing vehicle 10 to gradually slow down until vehicle 10 comes to a complete stop, - measurement of the distance between the stopping point of vehicle 10 and the intersection, - measurement of vehicle stopping time 10, - validation of a visual check through the right-hand windows of vehicle 10.
[0094] Following the second example of a driving situation, a second value representing the driving level of the driver of vehicle 10 is determined, for example, by comparing the actions performed by the driver to overtake the second vehicle, this information being contained in the first data point, with the target controls previously determined and contained in the fourth data point. Thus, for each target control, the driver's actions are compared: - validation of a visual check in the left-hand rearview mirror of vehicle 10 and in a blind spot on the left side of vehicle 10, - validation of an action on pedals 43 allowing the vehicle speed to be maintained 10, - action on the stalk 42 controlling the left turn signal of vehicle 10, - action on the steering wheel 41 to position vehicle 10 in the left lane, - once the second vehicle has been overtaken, validation of a visual check in the right-hand mirror of vehicle 10 and in a blind spot on the right side of vehicle 10, - measurement of the distance separating vehicle 10 from the second vehicle, - action on the switch 42 controlling the left and right indicators of vehicle 10, - action on the steering wheel 41 to place vehicle 10 in the right lane, - action on the switch 42 controlling the right indicator of vehicle 10.
[0095] According to a particular embodiment, points are awarded for each action performed in accordance with the selected target checks. The representative values of a driver's level of driving skill in vehicle 10 are, for example, determined as the number of points obtained by the driver of vehicle 10 relative to the total number of points he obtains if he performs all the checks according to the determined sequence.
[0096] According to another particular embodiment, the representative values of the driving level of a driver of vehicle 10 are for example determined as the number of points obtained by the driver of vehicle 10 weighted according to a level of importance or safety risk linked to each control in relation to the total number of points he obtains if he carries out all the controls according to the determined sequence.
[0097] According to a particular embodiment, the values representing a driving level of the vehicle driver 10 are categorized, and these values are thus determined for each driving situation encountered as: - intersection with priority to the right, - roundabout-type intersection, - exceeding, - parking maneuver, - obstacle avoidance.
[0098] In a step 35, an evolution of a current driving level is determined by comparing at least one first value to a set of second values representative of historical driving levels.
[0099] According to a particular embodiment, the set of second values represents historical driving levels obtained for any user of the vehicle 10. In the case where the user is always the same, the evolution then corresponds to the evolution of the driver's level of driving in vehicle 10.
[0100] According to another particular embodiment, for each driving session, a user profile is determined during a driver identification step for vehicle 10. Such an identification step is carried out, for example, at the beginning of the driving session, or during the driving session.
[0101] The second representative values of historical driving levels are then obtained from the driver identification step of vehicle 10. Thus, the second values represent the historical driving levels of the current driver of vehicle 10.
[0102] The value(s) representing the driving level of the driver of vehicle 10 are then compared to the values representing the historical driving levels of the driver of vehicle 10.
[0103] According to one embodiment, these comparisons are made by category.
[0104] The representative values of the driver's level of driving of vehicle 10 and / or its evolution, by category or overall, are then used in order to carry out an assessment of a learning session.
[0105] The representative data of a learning session assessment belong to a dataset comprising: - the progress made by the driver of vehicle 10, by category or in general, - driving situations that need to be reworked, - chapters of the highway code to review, - illustrations, comments and analyses of driving situations presenting an initial representative value of a driving level below a threshold.
[0106] Illustrations of driving situations presenting a first representative value of a driving level below a threshold are, for example, images from cameras lia, 11b, 11c equipping vehicle 10.
[0107] In a step 36, representative data from a learning session assessment are transmitted.
[0108] According to a particular embodiment, this data, representing the outcome of a learning session, is transmitted to the driver of the vehicle 10 in graphical form via the central screen 44b. Curves showing the evolution of initial values representing a driving level per session, for example for each category, are presented.
[0109] According to another particular embodiment, this data, representing the results of a learning session, is transmitted to a remote device via a wireless connection, for example via the communication unit 103. This transmission of the learning session results allows, for example, a monitor to receive and analyze this report, thus enabling him to put in place an appropriate educational program to work on the weaknesses of the driver of vehicle 10 during future driving lessons.
[0110] The vehicle 10 driving learning data processing method thus allows a driver of vehicle 10 to have a learning tool accompanying him during driving phases and thus enabling him to progress in the face of various driving situations.
[0111] Of course, the invention is not limited to the embodiments described above but extends to a method for processing driving learning data of a vehicle, and to the device configured for the implementation of such a method.
[0112] The invention also relates to a vehicle comprising the computer 102 or the device 2 of [Fig.2].
[0113] The invention also relates to a system comprising the vehicle 10 and the remote device connected wirelessly to the vehicle 10.
Claims
Claims
1. Method for processing driving learning data of a vehicle (10), said method comprising the following steps: - receiving (31) first data representative of a behavior of a driver of the vehicle (10) and second data representative of an environment of the vehicle (10) from a set of sensors on board the vehicle (10); - determining (32) third data representative of a driving situation as a function of said first and second data; - selecting (33) fourth data representative of a set of target controls of the vehicle (10) as a function of said third data; - determining (34) at least one first value representative of a driving level by comparing said first data with said fourth data;- determination (35) of an evolution of a current driving level by comparing said at least one first value to a set of second values representative of historical driving levels; - transmission (36) of data representative of a review of a learning session as a function of said at least one first value and / or as a function of said evolution of a current driving level.;
2. Method according to claim 1, for which said second values representative of historical driving levels are obtained from a step of identifying said driver of the vehicle (10).
3. Method according to one of claims 1 to 2, for which data representative of a set of instructions are transmitted to said driver of the vehicle (10) as a function of said fourth data.
4. Method according to one of claims 1 to 3, for which the first data belong to a first set of data comprising: - data representative of a control of a speed of the vehicle (10), - data representative of a control of a trajectory of the vehicle (10), - data representative of an attention of the driver of the vehicle (10), and - data representative of visual checks by the driver of the vehicle (10).
5. Method according to one of claims 1 to 4, for which the second data belong to a second set of data comprising: - data representative of a type of road, - data representative of a road marking, - data representative of a signage, and - data representative of positions of other vehicles, users and / or obstacles.
6. Method according to one of claims 1 to 5, for which the data representative of a report of a learning session are transmitted to a remote device via a wireless connection.
7. Method according to one of claims 1 to 6, for which the data representative of a balance sheet of a learning session are rendered in graphic form.
8. Device (2) for processing driving learning data of a vehicle (10), said device comprising a memory (21) associated with at least one processor (20) configured for implementing the steps of the method according to any one of claims 1 to 7.
9.
10. Vehicle (10) comprising the device according to claim 8. Computer program product comprising instructions adapted for executing the steps of the method according to one of claims 1 to 7, when the computer program is executed by at least one processor.
Citation Information
Patent Citations
Method for learning and checking driving behavior of a vehicle driver and vehicle
DE102017200149A1
Method and system for driver style monitoring and analysing
EP2312552A2
Automated road testing method
WO2021144611A1
