Method and device for controlling a vehicle image projection system with opacity adjustment

Abstract

The present invention relates to a method and device for controlling an image projection system for a vehicle equipped with one or more ADAS systems. To this end, initial data representing the activation of at least one ADAS system are received. A set of graphic objects (201, 202) is projected in augmented reality onto a glazed surface (17) of the vehicle with a degree of opacity determined by the initial data. The set of graphic objects (201, 202) is representative of at least one function implemented by the at least one ADAS system. The image projection system is configured to project a set of images representative of the set of graphic objects (201, 202), according to the degree of opacity, onto a glazed surface (17) of the vehicle within a field of vision corresponding to a driving position of the vehicle. Figure 2 (for the abstract)

Description

Title of the invention: Method and device for controlling a vehicle image projection system with opacity adjustment. Technical field

[0001] The invention relates to methods and devices for controlling an image projection system for a vehicle, particularly, but not exclusively, a motor vehicle. The invention specifically relates to a method and device for controlling the display of augmented reality graphic objects related to a vehicle driver assistance system. The invention also relates to a method and device for a vehicle driver assistance system. Technological background

[0002] Contemporary vehicles are equipped with functions or systems or driver assistance systems, called AD AS (from the English "Advanced Driver-Assistance System" or in French "Système d'aide à la conduite avancé").

[0003] Some of these ADAS systems assist the driver by automatically controlling the vehicle's speed or trajectory, for example. Speed ​​is controlled via a speed regulation system, for example, an ACC (Adaptive Cruise Control) system, based on a set speed and a set following distance. The vehicle's trajectory is controlled, for example, via a lane-keeping system or a semi-automatic lane-change assist system.Maintaining a vehicle in its lane is achieved through a lane keeping assist system (also called a lane position assist system), known for example as LPA (Lane Position Assist), LKA (Lane Keeping Assist), or LCA (Lane Centering Assist). Such a system keeps the vehicle within its lane, for example, in the center of the lane, by recognizing the lane markings and setting a torque threshold that the driver must exceed to change the vehicle's trajectory and override the LKA system.Semi-automatic lane change assistance is provided by a semi-automatic lane change system, known as a SALC system (from the English "Semi-Automatic Lane Change"). The primary function of such a SALC system is to assist the driver of a vehicle when the driver wishes to change lanes. traffic. Upon detection of the activation of the turn signals on one side of the vehicle to indicate its intention to change lanes from a current traffic lane to a target traffic lane on the side where the turn signals were activated by the driver, the SALC system operates the lane change after performing some checks.

[0004] The use of these ADAS systems is accompanied by the display of instructions, guidelines, or graphical information on one or more vehicle screens. With the increasing number of ADAS systems installed in a vehicle and the various functions they perform, the amount of information displayed on a screen also increases. The driver's attention can be reduced when different messages or information are displayed on the vehicle's screen(s), thereby diminishing their focus and disrupting their control of the vehicle. Summary of the present invention

[0005] One object of the present invention is to solve at least one of the problems of the technological background described above.

[0006] Another object of the present invention is, for example, to improve the driving assistance of a vehicle.

[0007] Another object of the present invention is to minimize the loss of driver attention and to improve vehicle safety.

[0008] According to a first aspect, the present invention relates to a method for controlling an image projection system of a vehicle, the vehicle having at least one driver assistance system, called ADAS system, the method being implemented by at least one processor and comprising the following steps: - receipt of initial data representative of the activation of at least one AD AS system; - control of the image projection system to display a set of graphic objects including at least one augmented reality graphic object with a degree of opacity depending on the first data, the set of graphic objects being representative of at least one function implemented by at least one AD AS system, the image projection system being configured to project a set of images representative of the set of graphic objects according to the degree of opacity onto a glazed surface of the vehicle in a field of vision corresponding to a driving position of the vehicle.

[0009] The use of a projection system that projects a set of graphic objects onto a glazed surface of the vehicle, for example the vehicle's windshield, facilitates the reading of information associated with the ADAS system(s) assisting the driver in driving the vehicle. Adjusting the degree of opacity of the displayed set of graphic objects makes it possible to highlight these objects when necessary. Conversely, their visibility is reduced when the associated information is no longer useful. This reduces the time spent searching for relevant information for the relevant ADAS system(s) and decreases the amount of information displayed with the same degree of relevance. The driver is thus less distracted by information searches and their attention is maximized on vehicle control, improving the safety of the vehicle and other road users.

[0010] According to one variant, the degree of opacity belongs to a set of degrees of opacity comprising a first degree of opacity and a second degree of opacity, the first degree of opacity being greater than the second degree of opacity, the set of graphic objects being displayed according to the first degree of opacity for a first determined duration at each activation of at least one AD AS system.

[0011] According to another variant, the method further includes a step of receiving second data representing the adjustment of at least one control parameter of at least one AD AS system, the degree of opacity being further a function of the second data, the set of graphic objects being displayed according to the first degree of opacity for a second determined duration at each adjustment of at least one control parameter of at least one AD AS system.

[0012] According to yet another variant, the method further includes a step of receiving third data representative of the detection of a traffic event associated with the vehicle, the degree of opacity being further a function of the third data, the set of graphic objects being displayed according to the first degree of opacity for a third determined duration at each detection of a traffic event associated with the vehicle.

[0013] According to a further variant, the traffic event belongs to a set of traffic events comprising: - the presence of another vehicle in front of the vehicle according to the direction of travel of the vehicle; - a change of lateral position of the vehicle in a current traffic lane; - a change of traffic lane from the current traffic lane; and - overtaking another vehicle.

[0014] According to an additional variant, the set of graphic objects is displayed according to the second degree of opacity at the end of the first determined duration.

[0015] According to another variant, the at least one AD AS system belongs to a set of AD AS systems comprising: - an adaptive speed control system, known as ACC; and - a lane keeping assistance system, known as the LKA system.

[0016] According to a further variant, the set of graphic objects comprises: - a first graphic object representing a set inter-vehicle distance when at least one AD AS system corresponds to the ACC system; and / or - a second graphic object representing lines of marking on the ground delimiting laterally the traffic lane when at least one AD AS system corresponds to the LKA system.

[0017] According to yet another variant, the glazed surface corresponds to a windshield of the vehicle.

[0018] According to a second aspect, the present invention relates to a control device of a vehicle image projection system, the device comprising a memory associated with a processor configured for the implementation of the steps of the process according to the first aspect of the present invention.

[0019] According to a third aspect, the present invention relates to a vehicle, for example of the automobile type, comprising a device as described above according to the second aspect of the present invention.

[0020] According to a fourth aspect, the present invention relates to a computer program which includes instructions adapted for carrying out the steps of the process according to the first aspect of the present invention, in particular when the computer program is executed by at least one processor.

[0021] Such a computer program may use any programming language, and be in the form of source code, object code, or an intermediate code between source code and object code, such as in a partially compiled form, or in any other desirable form.

[0022] According to a fifth aspect, the present invention relates to a computer-readable recording medium on which is recorded a computer program comprising instructions for carrying out the steps of the process according to the first aspect of the present invention.

[0023] On the one hand, the recording medium can be any entity or device capable of storing the program. For example, the medium can include a storage means, such as a ROM, a CD-ROM or a microelectronic circuit-type ROM, or a magnetic recording means or a hard disk drive.

[0024] On the other hand, this recording medium can also be a transmissible medium such as an electrical or optical signal, such a signal being able to be transmitted via an electrical or optical cable, by conventional or radio frequency, by self-directing laser beam, or by other means. The computer program according to the present invention can, in particular, be downloaded from an Internet-type network.

[0025] Alternatively, the recording medium may be an integrated circuit in which the computer program is incorporated, the integrated circuit being adapted to execute or to be used in the execution of the process in question. Brief description of the figures

[0026] Other features and advantages of the present invention will become apparent from the description of the specific and non-limiting embodiments of the present invention below, with reference to the attached Figures 1 to 6, in which:

[0027] [Fig-1] schematically illustrates part of a vehicle's passenger compartment, according to a example of a particular embodiment of the present invention;

[0028] [Fig.2] schematically illustrates a display support for the vehicle of [Fig.1], according to a first particular and non-limiting embodiment of the present invention;

[0029] [Fig.3] schematically illustrates the display support of the vehicle of [Fig.1], according to a second particular and non-limiting embodiment of the present invention;

[0030] [Fig.4] schematically illustrates the display support of the vehicle of [Fig.1], according to a third particular and non-limiting embodiment of the present invention;

[0031] [Fig.5] illustrates a device configured to control an image projection system of the vehicle of [Fig.1], according to a particular and non-limiting embodiment of the present invention.

[0032] [Fig.6] illustrates a flowchart of the different stages of a method for controlling an image projection system of the vehicle of [Fig.1], according to a particular and non-limiting example of the present invention. Description of examples of achievements

[0033] A method and a control device for a vehicle image projection system will now be described in what follows with joint reference to Figures 1 to 6. The same elements are identified with the same reference signs throughout the following description.

[0034] The terms "first," "second" (or "firsts," "seconds"), etc., are used in this document by arbitrary convention to allow for the identification and distinction of different elements (such as operations, means, etc.) implemented in the embodiments described below. Such elements may be distinct or correspond to a single element, depending on the embodiment.

[0035] According to a particular and non-limiting embodiment of the present invention, the control of a vehicle's image projection system is, for example, implemented by one or more vehicle computers, for example via one or more processors. Such a vehicle advantageously incorporates one or more ADAS systems, for example an ACC system and / or an LKA system.

[0036] For this purpose, initial representative activation data of at least one AD AS system of the vehicle are received, for example from the computer controlling the activation of the AD AS system concerned following a command received from a control unit provided for this purpose.

[0037] The vehicle's image projection system is controlled such that a set of graphic objects (comprising one or more graphic objects) is displayed or projected in augmented reality onto a glazed surface of the vehicle, for example, onto a portion of the windshield or a strip of transparent material positioned in the field of vision associated with a driving position of the vehicle. The set of graphic objects represents a set of functions implemented by the ADAS system(s). The set of graphic objects is displayed with a degree of opacity that is a function of the initial data. Thus, the opacity of the set of graphic objects varies according to the activation of the ADAS system(s); for example, the opacity corresponds to a first degree of opacity when the associated ADAS system has just been activated, and to a second degree of opacity after a predetermined time has elapsed since the ADAS system was activated.

[0038] According to other embodiments, the degree of opacity is further controlled as a function of second data representing the adjustment of at least one control parameter of at least one AD AS system and / or third data representing the detection of a traffic event associated with the vehicle.

[0039] Fig. 1 schematically illustrates part of the passenger compartment of a vehicle 10, according to a particular and non-limiting embodiment of the present invention.

[0040] Vehicle 10 corresponds, for example, to a vehicle with an internal combustion engine, with electric motor(s), or even a hybrid vehicle with an internal combustion engine and one or more electric motors. Vehicle 10 thus corresponds, for example, to a land vehicle, for example a car, a truck, a bus.

[0041] The vehicle 10 advantageously incorporates a display system comprising an image projection system configured to display images comprising one or more graphic objects on a glazed surface of the vehicle 10, for example on the windscreen 17 or on a transparent strip 16 rising for example from the dashboard 11, for example behind the dashboard 13 or the steering wheel 14. Such a projection system includes for example a projector integrated into the dashboard.Such a system for projecting images or graphic content corresponds, for example, to a system called augmented reality, or AR (from the English "Augmented Reality"), for example a Head Up Vision system, or HUD (from the English "Head Up Display" or in French "Affichage Tête Haute"), which allows the embedding of virtual objects in the field of vision of the driver sitting in the driver's seat 15 in a so-called driving position of the vehicle 10, for example on the windshield. 17 of vehicle 10, so as to superimpose the virtual objects onto the real road scene. The projection of the images of the graphic object is for example controlled by one or more computers of the vehicle 10's embedded system, for example by the computer of the infotainment system, called the IVI computer (from the English "In-Vehicle Infotainment" or in French "Infodivertissement étoilé") of vehicle 10.

[0042] According to particular embodiments, the vehicle display system 10 further comprises one or more screens or display devices such as: - a screen 13 corresponding for example to an LCD (Liquid Crystal Display) type screen, for example of TFT (Thin-Film Transistor) type, or OLED (Organic Light-Emitting Diode) type and configured to display content for the driver and passengers of the vehicle 10, the screen 13 being arranged in the dashboard 11, in a space provided behind the steering wheel 14 from the point of view of a driver of the vehicle 10 sitting in the driver's seat 15, such a screen 13 also being called the instrument cluster or dashboard of the vehicle 10;and / or - a screen 12 corresponding for example also to an LCD screen arranged in a central space of the dashboard 11, such a screen 12 being for example provided with a touch interface to allow the driver or passengers of the vehicle 10 to interact with one or more vehicle systems (for example the infotainment system, the navigation system, etc.) via touch commands entered via the touch interface. ;

[0043] According to a particular embodiment, the vehicle 10 carries one or more embedded systems, each controlled by one or more computers, for example, a navigation system, an ACC system, and / or an LKA system. These computers, together with the IVI computer, form, for example, a multiplexed architecture for providing various services useful for the proper functioning of the vehicle and for assisting the driver and / or passengers in controlling the vehicle 10 via the control of the embedded system(s) in the vehicle 10.Computers communicate and exchange data with each other via one or more computer buses, for example a CAN (Controller Area Network), CAN FD (Controller Area Network Flexible Data-Rate), FlexRay (according to ISO 17458), LIN (Local Interconnect Network), or Ethernet (according to ISO / IEC 802-3) type communication bus.

[0044] The navigation system is also called a navigation and geolocation system, or GNSS (Geolocation and Navigation by a Satellite System) system, for example a GPS (Global Positioning System) or Galileo type system, which system is configured to provide the vehicle 10 with data representative of its geographical position at any time, for example in the form of GPS coordinates (latitude and longitude) and to calculate or determine a route for the vehicle so that it reaches a destination address or position based on a starting address or position (which starting position may correspond to a current geographical position of the vehicle 10 determined automatically by the GNSS system).

[0045] The primary function of the ACC (Adaptive Cruise Control) system is to automatically and adaptively regulate the speed of vehicle 10 according to the environment in which vehicle 10 is traveling, particularly in relation to another vehicle preceding vehicle 10 in its lane. Such an ACC system determines one or more acceleration commands based on a speed command and information relating to the vehicle's environment. The acceleration command(s) are designed to regulate the vehicle's speed adaptively, that is, by taking into account the vehicle's environment and, in particular, the distance, referred to as the inter-vehicle distance (IVD, or an equivalent parameter called IIV, corresponding to the inter-vehicle time), between vehicle 10 and the other vehicle traveling in front of vehicle 10, depending on the direction of travel of vehicle 10.

[0046] When the ACC system is activated, its objective is to achieve a target acceleration, called Asetpoint(t), which varies over time 't' and which allows the system to maintain or reach a set speed and / or maintain a predetermined safety distance from the other vehicle ahead of vehicle 10. Data obtained from one or more sensors on board vehicle 10 allows the ACC system of vehicle 10 to establish a target acceleration value Acibie(t) over time 't'. The target acceleration Acibie(t) becomes an acceleration setpoint Asetpoint(t).The ACC system or a computer of this system transmits for example the acceleration commands Aconsigne(t) that it has determined to the computer(s) supervising the operation of a powertrain of the vehicle 10, in particular so that the latter determine(s) the torque commands to be generated by the powertrain to respect the acceleration commands Aconsigne(t) and regulate the speed of the vehicle 10.

[0047] The sensor(s) of vehicle 10 correspond, for example, to one or more of the following sensors: - one or more millimeter-wave radars arranged on the vehicle 10, for example at the front, at the rear, on each front / rear corner of the vehicle; each radar is adapted to emit electromagnetic waves and to receive the echoes of these waves reflected by one or more objects (for example, the other vehicle located in front of the vehicle 10), in order to detect obstacles and their distances from the vehicle 10; and / or - one or more LIDAR(s) (from the English "Light Detection And Ranging", or "Detection and estimation of distance by light" in French), a LIDAR sensor corresponding to an optoelectronic system composed of a laser emitter device, a receiver device including a light collector (to collect the part of the light radiation emitted by the emitter and reflected by any object located in the path of the light rays emitted by the emitter) and a photodetector which transforms the collected light into an electrical signal; a LIDAR sensor thus makes it possible to detect the presence of objects (for example the other vehicle) located in the emitted light beam and to measure the distance between the sensor and each detected object; and / or - one or more cameras (associated or not with a depth sensor) for the acquisition of one or more images of the environment around the vehicle 10 located in the field of vision of the camera(s).

[0048] The active lane departure warning system (LDWS) of vehicle 10 is configured to alert the driver of vehicle 10 when a lane marking line indicating the lateral boundary of a lane being used by vehicle 10 is unintentionally crossed, i.e., without prior activation of the turn signals to indicate the intention to change lanes and thus cross this lane marking line. Such a system is known to those skilled in the art and is not described in detail. The alert is given, for example, by generating vibrations in the driver's seat 15 on the side of the lane that was unintentionally crossed.Such a system, in its active version (corresponding to the LKA system, short for Lane Keeping Assist), also includes lane keeping assistance. This means automatic trajectory control by an onboard system, through steering and / or braking actions, to guide and maintain the vehicle within its lane once an unintentional lane departure is detected. The detection of the unintentional lane departure is obtained from data from onboard sensors, such as cameras configured to capture images of the road surface passing in front of the vehicle or infrared LEDs (associated with infrared detection sensors) located on the front bumper. The vehicle's 10-degree beam, directed towards the ground, detects when a vehicle crosses a white line by analyzing differences in infrared reflection on the road. Such AFIL and LKA systems are known to those skilled in the art, for example, as described in UNECE (United Nations Economic Commission for Europe) Regulation 130.

[0049] A control process for the image projection system of the vehicle 10 is advantageously implemented by one or more processors of the display system, for example by one or more processors of one or more computers, for example the computer of the IVI system.

[0050] The different operations of the process are described below with regard to figures 2, 3 and 4, according to different examples of implementation of the process.

[0051] Figures 2 to 4 each illustrate the result of displaying information to the driver of vehicle 10 in relation to one or more functions implemented by one or more AD AS systems such as the ACC system and / or the LKA system.

[0052] In a first operation of the process, first representative data of activation of one or more ADAS systems are received by the computer implementing the process at each activation of an ADAS system, for example at each activation of the ACC system and / or at each activation of the LKA system.

[0053] This data is received from the computer controlling the activation of the relevant ADAS system, for example the computer controlling the ACC system or the computer controlling the LKA system via one or more data buses linking these computers to the computer implementing the process.

[0054] Activation of an ADAS system is achieved by a command from the driver of the vehicle 10 via a control device or an HMI provided for this purpose, for example by pressing a physical button or a touch button displayed on the touch screen 12 of the vehicle 10.

[0055] The first data are also representative of the deactivation of the ADAS system(s) following a previous activation via the control device(s) or HMI provided for this purpose.

[0056] In a second operation of the process, the image projection system of the vehicle 10 is controlled to project or display a set of images comprising a set of augmented reality graphic objects onto a glazed surface of the vehicle 10, for example on the windshield 17, in a field of vision corresponding to a driving position of the vehicle 10.

[0057] The driving position of the vehicle 10 corresponds to the position of a driver sitting in the driver's seat 15 and looking straight ahead, i.e. in the direction of travel of the vehicle 10.

[0058] A display or projection control for graphic content or a graphic object (text, pictogram, icon, etc.) includes rendering the graphic content or graphic object, such rendering corresponding to a set of operations performed by one or more processors on the pixels of one or more images of the graphic content or graphic object to be displayed or projected. For example, rendering consists of associating pixel data (for example, color data expressed in an RGB (Red, Green, Blue) color space) with each graphic object.

[0059] The display control of a graphic object or graphic content thus includes the transmission of control signals to the projection system or to a display device (or screen) of the vehicle 10 to modify the values ​​associated with the pixels associated with the graphic object or graphic content.

[0060] Displaying the set of graphic objects in augmented reality amounts to displaying one or more virtual graphic objects (for example computer-generated) superimposed on the real world visible to the driver of the vehicle 10 through the windshield 17.

[0061] Each graphic object in the set of displayed graphic objects is representative of a function implemented by the activated AD AS system.

[0062] For example, when the AD AS system corresponds to the ACC system, the set of graphic objects includes a first graphic object representing a set inter-vehicle distance (called DIV). This first graphic object is illustrated, for example, in [Fig. 2] with reference 201 and in [Fig. 4] with reference 401. This first graphic object 201, 401 corresponds, for example, to a set of parallel horizontal segments displayed superimposed on the lane or traffic lane 21 in which the vehicle 10 is traveling, the length of each segment decreasing as the distance from the driver's point of view increases.

[0063] The number of parallel segments is for example a function of the DIV selected by the driver: a minimum DIV is represented by a single segment, a maximum DIV by three segments and an intermediate DIV between the minimum DIV and the maximum DIV by two segments.

[0064] Of course, the number of segments is not limited to 3 and extends to other numbers, for example 2, 4, 5 or more. Similarly, the graphical representation of the first graphical object 201, 401 is not limited to parallel segments.

[0065] Other graphic objects representing other functions implemented by the ACC system are also displayed, for example a graphic object representing the measured distance between vehicle 10 and the other vehicle in front of it, with an alert when this distance is less than a threshold.

[0066] When the AD AS system corresponds to the LKA system, the set of objects graphics includes a second first graphic object representing ground marking lines laterally delimiting the traffic lane 21 on which the vehicle 10 travels. This second graphic object is illustrated for example on [Fig.2] with reference 202 and on [Fig.4] with reference 402. This second graphic object 202, 402 corresponds for example to straight line segments overlapping the lateral limits of the traffic lane to materialize these left and right lateral limits.

[0067] The graphic representation of this second graphic object varies for example when the vehicle 10 is in the center of the line (fixed display of the second graphic object) and when the vehicle 10 approaches or crosses a lateral limit (the second graphic object associated with this lateral limit then flashes for example).

[0068] Of course, the graphical representation of the second graphical object 202, 402 is not limited to the segments illustrated in Figures 2 and 4 but extends to any graphical representation illustrating a function implemented by the LKA system.

[0069] The set of graphic objects is displayed semi-transparently so as to be both visible to the driver of the vehicle 10 and so as not to completely mask or obscure the real scene located behind this set of graphic objects according to the point of view of the driver of the vehicle 10.

[0070] Each graphic object in the set of graphic objects is advantageously displayed with a degree (or level) of opacity determined according to the first data received.

[0071] The degree of opacity of a graphic object corresponds to a property of the displayed graphic object, namely, the property of allowing a greater or lesser amount of the light it receives to pass through. The higher the opacity, the less light from outside the vehicle 10 passes through the graphic object and reaches the driver's eyes. Opacity is, for example, defined as the ratio of the incident luminous flux to the transmitted luminous flux. The opacity of an element of an image of the graphic object (i.e., a pixel of the image) is defined by an integer value (for example, between 0 and 255 when encoded on 8 bits) of the image's alpha channel. The alpha channel of a digital image corresponds to a component indicating the degree of transparency (or opacity) of each pixel of the image.

[0072] The degree of opacity of the set of graphic objects belongs, for example, to a set of opacity degrees comprising a first degree of opacity and a second degree of opacity, the first degree of opacity being greater than the second degree of opacity. The first degree of opacity is, for example, equal to 150, 175 or 200 (on a scale of 0 to 255) and the second degree of opacity is, for example, equal to 75, 100 or 125 respectively.

[0073] Figure 2 illustrates the display of a set of graphic objects 201, 202 displayed according to the first degree of opacity, according to a particular embodiment. The projection of the set of graphic objects 201, 202 is triggered, for example, when the first data indicates that one or more AD / AS systems to which the graphic object(s) forming the set of graphic objects are associated is or are activated.

[0074] Thus, at each activation of a given AD AS system, the associated graphic object(s) are displayed on the glass surface, for example the windshield 17, with the first degree of opacity for a first determined duration, for example for 5 or 10 seconds from the moment of activation of the AD AS system.

[0075] According to a particular and optional embodiment, additional information is further displayed on a screen or display device of the vehicle 10 such as the screen 13 or the screen 12. According to a variant, this additional information is projected onto the slat 16 when the set of graphic objects 201, 202 is projected onto the windscreen 17.

[0076] This additional information is represented, for example, by means of one or more pictograms, icons, or text areas and includes, for example: - a first piece of information represented by a graphic object 22, which is representative of a speed limit associated with the section of road on which the vehicle 10 is traveling, the graphic object 22 corresponding, for example, to a pictogram representing a speed limit sign, this fifth piece of information being obtained, for example, from a traffic sign recognition system or from mapping data used by the navigation system; and / or - a second piece of information represented by a graphic object 23, which is representative of a current speed value of the vehicle 10 (expressed for example in km / h) displayed in a text area.

[0077] Figure [Fig. 3] illustrates the windscreen 17 of the vehicle 10, according to a particular embodiment.

[0078] [Fig.3] illustrates what the driver of vehicle 10 sees when he looks at the windscreen 17 of vehicle 10 following the display of the set of graphic objects 201, 202 on the windscreen 17 illustrated in [Fig.2].

[0079] According to this particular embodiment, the set of graphic objects 201, 202 is displayed or projected onto the windshield 17 for a first determined period from the activation of the AD AS system(s), for example ACC and / or LKA.

[0080] Upon expiry of this initial period, the computer controls the end of the projection of the set of graphic objects 201, 202, and no graphic objects are then displayed on the windshield 17. Only the traffic lane 21 on which the vehicle is traveling vehicle 10 and the landscape surrounding this lane of traffic 21 is visible to the driver through the windscreen 17.

[0081] The end of the projection of the set of graphic objects also amounts to controlling the projection of this set of graphic objects with a degree of opacity equal to 0.

[0082] According to this embodiment, additional information is displayed, for example, on the screen 13 (or the screen 12 or the semi-transparent strip 16 according to other embodiments) to inform the driver 12 of the active state of each activated ADAS system. According to the example in [Fig. 3], this additional information corresponds to a third piece of information 31 representing the active state of the ACC system, for example. This third piece of information 31 takes, for example, the form of a pictogram representing the ACC system with the set of parallel horizontal segments indicating or representing the DIV set by the driver.

[0083] Figure 4 illustrates the windscreen 17 of the vehicle 10, according to another embodiment particular.

[0084] Figure 4 illustrates what the driver of vehicle 10 sees when he looks at the windshield. windshield 17 of vehicle 10 following the display of the set of graphic objects 201, 202 on the windshield 17 illustrated in [Fig. 2], that is, after the expiry of the first determined duration. This other embodiment corresponds to an alternative to the embodiment described opposite [Fig. 3].

[0085] According to this other embodiment, the set of graphic objects 401, 402 is projected or displayed on the windshield 17 according to the second degree of opacity following the projection of the same graphic objects 201, 202 according to the first degree of opacity during the first determined duration.

[0086] Graphic objects 401, 402 are projected according to the second degree of opacity as long as the AD AS system(s) are in the active state. Since the second degree of opacity is lower than the first degree of opacity, graphic objects 401, 402 are displayed in augmented reality with greater transparency than graphic objects 201, 202; that is to say, graphic objects 401, 402 according to the second degree of opacity are less visible to the driver than graphic objects 201, 202 according to the first degree of opacity, reducing the potential distraction to the driver due to the display of these graphic objects.

[0087] According to this other embodiment, the information displayed on the screen 13 (or the screen 12 or the semi-transparent slat 16 according to other embodiments) is, for example, identical to that displayed when the set of graphic objects is displayed according to the first degree of opacity, that is to say that the information displayed corresponds to the first piece of information 22 and the second piece of information 23. Indeed, the active state of each AD AS system is indicated or displayed to the driver via the projection of the associated graphic objects according to the second degree of opacity.

[0088] According to other embodiments of the invention, the projection of the set of graphic objects according to the first degree of opacity (or according to another degree of opacity different from the first degree of opacity and the second degree of opacity, and greater than the second degree of opacity) is triggered in contexts other than the sole activation of an AD AS system.

[0089] According to these other embodiments of the invention, the degree of opacity of the set of graphic objects is further a function of: - Second representative data showing the adjustment of at least one control parameter of the activated AD / AS system(s), this second data being received from the computer controlling each AD / AS system; and / or - third data representing the detection of a traffic event associated with vehicle 10, this third data being received from the computer controlling each AD AS system or from computers controlling the environmental perception sensors of vehicle 10 (for example radars, LIDAR and / or camera); and / or - fourth data representing the location of vehicle 10, this fourth data being received from the navigation system of vehicle 10 or from a receiver of a GPS-type geolocation system.

[0090] A traffic event corresponds, for example, to one of the following events, the list below not being exhaustive and being provided by way of illustration: - the presence of another vehicle in front of the vehicle in a direction of travel of the vehicle, the presence of such a vehicle being detected from the data received from one or more environmental sensors of the vehicle 10 (radars, lidar and / or camera); - a change in the lateral position of the vehicle in a current traffic lane, such a driving deviation being detected from the data received from one or more environmental sensors of the vehicle 10, for example a camera or infrared sensors detecting the lane markings and allowing the vehicle 10 to be positioned in relation to each of these lane markings; - a change of lane from the current lane, detected for example by crossing a lane marking and / or the activation of the vehicle's turn signals 10; and - an overtaking of another vehicle, detected for example by data received from cameras, radars or lidar.

[0091] Adjusting a parameter of the AD AS system (for example, the setpoint DIV) or the set speed for the ACC system) is obtained via an HMI or a control device associated with the AD AS system, the parameter(s) being chosen by the driver of vehicle 10.

[0092] According to these different embodiments, the detection of a traffic event and / or the adjustment of a parameter of an active AD AS system triggers the projection of the set of graphic objects according to the first degree of opacity (or according to another different degree of opacity remaining greater than the second degree of opacity).

[0093] The projection according to the first degree of opacity (or according to the other degree of opacity) is for example implemented for a second determined duration at each adjustment of at least one control parameter of the AD AS system(s) and the projection according to the first degree of opacity (or according to the other degree of opacity) is for example implemented for a third determined duration at each detection of a traffic event associated with the vehicle 10.

[0094] The second and third determined durations are, for example, identical and equal to the first determined duration. According to one variant, the first, second, and third determined durations are different.

[0095] According to these other embodiments, the display or projection of the set of graphic objects changes from the second degree of opacity to the first degree of opacity (or to another degree of opacity higher than the second degree of opacity) upon receipt of the second data and / or the second data for a determined duration.

[0096] When the set of graphic objects is no longer displayed as illustrated in [Fig.3], the reception of the second and / or third data triggers the display or projection of the set of graphic objects according to the first degree of opacity (or the other degree of opacity higher than the second degree of opacity).

[0097] These different embodiments thus make it possible to alert the driver of a change in traffic context for the vehicle 10 (adjustment of a control parameter of an AD AS system and / or detection of a traffic event) by displaying the set of graphic objects according to a higher degree of opacity (equal for example to the first degree of opacity when the AD AS system is activated).

[0098] Figure 5 schematically illustrates a device 5 configured for controlling a vehicle's projection system, for example, the vehicle 10, according to specific and non-limiting embodiments of the present invention. The device 5 corresponds, for example, to a device embedded in the vehicle 10, for example, a computer. The device 5 is further configured, for example, to control each device forming the vehicle 10's display system, for example, the projection system and each screen or display device of the vehicle 10.

[0099] Device 5 is, for example, configured to carry out the operations described opposite Figures 1 to 4 and / or the steps of the process described opposite [Fig. 6]. Examples of such a device 5 include, but are not limited to, embedded electronic equipment such as a vehicle's on-board computer, an electronic control unit such as an ECU (Electronic Control Unit), a smartphone, a tablet, or a laptop computer. The elements of device 5, individually or in combination, can be integrated into a single circuit integrated, in several integrated circuits, and / or in discrete components. Device 5 can be implemented in the form of electronic circuits or software (or computer) modules or a combination of electronic circuits and software modules.

[0100] The device 5 comprises one (or more) processor(s) 51 configured to execute instructions for carrying out the steps of the process and / or for executing instructions from the software embedded in the device 5. The processor 51 may include integrated memory, an input / output interface, and various circuits known to those skilled in the art. The device 5 further comprises at least one memory 52, for example, volatile and / or non-volatile memory, and / or includes a memory storage device that may include volatile and / or non-volatile memory, such as EEPROM, ROM, PROM, RAM, DRAM, SRAM, flash, magnetic disk, or optical disk.

[0101] The computer code of the embedded software(s) including the instructions to be loaded and executed by the processor is for example stored on memory 52.

[0102] According to various particular and non-limiting embodiments, the device 5 is coupled in communication with other similar devices or systems and / or with communication devices, for example a TCU (Telematic Control Unit), for example via a communication bus or through dedicated input / output ports.

[0103] According to a particular and non-limiting embodiment, the device 5 includes a block 54 of interface elements for communicating with external devices. The interface elements of the block 54 include one or more of the following interfaces: - radio frequency RF interface, for example of the Wi-Fi® type (according to IEEE 802.11), for example in the 2.4 or 5 GHz frequency bands, or of the Bluetooth® type (according to IEEE 802.15.1), in the 2.4 GHz frequency band, or of the Sigfox type using UBN (Ultra Narrow Band) radio technology, or LoRa in the 868 MHz frequency band, LTE (Long-Term Evolution), LTE-Advanced; - USB interface (from the English "Universal Serial Bus" or "Universal Serial Bus" in French); - HDMI interface (from the English "High Definition Multimedia Interface", or "High Definition Multimedia Interface" in French); - LIN interface (from the English "Local Interconnect Network", or in French "Réseau interconnecté local").

[0104] According to another particular and non-limiting embodiment, the device 5 includes a communication interface 54 which enables communication with other devices (such as other computers in the embedded system) via a communication channel 540. The communication interface 54 corresponds, for example, to a transmitter configured to transmit and receive information and / or data via the communication channel 540. The communication interface 54 corresponds, for example, to a wired network of the CAN (Controller Area Network), CAN FD (Controller Area Network Flexible Data-Rate), FlexRay (standardized by ISO 17458) or Ethernet (standardized by ISO / IEC 802-3) type.

[0105] According to a particular and non-limiting embodiment, the device 5 can provide output signals to one or more external devices, such as a display screen 550, touch or not, one or more loudspeakers 560 and / or other peripherals 570 (projection system) via output interfaces 55, 56 and 57 respectively. According to a variant, one or more of the external devices is integrated into the device 5.

[0106] Figure 6 illustrates a flowchart of the various steps in a method for controlling an image projection system of a vehicle, for example, vehicle 10, according to a particular and non-limiting embodiment of the present invention. The method is implemented, for example, by a device embedded in the vehicle 10 or by the device 5 of Figure 5, in particular by one or more processors of such a device 5.

[0107] In a first step 61, initial representative activation data of at least one AD AS system on board the vehicle are received.

[0108] In a second step 62, the image projection system is controlled to display a set of augmented reality graphic objects with a degree of opacity depending on the first data, the set of graphic objects being representative of at least one function implemented by at least one AD AS system, the image projection system being configured to project a set of images representative of the set of graphic objects according to the degree of opacity onto a glazed surface of the vehicle in a field of vision corresponding to a driving position of the vehicle.

[0109] According to one variant, the variants and examples of the operations described in relation to one of Figures 1 to 4 apply to the steps of the process in [Fig.6].

[0110] Of course, the present invention is not limited to the embodiments described above but extends to a method of displaying graphic content representing information relating to one or more ADAS systems of a vehicle which would include secondary steps without falling outside the scope of the present invention. The same would apply to a device configured for implementing such a method.

[0111] The present invention also relates to a vehicle, for example an automobile or more generally an autonomous land-powered vehicle, comprising the device 5 of [Fig.5] or a display system comprising the device 5 of [Fig.5] connected in communication to a projection system or a screen 13.

Claims

Demands

1. A method for controlling an image projection system of a vehicle (10), said vehicle (10) carrying at least one driver assistance system, said ADAS system, said method being implemented by at least one processor and comprising the following steps: - receiving (61) initial data representative of the activation of said at least one ADAS system; - controlling (62) said image projection system to display a set of graphic objects comprising at least one graphic object (201, 202; 401, 402) in augmented reality with a degree of opacity depending on said initial data, said set of graphic objects (201, 202; 401, 402) being representative of at least one function implemented by said at least one ADAS system, said image projection system being configured to project a set of images representative of said set of graphic objects (201, 202;401, 402) according to said degree of opacity on a glazed surface of said vehicle (10) in a field of vision corresponding to a driving position of said vehicle (10).;

2. A method according to claim 1, wherein said degree of opacity belongs to a set of degrees of opacity comprising a first degree of opacity and a second degree of opacity, said first degree of opacity being greater than said second degree of opacity, said set of graphic objects (201, 202) being displayed according to said first degree of opacity for a first determined duration at each activation of said at least one AD AS system.

3. A method according to claim 2, further comprising a step of receiving second data representing the adjustment of at least one control parameter of said at least one AD AS system, said degree of opacity being further a function of said second data, said set of graphic objects (201, 202) being displayed according to said first degree of opacity for a second duration determined at each adjustment of at least one control parameter of said at least one AD AS system.

4. A method according to claim 2 or 3, further comprising a step of receiving third data representative of the detection of a traffic event associated with said vehicle, said degree of opacity being further dependent on said third data, said set of graphic objects (201, 202) being displayed according to said first degree of opacity for a third duration determined at each detection of a traffic event associated with said vehicle (10).

5. A method according to claim 4, wherein said traffic event belongs to a set of traffic events comprising: - the presence of another vehicle in front of said vehicle (10) in a direction of travel of said vehicle (10); - a change of lateral position of said vehicle (10) in a current traffic lane (21); - a change of traffic lane from the current traffic lane (21); and - an overtaking of another vehicle.

6. A method according to any one of claims 2 to 5, wherein said set of graphic objects (401, 402) is displayed according to said second degree of opacity at the end of said first determined duration.

7. A method according to any one of claims 1 to 6, wherein said at least one AD AS system belongs to a set of AD AS systems comprising: - an adaptive speed control system, referred to as the ACC system; and - a lane keeping assist system, referred to as the LKA system.

8. A method according to claim 7, wherein said set of graphic objects comprises: - a first graphic object (201; 401) representing a set inter-vehicle distance when said at least one AD AS system corresponds to said ACC system; and / or - a second graphic object (202; 402) representing lane marking lines laterally delimiting said traffic lane when said at least one AD AS system corresponds to said LKA system.

9. Device (5) for controlling an image projection system of a vehicle (10), said device (5) comprising a memory (52) associated with at least one processor (51) configured for carrying out the steps of the method according to any one of claims 1 to 8.

10. Vehicle (10) comprising the device (5) according to claim 9.

Images