Method and device for controlling a vehicle image projection system in a permanent or temporary display mode

Abstract

The present invention relates to a method and device for controlling an image projection system in a vehicle equipped with at least one ADAS system. To this end, initial data representing a display mode for a set of graphic objects (201, 202) representative of at least one function implemented by the at least one ADAS system are received. The display mode comprises a first display mode for continuous display of the set of graphic objects and a second display mode for temporary display of the set of graphic objects. The set of graphic objects (201, 202) is projected in augmented reality onto a glazed surface (17) of the vehicle according to the display mode, the image projection system being configured to project a set of images representative of the set of graphic objects (201, 202) onto a glazed surface (17) of the vehicle in a field of vision corresponding to a driving position of the vehicle.Figure for the abbreviation: Figure 2.

Description

Title of the invention: Method and device for controlling a vehicle image projection system in a permanent or temporary display mode. Technical field

[0001] The invention relates to methods and devices for controlling an image projection system for a vehicle, particularly, but not exclusively, a motor vehicle. The invention specifically relates to a method and device for controlling the display of augmented reality graphic objects related to a vehicle driver assistance system. The invention also relates to a method and device for a vehicle driver assistance system. Technological background

[0002] Contemporary vehicles are equipped with functions or systems or driver assistance systems, called AD AS (from the English "Advanced Driver-Assistance System" or in French "Système d'aide à la conduite avancé").

[0003] Some of these ADAS systems assist the driver by automatically controlling the vehicle's speed or trajectory, for example. Speed ​​is controlled via a speed regulation system, for example, an ACC (Adaptive Cruise Control) system, based on a set speed and a set following distance. The vehicle's trajectory is controlled, for example, via a lane-keeping system or a semi-automatic lane-change assist system.Maintaining a vehicle in its lane is achieved through a lane keeping assist system (also called a lane position assist system), known for example as LPA (Lane Position Assist), LKA (Lane Keeping Assist), or LCA (Lane Centering Assist). Such a system keeps the vehicle within its lane, for example, in the center of the lane, by recognizing the lane markings and setting a torque threshold that the driver must exceed to change the vehicle's trajectory and override the LKA system.The semi-automatic lane change assistance is provided by a semi-automatic lane change system, known as a SALC system (from the English "Semi-Automatic Lane Change"). The primary function of such a SALC system is to... to assist the driver of a vehicle when the driver wishes to change lanes. Upon detecting the activation of the turn signals on one side of the vehicle to indicate the intention to change lanes from the current lane to a target lane on the side where the turn signals were activated by the driver, the SALC system performs the lane change after carrying out a few checks.

[0004] The use of these ADAS systems is accompanied by the display of instructions, guidelines, or graphic information on one or more vehicle screens. With the increasing number of ADAS systems installed in a vehicle and the various functions they perform, the amount of information displayed on a screen also increases. The driver's attention can be reduced when different messages or information are displayed on the vehicle's screen(s), thereby diminishing their focus and disrupting their control of the vehicle. Summary of the present invention

[0005] One object of the present invention is to solve at least one of the problems of the technological background described above.

[0006] Another object of the present invention is, for example, to improve the driving assistance of a vehicle.

[0007] Another object of the present invention is to minimize the loss of driver attention and to improve vehicle safety.

[0008] According to a first aspect, the present invention relates to a method for controlling an image projection system of a vehicle, the vehicle having at least one driver assistance system, called ADAS system, the method being implemented by at least one processor and comprising the following steps: - reception of initial data representative of a display mode of a set of graphic objects comprising at least one graphic object, said set of graphic objects being representative of at least one function implemented by at least one AD AS system, the display mode comprising a first display mode for a permanent display of the set of graphic objects and a second display mode for a temporary display of the set of graphic objects, the initial data being received from a human-machine interface of the vehicle; - control of the image projection system to display the set of augmented reality graphic objects according to the display mode, the image projection system being configured to project a set of images representative of the set of graphic objects onto a glass surface of the vehicle in a field of vision corresponding to a driving position of the vehicle.

[0009] Selecting a display mode for a set of graphical objects associated with one or more AD / AS systems, between a permanent display mode and a mode Temporary display allows a vehicle user, such as the driver, to choose how long information associated with one or more ADAS systems is displayed via the vehicle's human-machine interface (HMI). This enables the user to select which information should remain permanently displayed and which should be displayed only temporarily, thus reducing the amount of information displayed simultaneously and the time spent searching for relevant information for the relevant ADAS system(s). The driver is therefore less distracted by information searches and can focus their attention on vehicle control, thereby improving the safety of the vehicle and other road users.

[0010] According to one variant, the control of the image projection system to display the set of graphic objects in augmented reality according to the second display mode is triggered by a reception of second data representing an activation of at least one ADAS system, third data representing the adjustment of at least one control parameter of at least one ADAS system and / or fourth data representing the detection of a traffic event associated with the vehicle, the set of graphic objects being displayed for a first determined duration according to the second display mode.

[0011] According to a further variant, the traffic event belongs to a set of traffic events comprising: - the presence of another vehicle in front of the vehicle according to the direction of travel of the vehicle; - a change of lateral position of the vehicle in a current traffic lane; - a change of traffic lane from the current traffic lane; and - overtaking another vehicle.

[0012] According to another variant, the control of the image projection system to display the set of graphic objects in augmented reality according to the first display mode is further a function of a degree of opacity belonging to a set of degrees of opacity comprising a first degree of opacity and a second degree of opacity, the first degree of opacity being greater than the second degree of opacity.

[0013] According to yet another variant, the set of graphic objects is displayed according to the first degree of opacity for a second determined duration following an activation of at least one ADAS system and the set of graphic objects is displayed according to the second degree of opacity following a deadline of the second determined duration as long as at least one ADAS system is in an activated state.

[0014] According to another variant, the at least one ADAS system belongs to a set of ADAS systems comprising: - an adaptive speed control system, known as ACC; and - a lane keeping assistance system, known as the LKA system.

[0015] According to a further variant, the set of graphic objects includes: - a first graphic object representing a set inter-vehicle distance when at least one AD AS system corresponds to the ACC system; and / or - a second graphic object representing lines of marking on the ground delimiting laterally the traffic lane when at least one AD AS system corresponds to the LKA system.

[0016] According to yet another variant, the glazed surface corresponds to a windshield of the vehicle.

[0017] According to a second aspect, the present invention relates to a control device of a vehicle image projection system, the device comprising a memory associated with a processor configured for the implementation of the steps of the process according to the first aspect of the present invention.

[0018] According to a third aspect, the present invention relates to a vehicle, for example of the automobile type, comprising a device as described above according to the second aspect of the present invention.

[0019] According to a fourth aspect, the present invention relates to a computer program which includes instructions adapted for carrying out the steps of the process according to the first aspect of the present invention, in particular when the computer program is executed by at least one processor.

[0020] Such a computer program may use any programming language, and be in the form of source code, object code, or an intermediate code between source code and object code, such as in a partially compiled form, or in any other desirable form.

[0021] According to a fifth aspect, the present invention relates to a computer-readable recording medium on which is recorded a computer program comprising instructions for carrying out the steps of the process according to the first aspect of the present invention.

[0022] On the one hand, the recording medium can be any entity or device capable of storing the program. For example, the medium can include a storage means, such as a ROM, a CD-ROM or a microelectronic circuit-type ROM, or a magnetic recording means or a hard disk drive.

[0023] On the other hand, this recording medium can also be a transmissible medium such as an electrical or optical signal, such a signal being able to be transmitted via an electrical or optical cable, by conventional or radio frequency, by self-directing laser beam, or by other means. The computer program according to the present invention can, in particular, be downloaded from an Internet-type network.

[0024] Alternatively, the recording medium may be an integrated circuit in which the computer program is incorporated, the integrated circuit being adapted to execute or to be used in the execution of the process in question. Brief description of the figures

[0025] Other features and advantages of the present invention will become apparent from the description of the specific and non-limiting embodiments of the present invention below, with reference to the attached Figures 1 to 5, in which:

[0026] [Fig-1] schematically illustrates part of a vehicle's passenger compartment, according to a example of a particular embodiment of the present invention;

[0027] [Fig.2] schematically illustrates a display support for the vehicle of [Fig.1], according to a first particular and non-limiting embodiment of the present invention;

[0028] [Fig.3] schematically illustrates the display support of the vehicle of [Fig.1], according to a second particular and non-limiting embodiment of the present invention;

[0029] [Fig.4] illustrates a device configured to control an image projection system of the vehicle of [Fig.1], according to a particular and non-limiting embodiment of the present invention.

[0030] [Fig.5] illustrates a flowchart of the different stages of a method for controlling an image projection system of the vehicle of [Fig.1], according to a particular and non-limiting embodiment of the present invention. Description of examples of achievements

[0031] A method and a control device for a vehicle image projection system will now be described in what follows with joint reference to Figures 1 to 5. The same elements are identified with the same reference signs throughout the following description.

[0032] The terms "first," "second" (or "firsts," "seconds"), etc., are used in this document by arbitrary convention to allow for the identification and distinction of different elements (such as operations, means, etc.) implemented in the embodiments described below. Such elements may be distinct or correspond to a single element, depending on the embodiment.

[0033] According to a particular and non-limiting embodiment of the present invention, the control of a vehicle's image projection system is, for example, implemented by one or more vehicle computers, for example via one or more processors. Such a vehicle advantageously incorporates one or more ADAS systems, for example an ACC system and / or an LKA system.

[0034] To this end, initial data representing a display mode for information relating to the system(s), for example graphical objects representing one or more functions implemented by this / the AD / AS system(s), are received from an HMI (for example, one or more physical control devices or a touchscreen interface on which a graphical HMI is displayed). The display mode corresponds to a first display mode for the permanent display of information, for example, graphical objects, or a second display mode for the temporary display of information, for example, graphical objects.

[0035] The vehicle's image projection system is controlled such that a set of graphic objects (comprising one or more graphic objects) is displayed or projected in augmented reality onto a glazed surface of the vehicle, for example, onto a portion of the windshield or a strip of transparent material positioned in the field of vision associated with a driving position of the vehicle. The set of graphic objects represents a set of functions implemented by the ADAS system(s). The set of graphic objects is displayed according to the initial data, i.e., according to the first display mode or the second display mode.

[0036] According to other embodiments, the set of graphic objects is displayed with different degrees of opacity when the display mode corresponds to the first display mode, the degrees of opacity varying for example as a function of time.

[0037] Fig. 1 schematically illustrates part of the passenger compartment of a vehicle 10, according to a particular and non-limiting embodiment of the present invention.

[0038] Vehicle 10 corresponds, for example, to a vehicle with an internal combustion engine, with electric motor(s), or even a hybrid vehicle with an internal combustion engine and one or more electric motors. Vehicle 10 thus corresponds, for example, to a land vehicle, for example a car, a truck, a bus.

[0039] The vehicle 10 advantageously incorporates a display system comprising an image projection system configured to display images comprising one or more graphic objects on a glazed surface of the vehicle 10, for example on the windshield 17 or on a transparent strip 16 rising, for example, from the dashboard 11, for example behind the instrument panel 13 or the steering wheel 14. Such a projection system includes, for example, a projector integrated into the dashboard. Such an image or graphic content projection system corresponds, for example, to an augmented reality (AR) system, for example, a Head-Up Display (HUD) system, which allows virtual objects to be superimposed onto the field of vision of the driver seated in the driver's seat. 15 in a so-called driving position of the vehicle 10, for example on the windshield 17 of the vehicle 10, so as to superimpose the virtual objects onto the real road scene. The projection of the images of the graphic object is controlled, for example, by one or more computers of the vehicle 10's embedded system, for example by the computer of the infotainment system, known as the IVI computer (from the English "In-Vehicle Infotainment" or in French "Infodivertissement étoilé") of the vehicle 10.

[0040] According to particular embodiments, the vehicle display system 10 further comprises one or more screens or display devices such as: - a screen 13 corresponding for example to an LCD (Liquid Crystal Display) type screen, for example of TFT (Thin-Film Transistor) type, or OLED (Organic Light-Emitting Diode) type and configured to display content for the driver and passengers of the vehicle 10, the screen 13 being arranged in the dashboard 11, in a space provided behind the steering wheel 14 from the point of view of a driver of the vehicle 10 sitting in the driver's seat 15, such a screen 13 also being called the instrument cluster or dashboard of the vehicle 10;and / or - a screen 12 corresponding for example also to an LCD screen arranged in a central space of the dashboard 11, such a screen 12 being for example provided with a touch interface to allow the driver or passengers of the vehicle 10 to interact with one or more vehicle systems (for example the infotainment system, the navigation system, etc.) via touch commands entered via the touch interface. ;

[0041] According to a particular embodiment, the vehicle 10 carries one or more embedded systems, each controlled by one or more computers, for example, a navigation system, an ACC system, and / or an LKA system. These computers, together with the IVI computer, form, for example, a multiplexed architecture for providing various services useful for the proper functioning of the vehicle and for assisting the driver and / or passengers of the vehicle in controlling the vehicle 10 via the control of the embedded system(s) in the vehicle 10.Computers communicate and exchange data with each other via one or more computer buses, for example a CAN (Controller Area Network), CAN FD (Controller Area Network Flexible Data-Rate), FlexRay (according to ISO 17458), LIN (Local Interconnect Network), or Ethernet (according to ISO / IEC 802-3) type communication bus.

[0042] The navigation system is also called a navigation and geolocation system, or GNSS (Geolocation and Navigation by a Satellite System) system, for example a GPS type system (from the English "Global Positioning System" or in French "Système de géo-positionnement par satellites") or Galileo, which system is configured to provide the vehicle 10 with data representative of its geographical position at any time, for example in the form of GPS coordinates (latitude and longitude) and to calculate or determine a route for the vehicle so that the latter reaches a destination address or position based on a starting address or position (which starting position may correspond to a current geographical position of the vehicle 10 determined automatically by the GNSS system).

[0043] The primary function of the ACC (Adaptive Cruise Control) system is to automatically and adaptively regulate the speed of vehicle 10 according to the environment in which vehicle 10 is traveling, particularly in relation to another vehicle preceding vehicle 10 in its lane. Such an ACC system determines one or more acceleration commands based on a speed command and information relating to the vehicle's environment. The acceleration command(s) are designed to regulate the vehicle's speed adaptively, that is, by taking into account the vehicle's environment and, in particular, the distance, referred to as the inter-vehicle distance (IVD, or an equivalent parameter called IIV, corresponding to the inter-vehicle time), between vehicle 10 and the other vehicle traveling in front of vehicle 10, depending on the direction of travel of vehicle 10.

[0044] When the ACC system is activated, its objective is to achieve a target acceleration, called Asetpoint(t), which varies over time 't' and which allows the vehicle to maintain or reach a set speed and / or maintain a predetermined safety distance from the other vehicle ahead of vehicle 10. Data obtained from one or more sensors on board vehicle 10 allows the ACC system of vehicle 10 to establish a target acceleration value Acibie(t) over time 't'. The target acceleration Acibie(t) becomes an acceleration setpoint Asetpoint(t).The ACC system or a computer of this system transmits for example the acceleration commands Aconsigne(t) that it has determined to the computer(s) supervising the operation of a powertrain of the vehicle 10, in particular so that the latter determine(s) the torque commands to be generated by the powertrain to respect the acceleration commands Aconsigne(t) and regulate the speed of the vehicle 10.

[0045] The sensor(s) of vehicle 10 correspond, for example, to one or more of the following sensors: - one or more millimeter-wave radars arranged on the vehicle 10, for example at the front, at the rear, on each front / rear corner of the vehicle; each radar is adapted to emit electromagnetic waves and to receive the echoes of these waves reflected by one or more objects (for example, the other vehicle located in front of the vehicle 10), in order to detect obstacles and their distances from the vehicle 10; and / or - one or more LIDAR(s) (from the English "Light Detection And Ranging", or "Detection and estimation of distance by light" in French), a LIDAR sensor corresponding to an optoelectronic system composed of a laser emitter device, a receiver device including a light collector (to collect the part of the light radiation emitted by the emitter and reflected by any object located in the path of the light rays emitted by the emitter) and a photodetector which transforms the collected light into an electrical signal; a LIDAR sensor thus makes it possible to detect the presence of objects (for example the other vehicle) located in the emitted light beam and to measure the distance between the sensor and each detected object; and / or - one or more cameras (associated or not with a depth sensor) for the acquisition of one or more images of the environment around the vehicle 10 located in the field of vision of the camera(s).

[0046] The active lane departure warning system (LDWS) of vehicle 10 is configured to alert the driver of vehicle 10 when a lane marking line indicating the lateral boundary of a lane being used by vehicle 10 is unintentionally crossed, i.e., without prior activation of the turn signals to indicate the intention to change lanes and thus cross this lane marking line. Such a system is known to those skilled in the art and is not described in detail. The alert is given, for example, by generating vibrations in the driver's seat 15 on the side of the lane that was unintentionally crossed.Such a system, in its active version (corresponding to the LKA system, short for Lane Keeping Assist), also includes lane keeping assistance. This means automatic trajectory control by an onboard system, through steering and / or braking actions, to guide and maintain the vehicle within its lane once an unintentional lane departure is detected. The detection of the unintentional lane departure is obtained from data from onboard sensors, such as cameras configured to capture images of the road surface passing in front of the vehicle or infrared LEDs (associated with infrared detection sensors) located on the front bumper. The vehicle's 10-degree beam, directed towards the ground, detects when a vehicle crosses a white line by analyzing differences in infrared reflection on the road. Such AFIL and LKA systems are known to those skilled in the art, for example, as described in UNECE (United Nations Economic Commission for Europe) Regulation 130.

[0047] A control process for the image projection system of the vehicle 10 is advantageously implemented by one or more processors of the display system, for example by one or more processors of one or more computers, for example the computer of the IVI system.

[0048] The different operations of the process are described below with regard to figures 2 and 3, according to different examples of implementation of the process.

[0049] Figures 2 and 3 each illustrate the result of displaying information to the driver of vehicle 10 in relation to one or more functions implemented by one or more AD AS systems such as the ACC system and / or the LKA system.

[0050] In a first operation of the process, first data representing a display mode of a set of graphic objects comprising one or more graphic objects are received from a human-machine interface (HMI) of the vehicle 10. The set of graphic objects is representative of one or more functions implemented by the AD AS system(s) of the vehicle 10 (for example the ACC system and / or the LKA system).

[0051] The display mode corresponds to one of the following display modes, selected by the driver or a passenger of the vehicle 10 via an HMI of the vehicle 10 provided for this purpose: - a first display mode for the permanent display of the set of graphic objects, that is to say, a display mode in which the set of graphic objects is continuously displayed or projected, for example as long as the associated AD AS system remains in the activated state; and - a second display mode for a temporary display of the set of graphic objects, that is to say a display mode in which the set of graphic objects is displayed or projected temporarily, for a first determined duration (for example 3, 5, 10, 20 or 30 seconds) before the display of this set of graphic objects ceases.

[0052] The HMI corresponds, for example, to: - one or more physical control devices, for example physical buttons arranged on the dashboard 11 and / or on the steering wheel 14, control levers, or any other interface known to those skilled in the art for selecting and validating a control parameter, in this case the display mode and optional the value of the first determined duration when the second display mode is selected; or - a touch interface associated with a screen embedded in the vehicle 10 such as the screen 12, the selection of the first display mode or the second display mode (or even the value of the first determined duration) being obtained by touching a graphic element (virtual button, icon, pictogram, drop-down list) of graphic content displayed on the screen, this graphic content corresponding to a page of the graphic HMI of the vehicle 10.

[0053] This initial data is received from the computer controlling the HMI (for example the IVI computer in the case of a touch interface associated with the screen 12) via one or more data buses linking this computer to the computer implementing the process.

[0054] A default display mode is configured, for example, the default display mode corresponding, for example, to the first display mode. Thus, according to this example, unless the driver or passenger of vehicle 10 takes a contrary action via the HMI, the display mode activated when an AD AS system is activated corresponds to the default display mode. The AD AS system is activated, for example, automatically when the vehicle 10 is started or is activated by a command from the driver of vehicle 10 via a control device or an HMI designed for this purpose, for example, by pressing a physical button or a touch button displayed on the touchscreen 12 of vehicle 10.

[0055] In a second operation of the process, the image projection system of the vehicle 10 is controlled to project or display a set of images comprising the set of augmented reality graphic objects on a glazed surface of the vehicle 10, for example on the windshield 17, in a field of vision corresponding to a driving position of the vehicle 10, according to the display mode identified by the first data received in the first operation.

[0056] The driving position of the vehicle 10 corresponds to the position of a driver sitting in the driver's seat 15 and looking straight ahead, i.e. in the direction of travel of the vehicle 10.

[0057] A display or projection control for graphic content or a graphic object (text, pictogram, icon, etc.) includes rendering the graphic content or graphic object, such rendering corresponding to a set of operations performed by one or more processors on the pixels of one or more images of the graphic content or graphic object to be displayed or projected. For example, rendering consists of associating pixel data (for example, color data expressed in an RGB color space) with a set of pixels in an image. the English "Red, Green, Bine" or in French "rouge, vert, bleu")) associated with each graphic object.

[0058] The display control of a graphic object or graphic content thus includes the transmission of control signals to the projection system or to a display device (or screen) of the vehicle 10 to modify the values ​​associated with the pixels associated with the graphic object or graphic content.

[0059] Displaying the set of graphic objects in augmented reality amounts to displaying one or more virtual graphic objects (for example computer-generated) superimposed on the real world visible to the driver of the vehicle 10 through the windshield 17.

[0060] Each graphic object in the set of displayed graphic objects is representative of a function implemented by the activated AD AS system.

[0061] For example, when the AD AS system corresponds to the ACC system, the set of graphic objects includes a first graphic object representing a setpoint inter-vehicle distance (called DIV). This first graphic object is illustrated, for example, in Figures 2 and 3 with reference 201. This first graphic object 201 corresponds, for example, to a set of parallel horizontal segments displayed superimposed on the lane or traffic lane 21 in which the vehicle 10 is traveling, the length of each segment decreasing as the distance from the driver's point of view increases.

[0062] The number of parallel segments is for example a function of the DIV selected by the driver: a minimum DIV is represented by a single segment, a maximum DIV by three segments and an intermediate DIV between the minimum DIV and the maximum DIV by two segments.

[0063] Of course, the number of segments is not limited to 3 and extends to other numbers, for example 2, 4, 5 or more. Similarly, the graphical representation of the first graphical object 201 is not limited to parallel segments.

[0064] Other graphic objects representing other functions implemented by the ACC system are also displayed, for example a graphic object representing the measured distance between vehicle 10 and the other vehicle in front of it, with an alert when this distance is less than a threshold.

[0065] When the AD AS system corresponds to the LKA system, the set of graphic objects includes a second first graphic object representing road marking lines laterally delimiting the traffic lane 21 on which the vehicle 10 travels. This second graphic object is illustrated for example in Figures 2 and 3 with reference 202. This second graphic object 202 corresponds for example to straight line segments overlapping the lateral limits of the traffic lane to materialize these left and right lateral limits.

[0066] The graphic representation of this second graphic object 202 varies for example when the vehicle 10 is in the center of the line (fixed display of the second graphic object) and when the vehicle 10 approaches or crosses a lateral limit (the second graphic object associated with this lateral limit then flashes for example).

[0067] Of course, the graphical representation of the second graphical object 202 is not limited to the segments illustrated in Figures 2 and 4 but extends to any graphical representation illustrating a function implemented by the LKA system.

[0068] The set of graphic objects is for example displayed semi-transparent so as to be both visible to the driver of the vehicle 10 and so as not to completely mask or obscure the real scene located behind this set of graphic objects according to the point of view of the driver of the vehicle 10.

[0069] Each graphic object in the set of graphic objects is advantageously displayed with a determined degree (or level) of opacity, the value of which is for example chosen or set by the driver or a passenger of the vehicle 10 via the HMI.

[0070] The degree of opacity of a graphic object corresponds to a property of the displayed graphic object, namely, the property of allowing a greater or lesser amount of the light it receives to pass through. The higher the opacity, the less light from outside the vehicle 10 passes through the graphic object and reaches the driver's eyes. Opacity is, for example, defined as the ratio of the incident luminous flux to the transmitted luminous flux. The opacity of an element of an image of the graphic object (i.e., a pixel of the image) is defined by an integer value (for example, between 0 and 255 when encoded on 8 bits) of the image's alpha channel. The alpha channel of a digital image corresponds to a component indicating the degree of transparency (or opacity) of each pixel of the image.

[0071] According to a first particular embodiment, when the selected display mode corresponds to the first display mode, i.e., a permanent display of the set of graphic objects, the image projection system is controlled to display or project the set of graphic objects onto the glass surface 17 permanently, for an indefinite period, as long as the AD AS system(s) to which the set of graphic objects is associated is or are in the activated state. The set of graphic objects is projected with the same degree of opacity, for example, with the first degree of opacity or the second degree of opacity, as long as the AD AS system(s) remain activated.

[0072] According to a second particular embodiment, when the selected display mode corresponds to the first display mode, i.e. a permanent display of the set of graphic objects, the image projection system is controlled to display or project the set of graphic objects onto the glass surface depending on a degree of opacity belonging to a set of degrees of opacity including a first degree of opacity and a second degree of opacity, the first degree of opacity being greater than the second degree of opacity.

[0073] According to this second embodiment, the degree of opacity used to display the set of graphic objects 201, 202 varies, as a function of time, between the first degree of opacity and the second degree of opacity. The first degree of opacity is, for example, equal to 150, 175 or 200 (on a scale of 0 to 255) and the second degree of opacity is, for example, equal to 75, 100 or 125 respectively.

[0074] According to this second embodiment, the set of graphic objects 201, 202 is displayed according to the first degree of opacity for a second determined duration (for example equal to 10, 20 or 30 s) following an activation of the AD AS system(s) and the set of graphic objects 201, 202 is displayed according to the second degree of opacity following a deadline of the second determined duration as long as the AD AS system(s) is / are in the activated state.

[0075] Fig. 2 illustrates the display of the set of graphic objects 201, 202 according to the first degree of opacity and Fig. 3 illustrates the display of the set of graphic objects 201, 202 according to the second degree of opacity, according to particular embodiment examples.

[0076] The projection of the set of graphic objects 201, 202 according to the first degree of opacity is triggered for a second determined duration upon receipt of data representative of the activation of the ADAS system(s) associated with one or more graphic objects of the set of graphic objects.

[0077] Thus, when the ACC system is activated (transition from a deactivated or inactive state to an activated or active state), one or more particular functions of the ACC system are implemented and the associated graphic object(s), for example the first graphic object 201, is or are displayed or projected onto the windshield 17 in augmented reality according to the first degree of opacity for a determined duration corresponding to the second determined duration, as illustrated in [Fig.2].

[0078] When the LKA system is activated (transition from a deactivated or inactive state to an activated or active state), one or more specific functions of the LKA system are implemented and the associated graphic object(s), for example the second graphic object 201, is or are displayed or projected onto the windshield 17 in augmented reality according to the first degree of opacity for a determined duration corresponding to the second determined duration, as illustrated in [Fig.2].

[0079] Thus, at each activation of a given ADAS system, the associated graphic object(s) are displayed on the glass surface, for example the windshield 17, with the first degree of opacity for a second determined duration, for example for 5 or 10 seconds from the moment of activation of the ADAS system.

[0080] When the second determined time has elapsed, the projection of the graphic object set 201, 202 according to the second degree of opacity is triggered for an indefinite period, as long as the AD AS system(s) associated with the graphic object set are or remain in the activated state, as illustrated in [Fig.3].

[0081] As can be seen in Figures 2 and 3, the second degree of opacity is lower than the first degree of opacity.

[0082] Since the second degree of opacity is less than the first degree of opacity, the graphic objects 201, 202 illustrated in [Fig.3] are displayed in augmented reality with more transparency than the graphic objects 201, 202 illustrated in [Fig.2], that is to say, the graphic objects 201, 202 according to the second degree of opacity are less visible to the driver than the graphic objects 201, 202 according to the first degree of opacity, reducing the potential distraction of the driver due to the display of these graphic objects.

[0083] When the AD AS system(s) are deactivated, the end of the projection of the set of graphic objects 201, 202 is controlled by the computer and no graphic object is then displayed on the windshield 17. For this purpose, the computer implementing the process receives from the computer(s) controlling the AD AS system(s) data representing the end of activation of the AD AS system, which triggers the control of the end of projection of the set of graphic objects 201, 202.

[0084] The end of the projection of the set of graphic objects also amounts to controlling the projection of this set of graphic objects with a degree of opacity equal to 0.

[0085] When the selected display mode corresponds to the second display mode, i.e. a temporary display of the set of graphic objects 201, 202, the image projection system is controlled to display or project the set of graphic objects onto the glass surface according to a determined degree of opacity (for example the first degree of opacity) for a determined duration corresponding to a first determined duration (for example equal to 5, 10, 20 or 30 s).

[0086] The control of the image projection system to display the set of graphic objects 201, 202 in augmented reality according to the second display mode is triggered by the reception of data such as: - Second data points representing an activation of the AD / AS system(s) to which the set of graphic objects 201, 202 is associated, these second data points being received from the computer controlling each AD / AS system; and / or - third data representing the adjustment of at least one control parameter of the AD / AS system(s) to which the set of graphic objects 201, 202 is associated, this third data being received from the computer controlling each AD AS system or the computer controlling the HMI through which this or these parameters were adjusted; and / or - fourth data representing the detection of a traffic event associated with vehicle 10, this fourth data being received from the computer controlling each AD AS system or from computers controlling the environmental perception sensors of vehicle 10 (for example radars, LIDAR and / or camera).

[0087] A traffic event corresponds, for example, to one of the following events, the list below not being exhaustive and being provided by way of illustration: - the presence of another vehicle in front of the vehicle according to a direction of travel of the vehicle, the presence of such a vehicle being detected from the data received from one or more environmental sensors of the vehicle 10 (radars, lidar and / or camera); - a change in the lateral position of the vehicle in a current traffic lane, such a driving deviation being detected from the data received from one or more environmental sensors of the vehicle 10, for example a camera or infrared sensors detecting the lane markings and allowing the vehicle 10 to be positioned in relation to each of these lane markings; - a change of lane from the current lane, detected for example by crossing a lane marking and / or the activation of the vehicle's turn signals 10; and - an overtaking of another vehicle, detected for example by data received from cameras, radars or lidar.

[0088] The adjustment of a parameter of the AD AS system (for example the setpoint DIV or the setpoint speed for the ACC system) is obtained via an HMI or a control device associated with the AD AS system, the parameter(s) being chosen by the driver of the vehicle 10.

[0089] The detection of the activation of an ADAS system, the detection of a traffic event, and / or the adjustment of a parameter of an active ADAS system triggers the projection of the set of graphic objects 201, 202 for a duration equal to the first determined duration when the selected display mode corresponds to the second display mode. The projection is controlled, for example, so that the set of graphic objects 201, 202 is projected according to the first degree of opacity, as illustrated in [Fig. 2] (or according to another different degree of opacity remaining greater than the second degree of opacity).

[0090] At the end of the first determined duration, the projection system is controlled to stop or automatically stop the projection of the set of graphic objects 201, 202 onto the windshield 17.

[0091] These different embodiments thus make it possible to alert the driver to a change in the traffic context for vehicle 10 (activation of a system AD AS, adjustment of a control parameter of an AD AS system and / or detection of a traffic event) by triggering the projection of the set of graphic objects 201, 202 onto the windshield 17.

[0092] Figure 4 schematically illustrates a device 4 configured for controlling a vehicle's projection system, for example, the vehicle 10, according to specific and non-limiting embodiments of the present invention. The device 4 corresponds, for example, to a device embedded in the vehicle 10, for example, a computer. The device 4 is further configured, for example, to control each device forming the vehicle 10's display system, for example, the projection system and each screen or display device of the vehicle 10.

[0093] Device 4 is, for example, configured to carry out the operations described opposite Figures 1 to 3 and / or the steps of the process described opposite [Fig. 5]. Examples of such a device 4 include, but are not limited to, embedded electronic equipment such as a vehicle's on-board computer, an electronic control unit such as an ECU (Electronic Control Unit), a smartphone, a tablet, or a laptop computer. The elements of device 4, individually or in combination, can be integrated into a single integrated circuit, into several integrated circuits, and / or into discrete components. Device 4 can be implemented in the form of electronic circuits or software (or computer) modules, or a combination of electronic circuits and software modules.

[0094] The device 4 comprises one (or more) processor(s) 41 configured to execute instructions for carrying out the steps of the process and / or for executing instructions from the software embedded in the device 4. The processor 41 may include integrated memory, an input / output interface, and various circuits known to those skilled in the art. The device 4 further comprises at least one memory 42, corresponding, for example, to volatile and / or non-volatile memory, and / or includes a memory storage device that may include volatile and / or non-volatile memory, such as EEPROM, ROM, PROM, RAM, DRAM, SRAM, flash, magnetic disk, or optical disk.

[0095] The computer code of the embedded software(s) including the instructions to be loaded and executed by the processor is for example stored on memory 42.

[0096] According to various particular and non-limiting embodiments, the device 4 is coupled in communication with other similar devices or systems and / or with communication devices, for example a TCU (Telematic Control Unit), for example via a communication bus or through dedicated input / output ports.

[0097] According to a particular and non-limiting embodiment, the device 4 includes a block 44 of interface elements for communicating with external devices. The interface elements of the block 44 include one or more of the following interfaces: - radio frequency RF interface, for example of the Wi-Fi® type (according to IEEE 802.11), for example in the 2.4 or 5 GHz frequency bands, or of the Bluetooth® type (according to IEEE 802.15.1), in the 2.4 GHz frequency band, or of the Sigfox type using UBN (Ultra Narrow Band) radio technology, or LoRa in the 868 MHz frequency band, LTE (Long-Term Evolution), LTE-Advanced; - USB interface (from the English "Universal Serial Bus" or "Universal Serial Bus" in French); - HDMI interface (from the English "High Definition Multimedia Interface", or "High Definition Multimedia Interface" in French); - LIN interface (from the English "Local Interconnect Network", or in French "Réseau interconnecté local").

[0098] According to another particular and non-limiting embodiment, the device 4 includes a communication interface 44 which allows communication to be established with other devices (such as other computers in the embedded system) via a communication channel 440. The communication interface 44 corresponds, for example, to a transmitter configured to transmit and receive information and / or data via the communication channel 440. The communication interface 44 corresponds, for example, to a wired network of the CAN (Controller Area Network) type, CAN FD (Controller Area Network Flexible Data-Rate), FlexRay (standardized by ISO 17458) or Ethernet (standardized by ISO / IEC 802-3).

[0099] According to a particular and non-limiting embodiment, the device 4 can provide output signals to one or more external devices, such as a display screen 450, touch or not, one or more loudspeakers 460 and / or other peripherals 470 (projection system) via output interfaces 45, 46 and 47 respectively. According to a variant, one or more of the external devices is integrated into the device 4.

[0100] Figure 5 illustrates a flowchart of the different stages of a method for controlling an image projection system of a vehicle, for example vehicle 10, according to a particular and non-limiting embodiment of the present invention. The method is, for example, implemented by a device embedded in vehicle 10. or by device 4 of [Fig.4], in particular by one or more processors of such device 4.

[0101] In a first step 51, initial data representing a display mode for a set of graphical objects comprising at least one graphical object are received from a human-machine interface of the vehicle. The set of graphical objects is representative of at least one function implemented by at least one AD AS system of the vehicle, the display mode comprising a first display mode for a permanent display of the set of graphical objects and a second display mode for a temporary display of the set of graphical objects.

[0102] In a second step 62, the image projection system is controlled to display the set of graphic objects in augmented reality according to the display mode, the image projection system being configured to project a set of images representative of the set of graphic objects onto a glazed surface of the vehicle in a field of vision corresponding to a driving position of the vehicle.

[0103] According to one variant, the variants and examples of the operations described in relation to one of Figures 1 to 4 apply to the steps of the process in [Fig. 5].

[0104] Of course, the present invention is not limited to the embodiments described above but extends to a method for displaying graphic content representing information relating to one or more ADAS systems of a vehicle, which would include secondary steps without departing from the scope of the present invention. The same would apply to a device configured for implementing such a method.

[0105] The present invention also relates to a vehicle, for example an automobile or more generally an autonomous land-powered vehicle, comprising the device 4 of [Fig.4] or a display system comprising the device 4 of [Fig.4] connected in communication to a projection system or a screen 13.

Claims

Demands

1. Method for controlling an image projection system of a vehicle (10), said vehicle (10) carrying at least one driver assistance system, said AD AS system, said method being implemented by at least one processor and comprising the following steps: - receiving (51) first data representative of a display mode of a set of graphic objects comprising at least one graphic object, said set of graphic objects (201, 202) being representative of at least one function implemented by said at least one AD AS system, said display mode comprising a first display mode for a permanent display of said set of graphic objects and a second display mode for a temporary display of said set of graphic objects, said first data being received from a human-machine interface of said vehicle (10);- control (52) of said image projection system to display said set of augmented reality graphic objects according to said display mode, said image projection system being configured to project a set of images representative of said set of graphic objects (201, 202) onto a glazed surface of said vehicle (10) in a field of vision corresponding to a driving position of said vehicle (10).;

2. A method according to claim 1, wherein the control (52) of said image projection system for displaying said set of graphic objects (201, 202) in augmented reality according to the second display mode is triggered by the reception of second data representing an activation of said at least AD AS system, third data representing the adjustment of at least one control parameter of said at least one AD AS system and / or fourth data representing the detection of a traffic event associated with said vehicle, said set of graphic objects (201, 202) being displayed for a first determined duration according to said second display mode.

3. A method according to claim 2, wherein said traffic event belongs to a set of traffic events comprising: - the presence of another vehicle in front of said vehicle (10) according to a direction of travel of said vehicle (10); - a change of lateral position of said vehicle (10) in a current traffic lane (21); - a change of traffic lane from the current traffic lane (21); and - an overtaking of another vehicle.

4. A method according to any one of claims 1 to 3, wherein the control (52) of said image projection system for displaying said set of graphic objects (201, 202) in augmented reality according to the first display mode is further a function of a degree of opacity belonging to a set of degrees of opacity comprising a first degree of opacity and a second degree of opacity, said first degree of opacity being greater than said second degree of opacity.

5. A method according to claim 4, wherein said set of graphic objects (201, 202) is displayed according to said first degree of opacity for a second specified duration following an activation of said at least one AD AS system and said set of graphic objects (201, 202) is displayed according to said second degree of opacity following a deadline of said second specified duration as long as said at least one AD AS system is in an activated state.

6. A method according to any one of claims 1 to 5, wherein said at least one AD AS system belongs to a set of AD AS systems comprising: - an adaptive speed control system, referred to as the ACC system; and - a lane keeping assist system, referred to as the LKA system.

7. A method according to claim 6, wherein said set of graphic objects comprises: - a first graphic object (201) representing a set inter-vehicle distance when said at least one AD AS system corresponds to said ACC system; and / or - a second graphic object (202) representing lane marking lines laterally delimiting said traffic lane when said at least one AD AS system corresponds to said LKA system.

8. Computer program comprising instructions for carrying out the method according to any one of claims 1 to 7, when such instructions are executed by at least one processor.

9. Device (4) for controlling an image projection system of a vehicle (10), said device (4) comprising a memory (42) associated with at least one processor (41) configured for carrying out the steps of the method according to any one of claims 1 to 7.

10. Vehicle (10) comprising the device (4) according to claim 9.

Images