Method and control device for a display system for displaying a crosswind zone warning for a vehicle

Abstract

The present invention relates to a method and device for controlling a vehicle display system. To this end, the presence of a crosswind risk zone is detected when the vehicle is approaching and at a predetermined distance from the beginning or end of such a zone. The display of augmented reality graphic content (30) is controlled to display this graphic content (30) on a display device (13). The graphic content (30) comprises an image (31) of a real scene located in front of the vehicle and a virtual graphic object (32) superimposed on the image (31). A graphic representation of the virtual graphic object (32) is a function of data relating to wind intensity in the crosswind risk zone. Figure 3 (for the abstract)

Description

Title of the invention: Method and device for controlling a display system for displaying a crosswind warning zone for a vehicle technical field

[0001] The present invention relates to methods and devices for controlling a display system embedded in a vehicle, in particular but not exclusively a motor vehicle. The present invention also relates to a method and a display system or device for signaling a crosswind zone in a vehicle approaching such a zone. Technological background

[0002] To assist the driver of a vehicle, it is known to display information relating to the road environment in which the vehicle is traveling, for example on a vehicle display device or on a display screen of a mobile communication device such as a smartphone installed in the vehicle. The display of such information is done, for example, via a human-machine interface (HMI) of a navigation system. Such a navigation system uses mapping data such as digital road maps indicating the roads in the road environment in which the vehicle is traveling, this mapping data being associated with or including additional data relating to the road environment such as the presence of points of interest such as parking lots or information on current traffic conditions.

[0003] Certain information, particularly useful to the driver for ensuring their own safety and that of the passengers in the vehicle, is difficult to present to the driver. For example, information relating to areas at risk of crosswinds that the vehicle may have to cross during a journey is difficult to represent on a map, for example.

[0004] To ensure the safety of the vehicle and its passengers, it is important to provide the driver with the information necessary to control the vehicle according to the situations encountered during a journey. Summary of the present invention

[0005] One object of the present invention is to solve at least one of the problems of the technological background described above.

[0006] Another object of the present invention is to better alert a driver of a vehicle to a risk associated with an area at risk of crosswinds.

[0007] Another object of the present invention is to improve the user experience vis- regarding information associated with a crosswind risk area towards which the vehicle is approaching.

[0008] According to a first aspect, the present invention relates to a method for controlling a display system embedded in a vehicle, the display system comprising a display device, the method comprising the following steps: - obtaining initial data representative of the presence of an area at risk of crosswinds on a section of road on which the vehicle is traveling; - reception of second representative wind intensity data at the level of the area at risk of lateral wind via a wireless communication method; - control of display of augmented reality graphic content on the display device, the graphic content comprising an image of a real scene located in front of the vehicle acquired by a camera mounted in the vehicle and a virtual graphic object superimposed on the image, the virtual graphic object comprising a set of graphic objects representative of the area at risk of crosswind, a graphic representation of the virtual graphic object being a function of the second data.

[0009] Such a method allows a vehicle driver to be visually alerted when approaching an area at risk of crosswinds, the alert being further adapted to the intensity or strength of the wind in the area the vehicle is approaching. The use of augmented reality makes it possible to overlay virtual objects onto an image of the scene, providing the driver with clear information on the presence of an area at risk of crosswinds and on the reality of this risk by taking into account the wind intensity. This allows the vehicle control to be adjusted to the specific situation encountered, with an anticipation of the associated risks.

[0010] According to one variant, the first data are determined from third data representing the geographical positions of the vehicle, fourth data representing a map of a road environment in which the vehicle travels and fifth data representing the location of a set of areas at risk of crosswind included in the road environment.

[0011] According to yet another variant, the graphical representation of the virtual graphical object corresponds to: - a first graphic representation corresponding to a gantry supporting at least one first graphic object representing a road sign indicating the start of a crosswind risk zone and at least one second graphic object representing a light signal when the first data are representative of the start of a crosswind risk zone and the second data are representative of an intensity exceeding a threshold; and - a second graphic representation of the frame supporting at least one first graphic object and at least a second graphic object when the first data are representative of the beginning of a zone at risk of lateral wind and the second data are representative of an intensity below the threshold.

[0012] According to another variant: - the gantry is represented with a first color and the second graphic object represents a flashing light signal when the virtual graphic object is represented according to the first graphic representation; and - the gantry is represented with a second color different from the first color and the second graphic object is representative of a fixed light signal when the virtual graphic object is represented according to the second graphic representation.

[0013] According to a further variant, the graphical representation of the virtual graphical object corresponds to: - a third graphic representation corresponding to the gantry supporting at least a third graphic object representing a road sign indicating the end of a crosswind risk zone, where the first data points represent the end of a crosswind risk zone and the second data points represent an intensity exceeding the threshold; and - a fourth graphical representation of the gantry supporting at least a third graphical object when the first data are representative of the end of a zone at risk of lateral wind and the second data are representative of an intensity below the threshold.

[0014] According to an additional variant: - the gantry is represented with the first color when the virtual graphic object is represented according to the third graphic representation; and - the gantry is represented with the second color when the virtual graphic object is represented according to the fourth graphic representation.

[0015] According to another variant, the method further includes a step of receiving sixth data representing the activation or deactivation of a crosswind risk zone warning service from a human-machine interface on board the vehicle, the control of displaying the graphic content being a function of the sixth data.

[0016] According to a second aspect, the present invention relates to a control device for a display system embedded in a vehicle, the device comprising a memory associated with a processor configured for the implementation of the steps of the process according to the first aspect of the present invention.

[0017] According to a third aspect, the present invention relates to a vehicle, for example a motor vehicle, comprising a device as described above according to the second aspect of the present invention.

[0018] According to a fourth aspect, the present invention relates to a computer program which includes instructions adapted for carrying out the steps of the process according to the first aspect of the present invention, in particular when the computer program is executed by at least one processor.

[0019] Such a computer program may use any programming language, and be in the form of source code, object code, or an intermediate form between source code and object code, such as in a partially compiled form, or in any other desirable form.

[0020] According to a fifth aspect, the present invention relates to a computer-readable recording medium on which is recorded a computer program comprising instructions for carrying out the steps of the process according to the first aspect of the present invention.

[0021] On the one hand, the recording medium can be any entity or device capable of storing the program. For example, the medium can include a storage means, such as a ROM, a CD-ROM or a microelectronic circuit-type ROM, or a magnetic recording means or a hard disk drive.

[0022] On the other hand, this recording medium can also be a transmissible medium such as an electrical or optical signal, such a signal being able to be transmitted via an electrical or optical cable, by conventional or radio frequency, by self-directing laser beam, or by other means. The computer program according to the present invention can, in particular, be downloaded from an Internet-type network.

[0023] Alternatively, the recording medium may be an integrated circuit in which the computer program is incorporated, the integrated circuit being adapted to execute or to be used in the execution of the process in question. Brief description of the figures

[0024] Other features and advantages of the present invention will become apparent from the description of the particular and non-limiting embodiments of the present invention below, with reference to the attached Figures 1 to 6, in which:

[0025] [Fig-1] schematically illustrates a vehicle environment, according to an example of particular and non-limiting implementation of the present invention;

[0026] [Fig.2] schematically illustrates a passenger compartment of the vehicle of [Fig.1], according to a particular and non-limiting embodiment of the present invention;

[0027] [Fig.3] schematically illustrates a display screen embedded in the vehicle of [Fig.1], according to a first particular and non-limiting embodiment of the present invention;

[0028] [Fig.4] schematically illustrates a display screen embedded in the vehicle of [Fig.1], according to a second particular and non-limiting embodiment of the present invention;

[0029] [Fig.5] schematically illustrates a device configured for the control of an on-board display system in the vehicle of [Fig.1], according to a particular and non-limiting embodiment of the present invention;

[0030] [Fig.6] illustrates a flowchart of the different stages of a control process for an on-board display system in the vehicle of [Fig.1], according to a particular and non-limiting embodiment of the present invention. Description of examples of achievements

[0031] A method and a control device for an on-board display system in a vehicle will now be described in what follows with joint reference to Figures 1 to 6. The same elements are identified with the same reference signs throughout the following description.

[0032] The terms "first," "second" (or "firsts," "seconds"), etc., are used in this document by arbitrary convention to allow for the identification and distinction of different elements (such as operations, means, etc.) implemented in the embodiments described below. Such elements may be distinct or correspond to a single element, depending on the embodiment.

[0033] According to a particular and non-limiting example of an embodiment of the present invention, the control of a display system embedded in a vehicle is, for example, implemented by one or more computers of the vehicle, for example via one or more processors, or by one or more processors of a mobile communication device embedded in the vehicle, in particular when the display system is integrated into the mobile communication device.

[0034] To this end, initial data representative of the presence of a crosswind risk zone on a section of road on which the vehicle is traveling are obtained. This initial data is obtained, for example, by analyzing one or more images acquired by a camera mounted on the vehicle and detecting objects in these images that are representative of the presence of such a zone (crosswind risk sign and / or windsock). According to another example, the initial data is determined from third data points representing the vehicle's geographical positions, fourth data points representing a map of the road environment in which the vehicle is traveling, and fifth data points representing the location of a set of crosswind risk zones within the road environment.

[0035] Second data representing the intensity or strength of the wind at the level of the area at risk of crosswinds are received according to a communication method wireless, for example from a remote device such as a "cloud" server, for example a weather server.

[0036] The display of augmented reality graphic content is controlled such that this graphic content is displayed on a display device of the vehicle's display system. The graphic content comprises an image of a real scene located in front of the vehicle, which image is acquired by a camera on board the vehicle (for example, a vehicle camera or a camera of the mobile communication device), and a virtual graphic object displayed as an overlay on the image. The virtual graphic object comprises a set of graphic objects representing the crosswind risk zone that the vehicle is approaching. The virtual graphic object is represented according to a specific graphic representation that is a function of the second set of data, i.e., the intensity or strength of the wind.

[0037] The initial data includes data or information indicating, for example, the beginning of an area where there is a risk of strong crosswinds (i.e., winds coming from one side or the other of the roadway), with a risk of causing the vehicle's trajectory to deviate. Such an area corresponds to a geographical zone whose particular characteristics result in a greater risk of strong winds than elsewhere. For example, such an area might include a section of road with a high bridge or viaduct, a hilltop exposed to the wind, a windy rural area, etc. In one embodiment, the initial data further includes data or information indicating the end of the crosswind risk zone.

[0038] Fig. 1 schematically illustrates a vehicle 10 in an environment 1, according to a particular and non-limiting embodiment of the present invention.

[0039] Fig. 1 illustrates a vehicle 10, for example a motor vehicle, in an environment 1, the environment 1 corresponding to a road environment in which the vehicle 10 moves and travels.

[0040] Vehicle 10 corresponds, for example, to a vehicle with an internal combustion engine, with electric motor(s), or even a hybrid vehicle with an internal combustion engine and one or more electric motors. Vehicle 10 thus corresponds, for example, to a land vehicle, for example a car, a truck, a bus.

[0041] According to the example in [Fig. 1], the vehicle 10 is traveling on a road or section of road 110 comprising one or more traffic lanes and located in or leading into a crosswind risk zone. The vehicle 10 is thus approaching the crosswind risk zone, that is to say, the crosswind risk zone is downstream of the vehicle 10 (or in front of the vehicle 10) depending on the direction of travel of the vehicle 10.

[0042] According to the example in [Fig. 1], the beginning of the crosswind risk zone is ma This is indicated by a road sign 111 of type A24, signaling a danger and announcing the presence of crosswinds. Such a sign 111 depicts a windsock. In another example, the presence of a crosswind risk zone is indicated by a windsock 112 placed at the edge of the road; this windsock 112 may, for example, be placed in addition to or instead of the sign 111.

[0043] According to a particular embodiment, the vehicle 10 carries a communication system configured to communicate with one or more remote devices or servers 103 via a wireless communication network infrastructure.

[0044] The remote server(s) 103 each correspond, for example, to a server in the "cloud" 100. The wireless communication infrastructure includes, for example, a set of LTE (Long Term Evolution) 4G or 5G cellular network antenna communication devices 102. In one embodiment, the communication devices belonging to the wireless communication infrastructure correspond to UBRs (Roadside Units).

[0045] The communication system of the vehicle 10 includes, for example, one or more communication antennas connected to a telematic control unit, called a TCU (from the English "Telematic Control Unit"), itself connected to one or more computers of the vehicle's on-board system 10. The antenna(s), the TCU and the computer(s) form, for example, a multiplexed architecture for the implementation of various services useful for the proper functioning of the vehicle and for assisting the driver and / or passengers of the vehicle in controlling the vehicle 10.The computer(s) and the TCU communicate and exchange data with each other via one or more computer buses, for example a CAN (Controller Area Network), CAN FD (Controller Area Network Flexible Data-Rate), FlexRay (according to ISO 17458) or Ethernet (according to ISO / IEC 802-3) type communication bus.

[0046] According to a particular embodiment, the vehicle 10 carries a navigation and geolocation system, also called a GNSS (Geolocation and Navigation by Satellite System) system, for example a GPS (Global Positioning System) or Galileo type system. According to this embodiment, the vehicle 10 carries a geolocation system receiver enabling the vehicle 10 to obtain third data representative of its geographic position at any time instant, for example in the form of GPS coordinates (latitude and longitude), via a satellite link with a set of 101 satellites.

[0047] The vehicle 10's navigation system is, for example, connected via an OTA (Over The Air) link to receive mapping data and data relating to the presence of one or more areas at risk of crosswinds, for example as the vehicle 10 moves, via the vehicle 10's communication system. According to one variant, such data is recorded in a memory of the vehicle 10 associated with the navigation system, the recorded data being, for example, updated via the OTA link (for example periodically or when the mapping data and / or the level crossing and barrier data have been updated on the remote device 103).

[0048] According to one embodiment, the vehicle 10, for example the navigation system, further receives meteorological data relating to the intensity or strength of the wind in the environment 1 or at the level of the geographical area in which the vehicle 10 is traveling at the current time. The meteorological data is received from a remote device such as a cloud server, such as the remote device 103.

[0049] According to another particular embodiment, the vehicle 10 carries a mobile communication device, such as a smartphone (from the English "Smartphone") or a tablet, such a wireless communication device being, for example, arranged on a support fixed to an element of the vehicle's interior 10 so that the display screen of the mobile communication device is visible to the driver when the latter is driving the vehicle 10. According to such an embodiment, the mobile communication device incorporates a navigation and geolocation system, also called a GNSS (Geolocation and Navigation by a Satellite System) system, for example a GPS type system (from the English "Global Positioning System" or in French "Système de géo-positionnement par satellites"), for example installed on the communication device in the form of a mobile application.Such an embodiment allows the driver of the vehicle 10 to use the navigation system and display system of the mobile communication device, for example, when the vehicle 10 does not have a navigation system or when the driver prefers to use the navigation system of the mobile communication device instead of the navigation system of the vehicle 10. The mobile communication device is advantageously connected wirelessly to the remote device(s) 103 via the wireless network infrastructure, for example, to receive mapping data as well as data relating to crosswind risk zones, or updates to such data stored in the memory of the mobile communication device. The mobile communication device is by. example connected wirelessly to vehicle 10, for example via a Bluetooth® or Wifi® type wireless link.

[0050] Remote server 103 is configured, for example, to send data relating to road infrastructure such as: - fourth mapping data, for example fourth data representing road maps, and / or - fifth data representative of one or more areas at risk of crosswind, for example data representative of the coordinates of the start of each area or location data of this or these areas on the roads with the start and end of the area.

[0051] The remote server 103 or another remote server separate from the remote server is further configured to transmit second data representing the predicted, estimated, or measured wind intensity (or strength) at each crosswind risk zone. The wind intensity is, for example, expressed in km / h (kilometers per hour), with a level ranging, for example, from 1 to 5 or from 1 to 10 (1 corresponding to the lowest wind strength and 5 or 10 to the highest), or with a binary or boolean value to indicate whether the wind is weak (i.e., below a specified threshold) or strong (i.e., above a specified threshold).

[0052] According to a particular embodiment illustrated in [Fig.2], vehicle 10 carries a display system comprising a display device or screen 13 and a computer configured to control the display of content(s) of a graphic HMI on the touch screen 13. The computer corresponds for example to the computer of the infotainment system, called the IVI computer (from the English "In-Vehicle Infotainment" or in French "Infodivertissement étoilé") of the vehicle 10.

[0053] According to one embodiment, the vehicle display system 10 includes one or more other screens, for example a screen of a device or system called a head-up display corresponding for example to a transparent or semi-transparent blade arranged in such a way that a driver sitting in the seat 16 sees the content displayed or projected onto the transparent blade when the driver drives the vehicle 10, or a display screen 15 called a combination or instrument panel generally arranged in an area behind the steering wheel 14 in the dashboard 11.

[0054] The screen 13 is for example associated with a touch interface and corresponds for example to an LCD type screen (from the English "Liquid Crystal Display" or in French "Affichage à cristals liquide"), for example of the TFT type (from the English "Thin-Film Transistor" or in French "Transistor en film mince"), or OLED (from the English "Organic Light-Emitting Diode" or in French "Diode électroluminescente organique").

[0055] Screen 13 is configured to display content for the driver and vehicle passengers. Screen 13 is also configured to allow the driver and / or vehicle passengers to interact with one or more vehicle-mounted systems via a human-machine interface (HMI) displayed on screen 13. For example, screen 13 is configured to interact with the IVI system and / or a vehicle navigation system 10.

[0056] According to a particular embodiment, the screen 13 is not integrated into the vehicle's passenger compartment but corresponds to a screen of a mobile communication device (smartphone, tablet), connected in communication, for example wirelessly, with the vehicle's embedded system 10.

[0057] The vehicle 10 also carries, for example, one or more cameras, for example, a camera 12 corresponding to a front-facing camera (also called a windshield camera). Such a camera 12 is arranged in the passenger compartment of the vehicle 10 below the windshield and at the top and in the middle of this windshield. Such a front-facing camera 12 has a field of view corresponding to the space located in front of the vehicle 10 in the direction of travel of the vehicle 10. Such a camera 12 is thus configured for acquiring image data representative of the actual scene located in front of the vehicle 10, in the direction of travel of the vehicle 10.

[0058] Camera 12 includes, for example, the following elements: - a photosensitive sensor corresponding for example to a matrix of photoreceptors associated for example with a Bayer filter; - an optical assembly arranged in front of the sensor with respect to the scene to be acquired by the sensor, the optical assembly comprising, for example, an arrangement of one or more lenses; and - optionally one or more computers associated with memory and configured for processing images acquired by the sensor.

[0059] According to one embodiment, the camera corresponds to a camera of the mobile communication device installed in the vehicle 10, if applicable. The camera of the mobile communication device is also configured to acquire image data representative of the actual scene in front of the vehicle 10, depending on the location of the mobile communication device within the passenger compartment of the vehicle 10.

[0060] A control process for an on-board display system in the vehicle 10 is advantageously implemented by one or more processors of the display system, for example by a computer of an on-board system of the vehicle 10 such as the IVI system or the navigation system, or by a processor of the mobile communication device. The on-board display system thus corresponds to a display device integrated into the vehicle 10 or to a display system of a mobile communication device itself embedded in the vehicle 10.

[0061] In a first operation of the process, initial data representative of the presence of a crosswind risk zone on a section of road on which the vehicle 10 is traveling are obtained, for example received from another device (for example another computer of the vehicle 10) or determined from other data.

[0062] According to a first embodiment, the presence of the crosswind risk zone is detected or determined by cross-referencing third data representing the geographical positions of the vehicle 10, fourth data representing a map of the road environment 1 in which the vehicle 10 travels, and fifth data representing the location of a set of crosswind risk zones included in the road environment 1.

[0063] According to one embodiment, the fifth data received is representative only of the crosswind risk zone from which the vehicle 10 is approaching, this fifth data being received knowing the current position of the vehicle 10 (via the third data) and the mapping (via the fourth data).

[0064] According to another variant, the fifth data form part of the fourth data, that is to say that the mapping data include the position or location of areas at risk of lateral wind.

[0065] The third data are for example received from a receiver of a geolocation system 101. The fourth and fifth data are for example received from a memory and / or a remote device such as a server 103 configured to make such data available to navigation systems of so-called connected vehicles and / or mobile navigation applications of mobile communication devices.

[0066] The fourth and fifth data received correspond, for example, to data relating to the road environment in which the vehicle 10 is traveling at each moment, these fourth and fifth data varying as the vehicle 10 moves in its environment 1. For example, the fourth and fifth data relate to an area surrounding the vehicle 10, for example over a radius of a few kilometers or a few hundred meters.

[0067] According to a second embodiment, the presence of the crosswind risk zone is detected or determined by analyzing image data of the scene in front of the vehicle 10 acquired by the camera 12 or by a camera of a traffic sign recognition system of the vehicle 10, as the vehicle 10 moves along the road 110.

[0068] Image data analysis includes the detection and recognition of specific objects, such as an A24-type road sign and / or a windsock. When such an object is detected in one or more acquired images, the presence an area at risk of crosswind is detected and the first data is generated, then transmitted to the computer implementing the process by the computer controlling the image analysis system.

[0069] The detection of the presence of the crosswind risk zone is obtained, for example, when the vehicle 10 arrives at a predetermined distance from the start of such a zone, for example, when the vehicle 10 is located 50, 100, 200, or 500 m from the start of the crosswind risk zone (the start of the zone being, for example, marked by the presence of sign 111 or indicated in the fifth data point). The detection distance corresponds, for example, to a fixed parameter of the system or to a parameter adjustable by a user of the system, for example, by the driver of the vehicle 10.

[0070] In a second operation of the process, second data representative of wind intensity at the level of the area at risk of crosswind are received according to a wireless communication mode, for example according to an I2V type communication mode (from the English "Infrastructure-to-Vehicle" or in French "Infrastructure to vehicle") and / or according to a wireless link using a 4G or 5G type cellular network.

[0071] The second data is received from a remote server such as server 103 configured to store and transmit meteorological data, including the strength or intensity of the wind (estimated according to a meteorological model or measured by anemometers arranged in the environment 1) in different locations and in particular at the level of the area at risk of crosswind from which the vehicle 10 is approaching.

[0072] The second set of data is received automatically by the vehicle 10, for example at regular intervals, this second set comprising a series of wind intensity values ​​at different locations. In another example, the second set of data is received automatically and comprises only the wind intensity in the crosswind risk zone toward which the vehicle 10 is approaching. According to this other example, the vehicle 10 transmits, for example, its geographical location at regular intervals, and the server, detecting the presence of the vehicle 10 approaching the crosswind risk zone, automatically transmits the second set of data relating to this crosswind risk zone.According to yet another example, the second data is transmitted by the remote server to vehicle 10 following the transmission from vehicle 10 to the remote server of a request to receive the second data, the request including for example the geographical position data of vehicle 10 at the time of transmission of the request so that the remote server transmits back the second data for the area including the position of vehicle 10.

[0073] In a third operation of the process, the display of augmented reality graphic content is controlled so that this graphic content is displayed on a display device, for example screen 13.

[0074] The display control is triggered by the detection of the presence of the area at risk of lateral wind materialized by obtaining the first data at the first operation of the process.

[0075] The graphic content advantageously includes: - an image of the actual scene located in front of vehicle 10 acquired by a camera mounted in vehicle 10 such as camera 12; and - a virtual graphic object displayed as an overlay on the image, the virtual graphic object comprising a set of graphic objects representing the area at risk of lateral wind, a graphic representation of the virtual graphic object being a function of the second data, that is to say of the intensity of the wind at the level of the area at risk of lateral wind.

[0076] Display control includes rendering the graphic content, such rendering corresponding to a set of operations performed by one or more processors on the pixels of the image to compose the graphic content. For example, rendering consists of associating a set of pixels of the image with pixel data (for example, color data expressed in an RGB (Red, Green, Blue) type space) associated with the virtual graphic object.

[0077] The virtual graphic object (and the graphic objects that this virtual graphic object comprises) corresponds to a graphic object obtained by image synthesis, the virtual graphic object being superimposed on the image at a determined location, for example at a determined distance from the viewpoint associated with the image, that is to say at a location situated at a determined distance from the viewpoint of the camera 12, for example. Thus, the pixels of the first image at the location of the overlay of the virtual graphic object in the image are replaced by the pixels defining the virtual graphic object.

[0078] The graphical representation of the virtual graphical object 32 corresponds to: - a first graphic representation corresponding to a gantry supporting at least one first graphic object representing a road sign indicating the start of an area at risk of crosswinds and at least one second graphic object representing a light signal when the first data are representative of the start of an area at risk of crosswinds and the second data are representative of an intensity exceeding a threshold (corresponding to a risk of strong winds); and - a second graphical representation of the gantry supporting at least one first graphical object and at least one second graphical object when the first data are representative of the beginning of a zone at risk of crosswinds and the second data are representative of an intensity below the threshold (corresponding to a risk of low or moderate wind).

[0079] Fig. 3 illustrates an example of the result of such a rendering of the virtual graphic object, i.e. the display of graphic content 30 on the screen 13 with the virtual graphic object 32 according to the first or second graphic representation.

[0080] The graphic content 30 thus displayed results from the embedding of a virtual graphic object 32, for example a 3-dimensional (3D) graphic object, on an image 31 whose content represents the real scene that the driver sees (at least partially) through the windshield of the vehicle 10 at the moment of acquisition of the image 31 (or with a slight time delay necessary for the composition of the graphic content 30, on the order of a few hundred milliseconds for example).

[0081] The result of the rendering thus corresponds to content called augmented reality (noted RA, or AR in English for "Augmented Reality") in that this content mixes content representing a real environment (acquired by a camera) with digital virtual content obtained by computer.

[0082] The graphic content 30 varies according to the movement of the vehicle 10 on the road, as the vehicle 10 moves along the road, via: - the displayed image 31, which varies as image data is received from camera 12, depending on the viewpoint of camera 12, which evolves and varies according to the movement of vehicle 10, the images being, for example, refreshed / displayed at a frequency of 24, 48 or 50 frames per second; and - an adjustment of the representation of the virtual graphic object 32 as the vehicle 10 moves, the virtual graphic object 32 being for example superimposed on the image at a constant distance from the viewpoint of the camera 12 or the representation of the virtual graphic object 32 being modified as the vehicle moves to provide the illusion to the driver that the vehicle 10 is approaching the virtual graphic object 32, the adjustment of the graphic representation allowing the perspective to be adapted according to the evolution of the viewpoint of the graphic content 30 which varies with the movement of the vehicle 10, until the vehicle 10 passes virtually under the virtual graphic object 32 which then disappears from the graphic content 30.

[0083] According to the example in [Fig.3], the virtual graphic object 32 is representative of a gantry supporting one or more first graphic objects or pictograms 321 each representing a warning sign for risk of crosswind and / or strong wind (sign of type A24 for example) and a second graphic object or pictogram 322 representing one or more light signals.

[0084] According to the particular example of [Fig.3], the second graphic object 322 is arranged in the middle of the first two graphic objects 321.

[0085] Of course, the virtual graphic object 32 is not limited to such a representation but extends to any virtual graphic representation, for example to a gallows or a lateral post supporting the first and second graphic objects 321, 322, or a line drawn on the ground with the first and second graphic objects superimposed.

[0086] According to a particular embodiment, the first graphic representation includes the gantry represented with a first color (for example, red) and the second graphic object 322 is representative of a flashing light signal when the virtual graphic object is represented according to the first graphic representation, that is, when the wind at the level of the area at risk of crosswind from which the vehicle 10 approaches is greater than a threshold (corresponding to a risk of strong wind).

[0087] According to this particular embodiment, the second graphic representation includes the gantry represented with a second different color (for example, green) from the first color and the second graphic object 322 is representative of a fixed light signal when the virtual graphic object 32 is represented according to the second graphic representation (corresponding to a low or moderate wind risk).

[0088] Other colours can of course be used, such as for example orange for the first colour or blue for the second colour.

[0089] The flashing light signal draws the driver's attention to a situation requiring increased vigilance, for example when the wind blowing at the level of the area at risk of crosswind is strong, i.e. above the threshold.

[0090] When the second data indicates an intensity according to a wind speed (in km / h) or an intensity level on a determined scale (for example from 1 to 5 or from 1 to 2), the process further includes a comparison of this intensity information to the threshold (which is fixed or configurable) to determine whether the wind intensity is above or below the threshold.

[0091] According to another particular embodiment, when the first data include information on the beginning of the crosswind risk zone and information on the end of this zone (for example when the fifth data received include this two pieces of information), the graphic representation of the virtual graphic object includes other graphic representations in addition to the first and second graphic representations described above.

[0092] Fig. 4 illustrates an example of the result of such a rendering of the virtual graphic object, i.e. the display of graphic content 40 on the screen 13 with the virtual graphic object 42, according to a third or fourth graphic representation of the virtual graphic object, superimposed on an image 41 of the real scene.

[0093] Thus, according to the example in [Fig. 4], the graphical representation of the virtual graphical object 42 corresponds to: - a third graphic representation corresponding to the gantry supporting one or more third graphic objects 421 (2 third graphic objects according to [Fig.4]) representing a road sign indicating the end of a crosswind risk zone when the first data are representative of the end of a crosswind risk zone and the second data are representative of an intensity exceeding the threshold; and - a fourth graphic representation of the gantry supporting the third graphic object(s) 421 when the first data are representative of the end of a zone at risk of lateral wind and the second data are representative of an intensity below the threshold.

[0094] Unlike the first and second graphical representations, neither the third nor the fourth graphical representation includes a graphical object representing a light signal.

[0095] The gantry is represented with the first color (for example the color red) when the virtual graphic object 42 is represented according to the third graphic representation and the gantry is represented with the second color (for example the color green) when the virtual graphic object is represented according to the fourth graphic representation.

[0096] The virtual graphic object 32 is, for example, displayed at the beginning of the crosswind risk zone, the geographical coordinates of which are fixed in the real world. Thus, the graphic representation of this virtual graphic object 32, whether according to the first or second graphic representation, varies as the vehicle 10 moves towards the beginning of the zone. The dimensions of the virtual graphic object 32 are modified, for example, as the vehicle 10 approaches the beginning of the zone to give the visual impression that the vehicle is approaching the beginning of the zone, until it passes it.

[0097] When the virtual graphic object 32 takes the form of a gantry, its graphic representation is adapted to give the driver the illusion that the vehicle 10 passes under the gantry when the vehicle 10 physically reaches the beginning of the zone, the virtual graphic object 32 disappearing from the graphic content 30 once the vehicle 10 has passed the beginning of the zone.

[0098] Similarly, the virtual graphic object 42 is displayed at the end of the crosswind risk zone, the geographical coordinates of which are fixed in the real world. As with the virtual graphic object 32, the graphic representation of the virtual graphic object 42 is adapted to the movement of the vehicle 10, until the vehicle 10 crosses the end of the zone.

[0099] According to a particular embodiment, the display of the virtual graphic object 32, 42 is controlled so that the display begins when the vehicle 10 is at a The display is set at a specific distance from the start or end of the crosswind risk zone, for example, when vehicle 10 is 150 m from the start or end of the crosswind risk zone. In other examples, the display starts when the vehicle is 100, 200, or 300 m from the start or end of the crosswind risk zone.

[0100] According to this particular embodiment, the display of the virtual graphic object 32, 42 ends when the vehicle 10 crosses the beginning or end of the crosswind risk zone, this information being determined from the geographical position of the vehicle (via the third data), the mapping data (via the fourth data) and the location data of the beginning or end of the crosswind risk zone (via the fifth data).

[0101] According to another particular embodiment, the control of displaying the graphic content is a function of the sixth data representing the activation or deactivation of a crosswind risk zone alert service.

[0102] According to this other particular embodiment, the sixth data is for example received from a human-machine interface (HMI) embedded in the vehicle 10. The sixth data is for example generated following an action by a user activating or deactivating the crosswind risk zone alert service, for example via the touch interface associated with the screen 13.

[0103] The crosswind risk zone warning service, when activated, causes the generation or rendering of graphic contents 30, 40 when the vehicle 10 is approaching the beginning or end of a crosswind risk zone and then the display of these graphic contents 30, 40 on the screen 13.

[0104] Conversely, when the crosswind risk zone alert service is deactivated, the rendering and display of graphic contents 30, 40 are deactivated and inoperative.

[0105] According to yet another variant, other virtual graphic objects are added to the graphic content 30, 40, for example when the navigation system is used in a guidance mode (following a route calculated by the navigation system), these other virtual graphic objects representing, for example, guidance instructions (for example, arrows embedded on the road to materialize the route to follow) to indicate to the driver the route to follow.

[0106] The display of graphic content 30, 40 is controlled and implemented, whether the navigation system is used in guidance mode or not.

[0107] Figure 5 schematically illustrates a device 5 configured for controlling a display system embedded in a vehicle, for example, the vehicle 10, according to a particular and non-limiting embodiment of the present invention. The device 5 corresponds, for example, to a device embedded in the vehicle 10, for example, a computer, or to a device or a unit of a mobile communication device.

[0108] Device 5 is, for example, configured for the implementation of operations described opposite Figures 1 to 4 and / or the steps of the process described opposite [Fig. 6]. Examples of such a device 5 include, but are not limited to, embedded electronic equipment such as a vehicle's on-board computer, an electronic control unit such as an ECU (Electronic Control Unit), a smartphone, a tablet, or a laptop computer. The elements of the device 5, individually or in combination, can be integrated into a single integrated circuit, into several integrated circuits, and / or into discrete components. The device 5 can be implemented as electronic circuits or software (or computer) modules, or a combination of electronic circuits and software modules.

[0109] The device 5 comprises one (or more) processor(s) 50 configured to execute instructions for carrying out the steps of the process and / or for executing instructions from the software embedded in the device 5. The processor 50 may include integrated memory, an input / output interface, and various circuits known to those skilled in the art. The device 5 further comprises at least one memory 51, for example, volatile and / or non-volatile memory, and / or includes a memory storage device that may include volatile and / or non-volatile memory, such as EEPROM, ROM, PROM, RAM, DRAM, SRAM, flash, magnetic disk, or optical disk.

[0110] The computer code of the embedded software(s) including the instructions to be loaded and executed by the processor is for example stored on memory 51.

[0111] According to various particular and non-limiting embodiments, the device 5 is coupled in communication with other similar devices or systems and / or with communication devices, for example a TCU (Telematic Control Unit), for example via a communication bus or through dedicated input / output ports.

[0112] According to a particular and non-limiting embodiment, the device 5 includes a block 52 of interface elements for communicating with external devices. The interface elements of the block 52 include one or more of the following interfaces: - Radio frequency (RF) interface, for example, Wi-Fi® (according to IEEE 802.11), for example in the 2.4 or 5 GHz frequency bands, or Bluetooth® (according to IEEE 802.15.1), in the 2.4 GHz frequency band, or Sigfox using UBN (Ultra Narrow Band) radio technology, or LoRa in the 868 MHz frequency band, LTE (from the English "Long-Term Evolution" or in French "Evolution à long terme"), LTE-Advanced (or in French LTE-avancé); - USB interface (from the English "Universal Serial Bus" or "Universal Serial Bus" in French); - HDMI interface (from the English "High Definition Multimedia Interface", or "High Definition Multimedia Interface" in French); - LIN interface (from the English "Local Interconnect Network", or in French "Réseau interconnecté local").

[0113] According to another particular and non-limiting embodiment, the device 5 includes a communication interface 53 which enables communication with other devices (such as other computers in the embedded system) via a communication channel 530. The communication interface 53 corresponds, for example, to a transmitter configured to transmit and receive information and / or data via the communication channel 530. The communication interface 53 corresponds, for example, to a wired network of the CAN (Controller Area Network), CAN FD (Controller Area Network Flexible Data-Rate), FlexRay (standardized by ISO 17458) or Ethernet (standardized by ISO / IEC 802-3) type.

[0114] According to a particular and non-limiting embodiment, the device 5 can provide output signals to one or more external devices, such as a display screen 540, touch or not, one or more loudspeakers 550 and / or other peripherals 560 (projection system) via output interfaces 54, 55 and 56 respectively. According to a variant, one or more of the external devices is integrated into the device 5.

[0115] Figure 6 illustrates a flowchart of the various steps in a method for controlling a display system embedded in a vehicle, for example vehicle 10, according to a particular and non-limiting embodiment of the present invention. The method is implemented, for example, by a device embedded in the vehicle 10, by a mobile communication device, or by the device 5 of Figure 5.

[0116] In a first step 61, initial data representative of the presence of a crosswind risk zone on a section of road on which the vehicle is traveling are obtained.

[0117] In a second step 62, second representative wind intensity data at the level of the area at risk of crosswind are received according to a wireless communication mode.

[0118] In a third step 63, the display of augmented reality graphic content is controlled so that this graphic content is displayed on a display device of the vehicle, the graphic content comprising an image of a real scene located in front of the vehicle acquired by a camera mounted in the vehicle and a virtual graphic object superimposed on the image, the virtual graphic object comprising a set of graphic objects representing the area at risk of lateral wind, a graphic representation of the virtual graphic object being a function of the second data.

[0119] According to one variant, the variants and examples of the operations described in relation to one of Figures 1 to 4 apply to the steps of the process in [Fig.6].

[0120] Of course, the present invention is not limited to the embodiments described above but extends to a method for displaying graphic content in augmented reality that would include secondary steps without departing from the scope of the present invention. The same would apply to a device configured for implementing such a method.

[0121] The present invention also relates to a vehicle, for example an automobile or more generally an autonomous land-powered vehicle, comprising the device 5 of [Fig.5] or a display system comprising the device 5 of [Fig.5] connected in communication to a screen 13.

Claims

Demands

1. Method for controlling a display system on board a vehicle (10), said display system comprising a display device (13), said method comprising the following steps: - obtaining (61) first data representative of the presence of an area at risk of crosswinds on a portion of road (110) on which said vehicle (10) is traveling; - receiving (62) second data representative of wind intensity at said area at risk of crosswinds by means of a wireless communication method; - display control (63) of augmented reality graphic content (30; 40) on said display device (13), said graphic content (30; 40) comprising an image (31; 41) of a real scene located in front of said vehicle (10) acquired by a camera (12) mounted in said vehicle (10) and a virtual graphic object (32; 42) superimposed on said image (31; 41), said virtual graphic object (32;42) comprising a set of graphic objects representing said risk zone, a graphic representation of said virtual graphic object (32; 42) being a function of said second data.;

2. A method according to claim 1, wherein said first data are determined from third data representing geographical positions of the vehicle (10), fourth data representing a map of a road environment (1) in which said vehicle (10) travels and fifth data representing the location of a set of areas at risk of crosswind included in said road environment (1).

3. A method according to claim 1 or 2, wherein the graphic representation of said virtual graphic object (32) corresponds to: - a first graphic representation corresponding to a gantry supporting at least one first graphic object (321) representing a road sign indicating the beginning of a crosswind risk zone and at least one second graphic object (322) representing a light signal when said first data are representative of the beginning of a crosswind risk zone and said second data are representative of an intensity exceeding a threshold; and - a second graphic representation of said gantry supporting said at least one first graphic object and said at least one second graphic object when said first data are representative of the beginning of a zone at risk of lateral wind and said second data are representative of an intensity below said threshold.

4. A method according to claim 3, wherein: - said gantry is represented with a first color and said second graphic object (322) is representative of a flashing light signal when said virtual graphic object (32) is represented according to the first graphic representation; and - said gantry is represented with a second color different from said first color and said second graphic object (322) is representative of a fixed light signal when said virtual graphic object (32) is represented according to the second graphic representation.

5. A method according to claim 3 or 4, wherein the graphic representation of said virtual graphic object (42) corresponds to: - a third graphic representation corresponding to said gantry supporting at least a third graphic object (421) representing a road sign indicating the end of a crosswind risk zone when said first data are representative of the end of a crosswind risk zone and said second data are representative of an intensity greater than said threshold; and - a fourth graphic representation of said gantry supporting said at least a third graphic object (421) when said first data are representative of the end of a crosswind risk zone and said second data are representative of an intensity less than said threshold.

6. Method according to claim 5, wherein: - said gantry is represented with the first color when said virtual graphic object (42) is represented according to the third graphic representation; and - said gantry is represented with the second color when said virtual graphic object (42) is represented according to the fourth graphic representation.

7. A method according to any one of claims 1 to 6, further comprising a step of receiving sixth data points representing the activation or deactivation of a crosswind risk zone warning service from a human-machine interface embedded in said vehicle, said display control (63) of the graphic content being a function of the said sixth data.

8. A computer program comprising instructions for carrying out the method according to any one of the preceding claims, when such instructions are executed by a processor.

9. Device (5) for controlling a display system embedded in a vehicle, said device (5) comprising a memory (51) associated with at least one processor (50) configured for carrying out the steps of the method according to any one of claims 1 to 7.

10. Vehicle (10) comprising the device (5) according to claim 9.

Images