Method and device for controlling a display system for displaying a warning when approaching a level crossing for a vehicle

Abstract

The present invention relates to a method and a device for controlling a display system of a vehicle. For this purpose, a level crossing (311) is detected when the vehicle is approaching and at a determined distance from this level crossing (311) as a function of the position of the vehicle, mapping data and data representative of a set of level crossings. The display of graphic content (30) in augmented reality is controlled to display this graphic content (30) on a display device (13), the graphic content (30) comprising a first image (31) of a real scene located in front of the vehicle and a virtual graphic object (32) superimposed on the first image (31), a graphic representation of the virtual graphic object (32) being a function of data relating to barriers (312) associated with the level crossing (311). Figure for abstract: Figure 3

Description

Title of the invention: Method and device for controlling a display system for displaying an alert when approaching a level crossing for a vehicle Technical field

[0001] The present invention relates to methods and devices for controlling an on-board display system in a vehicle, in particular but not exclusively a motor vehicle. The present invention also relates to a method and a display system or device for signaling an alert in a vehicle approaching a level crossing. Technological background

[0002] To assist the driver of a vehicle, it is known to display information relating to the road environment in which the vehicle is traveling, for example on a display device of the vehicle or on a display screen of a mobile communication device such as a smartphone on board the vehicle. The display of such information is done for example via a human-machine interface (HMI) of a navigation system. Such a navigation system uses map data such as digital road maps indicating the roads of the road environment in which the vehicle is traveling, this map data being associated with or including additional data relating to the road environment such as the presence of places of interest such as parking lots or information on current traffic conditions.

[0003] Certain information, particularly useful to the driver to ensure his safety as well as that of the passengers on board the vehicle, is difficult to present to the driver. For example, information relating to level crossings that the vehicle is required to cross during a journey is difficult to represent, their nature sometimes varying from one level crossing to another.

[0004] To ensure the safety of the vehicle and its passengers, it is important to provide the driver with the information necessary for controlling the vehicle according to the situations encountered during a journey. Summary of the present invention

[0005] An object of the present invention is to solve at least one of the problems of the technological background described above.

[0006] Another object of the present invention is to better alert a driver of a vehicle of a risk associated with crossing a level crossing.

[0007] Another object of the present invention is to improve the user experience vis- with regard to information associated with a level crossing which the vehicle is approaching.

[0008] According to a first aspect, the present invention relates to a method for controlling an on-board display system in a vehicle, the display system comprising a display device, the method comprising the following steps: - reception of first data representative of geographical positions of the vehicle, second data representative of a map of a road environment in which the vehicle is traveling, third data representative of the location of a set of level crossings included in the road environment and fourth data representative of level crossing barriers associated with at least part of the set of level crossings; - detection of the presence of a level crossing from the set of level crossings on a portion of road in the road environment on which the vehicle is traveling based on the first, second and third data, the vehicle being approaching and at a determined distance from the level crossing during detection; - control of display of graphic content in augmented reality on the display device following detection, the graphic content comprising a first image of a real scene located in front of the vehicle acquired by a camera on board the vehicle and a virtual graphic object superimposed on the first image, the virtual graphic object comprising a set of graphic objects representative of traffic signs relating to the level crossing, a graphic representation of the virtual graphic object being a function of the fourth data.

[0009] Such a method makes it possible to visually alert a driver of a vehicle when the latter is approaching a level crossing, the alert being personalized according to information relating to level crossing barriers for the level crossing concerned, such as the presence or absence of barriers, or the open or closed state of the barriers. The use of augmented reality makes it possible to embed virtual objects on an image of the scene providing the driver with clear information on the presence of a level crossing, with an adaptation of the displayed content to the situation encountered. This makes it possible to adjust the control of the vehicle to the particular situation encountered, with anticipation of the associated risks.

[0010] According to a variant, the fourth data comprising a first piece of information representative of the presence or absence of level crossing barriers associated with the level crossing, the graphic representation of the virtual graphic object corresponds to: - a first graphic representation corresponding to a gantry supporting at least a first graphic object representing a road sign indicating a level crossing equipped with barriers and a second graphic object representing indicating a light signal when the first information is representative of the presence of level crossing barriers; and - a second graphic representation corresponding to a gantry supporting at least a third graphic object representative of a road sign indicating a level crossing without a barrier and the second graphic object when the first information is representative of the absence of level crossing barriers.

[0011] According to another variant, the method further comprises a reception of fifth data representative of a position of a train with respect to the level crossing, the fourth data further comprising a second piece of information representative of an opening state or a closing state of the level crossing barriers, the first graphic representation of the virtual graphic object further being a function of the fifth data and the second piece of information.

[0012] According to another variant, the first graphical representation comprises: - a third graphic representation according to which the gantry is represented with a first color when the second information is representative of an open state of the level crossing barriers and the train is at a distance greater than a threshold distance from the level crossing; - a fourth graphic representation according to which the gantry is represented with a second color when the second information is representative of an open state of the level crossing barriers and the train is at a distance less than the threshold distance from the level crossing, the second color being different from the first color; and - a fifth graphic representation according to which the gantry is represented with a third color when the second information is representative of a state of closure of the level crossing barriers, the third color being different from the first color and the second color.

[0013] According to an additional variant, the second graphic object is representative of a flashing light signal when the virtual graphic object is represented according to the fourth graphic representation or according to the fifth graphic representation and the second graphic object is representative of a fixed light signal when the virtual graphic object is represented according to the third graphic representation.

[0014] According to a variant, the gantry is represented according to the second color when the virtual graphic object is represented according to the second graphic representation.

[0015] According to an additional variant, the method further comprises a step of receiving sixth data representative of activation or deactivation of a level crossing alert service from a human-machine interface on board the vehicle, the control of display of the graphic content being a function of the sixth data.

[0016] According to a second aspect, the present invention relates to a device for controlling an on-board display system in a vehicle, the device comprising a memory associated with a processor configured for implementing the steps of the method according to the first aspect of the present invention.

[0017] According to a third aspect, the present invention relates to a vehicle, for example of the automobile type, comprising a device as described above according to the second aspect of the present invention.

[0018] According to a fourth aspect, the present invention relates to a computer program which comprises instructions adapted for executing the steps of the method according to the first aspect of the present invention, in particular when the computer program is executed by at least one processor.

[0019] Such a computer program may use any programming language, and be in the form of source code, object code, or intermediate code between source code and object code, such as in a partially compiled form, or in any other desirable form.

[0020] According to a fifth aspect, the present invention relates to a computer-readable recording medium on which is recorded a computer program comprising instructions for carrying out the steps of the method according to the first aspect of the present invention.

[0021] On the one hand, the recording medium may be any entity or device capable of storing the program. For example, the medium may comprise a storage means, such as a ROM memory, a CD-ROM or a microelectronic circuit type ROM memory, or a magnetic recording means or a hard disk.

[0022] Furthermore, this recording medium may also be a transmissible medium such as an electrical or optical signal, such a signal being able to be conveyed via an electrical or optical cable, by conventional or hertzian radio or by self-directed laser beam or by other means. The computer program according to the present invention may in particular be downloaded from an Internet-type network.

[0023] Alternatively, the recording medium may be an integrated circuit in which the computer program is incorporated, the integrated circuit being adapted to perform or to be used in performing the method in question. Brief description of the figures

[0024] Other characteristics and advantages of the present invention will emerge from the description of the particular and non-limiting exemplary embodiments of the present invention below, with reference to the appended figures 1 to 6, in which:

[0025] [Fig-1] schematically illustrates an environment of a vehicle, according to an example particular and non-limiting embodiment of the present invention;

[0026] [Fig.2] schematically illustrates a passenger compartment of a vehicle, according to a particular and non-limiting exemplary embodiment of the present invention;

[0027] [Fig.3] schematically illustrates a display screen on board the vehicle of [Fig.l], according to a first particular and non-limiting example of embodiment of the present invention;

[0028] [Fig.4] schematically illustrates a display screen on board the vehicle of [Fig.l], according to a second particular and non-limiting exemplary embodiment of the present invention;

[0029] [Fig.5] schematically illustrates a device configured for controlling an on-board display system in the vehicle of [Fig.l], according to a particular and non-limiting exemplary embodiment of the present invention;

[0030] [Fig.6] illustrates a flowchart of the different steps of a method for controlling an on-board display system in the vehicle of [Fig.l], according to a particular and non-limiting exemplary embodiment of the present invention. Description of examples of implementation

[0031] A method and a device for controlling an on-board display system in a vehicle will now be described in the following with joint reference to FIGS. 1 to 6. The same elements are identified with the same reference signs throughout the description which follows.

[0032] The terms "first(s)", "second(s)" (or "first(s)", "second(s)"), etc. are used in this document by arbitrary convention to enable different elements (such as operations, means, etc.) implemented in the embodiments described below to be identified and distinguished. Such elements may be distinct or correspond to a single element, depending on the embodiment.

[0033] According to a particular and non-limiting example of embodiment of the present invention, the control of a display system on board a vehicle is for example implemented by one or more computers of the vehicle, for example via one or more processors, or by one or more processors of a mobile communication device on board the vehicle, in particular when the display system is integrated into the mobile communication device.

[0034] For this purpose, first data representative of geographical positions of the vehicle, second data representative of a map of a road environment in which the vehicle is traveling, third data representative of the location of a set of level crossings included in the road environment and fourth data representative of level crossing barriers associated with at least part of the set of level crossings are obtained. The first data are for example obtained or received from a receiver of a geolocation system (of the vehicle or the mobile communication device). The second data are for example obtained or received from a remote device (for example a cloud server) and / or from a memory, the second data being for example intended to be used by a navigation system (of the vehicle or the mobile communication device). The third data are for example obtained or received from a remote device (for example a cloud server, identical or different from the one providing the second data) and / or from a memory, the third data being for example intended to be used by the navigation system (of the vehicle or the mobile communication device).Finally, the fourth data are for example obtained or received from a remote device (for example a cloud server, identical or different from that providing the second data) and / or from a memory, the fourth data being for example intended to be used by the navigation system (of the vehicle or of the mobile communication device). The fourth data are for example received in addition to the third data or as a part of these third data.

[0035] The presence of a level crossing located on a portion of road on which the vehicle is traveling is detected on the basis of the first, second and third data when the vehicle approaches this level crossing, in particular when the vehicle is at a determined distance from this level crossing (for example 100, 150, 200, 300 or 500 m).

[0036] The display of graphic content in augmented reality is controlled in such a way that this graphic content is displayed on a display device of the display system following the detection of the presence of the level crossing on the road taken by the vehicle. The graphic content comprises a first image of a real scene located in front of the vehicle, which first image is acquired by a camera on board the vehicle (for example a camera of the vehicle or a camera of the mobile communication device) and a virtual graphic object displayed superimposed on the first image. The virtual graphic object comprises a set of graphic objects representing one or more traffic signs relating to the level crossing which the vehicle is approaching.The virtual graphical object is represented according to a determined graphical representation which is a function of the fourth data, for example depending on whether the level crossing is equipped with level crossing barriers or not and / or depending on whether these barriers, when present, are in an open or closed state.

[0037] A level crossing is a crossing or intersection between a road intended for the movement of vehicles and a railway track for trains or tramways. The level crossing may be equipped with level crossing barriers (or half-barriers, the term barriers being used hereinafter to designate barriers and half-barriers) or lacking such barriers

[0038] [Fig. 1] schematically illustrates a vehicle 10 in an environment 1, according to a particular and non-limiting exemplary embodiment of the present invention.

[0039] [Fig.l] illustrates a vehicle 10, for example a motor vehicle, in an environment 1, the environment 1 corresponding to a road environment in which the vehicle 10 moves and circulates.

[0040] The vehicle 10 corresponds for example to a vehicle with a thermal engine, with electric motor(s) or even a hybrid vehicle with a thermal engine and one or more electric motors. The vehicle 10 thus corresponds for example to a land vehicle, for example an automobile, a truck, a bus.

[0041] According to the example of [Fig.l], the vehicle 10 is traveling on a road or portion of road 102 comprising one or more traffic lanes. The vehicle 10 is approaching a level crossing 111, that is to say that a level crossing 111 crosses the road 110 downstream of the vehicle 10 (or in front of the vehicle 10) according to the direction of travel of the vehicle 10. According to the example of [Fig.l], the level crossing 111 is provided with barriers 112.

[0042] The invention also applies to environments comprising a road crossing a level crossing without a barrier. Generally, the invention applies to any environment comprising one or more roads crossing one or more level crossings, regardless of the type of level crossing.

[0043] In France, there are several types of level crossings identified as follows: - PN to SAL (Automatic Light Signaling Level Crossing) with lights only of type SAL 0, i.e. a PN to SAL not including barriers; - PN to SAL with two half-barriers of type SAL 2; - PN to SAL with two barriers of type SAL2B; and - PN to SAL with four half-barriers of type SAL 4.

[0044] The level crossing 111 is for example according to any one of the types listed above.

[0045] According to a particular exemplary embodiment, the vehicle 10 carries a communication system configured to communicate with one or more remote devices or servers 103 via a wireless communication network infrastructure.

[0046] The remote server(s) 103 each correspond, for example, to a server of the “cloud” 100 (or “cloud” in French). The wireless communication infrastructure comprises, for example, a set of communication devices of the LTE (Long Term Evolution) 4G or 5G cellular network antenna type 102. According to an alternative embodiment, the communication devices belonging to the wireless communication infrastructure correspond to UBR (Roadside Unit).

[0047] The communication system of the vehicle 10 comprises, for example, one or more communication antennas connected to a telematic control unit, called TCU (from the English "Telematic Control Unit"), itself connected to one or more computers of the on-board system of the vehicle 10. The antenna(s), the TCU unit and the computer(s) form, for example, a multiplexed architecture for the realization of different services useful for the proper functioning of the vehicle and for assisting the driver and / or the passengers of the vehicle in the control of the vehicle 10.The computer(s) and the TCU communicate and exchange data with each other via one or more computer buses, for example a communication bus of the data bus type CAN (from the English "Controller Area Network" or in French "Réseau de contrôles"), CAN FD (from the English "Controller Area Network Flexible Data-Rate" or in French "Réseau de contrôles à débit de données flexible"), FlexRay (according to the ISO 17458 standard) or Ethernet (according to the ISO / IEC 802-3 standard).

[0048] According to a particular embodiment, the vehicle 10 carries a navigation and geolocation system, also called a GNSS system (Geolocation and Navigation by a Satellite System), for example a GPS (Global Positioning System) or Galileo type system. According to this embodiment, the vehicle 10 carries a geolocation system receiver allowing the vehicle 10 to obtain first data representative of its geographical position at any time, for example in the form of GPS coordinates (latitude and longitude), via a satellite link with a set of satellites 101.

[0049] The navigation system of the vehicle 10 is for example connected via an OTA (Over The Air) type link to receive map data, data relating to one or more level crossings and data relating to barriers associated with all or part of these level crossings as the vehicle 10 moves, via the communication system of the vehicle 10. According to a variant, such data is recorded in a memory of the vehicle 10 associated with the navigation system, the recorded data being for example updated via the OTA link (for example periodically or when the map data and / or the level crossing and barrier data have been updated on the remote device 103).

[0050] According to an alternative embodiment, the navigation system also receives data relating to the position of train(s) relative to a level crossing which the vehicle 10 is approaching and / or relating to the position of the train(s) on the rail network. located in the environment in which the vehicle 10 circulates.

[0051] According to another particular embodiment, the vehicle 10 carries a mobile communication device, such as a smartphone (from the English "Smartphone") or a tablet, such a wireless communication device being for example arranged on a support fixed to an element of the passenger compartment of the vehicle 10 so that the display screen of the mobile communication device is visible to the driver when the latter is driving the vehicle 10. According to such an embodiment, the mobile communication device incorporates a navigation and geolocation system, also called a GNSS system (Geolocation and Navigation by a Satellite System), for example a GPS type system (from the English "Global Positioning System" or in French "Geo-positioning system by satellites"), for example installed on the communication device in the form of a mobile application.Such an embodiment allows the driver of the vehicle 10 to use the navigation system and the display system of the mobile communication device, for example when the vehicle 10 does not integrate a navigation system or when the driver prefers to use the navigation system of the mobile communication device instead of the navigation system of the vehicle 10. The mobile communication device is advantageously connected in wireless communication with the remote device(s) 103 via the wireless network infrastructure, for example to receive mapping data as well as data relating to level crossings, barriers and / or trains, or updates of such data stored in the memory of the mobile communication device. The mobile communication device is for example connected in wireless communication to the vehicle 10, for example via a wireless link of the Bluetooth® or Wifi® type.

[0052] The remote server 103 is for example configured to send data relating to the road infrastructure such as: - second mapping data, for example first data representative of road maps, and / or - third data representative of one or more level crossings, for example data representative of the coordinates of this or these level crossings or the locations of this or these level crossings on the roads they cross; and / or - fourth data representative of barriers associated with all or part of the level crossings described by the third data, the fourth data being for example associated with the third data or included in the third data, the fourth data describing a set of information such as a first piece of information representative of the presence or absence of barriers for each level crossing, a second piece of information representative of the state of opening and closing of the barriers equipping a level crossing (i.e. a level crossing for which the first associated information is representative of the presence of barriers), the second information being provided in real time to the vehicle 10 to indicate to it whether the barriers of the level crossing 111 which it is approaching are open or closed; and / or - fifth data representative of the position of train(s), the fifth data indicating for example the absolute position (i.e. the coordinates) of the trains present in the environment 1, the relative position of the trains in relation to the next level crossing encountered by each train and / or the absolute or relative position of the train approaching only the level crossing 111 which the vehicle is approaching, these fifth data being provided in real time to the vehicle 10 to inform it of the absolute or relative position in real time of the train(s).

[0053] According to a particular embodiment illustrated in [Fig.2], vehicle 10 has a display system comprising a display device or screen 13 and a computer configured to control the display of content(s) of a graphical MMI on the touch screen 13. The computer corresponds for example to the computer of the infotainment system, called the IVI computer (from the English “In-Vehicle Infotainment” or in French “Infodivertissement embargo”) of the vehicle 10.

[0054] According to an alternative embodiment, the display system of the vehicle 10 comprises one or more other screens, for example a screen of a device or system called a head-up display corresponding for example to a transparent or semi-transparent blade arranged in such a way that a driver seated in the seat 16 sees the content displayed or projected on the transparent blade when the driver drives the vehicle 10, or a display screen 15 called a handset or dashboard generally arranged in an area behind the steering wheel 14 in the dashboard 11.

[0055] The screen 13 is for example associated with a touch interface and corresponds for example to a screen of the LCD type (from the English “Liquid Crystal Display” or in French “Display à cristals liquide”), for example of the TFT type (from the English “Thin-Film Transistor” or in French “Transistor en film mince”), or OLED type (from the English “Organic Light-Emitting Diode” or in French “Diode électroluminescente biologique”).

[0056] The screen 13 is configured to display content intended for the driver and passengers of the vehicle. The screen 13 is also configured to allow the driver and / or passengers of the vehicle to interact with one or more systems embedded in the vehicle via a human machine interface (HMI) displayed on the screen 13. For example, the screen 13 is configured to interact with the IVI system and / or a navigation system of the vehicle 10.

[0057] According to a particular embodiment, the screen 13 is not integrated into the passenger compartment of the vehicle but corresponds to a screen of a mobile communication device. (smartphone, tablet), connected in communication, for example wirelessly, with the on-board system of the vehicle 10.

[0058] The vehicle 10 also carries, for example, one or more cameras, for example a camera 12 corresponding to a front camera (also called a windshield camera). Such a camera 12 is arranged in the passenger compartment of the vehicle 10 under the windshield and at the top and in the middle of this windshield. Such a front camera 12 has a field of vision corresponding to the space located in front of the vehicle 10 according to the direction of travel of the vehicle 10. Such a camera 12 is thus configured for the acquisition of image data representative of the real scene located in front of the vehicle 10, according to the direction of travel of the vehicle 10.

[0059] The camera 12 comprises for example the following elements: - a photosensitive sensor corresponding for example to a matrix of photoreceptors associated for example with a Bayer filter; - an optical assembly arranged in front of the sensor with respect to the scene to be acquired by the sensor, the optical assembly comprising for example an arrangement of one or more lenses; and - optionally one or more calculators associated with memory and configured for processing images acquired by the sensor.

[0060] According to an alternative embodiment, the camera corresponds to a camera of the mobile communication device on board the vehicle 10, if applicable. The camera of the mobile communication device is also configured for the acquisition of image data representative of the real scene located in front of the vehicle 10, depending on where the mobile communication device is arranged in the passenger compartment of the vehicle 10.

[0061] A process for controlling a display system on board the vehicle 10 is advantageously implemented by one or more processors of the display system, for example by a computer of an on-board system of the vehicle 10 such as the IVI system or the navigation system or by a processor of the mobile communication device. The on-board display system thus corresponds to a display device integrated into the vehicle 10 or to a display system of a mobile communication device itself on board the vehicle 10.

[0062] In a first operation of the process, first data representative of geographical positions of the vehicle 10, second data representative of a map of the road environment in which the vehicle 10 is traveling, third data representative of a set of level crossings included in the road environment 1 and fourth data representative of barriers associated with at least part of the set of level crossings are received.

[0063] According to an alternative embodiment, the third data received are only representative of the level crossing 111 located on the road 110 on which the vehicle 10 is traveling, these third data being received knowing the current position of the vehicle 10 (via the first data) and the mapping (via the second data). In the same way, the fourth data received are only representative of any barriers associated with the level crossing 111.

[0064] According to another variant, the third and / or fourth data form a part of the second data, that is to say that the mapping data comprises the position of the level crossings and at least the first information relating to the presence or absence of barriers associated with each of the level crossings.

[0065] According to an alternative embodiment, fifth data representative of the absolute or relative position of a set of trains are further received. These fifth data are for example only representative of the position of a train approaching the level crossing 111. According to a particular example, the fifth data are representative of an indicator indicating whether an approaching train is at a distance from the level crossing 111 less than or greater than a threshold distance (the threshold distance being for example equal to 100, 200, 500 or 1000 m). The indicator takes for example the value '0' when a train is approaching at a distance greater than the threshold distance (or when no train is approaching the level crossing 111) and the indicator then takes the value '1' when the train is approaching at a distance less than the threshold distance.

[0066] The first data are for example received from a receiver of a geolocation system 101. The second and third data and / or a part of the fourth data (i.e. the first information) are for example received from a memory and / or from a remote device such as a server 103 configured to make such data available to navigation systems of so-called connected vehicles and / or mobile navigation applications of mobile communication devices.

[0067] The fourth data (and more particularly the second information on the state of opening or closing of barriers) and the fifth data are received in real time from one or more remote devices such as the server 103.

[0068] The second and third data received correspond for example to data relating to the road environment in which the vehicle 10 is traveling at each instant, these second and third data varying as the vehicle 10 moves in its environment 1. For example, the second and third data relate to an area surrounding the vehicle 10, for example over a radius equal to a few kilometers or a few hundred meters.

[0069] The fourth and fifth are received automatically when the vehicle 10 approaches a level crossing or are received, according to a particular example, on request from the vehicle 10 transmitted to the server 103 via a wireless link between the vehicle 10 and the “cloud” 100.

[0070] In a second operation of the process, the presence of the level crossing 111 is detected when the vehicle 10 approaches the level crossing 111.

[0071] The level crossing 111 is for example detected when the vehicle 10 arrives at a determined distance from the level crossing 111, for example when the vehicle 10 is located 50, 100, 200 or 500 m from the level crossing 111. The detection distance corresponds for example to a fixed parameter of the system or to a parameter adjustable by a user of the system, for example by the driver of the vehicle 10.

[0072] The detection of the level crossing 111 is obtained as a function of the first, second and third data. Thus, knowing the current geographical position of the vehicle 10 and the road on which the vehicle 10 is traveling (via the first and second data) and knowing the position of the level crossing 111 in the traffic zone of the vehicle 10 (via the third data), the device implementing the invention is able to know at any time whether the vehicle 10 is approaching a level crossing.

[0073] In a third operation of the process, the display of graphic content in augmented reality is controlled so that this graphic content is displayed on a display device, for example the screen 13.

[0074] The display control is triggered by the detection of the level crossing 111, i.e. when the vehicle 10 is approaching the level crossing 111 at a determined distance from this level crossing.

[0075] The graphic content advantageously includes: - a first image of the real scene located in front of the vehicle 10 acquired by a camera on board the vehicle such as the camera 12; and - a virtual graphic object displayed superimposed on the first image, the virtual graphic object comprising a set of graphic objects representative of traffic signs relating to the level crossing 111, a graphic representation of the virtual graphic object being a function of the fourth data, and optionally of the fifth data.

[0076] The display control comprises rendering of the graphic content, such rendering corresponding to a set of operations performed by one or more processors on the pixels of the first image to compose the graphic content. For example, the rendering consists of associating with a set of pixels of the first image pixel data (for example color data expressed in an RGB (Red, Green, Blue) type space) associated with the virtual graphic object.

[0077] The virtual graphic object (and the graphic objects that this virtual graphic object includes) corresponds to a graphic object obtained by image synthesis, the virtual graphic object being superimposed on the first image at a specific location, for example at a specific distance from the point of view associated with the first image, i.e. at a location located between the vehicle and the level crossing represented in the first image. Thus, the pixels of the first image at the location of the inlay of the virtual object in the first image are replaced by the pixels defining the virtual graphic object.

[0078] The graphical representation of the virtual graphical object corresponds to: - a first graphic representation corresponding to a gantry supporting at least a first graphic object representative of a road sign indicating a level crossing equipped with barriers and a second graphic object representative of a light signal when the first information (included in the fourth data) is representative of the presence of level crossing barriers, the first graphic representation being illustrated in [Fig.3] according to a particular example of embodiment; and - a second graphic representation corresponding to a gantry supporting at least a third graphic object representative of a road sign indicating a level crossing without a barrier and the second graphic object when the first information (included in the fourth data) is representative of the absence of level crossing barriers, the second graphic representation being illustrated in [Fig.4] according to a particular example of embodiment.

[0079] [Fig.3] illustrates an example of the result of such a rendering of the virtual graphic object, i.e. the display of a graphic content 30 on the screen 13 with the virtual graphic object 32 according to the first graphic representation.

[0080] The graphic content 30 thus displayed results from the overlaying of a virtual graphic object 32, for example a 3-dimensional (3D) graphic object, on a first image 31 whose content represents the real scene that the driver sees (at least partially) through the windshield of the vehicle 10 at the time of acquisition of the first image 31 (or with a slight time shift necessary for the composition of the graphic content 30, of the order of a few hundred milliseconds for example).

[0081] The rendering result thus corresponds to so-called augmented reality content (noted RA, or AR in English for “Augmented Reality”) in that this content mixes content representing a real environment (acquired by a camera) with digital virtual content obtained by computer.

[0082] The graphic content 30 varies depending on the movement of the vehicle 10 on the roadway, as the vehicle 10 approaches the level crossing 311.

[0083] The graphic content 30 varies via: - the first image displayed which varies as image data is received of the camera 12 as a function of the point of view of the camera 12 which evolves and varies as a function of the movement of the vehicle 10, the first images being for example refreshed / displayed at a frequency of 24, 48 or 50 images per second; and - an adjustment of the representation of the virtual graphic object 32 as the vehicle 10 moves, the virtual graphic object 32 being for example embedded in the first image at a constant distance from the point of view of the camera 12 or the representation of the virtual graphic object 32 being modified as the vehicle moves to provide the illusion to the driver that the vehicle 10 is approaching the virtual graphic object 32, the adjustment of the graphic representation making it possible to adapt the perspective according to the evolution of the point of view of the graphic content 30 which varies with the movement of the vehicle 10.

[0084] According to the example of [Fig.3], the virtual graphic object 32 is representative of a gantry supporting one or more first graphic objects or pictograms 321 each representing a signaling panel of a level crossing with barriers (2 panels according to the example of [Fig.3]) and a second graphic object or pictogram 322 representing a light signal associated with a level crossing.

[0085] According to the particular example of [Fig.3], the second graphic object 322 is arranged in the middle of the first two graphic objects 321.

[0086] Of course, the virtual graphic object 32 is not limited to such a representation but extends to any virtual graphic representation, for example to a bracket or a lateral post supporting the first and second graphic objects 321, 322.

[0087] According to the example of [Fig. 3], the first image 31 represents the level crossing 311 (corresponding for example to the level crossing 111 of [Fig. 1]) provided with barriers 312 in the open state.

[0088] According to a particular embodiment, the first graphic representation comprises or is broken down into 3 graphic representations corresponding to: - a third graphical representation according to which the gantry is represented with a first color when the second information (included in the fourth data) is representative of an open state of the level crossing barriers 312 (i.e. when the current state of the barriers 312 corresponds to the open state authorizing the crossing of the level crossing 311, as represented in [Fig. 3]) and that a train traveling on the railway passing over the level crossing 311 is at a distance from the level crossing 311 greater than the threshold distance defined previously, the information associated with the distance with respect to the threshold distance being obtained from the fifth data or from an analysis of the third and fifth data; - a fourth graphical representation according to which the gantry is represented with a second color when the second information is representative of an opening state of the level crossing barriers 312 (i.e. when the state current of barriers 312 corresponds to the open state, as shown in [Fig.3]) and that the train is at a distance less than the threshold distance from the level crossing, the second color being different from the first color; and - a fifth graphic representation according to which the gantry is represented with a third color when the second information is representative of a closed state of the level crossing barriers 312 (i.e. when the current state of the barriers 312 corresponds to the closed state prohibiting crossing of the level crossing 311), the third color being different from the first color and the second color.

[0089] The first color corresponds for example to the color green, the second color to the color red and the third color to the color orange. Other colors can of course be used, such as for example blue for the first color or yellow for the third color.

[0090] The third graphical representation illustrates a situation where the danger associated with crossing the level crossing 311 is low, the barriers 312 being open, the train traveling on approach to the level crossing being sufficiently far from the level crossing to avoid any risk of collision with the vehicle 10 when the vehicle 10 will cross the level crossing 311. The fourth graphical representation illustrates a situation where the danger associated with crossing the level crossing 311 is high, the barriers 312 being open and the train traveling on approach to the level crossing 311 being close to the level crossing 311, with a potential risk of collision with the vehicle 10 when the vehicle 10 will cross the level crossing 311.Finally, the fifth graphic representation illustrates a situation where the danger associated with crossing level crossing 311 is low, the barriers 312 being closed forcing the vehicle 10 to slow down when approaching level crossing 311, or even to stop before crossing level crossing 311.

[0091] According to this particular embodiment, the second graphic object 322 is representative of a flashing light signal when the virtual graphic object 32 is represented according to the fourth graphic representation or according to the fifth graphic representation and the second graphic object 322 is representative of a fixed light signal when the virtual graphic object 32 is represented according to the third graphic representation. The flashing light signal makes it possible to draw the driver's attention to a situation requiring increased vigilance, for example when the danger associated with crossing the level crossing 311 is high (corresponding to the fourth graphic representation) or when controlling the vehicle requires the braking system to be activated (when the barriers 312 are closed).

[0092] [Fig.4] illustrates an example of the result of the rendering of the virtual graphic object, i.e. the display of a graphic content 40 on the screen 13 with the object virtual graph 42 according to the second graphic representation.

[0093] Just as for the graphic content 30 of [Fig. 3], the graphic content 40 thus displayed results from the overlay of a virtual graphic object 42, for example a 3-dimensional (3D) graphic object, on a first image 41 whose content represents the real scene that the driver sees (at least partially) through the windshield of the vehicle 10 at the time of acquisition of the first image 41 (or with a slight time shift necessary for the composition of the graphic content 40, of the order of a few hundred milliseconds for example).

[0094] The graphic content 40 varies like the graphic content 30 depending on the movement of the vehicle 10 on the roadway, as the vehicle 10 approaches the level crossing 311.

[0095] According to the example of [Fig.4], the virtual graphic object 42 is representative of a gantry supporting one or more third graphic objects or pictograms 421 each representing a signaling panel for a level crossing without a barrier (2 panels according to the example of [Fig.4]) and the second graphic object or pictogram 322 representing a light signal associated with a level crossing.

[0096] According to the particular example of [Fig.4], the second graphic object 322 is arranged in the middle of the two third graphic objects 421.

[0097] According to the example of [Fig.4], the first image 41 represents the level crossing 411 (corresponding for example to the level crossing 111 of [Fig. 1]) without a barrier, corresponding to a level crossing of type S AL 0 for example.

[0098] The gantry of the virtual graphic object 42 according to the second graphic representation is for example in a determined color, for example red to draw the driver's attention to the danger associated with this type of level crossing without a barrier.

[0099] The second graphic object 322 is for example representative of a flashing light signal to attract the driver's attention.

[0100] According to a particular embodiment, the display of the virtual graphic object 32, 42 is controlled so that the display begins when the vehicle 10 is at a determined distance from the level crossing 311, 411, for example when the vehicle 10 is 150 m from the level crossing 311. According to other examples, the display begins when the vehicle is 100, 200 or 300 m from the level crossing 311, 411.

[0101] According to this particular embodiment, the display of the virtual graphic object 32, 42 ends when the vehicle 10 crosses the level crossing 311, 411, this information being determined from the geographical position of the vehicle (via the first data), the mapping data (via the second data) and the location data of the level crossing (via the third data).

[0102] According to another particular embodiment, the content display control graph being a function of the sixth data representing activation or deactivation of a level crossing alert service.

[0103] According to this other particular embodiment, the sixth data are for example received from a human-machine interface (HMI) on board the vehicle 10. The sixth data are for example generated following an action by a user activating or deactivating the level crossing alert service, for example via the touch interface associated with the screen 13.

[0104] The level crossing service, when activated, causes the generation or rendering of graphic contents 30, 40 when the vehicle 10 is approaching a level crossing and then the display of these graphic contents 30, 40 on the screen 13.

[0105] Conversely, when the level crossing service is deactivated, the rendering and display of the graphic contents 30, 40 are deactivated and inoperative.

[0106] [Fig. 5] schematically illustrates a device 5 configured for controlling a display system on board a vehicle, for example the vehicle 10, according to a particular and non-limiting exemplary embodiment of the present invention. The device 5 corresponds for example to a device on board the vehicle 10, for example a computer, or to a device or unit of a mobile communication device.

[0107] The device 5 is for example configured for the implementation of the operations described with regard to figures 1 to 4 and / or the steps of the method described with regard to [Fig.6]. Examples of such a device 5 include, but are not limited to, on-board electronic equipment such as an on-board computer of a vehicle, an electronic calculator such as an ECU (“Electronic Control Unit”), a smartphone, a tablet, a laptop. The elements of the device 5, individually or in combination, can be integrated into a single integrated circuit, into several integrated circuits, and / or into discrete components. The device 5 can be produced in the form of electronic circuits or software (or computer) modules or even a combination of electronic circuits and software modules.

[0108] The device 5 comprises one (or more) processor(s) 50 configured to execute instructions for carrying out the steps of the method and / or for executing the instructions of the software(s) embedded in the device 5. The processor 50 may include integrated memory, an input / output interface, and various circuits known to those skilled in the art. The device 5 further comprises at least one memory 51 corresponding for example to a volatile and / or non-volatile memory and / or comprises a memory storage device which may comprise volatile and / or non-volatile memory, such as EEPROM, ROM, PROM, RAM, DRAM, SRAM, flash, magnetic or optical disk.

[0109] The computer code of the embedded software(s) comprising the instructions to be loaded and executed by the processor is for example stored in the memory 51.

[0110] According to various particular and non-limiting embodiments, the device 5 is coupled in communication with other similar devices or systems and / or with communication devices, for example a TCU (from the English “Telematic Control Unit” or in French “Telematic Control Unit”), for example via a communication bus or through dedicated input / output ports.

[0111] According to a particular and non-limiting exemplary embodiment, the device 5 comprises a block 52 of interface elements for communicating with external devices. The interface elements of the block 52 comprise one or more of the following interfaces: - RF radio frequency interface, for example Wi-Fi® type (according to IEEE 802.11), for example in the 2.4 or 5 GHz frequency bands, or Bluetooth® type (according to IEEE 802.15.1), in the 2.4 GHz frequency band, or Sigfox type using UBN (Ultra Narrow Band) radio technology, or LoRa in the 868 MHz frequency band, LTE (Long-Term Evolution), LTE-Advanced; - USB interface (from the English “Universal Serial Bus” or “Universal Serial Bus” in French); - HDMI interface (from the English “High Definition Multimedia Interface” or “High Definition Multimedia Interface” in French); - LIN interface (from the English “Local Interconnect Network”).

[0112] According to another particular and non-limiting exemplary embodiment, the device 5 comprises a communication interface 53 which makes it possible to establish communication with other devices (such as other computers of the on-board system) via a communication channel 530. The communication interface 53 corresponds for example to a transmitter configured to transmit and receive information and / or data via the communication channel 530. The communication interface 53 corresponds for example to a wired network of the CAN (from the English "Controller Area Network" or in French "Réseau de contrôles") type, CAN FD (from the English "Controller Area Network Flexible Data-Rate" or in French "Réseau de contrôles à débit de données flexible"), FlexRay (standardized by the ISO 17458 standard) or Ethernet (standardized by the ISO / IEC 802-3 standard).

[0113] According to a particular and non-limiting exemplary embodiment, the device 5 can provide output signals to one or more external devices, such as a screen display 540, touch-sensitive or not, one or more speakers 550 and / or other peripherals 560 (projection system) via output interfaces 54, 55 and 56 respectively. According to a variant, one or other of the external devices is integrated into the device 5.

[0114] [Fig. 6] illustrates a flowchart of the different steps of a method for controlling a display system on board a vehicle, for example the vehicle 10, according to a particular and non-limiting exemplary embodiment of the present invention. The method is for example implemented by a device on board the vehicle 10, by a mobile communication device or by the device 5 of [Fig. 5].

[0115] In a first step 61, first data representative of geographical positions of the vehicle, second data representative of a map of a road environment in which the vehicle is traveling, third data representative of the location of a set of level crossings included in the road environment and fourth data representative of level crossing barriers associated with at least part of the set of level crossings are received.

[0116] In a second step 62, the presence of a level crossing from the set of level crossings on a portion of road in the road environment on which the vehicle is traveling is detected as a function of the first, second and third data, the vehicle being approaching and at a determined distance from the level crossing during detection.

[0117] In a third step 63, the display of graphic content in augmented reality is controlled so that this graphic content is displayed on a display device of the vehicle following the detection of the second operation 62, the graphic content comprising a first image of a real scene located in front of the vehicle acquired by a camera on board the vehicle and a virtual graphic object superimposed on the first image, the virtual graphic object comprising a set of graphic objects representative of traffic signs relating to the level crossing, a graphic representation of the virtual graphic object being a function of the fourth data.

[0118] According to a variant, the variants and examples of the operations described in relation to one of figures 1 to 4 apply to the steps of the method of [Fig.6].

[0119] Of course, the present invention is not limited to the exemplary embodiments described above but extends to a method for displaying graphic content in augmented reality which would include secondary steps without thereby departing from the scope of the present invention. The same would apply to a device configured for implementing such a method.

[0120] The present invention also relates to a vehicle, for example an automobile or more generally an autonomous land-powered vehicle, comprising the device 5 of [Fig.5] or a display system comprising the device 5 of [Fig.5] connected in communication to a screen 13.

Claims

Claims

1. Method for controlling an on-board display system in a vehicle (10), said display system comprising a display device (13), said method comprising the following steps: - receiving (61) first data representative of geographical positions of the vehicle (10), second data representative of a map of a road environment (1) in which said vehicle (10) is traveling, third data representative of the location of a set of level crossings included in said road environment (1) and fourth data representative of level crossing barriers associated with at least part of said set of level crossings; - detection (62) of the presence of a level crossing (311; 411) of said set of level crossings on a portion of road of said road environment (1) on which said vehicle (10) is traveling as a function of said first, second and third data, said vehicle (10) being approaching and at a determined distance from said level crossing (311; 411) during said detection (62); - display control (63) of graphic content (30; 40) in augmented reality on said display device (13) following said detection (62), said graphic content (30; 40) comprising a first image (31; 41) of a real scene located in front of said vehicle (10) acquired by a camera (12) on board said vehicle (10) and a virtual graphic object (32; 42) superimposed on said first image (31; 41), said virtual graphic object (32; 42) comprising a set of graphic objects representative of traffic signs relating to said level crossing (311; 411), a graphic representation of said virtual graphic object (32; 42) being a function of said fourth data.

2. Method according to claim 1, for which, said fourth data comprising first information representative of the presence or absence of level crossing barriers (312) associated with said level crossing (311), the graphic representation of said virtual graphic object (32; 42) corresponds to: - a first graphic representation corresponding to a gantry supporting at least one first graphic object (321) representative of a road sign indicating a level crossing provided with barriers and a second graphic object (322) representative of a light signal when said first information is representative of the presence of level crossing barriers (312); and - a second graphic representation corresponding to a gantry supporting at least a third graphic object (421) representative of a road sign indicating a level crossing without a barrier and said second graphic object (322) when said first information is representative of the absence of level crossing barriers.

3. Method according to claim 2, further comprising a reception of fifth data representative of a position of a train with respect to said level crossing, said fourth data further comprising a second information representative of an opening state or a closing state of said level crossing barriers (312), said first graphical representation of the virtual graphical object (32) being further a function of said fifth data and of said second information.

4. Method according to claim 3, for which said first graphical representation comprises: - a third graphical representation according to which said gantry is represented with a first color when said second information is representative of an opening state of the level crossing barriers (312) and said train is at a distance greater than a threshold distance from said level crossing; - a fourth graphical representation according to which said gantry is represented with a second color when said second information is representative of an opening state of the level crossing barriers (312) and said train is at a distance less than the threshold distance from said level crossing, said second color being different from said first color;and - a fifth graphical representation according to which said gantry is represented with a third color when said second information is representative of a state of closure of the level crossing barriers (312), said third color being different from said first color and said second color.;

5. The method of claim 4, wherein said second graphical object (322) is representative of a flashing light signal when said virtual graphical object (32) is represented according to the fourth graphical representation or according to the fifth graphical representation and said second graphical object (322) is representative of a fixed light signal when said virtual graphical object (32) is represented according to the third graphical representation.

6. The method of claim 3, wherein said portal is represented according to the second color when said virtual graphical object (42) is represented according to the second graphical representation.

7. Method according to one of claims 1 to 6, further comprising a step of receiving sixth data representative of activation or deactivation of a level crossing alert service from a human-machine interface on board said vehicle, said display control (63) of the graphic content being a function of said sixth data.

8. Computer program comprising instructions for implementing the method according to any one of the preceding claims, when these instructions are executed by a processor.

9. Device (5) for controlling an on-board display system in a vehicle, said device (5) comprising a memory (51) associated with at least one processor (50) configured for implementing the steps of the method according to any one of claims 1 to 7.

10. Vehicle (10) comprising the device (5) according to claim 9.

Images