Method and control device for a display system for warning of a submersible road crossing for a vehicle

Abstract

The present invention relates to a method and device for controlling a vehicle display system. To this end, the presence of a submerged roadway is detected when the vehicle is approaching and at a predetermined distance from the entrance or end of such a roadway. The display of augmented reality graphic content (40) is controlled to display this graphic content (40) on a display device (13). The graphic content (40) comprises an image (41) of a real scene located in front of the vehicle and a virtual graphic object (42) superimposed on the image (41). A graphic representation of the virtual graphic object (42) is a function of data relating to a tide calendar associated with the submerged roadway. Figure 4 (for the abstract)

Description

Title of the invention: Method and device for controlling a display system for a submersible road crossing warning for a vehicle technical field

[0001] The present invention relates to methods and devices for controlling a display system embedded in a vehicle, in particular but not exclusively a motor vehicle. The present invention also relates to a method and a display system or device for signaling a submersible roadway in a vehicle approaching such a submersible roadway. Technological background

[0002] To assist the driver of a vehicle, it is known to display information relating to the road environment in which the vehicle is traveling, for example on a vehicle display device or on a display screen of a mobile communication device such as a smartphone installed in the vehicle. The display of such information is done, for example, via a human-machine interface (HMI) of a navigation system. Such a navigation system uses mapping data such as digital road maps indicating the roads in the road environment in which the vehicle is traveling, this mapping data being associated with or including additional data relating to the road environment such as the presence of points of interest such as parking lots or information on current traffic conditions.

[0003] Certain information, particularly useful to the driver for ensuring their own safety and that of the passengers in the vehicle, is difficult to present to the driver. For example, information relating to sections of road that may be submerged during a journey is difficult to represent on a map, for instance.

[0004] To ensure the safety of the vehicle and its passengers, it is important to provide the driver with the information necessary to control the vehicle according to the situations encountered during a journey. Summary of the present invention

[0005] One object of the present invention is to solve at least one of the problems of the technological background described above.

[0006] Another object of the present invention is to better alert a driver of a vehicle to a risk associated with a submersible roadway.

[0007] Another object of the present invention is to improve the user experience vis- regarding information associated with a submersible roadway which the vehicle is approaching.

[0008] According to a first aspect, the present invention relates to a method for controlling a display system embedded in a vehicle, the display system comprising a display device, the method comprising the following steps: - obtaining initial data representative of the presence of a submersible roadway on a section of road on which the vehicle is traveling; - receipt of second data representative of a calendar of high and low tide times associated with a maritime area including the submersible causeway, the calendar including information representative of tide coefficients associated with high and low tides; - control of display of augmented reality graphic content on the display device, the graphic content comprising an image of a real scene located in front of the vehicle acquired by a camera mounted in the vehicle and a virtual graphic object superimposed on the image, the virtual graphic object comprising a set of graphic objects representing the submersible roadway, a graphic representation of the virtual graphic object being a function of the second data and of a temporal information representative of a current moment.

[0009] Such a method allows a driver of a vehicle to be visually alerted when approaching a submersible roadway. The alert is further adapted to the tide times and the associated tidal coefficients in the maritime area encompassing the submersible roadway the vehicle is approaching. The use of augmented reality allows virtual objects to be superimposed onto an image of the scene, providing the driver with clear information about the presence of a risk zone, i.e., the submersible roadway, and about the actual risk by taking into account the tide coefficient and time. This allows the driver to adjust vehicle control to the specific situation encountered, anticipating the associated risks.

[0010] According to one variant, the virtual graphic object represents a gantry supporting at least a first graphic object representing a road sign indicating a submersible roadway area, at least a second graphic object representing a light signal and a third graphic object representing a text display area.

[0011] According to yet another variant, the graphical representation of the virtual graphical object corresponds to: - a first graphical representation when the current moment belongs to a first time interval of determined duration centered on a low tide time and when a coefficient of a high tide following temporally the low tide is less than a threshold coefficient, the gantry being displayed with a first color according to the first graphic representation; - a second graphic representation when the current moment belongs to the first time interval and when the high tide coefficient is greater than the threshold coefficient, the gantry being displayed with a second color different from the first color according to the second graphic representation; - a third graphical representation when the current moment belongs to a second time interval of determined duration centered on a high tide time, the gantry being displayed with a third color according to the third graphical representation, the third color being different from the first and second colors; and - a fourth graphical representation when the current moment belongs to a third time interval between the first interval and the second time interval, the gantry being displayed with the second color according to the fourth graphical representation.

[0012] According to another variant, the at least one second graphic object is representative of a fixed light signal according to the first graphic representation and according to the second graphic representation, and the at least one second graphic object is representative of a flashing light signal according to the third graphic representation and according to the fourth graphic representation.

[0013] According to an additional variant, the text display area includes a first piece of information representing the current moment, a second piece of information representing a time of the coming high tide and a third piece of information representing a high tide coefficient.

[0014] According to an additional variant, the at least first graphic object is representative of a road sign indicating the start of a submersible roadway when the vehicle is approaching the start of a submersible roadway and the at least first graphic object is representative of a road sign indicating the end of a submersible roadway when the vehicle is approaching the end of a submersible roadway.

[0015] According to another variant, the first data are determined from third data representing the geographical positions of the vehicle, fourth data representing a map of a road environment in which the vehicle travels and fifth data representing the location of submersible pavements included in the road environment.

[0016] According to yet another variant, the method further comprises a step of receiving sixth data points representing the activation or deactivation of a submersible pavement presence alert service from an onboard human-machine interface in the vehicle, the control of the display of graphic content is a function of the sixth data point.

[0017] According to a second aspect, the present invention relates to a control device for a display system embedded in a vehicle, the device comprising a memory associated with a processor configured for the implementation of the steps of the process according to the first aspect of the present invention.

[0018] According to a third aspect, the present invention relates to a vehicle, for example of the automobile type, comprising a device as described above according to the second aspect of the present invention.

[0019] According to a fourth aspect, the present invention relates to a computer program which includes instructions adapted for carrying out the steps of the process according to the first aspect of the present invention, in particular when the computer program is executed by at least one processor.

[0020] Such a computer program may use any programming language, and be in the form of source code, object code, or an intermediate code between source code and object code, such as in a partially compiled form, or in any other desirable form.

[0021] According to a fifth aspect, the present invention relates to a computer-readable recording medium on which is recorded a computer program comprising instructions for carrying out the steps of the process according to the first aspect of the present invention.

[0022] On the one hand, the recording medium can be any entity or device capable of storing the program. For example, the medium can include a storage means, such as a ROM, a CD-ROM or a microelectronic circuit-type ROM, or a magnetic recording means or a hard disk drive.

[0023] On the other hand, this recording medium can also be a transmissible medium such as an electrical or optical signal, such a signal being able to be transmitted via an electrical or optical cable, by conventional or radio frequency, by self-directing laser beam, or by other means. The computer program according to the present invention can, in particular, be downloaded from an Internet-type network.

[0024] Alternatively, the recording medium may be an integrated circuit in which the computer program is incorporated, the integrated circuit being adapted to execute or to be used in the execution of the process in question. Brief description of the figures

[0025] Other features and advantages of the present invention will become apparent from the description of the particular and non-limiting embodiments of this invention. invention below, with reference to figures 1 to 7 attached, in which:

[0026] [Fig.1] schematically illustrates an environment of a vehicle, according to a particular and non-limiting embodiment of the present invention;

[0027] [Fig.2] schematically illustrates a passenger compartment of the vehicle of [Fig.1], according to a particular and non-limiting embodiment of the present invention;

[0028] [Fig.3] schematically illustrates a chronogram of the tides associated with the environment of [Fig.1], according to a particular and non-limiting embodiment of the present invention;

[0029] [Fig.4] schematically illustrates a display screen embedded in the vehicle of [Fig.1], according to a first particular and non-limiting embodiment of the present invention;

[0030] [Fig.5] schematically illustrates a display screen embedded in the vehicle of [Fig.1], according to a second particular and non-limiting embodiment of the present invention;

[0031] [Fig.6] schematically illustrates a device configured for the control of an on-board display system in the vehicle of [Fig.1], according to a particular and non-limiting embodiment of the present invention;

[0032] [Fig.7] illustrates a flowchart of the different stages of a control process for an on-board display system in the vehicle of [Fig.1], according to a particular and non-limiting embodiment of the present invention. Description of examples of achievements

[0033] A method and a control device for an on-board display system in a vehicle will now be described in what follows with joint reference to Figures 1 to 7. The same elements are identified with the same reference signs throughout the following description.

[0034] The terms "first," "second" (or "firsts," "seconds"), etc., are used in this document by arbitrary convention to allow for the identification and distinction of different elements (such as operations, means, etc.) implemented in the embodiments described below. Such elements may be distinct or correspond to a single element, depending on the embodiment.

[0035] According to a particular and non-limiting example of an embodiment of the present invention, the control of a display system embedded in a vehicle is, for example, implemented by one or more computers of the vehicle, for example via one or more processors, or by one or more processors of a mobile communication device embedded in the vehicle, in particular when the display system is integrated into the mobile communication device.

[0036] To this end, initial data representative of the presence of a submersible road surface on a section of road on which the vehicle is traveling are obtained. Initial data is obtained, for example, by analyzing one or more images acquired by a camera mounted in the vehicle and detecting objects in these images that indicate the presence of such an area (a warning sign indicating a floodable road). In another example, initial data is determined from third data points representing the vehicle's geographic position, fourth data points representing a map of the road environment in which the vehicle is traveling, and fifth data points representing the location of a set of floodable roads within that road environment.

[0037] Second data sets representing a calendar of high and low tide times associated with a maritime area including the submersible causeway are received via wireless communication, for example from a remote device such as a cloud server, for example a weather server. These second data sets also include information representing tidal coefficients associated with high and low tides.

[0038] The display of augmented reality graphic content is controlled such that this graphic content is displayed on a display device of the vehicle's display system. The graphic content comprises an image of a real scene located in front of the vehicle, which image is acquired by a camera on board the vehicle (for example, a vehicle camera or a camera of the mobile communication device), and a virtual graphic object displayed as an overlay on the image. The virtual graphic object comprises a set of graphic objects representing the submersible roadway (or the risks associated with this submersible roadway) that the vehicle is approaching. The virtual graphic object is represented according to a specific graphic representation that is a function of the second set of data, namely the high and low tide times and the current time (or instant).

[0039] The first data include data or information indicating, for example, the beginning and end of a submersible roadway.

[0040] In a maritime area subject to tides, a submersible causeway corresponds to a causeway or a portion of a road which is practicable at low tide, for a specified period around the low tide, i.e. which can be used by vehicles at low tide because it is exposed, and which is impracticable at high tide, for a specified period around the high tide, i.e. which cannot be used by vehicles at high tide because it is covered in whole or in part by the waters.

[0041] Such submersible roadways represent a risk to vehicles and their passengers, particularly during the rising tide (the phase of rising water levels from low tide to high tide): a vehicle using the submersible roadway while it is not yet covered by water risks being to find oneself blocked by the waters without having reached the end of the submersible causeway, without the possibility of advancing or retreating, the causeway becoming submerged as the water rises, until reaching a maximum water height corresponding to high tide.

[0042] The water depths at low tide (minimum height) and high tide (maximum height) vary according to the tidal coefficients associated with these low and high tides, the difference in water depth between high and low tide being called the tidal range. The tidal coefficients are between 20 and 120.

[0043] Fig. 1 schematically illustrates a vehicle 10 in an environment 1, according to a particular and non-limiting embodiment of the present invention.

[0044] Fig. 1 illustrates a vehicle 10, for example a motor vehicle, in an environment 1, the environment 1 corresponding to a road environment in which the vehicle 10 moves and travels.

[0045] Vehicle 10 corresponds, for example, to a vehicle with an internal combustion engine, with electric motor(s), or even a hybrid vehicle with an internal combustion engine and one or more electric motors. Vehicle 10 thus corresponds, for example, to a land vehicle, for example a car, a truck, a bus.

[0046] According to the example in [Fig. 1], the vehicle 10 is traveling on a road or section of road 110 comprising one or more traffic lanes and located in an area including a submersible road or pavement, the section of road 110 leading into an area 112 whose pavement is submersible, that is to say, an area that can be covered by water for a specified period around the time of high tide. The vehicle 10 is thus approaching a section of submersible pavement 112, that is to say, the submersible pavement 112 is downstream of the vehicle 10 (or in front of the vehicle 10) depending on the direction of travel of the vehicle 10.

[0047] According to the example in [Fig. 1], the beginning of the submersible roadway 112 is marked or indicated by a road sign 111 indicating a danger of flooding. Such a sign 111 corresponds to a danger sign with, for example, an exclamation mark and text below the sign specifying the type of danger (submersible road or roadway) or a danger sign with a pictogram representing a vehicle submerged by water.

[0048] According to a particular embodiment, the vehicle 10 carries a communication system configured to communicate with one or more remote devices or servers 103 via a wireless communication network infrastructure.

[0049] The remote server(s) 103 each correspond, for example, to a server in the "cloud" 100. The wireless communication infrastructure includes, for example, a set of antenna-type communication devices 102 LTE (Long Term Evolution) 4G or 5G cellular network. According to one embodiment, the communication devices belonging to the wireless communication infrastructure correspond to UBRs (Roadside Units).

[0050] The communication system of the vehicle 10 includes, for example, one or more communication antennas connected to a telematic control unit, called a TCU (from the English "Telematic Control Unit"), itself connected to one or more computers of the vehicle's on-board system 10. The antenna(s), the TCU and the computer(s) form, for example, a multiplexed architecture for the implementation of various services useful for the proper functioning of the vehicle and for assisting the driver and / or passengers of the vehicle in controlling the vehicle 10.The computer(s) and the TCU communicate and exchange data with each other via one or more computer buses, for example a CAN (Controller Area Network), CAN FD (Controller Area Network Flexible Data-Rate), FlexRay (according to ISO 17458) or Ethernet (according to ISO / IEC 802-3) type communication bus.

[0051] According to a particular embodiment, the vehicle 10 carries a navigation and geolocation system, also called a GNSS (Geolocation and Navigation by Satellite System) system, for example a GPS (Global Positioning System) or Galileo type system. According to this embodiment, the vehicle 10 carries a geolocation system receiver enabling the vehicle 10 to obtain third data representative of its geographic position at any time, for example in the form of GPS coordinates (latitude and longitude), via a satellite link with a set of satellites 101.

[0052] The vehicle 10's navigation system is, for example, connected via an OTA (Over The Air) link to receive mapping data and initial data relating to the presence of one or more submersible roads or pavements, for example as the vehicle 10 moves, via the vehicle 10's communication system. According to one variant, such data is recorded in a memory of the vehicle 10 associated with the navigation system, the recorded data being updated, for example, via the OTA link (for example, periodically or when the mapping data and / or the level crossing and barrier data have been updated on the remote device 103).

[0053] According to one embodiment, the vehicle 10, for example the na system The monitoring system also receives data, known as second data, relating to a tide calendar associated with the maritime area including the submersible causeway 112. Such a calendar indicates the times of successive low and high tides with the tidal coefficients associated with each high and low tide over a given period (for example, the next month, the next 3 or 6 months, or the current year). This second data is, for example, stored in a memory of the vehicle 10 and updated regularly (for example, monthly, every 3 or 6 months, or annually).According to one variant, the second data only indicates the time of the current tide and the time of the next coming tide (considering the current time, indicating whether it is a high or low tide, the associated time and the associated tide coefficient) for only the submersible causeway 112 from which the vehicle 10 is approaching, knowing the current time and the current geographical position of the vehicle 10. The second data is received from a remote device such as a "cloud" server, such as the remote device 103.

[0054] According to another particular embodiment, the vehicle 10 carries a mobile communication device, such as a smartphone (from the English "Smartphone") or a tablet, such a wireless communication device being arranged for example on a support fixed to an element of the vehicle's interior 10 so that the display screen of the mobile communication device is visible to the driver when the latter is driving the vehicle 10. According to such an embodiment, the mobile communication device incorporates a navigation and geolocation system, also called a GNSS (Geolocation and Navigation by a Satellite System) system, for example a GPS type system (from the English "Global Positioning System" or in French "Système de géo-positionnement par satellites"), for example installed on the communication device in the form of a mobile application.Such an embodiment allows the driver of the vehicle 10 to use the navigation and display systems of the mobile communication device, for example, when the vehicle 10 does not have a navigation system or when the driver prefers to use the navigation system of the mobile communication device instead of the navigation system of the vehicle 10. The mobile communication device is advantageously connected wirelessly to the remote device(s) 103 via the wireless network infrastructure, for example, to receive mapping data as well as data relating to flooded pavements, or updates to such data stored in the memory of the mobile communication device. The mobile communication device is, for example, connected wirelessly to the vehicle 10, for example, via a Bluetooth® or Wi-Fi® wireless connection.

[0055] Remote server 103 is configured, for example, to send data relating to road infrastructure such as: - fourth mapping data, for example fourth data representing road maps, and / or - fifth data representing one or more submersible roadways, for example data representing the coordinates of the start and end of each submersible roadway (or the length of the submersible roadway, for example indicated in meters) or location data of this or these submersible roadways on the roads with the start and end of the submersible roadway.

[0056] According to a particular embodiment illustrated in [Fig.2], the vehicle 10 includes a display system comprising a display device or screen 13 and a computer configured to control the display of content(s) of a graphic HMI on the touch screen 13. The computer corresponds, for example, to the computer of the infotainment system, called the IVI computer (from the English "In-Vehicle Infotainment" or in French "Infodivertissement étoilé") of the vehicle 10.

[0057] According to one embodiment, the vehicle display system 10 includes one or more other screens, for example a screen of a device or system called a head-up display corresponding for example to a transparent or semi-transparent blade arranged in such a way that a driver sitting in the seat 16 sees the content displayed or projected onto the transparent blade when the driver drives the vehicle 10, or a display screen 15 called a combination or instrument panel generally arranged in an area behind the steering wheel 14 in the dashboard 11.

[0058] The screen 13 is for example associated with a touch interface and corresponds for example to an LCD type screen (from the English "Liquid Crystal Display" or in French "Affichage à cristals liquide"), for example of type TFT (from the English "Thin-Film Transistor" or in French "Transistor en film mince"), or OLED (from the English "Organic Light-Emitting Diode" or in French "Diode électroluminescente organique").

[0059] The screen 13 is configured to display content for the driver and passengers of the vehicle. The screen 13 is also configured to allow the driver and / or passengers of the vehicle 10 to interact with one or more systems embedded in the vehicle 10 via a human-machine interface (HMI) displayed on the screen 13. For example, the screen 13 is configured to interact with the IVI system and / or a navigation system of the vehicle 10.

[0060] According to a particular embodiment, the screen 13 is not integrated into the vehicle's passenger compartment but corresponds to a screen of a mobile communication device (smartphone, tablet), connected in communication, for example wirelessly, with the vehicle embedded system 10.

[0061] The vehicle 10 also carries, for example, one or more cameras, for example, a camera 12 corresponding to a front-facing camera (also called a windshield camera). Such a camera 12 is arranged in the passenger compartment of the vehicle 10 below the windshield and at the top and in the middle of this windshield. Such a front-facing camera 12 has a field of view corresponding to the space located in front of the vehicle 10 in the direction of travel of the vehicle 10. Such a camera 12 is thus configured for acquiring image data representative of the actual scene located in front of the vehicle 10, in the direction of travel of the vehicle 10.

[0062] Camera 12 includes, for example, the following elements: - a photosensitive sensor corresponding for example to a matrix of photoreceptors associated for example with a Bayer filter; - an optical assembly arranged in front of the sensor with respect to the scene to be acquired by the sensor, the optical assembly comprising, for example, an arrangement of one or more lenses; and - optionally one or more computers associated with memory and configured for processing images acquired by the sensor.

[0063] According to one embodiment, the camera corresponds to a camera of the mobile communication device installed in the vehicle 10, if applicable. The camera of the mobile communication device is also configured to acquire image data representative of the actual scene in front of the vehicle 10, depending on the location of the mobile communication device within the passenger compartment of the vehicle 10.

[0064] A control process for an on-board display system in the vehicle 10 is advantageously implemented by one or more processors of the display system, for example by a computer of an on-board system of the vehicle 10 such as the IVI system or the navigation system, or by a processor of the mobile communication device. The on-board display system thus corresponds to a display device integrated into the vehicle 10 or to a display system of a mobile communication device itself embedded in the vehicle 10.

[0065] In a first operation of the process, first representative data of the presence of a submersible roadway 112 onto which a portion of road 110 on which the vehicle 10 travels is brought out are obtained, for example received from another device (for example another computer of the vehicle 10) or determined from other data.

[0066] According to a first embodiment, the presence of the submersible pavement 112 is detected or determined by cross-referencing third data points representative of geographical positions of vehicle 10, fourth data representing a map of the road environment 1 in which vehicle 10 travels and fifth data representing the location of a set of submersible pavements included in the road environment 1.

[0067] According to one embodiment, the fifth data received are representative only of the submersible roadway 112 of which the vehicle 10 is approaching, these fifth data being received knowing the current position of the vehicle 10 (via the third data) and the mapping (via the fourth data).

[0068] According to another variant, the fifth data form part of the fourth data, that is to say that the mapping data include the position or location of the submersible pavement(s).

[0069] The third data are for example received from a receiver of a geolocation system 101. The fourth and fifth data are for example received from a memory and / or a remote device such as a server 103 configured to make such data available to navigation systems of so-called connected vehicles and / or mobile navigation applications of mobile communication devices.

[0070] The fourth and fifth data received correspond, for example, to data relating to the road environment in which the vehicle 10 is traveling at each moment, these fourth and fifth data varying as the vehicle 10 moves in its environment 1. For example, the fourth and fifth data relate to an area surrounding the vehicle 10, for example over a radius of a few kilometers or a few hundred meters.

[0071] According to a second embodiment, the presence of the submersible roadway 112 is detected or determined by analyzing image data of the scene in front of the vehicle 10 acquired by the camera 12 or by a camera of a traffic sign recognition system of the vehicle 10, as the vehicle 10 moves along the road 110.

[0072] Image data analysis includes the detection and recognition of specific objects, such as a road sign 111 indicating the presence of a submersible roadway. When such an object is detected in one or more acquired images, the presence of a submersible roadway 112 is detected and the initial data is generated, then transmitted to the computer implementing the process by the computer controlling the image analysis system.

[0073] The detection of the submersible roadway 112 is obtained, for example, when the vehicle 10 arrives at a determined distance from the start of such a submersible roadway 112, for example when the vehicle 10 is located 50, 100, 200 or 500 m from the start of the submersible roadway 112 (the start of the zone being, for example, marked by the presence of sign 111 or indicated in the fifth data). The detection distance corresponds for example to a fixed parameter of the system or to a parameter adjustable by a user of the system, for example by the driver of vehicle 10.

[0074] In a second operation of the process, second data representing a calendar of high and low tide times associated with a maritime area including the submersible causeway are received according to a wireless communication mode, for example according to an I2V type communication mode (from the English "Infrastructure-to-Vehicle" or in French "Infrastructure to vehicle") and / or according to a wireless link using a 4G or 5G type cellular network.

[0075] Such a calendar includes the time of each high and low tide in a sequence of alternating high and low tides, for example, for each day of a specified time period (e.g., 3, 6, or 12 months). The calendar further includes the tidal coefficient associated with each high and low tide.

[0076] The second data is received from a remote server such as server 103 configured to store and transmit tide data for a given maritime or geographical area (for example France, Europe or the Atlantic coast of France, the English Channel, the Mediterranean, etc.) or for a plurality of maritime or geographical areas, and in particular data relating to the maritime area including the submersible causeway 112 from which the vehicle 10 is approaching.

[0077] The second data is received automatically by the vehicle 10, for example at regular intervals, for example every 3, 6, or 12 months depending on the length of the time period of the received calendar, the second data then being stored in the memory of the vehicle 10 (or the mobile communication device depending on the implementation method). According to another example, the second data is received automatically and comprises only the tide information relating to the submersible causeway 112 which the vehicle 10 is approaching for a time period around the current moment corresponding to the hour and day at which the vehicle 10 is approaching the submersible causeway 112.According to this other example, vehicle 10 transmits its geographical location at regular intervals, and server 103, detecting the presence of vehicle 10 approaching the submersible road 112, automatically transmits the second set of tide data in this area, particularly around the time (called the current time) at which vehicle 10 is approaching the submersible road 112. According to yet another example, the second set of data is transmitted by the remote server 103 to vehicle 10 following the transmission by vehicle 10 of a request to the remote server to receive the second set of data, the request including by. example the geographic position data of vehicle 10 at the time of transmission of the request so that the remote server can in turn transmit the second data for the area including the position of vehicle 10.

[0078] In a third operation of the process, the display of augmented reality graphic content is controlled so that this graphic content is displayed on a display device, for example screen 13.

[0079] The display control is triggered by the detection of the presence of the submersible pavement 112 materialized by obtaining the first data at the first operation of the process.

[0080] The graphic content advantageously includes: - an image of the actual scene located in front of vehicle 10 acquired by a camera mounted in vehicle 10 such as camera 12; and - a virtual graphic object displayed as an overlay on the image, the virtual graphic object comprising a set of graphic objects representing the submersible roadway and associated risks, a graphic representation of the virtual graphic object being a function of the second data and of a temporal information representative of the current moment (corresponding for example to the moment (day and time) of detection of the presence of the submersible roadway 112), that is to say of the time of the current tide at the current moment (low tide or high tide), of the time of the next tide following temporally the current tide (high tide if the current tide is a low tide and low tide if the current tide is a high tide) and / or the tide coefficients associated with the current tide and the next tide.

[0081] Display control includes rendering the graphic content, such rendering corresponding to a set of operations performed by one or more processors on the pixels of the image to compose the graphic content. For example, rendering consists of associating a set of pixels of the image with pixel data (for example, color data expressed in an RGB (Red, Green, Blue) type space) associated with the virtual graphic object.

[0082] The virtual graphic object (and the graphic objects that this virtual graphic object comprises) corresponds to a graphic object obtained by image synthesis, the virtual graphic object being superimposed on the image at a determined location, for example at a determined distance from the viewpoint associated with the image, that is to say at a location situated at a determined distance from the viewpoint of the camera 12, for example. Thus, the pixels of the first image at the location of the overlay of the virtual graphic object in the image are replaced by the pixels defining the virtual graphic object.

[0083] Figures 4 and 5 each illustrate an example of the result of such a rendering of the virtual graphic object, i.e. the display of graphic content 40, 50 on the screen 13 with the virtual graphic object 42, 52 according to different graphic representations.

[0084] Each virtual graphic object 42 or 52 represents a gantry supporting at least a first graphic object 421, 521 representing a road sign indicating a submersible roadway area, at least a second graphic object 422, 522 representing a traffic light signal and a third graphic object 423, 523 representing a text display area

[0085] In [Fig.4], the graphic content 40 thus displayed results from the embedding of a virtual graphic object 42, for example a 3D graphic object, on an image 41 whose content represents the real scene that the driver sees (at least partially) through the windshield of the vehicle 10 at the moment of acquisition of the image 41 (or with a slight time delay necessary for the composition of the graphic content 40, on the order of a few hundred milliseconds for example).

[0086] The result of the rendering thus corresponds to content called augmented reality (noted RA, or AR in English for "Augmented Reality") in that this content mixes content representing a real environment (acquired by a camera) with digital virtual content obtained by computer.

[0087] The graphic content 40 varies according to the movement of the vehicle 10 on the roadway of the road segment 110, as the vehicle 10 moves along the roadway, via: - the displayed image 41, which varies as image data is received from camera 12, depending on the viewpoint of camera 12, which evolves and varies according to the movement of vehicle 10, the images being, for example, refreshed / displayed at a frequency of 24, 48 or 50 frames per second; and - an adjustment of the representation of the virtual graphic object 42 as the vehicle 10 moves, the virtual graphic object 42 being for example superimposed on the image at a constant distance from the viewpoint of the camera 12 or the representation of the virtual graphic object 42 being modified as the vehicle moves to provide the illusion to the driver that the vehicle 10 is approaching the virtual graphic object 42, the adjustment of the graphic representation allowing the perspective to be adapted according to the evolution of the viewpoint of the graphic content 40 which varies with the movement of the vehicle 10, until the vehicle 10 passes virtually under the virtual graphic object 42 which then disappears from the graphic content 40.

[0088] According to the example in [Fig. 4], the virtual graphic object 42 represents a gantry supporting one or more first graphic objects or pictograms 421 (two first graphic objects 421 according to the particular example in [Fig. 4]), each representing a sign indicating a submersible roadway area, or the beginning of such a submersible roadway, one or more second graphic objects or pictograms 422 (two second graphic objects 422 according to the particular example of [Fig.4]) each representing a light signal (fixed or flashing depending on different scenarios, as explained below) and a third graphic object 423 representing a text display area for displaying textual information relating in particular to the current tide.

[0089] According to the particular example of [Fig.4], the third graphic object 423 is displayed in the middle of the upper upright of the portico, the third graphic object 423 is surrounded on the left and right by a second graphic object 322 arranged on the upper upright of the portico is arranged in the middle of the first two graphic objects 321, the second graphic objects 422 being themselves surrounded by the first graphic objects 421 arranged on the upper upright of the portico.

[0090] Of course, the virtual graphic object 42 is not limited to such a representation but extends to any virtual graphic representation, for example to a gantry or a lateral post supporting the first, second, and third graphic objects 421, 422, 423, or even to a line drawn on the ground with the first, second, and third graphic objects superimposed on it. According to another example, the virtual graphic object comprises only the first and third graphic objects 421, 423.

[0091] Since the graphical representation of the virtual graphical object 42 is a function of the second set of data, this graphical representation corresponds, for example, to one of the following graphical representations: - a first graphical representation when the current moment belongs to a first time interval 301 of determined duration centered on a low tide time 31 and when a coefficient of the high tide 32 following temporally the low tide 31 is less than a threshold coefficient, the gantry being displayed with a first color (for example the color green) according to the first graphical representation: the first graphical representation indicates that crossing the submersible causeway is possible and authorized because the tide is low and that the high tide which will follow the current low tide will have a coefficient less than the threshold coefficient; - a second graphic representation when the current moment belongs to the first time interval and when the high tide coefficient 32 is greater than the threshold coefficient, the gantry being displayed with a second color (for example the color orange) different from the first color according to the second graphic representation: the second graphic representation indicates that crossing the submersible roadway is possible and authorized because the tide is low, the second color allowing the driver of the vehicle 10 to be alerted to a possible danger or risk associated with the risk of the next high tide with a high coefficient (i.e. greater than the threshold coefficient); - a third graphical representation when the current moment belongs to a second time interval of determined duration centered on a tide time high 32 following temporally the low tide 31, the gantry being displayed with a third colour (for example the colour red) according to the third graphic representation, the third colour being different from the first colour and the second colour: the third graphic representation indicates that crossing the submersible causeway is impossible and prohibited because the tide is high;and - a fourth graphical representation when the current moment belongs to a third time interval between the first and second time intervals, the gantry being displayed with the second color according to the fourth graphical representation: the fourth graphical representation indicates that crossing the submersible roadway is possible but dangerous because the tide is rising and there is a risk that the vehicle 10 will be blocked by the water while crossing the submersible roadway 112, regardless of the tide coefficient. ;

[0092] The threshold coefficient is, for example, equal to 70, with tidal coefficients lower than the threshold coefficient corresponding to neap tide coefficients and tidal coefficients higher than the threshold coefficient corresponding to spring tide coefficients. In another example, the threshold coefficient is equal to 80.

[0093] According to an optional embodiment, the virtual graphic object 42 further includes a fourth graphic object 424 representing, for example, a colored cross corresponding to the third color, this fourth graphic object being displayed inside the gantry to explicitly indicate that the gantry must not be crossed, the submersible causeway 112 being impassable at high tide (i.e. during the second time interval 302 associated with this high tide).

[0094] The text display area 423 includes a first piece of information representing the current time (for example, a text of the type: "It is HH h MM" with 'HH' the hour and 'MM' the minutes), a second piece of information representing a time of high tide, current or coming after the current low tide (for example, a text of the type "high tide: HH h MM" with 'HH' the hour and 'MM' the minutes) and a third piece of information representing a tide coefficient of the high tide, current or coming (for example, a text of the type "coefficient: CC" with 'CC' the value of the tide coefficient).

[0095] The text color is, for example, identical regardless of the graphic representation of the virtual graphic object 42. According to one variant, the text color corresponds to the color of the gantry according to the graphic representation of the virtual graphic object 42.

[0096] Figure 3 illustrates a temporal diagram of a sequence of low and high tides following each other temporally, according to a particular embodiment.

[0097] Figure 3 illustrates in particular the first 301, second 302 and third 303 in- temporal intervals described previously.

[0098] Fig. 3 thus illustrates a temporal sequence comprising a low tide 31 followed temporally by a high tide 32, which high tide 32 is followed by a low tide 33, which low tide 33 is also followed by another high tide not shown, and so on.

[0099] Each tide (high or low) is separated from the tide (low or high, respectively) which precedes or follows it by a time interval whose duration varies according to the day and which is for example equal to a duration between 4h and 7h.

[0100] The first time interval 301 is associated with the low tide 31, the first time interval 301 being, for example, of a determined duration and temporally centered on the time of the low tide 31 (that is to say, the time at which the water level is lowest, this minimum water level depending on the tidal coefficient associated with this low tide 31). The first time interval 301 is between a lower bound 311 (at a time distance ôt from the time of the low tide 31 of, for example, 1h30 or 2h) and an upper bound 312 (at a time distance ôt from the time of the low tide 31 of, for example, 1h30 or 2h, respectively). Thus, if t3[ corresponds to the time of low tide 31, then the time of the lower boundary 311 is t3n = t3[ - ôt, with ôt equal to 1h30, 2h or 2h30 for example. Similarly, the time of the upper boundary 312 is t3[2 = t3[ + ôt and the duration of the first time interval 301 is 2* ôt.The value of ôt of the first time interval 301 is for example a function of the tidal coefficient of low tide 31. .

[0101] The second time interval 302 is associated with the high tide 32 following temporally the low tide 31 (the high tide 32 also being called the next high tide in relation to the low tide 31), the second time interval 302 being for example of a determined duration and temporally centered on the time of the low tide 32 (that is to say the time at which the water height is the highest, this maximum water height depending on the tidal coefficient associated with this high tide 32). The second time interval 302 is between a lower bound 321 (at a time distance ôt from the time of high tide 32, for example lh30 or 2h, this value of ôt being equal to or different from the value of ôt associated with the first time interval 301) and an upper bound 322 (at the time distance ôt from the time of high tide 32, for example lh30 or 2h, respectively).Thus, if t32 corresponds to the time of high tide 32, then the time of the lower boundary 321 is t32i = t32 - ôt, with ôt equal to 1h30, 2h, or 2h30, for example. Similarly, the time of the upper boundary 322 is t322 = t32 + ôt, and the duration of the second time interval 302 is 2* ôt. The value of ôt for the second time interval 302 is, for example, a function of the tidal coefficient of high tide 32.

[0102] The third time interval 303 corresponds to the time interval between the upper bound 312 of the first time interval 301 and the lower bound 321 of the second time interval 302. The duration of this third time interval 303 is a function of the duration between t3i and t32, of the value of ôt of the first time interval 301 and of the value of ôt of the second time interval 302. The third time interval 303 is associated with a period the tide called rising tide linking the period of low tide (defined by the first time interval 301) and the period of high tide (defined by the second time interval 302), the height of the water increasing during the rising tide.

[0103] Similarly, a fifth time interval 305 is associated with the low tide 33 following the high tide 33. The fifth time interval 305 is defined in the same way as the first time interval 301 associated with the low tide 31, with a lower bound 331 and an upper bound 332 at a time distance ôt from the time t33 of the low tide 33. A fourth time interval 304 is defined as corresponding to the time interval between the upper bound 322 of the second time interval 302 and the lower bound 331 of the fifth time interval 305. The duration of this fourth time interval 304 is a function of the duration between t32 and t33, the value of ôt of the second time interval 302, and the value of ôt of the fifth time interval 305.The fourth time interval 304 is associated with a period, the so-called ebb tide, linking the period of high tide (defined by the second time interval 302) and the following period of low tide (defined by the fifth time interval 305), the water height decreasing during the ebb tide.

[0104] Other colours can of course be used, such as for example blue for the first colour or yellow for the second colour.

[0105] According to one embodiment, the light signal is fixed or flashing depending on the graphic representation of the virtual graphic object 42. According to this embodiment, each second graphic object 422 is representative of a fixed light signal according to the first graphic representation and according to the second graphic representation, and each second graphic object 422 is representative of a flashing light signal according to the third graphic representation and according to the fourth graphic representation.

[0106] The flashing light signal is used to draw the driver's attention to a situation requiring increased vigilance, for example when: - the tide is high and the submersible causeway 112 is covered with water, corresponding to the second time interval 302, and - when the sea rises, with a risk that the roadway 112 will become submerged while the vehicle 10 has entered it, corresponding to the third time interval 303.

[0107] Figure 5 illustrates an example of the result of a rendering of the virtual graphic object 52, that is to say the display of graphic content 50 on the screen 13 with the virtual graphic object 52 superimposed on an image 51 of the real scene.

[0108] Thus, according to the example of [Fig.5], the graphical representation of the virtual graphical object 52 is similar to that of the virtual graphical object 42 described opposite [Fig.4],

[0109] The graphic content 50 is displayed on the screen 13 when the vehicle 10 is approaching the end of the submersible roadway 112, when the vehicle 10 is at a determined distance from the end of the submersible roadway 112, for example at 50, 100, 200 or 500 m from the end of the submersible roadway 112.

[0110] The virtual graphic object 52 is representative of a gantry supporting one or more first graphic objects or pictograms 521 (two first graphic objects 521 according to the particular example of [Fig.5]) each representing a sign indicating a submersible roadway area, or the end of such a submersible roadway (the pictogram 521 corresponding to the pictogram 421 with a bar across this pictogram 421 to indicate the end of the area concerned by the danger indicated by the sign), one or more second graphic objects or pictograms 422 (two second graphic objects 422 according to the particular example of [Fig.5], identical to those of [Fig.4]) each representing a light signal (steady or flashing depending on different scenarios, as explained previously) and a third graphic object 423 representing a text display area for displaying textual information relating in particular to the current tide, the third graphic object 423 being identical to that of [Fig.4]. .

[0111] The graphic representation of the virtual graphic object 52 varies according to the second data, the graphic representations taken by the virtual graphic object 52 being identical to those taken by the virtual graphic object 42 described previously with regard to [Fig.4] and under the same conditions, i.e. the first, second, third and fourth graphic representations.

[0112] The end of the display of the virtual graphic object 42 or 52 is controlled so that the display of this virtual graphic object 42 or 52 on the screen ceases as soon as the vehicle crosses the beginning or end, respectively, of the submersible roadway 112 (the crossing being detected for example from the geographical coordinates of the vehicle 10 and the first data).

[0113] According to another particular embodiment, the control of displaying the graphic content is a function of sixth data representing the activation or deactivation of a submersible roadway zone alert service.

[0114] According to this other particular embodiment, the sixth data points are, for example, received from a human-machine interface (HMI) embedded in the vehicle 10. The sixth data points are generated, for example, following a user action activating or deactivating the flood road zone alert service, for example via the touch interface associated with screen 13.

[0115] The flood road zone warning service, when activated, causes the generation or rendering of graphic content 40, 50 when the vehicle 10 is approaching the beginning or end of a flood road zone and then the display of this graphic content 40, 50 on the screen 13.

[0116] Conversely, when the flooded road zone alert service is deactivated, the rendering and display of graphic contents 40, 50 are deactivated and inoperative.

[0117] According to yet another variant, other virtual graphic objects are added to the graphic content 40, 50, for example when the navigation system is used in a guidance mode (following a route calculated by the navigation system), these other virtual graphic objects representing, for example, guidance instructions (for example, arrows embedded on the road to materialize the route to follow) to indicate to the driver the route to follow.

[0118] The display of graphic contents 40, 50 is controlled and implemented, whether the navigation system is used in guidance mode or not.

[0119] Such a process makes it possible to maintain a visualization and user experience of the navigation module in augmented reality format, without needing to add a pop-up window message that clutters the augmented reality navigation module scene. Displaying such a pop-up window requires user action (for example, from the driver) to close it and return to the augmented reality navigation mode, which represents a safety risk for the vehicle.10

[0120] Figure 6 schematically illustrates a device 6 configured for the control of a A display system embedded in a vehicle, for example vehicle 10, according to a particular and non-limiting embodiment of the present invention. Device 6 corresponds, for example, to a device embedded in vehicle 10, for example a computer, or to a device or a unit of a mobile communication device.

[0121] Device 6 is, for example, configured to carry out the operations described opposite Figures 1 to 5 and / or the steps of the process described opposite [Fig. 7]. Examples of such a device 6 include, but are not limited to, embedded electronic equipment such as a vehicle's on-board computer, an electronic control unit such as an ECU (Electronic Control Unit), a smartphone, a tablet, or a laptop computer. The elements of device 6, individually or in combination, can be integrated into a single integrated circuit, into several integrated circuits, and / or into discrete components. Device 6 can be implemented in the form of electronic circuits or modules. software (or computer software) or a combination of electronic circuits and software modules.

[0122] The device 6 comprises one (or more) processor(s) 60 configured to execute instructions for carrying out the steps of the process and / or for executing instructions from the software embedded in the device 6. The processor 60 may include integrated memory, an input / output interface, and various circuits known to those skilled in the art. The device 6 further comprises at least one memory 61, for example, volatile and / or non-volatile memory, and / or includes a memory storage device that may include volatile and / or non-volatile memory, such as EEPROM, ROM, PROM, RAM, DRAM, SRAM, flash, magnetic disk, or optical disk.

[0123] The computer code of the embedded software(s) including the instructions to be loaded and executed by the processor is for example stored on memory 61.

[0124] According to various particular and non-limiting embodiments, the device 6 is coupled in communication with other similar devices or systems and / or with communication devices, for example a TCU (Telematic Control Unit), for example via a communication bus or through dedicated input / output ports.

[0125] According to a particular and non-limiting embodiment, the device 6 includes a block 62 of interface elements for communicating with external devices. The interface elements of the block 62 include one or more of the following interfaces: - radio frequency RF interface, for example of the Wi-Fi® type (according to IEEE 802.11), for example in the 2.4 or 5 GHz frequency bands, or of the Bluetooth® type (according to IEEE 802.15.1), in the 2.4 GHz frequency band, or of the Sigfox type using UBN (Ultra Narrow Band) radio technology, or LoRa in the 868 MHz frequency band, LTE (Long-Term Evolution), LTE-Advanced; - USB interface (from the English "Universal Serial Bus" or "Universal Serial Bus" in French); - HDMI interface (from the English "High Definition Multimedia Interface", or "High Definition Multimedia Interface" in French); - LIN interface (from the English "Local Interconnect Network", or in French "Réseau interconnecté local").

[0126] According to another particular and non-limiting embodiment, the device 6 includes a communication interface 63 which enables communication with other devices (such as other computers in the embedded system) via a 630 communication channel. The 63 communication interface corresponds, for example, to a transmitter configured to transmit and receive information and / or data via the 630 communication channel. The 63 communication interface corresponds, for example, to a wired network of the CAN (Controller Area Network) type, CAN FD (Controller Area Network Flexible Data-Rate), FlexRay (standardized by ISO 17458) or Ethernet (standardized by ISO / IEC 802-3).

[0127] According to a particular and non-limiting embodiment, the device 6 can provide output signals to one or more external devices, such as a display screen 640, touch or not, one or more speakers 650 and / or other peripherals 660 (projection system) via output interfaces 64, 65 and 66 respectively. According to a variant, one or more of the external devices is integrated into the device 6.

[0128] Figure 7 illustrates a flowchart of the various steps in a method for controlling a display system embedded in a vehicle, for example vehicle 10, according to a particular and non-limiting embodiment of the present invention. The method is implemented, for example, by a device embedded in the vehicle 10, by a mobile communication device, or by the device 6 of Figure 6.

[0129] In a first step 71, initial data representative of the presence of a submersible roadway on a section of road on which the vehicle travels are obtained.

[0130] In a second step 72, second data representing a calendar of high and low tide times associated with a maritime area including the submersible causeway are received, the calendar including information representing tide coefficients associated with high and low tides.

[0131] In a third step 73, the display of augmented reality graphic content is controlled so that this graphic content is displayed on a display device of the vehicle, the graphic content comprising an image of a real scene located in front of the vehicle acquired by a camera mounted in the vehicle and a virtual graphic object superimposed on the image, the virtual graphic object comprising a set of graphic objects representative of the submersible pavement, a graphic representation of the virtual graphic object being a function of the second data.

[0132] According to one variant, the variants and examples of the operations described in relation to one of Figures 1 to 5 apply to the steps of the process in [Fig.7].

[0133] Of course, the present invention is not limited to the embodiments described above but extends to a method for displaying graphic content in augmented reality that would include secondary steps without departing from the scope of the present invention. The same would apply to a device configured for implementing such a method.

[0134] The present invention also relates to a vehicle, for example an automobile or more generally an autonomous land-powered vehicle, comprising the device 6 of [Fig.6] or a display system comprising the device 6 of [Fig.6] connected in communication to a screen 13.

Claims

Demands

1. A method for controlling a display system embedded in a vehicle (10), said display system comprising a display device (13), said method comprising the following steps: - obtaining (71) first data representative of the presence of a submersible roadway (112) on a portion of road (110) on which said vehicle (10) is traveling; - receiving (72) second data representative of a calendar of high and low tide times associated with a maritime area including said submersible roadway (112), said calendar comprising information representative of tide coefficients associated with said high and low tides; - display control (73) of augmented reality graphic content (40; 50) on said display device (13), said graphic content (40; 50) comprising an image (41;51) of a real scene located in front of said vehicle (10) acquired by a camera (12) mounted in said vehicle (10) and a virtual graphic object (42; 52) superimposed on said image (41; 51), said virtual graphic object (42; 52) comprising a set of graphic objects representing said submersible roadway, a graphic representation of said virtual graphic object (42; 52) being a function of said second data and of temporal information representing a current instant.;

2. A method according to claim 1, wherein said virtual graphic object (42) represents a gantry supporting at least a first graphic object (421, 521) representing a road sign indicating a submersible roadway area, at least a second graphic object (422) representing a light signal and a third graphic object (423) representing a text display area.

3. Method according to claim 2, wherein the graphic representation of said virtual graphic object (42) corresponds to: - a first graphic representation when said current instant belongs to a first time interval (301) of determined duration centered on a low tide time (31) and when a coefficient of a high tide (32) temporally following said low tide (31) is less than a threshold coefficient, said gantry being displayed with a first color according to said first graphic representation; - a second graphic representation when said current instant belongs to said first time interval (301) and when the coefficient of said high tide (32) is greater than said threshold coefficient, said gantry being displayed with a second color different from said first color according to said second graphic representation; - a third graphic representation when said current instant belongs to a second time interval (302) of determined duration centered on a time of said high tide (32) following temporally said low tide (31), said gantry being displayed with a third color according to said third graphic representation, said third color being different from said first color and said second color;and - a fourth graphical representation when said current instant belongs to a third time interval (303) between said first interval (301) and said second time interval (302), said gantry being displayed with said second color according to said fourth graphical representation.;

4. A method according to claim 3, wherein said at least one second graphic object (422) is representative of a fixed light signal according to said first graphic representation and according to said second graphic representation, and said at least one second graphic object (422) is representative of a flashing light signal according to said third graphic representation and according to said fourth graphic representation.

5. A method according to any one of claims 2 to 4, wherein said text display area (423) comprises a first piece of information representing said current time, a second piece of information representing a high tide time and a third piece of information representing a coefficient of said high tide.

6. A method according to any one of claims 1 to 5, wherein said at least one first graphic object (421) is representative of a road sign indicating the start of a submersible roadway when said vehicle (10) is approaching the start of said submersible roadway (112) and said at least one first graphic object (521) is representative of a road sign indicating the end of a submersible roadway when said vehicle (10) is approaching the end of said submersible roadway (112).

7. A method according to any one of claims 1 to 6, wherein said first data are determined from third data representing geographical positions of the vehicle (10), fourth data representing a map of a road environment (1) in which said vehicle (10) travels and fifth data representing the location of submersible roadways included in said road environment (1).

8. A method according to any one of claims 1 to 7, further comprising a step of receiving sixth data representing the activation or deactivation of a submersible pavement presence alert service from a human-machine interface embedded in said vehicle, said display control (73) of the graphic content being a function of said sixth data.

9. Device (6) for controlling a display system embedded in a vehicle, said device (6) comprising a memory (61) associated with at least one processor (60) configured for carrying out the steps of the method according to any one of claims 1 to 8.

10. Vehicle (10) comprising the device (6) according to claim 9.

Images