Method and device for controlling a display system for displaying representative content of a variable message panel
The method and device for controlling an on-board display system in a vehicle address the challenge of alerting drivers to variable message signs by using augmented reality to display message data on the vehicle's display device, ensuring drivers are informed even if they miss the original message.
Patent Information
- Application Number
- FR2023013746
- Authority / Receiving Office
- FR · FR
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-12-07
- Publication Date
- 2025-06-13
- Estimated Expiration
- 2043-12-07
AI Technical Summary
Existing systems struggle to effectively alert drivers of messages displayed on variable message signs, especially when drivers do not have time to see or read the messages as they pass by.
A method and device for controlling an on-board display system in a vehicle, which detects variable message signs, obtains message data, and displays graphic content in augmented reality on the vehicle's display device, including a real scene image and a virtual graphic object with a display area for the message data.
This solution provides clear and timely alerts to drivers about variable message sign content, even if they missed the original message, enhancing driver awareness and improving user experience.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
Title of the invention: Method and device for controlling a display system for displaying content representative of a variable message panel Technical field
[0001] The present invention relates to methods and devices for displaying information in a unilateral alternating parking zone. In particular, the present invention relates in particular to methods and devices for controlling an on-board display system in a vehicle, in particular but not exclusively a motor vehicle. Technological background
[0002] To assist the driver of a vehicle, it is known to display information relating to the road environment in which the vehicle is traveling, for example on a display device of the vehicle or on a display screen of a mobile communication device such as a smartphone on board the vehicle. The display of such information is done for example via a human-machine interface (HMI) of a navigation system. Such a navigation system uses map data such as digital road maps indicating the roads of the road environment in which the vehicle is traveling, this map data being associated with or including additional data relating to the road environment such as the presence of places of interest such as parking lots or information on current traffic conditions.
[0003] Certain information, particularly useful to the driver, is difficult to present to the driver. For example, information relating to messages displayed on variable message signs is difficult to represent, their nature sometimes varying from one sign to another and from one message to another. Summary of the present invention
[0004] An object of the present invention is to solve at least one of the problems of the technological background described above.
[0005] Another object of the present invention is to better alert a driver of a vehicle of a message displayed on a variable message sign.
[0006] Another object of the present invention is to improve the user experience with respect to the information associated with a variable message sign.
[0007] According to a first aspect, the present invention relates to a method for controlling an on-board display system in a vehicle, the display system comprising a display device, the method comprising the following steps: - detection of a variable message sign located on a section of road on which the vehicle is traveling; - obtaining message data representative of a message displayed on the variable message panel; - control of display of graphic content in augmented reality on the display device following detection, the graphic content comprising an image of a real scene located in front of the vehicle acquired by a camera on board the vehicle and a virtual graphic object superimposed on the image, the virtual graphic object comprising a display area configured to display the message data.
[0008] Such a method makes it possible to visually alert a driver of a vehicle of the content of a message displayed on a variable message sign. The use of augmented reality makes it possible to embed virtual objects on an image of the scene providing the driver with clear information, allowing the driver to become aware of the message displayed on the variable message sign, even if the driver did not have time to see or did not see the message displayed on the variable message sign when the vehicle was approaching this sign.
[0009] According to a variant, the graphic representation of the virtual graphic object corresponds to a gantry supporting the display area.
[0010] According to another variant, the variable message sign is detected from image data representative of at least a second image of the variable message sign, the image data being acquired by the camera on board the vehicle.
[0011] According to another variant, the message data is obtained by processing the image data, the message data corresponding to a part of the image data corresponding to an area of the at least one second image comprising the message.
[0012] According to an additional variant, the display system is associated with a navigation system on board the vehicle.
[0013] According to an additional variant, the message data is obtained by applying an optical character recognition method to at least a portion of the image data corresponding to an area of the at least one second image comprising the message.
[0014] According to another variant, the variable message panel is detected as a function of position data representative of the geographical location of the vehicle and location data representative of the geographical location of the variable message panel, the message data being received from a remote device according to a wireless communication mode.
[0015] According to a further variant, the display of the graphic content is controlled in such a way that the graphic content is displayed on the display device after a time instant of crossing of the variable message sign by the vehicle.
[0016] According to a second aspect, the present invention relates to a device for controlling an on-board display system in a vehicle, the device comprising a memory associated with a processor configured for implementing the steps of the method according to the first aspect of the present invention.
[0017] According to a third aspect, the present invention relates to a vehicle, for example of the automobile type, comprising a device as described above according to the second aspect of the present invention.
[0018] According to a fourth aspect, the present invention relates to a computer program which comprises instructions adapted for executing the steps of the method according to the first aspect of the present invention, in particular when the computer program is executed by at least one processor.
[0019] Such a computer program may use any programming language, and be in the form of source code, object code, or intermediate code between source code and object code, such as in a partially compiled form, or in any other desirable form.
[0020] According to a fifth aspect, the present invention relates to a computer-readable recording medium on which is recorded a computer program comprising instructions for carrying out the steps of the method according to the first aspect of the present invention.
[0021] On the one hand, the recording medium may be any entity or device capable of storing the program. For example, the medium may comprise a storage means, such as a ROM memory, a CD-ROM or a microelectronic circuit type ROM memory, or a magnetic recording means or a hard disk.
[0022] Furthermore, this recording medium may also be a transmissible medium such as an electrical or optical signal, such a signal being able to be conveyed via an electrical or optical cable, by conventional or hertzian radio or by self-directed laser beam or by other means. The computer program according to the present invention may in particular be downloaded from an Internet-type network.
[0023] Alternatively, the recording medium may be an integrated circuit in which the computer program is incorporated, the integrated circuit being adapted to perform or to be used in performing the method in question. Brief description of the figures
[0024] Other characteristics and advantages of the present invention will emerge from the description of the particular and non-limiting exemplary embodiments of the present invention below, with reference to the appended figures 1 to 5, in which:
[0025] [Fig-1] schematically illustrates a passenger compartment of a vehicle, according to an example of particular and non-limiting embodiment of the present invention;
[0026] [Fig.2] illustrates an image of a variable message sign, according to an example of realization particular and non-limiting use of the present invention;
[0027] [Fig.3] schematically illustrates a display screen on board the vehicle of [Fig.l], according to a particular and non-limiting exemplary embodiment of the present invention;
[0028] [Fig.4] schematically illustrates a device configured for the control of a on-board display system in the vehicle of [Fig.l], according to a particular and non-limiting exemplary embodiment of the present invention;
[0029] [Fig.5] illustrates a flowchart of the different stages of a method for controlling a on-board display system in the vehicle of [Fig.l], according to a particular and non-limiting exemplary embodiment of the present invention. Description of examples of implementation
[0030] A method and a device for controlling an on-board display system in a vehicle will now be described in the following with joint reference to FIGS. 1 to 5. The same elements are identified with the same reference signs throughout the description which follows.
[0031] The terms "first(s)", "second(s)" (or "first(s)", "second(s)"), etc. are used in this document by arbitrary convention to enable different elements (such as operations, means, etc.) implemented in the embodiments described below to be identified and distinguished. Such elements may be distinct or correspond to a single element, depending on the embodiment.
[0032] According to a particular and non-limiting example of embodiment of the present invention, the control of a display system on board a vehicle is for example implemented by one or more computers of the vehicle, for example via one or more processors, or by one or more processors of a mobile communication device on board the vehicle, in particular when the display system is integrated into the mobile communication device.
[0033] For this purpose, a variable message sign located on a portion of road on which the vehicle is traveling is detected, for example from data acquired by one or more devices on board the vehicle or from vehicle location data. Message data representative of a message displayed on the variable message sign are obtained, for example by processing the data acquired by the on-board device(s) or from a remote device via a link wireless.
[0034] The display of graphic content in augmented reality is controlled in such a way that this graphic content is displayed on a display device of the display system following the detection of the variable message sign. The graphic content comprises a first image of a real scene located in front of the vehicle, which first image is acquired by a camera on board the vehicle (for example a camera of the vehicle or a camera of the mobile communication device) and a virtual graphic object is displayed superimposed on the first image. The virtual graphic object comprises a display area configured or adapted to display the message data.
[0035] A variable message sign, noted PMV, corresponds to a road sign intended to inform road users by displaying text messages intended for road users. Some messages are sometimes accompanied by pictograms. A PMV is arranged on a gantry overlooking the roadway or on a post placed on the side of the roadway.
[0036] A PMV is a so-called dynamic equipment, i.e. belonging to a standardized architecture organizing dynamic road equipment into a network, called EQUIDYN. A PMV is configured to display in real time messages relating to certain events such as traffic jams, accidents, slowdowns, weather conditions, journey times, warnings, road user awareness messages, etc.
[0037] [Fig. 1] schematically illustrates the interior of a vehicle 10, according to a particular and non-limiting exemplary embodiment of the present invention.
[0038] The vehicle 10 corresponds for example to a vehicle with a thermal engine, with electric motor(s) or even a hybrid vehicle with a thermal engine and one or more electric motors. The vehicle 10 thus corresponds for example to a land vehicle, for example an automobile, a truck, a bus.
[0039] The vehicle 10 has a display system comprising a display device or screen 13 and a computer configured to control the display of content(s) of a graphical HMI on a screen 13, for example a touch screen. The computer corresponds for example to the computer of the infotainment system, called the IVI computer (from the English “In-Vehicle Infotainment” or in French “Infodivertissement monté”) of the vehicle 10.
[0040] According to an alternative embodiment, the display system of the vehicle 10 comprises one or more other screens, for example a screen of a device or system called a head-up display corresponding for example to a transparent or semi-transparent blade arranged in such a way that a driver seated in the seat 16 sees the content displayed or projected on the transparent blade when the driver drives the vehicle 10, or a display screen 15 called a handset or dashboard generally arranged in an area behind the steering wheel 14 in the dashboard 11.
[0041] The screen 13 is for example associated with a touch interface and corresponds for example to a screen of the LCD type (from the English “Liquid Crystal Display” or in French “Display à cristals liquide”), for example of the TFT type (from the English “Thin-Film Transistor” or in French “Transistor en film mince”), or OLED type (from the English “Organic Light-Emitting Diode” or in French “Diode électroluminescente biologique”).
[0042] The screen 13 is configured to display content intended for the driver and passengers of the vehicle. The screen 13 is also configured to allow the driver and / or passengers of the vehicle to interact with one or more systems embedded in the vehicle via a human machine interface (HMI) displayed on the screen 13. For example, the screen 13 is configured to interact with the IVI system and / or a navigation system of the vehicle 10.
[0043] According to a particular embodiment, the screen 13 is not integrated into the passenger compartment of the vehicle but corresponds to a screen of a mobile communication device (smartphone, tablet), connected in communication, for example wirelessly, with the on-board system of the vehicle 10.
[0044] The vehicle 10 also carries, for example, one or more cameras, for example a camera 12 corresponding to a front camera (also called a windshield camera). Such a camera 12 is arranged in the passenger compartment of the vehicle 10 under the windshield and at the top and in the middle of this windshield. Such a front camera 12 has a field of vision corresponding to the space located in front of the vehicle 10 according to the direction of travel of the vehicle 10. Such a camera 12 is thus configured for the acquisition of image data representative of the real scene located in front of the vehicle 10, according to the direction of travel of the vehicle 10.
[0045] The camera 12 comprises for example the following elements: - a photosensitive sensor corresponding for example to a matrix of photoreceptors associated for example with a Bayer filter; - an optical assembly arranged in front of the sensor with respect to the scene to be acquired by the sensor, the optical assembly comprising for example an arrangement of one or more lenses; and - optionally one or more calculators associated with memory and configured for processing images acquired by the sensor.
[0046] According to an alternative embodiment, the camera corresponds to a camera of the mobile communication device on board the vehicle 10, where applicable. The camera of the mobile communication device is also configured for the acquisition of image data representative of the actual scene located in front of the vehicle 10, depending on where the mobile communication device is located in the passenger compartment of the vehicle 10.
[0047] According to a particular embodiment, the vehicle 10 carries a navigation and geolocation system, also called a GNSS system (Geolocation and Navigation by a Satellite System), for example a GPS (Global Positioning System) or Galileo type system. According to this embodiment, the vehicle 10 carries a geolocation system receiver allowing the vehicle 10 to obtain first data representative of its geographical position at any time, for example in the form of GPS coordinates (latitude and longitude), via a satellite link with a set of satellites 101.
[0048] According to this embodiment, the display system of the vehicle 10 is associated with the navigation system, that is to say that the display system is configured to control the display of the data obtained from the navigation system (for example the data representing the road environment in which the vehicle 10 is traveling and / or guidance instruction data when the vehicle 10 follows a route calculated by the navigation system).
[0049] A process for controlling a display system on board the vehicle 10 is advantageously implemented by one or more processors of the display system, for example by a computer of an on-board system of the vehicle 10 such as the IVI system or the navigation system or by a processor of the mobile communication device. The on-board display system thus corresponds to a display device integrated into the vehicle 10 or to a display system of a mobile communication device itself on board the vehicle 10.
[0050] In a first operation of the process, a variable message sign, called PMV, located on a portion of road on which the vehicle 10 is traveling is detected.
[0051] The PMV is for example detected from image data acquired by the camera 12 or by the camera of the mobile communication device when the process is implemented by the mobile communication device.
[0052] [Fig. 2] illustrates an example of an image 20 comprising a variable message sign 21, the image 20 being from a point of view of the vehicle 10 traveling on a portion of road. The image data of the image 20 are for example acquired by the camera 12 or by the camera of a mobile communication device having in its field of vision the scene in front of the vehicle 10, such as the camera 12.
[0053] According to the example of [Fig.2], the PMV 21 is mounted on a gantry spanning the roadway on which the vehicle 10 is traveling. The message displayed on the PMV 21 relates to estimated travel times to reach a set of destinations, the travel time to reach each destination being indicated in minutes (noted “MN” in image 20) with the following information: - destination “ACCES A64” with estimated journey time of “1MN”; - destination “RANGUEIL” with estimated journey time of “3MN”; and - destination “ACCES A61” with estimated journey time of “7MN”.
[0054] According to another exemplary embodiment, the PMV 21 is detected from position data representative of the geographical location of the vehicle 10.
[0055] The position data are for example received from a receiver of a geolocation system on board the vehicle 10. The position data correspond for example to coordinates in world space, for example GPS (Global Positioning System) or Galileo coordinates corresponding to a pair of latitude and longitude type data.
[0056] The PMV 21 is for example detected from mapping data of the environment in which the vehicle 10 is traveling. The mapping data is for example stored in a memory of the vehicle 10, this mapping data comprising data describing the road sections of the road environment of the vehicle as well as data on a set of points of interest located in the environment of the vehicle 10, including the PMVs.
[0057] According to a variant, the position data are transmitted by the vehicle 10 in real time to a remote device of the “cloud” server type via a wireless connection, the remote device cross-referencing the position data with geographic location data of the PMVs to determine when the vehicle 10 is approaching a PMV. When this is the case, the remote device transmits to the vehicle 10, via the wireless connection, an alert of detection of approach of a PMV, for example the PMV 21.
[0058] According to another variant, the PMV 21 corresponds to an embedded wireless communication unit (i.e. a radio communication module or interface associated with one or more antennas). According to this variant, the PMV 21 communicates, according to a wireless communication mode, to road users compatible with such a wireless communication mode, message data representative of the content of the message displayed on the PMV 21. According to this variant, the message data are for example communicated according to a so-called broadcast mode (from the English "Broadcast"). The wireless communication mode corresponds for example to a so-called Vehicle to All mode, noted V2X (from the English "Vehicle-to-Everything"), more particularly according to a mode called Infrastructure to Vehicle, noted I2V (from the English "Infrastructure-to-Vehicle"). According to this variant, the detection of the PMV 21 by the vehicle 10 is obtained when the vehicle 10 detects the communication of message data sent by PMV 21.
[0059] The detection of the PMV 21 is materialized for example by the display of an alert or a pictogram on a road map of the road environment of the vehicle 10, at the location of the PMV 21, displayed for example on the screen 13. According to another example, the detection is materialized by a rendering of a sound or a voice message.
[0060] According to yet another example, the detection of the PMV 21 is not accompanied by any alert to the vehicle, the detection corresponding to an event whose associated data are temporarily stored in a memory of the vehicle 10, for example a buffer memory.
[0061] In a second operation of the process, message data representative of the message displayed on the PMV 21 is obtained.
[0062] When the PMV 21 is detected from the image data such as image 20, the message data is for example by applying one or more image processing methods to the image data received from the camera 12 (or the camera of the mobile communication device if applicable).
[0063] According to a first exemplary embodiment, the message data corresponds to a part of the image data, the message data corresponding for example to data relating to the pixels of the part of the image 20 comprising the displayed message.
[0064] According to this first exemplary embodiment, a method of segmenting the image 20 is implemented to detect the area of the image 20 comprising the message, the area of the image 20 then being selected and cut out to retain only the pixel data associated with this area.
[0065] The methods for detecting text or messages in an image are known to those skilled in the art and are not repeated in detail in this text.
[0066] According to a second exemplary embodiment, the message data are obtained by applying an optical character recognition method, called OCR (from the English “Optical Character Recognition”). Such a method comprises for example a segmentation of the image to detect the part of the image comprising the message, the OCR processing then being applied only to the part of the image 20 comprising the message.
[0067] The optical character recognition methods applied to all or part of a digital image are known to those skilled in the art and are not repeated in detail in this text.
[0068] When the PMV 21 is detected from the position data of the vehicle 10, the message data is for example received from a remote device, for example a cloud server.
[0069] When the detection of the PMV 21 is implemented directly by the vehicle 10, the vehicle 10 transmits for example a request to the remote device, via a wireless connection or link, to receive in return via the wireless connection the message data, that is to say the data describing the content of the message displayed on the PMV 21.
[0070] When the detection of the PMV is obtained directly by the remote device, the latter automatically transmits the message data, i.e. the data describing the content of the message displayed on the PMV 21, to the vehicle 10 via a wireless connection.
[0071] The vehicle 10 and the remote device communicate according to a wireless communication mode, for example of the V2X or V2I type (from the English “Vehicle-to-Infrastructure” or in French “Vehicle to infrastructure”), or according to a wireless communication mode of the LTE 4G type or of the 5G type via a terrestrial cellular network infrastructure.
[0072] When the PMV 21 is detected from the detection of the communication of the message data by the PMV 21, the message data is automatically obtained or received from the PMV 21 by the vehicle 10.
[0073] The message data is for example stored in a memory of the vehicle 10, for example temporarily, until its use in the third operation of the process described below.
[0074] In a third operation of the process, the display of graphic content in augmented reality is controlled so that this graphic content is displayed on a display device, such as the screen 13.
[0075] The display control is for example triggered by the detection of the PMV, that is to say that the computer(s) or processor(s) in charge of the display initiate the generation of the graphic content upon detection of the PMV 21.
[0076] The graphic content advantageously includes: - a first image of the real scene located in front of the vehicle 10 acquired by a camera on board the vehicle such as the camera 12, the content of this first image varying as the vehicle 10 moves; and - a virtual graphical object displayed overlaying the first image, the virtual graphical object comprising a display area configured to display the message data.
[0077] Controlling the display includes rendering (i.e., generating) the graphic content, such rendering corresponding to a set of operations performed by one or more processors on the pixels of the first image to compose the graphic content. For example, rendering involves associating pixel data (e.g., color data expressed in an RGB (Red, Green, Blue) type space) with a set of pixels of the first image. French "red, green, blue")) associated with the virtual graphic object.
[0078] The virtual graphic object corresponds to a graphic object obtained by image synthesis, the virtual graphic object being superimposed on the first image in an area of the first image corresponding for example to a location where the PMV is located in the real scene associated with the first image. Thus, the pixels of the first image at the location of the inlay of the virtual object in the first image are replaced by the pixels defining the virtual graphic object.
[0079] [Fig.3] illustrates an example of the result of such rendering, i.e. the display of graphic content 30 on the screen 13.
[0080] The graphic content 30 thus displayed results from the overlaying of a virtual graphic object 32, for example a 3-dimensional (3D) graphic object, on a first image 31 whose content represents the real scene that the driver sees (at least partially) through the windshield of the vehicle 10 at the time of acquisition of the first image 31 (or with a slight time shift necessary for the composition of the graphic content 30, of the order of a few hundred milliseconds for example).
[0081] The rendering result thus corresponds to so-called augmented reality content (noted RA, or AR in English for “Augmented Reality”) in that this content mixes content representing a real environment (acquired by a camera) with digital virtual content obtained by computer.
[0082] The graphic content 30 varies depending on the movement of the vehicle 10 on the roadway, as the vehicle 10 moves on the roadway.
[0083] The graphic content 30 varies via: - the first displayed image which varies as the image data received from the camera 12 changes depending on the point of view of the camera 12 which evolves and varies depending on the movement of the vehicle 10, the first images being for example refreshed / displayed at a frequency of 24, 48 or 50 images per second; and / or - an adjustment of the representation of the virtual graphic object 32 as the vehicle 10 moves, the virtual graphic object 32 being for example embedded in the first image at a constant distance from the point of view of the camera 12 or the representation of the virtual graphic object 32 being modified as the vehicle moves to provide the driver with the illusion that the vehicle 10 is approaching the virtual graphic object 32, the adjustment of the graphic representation making it possible to adapt the perspective according to the evolution of the point of view of the graphic content 30 which varies with the movement of the vehicle 10.
[0084] According to the example of [Fig.3], the graphic object 32 is representative of a gantry supporting a display area 320 on which the message 321 is displayed from the message data obtained in the second operation of the process.
[0085] Of course, the graphic object 32 is not limited to such a representation but extends to any virtual graphical representation, for example to a gallows or a side post supporting the display area 320.
[0086] The message 321 displayed on the display area 320 corresponds to a part of the image 20 comprising the content displayed on the PMV 21 (obtained from the image data of the camera 12) or to a text obtained by OCRing the first image or to a text received via the wireless communication mode described previously.
[0087] According to a particular embodiment, the display of the graphic content 30 comprising the virtual graphic object 32 is controlled in such a way that the graphic content 30 is displayed on the display device 13 after a time instant of crossing of the PMV 21 by the vehicle 10.
[0088] Such an embodiment thus makes it possible to display the message 321 via the virtual graphic object 32 once the message displayed on the PMV 21 is no longer visible to the driver of the vehicle 10, the latter having passed the PMV 21. This gives the driver the opportunity to see the message, in particular in situations where the driver would not have seen or not had time to read the original message displayed on the PMV 21.
[0089] The virtual graphic object 32 with the display area 320 and the displayed message 321 are for example displayed on the screen 13 for a determined duration, for example equal to 20 seconds. According to other examples, the display duration of the graphic content 30 comprising the virtual graphic object 32 is equal to 10, 15, 25 or 30 seconds.
[0090] This display duration corresponds for example to a fixed parameter of the display system of the vehicle 10 or to an adjustable parameter, for example via an HMI (Human-Machine Interface) of the display system, which a user can adjust according to his preferences.
[0091] [Fig. 4] schematically illustrates a device 4 configured for controlling a display system on board a vehicle, for example the vehicle 10, according to a particular and non-limiting exemplary embodiment of the present invention. The device 4 corresponds for example to a device on board the vehicle 10, for example a computer, or to a device or unit of a mobile communication device.
[0092] The device 4 is for example configured for the implementation of the operations described with regard to figures 1 to 3 and / or the steps of the method described with regard to [Fig.5]. Examples of such a device 4 include, but are not limited to, on-board electronic equipment such as an on-board computer of a vehicle, an electronic calculator such as an ECU (“Electronic Control Unit”), a smartphone, a tablet, a laptop. The elements of the device 4, individually or in combination, can be integrated in a single integrated circuit, in several integrated circuits, and / or in discrete components. The device 4 can be implemented in the form of electronic circuits or software (or computer) modules or even a combination of electronic circuits and software modules.
[0093] The device 4 comprises one (or more) processor(s) 40 configured to execute instructions for carrying out the steps of the method and / or for executing the instructions of the software(s) embedded in the device 4. The processor 40 may include integrated memory, an input / output interface, and various circuits known to those skilled in the art. The device 4 further comprises at least one memory 41 corresponding for example to a volatile and / or non-volatile memory and / or comprises a memory storage device which may comprise volatile and / or non-volatile memory, such as EEPROM, ROM, PROM, RAM, DRAM, SRAM, flash, magnetic or optical disk.
[0094] The computer code of the embedded software(s) comprising the instructions to be loaded and executed by the processor is for example stored in the 4L memory.
[0095] According to various particular and non-limiting embodiments, the device 4 is coupled in communication with other similar devices or systems and / or with communication devices, for example a TCU (from the English “Telematic Control Unit” or in French “Telematic Control Unit”), for example via a communication bus or through dedicated input / output ports.
[0096] According to a particular and non-limiting exemplary embodiment, the device 4 comprises a block 42 of interface elements for communicating with external devices. The interface elements of the block 42 comprise one or more of the following interfaces: - RF radio frequency interface, for example Wi-Fi® type (according to IEEE 802.11), for example in the 2.4 or 5 GHz frequency bands, or Bluetooth® type (according to IEEE 802.15.1), in the 2.4 GHz frequency band, or Sigfox type using UBN (Ultra Narrow Band) radio technology, or LoRa in the 868 MHz frequency band, LTE (Long-Term Evolution), LTE-Advanced; - USB interface (from the English “Universal Serial Bus” or “Universal Serial Bus” in French); - HDMI interface (from the English “High Definition Multimedia Interface” or “High Definition Multimedia Interface” in French); - LIN interface (from the English “Local Interconnect Network”).
[0097] According to another particular and non-limiting example of embodiment, the device 4 comprises a communication interface 43 which makes it possible to establish communication with other devices (such as other computers of the on-board system) via a communication channel 430. The communication interface 43 corresponds for example to a transmitter configured to transmit and receive information and / or data via the communication channel 430. The communication interface 43 corresponds for example to a wired network of the CAN (from the English “Controller Area Network” or in French “Réseau de contrôles”) type, CAN FD (from the English “Controller Area Network Flexible Data-Rate” or in French “Réseau de contrôles à débit de données flexible”), FlexRay (standardized by the ISO 17458 standard) or Ethernet (standardized by the ISO / IEC 802-3 standard).
[0098] According to a particular and non-limiting exemplary embodiment, the device 4 can provide output signals to one or more external devices, such as a display screen 440, touch-sensitive or not, one or more speakers 450 and / or other peripherals 460 (projection system) via output interfaces 44, 45 and 46 respectively. According to a variant, one or other of the external devices is integrated into the device 4.
[0099] [Fig. 5] illustrates a flowchart of the different steps of a method for controlling a display system on board a vehicle, for example the vehicle 10, according to a particular and non-limiting exemplary embodiment of the present invention. The method is for example implemented by a device on board the vehicle 10, by a mobile communication device or by the device 4 of [Fig. 4].
[0100] In a first step 51, a variable message sign located on a portion of road on which the vehicle is traveling is detected.
[0101] In a second step 52, message data representative of a message displayed on the variable message panel are obtained.
[0102] In a third step 53, the display of graphic content in augmented reality is controlled so as to display the graphic content on a display device of the display system following the detection, the graphic content comprising an image of a real scene located in front of the vehicle acquired by a camera on board the vehicle and a virtual graphic object superimposed on the image, the virtual graphic object comprising a display area configured to display the message data.
[0103] According to a variant, the variants and examples of the operations described in relation to one of figures 1 to 3 apply to the steps of the method of [Fig.5].
[0104] Of course, the present invention is not limited to the exemplary embodiments described above but extends to a method for displaying graphic content in augmented reality which would include secondary steps without thereby departing from the scope of the present invention. The same would apply to a device configured for the implementation implementation of such a process.
[0105] The present invention also relates to a vehicle, for example an automobile or more generally an autonomous land-based motor vehicle, comprising the device 4 of [Fig.4] or a display system comprising the device 4 of [Fig.4] connected in communication to a screen 13.
Claims
Claims
1. Method for controlling a display system on board a vehicle (10), said display system comprising a display device (13), said method comprising the following steps: - detecting (51) a variable message sign (21) located on a portion of road on which said vehicle (10) is traveling; - obtaining (52) message data representative of a message displayed on said variable message sign (21); - controlling the display (53) of graphic content (30) in augmented reality on said display device (13) following said detection (51), said graphic content (30) comprising a first image (31) of a real scene located in front of said vehicle (10) acquired by a camera (12) on board said vehicle (10) and a virtual graphic object (32) superimposed on said first image, said virtual graphic object (31) comprising a display area (320) configured to display said message data.
2. The method of claim 1, wherein the graphical representation of said virtual graphical object (32) corresponds to a gantry supporting said display area (320).
3. A method according to claim 1 or 2, wherein said variable message sign (21) is detected from image data representative of at least a second image (20) of the variable message sign (21), said image data being acquired by said camera (12) on board said vehicle (10).
4. A method according to claim 3, wherein said message data is obtained by processing said image data, said message data corresponding to a portion of said image data corresponding to an area of said at least one second image (20) comprising said message.
5. A method according to claim 3, wherein said message data is obtained by applying an optical character recognition method to at least a portion of said image data corresponding to an area of said at least one second image (20) comprising said message.
6. Method according to claim 1 or 2, for which said variable message sign (21) is detected as a function of position data representative of the geographical location of said vehicle (10) and of location data representative of the geographic location of said variable message sign (21), said message data being received from a remote device according to a wireless communication mode.
7. Method according to one of claims 1 to 6, for which the display of the graphic content (30) is controlled in such a way that the graphic content (30) is displayed on said display device (13) after a time instant of crossing of said variable message sign (21) by said vehicle (10).
8. Computer program comprising instructions for implementing the method according to any one of the preceding claims, when these instructions are executed by a processor.
9. Device (4) for controlling an on-board display system in a vehicle, said device (4) comprising a memory (41) associated with at least one processor (40) configured for implementing the steps of the method according to any one of claims 1 to 7.
10. Vehicle (10) comprising the device (4) according to claim 9.
Citation Information
Patent Citations
A method for securely displaying information in a vehicle.
FR3113881A1
Infrastructure-to-vehicle communication system and method
US20170018179A1
Road speed limit identification method, road speed limit identification apparatus, electronic apparatus, computer program, and computer readable recording medium
US20200184812A1
Smart road signs
WO2019221688A1