Method and device for controlling a display system for displaying representative content on a variable message sign

Augmented reality is used to overlay variable message sign data onto vehicle displays, addressing the challenge of dynamic sign information delivery, ensuring drivers are informed even after passing the sign.

FR3156576B1Active Publication Date: 2026-01-02STELLANTIS AUTO SAS +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
FR2023013746
Authority / Receiving Office
FR · FR
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-12-07
Publication Date
2026-01-02
Estimated Expiration
2043-12-07

AI Technical Summary

Technical Problem

Existing systems struggle to effectively present information from variable message signs to vehicle drivers, particularly when the driver does not have time to read the signs due to their dynamic and variable nature.

Method used

A method and device that utilize augmented reality to overlay virtual graphic objects on a vehicle's display, superimposing message data from detected variable message signs onto real-time camera images, allowing for enhanced visibility and alertness.

Benefits of technology

Enables drivers to be alerted to variable message sign content even after passing the sign, improving user experience and ensuring clear information delivery.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000018_0000
    Figure 00000018_0000
  • Figure 00000018_0001
    Figure 00000018_0001
  • Figure 00000019_0000
    Figure 00000019_0000
Patent Text Reader

Abstract

The present invention relates to a method and device for controlling a vehicle display system. To this end, a variable message sign located on a section of road on which the vehicle is traveling is detected. Message data representing a message displayed on the variable message sign is obtained. Augmented reality graphic content (30) is displayed on a display device (13) following the detection of the sign. This graphic content (30) comprises a first image (31) of a real scene located in front of the vehicle, acquired by a camera mounted in the vehicle, and a virtual graphic object (32) superimposed on the first image (31). The virtual graphic object (32) comprises a display area (320) configured to display said message data. (See Figure 3 for abbreviations.)
Need to check novelty before this filing date? Find Prior Art

Description

Title of the invention: Method and device for controlling a display system for displaying content representative of a variable message sign technical field

[0001] The present invention relates to methods and devices for displaying information in an alternating one-way parking zone. In particular, the present invention relates to methods and devices for controlling a display system installed in a vehicle, including but not limited to a motor vehicle. Technological background

[0002] To assist the driver of a vehicle, it is known to display information relating to the road environment in which the vehicle is traveling, for example on a vehicle display device or on a display screen of a mobile communication device such as a smartphone installed in the vehicle. The display of such information is done, for example, via a human-machine interface (HMI) of a navigation system. Such a navigation system uses mapping data such as digital road maps indicating the roads in the road environment in which the vehicle is traveling, this mapping data being associated with or including additional data relating to the road environment such as the presence of points of interest such as parking lots or information on current traffic conditions.

[0003] Certain information, particularly useful to the driver, is difficult to present to the driver. For example, information relating to messages displayed on variable message signs is difficult to represent, as its nature sometimes varies from one sign to another and from one message to another. Summary of the present invention

[0004] One object of the present invention is to solve at least one of the problems of the technological background described above.

[0005] Another object of the present invention is to better alert a driver of a vehicle to a message displayed on a variable message sign.

[0006] Another object of the present invention is to improve the user experience with respect to information associated with a variable message sign.

[0007] According to a first aspect, the present invention relates to a method for controlling a display system embedded in a vehicle, the display system comprising a display device, the method comprising the following steps: - detection of a variable message sign located on a section of road on which the vehicle is traveling; - obtaining message data representative of a message displayed on the variable message sign; - control of display of augmented reality graphic content on the display device following detection, the graphic content comprising an image of a real scene located in front of the vehicle acquired by a camera mounted in the vehicle and a virtual graphic object superimposed on the image, the virtual graphic object comprising a display area configured to display message data.

[0008] Such a method makes it possible to visually alert a vehicle driver to the content of a message displayed on a variable message sign. The use of augmented reality makes it possible to overlay virtual objects onto an image of the scene, providing the driver with clear information so that they can become aware of the message displayed on the variable message sign, even if the driver did not have time to see or did not see the message displayed on the variable message sign when the vehicle was approaching it.

[0009] According to one variant, the graphical representation of the virtual graphical object corresponds to a gantry supporting the display area.

[0010] According to yet another variant, the variable message sign is detected from image data representative of at least one second image of the variable message sign, the image data being acquired by the camera mounted in the vehicle.

[0011] According to another variant, the message data is obtained by processing the image data, the message data corresponding to a part of the image data corresponding to an area of ​​at least a second image including the message.

[0012] According to a further variant, the display system is associated with an on-board navigation system in the vehicle.

[0013] According to an additional variant, the message data is obtained by applying an optical character recognition method to at least a part of the image data corresponding to an area of ​​at least a second image comprising the message.

[0014] According to another variant, the variable message sign is detected based on position data representative of the geographical location of the vehicle and location data representative of the geographical location of the variable message sign, the message data being received from a remote device according to a wireless communication mode.

[0015] According to yet another variant, the display of the graphic content is controlled in such a way that the graphic content is displayed on the display device after a time has passed the variable message sign by the vehicle.

[0016] According to a second aspect, the present invention relates to a control device for a display system embedded in a vehicle, the device comprising a memory associated with a processor configured for the implementation of the steps of the process according to the first aspect of the present invention.

[0017] According to a third aspect, the present invention relates to a vehicle, for example of the automobile type, comprising a device as described above according to the second aspect of the present invention.

[0018] According to a fourth aspect, the present invention relates to a computer program which includes instructions adapted for carrying out the steps of the process according to the first aspect of the present invention, in particular when the computer program is executed by at least one processor.

[0019] Such a computer program may use any programming language, and be in the form of source code, object code, or an intermediate form between source code and object code, such as in a partially compiled form, or in any other desirable form.

[0020] According to a fifth aspect, the present invention relates to a computer-readable recording medium on which is recorded a computer program comprising instructions for carrying out the steps of the process according to the first aspect of the present invention.

[0021] On the one hand, the recording medium can be any entity or device capable of storing the program. For example, the medium can include a storage means, such as a ROM, a CD-ROM or a microelectronic circuit-type ROM, or a magnetic recording means or a hard disk drive.

[0022] On the other hand, this recording medium can also be a transmissible medium such as an electrical or optical signal, such a signal being able to be transmitted via an electrical or optical cable, by conventional or radio frequency, by self-directing laser beam, or by other means. The computer program according to the present invention can, in particular, be downloaded from an Internet-type network.

[0023] Alternatively, the recording medium may be an integrated circuit in which the computer program is incorporated, the integrated circuit being adapted to execute or to be used in the execution of the process in question. Brief description of the figures

[0024] Other features and advantages of the present invention will become apparent from the description of the particular and non-limiting embodiments of the present invention below, with reference to the attached Figures 1 to 5, in which:

[0025] [Fig-1] schematically illustrates a vehicle passenger compartment, according to an example of particular and non-limiting embodiment of the present invention;

[0026] [Fig.2] illustrates an image of a variable message sign, according to an example of a particular and non-limiting interpretation of the present invention;

[0027] [Fig.3] schematically illustrates a display screen embedded in the vehicle of the [Fig.1], according to a particular and non-limiting example of the present invention;

[0028] [Fig.4] schematically illustrates a device configured for the control of a vehicle-mounted display system [Fig.1], according to a particular and non-limiting embodiment of the present invention;

[0029] [Fig. 5] illustrates a flowchart of the different stages of a control process of a vehicle-mounted display system [Fig.1], according to a particular and non-limiting embodiment of the present invention. Description of examples of achievements

[0030] A method and a control device for an on-board display system in a vehicle will now be described in what follows with joint reference to Figures 1 to 5. The same elements are identified with the same reference signs throughout the following description.

[0031] The terms "first," "second" (or "firsts," "seconds"), etc., are used in this document by arbitrary convention to allow for the identification and distinction of different elements (such as operations, means, etc.) implemented in the embodiments described below. Such elements may be distinct or correspond to a single element, depending on the embodiment.

[0032] According to a particular and non-limiting embodiment of the present invention, the control of a display system embedded in a vehicle is implemented, for example, by one or more computers of the vehicle, for example via one or more processors, or by one or more processors of a mobile communication device embedded in the vehicle, in particular when the display system is integrated into the mobile communication device.

[0033] To this end, a variable message sign located on a section of road on which the vehicle is traveling is detected, for example, from data acquired by one or more devices on board the vehicle or from vehicle location data. Message data representative of a message displayed on the variable message sign are obtained, for example, by processing the data acquired by the on-board device(s) or from a remote device via a link wireless.

[0034] The display of augmented reality graphic content is controlled such that this graphic content is displayed on a display device of the display system following detection of the variable message sign. The graphic content comprises a first image of a real scene located in front of the vehicle, which first image is acquired by a camera on board the vehicle (for example, a vehicle camera or a camera of the mobile communication device), and a virtual graphic object is displayed superimposed on the first image. The virtual graphic object includes a display area configured or adapted to display the message data.

[0035] A variable message sign, abbreviated VMS, is a road sign designed to inform road users by displaying text messages. Some messages are sometimes accompanied by pictograms. A VMS is mounted on a gantry overhanging the roadway or on a post placed at the side of the roadway.

[0036] A VMS is a so-called dynamic device, that is to say, belonging to a standardized architecture organizing road dynamic equipment into a network, called EQUIDYN. A VMS is configured to display in real time messages relating to certain events such as traffic jams, accidents, slowdowns, weather conditions, travel times, warnings, road user awareness messages, etc.

[0037] Fig. 1 schematically illustrates the interior of a vehicle 10, according to a particular and non-limiting embodiment of the present invention.

[0038] Vehicle 10 corresponds, for example, to a vehicle with an internal combustion engine, with electric motor(s), or even a hybrid vehicle with an internal combustion engine and one or more electric motors. Vehicle 10 thus corresponds, for example, to a land vehicle, for example a car, a truck, a bus.

[0039] The vehicle 10 includes a display system comprising a display device or screen 13 and a control unit configured to control the display of content from a graphical HMI on a screen 13, for example a touchscreen. The control unit corresponds, for example, to the infotainment system control unit, known as the IVI (In-Vehicle Infotainment) control unit of the vehicle 10.

[0040] According to one embodiment, the vehicle display system 10 comprises one or more other screens, for example, a screen of a head-up display device or system, corresponding, for example, to a transparent or semi-transparent screen arranged in such a way that a driver seated in the seat 16 sees the content displayed or projected onto the transparent screen when the driver is driving the vehicle 10, or a display screen 15 called instrument cluster or instrument panel usually arranged in an area behind the steering wheel 14 in the instrument panel 11.

[0041] The screen 13 is for example associated with a touch interface and corresponds for example to an LCD type screen (from the English "Liquid Crystal Display" or in French "Affichage à cristals liquide"), for example of type TFT (from the English "Thin-Film Transistor" or in French "Transistor en film mince"), or OLED (from the English "Organic Light-Emitting Diode" or in French "Diode électroluminescente organique").

[0042] The screen 13 is configured to display content for the driver and passengers of the vehicle. The screen 13 is also configured to allow the driver and / or passengers of the vehicle to interact with one or more on-board systems in the vehicle via a human-machine interface (HMI) displayed on the screen 13. For example, the screen 13 is configured to interact with the IVI system and / or a navigation system of the vehicle 10.

[0043] According to a particular embodiment, the screen 13 is not integrated into the vehicle's passenger compartment but corresponds to a screen of a mobile communication device (smartphone, tablet), connected in communication, for example wirelessly, with the vehicle's embedded system 10.

[0044] The vehicle 10 also carries, for example, one or more cameras, for example, a camera 12 corresponding to a front-facing camera (also called a windshield camera). Such a camera 12 is arranged in the passenger compartment of the vehicle 10 below the windshield and at the top and in the middle of this windshield. Such a front-facing camera 12 has a field of view corresponding to the space located in front of the vehicle 10 in the direction of travel of the vehicle 10. Such a camera 12 is thus configured for acquiring image data representative of the actual scene located in front of the vehicle 10, in the direction of travel of the vehicle 10.

[0045] Camera 12 includes, for example, the following elements: - a photosensitive sensor corresponding for example to a matrix of photoreceptors associated for example with a Bayer filter; - an optical assembly arranged in front of the sensor with respect to the scene to be acquired by the sensor, the optical assembly comprising, for example, an arrangement of one or more lenses; and - optionally one or more computers associated with memory and configured for processing images acquired by the sensor.

[0046] According to one embodiment, the camera corresponds to a camera of the mobile communication device mounted in the vehicle 10, if applicable. The camera of the mobile communication device is also configured for the acquisition of image data representative of the actual scene located in front of vehicle 10, according to the location of the mobile communication device in the passenger compartment of vehicle 10.

[0047] According to a particular embodiment, the vehicle 10 carries a navigation and geolocation system, also called a GNSS (Geolocation and Navigation by Satellite System) system, for example a GPS (Global Positioning System) or Galileo type system. According to this embodiment, the vehicle 10 carries a geolocation system receiver enabling the vehicle 10 to obtain initial data representative of its geographic position at any time, for example in the form of GPS coordinates (latitude and longitude), via a satellite link with a set of satellites 101.

[0048] According to this embodiment, the vehicle display system 10 is associated with the navigation system, i.e. the display system is configured to control the display of data obtained from the navigation system (for example, data representing the road environment in which the vehicle 10 is traveling and / or guidance instruction data when the vehicle 10 follows a route calculated by the navigation system).

[0049] A control process for an on-board display system in the vehicle 10 is advantageously implemented by one or more processors of the display system, for example by a computer of an on-board system of the vehicle 10 such as the IVI system or the navigation system, or by a processor of the mobile communication device. The on-board display system thus corresponds to a display device integrated into the vehicle 10 or to a display system of a mobile communication device itself embedded in the vehicle 10.

[0050] In a first operation of the process, a variable message sign, called VMS, located on a section of road on which the vehicle 10 is traveling is detected.

[0051] The PMV is for example detected from image data acquired by the camera 12 or by the camera of the mobile communication device when the process is implemented by the mobile communication device.

[0052] Figure 2 illustrates an example of an image 20 comprising a variable message sign 21, the image 20 being viewed from the perspective of a vehicle 10 traveling on a section of road. The image data of image 20 are acquired, for example, by a camera 12 or by the camera of a mobile communication device having the scene in front of the vehicle 10 in its field of view, such as camera 12.

[0053] According to the example in [Fig. 2], the PMV 21 is mounted on a gantry spanning the roadway on which the vehicle 10 travels. The message displayed on the PMV 21 relates to estimated travel times to reach a set of destinations, the Travel time to reach each destination is indicated in minutes (noted as "MN" in image 20) with the following information: - destination “ACCESS A64” with estimated travel time of “1 MN”; - destination “RANGUEIL” with estimated travel time of “3 MN”; and - destination “ACCES A61” with estimated travel time of “7 MN”.

[0054] According to another embodiment, the PMV 21 is detected from position data representative of the geographical location of the vehicle 10.

[0055] Position data are for example received from a receiver of a geolocation system on board the vehicle 10. Position data correspond for example to coordinates in global space, for example GPS coordinates (from the English "Global Positioning System" or in French "Système de géopositionnement par satellites") or Galileo corresponding to a pair of latitude and longitude type data.

[0056] The VMS 21 is detected, for example, from mapping data of the environment in which the vehicle 10 is traveling. The mapping data is stored, for example, in a memory of the vehicle 10, this mapping data including data describing the road segments of the vehicle's road environment as well as data on a set of points of interest located in the environment of the vehicle 10, including the VMS.

[0057] According to one embodiment, the position data is transmitted by the vehicle 10 in real time to a remote cloud server-type device via a wireless connection. The remote device cross-references the position data with the geographic location data of the VMS (Vehicle Monitoring System) to determine when the vehicle 10 is approaching a VMS. When this occurs, the remote device transmits an approach detection alert to the vehicle 10 via the wireless connection. For example, VMS 21.

[0058] According to another embodiment, the PMV 21 incorporates a wireless communication unit (i.e., a radio communication module or interface associated with one or more antennas). According to this embodiment, the PMV 21 communicates message data representative of the content of the message displayed on the PMV 21 wirelessly to road users compatible with such a wireless communication mode. According to this embodiment, the message data is, for example, communicated using a broadcast mode. The wireless communication mode corresponds, for example, to a Vehicle-to-Everything (V2X) mode. "Vehicle-to-Everything"), more specifically according to a mode called Infrastructure-to-Vehicle, denoted I2V (from the English "Infrastructure-to-Vehicle"). According to this variant, the detection of the PMV 21 by vehicle 10 is obtained when vehicle 10 detects the communication of message data emitted by PMV 21.

[0059] The detection of the PMV 21 is materialized for example by the display of an alert or a pictogram on a road map of the road environment of the vehicle 10, at the location of the PMV 21, displayed for example on the screen 13. According to another example, the detection is materialized by the rendering of a sound or a voice message.

[0060] According to yet another example, the detection of the PMV 21 is not accompanied by any alert to the vehicle, the detection corresponding to an event whose associated data are temporarily stored in a memory of the vehicle 10, for example a buffer memory (from the English "buffer").

[0061] In a second operation of the process, message data representative of the message displayed on the PMV 21 are obtained.

[0062] When the PMV 21 is detected from image data such as image 20, the message data is for example by applying one or more image processing methods to the image data received from the camera 12 (or from the camera of the mobile communication device where applicable).

[0063] According to a first embodiment, the message data corresponds to a part of the image data, the message data corresponding for example to data relating to the pixels of the part of the image 20 comprising the displayed message.

[0064] According to this first embodiment, a method of segmenting image 20 is implemented to detect the area of ​​image 20 containing the message, the area of ​​image 20 then being selected and cut out to retain only the pixel data associated with this area.

[0065] Methods for detecting text or messages in an image are known to those skilled in the art and are not detailed in this text.

[0066] According to a second embodiment, the message data is obtained by applying an optical character recognition (OCR) method. Such a method includes, for example, segmenting the image to detect the part of the image containing the message, with the OCR processing then being applied only to the part of the image containing the message.

[0067] Optical character recognition methods applied to all or from a digital image are known to those skilled in the art and are not described in detail in this text.

[0068] When the PMV 21 is detected from the position data of the vehicle 10, the message data is received for example from a remote device, for example a server in the "cloud" (or "nuage" in French).

[0069] When the detection of the PMV 21 is implemented directly by the vehicle 10, the vehicle 10 transmits, for example, a request to the remote device, via a wireless connection or link, to receive back via the wireless connection the message data, i.e. the data describing the content of the message displayed on the PMV 21.

[0070] When the PMV detection is obtained directly by the remote device, the latter automatically transmits the message data, i.e. the data describing the content of the message displayed on the PMV 21, to the vehicle 10 via a wireless connection.

[0071] The vehicle 10 and the remote device communicate in a wireless communication mode, for example of type V2X or V2I (from the English "Vehicle-to-Infrastructure" or in French "Véhicule vers infrastructure"), or in a wireless communication mode of type LTE 4G or type 5G via a terrestrial cellular network infrastructure.

[0072] When PMV 21 is detected from the detection of message data communication by PMV 21, the message data is automatically obtained or received from PMV 21 by vehicle 10.

[0073] The message data is for example stored in a memory of the vehicle 10, for example temporarily, until its use in the third operation of the process described below.

[0074] In a third operation of the process, the display of augmented reality graphic content is controlled so that this graphic content is displayed on a display device, such as screen 13.

[0075] The display control is for example triggered by the detection of the PMV, that is to say that the computer or processors in charge of the display initiate the generation of the graphic content upon detection of the PMV 21.

[0076] The graphic content advantageously includes: - a first image of the actual scene located in front of vehicle 10 acquired by a camera mounted in the vehicle such as camera 12, the content of this first image varying as vehicle 10 moves; and - a virtual graphic object displayed as an overlay to the first image, the virtual graphic object including a display area configured to display message data.

[0077] Display control includes rendering (i.e., generating) the graphic content, such rendering corresponding to a set of operations performed by one or more processors on the pixels of the first image to compose the graphic content. For example, rendering consists of associating pixel data (for example, color data expressed in an RGB (Red, Green, Blue) color space) with a set of pixels in the first image. French "red, green, blue")) associated with the virtual graphic object.

[0078] The virtual graphic object corresponds to a graphic object obtained by image synthesis, the virtual graphic object being superimposed on the first image in an area of ​​the first image corresponding, for example, to a location where the PMV is situated in the real scene associated with the first image. Thus, the pixels of the first image at the location of the overlay of the virtual object in the first image are replaced by the pixels defining the virtual graphic object.

[0079] Fig. 3 illustrates an example of the result of such a rendering, i.e. the display of graphic content 30 on screen 13.

[0080] The graphic content 30 thus displayed results from the embedding of a virtual graphic object 32, for example a 3-dimensional (3D) graphic object, on a first image 31 whose content represents the real scene that the driver sees (at least partially) through the windshield of the vehicle 10 at the moment of acquisition of the first image 31 (or with a slight time delay necessary for the composition of the graphic content 30, on the order of a few hundred milliseconds for example).

[0081] The result of the rendering thus corresponds to content called augmented reality (noted RA, or AR in English for "Augmented Reality") in that this content mixes content representing a real environment (acquired by a camera) with digital virtual content obtained by computer.

[0082] The graphic content 30 varies according to the movement of the vehicle 10 on the roadway, as the vehicle 10 moves along the roadway.

[0083] Graphic content 30 varies via: - the first image displayed, which varies as image data is received from camera 12, depending on the viewpoint of camera 12, which evolves and varies according to the movement of vehicle 10, the first images being, for example, refreshed / displayed at a frequency of 24, 48 or 50 frames per second; and / or - an adjustment of the representation of the virtual graphic object 32 as the vehicle 10 moves, the virtual graphic object 32 being for example superimposed on the first image at a constant distance from the viewpoint of the camera 12 or the representation of the virtual graphic object 32 being modified as the vehicle moves to provide the illusion to the driver that the vehicle 10 is approaching the virtual graphic object 32, the adjustment of the graphic representation allowing the perspective to be adapted according to the evolution of the viewpoint of the graphic content 30 which varies with the movement of the vehicle 10.

[0084] According to the example in [Fig.3], the graphic object 32 is representative of a gantry supporting a display area 320 on which the message 321 is displayed from the message data obtained in the second operation of the process.

[0085] Of course, the graphic object 32 is not limited to such a representation but extends to any virtual graphic representation, for example to a gantry or a side post supporting the display area 320.

[0086] The message 321 displayed on the display area 320 corresponds to a part of the image 20 comprising the content displayed on the PMV 21 (obtained from the image data of the camera 12) or to a text obtained by OCR of the first image or to a text received via the wireless communication mode described above.

[0087] According to a particular embodiment, the display of the graphic content 30 including the virtual graphic object 32 is controlled in such a way that the graphic content 30 is displayed on the display device 13 after a time instant of crossing the PMV 21 by the vehicle 10.

[0088] Such an embodiment thus makes it possible to display the message 321 via the virtual graphic object 32 once the message displayed on the PMV 21 is no longer visible to the driver of the vehicle 10, the latter having passed the PMV 21. This gives the driver the opportunity to see the message, in particular in situations where the driver would not have seen or had not had time to read the original message displayed on the PMV 21.

[0089] The virtual graphic object 32 with the display area 320 and the displayed message 321 are, for example, displayed on the screen 13 for a predetermined duration, for example, 20 seconds. According to other examples, the display duration of the graphic content 30, including the virtual graphic object 32, is 10, 15, 25, or 30 seconds.

[0090] This display duration corresponds, for example, to a fixed parameter of the vehicle display system 10 or to an adjustable parameter, for example via an HMI (Human-machine interface) of the display system, which a user can adjust according to their preferences.

[0091] Figure 4 schematically illustrates a device 4 configured for controlling a display system embedded in a vehicle, for example, vehicle 10, according to a particular and non-limiting embodiment of the present invention. The device 4 corresponds, for example, to a device embedded in the vehicle 10, such as a computer, or to a device or unit of a mobile communication device.

[0092] Device 4 is, for example, configured to carry out the operations described opposite Figures 1 to 3 and / or the steps of the process described opposite [Fig. 5]. Examples of such a device 4 include, but are not limited to, embedded electronic equipment such as a vehicle's on-board computer, an electronic control unit such as an ECU (Electronic Control Unit), a smartphone, a tablet, or a laptop computer. The elements of device 4, individually or in combination, may be integrated into a single integrated circuit, into several integrated circuits, and / or into discrete components. Device 4 can be implemented in the form of electronic circuits or software (or computer) modules or a combination of electronic circuits and software modules.

[0093] The device 4 comprises one (or more) processor(s) 40 configured to execute instructions for carrying out the steps of the process and / or for executing instructions from the software embedded in the device 4. The processor 40 may include integrated memory, an input / output interface, and various circuits known to those skilled in the art. The device 4 further comprises at least one memory 41, for example, volatile and / or non-volatile memory, and / or includes a memory storage device that may include volatile and / or non-volatile memory, such as EEPROM, ROM, PROM, RAM, DRAM, SRAM, flash, magnetic disk, or optical disk.

[0094] The computer code of the embedded software(s), including the instructions to be loaded and executed by the processor, is for example stored on memory 4L

[0095] According to various particular and non-limiting embodiments, the device 4 is coupled in communication with other similar devices or systems and / or with communication devices, for example a TCU (Telematic Control Unit), for example via a communication bus or through dedicated input / output ports.

[0096] According to a particular and non-limiting embodiment, the device 4 includes a block 42 of interface elements for communicating with external devices. The interface elements of the block 42 include one or more of the following interfaces: - radio frequency RF interface, for example of the Wi-Fi® type (according to IEEE 802.11), for example in the 2.4 or 5 GHz frequency bands, or of the Bluetooth® type (according to IEEE 802.15.1), in the 2.4 GHz frequency band, or of the Sigfox type using UBN (Ultra Narrow Band) radio technology, or LoRa in the 868 MHz frequency band, LTE (Long-Term Evolution), LTE-Advanced; - USB interface (from the English "Universal Serial Bus" or "Universal Serial Bus" in French); - HDMI interface (from the English "High Definition Multimedia Interface", or "High Definition Multimedia Interface" in French); - LIN interface (from the English "Local Interconnect Network", or in French "Réseau interconnecté local").

[0097] According to another particular and non-limiting embodiment, device 4 includes a communication interface 43 which allows communication with other devices (such as other computers in the embedded system) via a communication channel 430. The communication interface 43 corresponds, for example, to a transmitter configured to transmit and receive information and / or data via the communication channel 430. The communication interface 43 corresponds, for example, to a wired network of the type CAN (Controller Area Network), CAN FD (Controller Area Network Flexible Data-Rate), FlexRay (standardized by ISO 17458) or Ethernet (standardized by ISO / IEC 802-3).

[0098] According to a particular and non-limiting embodiment, the device 4 can provide output signals to one or more external devices, such as a display screen 440, touch or not, one or more speakers 450 and / or other peripherals 460 (projection system) via output interfaces 44, 45 and 46 respectively. According to a variant, one or more of the external devices is integrated into the device 4.

[0099] Figure 5 illustrates a flowchart of the different steps in a method for controlling a display system embedded in a vehicle, for example vehicle 10, according to a particular and non-limiting embodiment of the present invention. The method is implemented, for example, by a device embedded in the vehicle 10, by a mobile communication device, or by device 4 in Figure 4.

[0100] In a first step 51, a variable message sign located on a portion of road on which the vehicle is traveling is detected.

[0101] In a second step 52, message data representative of a message displayed on the variable message sign are obtained.

[0102] In a third step 53, the display of augmented reality graphic content is controlled so as to display the graphic content on a display device of the display system following detection, the graphic content comprising an image of a real scene located in front of the vehicle acquired by a camera mounted in the vehicle and a virtual graphic object superimposed on the image, the virtual graphic object comprising a display area configured to display message data.

[0103] According to one variant, the variants and examples of the operations described in relation to one of Figures 1 to 3 apply to the steps of the process in [Fig. 5].

[0104] Of course, the present invention is not limited to the embodiments described above but extends to a method for displaying graphic content in augmented reality that would include secondary steps without departing from the scope of the present invention. The same would apply to a device configured for the display of work of such a process.

[0105] The present invention also relates to a vehicle, for example an automobile or more generally an autonomous land-powered vehicle, comprising the device 4 of [Fig.4] or a display system comprising the device 4 of [Fig.4] connected in communication to a screen 13.

Claims

Demands

1. Method of controlling a display system embedded in a vehicle (10), said display system comprising a display device (13), said method comprising the following steps: - detection (51) of a variable message sign (21) located on a portion of road on which said vehicle (10) is traveling; - obtaining (52) message data representative of a message displayed on said variable message sign (21); - display control (53) of augmented reality graphic content (30) on said display device (13) following said detection (51), said graphic content (30) comprising a first image (31) of a real scene located in front of said vehicle (10) acquired by a camera (12) embedded in said vehicle (10) and a virtual graphic object (32) superimposed on said first image, said virtual graphic object (31) comprising a display area (320) configured to display said message data.

2. A method according to claim 1, wherein the graphic representation of said virtual graphic object (32) corresponds to a gantry supporting said display area (320).

3. A method according to claim 1 or 2, wherein said variable message sign (21) is detected from image data representative of at least one second image (20) of the variable message sign (21), said image data being acquired by said camera (12) mounted in said vehicle (10).

4. A method according to claim 3, wherein said message data are obtained by processing said image data, said message data corresponding to a part of said image data corresponding to an area of ​​said at least a second image (20) comprising said message.

5. A method according to claim 3, wherein said message data are obtained by applying an optical character recognition method to at least a portion of said image data corresponding to an area of ​​said at least a second image (20) comprising said message.

6. A method according to claim 1 or 2, wherein said variable message sign (21) is detected based on position data representative of the geographical location of said vehicle (10) and location data representative of the geographical location of said variable message sign (21), said message data being received from a remote device via a wireless communication method.

7. A method according to any one of claims 1 to 6, wherein the display of the graphic content (30) is controlled in such a way that the graphic content (30) is displayed on said display device (13) after a time has passed said variable message sign (21) by said vehicle (10).

8. A computer program comprising instructions for carrying out the method according to any one of the preceding claims, when such instructions are executed by a processor.

9. Device (4) for controlling a display system embedded in a vehicle, said device (4) comprising a memory (41) associated with at least one processor (40) configured for carrying out the steps of the method according to any one of claims 1 to 7.

10. Vehicle (10) comprising the device (4) according to claim 9.