Motor vehicle equipped with a multiplane head-up display system

The multi-plan head-up display system addresses the challenge of displaying POIs at the same distance as the driver sees them, enhancing the immersive experience and maintaining the clarity of other HUD information by dynamically selecting the appropriate display plan based on the POI's position.

FR3153427A1Inactive Publication Date: 2025-03-28STELLANTIS AUTO SAS +1
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
FR2023010078
Authority / Receiving Office
FR · FR
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-09-22
Publication Date
2025-03-28
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Traditional HUD systems struggle to display Points of Interest (POI) at the same distance as seen by the driver, leading to a compromise between POI display and other essential information, resulting in reduced ergonomics and immersive experience.

Method used

A multi-plan head-up display system that selects the most suitable display plan based on the POI's position, ensuring the graphic representation of the POI is displayed at the same distance as the real POI, while maintaining the display of other essential information without impact.

Benefits of technology

This solution enhances the immersive experience by providing an augmented reality-like display of POIs, maintaining the clarity and ergonomics of other HUD information, and adapting dynamically with the vehicle's movement.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

A motor vehicle (MV) comprising a multiplane head-up display (HUD) system, a navigation system comprising means for identifying and locating at least one point of interest (POI), and a display control module for the HUD system; said HUD system comprising a projection system (PSI) of at least one image emitting a light beam according to the image to be displayed, an optical system (OS) forming the image from the beam, and said display control module being capable of controlling the image projection system (PSI) and / or the optical system (PSI) to display a graphical representation (RPI) of the POI in one (PA2) of the display planes of the HUD system selected from among the display planes (PAn) of the HUD system to correspond to the position of the POI as seen by the driver (DV) of the vehicle (MV) in the driver's (DV) field of vision (FDV). (Figure 2)
Need to check novelty before this filing date? Find Prior Art

Description

Title of the invention: Motor vehicle comprising a multi-plane head-up display system

[0001] The present invention relates generally to display systems for motor vehicles and is more particularly concerned with a motor vehicle comprising a head-up display system also referred to as "HUD", an acronym for "Head Up Vision", or "HUD", an English acronym for "Head Up Display", and in particular to a head-up display system with adaptable focal lengths also referred to as a multi-plane head-up display system or multi-plane HUD.

[0002] The future of HUD technologies involves the use of adaptable focal lengths, or focal lengths. This makes it possible to develop and use a single HUD for multiple windshield sizes and shapes, and to achieve more immersive augmented reality effects for the user.

[0003] A HUD generally comprises an image projection unit emitting a light beam according to the image to be displayed, an optical system forming the image from the beam and a control unit controlling the optical system.

[0004] There are different arrangements for creating a multi-plane HUD.

[0005] A first arrangement uses only a single mirror and a single light source to display images on a windshield whose optical properties are different according to different planes considered in the thickness of the windshield (in different layers of the windshield) for the same display area of ​​the windshield.

[0006] A second arrangement uses only a single light source coupled with several motorized orientable mirrors to obtain several focal lengths in the same display area of ​​the HUD.

[0007] A third arrangement uses only a single motorized orientable mirror, coupled with several light sources to obtain several focal lengths in the same display area of ​​the HUD.

[0008] It is common to display information related to points of interest also referred to as “POI” (Anglo-Saxon acronym for “Point Of Interest”) in single-plane HUDs, i.e. HUDs with a single focal length (a single display plane).

[0009] POIs are characteristic points listed in navigation databases (cartographic databases) used by vehicle navigation systems. Some of these POIs make it possible to locate physical spaces composed in particular of buildings: public establishments, entertainment establishments, state commercial developments,... These are notable points which are displayed in particular on a vehicle guidance route by the vehicle's navigation system after having been preselected by the driver in a navigation system menu.

[0010] The graphic representation of this type of POIs (buildings) is displayed, in traditional, single-plane HUDs, in a single plane with the other information displayed by the HUD (current vehicle speed, speed limit sign, dangerous bend, etc.).

[0011] It is not possible to display the POIs in a plane located at the same distance as the POI seen by the driver, in the driver's field of vision, without having all the display content of the HUD displayed in this plane (speed, sign, etc.). It is then necessary to make a choice between either the POI or the other information displayed by the HUD (speed, signs, etc.)

[0012] This makes the display provided by a HUD less ergonomic, and limits the appeal of driving assistance systems with limited and not very immersive POI-related display solutions.

[0013] One of the solutions used to try to improve the ergonomics of the display and the immersive aspect of the display of information related to the POIs of a multi-plane HUD is to realign the display in relation to the driver in order to get closer to an augmented reality rendering. However, this alignment is approximate due to the different morphologies of drivers and the rendering is therefore just as approximate.

[0014] To overcome these drawbacks, the invention proposes to display a graphical representation of a POI, in a plane of the multi-plane HUD which is at the same distance as the actual POI as seen by the driver in his driving field of vision.

[0015] Thus, when the vehicle moves, the display system selects the most suitable POI display plane so that the display of the graphic representation of the POI remains at the same level as the real POI as seen by the driver, in his driving field of vision, thus giving a maximum immersive effect (also known as an augmented reality effect).

[0016] The invention makes it possible to manipulate several distinct planes: the display of the graphic representation of the POI is done distinctly, in parallel with the other information displayed by the multi-plane HUD (speed, turn, etc.), without impact (shift, deformation, etc.) on the other information displayed by the multi-plane HUD.

[0017] To this end, the present invention has as its first subject a motor vehicle comprising a multi-plane head-up display system, a navigation system comprising means for identifying and locating at least one point of interest, called POI, in the environment of the vehicle, and a module for controlling the display of the multi-plane head-up display system; said display system multi-plane head-up display comprising a system for projecting at least one image emitting a light beam as a function of the image to be displayed, an optical system forming the image from the beam and said display control module being capable of controlling the image projection system and / or the optical system to display a graphic representation of the POI in one of the display planes of the multi-plane head-up display system selected, among the other display planes of the multi-plane head-up display system, to correspond to the position of the POI, provided by the navigation system and as seen by the driver of the vehicle, in the driver's driving field of vision.

[0018] According to one characteristic, said display control module is capable of controlling the image projection system and / or the optical system to adapt the display of the graphical representation of the POI in one of the display planes of the multi-plane head-up display system, selected from among the planes of the multi-plane head-up display system, corresponding to the position of the POI as seen by the driver of the vehicle, in the driver's driving field of vision, during the movement of the vehicle and with a position of the graphical representation of the POI adapting to the position of the POI as seen by the driver of the vehicle during the movement of the vehicle.

[0019] According to another characteristic, the projection system comprises at least one light projector and the optical system comprises at least one mirror interacting optically with the light projector to display a graphic representation of the POI on one of the planes of the multi-plane head-up display system, selected by the display control module.

[0020] According to another characteristic, the projector and / or the mirror interacting optically with the projector are motorized to enable the orientation of the projector and / or the mirror to be continuously adapted as a function of the display plane of the multi-plane head-up display system, selected by the display control module.

[0021] According to another characteristic, the means for identifying and locating the POI comprise a GPS receiver coupled to a cartographic database.

[0022] According to another characteristic, the means for identifying and locating the POI comprise at least one camera coupled to an image recognition algorithm.

[0023] The second subject of the present invention is a method implemented by the vehicle display control module as described above, consisting of using the position of the POI provided by the navigation system to determine the focal length of the plane to be selected to display the graphic representation of the POI and to determine the orientation of the POI relative to the direction of travel of the vehicle and, to display in the selected plane, the graphic representation of the POI with a corresponding orientation. corresponding to the position of the POI provided by the navigation system.

[0024] According to one characteristic, the method consists, during the movement of the vehicle, in adapting the display of the graphic representation of the POI, as a function of the successive positions of the POI provided by the navigation system, by selecting from the display planes of the multi-plane head-up display system, the successive display planes whose focal distances correspond to the successive positions of the POI.

[0025] According to another characteristic, the method consists of controlling the orientation of the image projection system and / or the optical system of the multi-plane head-up display system according to a linear control law; the transition from one display plane to another successive display plane being carried out continuously.

[0026] According to another characteristic, the method consists of controlling a transfer of the graphic representation of the POI to successive display planes whose focal distances correspond to the successive positions of the POI.

[0027] The display of the graphical representation of the POI being positioned at the same level as the POI as seen by the driver in his driving field of vision, while the vehicle is moving, it is thus possible to highlight this POI in an immersive manner, which was not possible with traditional multi-plane HUDs.

[0028] Other advantages and characteristics of the present invention may emerge more clearly from the description which follows, given solely by way of non-limiting example and made with reference to the drawings in which:

[0029] [Fig-1] illustrates a schematic interior view of a motor vehicle passenger compartment according to the invention;

[0030] [Fig.2] illustrates a schematic embodiment of the multi-plane HUD of the vehicle according to the invention, in a first display phase;

[0031] [Fig.3] illustrates the embodiment of [Fig.2], in a second display phase; and

[0032] [Fig.4] illustrates by a flowchart, the main steps of a method implemented by a control module of the display of the multi-plane HUD of the vehicle according to the invention.

[0033] [Fig.l] illustrates the interior of a passenger compartment of a VHL motor vehicle according to the invention equipped with a multi-plane head-up display system, hereinafter referred to as a DTH multi-plane HUD.

[0034] The VHL vehicle comprises identification and location means MDI, making it possible to identify and locate predetermined POIs, in the environment of the VHL vehicle on a guidance route of the VHL vehicle provided by a navigation system NAV of the VHL vehicle, comprising for example a GPS receiver (an English acronym for Global Positioning System) coupled to a cartographic database and / or at least one camera associated with a recognition algorithm of images, not shown.

[0035] It will be considered below that the identification and location means MDI are part of the navigation system NAV even if these means MDI can be coupled to the navigation system NAV of the vehicle VHL.

[0036] The VHL vehicle also comprises a control module for the MCA display of the DTH multi-plane HUD, coupled to the NAV navigation system, capable of controlling the display of at least one predetermined POI, on one of the planes of the DTH multi-plane HUD, when the latter is located on a guidance route of the VHL vehicle by the NAV navigation system of the VHL vehicle.

[0037] In an exemplary embodiment of a multi-plane HUD, illustrated schematically in Figures 2 and 3, the multi-plane HUD DTH comprises one or more light sources, not shown, belonging to an image projection system SPI (projectors) comprising here two projectors PJ1, PJ2 and one or more mirrors, here two mirrors MRI, MR2 belonging to an optical system STO cooperating with the projection system SPI to form images from the light beams projected respectively by the projectors PH, PJ2 in different planes PA1, PA2 among a set of display planes PAn of the multi-plane HUD DTH.

[0038] The mirrors MRI, MR2 optically interact respectively with the projectors PH, PJ2 to display images, on different display planes PA1, PA2 of the multi-plane HUD DTH, in relation to the driving environment of the vehicle VHL.

[0039] The projector PJ2 and / or the associated mirror MR2 can be motorized in rotation to modify their orientation and orient the light beam towards a PA2 of the display planes PAn of the multi-plane HUD DTH, independently of the light beam projected by the projector PH associated with the mirror MRI.

[0040] The display control module MCA is furthermore capable of adapting the display of the predetermined POI on one of the planes selected from among the different display planes of the multi-plane HUD DTH as a function of the position of the POI in the field of vision CDV of the driver COV of the VHL vehicle and continuously during the movement of the VHL vehicle relative to the POI as described below.

[0041] [Fig.2] illustrates a first display phase in which the vehicle VHL is at a first distance DI from the POI with a first angle al formed between the distance separating the POI from the vehicle VHL and the heading direction of the vehicle VHL (first orientation OR1 of the POI relative to the driving field of vision CDV of the driver COV).

[0042] [Fig. 3] illustrates a second display phase in which the VHL vehicle approaches the POI at a second distance D2 (D2 < Dl) and with a second angle a2 (a2 > al) formed between the distance separating the POI from the VHL vehicle and the direction vehicle heading VHL (second orientation OR2 of the POI relative to the driver's driving field of vision COV).

[0043] The PA1 plane, the closest to the driver COV in the driving field of vision CDV, displays distinctly from the other PAn planes of the multi-plane HUD, and in particular from the PA2 plane displaying a graphical representation RPI of the POI, the information usually displayed by a single-plane HUD, such as here information about a dangerous bend at 300 m with a speed limit of 70 km / h.

[0044] This information is displayed via the projector PJ1 optically associated with the mirror MRI independently of the projector PJ2 and its associated mirror MR2.

[0045] When the NAV navigation system of the VHL vehicle detects a predetermined POI on a determined VHL vehicle guidance route, it transmits the position (GPS coordinates) of the POI to the MCA display control module. The MCA display control module then determines whether it is relevant to display this POI on the DTH multi-plane HUD (relevant restaurant or store at short distance, etc.) following a decision-making process determined by the MCA display control module which is not the subject of the present invention and will therefore not be described.

[0046] If the MCA display control module determines that a POI is relevant following the decision-making process, it then implements a display control method as described below with reference to the flowchart of [Fig.4].

[0047] The method uses the position of the POI provided by the NAV navigation system (GPS position) to, from the distance DI ([Fig.2]) of the POI relative to the VHL vehicle (the distance DI is considered relative to the heading direction of the VHL vehicle), determine 100 the focal distance of the PA2 plane to be selected to display the RPI graphic representation of the POI.

[0048] The method also uses the position of the POI provided by the navigation system NAV (GPS position) to, from the angle al ([Fig.2]) formed between the distance separating the VHL vehicle from the POI and the heading direction of the VHL vehicle, determine 200 the orientation OR1 of the POI relative to the direction of travel of the VHL vehicle (or heading direction of the VHL vehicle); the COV driver and the DTH multiplane HUD being oriented in this direction.

[0049] The method then consists of displaying 300 in the selected PA2 plane, the graphical representation RPI of the POI with a position corresponding to the orientation OR1 of the POI provided by the navigation system NAV.

[0050] In Figures 1 to 3, the RPI graphical representation of the POI is represented by a broken line circle.

[0051] To display the RPI graphical representation of the POI in the selected plane PA2 (integration of the RPI graphic representation of the POI with the correct orientation OR1), the display control process controls the projection of the RPI graphic representation of the POI by the projector PJ2 and the mirror MR2, associated with the selected plane PA2. The COV driver then benefits from an optimal immersive vision of the POI in his field of vision CDV.

[0052] Advantageously, during the movement of the vehicle VHL, the method for controlling the MCA display consists of adapting 400 the display of the graphic representation RPI of the POI, as a function of the successive positions of the POI provided by the navigation system NAV, by selecting from the display planes PAn of the multi-plane head-up display system DTH, the successive display planes whose focal distances correspond to the successive positions of the POI.

[0053] For this, the method controls the orientation of the projector PJ2, and / or the mirror MR2 to display the RPI representation of the POI in the selected plane PA2 with the new orientation OR2 of the POI (distance D2 and angle a2, [Fig.3]) and this, independently of the projector PU associated with the mirror MRI.

[0054] Advantageously, the transition from one display plane to another plane is carried out continuously (without interruption) by controlling the motors (not shown) equipping the projector PJ2 and / or the mirror MR2 of the multi-plane HUD DTH according to a linear control law.

[0055] Alternatively, the display of the RPI graphical representation of the POI can be transferred to another plane of the DTH multi-plane HUD among the set of PAn planes whose focal distance corresponds to the new position of the POI.

[0056] This transfer can be carried out, for example, by an image processing calculation module capable of “translating” the pixels representing the POI from one plane to another. This variant, simpler to implement, since it does not use mechanical means, can however give a less immersive rendering and therefore less attractive for the driver of the vehicle.

[0057] Thanks to the VHL vehicle according to the invention equipped with a multi-plane HUD DTH, coupled to the navigation system NAV of the VHL vehicle, and controlled by a display control module MCA, the driver COV of the VHL vehicle benefits from a visual restitution of the POI, displayed in a continuous and immersive manner approaching an augmented reality display.

Claims

1.

2.

3. Claims Motor vehicle (VHL) comprising a multi-plane head-up display (DTH) system, a navigation system (NAV) comprising means for identifying and locating (MDI) at least one point of interest, called POI, in the environment of the vehicle (VHL), and a display control module (MCA) of the multi-plane head-up display (DTH) system;said multi-plane head-up display (DTH) system comprising a projection system (SPI) of at least one image emitting a light beam as a function of the image to be displayed, an optical system (STO) forming the image from the beam and said display control module (MCA) being capable of controlling the image projection system (SPI) and / or the optical system (STO) to display a graphical representation (RPI) of the POI in one (PA2) of the display planes of the multi-plane head-up display (DTH) system selected, from among the other display planes (PAn) of the multi-plane head-up display (DTH) system, to correspond to the position of the POI provided by the navigation system (NAV) and as seen by the driver (COV) of the vehicle (VHL), in the driving field of vision (CDV) of the driver (COV).; Vehicle (VHL) according to the preceding claim, wherein said display control module (MCA) is capable of controlling the image projection system (SPI) and / or the optical system (STO) to adapt the display of the graphical representation (RPI) of the POI in one (PA2) of the display planes (PAn) of the multi-plane head-up display (DTH) system, selected from the planes (PAn) of the multi-plane head-up display (DTH) system, corresponding to the position of the POI as seen by the driver (COV) of the vehicle (VHL), in the driving field of vision (CDV) of the driver (COV), during the movement of the vehicle (VHL) and with a position of the graphical representation (RPI) of the POI adapting to the position of the POI as seen by the driver (COV) of the vehicle (VHL) during the movement of the vehicle (VHL). Vehicle (VHL) according to the preceding claim, in which the projection system (SPI) comprises at least one light projector (PJ2) and in which the optical system (STO) comprises at least one mirror (MR2) optically interacting with the light projector (PJ2) to display a graphic representation (RPI) of the POI on a (PA2) of the planes (PAn) of the multi-plane head-up display (DTH) system, selected by the display control module (MCA).

4. Vehicle (VHL) according to the preceding claim, in which the projector (PJ2) and / or the mirror (MR2) optically interacting with the projector (PJ2), are motorized to allow continuous adaptation of the orientation of the projector (PJ2) and / or the mirror (MR2) according to the display plane of the multi-plane head-up display (DTH) system, selected by the display control module (MCA).

5. Vehicle (VHL) according to one of the preceding claims, in which the identification and location means (MDI) of the POI comprise a GPS receiver coupled to a cartographic database.

6. Vehicle (VHL) according to one of the preceding claims, in which the identification and location means (MDI) of the POI comprise at least one camera coupled to an image recognition algorithm.

7. Method implemented by the display control module (MCA) of the vehicle (VHL) according to the preceding claims, consisting of using the position of the POI provided by the navigation system (NAV) to determine (100) the focal distance of the plane (PA2) to be selected to display the graphic representation (RPI) of the POI and determine (200) the orientation (OR1) of the POI relative to the direction of travel of the vehicle (VHL) and, to display (300) in the selected plane (PA2), the graphic representation (RPI) of the POI with an orientation (OR1) corresponding to the position of the POI provided by the navigation system (NAV).

8. Method according to the preceding claim, consisting, during the movement of the vehicle (VHL), in adapting (400) the display of the graphic representation (RPI) of the POI, as a function of the successive positions of the POI provided by the navigation system (NAV), by selecting from the display planes (PAn) of the multi-plane head-up display system (DTH), the successive display planes whose focal distances correspond to the successive positions of the POI.

9. Method according to the preceding claim consisting of controlling the orientation of the image projection system (SPI) and / or the optical system (STO) of the multi-plane head-up display (DTH) system according to a linear control law; the transition from one display plane to another successive display plane being carried out continuously.

10. A method according to claim 8, comprising controlling a transfer from the graphical representation (RPI) of the POI to successive display planes whose focal distances correspond to the successive positions of the POI.

Citation Information

Patent Citations

  • Heads-up display with variable image plane

    EP3696597A1

  • Reducing Driver Distraction Using a Heads-Up Display

    US20120224060A1

  • Multi-level navigation monitoring and control

    US20160003636A1

  • Passenger heads-up displays for vehicles

    US20200018976A1