Head-up display device, electronic device and vehicle

Abstract

The invention discloses a head-up display device, an electronic device and a vehicle, the head-up display device comprises a display module, the display module comprises a liquid crystal lens array, the liquid crystal lens array comprises a lens, a liquid crystal, a first electrode and a second electrode, the liquid crystal and the lens are arranged between the first electrode and the second electrode, and the liquid crystal is arranged between the first electrode and the second electrode. Under the condition that the first electrode and the second electrode are not electrified, the refractive indexes of the lens and the liquid crystal are the same, and under the condition that the first electrode and the second electrode are electrified, the refractive indexes of the lens and the liquid crystal are different. The refractive index of the liquid crystal is flexibly adjusted by changing the power-on and power-off of the first electrode and the second electrode, so that the optical characteristics of the display module are controlled, and 2D-HUD and 3D-HUD display can be achieved on one display module at the same time.

Description

Technical Field

[0001] The present application relates to the field of vehicle technology, and more specifically, to a head-up display device, an electronic device and a vehicle. Background Art

[0002] In the related art, 3D-Head-Up Display (3D-HUD) technology is widely used in vehicles. Since some people have problems with 3D vision failure or visual fatigue, how to achieve the display switching between 2D-Head-Up Display (2D-HUD) and 3D-HUD in the same head-up display device is an urgent problem to be solved in this field. Summary of the invention

[0003] Embodiments of the present application provide a head-up display device, an electronic device, and a vehicle, which can switch between 2D-HUD and 3D-HUD display.

[0004] In a head-up display device according to one embodiment of the present application, the display module includes a liquid crystal lens array, the liquid crystal lens array includes a lens, a liquid crystal, a first electrode, and a second electrode, the liquid crystal and the lens are arranged between the first electrode and the second electrode, when the first electrode and the second electrode are not energized, the refractive index of the lens and the liquid crystal is the same, and when the first electrode and the second electrode are energized, the refractive index of the lens and the liquid crystal is different.

[0005] In some embodiments, the lens includes a convex lens, the display module also includes a display layer, the display layer is used to emit display light, and along the emitting direction of the display light, the lens and the liquid crystal are arranged in sequence.

[0006] In some embodiments, when the first electrode and the second electrode are powered on, the refractive index of the lens is greater than the refractive index of the liquid crystal.

[0007] In certain embodiments, the liquid crystal comprises a twisted nematic liquid crystal.

[0008] In some embodiments, the lens includes a concave lens, the display module also includes a display layer, the display layer is used to emit display light, and along the emitting direction of the display light, the liquid crystal and the lens are arranged in sequence.

[0009] In some embodiments, when the first electrode and the second electrode are powered on, a refractive index of the lens is less than a refractive index of the liquid crystal.

[0010] In certain embodiments, the liquid crystal comprises homeotropically aligned liquid crystal.

[0011] In some embodiments, the head-up display device further includes a reflector assembly, and the reflector assembly is used to reflect the display light emitted by the display module to a preset area.

[0012] The display method of the present application is used for display control of the head-up display device described in any of the above-mentioned embodiments, and the method includes: performing image rendering in response to a display mode to obtain a display image, the display mode includes a two-dimensional display mode and a three-dimensional display mode, and the display image includes a two-dimensional display image and a three-dimensional display image; based on the display mode, controlling the power on or off of the first electrode and the second electrode to display the display image.

[0013] In some embodiments, based on the display mode, controlling the power on or off of the first electrode and the second electrode to display the display image includes: in the two-dimensional display mode, controlling the power off of the first electrode and the second electrode to display the two-dimensional display image; in the three-dimensional display mode, controlling the power on of the first electrode and the second electrode to display the three-dimensional display image.

[0014] In some embodiments, the displayed image includes a three-dimensional display image, and the image rendering is performed on the image in response to the display mode to obtain the display image, including: in the three-dimensional display mode, image rendering is performed to generate rendered images of different perspectives; based on a preset image arrangement algorithm, the rendered images of different perspectives are processed to generate the three-dimensional display image.

[0015] In some embodiments, the head-up display device also includes an eye tracking module, which is used to collect human eye position information. The method also includes: in the three-dimensional display mode, based on the human eye position information, adjusting the display viewing angle of the three-dimensional display image so that the display viewing angle matches the position information.

[0016] In some embodiments, the display method also includes: obtaining current scene information, the current scene information including a scene object and a first scene coordinate of the scene object in a sensor coordinate system; based on a first conversion relationship between the sensor coordinate system and a world coordinate system, converting the first scene coordinate into a second scene coordinate; based on a second conversion relationship between the world coordinate system and a visual model of the head-up display device, converting the second scene coordinate into a third scene coordinate; based on a third conversion relationship between the visual model and the display module, converting the third scene coordinate into a fourth scene coordinate; and generating the display image based on the scene image and the fourth scene coordinate.

[0017] The present application also proposes an electronic device, a processor, wherein the processor is connected to a memory; a computer program is stored in the memory, and the processor executes the computer program to implement the display method described in any of the above embodiments.

[0018] The present application also proposes a vehicle, which includes the head-up display device described in any one of the above embodiments or the electronic device described in any one of the above embodiments.

[0019] The head-up display device, electronic device and vehicle of the embodiments of the present application, the head-up display device includes a display module, the display module includes a liquid crystal lens array, the liquid crystal lens array includes a lens, a liquid crystal, a first electrode and a second electrode, the liquid crystal and the lens are arranged between the first electrode and the second electrode, when the first electrode and the second electrode are not energized, the refractive index of the lens and the liquid crystal is the same, the liquid crystal lens array can be equivalent to transparent glass, so as to achieve the effect of displaying a two-dimensional image without loss of image quality, thereby realizing the display of 2D-HUD; when the first electrode and the second electrode are energized, the refractive index of the lens and the liquid crystal is different, the liquid crystal lens array can be equivalent to a cylindrical lens grating, so as to achieve a stereoscopic display effect of a three-dimensional image, thereby realizing the display of 3D-HUD.

[0020] By changing the on and off of the first electrode and the second electrode, the refractive index of the liquid crystal is flexibly adjusted to control the optical properties of the display module, so that 2D-HUD and 3D-HUD can be displayed simultaneously on one display module. The driver can freely switch the display of 2D-HUD and 3D-HUD according to his own visual conditions and usage habits, the external driving environment of the vehicle or his own actual needs. It can not only meet the needs of drivers with normal stereoscopic vision, but also meet the needs of people with failed 3D stereoscopic vision, thereby improving the applicability and flexibility of the head-up display.

[0021] In addition, the integration of liquid crystal and lens can also reduce the structural complexity of the display module, improve the integration level, and save the space occupied by the display module and the production cost.

[0022] Additional aspects and advantages of the embodiments of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the embodiments of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0024] Figure 1 is a schematic diagram of an application scenario of a head-up display device according to some embodiments of the present application;

[0025] Figure 2is a schematic diagram of a scene of a head-up display device according to some embodiments of the present application;

[0026] Figure 3 is a schematic diagram of a scene of a head-up display device according to some embodiments of the present application;

[0027] Figure 4 is a schematic diagram of a scene of a head-up display device according to some embodiments of the present application;

[0028] Figure 5 is a schematic diagram of a scene of a head-up display device according to some embodiments of the present application;

[0029] Figure 6 is a schematic diagram of a flow chart of a head-up display device according to certain embodiments of the present application;

[0030] Figure 7 is a schematic diagram of a flow chart of a head-up display device according to certain embodiments of the present application;

[0031] Figure 8 is a schematic diagram of a scene of a head-up display device according to some embodiments of the present application;

[0032] Fig. 9 is a schematic diagram of a flow chart of a head-up display device according to certain embodiments of the present application;

[0033] Fig.10 is a schematic diagram of a scene of a head-up display device according to some embodiments of the present application;

[0034] Fig.11 is a schematic diagram of a flow chart of a head-up display device according to certain embodiments of the present application;

[0035] Fig.12 is a schematic diagram of a scene of a head-up display device according to some embodiments of the present application;

[0036] Fig.13 is a schematic diagram of a flow chart of a head-up display device according to certain embodiments of the present application;

[0037] Fig.14 is a schematic diagram of a scene of a head-up display device according to some embodiments of the present application;

[0038] Fig.15 is a schematic diagram of a scene of a head-up display device according to some embodiments of the present application;

[0039] Fig.16 is a schematic diagram of a module of a display device according to some embodiments of the present application;

[0040] Fig.17 It is a schematic diagram of the connection status of a non-volatile computer-readable storage medium and a processor in certain embodiments of the present application. DETAILED DESCRIPTION

[0041] The embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals represent the same or similar elements or elements having the same or similar functions from beginning to end. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the embodiments of the present application, and cannot be understood as limiting the embodiments of the present application.

[0042] To facilitate understanding of this application, the terms and background technologies that appear in this application are explained below:

[0043] Head-Up Display (HUD) technology is widely used in vehicles. It projects information into the driver's field of vision (for example, into the windshield) and directly superimposes the information onto the real environment, helping the driver to obtain important information without leaving his sight, thereby improving safety and driving experience.

[0044] In-vehicle head-up display systems usually include windshield type (W-HUD), integrated display type (C-HUD) and augmented reality type (AR-HUD). Among them, AR-HUD actually adds an AR image layer. In addition to displaying conventional vehicle information, it generally adds real-time navigation and advanced driving assistance systems (ADAS) to help display lane information, collision warning information, etc.

[0045] In the related art, HUD usually displays a flat virtual image (2D image), which is often fixed at a certain position in front of the driver and cannot change with the focusing distance of the human eye. During driving, the driver needs to adjust the focal length of the eyes so that the human eye focuses on the focal plane of the 2D image. Long-term viewing of the displayed image at a fixed focal length can easily cause visual fatigue to the driver, affecting driving safety. In addition, since the 2D image is a flat image, it cannot display the depth information of the real object and lacks a three-dimensional sense. That is, the displayed image (such as navigation steering information, three-dimensional warning information, superimposed information of other real-life landmarks, etc.) cannot overlap with the real scene, and the driver needs to make further judgments on the displayed information. Therefore, the three-dimensional head-up display (3D-Head-Up Display, 3D-HUD) technology came into being.

[0046] 3D-HUD is usually a combination of 3D display technology and HUD display technology. 3D display technology is used to generate a stereoscopic image information source, and HUD display technology is used to realize virtual image display. The 3D display image can be integrated with at least one of the lane lines, pedestrians, vehicles and the ground in front of the vehicle, that is, the 3D display image can be integrated with the actual road conditions, and the displayed object image has real depth and depth of field information, and is no longer an image with a single focal plane depth of field, which can achieve a 3D head-up display effect.

[0047] Since some people have problems with 3D vision failure or visual fatigue, 2D-HUD and 3D-HUD are indispensable in the vehicle's head-up display technology.

[0048] In 3D-HUD technology, a slit grating, a liquid crystal slit grating, a cylindrical lens, a compound eye lens or a liquid crystal lens (pure liquid crystal) is usually used to help generate a stereoscopic image to achieve a 3D-HUD display effect. However, the existence of slit grating, a liquid crystal slit grating, a cylindrical lens, a compound eye lens or a liquid crystal lens (pure liquid crystal) and other spectral devices results in a 2D display state in which the 2D display image has a more obvious sense of stripes and grids of the grating or lens (due to the natural existence of the grating or lens, its physical structure will not disappear), which loses the display quality of the 2D display image and affects the resolution and clarity of the displayed image.

[0049] Therefore, how to realize the display switching between 2D-HUD and 3D-HUD in the same head-up display device is a problem that needs to be solved urgently in the field.

[0050] The following first introduces the application scenarios of the technical solution of the present application. The head-up display device 100 provided by the present application can be applied to Figure 1 The vehicle 1000 shown is used to implement a 2D-HUD and a 3D-HUD of the vehicle.

[0051] See also Figure 1 and Figure 2 The head-up display device 100 includes a display module 101, and the display module 101 includes a liquid crystal lens array 10. The liquid crystal lens array 10 includes a lens 11, a liquid crystal 12, a first electrode 13 and a second electrode 14. The liquid crystal 12 and the lens 11 are arranged between the first electrode 13 and the second electrode 14. When the first electrode 13 and the second electrode 14 are powered, the refractive indexes of the lens 11 and the liquid crystal 12 are different. When the first electrode 13 and the second electrode 14 are not powered, the refractive indexes of the lens 11 and the liquid crystal 12 are the same.

[0052] The lens liquid crystal array 10 further includes an upper substrate 15 and a lower substrate 16 , and the upper substrate 15 and the lower substrate 16 provide support.

[0053] The display module 101 may be used to project display information into the field of vision of the driver of the vehicle 1000 .

[0054] The lens 11 can be used to refract light to control the propagation direction and focusing direction of the light.

[0055] Among them, the lens 11 can be formed by a coating and imprinting process or a micro-nano printing process, and is produced based on optical glue such as optical glue, UV glue, resin glue, etc.

[0056] The liquid crystal 12 (LC) can be used to help control the propagation of light, and the refractive index of the liquid crystal 12 can be changed by applying voltage to the liquid crystal 12 .

[0057] When both the first electrode 13 and the second electrode 14 are powered on, an electric field can be generated to change the refractive index of the liquid crystal 12 .

[0058] Optionally, the vehicle 1000 includes an information collection module 200, which may include at least one of one or more image sensors, radar sensors (such as millimeter wave radars, ultrasonic radars, lidars, etc.), global navigation satellite systems (Global Navigation Satellite System, GNSS), inertial measurement units (Inertial MeasurementUni, IMU) and other components.

[0059] Among them, vehicle 1000 can collect environmental information around vehicle 1000 based on at least one of the above components. The environmental information may include the distance between vehicle 1000 and surrounding obstacles, road sign information around vehicle 1000 (such as the meaning of road signs, road sign color, etc.), high-resolution map positioning information of vehicle 1000, movement speed, acceleration and other basic physical quantity information of vehicle 1000, etc.

[0060] Optionally, the vehicle 1000 includes an eye tracking module 300, which includes one or more infrared cameras, depth cameras, time of flight (ToF) modules, etc. The eye tracking module 300 can be used to obtain and track the driver's eye position information (such as position coordinates, etc.).

[0061] Optionally, the head-up display device 100 further includes a reflector assembly 20, and the reflector assembly 20 is used to reflect the display light emitted by the display module 101 to a preset area.

[0062] Among them, the reflector assembly 20 includes a first reflector 21, a second reflector 22 and a front windshield 23. The first reflector 21 can be a plane reflector, a spherical reflector, an aspherical reflector or a free-form reflector. The second reflector 22 can be a spherical reflector or a free-form reflector. The front windshield 23 can be a wedge-shaped structure glass, which can be used to correct the imaging quality.

[0063] Optionally, the display module 101 also includes a backlight module and a display layer. The backlight module may include a light source (such as a light emitting diode (LED), etc., for providing backlight brightness; the display layer may be used to display and store a HUD display image for the driver to view (for example, it may be a display image generated by sampling the surrounding environment of the vehicle 1000 through the sensor of the vehicle 1000 (such as an image sensor, a radar sensor, etc.), or it may be an image content pre-stored in the memory of the vehicle 1000, the vehicle system, etc. (such as the vehicle 1000 driving icon, etc.)). The display layer may be a liquid crystal display (Liquid Crystal Display, LCD), an organic light emitting diode (Organic Light Emitting Diode, OLED), or a micro light emitting diode (MicroLED, MLED), etc. The lens liquid crystal array 10 may be arranged on the display layer.

[0064] It can be understood that if it is an active direct display light-emitting device (ie, a light-emitting display device that displays images based on its own light-emitting ability and does not require a backlight source), the display module 101 does not need to be additionally provided with a backlight module.

[0065] Specifically, the light emitted by the backlight module of the display module 101 of the vehicle 1000 can be directed toward the display layer. After the light reaches the display unit, it passes through the lens liquid crystal array 10 of the display module 101 and is directed toward the reflector assembly. The reflector assembly then directs the light toward a preset area (for example, it may be in front of the driver's line of sight, etc.) to achieve a two-dimensional display effect of 2D-HUD or a three-dimensional display effect of 3D-HUD.

[0066] The lens liquid crystal array 10 includes a lens 11, a liquid crystal 12, a first electrode 13 and a second electrode 14. The liquid crystal 12 and the lens 11 are arranged between the first electrode 13 and the second electrode 14. When the first electrode 13 and the second electrode 14 are not powered, the refractive indexes of the lens 11 and the liquid crystal 12 are the same, that is, when the first electrode 13 and the second electrode 14 are not powered, when light passes through the lens 11 and the liquid crystal 12, since the refractive indexes of the lens 11 and the liquid crystal 12 are the same, the light is transmitted without splitting, which is equivalent to natural light emission through transparent glass, thereby realizing the display of a two-dimensional image, that is, realizing the display of a 2D-HUD; when the first electrode 13 and the second electrode 14 are powered, an electric field is formed between the first electrode 13 and the second electrode 14, changing the molecular arrangement of the liquid crystal 12 to change the refractive index of the liquid crystal 12, so that the refractive index of the liquid crystal 12 is different from that of the lens 11. The difference in refractive index will affect the propagation of light to achieve the adjustment, focusing or refraction of light. That is, when light passes through the lens 11 and the liquid crystal 12, due to the different refractive indices of the liquid crystal 12 and the lens 11, the light can be refracted and split, which is equivalent to the light splitting after passing through the grating of the cylindrical lens 11, thereby realizing the display of three-dimensional images, that is, realizing the display of 3D-HUD.

[0067] In this way, the head-up display device 100 includes a display module 101, and the display module 101 includes a lens liquid crystal array 10. The lens liquid crystal array 10 includes a lens 11, a liquid crystal 12, a first electrode 13 and a second electrode 14. The liquid crystal 12 and the lens 11 are arranged between the first electrode 13 and the second electrode 14. When the first electrode 13 and the second electrode 14 are not powered, the refractive index of the lens 11 and the liquid crystal 12 is the same, and the lens liquid crystal array 10 can be equivalent to transparent glass, so as to achieve the effect of displaying a two-dimensional image without loss of image quality, thereby realizing the display of 2D-HUD; when the first electrode 13 and the second electrode 14 are powered, the refractive index of the lens 11 and the liquid crystal 12 is different, and the lens liquid crystal array 10 can be equivalent to a cylindrical lens 11 grating, so as to achieve a stereoscopic display effect of a three-dimensional image, thereby realizing the display of 3D-HUD.

[0068] By changing the on and off of the first electrode 13 and the second electrode 14, the refractive index of the liquid crystal 12 is flexibly adjusted to control the optical properties of the display module 101, so that 2D-HUD and 3D-HUD can be displayed simultaneously on one display module 101. The driver can freely switch the display of 2D-HUD and 3D-HUD according to his own visual conditions and usage habits, the external driving environment of the vehicle 1000 or his own actual needs, which can not only meet the needs of drivers with normal stereoscopic vision, but also meet the needs of people with 3D stereoscopic vision failure, thereby improving the applicability and flexibility of the head-up display.

[0069] Furthermore, the integration of the liquid crystal 12 and the lens 11 can also reduce the structural complexity of the display module 101 , improve the integration level, and save the occupied space and production cost of the display module 101 .

[0070] See also Figure 2 In some embodiments, the lens 11 includes a convex lens 11, and the display module 101 also includes a display layer, the display layer is used to emit display light, and the lens 11 and the liquid crystal 12 are arranged in sequence along the emitting direction of the display light.

[0071] When the first electrode 13 and the second electrode 14 are powered on, the refractive index of the lens 11 is greater than the refractive index of the liquid crystal 12 .

[0072] The liquid crystal 12 includes twisted nematic liquid crystal 12 (TN liquid crystal 12).

[0073] Optionally, the refractive index of the convex lens is generally between 1.6 and 1.8. For the convenience of explanation, in the embodiment of the present application, the refractive index of the convex lens 11 is ne (ne=1.8, that is, the convex lens 11 is a high refractive index lens 11), and the refractive index of the TN-type liquid crystal 12 is ne when it is not subjected to an electric field, and the refractive index is no (no<1.8, for example, no=1.5) when it is subjected to an electric field.

[0074] Specifically, see Figure 2 and Figure 3 The display module 101 also includes a display layer, which is used to emit display light. The display light can pass through the lens 11 and the liquid crystal 12 in sequence to perform HUD imaging and display. When the first electrode 13 and the second electrode 14 are not powered, the TN-type liquid crystal 12 is not affected by the electric field, and the refractive index is ne, which is the same as the refractive index of the convex lens 11. The display light can pass normally without light splitting. The lens liquid crystal array 10 can be equivalent to transparent glass to achieve 2D-HUD display; when the first electrode 13 and the second electrode 14 are powered, the TN-type liquid crystal 12 is affected by the electric field, and the refractive index becomes no, which is less than ne. The display light is emitted from the high-refractive-index lens 11 to the low-refractive-index liquid crystal 12, and the display light is refracted to achieve light splitting. The lens liquid crystal array 10 can be equivalent to the cylindrical lens 11 grating to achieve 3D-HUD display.

[0075] See also Figure 4 In some embodiments, the lens 11 includes a concave lens 11, and the display module 101 also includes a display layer, the display layer is used to emit display light, and the liquid crystal 12 and the lens 11 are arranged in sequence along the emitting direction of the display light.

[0076] When the first electrode 13 and the second electrode 14 are powered on, the refractive index of the lens 11 is smaller than the refractive index of the liquid crystal 12 .

[0077] The liquid crystal 12 includes vertical alignment liquid crystal 12 (VA liquid crystal 12).

[0078] The refractive index of the concave lens 11 is smaller than the refractive index of the convex lens 11 .

[0079] Optionally, the refractive index of the concave lens is generally between 1.3 and 1.6. For the convenience of explanation, in the embodiment of the present application, the refractive index of the concave lens 11 is no (no=1.5, that is, the concave lens 11 is a low refractive index lens 11), and the refractive index of the VA liquid crystal 12 is no when not affected by an electric field, and the refractive index is ne (ne>no, for example, ne=1.8) when affected by an electric field.

[0080] Specifically, see Figure 4 and Figure 5 The display module 101 also includes a display layer, which is used to emit display light. The display light can pass through the liquid crystal 12 and the lens 11 in sequence to perform HUD imaging and display. When the first electrode 13 and the second electrode 14 are not powered, the VA type liquid crystal 12 is not affected by the electric field, and the refractive index is no, which is the same as the refractive index no of the concave lens 11. The display light can pass normally without light splitting. The lens liquid crystal array 10 can be equivalent to transparent glass to achieve 2D-HUD display; when the first electrode 13 and the second electrode 14 are powered, the VA type liquid crystal 12 is affected by the electric field, and the refractive index increases to ne. The display light is emitted from the high refractive index liquid crystal 12 to the low refractive index lens 11, and the display light is refracted to achieve light splitting. The lens liquid crystal array 10 can be equivalent to the cylindrical lens 11 grating to achieve 3D-HUD display.

[0081] See also Figure 6 The present application also proposes a display method, which can be used for display control of the head-up display device described in any of the above embodiments, and the display method includes:

[0082] Step 011: performing image rendering in response to a display mode to obtain a display image, the display mode includes a two-dimensional display mode and a three-dimensional display mode, and the display image includes a two-dimensional display image and a three-dimensional display image;

[0083] Step 012: Based on the display mode, controlling the first electrode and the second electrode to be powered on or off to display a display image.

[0084] Among them, the display mode includes a two-dimensional display mode and a three-dimensional display mode. In the two-dimensional display mode, the image (such as the image collected by the vehicle's sensor, or the pre-stored image, etc.) can be rendered to obtain a two-dimensional display image; in the three-dimensional display mode, the image (such as the image collected by the vehicle's sensor, or the pre-stored image, etc.) can be rendered to obtain a three-dimensional display image.

[0085] Optionally, see Figure 7 , step 012: based on the display mode, controlling the first electrode and the second electrode to be powered on or off to display a display image, including:

[0086] Step 0121: in a two-dimensional display mode, controlling the first electrode and the second electrode to be powered off to display a two-dimensional display image;

[0087] Step 0122: In the three-dimensional display mode, controlling the first electrode and the second electrode to be energized to display a three-dimensional display image.

[0088] Specifically, the driver can interact with the vehicle based on the vehicle display screen or a terminal (such as a mobile phone, etc.) connected to the vehicle to determine the desired display mode. In response to the selection of the display mode, the vehicle performs two-dimensional or three-dimensional processing on the image data collected by the vehicle's information collection module corresponding to the display mode, and displays a two-dimensional display image or a three-dimensional display image.

[0089] When the vehicle responds to the two-dimensional display mode and displays a two-dimensional display image, for example, the image data collected by the vehicle's information collection module (taking the image sensor as an example) is subjected to image processing such as bitmap rendering and vector rendering to generate a two-dimensional display image, and then the first electrode and the second electrode are powered off to make the refractive index of the lens and the liquid crystal consistent, so as to display a two-dimensional display image with a planar effect. Since the two-dimensional display image is a planar image, for example, refer to Figure 8 , two-dimensional display images (2D images) only need to be displayed through images with the same viewing angle (same image source) (such as Figure 8 As shown, the first image source and the second image source are images of the same view) and the result can be obtained by performing 2D rendering processing.

[0090] When the vehicle responds to the three-dimensional display mode and displays a three-dimensional display image, for example, stereoscopic image rendering (Stereo3DRendering) is performed on the image data collected by the vehicle's information acquisition module (taking the image sensor as an example) to obtain a three-dimensional display image, and then the first electrode and the second electrode are controlled to be energized to change the arrangement of the liquid crystal molecules, so that the refractive indexes of the lens and the liquid crystal are different, thereby realizing the splitting of the display light, thereby displaying a three-dimensional display image with a three-dimensional effect.

[0091] In this way, by responding to the display mode, image rendering is performed to obtain a display image, the display mode includes a two-dimensional display mode and a three-dimensional display mode, and the display image includes a two-dimensional display image and a three-dimensional display image; then based on the display mode, the power on or off of the first electrode and the second electrode is controlled to display the display image, and by responding to the display mode, the generation of the two-dimensional display image or the three-dimensional display image is controlled, and the power on or off of the first electrode and the second electrode is correspondingly controlled to flexibly switch between 2D-HUD and 3D-HUD, so as to meet the user's planar visual needs or stereoscopic visual needs, improve the flexibility and applicability of the vehicle's HUD, and the user's experience.

[0092] Optionally, see Fig. 9 , the display image includes a three-dimensional display image, step 011: in response to the display mode, the image is rendered to obtain a display image, including:

[0093] Step 0111: performing image rendering in a three-dimensional display mode to generate rendered images at different viewing angles;

[0094] Step 0112: Based on a preset image arrangement algorithm, the rendered images of different viewing angles are processed to generate a three-dimensional display image.

[0095] The preset graph arrangement algorithm may be a dynamic programming, graph cuts or other algorithms.

[0096] Specifically, see Fig.10 In the three-dimensional display mode, the image data collected by the vehicle information collection module (taking the image sensor as an example) can be processed from multiple perspectives to obtain rendering images corresponding to each perspective. There is parallax between these rendering images. Then, based on a preset arrangement algorithm, the rendering images from multiple perspectives are synthesized to obtain a three-dimensional display image (for example, a three-dimensional image with two perspectives (such as Fig.10 As shown, taking two perspectives including a first image source and a second image source, where the two image sources correspond to the left eye perspective and the right eye perspective of a driver when viewing a three-dimensional display image as an example, 3D rendering is performed on different views under the two image sources to obtain a 3D composite image (i.e., a three-dimensional display image). After image processing by a preset image arrangement algorithm, the display light of the three-dimensional display image can present a display image with a three-dimensional stereoscopic effect after passing through the lens liquid crystal array.

[0097] See also Fig.11 In some embodiments, the head-up display device further includes an eye tracking module, which is used to collect human eye position information, and the display method further includes:

[0098] Step 013: In the three-dimensional display mode, based on the human eye position information, the display viewing angle of the three-dimensional display image is adjusted so that the display viewing angle matches the human eye position information.

[0099] Specifically, see Fig.12 , the three-dimensional display image can be reflected as a combination of multiple views in space. The human eye is in different positions, and the corresponding visual area is different, so different views of the three-dimensional display image can be viewed. For example, when the position is S1, the visual effect of the view View1 viewed is the clearest; when the position is S2, the visual effect of the view View n viewed is the clearest. Therefore, as the position of the human eye changes, that is, as the position information of the human eye changes, the display viewing angle of the three-dimensional display image can be adjusted based on a preset arrangement algorithm, so that the view that can reflect the display information of the HUD display can follow the position of the human eye, that is, the view that needs to include the display information can be accurately projected to the visual area of ​​the driver's human eye.

[0100] Since the viewing angle in the 3D-HUD display system is usually small due to the design of the spectral grating or lens, the human eye can only view the stereoscopic image within a fixed small viewing angle range. By setting up an eye tracking module to determine the human eye position information, and then adjusting the display angle of the three-dimensional display image according to the human eye position information, the display angle matches the human eye position information (for example, the display angle is directly relative to the human eye position information), thereby improving the driver's viewing angle and expanding the viewing field of the 3D-HUD. That is, by adjusting the display angle of the three-dimensional display image based on the human eye position information, the small fixed viewing angle in the existing 3D-HUD display is expanded to a large tracking angle of continuous viewing that moves with the human eye position.

[0101] See also Fig.13 In some embodiments, the display method further comprises:

[0102] Step 014: Acquire current scene information, where the current scene information includes scene objects and first scene coordinates of the scene objects in the sensor coordinate system;

[0103] Step 015: based on a first conversion relationship between the sensor coordinate system and the world coordinate system, convert the first scene coordinate into a second scene coordinate;

[0104] Step 016: based on a second conversion relationship between the world coordinate system and the visual model of the head-up display device, convert the second scene coordinates into third scene coordinates;

[0105] Step 017: based on a third conversion relationship between the visual model and the display module, convert the third scene coordinates into fourth scene coordinates;

[0106] Step 018: Generate a display image based on the scene image and the fourth scene coordinates.

[0107] Among them, the visual model can be a computing model used to understand, analyze and process the environmental information around the vehicle.

[0108] Specifically, see Fig.14 The vehicle's information acquisition module can obtain current scene information, collect scene objects (such as obstacles, other vehicles, etc.) and the first scene coordinates of the scene objects in the sensor coordinate system; based on the first conversion relationship (ADAS coordinate conversion relationship), the first scene coordinates are converted into second scene coordinates in the world coordinate system; based on the second conversion relationship (HUD coordinate conversion relationship), the second scene coordinates are converted into third scene coordinates under the visual model; then based on the third conversion relationship (display module coordinate conversion relationship), the third scene coordinates are converted into fourth scene coordinates in the display module coordinate system, and based on the image data collected by the information acquisition module and the fourth scene coordinates, a display image displayed in space is generated.

[0109] It can be understood that the eye tracking module can also be used to obtain the first position coordinates of the human eye in space, and convert the position coordinates into second position coordinates in the display module coordinate system. When a display image is generated based on the scene image and the fourth scene coordinates, the display position, display viewing angle, etc. of the display image can be adjusted based on the second position coordinates to match the display image with the human eye position and improve the display effect.

[0110] See also Fig.15 The vehicle of the present application may include an information acquisition module, an eye tracking module, an image generation module, an image display module and a HUD imaging module. The information acquisition module collects current scene information and image data around the vehicle, and in the image generation module, in response to the display mode selected by the user, performs image rendering processing (including two-dimensional rendering mode and three-dimensional rendering mode) on the current scene information and image data corresponding to the display mode to obtain a display image; and according to the position information of the human eye determined by the eye tracking module, performs two-dimensional display or three-dimensional display in the image display module to display a two-dimensional display image or a three-dimensional display image, and finally realizes 2D-HUD or 3D-HUD through the HUD imaging module.

[0111] See also Fig.16In order to better implement the head-up display method of the embodiment of the present application, the embodiment of the present application also provides a display device 300, and the display device 300 can perform display control on the head-up display device of any of the above embodiments. The display device 300 includes a response module 301 and a control module 302. The response module 301 is used to respond to the display mode and perform image rendering to obtain a display image. The display mode includes a two-dimensional display mode and a three-dimensional display mode, and the display image includes a two-dimensional display image and a three-dimensional display image; the control module 302 is used to control the power on or off of the first electrode and the second electrode based on the display mode to display the display image.

[0112] In some embodiments, the control module 302 is further configured to control power-off of the first electrode and the second electrode in a two-dimensional display mode to display a two-dimensional display image; and to control power-on of the first electrode and the second electrode in a three-dimensional display mode to display a three-dimensional display image.

[0113] In some embodiments, the displayed image includes a three-dimensional display image, and the response module 301 is specifically used to perform image rendering in a three-dimensional display mode to generate rendered images of different perspectives; based on a preset image arrangement algorithm, the rendered images of different perspectives are processed to generate a three-dimensional display image.

[0114] In some embodiments, the head-up display device also includes an eye tracking module, which is used to collect human eye position information. The display device 300 also includes an adjustment module 303, which is used to adjust the display viewing angle of the three-dimensional display image based on the human eye position information in the three-dimensional display mode so that the display viewing angle matches the position information.

[0115] In some embodiments, the display device 300 also includes a generation module 304, which is used to obtain current scene information, the current scene information including scene objects and first scene coordinates of the scene objects in the sensor coordinate system; based on a first conversion relationship between the sensor coordinate system and the world coordinate system, converting the first scene coordinates to second scene coordinates; based on a second conversion relationship between the world coordinate system and the visual model of the head-up display device, converting the second scene coordinates to third scene coordinates; based on a third conversion relationship between the visual model and the display module, converting the third scene coordinates to fourth scene coordinates; and generating a display image based on the scene image and the fourth scene coordinates.

[0116] The above describes the device from the perspective of functional modules in conjunction with the accompanying drawings. The functional modules can be implemented in hardware form, can be implemented by instructions in software form, or can be implemented by a combination of hardware and software modules. Specifically, each step of the method implementation method in the embodiment of the present application can be completed by the hardware integrated logic circuit in the processor and / or the instructions in software form. The steps of the method disclosed in the embodiment of the present application can be directly embodied as a hardware coding processor to execute, or can be executed by a combination of hardware and software modules in the coding processor. Optionally, the software module can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps in the above method implementation method in conjunction with its hardware.

[0117] Please refer again Figure 1 The embodiment of the present application also provides an electronic device, which includes a processor 400 and a memory 500, wherein the memory 500 stores a computer program, and the computer program is executed by the processor 400. The computer program includes instructions for executing the display method of any of the above-mentioned embodiments, and can achieve the same technical effect. For the sake of brevity, it will not be repeated here.

[0118] See also Fig.17 The embodiment of the present application further provides a computer-readable storage medium 500 on which a computer program 510 is stored. When the computer program 510 is executed by a processor 520, the steps of implementing the head-up display device of any of the above-mentioned embodiments are implemented. For the sake of brevity, they are not repeated here.

[0119] In the description of this specification, the descriptions with reference to the terms "certain embodiments", "in an example", "exemplarily", etc., mean that the specific features, structures, materials or characteristics described in conjunction with the embodiments or examples are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, unless they are contradictory.

[0120] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code that includes one or more executable instructions for implementing the steps of a specific logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.

[0121] Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations on the present application. Ordinary technicians in this field can change, modify, replace and modify the above embodiments within the scope of the present application.

Claims

1. A head-up display device, characterized in that: The head-up display device includes a display module, the display module includes a liquid crystal lens array, the liquid crystal lens array includes a lens, a liquid crystal, a first electrode, and a second electrode, the liquid crystal and the lens are arranged between the first electrode and the second electrode, when the first electrode and the second electrode are not energized, the refractive index of the lens and the liquid crystal is the same, and when the first electrode and the second electrode are energized, the refractive index of the lens and the liquid crystal is different.

2. The head-up display device according to claim 1, characterized in that: The lens comprises a convex lens, and the display module further comprises a display layer, wherein the display layer is used for emitting display light, and along the emitting direction of the display light, the lens and the liquid crystal are arranged in sequence.

3. The head-up display device according to claim 2, characterized in that: When the first electrode and the second electrode are energized, the refractive index of the lens is greater than the refractive index of the liquid crystal.

4. The head-up display device according to claim 2 or 3, characterized in that: The liquid crystal includes twisted nematic liquid crystal.

5. The head-up display device according to claim 1, characterized in that: The lens includes a concave lens, and the display module also includes a display layer, which is used to emit display light. Along the emitting direction of the display light, the liquid crystal and the lens are arranged in sequence.

6. The head-up display device according to claim 5, characterized in that: When the first electrode and the second electrode are energized, the refractive index of the lens is lower than the refractive index of the liquid crystal.

7. The head-up display device according to claim 5 or 6, characterized in that: The liquid crystal includes a homeotropically aligned liquid crystal.

8. The head-up display device according to claim 1, characterized in that: The head-up display device further includes a reflector assembly, and the reflector assembly is used to reflect the display light emitted by the display module to a preset area.

9. A display method, characterized in that: For controlling the display of the head-up display device according to any one of claims 1 to 8, the method comprises: In response to a display mode, performing image rendering to obtain a display image, the display mode includes a two-dimensional display mode and a three-dimensional display mode, and the display image includes a two-dimensional display image and a three-dimensional display image; Based on the display mode, the first electrode and the second electrode are controlled to be powered on or off to display the display image.

10. The display method according to claim 9, characterized in that: The controlling the first electrode and the second electrode to be powered on or powered off based on the display mode to display the display image comprises: In the two-dimensional display mode, controlling the first electrode and the second electrode to be powered off to display the two-dimensional display image; In the three-dimensional display mode, the first electrode and the second electrode are controlled to be energized to display the three-dimensional display image.

11. The display method according to claim 9, characterized in that: The display image includes a three-dimensional display image, and the image rendering is performed on the image in response to the display mode to obtain the display image, including: In the three-dimensional display mode, performing image rendering to generate rendered images at different viewing angles; Based on a preset image arrangement algorithm, the rendered images of different viewing angles are processed to generate the three-dimensional display image.

12. The display method according to claim 11, characterized in that: The head-up display device further includes an eye tracking module, and the eye tracking module is used to collect human eye position information. The method further includes: In the three-dimensional display mode, based on the human eye position information, the display viewing angle of the three-dimensional display image is adjusted so that the display viewing angle matches the position information.

13. The display method according to claim 9, characterized in that: The display method further includes: Acquire current scene information, the current scene information including a scene object and a first scene coordinate of the scene object in a sensor coordinate system; Based on a first conversion relationship between the sensor coordinate system and the world coordinate system, converting the first scene coordinate into a second scene coordinate; Based on a second conversion relationship between the world coordinate system and the visual model of the head-up display device, converting the second scene coordinates into third scene coordinates; Based on a third conversion relationship between the visual model and the display module, converting the third scene coordinates into fourth scene coordinates; The display image is generated based on the scene image and the fourth scene coordinates.

14. An electronic device, characterized in that: include: A processor, the processor is connected to a memory; a computer program is stored in the memory, and the processor executes the computer program to implement the display method according to any one of claims 9 to 13.

15. A vehicle, characterized in that: It includes the head-up display device according to any one of claims 1 to 8 or the electronic device according to claim 14.

Images