Control method, device and vehicle

Abstract

The application provides a control method and device and a vehicle. The method comprises: acquiring a first image, the first image being an image to be projected into a first display region of a first carrier; performing distortion correction on pixel coordinates of pixel points of the first image according to a first angle to obtain a second image, the first angle being an included angle between a line connecting a user's eye and a center point of an image displayed by the first display region and a normal line of the first carrier; and controlling a projection unit to project the second image to the first display region. Through the above method, the image to be projected onto the first carrier can be corrected, so that the image display distortion is avoided, and the driving experience of the user is improved.

Description

Technical Field

[0001] This application relates to the field of intelligent vehicles, and more specifically, to a control method, device, and vehicle. Background Technology

[0002] As smart cars become increasingly common in daily life, users expect them and their related devices to provide a more comfortable and intelligent experience. Against this backdrop, windshield display technology is gaining popularity. The technical principle behind windshield display technology is to cover the windshield with a special polarizing coating, allowing the windshield to be used as a projection screen, thus providing users with a more immersive driving experience.

[0003] However, when using the windshield to display images, the surface characteristics of the windshield change significantly, and the images displayed on the windshield are prone to deformation, which in turn causes a strong sense of tilt and oppression in the image display, seriously affecting the user's driving experience and may even threaten the user's driving safety. Summary of the Invention

[0004] This application provides a control method, device, and vehicle that can correct images projected onto a first carrier, thereby avoiding image display distortion and improving the user's driving experience.

[0005] In a first aspect, a control method is provided, the method comprising: acquiring a first image, the first image being an image to be projected onto a first display area in a first carrier; performing distortion correction on the pixel coordinates of the pixels of the first image according to a first angle to obtain a second image, the first angle being the angle between the line connecting the user's eye and the center point of the image displayed in the first display area and the normal of the first carrier; and controlling a projection unit to project the second image onto the first display area.

[0006] In one possible implementation, the projection unit can be a component in a head-up display device that projects image information onto a first carrier. The image projected by the projection unit can be accurately superimposed in front of the driver's line of sight, thereby achieving a good display effect.

[0007] In one possible implementation, the first carrier could be a visual interface such as a vehicle windshield or a projection screen, used to carry and display augmented reality content, navigation information, or other visual data related to user interaction.

[0008] In one possible implementation, when the first carrier is a windshield, the first display area can be the entire area of ​​the windshield or a part of the windshield. For example, the first display area is the area of ​​the windshield that is closer to the lower edge.

[0009] In one possible implementation, the first display area may correspond to the first eye box, so that a user within the range of the first eye box can view the image within the first display area.

[0010] In one possible implementation, the distortion-corrected second image, compared to the first image, presents a visual effect of being tilted backward and stretched along a first direction, thereby making the second image closer to the visual angle perceived by the user's eyes in actual observation.

[0011] In this embodiment, distortion correction can be performed on the pixel coordinates of the first image to be projected onto the first carrier based on a first angle, and the distortion-corrected second image can be projected onto the first display area of ​​the first carrier. This avoids image distortion in the first display area, reduces the sense of tilt and pressure on the displayed image, and thus improves the user's driving experience.

[0012] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes: in response to a change in the user's eye height relative to the seat height, obtaining a second angle, the second angle being the angle between the line connecting the user's eye and the center point of the image displayed in the first display area and the normal of the first carrier; based on the second angle, performing distortion correction on the pixel coordinates of the pixels of the first image to obtain a third image, the length of the third image along the first direction being different from the length of the second image along the first direction; and controlling the projection unit to project the third image onto the first display area.

[0013] In one possible implementation, changes in the user's eye level relative to the seat height can be detected using an in-vehicle camera combined with image recognition technology.

[0014] In one possible implementation, the first direction can be the vertical or horizontal direction of the first to third images, or other spatial directions determined by the image arrangement.

[0015] In this embodiment, when the user's eye level changes relative to the seat, distortion correction can be performed on the pixel coordinates of the first image to be projected onto the first carrier based on a second angle. The resulting distortion-corrected third image is then projected onto the first display area of ​​the first carrier. This method allows the image displayed in the first display area to adapt to changes in the user's viewing angle, making the displayed image visually more consistent with the field of vision and proportions perceived by the user's eyes in actual observation, thereby further enhancing the user's immersion and driving experience.

[0016] In conjunction with the first aspect, in some implementations of the first aspect, the length of the second image along the first direction is N times the length of the first image along the first direction, and the length of the third image along the first direction is M times the length of the first image along the first direction, where N and M are greater than or equal to 1, and where M is greater than N when the second angle is greater than the first angle.

[0017] In one possible implementation, M is less than N when the second angle is less than the first angle.

[0018] In this embodiment, by associating the stretching ratio of the image displayed on the first display area with the size of the first angle and the second angle, the position, ratio, and shape of the image to be projected, after propagating through the optical path, are more accurately presented in the driver's field of vision. This enhances the intuitiveness and readability of the image displayed in the first display area, further enhancing the user's immersion and driving experience.

[0019] In conjunction with the first aspect, in some implementations of the first aspect, the first direction is the vertical direction of the image, and the image includes the first image to the third image.

[0020] In this embodiment of the application, during the process of image distortion correction, by stretching the first image in the vertical direction, the compression of the image displayed in the first display area can be effectively compensated, thereby restoring the image displayed in the first display area to a proportion that is more in line with the actual observation angle, which helps to provide users with a more natural and intuitive head-up display experience.

[0021] In conjunction with the first aspect, in some implementations of the first aspect, the distortion correction of the pixel coordinates of the pixels of the first image based on the first angle to obtain the second image includes: obtaining a third angle, wherein the third angle is the angle between the line connecting the projection unit and the center point of the image displayed in the first display area and the normal of the first carrier; determining the stretching factor based on the first angle and the third angle; and performing distortion correction on the pixel coordinates of the pixels of the first image based on the stretching factor to obtain the second image.

[0022] In one possible implementation, the stretch ratio can be determined by looking up a table or by calculating using a formula based on the first and third angles.

[0023] In one possible implementation, determining the stretch ratio can refer to the values ​​of M or N mentioned above.

[0024] In this embodiment, the stretching factor of the image in a specific direction can be accurately and efficiently determined based on the first angle and the third angle, thereby providing a precise basis for subsequent image distortion correction.

[0025] In conjunction with the first aspect, in some implementations of the first aspect, the first angle is associated with the angle between the first carrier and the ground, the distance between the user's eye and the center point of the image displayed in the first display area, the horizontal field of view of the image displayed in the first display area, and the vertical field of view of the image displayed in the first display area.

[0026] In this embodiment, the angle between the first carrier and the ground, the distance between the user's eye and the center point of the image displayed in the first display area, the horizontal field of view of the image displayed in the first display area, and the vertical field of view of the image displayed in the first display area can provide a basis for determining the value of the first angle, thereby facilitating the smooth progress of the image distortion correction process.

[0027] In conjunction with the first aspect, in some implementations of the first aspect, the first carrier is vehicle glass, the first display area is provided with a first imaging film, and the second image is imaged onto the first display area through the first imaging film.

[0028] In one possible implementation, the first imaging film can be a holographic optical element (HOE).

[0029] In one possible implementation, the HOE used as the first imaging film may include a substrate layer and a holographic recording layer. The substrate layer may be a transparent thin film material with good optical transparency and mechanical properties, which can support the recording of holograms. The holographic recording layer is located on the substrate layer and records the interference fringes of the object light wave and the reference light wave through the principle of holography to form a grating structure, thereby recording the amplitude and phase information of the light wave and determining the diffraction characteristics of the HOE.

[0030] In one possible implementation, the HOE may also include a protective layer to protect the holographic recording layer from damage by the external environment. This protective layer may be a transparent organic or inorganic material.

[0031] In this embodiment, by setting a first imaging module to image the distortion-corrected second image in the first display area, the clarity of the displayed image in the first display area can be improved, thereby further enhancing the intuitiveness and readability of the displayed image in the first display area and improving the user's head-up display experience.

[0032] In conjunction with the first aspect, in some implementations of the first aspect, the length of the first edge of the second image is determined based on the horizontal field of view of the second image and a first distance, the first edge including an upper edge or a lower edge, and the first distance being the distance between the first edge and the user's eye.

[0033] In this embodiment, the projection length of the first edge of the second image in the first display area can be accurately obtained by using the horizontal field of view of the second image and the distance between the first edge and the user's eyes. This makes the second image present a sense of size and spatial relationship consistent with the actual viewing angle in the user's field of vision, ensuring that the content displayed in the first display area maintains a sense of realism and immersion, and further enhancing the user's spatial perception and interactive experience.

[0034] In conjunction with the first aspect, in some implementations of the first aspect, the first carrier further includes a second display area, wherein the distance between the upper edge of the first display area and the lower edge of the first carrier is less than or equal to the distance between the lower edge of the second display area and the lower edge of the first carrier.

[0035] Because the first display area is closer to the lower edge of the first carrier, meaning its surface characteristics (e.g., curvature) change significantly, it is more prone to geometric distortion of the projected image after irregular refraction. In this embodiment, by correcting the distortion of the image projected from the first display area, which is closer to the lower edge of the first carrier, a good image display effect can be achieved. Furthermore, compared to correcting the distortion of the images projected from both the first and second display areas, this approach improves the efficiency of distortion correction and reduces the computational overhead of the system.

[0036] In conjunction with the first aspect, in some implementations of the first aspect, the angle between the first carrier and the ground is greater than or equal to 20 degrees and less than or equal to 40 degrees.

[0037] In one possible implementation, the tilt angle of the first carrier can refer to the angle between the tangent at a specific point on the surface of the first carrier and the ground normal.

[0038] In this embodiment, by setting the angle between the first carrier and the ground, the first carrier can better display the distortion-corrected image, ensuring that the projected second image is presented in the driver's field of vision in a more natural and intuitive way, reducing visual offset and blurriness. Furthermore, optimizing the angle between the first carrier and the ground can also reduce ambient light interference to a certain extent, improve image contrast and clarity, and ensure accurate overlay between virtual information and the real road scene, thereby enhancing the overall performance and user experience of the head-up display system.

[0039] In conjunction with the first aspect, in some implementations of the first aspect, the first image includes three-dimensional image elements.

[0040] In this embodiment, since the first image includes three-dimensional image elements, after distortion correction, the second image displayed in the first display area also retains these three-dimensional image features, thereby making the spatial structure relationship of objects in the image more realistic and accurate, and further improving the intuitiveness and readability of the content displayed in the second image.

[0041] In a second aspect, a control device is provided, comprising: an acquisition unit and a processing unit; the acquisition unit is configured to acquire a first image, the first image being an image to be projected onto a first display area in a first carrier; the processing unit is configured to: perform distortion correction on the pixel coordinates of the pixels of the first image according to a first angle to obtain a second image, the first angle being the angle between the line connecting the user's eye and the center point of the image displayed in the first display area and the normal of the first carrier; and control the projection unit to project the second image onto the first display area.

[0042] For a description of the beneficial effects of the second aspect, please refer to the description of the beneficial effects of the first aspect, which will not be repeated here.

[0043] In conjunction with the second aspect, in some implementations of the second aspect, the acquisition unit is further configured to acquire a second angle in response to changes in the user's eye height relative to the seat height, the second angle being the angle between the line connecting the user's eye and the center point of the image displayed in the first display area and the normal of the first carrier; the processing unit is further configured to: perform distortion correction on the pixel coordinates of the pixels of the first image according to the second angle to obtain a third image, the length of the third image along the first direction being different from the length of the second image along the first direction; and control the projection unit to project the third image onto the first display area.

[0044] In conjunction with the second aspect, in some implementations of the second aspect, the length of the second image along the first direction is N times the length of the first image along the first direction, and the length of the third image along the first direction is M times the length of the first image along the first direction, where N and M are greater than or equal to 1, and where M is greater than N when the second angle is greater than the first angle.

[0045] In conjunction with the second aspect, in some implementations of the second aspect, the first direction is the vertical direction of the image, and the image includes the first image to the third image.

[0046] In conjunction with the second aspect, in some implementations of the second aspect, the acquisition unit is further configured to acquire a third angle, which is the angle between the line connecting the projection unit and the center point of the image displayed in the first display area and the normal of the first carrier; the processing unit is further configured to: determine the stretching factor based on the first angle and the third angle; and perform distortion correction on the pixel coordinates of the pixels of the first image based on the stretching factor to obtain the second image.

[0047] In conjunction with the second aspect, in some implementations of the second aspect, the first angle is associated with the angle between the first carrier and the ground, the distance between the user's eye and the center point of the image displayed in the first display area, the horizontal field of view of the image displayed in the first display area, and the vertical field of view of the image displayed in the first display area.

[0048] In conjunction with the second aspect, in some implementations of the second aspect, the first carrier is vehicle glass, the first display area is provided with a first imaging film, and the second image is imaged onto the first display area through the first imaging film.

[0049] In conjunction with the second aspect, in some implementations of the second aspect, the length of the first edge of the second image is determined based on the horizontal field of view of the second image and a first distance, the first edge including an upper edge or a lower edge, and the first distance being the distance between the first edge and the user's eye.

[0050] In conjunction with the second aspect, in some implementations of the second aspect, the first carrier further includes a second display area, wherein the distance between the upper edge of the first display area and the lower edge of the first carrier is less than or equal to the distance between the lower edge of the second display area and the lower edge of the first carrier.

[0051] In conjunction with the second aspect, in some implementations of the second aspect, the angle between the first carrier and the ground is greater than or equal to 20 degrees and less than or equal to 40 degrees.

[0052] In conjunction with the second aspect, in some implementations of the second aspect, the first image includes three-dimensional image elements.

[0053] Thirdly, a projection device is provided, comprising: at least one processor and a memory, wherein the at least one processor is coupled to the memory for reading and executing instructions in the memory, such that the device implements the method in any of the implementations of the first aspect described above.

[0054] Fourthly, a computer-readable storage medium is provided, the computer-readable storage medium storing program code, which, when run on a computer, causes the computer to perform the method in any of the implementations of the first aspect described above.

[0055] Fifthly, a chip is provided, the chip including circuitry for performing the method in any of the implementations of the first aspect described above.

[0056] Sixthly, a computer program product is provided, the computer product including a computer program that, when the computer program is run by a processor, causes the method in any of the implementations of the first aspect to be executed.

[0057] In a seventh aspect, a head-up display device is provided, including the control device in any implementation of the second aspect above, or including the projection device in the third aspect.

[0058] Eighthly, a vehicle is provided, comprising: a control device according to any implementation of the second aspect above, or a projection device according to the third aspect, or a head-up display device according to the seventh aspect above. Attached Figure Description

[0059] Figure 1 This is a functional schematic diagram of a vehicle provided in an embodiment of this application;

[0060] Figure 2 This is a schematic diagram illustrating the image deformation of a baffle glass display provided in an embodiment of this application;

[0061] Figure 3 This is a schematic flowchart of a control method provided in an embodiment of this application;

[0062] Figure 4 This is a schematic diagram of a windshield tilt angle setting provided in an embodiment of this application;

[0063] Figure 5 This is a schematic diagram illustrating the stretching of an image projected onto a windshield, provided in an embodiment of this application.

[0064] Figure 6 This is a schematic diagram illustrating the determination of the longitudinal stretching factor of an image according to an embodiment of this application;

[0065] Figure 7 This is a schematic diagram illustrating distortion correction of an image projected onto a first display area of ​​a windshield, as provided in an embodiment of this application.

[0066] Figure 8 This is a schematic diagram illustrating the principle of image distortion correction provided in an embodiment of this application;

[0067] Figures 9 to 10 This is a schematic diagram of a three-dimensional image element projection process provided in an embodiment of this application;

[0068] Figure 11 This is a schematic diagram of a control device provided in an embodiment of this application;

[0069] Figure 12 This is a schematic diagram of a projection device provided in an embodiment of this application;

[0070] Figure 13 This is a schematic diagram of a display device provided in an embodiment of this application;

[0071] Figure 14This is a graph showing the relationship between the incident angle, reflectivity, and contrast of a display device according to an embodiment of this application.

[0072] Figure 15 This is a schematic diagram of another display device provided in an embodiment of this application. Detailed Implementation

[0073] The technical solutions in this application will now be described with reference to the accompanying drawings.

[0074] In the description of the embodiments of this application, unless otherwise stated, " / " means "or", for example, A / B can mean A or B; "and / or" in this document is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. In this application, "at least one" means one or more, and "more" means two or more. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or multiple items. For example, at least one of a, b, or c can represent: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple.

[0075] The use of prefixes such as "first" and "second" in this application embodiment is solely for distinguishing different descriptive objects and does not limit the position, order, priority, quantity, or content of the described objects. The use of ordinal numbers and other prefixes to distinguish descriptive objects in this application embodiment does not constitute a limitation on the described objects. The description of the described objects is found in the claims or the context of the embodiments, and the use of such prefixes should not constitute unnecessary restrictions.

[0076] The technical solutions in this application will now be described with reference to the accompanying drawings.

[0077] Figure 1 This is a functional schematic diagram of a vehicle provided in an embodiment of this application.

[0078] like Figure 1 As shown, the vehicle 100 involved in this application may include multiple subsystems, such as a perception system 120, a computing platform 130, and a head-up display device 140. Optionally, the vehicle 100 may include more or fewer subsystems, and each subsystem may include one or more components. In addition, each subsystem and component of the vehicle 100 can be interconnected via wired or wireless means.

[0079] The perception system 120 may include several sensors for sensing information about the environment surrounding the vehicle 100. For example, the perception system 120 may include a positioning system, which may be a global positioning system (GPS), a BeiDou system, or another positioning system. The perception system 120 may include one or more of the following: an inertial measurement unit (IMU), a rain sensor, a humidity and temperature sensor, a lidar, a millimeter-wave radar, an ultrasonic radar, and a camera device.

[0080] Some or all of the functions of vehicle 100 can be controlled by computing platform 130. Computing platform 130 may include processors 131 to 13n (n being a positive integer). A processor is a circuit with signal processing capabilities. In one implementation, the processor can be a circuit with instruction read and execute capabilities, such as a central processing unit (CPU), microprocessor, graphics processing unit (GPU) (which can be understood as a type of microprocessor), or digital signal processor (DSP). In another implementation, the processor can implement certain functions through the logical relationships of hardware circuits. These logical relationships are fixed or reconfigurable. For example, the processor may be a hardware circuit implemented using an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as an FPGA. In reconfigurable hardware circuits, the process of the processor loading a configuration document and configuring the hardware circuit can be understood as the process of the processor loading instructions to implement some or all of the functions of the aforementioned units. Furthermore, the processor can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (NPU), tensor processing unit (TPU), deep learning processing unit (DPU), etc. In addition, the computing platform 130 may also include a memory for storing instructions. Some or all of the processors 131 to 13n can call the instructions in the memory to implement the corresponding functions.

[0081] The computing platform 130 can control the functions of the vehicle 100 based on inputs received from various subsystems (e.g., the sensing system 120). In some embodiments, the computing platform 130 can be used to provide control over many aspects of the vehicle 100 and its subsystems.

[0082] The head-up display 140 projects vehicle-related information (such as speed, navigation, prompts, and additional information) onto the windshield as images or symbols, allowing the driver to access the necessary information without taking their eyes off the road, thus improving driving safety and convenience. This device can combine sensor data and augmented reality technology to achieve more precise display positioning and dynamic content adjustment, providing a more immersive and intelligent human-machine interaction experience.

[0083] Optionally, the above components are just an example. In actual applications, the components in each of the above modules may be added or deleted as needed.

[0084] The vehicle 100 in this application may include: road vehicles, water vehicles, air vehicles, industrial equipment, agricultural equipment, or entertainment equipment, etc. For example, vehicle 100 may be a means of transportation (such as commercial vehicles, passenger cars, motorcycles, flying cars, trains, etc.), industrial vehicles (such as forklifts, trailers, tractors, etc.), engineering vehicles (such as excavators, bulldozers, cranes, etc.), agricultural equipment (such as lawnmowers, harvesters, etc.), amusement equipment, toy vehicles, etc. The embodiments of this application do not specifically limit the type of vehicle.

[0085] As described in the background art, during the process of displaying images using the windshield, the surface characteristics of the windshield change significantly, and the image displayed on the windshield (especially in the area close to the bottom) is prone to deformation, which in turn causes a strong sense of tilt and pressure in the image display, seriously affecting the user's driving experience and may even threaten the user's driving safety.

[0086] For example, such as Figure 2As shown, during vehicle 100 operation, the user controls the head-up display (HUD) via the vehicle's infotainment system to project an image onto the windshield display area 200. The display area 200 may include display area 201 for displaying prompts; display area 202 for displaying navigation information; and display area 203 for displaying vehicle status information. Due to significant variations in the surface characteristics (e.g., curvature) of the glass in display area 203, the projected image is prone to geometric distortion after irregular refraction, resulting in visual misalignment and a strong sense of tilt and oppression in the image display. This display distortion not only causes the driver to misjudge the position and shape of the virtual image, interfering with their perception of the real road environment, but may also obstruct key areas of vision, leading to distraction or incorrect decision-making, thus seriously affecting the user's driving experience and even posing a potential threat to driving safety in complex or high-speed driving situations.

[0087] It should be noted that, Figure 2 The division of display area 200 is only an illustrative example. The size and content of display areas 201, 202 and 203 are not fixed. The display areas can be flexibly determined according to the design structure of different vehicles, the driver's field of vision requirements and actual application scenarios to ensure the rationality and practicality of the area division.

[0088] This application provides a control method, device, and vehicle that can correct images projected onto a first carrier, thereby avoiding image display distortion and improving the user's driving experience.

[0089] Figure 3 This is a schematic flowchart illustrating a control method provided in an embodiment of this application. The execution subject of method 300 can be a vehicle, or a controller in the vehicle (e.g., a microcontroller unit (MCU)). When the execution subject of method 300 is vehicle 100, it can be executed by computing platform 130 in vehicle 100, or by system-on-chip (SoC) in computing platform 130, or by processor in computing platform 130. The following describes method 300 with a controller as the execution subject. Method 300 can include steps S301 to S303.

[0090] S301, acquire the first image.

[0091] The first image is the image to be projected onto the first display area of ​​the first carrier.

[0092] Optionally, the first carrier can be a visual interface such as a vehicle windshield or a projection screen, used to carry and display augmented reality content, navigation information, or other visual data related to user interaction.

[0093] Optionally, when the first carrier is a windshield, the first display area can be the entire area of ​​the windshield or a portion of the windshield. For example, the first display area is the area of ​​the windshield closer to the lower edge (corresponding to...). Figure 2 (e.g., display area 203). For example, the first display area could be... Figure 2 The display area is 200.

[0094] Optionally, the first display area may correspond to the first eye box, so that a user within the range of the first eye box can view the image within the first display area.

[0095] In one possible implementation, the first carrier can also be a diffusion element, the specific form of which will be combined with... Figures 13 to 15 A detailed introduction will not be repeated here.

[0096] S302, based on the first angle, perform distortion correction on the pixel coordinates of the pixels in the first image to obtain the second image.

[0097] Optionally, the process of distortion correction of pixel coordinates in the first image based on the first angle may involve coordinate transformation between different planes. The detailed coordinate transformation process will be discussed in conjunction with... Figures 7 to 10 Detailed explanations are omitted here.

[0098] Optionally, the distortion-corrected second image presents a visual effect of tilting backward and stretching along the first direction compared to the first image, thereby making the second image closer to the visual angle perceived by the user's eyes in actual observation.

[0099] S303, control the projection unit to project the second image onto the first display area.

[0100] The projection unit can be a component in a head-up display device that projects image information onto a first carrier. The image projected by the projection unit can be accurately superimposed in front of the driver's line of sight, thereby achieving a good display effect.

[0101] In one possible implementation, the projection unit can also be a picture generation unit (PGU), the specific form of which will be combined with... Figures 13 to 15 A detailed introduction will not be repeated here.

[0102] Based on the above control method, distortion correction can be performed on the pixel coordinates of the first image to be projected onto the first carrier based on a first angle, and the distortion-corrected second image can be projected onto the first display area of ​​the first carrier. In this way, image distortion in the first display area can be avoided, reducing the sense of tilt and oppression of the image displayed in the first display area, thereby improving the user's driving experience.

[0103] According to some embodiments, after step S303, method 300 further includes: in response to a change in the height of the user's eye relative to the seat, obtaining a second angle, the second angle being the angle between the line connecting the user's eye and the center point of the image displayed in the first display area and the normal of the first carrier; based on the second angle, performing distortion correction on the pixel coordinates of the pixels of the first image to obtain a third image, the length of the third image along the first direction being different from the length of the second image along the first direction; and controlling the projection unit to project the third image onto the first display area.

[0104] Based on the above control method, when the user's eye level changes relative to the seat height, distortion correction can be performed on the pixel coordinates of the first image to be projected onto the first carrier based on the second angle. The resulting distortion-corrected third image is then projected onto the first display area of ​​the first carrier. In this way, the image displayed in the first display area adapts to the user's changing viewing angle, making the displayed image visually more consistent with the user's perceived field of vision and proportions in actual observation, thereby further enhancing the user's immersion and driving experience.

[0105] Optionally, changes in the user's eye level relative to the seat height can be detected using an in-vehicle camera combined with image recognition technology.

[0106] Optionally, the first direction can be the vertical or horizontal direction of the first to third images, or other spatial directions determined by the image arrangement.

[0107] According to some embodiments, the length of the second image along the first direction is N times the length of the first image along the first direction, and the length of the third image along the first direction is M times the length of the first image along the first direction, where N and M are greater than or equal to 1. Specifically, when the second angle is greater than the first angle, M is greater than N. Correspondingly, when the second angle is less than the first angle, M is less than N.

[0108] Based on the above control method, by associating the stretching ratio of the image displayed on the first display area with the size of the first angle and the second angle, the position, ratio and shape of the image to be projected after propagation through the optical path are more accurate in the driver's field of vision. This enhances the intuitiveness and readability of the image displayed in the first display area, and further enhances the user's immersion and driving experience.

[0109] According to some embodiments, the first direction is the longitudinal direction from the first image to the third image.

[0110] Based on the above control method, during the image distortion correction process, stretching the first image in the vertical direction can effectively compensate for the compression of the image displayed in the first display area, thereby visually restoring the image displayed in the first display area to a proportion that is more in line with the actual observation angle, which helps to provide users with a more natural and intuitive head-up display experience.

[0111] For example, after the distortion correction process in step S302, the vertical length of the second image obtained from the first image is 1.5 times the vertical length of the first image. When the user raises the height of the seat, the angle between the line connecting the user's eye and the center point of the image displayed in the first display area and the normal of the first carrier also increases. At this time, the third image is obtained after the distortion correction of the first image. The vertical length of the third image can be twice the vertical length of the first image.

[0112] According to some embodiments, step S302 includes: obtaining a third angle, wherein the third angle is the angle between the line connecting the projection unit and the center point of the image displayed in the first display area and the normal of the first carrier; determining the stretching factor based on the first angle and the third angle; and performing distortion correction on the pixel coordinates of the pixels of the first image based on the stretching factor to obtain a second image.

[0113] Based on the above control method, the stretching factor of the image in a specific direction can be accurately and efficiently determined based on the first angle and the third angle, thereby providing a precise basis for subsequent image distortion correction.

[0114] In this context, determining the stretch ratio can refer to the values ​​of M or N mentioned earlier.

[0115] In one possible implementation, determining the stretch ratio based on the first and third angles can be done either by looking up a table or by calculating using a formula. Calculating the stretch ratio using a formula will combine... Figure 6 A detailed introduction will not be repeated here.

[0116] According to some embodiments, in method 300, the first angle may be associated with the angle between the first carrier and the ground, the distance between the user's eye and the center point of the image displayed in the first display area, the horizontal field of view of the image displayed in the first display area, and the vertical field of view of the image displayed in the first display area.

[0117] Based on the above control method, the angle between the first carrier and the ground, the distance between the user's eye and the center point of the image displayed in the first display area, the horizontal field of view of the image displayed in the first display area, and the vertical field of view of the image displayed in the first display area can provide a basis for determining the value of the first angle, thereby facilitating the smooth progress of the image distortion correction process.

[0118] For example, once the angle between the first carrier and the ground, the distance between the user's eye and the center point of the image displayed in the first display area, the horizontal field of view of the image displayed in the first display area, and the vertical field of view of the image displayed in the first display area are determined, the value of the first angle can be determined based on the values ​​of the above parameters, thereby performing distortion correction on the first image.

[0119] According to some embodiments, in method 300, when the first carrier is vehicle glass, the first display area may be provided with a first imaging film. At this time, the second image projected by the projection unit can be imaged on the first display area through the first imaging film.

[0120] Based on the above control method, by setting the first imaging module to image the distortion-corrected second image in the first display area, the clarity of the displayed image in the first display area can be improved, thereby further enhancing the intuitiveness and readability of the displayed image in the first display area and improving the user's head-up display experience.

[0121] Optionally, the first carrier can be the windshield of a vehicle.

[0122] Optionally, the first imaging film can be a HOE.

[0123] Optionally, the HOE used as the first imaging film may include a substrate layer and a holographic recording layer. The substrate layer is usually a transparent thin film material with good optical transparency and mechanical properties, which can support the recording of holograms. The holographic recording layer is located on the substrate layer and records the interference fringes of the object light wave and the reference light wave through the principle of holography to form a grating structure, thereby recording the amplitude and phase information of the light wave and determining the diffraction characteristics of the HOE.

[0124] Optionally, the HOE may also include a protective layer to protect the holographic recording layer from damage by the external environment. This protective layer may be a transparent organic or inorganic material.

[0125] According to some embodiments, the length of the first edge of the second image is determined based on the horizontal field of view of the second image and a first distance. The first edge includes an upper edge or a lower edge, and the first distance is the distance between the first edge and the user's eye.

[0126] Based on the above control method, the projection length of the first edge of the second image in the first display area can be accurately obtained by using the horizontal field of view of the second image and the distance between the first edge and the user's eyes. This makes the second image present a sense of size and spatial relationship consistent with the actual viewing angle in the user's field of vision, ensuring that the content displayed in the first display area maintains a sense of realism and immersion, and further enhancing the user's spatial perception and interactive experience.

[0127] For example, please refer to Figure 2 The display area 200 of the windshield is used to display a second image. The display area 200 includes an upper edge 204 and a lower edge 205. The upper edge 204 may coincide with the upper edge of the second image, and the lower edge 204 may coincide with the lower edge of the second image. The length of the upper edge of the second image may be equal to the distance between the upper edge of the second image and the user's eye multiplied by the horizontal field of view of the user's eye, and the length of the lower edge of the second image may be equal to the distance between the lower edge of the second image and the user's eye multiplied by the horizontal field of view of the user's eye.

[0128] Optionally, the length of the upper edge of the second image can be the same as or different from the length of the lower edge.

[0129] According to some embodiments, the first carrier further includes a second display area, wherein the distance between the upper edge of the first display area and the lower edge of the first carrier is less than or equal to the distance between the lower edge of the second display area and the lower edge of the first carrier.

[0130] Because the first display area is closer to the lower edge of the first carrier, its surface characteristics (e.g., curvature) change significantly, making it more susceptible to geometric distortion of the projected image after irregular refraction. Based on the aforementioned control method, by correcting the distortion of the image projected from the first display area, which is closer to the lower edge of the first carrier, a good image display effect can be achieved. Furthermore, compared to correcting the distortion of images projected from both the first and second display areas, this approach improves the efficiency of distortion correction and reduces the computational overhead of the system.

[0131] For example, the first display area may be Figure 2 The second display area can be the display area 203 in the middle. Figure 2 The display area 202, or the first display area, can be... Figure 2 The second display area can be the display area 203 in the middle. Figure 2The display area 201, or the first display area, can be... Figure 2 The first display area can be either display area 203 or display area 202. Figure 2 Display area 201 in the middle.

[0132] According to some embodiments, in method 300, the angle between the first carrier and the ground is greater than or equal to 20 degrees and less than or equal to 40 degrees.

[0133] Based on the aforementioned control method, by setting the angle between the first carrier and the ground, the first carrier can better display the distortion-corrected image, ensuring that the projected second image is presented in the driver's field of vision in a more natural and intuitive way, reducing visual offset and blurriness. Furthermore, optimizing the angle between the first carrier and the ground can also reduce ambient light interference to some extent, improve image contrast and clarity, and ensure accurate overlay between virtual information and the real road scene, thereby enhancing the overall performance and user experience of the head-up display system.

[0134] Optionally, the tilt angle of the first carrier can refer to the angle between the tangent at a specific point on the surface of the first carrier and the ground normal.

[0135] For example, Figure 4 This is a schematic diagram illustrating a windshield tilt angle setting according to an embodiment of this application, such as... Figure 4 As shown, the vehicle 100 may include a windshield 101, and the tilt angle of the windshield 101 may be set to 20° to 40°, thereby enabling the windshield to better display the distortion-corrected image.

[0136] According to some embodiments, in method 300, the first image includes three-dimensional image elements, and correspondingly, the second image obtained after distortion correction also includes three-dimensional image elements.

[0137] In this embodiment, since the first image includes three-dimensional image elements, after distortion correction, the second image displayed in the first display area also retains these three-dimensional image features, thereby making the spatial structure relationship of objects in the image more realistic and accurate, and further improving the intuitiveness and readability of the content displayed in the second image.

[0138] It should be understood that, in the various embodiments of this application, unless otherwise specified or in case of logical conflict, the terms and / or descriptions between the various embodiments are consistent and can be referenced by each other, and the technical features in different embodiments can be combined to form new embodiments according to their inherent logical relationships.

[0139] The following is combined Figure 5 and Figure 6The method 300 is explained in detail, including the calculation principle of the longitudinal stretching effect and stretching factor of the second image after distortion correction relative to the first image.

[0140] Figure 5 This is a schematic diagram illustrating the stretching of an image projected onto a windshield, as provided in an embodiment of this application.

[0141] like Figure 5 As shown, the first image to be projected onto the windshield includes: a prompt interface 510 and a function interface 520. The prompt interface 510 is used to prompt the user that "the road ahead is XX Road, please keep going straight, the speed limit is 80 km / h". The function interface 520 includes: icons 521 on the central control screen desktop, an internal air circulation icon 522, a driver's seat heating function icon 523, a driver's area air conditioning temperature display icon 524, a passenger's area air conditioning temperature display icon 525, a passenger's seat heating function icon 526, and a volume setting icon 527.

[0142] When performing distortion correction on the projected image, the prompt interface 510 and the function interface 520 can be stretched vertically, and the stretched second image is projected onto the first display area 500. Figure 4 As can be seen, after being stretched vertically by N times, the vertical length of the text and icons in both the prompt interface 510 and the function interface 520 increases. This effectively reduces the sense of tilt and oppression in the image displayed on the windshield projection area, improving the user's visual experience.

[0143] Optionally, when stretching the image to be projected vertically, the image can be enlarged proportionally according to the stretch factor.

[0144] Figure 6 This is a schematic diagram illustrating the determination of the longitudinal stretching factor of an image according to an embodiment of this application, such as... Figure 6 As shown, θ1 is the tilt angle of the windshield, θ2 is the incident angle, θ3 is the reflection angle, L1 is the distance between the user's eye and the center point of the distortion-corrected image 602, L2 is the distance between the head-up display and the center point of the distortion-corrected image 602, W3 is the longitudinal length of the image 602 before distortion correction, and L3 is the lateral length of the image 602 before distortion correction. The incident angle can be the angle between the line connecting the head-up display and the center point of the distortion-corrected image 602 and the normal to the windshield, corresponding to the third angle in method 300; the reflection angle can be the angle between the line connecting the user's eye and the center point of the distortion-corrected image 602 and the normal to the windshield, corresponding to the first angle in method 300.

[0145] At this point, the stretch ratio N can be calculated using the following formula:

[0146]

[0147] For example, when Figure 6 When the parameters are shown in Table 1, the stretching ratio N = cos30° / cos47° = 1.27.

[0148] Table 1

[0149] numerical values 40 30 47 620 400 280 106 unit Deg. Deg. Deg. mm mm mm mm

[0150] After determining the stretch factor, distortion correction can be performed on the pixel coordinates of the pixels in the first image based on the stretch factor to obtain the second image. For example, in Figure 6 In the process, after distortion correction of image 601 (which can correspond to the first image) based on the stretching factor, image 602 (which can correspond to the second image) can be obtained. Since image 602 has been stretched vertically, the visual effect of the image is more in line with the field of vision and proportion relationship perceived by the user's eyes in actual observation, thereby further enhancing the user's sense of immersion and driving experience.

[0151] Optionally, once the head-up display device is fixed, the value of θ2 can be determined accordingly; the value of θ3 can be determined based on θ1, L1, the horizontal field of view of the second image 602, and the vertical field of view of the second image 602.

[0152] The following is combined Figure 7 and Figure 8 The method 300 provides a detailed explanation of the display effect of the second image and the distortion correction process, including the conversion process of pixel coordinates.

[0153] Figure 7 This is a schematic diagram illustrating distortion correction of an image projected onto a first display area of ​​a windshield, as provided in an embodiment of this application. Figure 7 As shown in (a), the image projected by the projection unit onto the first display area 700 of the windshield is a first image 701. The first image 701 shows that the vehicle 100 is currently traveling at a speed of 60 km / h, the current road speed limit is 80 km / h, other vehicles (trucks and pickup trucks) are traveling on the road to the right of the vehicle 100, and the remaining distance to the destination is 2 km. Without distortion correction for the first image 701, the display effect of the first display area is as follows: Figure 7 As shown in (b) above, the first image 701 has been deformed, resulting in a tilted and oppressive appearance in its display. After distortion correction of the first image 701, as shown in (b) above, the distortion is corrected. Figure 7As shown in (c), the obtained second image 702 is tilted backward compared to the windshield 703, making the display of the second image 702 closer to the driver's natural viewing angle, thereby reducing the sense of tilt and oppression in the image display. Furthermore, the second image 702 does not undergo deformation, resulting in a more natural and comfortable display effect, and improving the overall readability and user experience of the image display.

[0154] Figure 8 This is a schematic diagram of the principle of image distortion correction provided in an embodiment of this application. The goal of the entire distortion correction process is to map the distorted image (located on plane 801, which can correspond to the first image in method 300) onto an ideal display plane (plane 802) through geometric transformation, thereby obtaining the distortion-corrected image (which can correspond to the second image in method 300), making it more consistent with the natural image effect seen by the user from a specified observation point (point O, i.e., the user's eye position).

[0155] like Figure 8 As shown, the process of transforming the distorted image on plane 801 to the distorted corrected image on plane 802 can be achieved by the following formula:

[0156]

[0157]

[0158] Where (x, y) are the pixel coordinates of the distorted image, (x′, y′) are the pixel coordinates of the distorted image, and a to f are perspective transformation parameters describing the geometric mapping relationship between the two planes. To solve for these perspective transformation parameters, at least four pairs of spatially known corresponding pixel points can be provided, for example, Figure 8 The four pairs of corresponding points A-A', B-B', C-C', and D-D' shown are located at specific positions in the original distorted image and the image after distortion correction, respectively. Using the spatial coordinates of these four pairs of points, a set of linear equations can be established to solve for the perspective transformation parameters a to f.

[0159] Optionally, the positions of these corresponding points are not arbitrarily chosen, but should be reasonably set based on the user's viewing angle (e.g., the user's horizontal field of view, vertical field of view, and distance from the user's eyes to plane 802) and the actual hardware layout (e.g., the angle of the light projected by the head-up display, the tilt angle of the windshield, and the seat position).

[0160] The following is combined Figure 9 and Figure 10 The process of distortion correction of the first image, which includes three-dimensional image elements, in method 300 is described in detail. Figures 9 to 10 This is a schematic diagram of a three-dimensional image element projection process provided in an embodiment of this application.

[0161] like Figure 9 As shown, the frustum formed by the near plane and the far plane can be called a cone, representing the visible range of the user's eye. The three-dimensional image element 901 in the cone (represented by three-dimensional coordinates) can be projected onto the near plane (represented by two-dimensional coordinates) through perspective transformation. The near plane can correspond to the first display area in method 300.

[0162] like Figure 10 As shown, the second image projected onto the windshield by the projection unit 902 includes a three-dimensional image element 901. After distortion correction, the three-dimensional image element 901 retains the three-dimensional image features, thereby making the spatial structure relationship of objects in the image more realistic and accurate, and further improving the intuitiveness and readability of the content displayed in the second image.

[0163] It should be noted that, Figure 9 and Figure 10 The shapes of the 3D image elements and the positions of the projection units shown are merely illustrative examples. Those skilled in the art can make appropriate changes to the relevant structures or positions according to specific application scenarios or optimization needs.

[0164] Figure 11 This is a schematic diagram of a control device provided in an embodiment of this application. The device 1100 may include an acquisition unit 1110, a storage unit 1120, and a processing unit 1130. The acquisition unit 1110 is used to acquire instructions and / or data. The storage unit 1120 is used to implement corresponding storage functions and store corresponding instructions and / or data. The processing unit 1130 is used to perform data processing so that the device 1100 implements the aforementioned control method.

[0165] In one embodiment, the device 1100 includes: an acquisition unit 1110 and a processing unit 1130; the acquisition unit 1110 is used to acquire a first image, the first image being an image to be projected onto a first display area in a first carrier; the processing unit 1130 is used to: perform distortion correction on the pixel coordinates of the pixels of the first image according to a first angle to obtain a second image, the first angle being the angle between the line connecting the user's eye and the center point of the image displayed in the first display area and the normal of the first carrier; and control the projection unit to project the second image onto the first display area.

[0166] In one possible implementation, the acquisition unit 1110 is further configured to acquire a second angle in response to changes in the user's eye height relative to the seat height. The second angle is the angle between the line connecting the user's eye and the center point of the image displayed in the first display area and the normal of the first carrier. The processing unit 1130 is further configured to: perform distortion correction on the pixel coordinates of the pixels of the first image according to the second angle to obtain a third image, wherein the length of the third image along the first direction is different from the length of the second image along the first direction; and control the projection unit to project the third image onto the first display area.

[0167] In one possible implementation, the length of the second image along the first direction is N times the length of the first image along the first direction, and the length of the third image along the first direction is M times the length of the first image along the first direction, where N and M are greater than or equal to 1, and M is greater than N when the second angle is greater than the first angle.

[0168] In one possible implementation, the first direction is the vertical direction of the image, and the image includes a first image to a third image.

[0169] In one possible implementation, the acquisition unit 1110 is further configured to acquire a third angle, which is the angle between the line connecting the center point of the projection unit and the image displayed in the first display area and the normal of the first carrier; the processing unit 1130 is further configured to: determine the stretching factor based on the first angle and the third angle; and perform distortion correction on the pixel coordinates of the pixels of the first image based on the stretching factor to obtain the second image.

[0170] In one possible implementation, the first angle is associated with the angle between the first carrier and the ground, the distance between the user's eye and the center point of the image displayed in the first display area, the horizontal field of view of the image displayed in the first display area, and the vertical field of view of the image displayed in the first display area.

[0171] In one possible implementation, the first carrier is vehicle glass, the first display area is provided with a first imaging film, and the second image is imaged onto the first display area through the first imaging film.

[0172] In one possible implementation, the length of the first edge of the second image is determined based on the horizontal field of view of the second image and a first distance, the first edge including an upper edge or a lower edge, and the first distance being the distance between the first edge and the user's eye.

[0173] In one possible implementation, the first carrier further includes a second display area, wherein the distance between the upper edge of the first display area and the lower edge of the first carrier is less than or equal to the distance between the lower edge of the second display area and the lower edge of the first carrier.

[0174] In one possible implementation, the angle between the first carrier and the ground is greater than or equal to 20 degrees and less than or equal to 40 degrees.

[0175] In one possible implementation, the first image includes three-dimensional image elements.

[0176] Figure 12 This is a schematic diagram of a projection device provided in an embodiment of this application.

[0177] The device 1200 includes a memory 1210, a processor 1220, and a communication interface 1230. The memory 1210, processor 1220, and communication interface 1230 are connected via an internal connection path. The memory 1210 stores instructions, and the processor 1220 executes the instructions stored in the memory 1210 to control the communication interface 1230 to acquire information, thereby enabling the device 1200 to implement the aforementioned control method. Optionally, the memory 1210 can be coupled to the processor 1220 via an interface, or it can be integrated with the processor 1220.

[0178] It should be noted that the communication interface 1230 described above uses a transceiver device, such as, but not limited to, a transceiver. The communication interface 1230 may also include an input / output interface.

[0179] The processor 1220 stores one or more computer programs, which include instructions. When the instructions are executed by the processor 1220, the control device 1200 performs the control methods described in the above embodiments.

[0180] In implementation, each step of the above method can be completed by the integrated logic circuitry of the hardware in the processor 1220 or by instructions in software form. The method disclosed in the embodiments of this application can be directly implemented by a hardware processor, or by a combination of hardware and software modules in the processor. The software modules can reside in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other mature storage media in the art. This storage medium is located in memory 1210, and the processor 1220 reads the information in memory 1210 and, in conjunction with its hardware, completes the steps of the above method. To avoid repetition, detailed descriptions are not provided here.

[0181] Optionally, Figure 12 The communication interface 1230 in the middle can achieve Figure 11 The acquisition unit 1110 in the middle, Figure 12 The processor 1220 in the middle can achieve Figure 11 The processing unit 1130 in the middle.

[0182] Figure 13 This is a schematic diagram of a display device provided in an embodiment of this application. Figure 14 This is a graph showing the relationship between the incident angle, reflectivity, and contrast of a display device according to an embodiment of this application; Figure 14 In the diagram, the horizontal axis represents the angle of incidence, the left vertical axis represents the reflectivity of the light, and the right vertical axis represents the contrast between the image and the ghost image. R1 illustrates the relationship between the reflectivity of S-polarized light and the angle of incidence, R2 illustrates the relationship between the reflectivity of P-polarized light and the angle of incidence, and R3 illustrates the contrast curve between the image and the ghost image.

[0183] In view of this, embodiments of this application provide a display device, see below. Figure 13 The display device includes a transparent display element 1320. The imaging light incident on the transparent display element 1320 is P-polarized light, and at a certain incident angle (e.g., Figure 13 Within the range shown in (a) (e.g.) Figure 14 As shown), P-polarized light has low reflectivity, which reduces ghosting, thereby decreasing the contrast between the image and the ghosting, and thus reducing the impact of ghosting on the image and improving the display effect. Furthermore, the imaging light incident on the transparent display 1320 does not include S-polarized light, so there is no S-polarized light scattering. At the same time, the scattering brightness of P-polarized light is low, which reduces the angle between the imaging light incident on the transparent display 1320 and the viewing light when the user views from the outside of the transparent display 1320 inwards (e.g., ...). Figure 13 When the value (as shown in b) is greater than a certain value, it prevents the user from seeing the image formed by the imaging light from the outside of the transparent display 1320, thus enabling single-sided display. Furthermore, the transparent display 1320 has transparent properties, allowing it to project ambient light into the user's eyes, enabling the user to see the image formed by the imaging light while simultaneously seeing the real environment through the transparent display 1320.

[0184] like Figure 13 As shown, the display device includes an image generation unit 1310 (which may correspond to the projection unit in method 300) and a transparent display element 1320. The image generation unit 1310 generates imaging light containing image information. The transparent display element 1320 transmits ambient light to the human eye and receives the imaging light. The imaging light incident on the transparent display element 1320 is P-polarized light. The transparent display element 1320 includes a diffusion element 1321 (which may correspond to the first carrier in method 300) and a transparent carrier 1322. The transparent carrier 1322 carries the diffusion element 1321, which diffuses the imaging light and projects the diffused imaging light to the human eye.

[0185] The diffusion element 1321 can also be attached to the surface of the transparent carrier 1322, which can reduce the difficulty of connecting the diffusion element 1321 and the transparent carrier 1322, and reduce the production difficulty and production cost of the transparent display component 1320.

[0186] In some embodiments, the transparent display 1320 includes only the diffusion element 1321.

[0187] In some embodiments, such as Figure 13 As shown, the diffusion element 1321 can be a reflective diffusion element, which is used to diffuse the imaging light and reflect the diffused imaging light to the human eye to form an image.

[0188] In some embodiments, the diffusion element 1321 may be a transmissive diffusion element, which is used to diffuse the imaging light and transmit the diffused imaging light to the human eye to form an image.

[0189] In this embodiment, the transparent display element 1320 has transparent properties, such as... Figure 13 As shown, the ambient light (such as) on the side opposite the transparent display 1320 Figure 13 The light (as indicated by the dashed arrow) enters the human eye through the transparent display 1320, allowing the human eye to see the real environment (e.g., the real world). Figure 13 (The tree in the image) achieves transparent display. At the same time, the diffuser element 1320 reflects the diffused imaging light to the human eye, allowing the user to see the real environment while simultaneously seeing the image formed by the imaging light.

[0190] In the prior art, ghosting is formed by imaging light including P-polarized light and S-polarized light. In this embodiment, the imaging light incident on the transparent display 1320 is P-polarized light, see [link to previous document]. Figure 13 As shown, at a certain incident angle (such as...) Figure 13 Within the range shown in (a), P-polarized light has low reflectivity, which can reduce ghosting, decrease the contrast between the image and the ghosting, reduce the impact of ghosting on the image, and improve the display effect.

[0191] Specifically, in Figure 13 In this context, ghosting is formed by the imaging light reflected from the interface between the transparent carrier 1322 and the air, reaching the human eye. Because P-polarized light is incident at a certain angle at the interface between the transparent carrier 1322 and the air, it can cause ghosting on the outer surface of the transparent carrier 1322 (e.g., ...). Figure 13 The ghosting formed by the imaging light reflected to the human eye from the interface between the inner and outer surfaces of the transparent carrier 1322 and the air is smaller, which reduces the contrast between the image and the ghosting formed by the imaging light reflected to the human eye from the diffusion element 1321 and improves the display effect.

[0192] In some possible implementations, the incident angle of the imaging light incident on the transparent display 1320 (e.g. Figure 13(As shown in a) The incident angle is greater than or equal to 25° and less than or equal to 68°, and is the angle between the normal of the transparent display 1320 and the imaging light incident on the transparent display 1320.

[0193] Thus, as Figure 14 As shown, P-polarized light has extremely low reflectivity, resulting in minimal or no ghosting, thus further reducing the impact of ghosting on the image.

[0194] See Figure 14 As shown, when the incident angle of P-polarized light incident on the transparent display 1320 is equal to the Brewster angle, the reflectivity of P-polarized light is zero, and no ghosting will be formed. The contrast between the image and the ghosting is zero, which can solve the ghosting problem.

[0195] See Figure 14 As shown, when the incident angle of the P-polarized light incident on the transparent display 1320 is closer to the Brewster angle, the reflectivity of the P-polarized light is smaller, and therefore less P-polarized light is reflected to the human eye, resulting in less ghosting and thus less contrast between the image and the ghosting.

[0196] In some possible implementations, such as Figure 15 As shown, along the thickness direction of the transparent display element 1320, the reflective element 1330 and the image generation unit 1310 are located on opposite sides of the transparent display element 1320. This allows the display device to be arranged in different scenarios, expanding its application range.

[0197] In some possible implementations, the imaging light generated by the image generation unit 1310 is P-polarized light, which can reduce the number of parts in the display device and lower the cost of the image display device.

[0198] It can be understood that the image generation unit 1310 that generates P-polarized light can also be called a P-polarized light optical engine. The P-polarized light optical engine is used to generate P-polarized light and filter other light rays, such as S-polarized light. Any device that can generate P-polarized light belongs to the P-polarized light optical engine in this embodiment.

[0199] In one embodiment, the P-polarized light optical engine can be an LCoS (liquid crystal on silicon) image generating device. The LCOS image generating device modulates the polarization state through a silicon-based reflective liquid crystal layer: after incident P-polarized light (linearly polarized) penetrates the liquid crystal layer, the liquid crystal molecules are voltage-controlled to change their polarization direction; the light reflected to the silicon substrate passes through the liquid crystal layer a second time, and the polarization state is precisely modulated. Finally, a polarizer filters out specific P-polarized light components to achieve the purpose of projecting P-polarized light onto the transparent display device 1320. The P-polarized light optical engine in this embodiment can reduce light loss and support ultra-high resolution and precise phase modulation.

[0200] In one embodiment, the P-polarized optical engine includes an image generating device and a polarizing filter. The polarizing filter converts the polarization state of the light beam emitted from the image generating device into a P-polarized state. When the light beam emitted from the image generating device passes through the polarizing filter, only the P-polarized light aligned with the transmission axis of the polarizing filter passes through, while other polarization components are blocked. Therefore, by setting the polarizing filter, P-polarized light can be filtered out to achieve the purpose of projecting P-polarized light onto the diffusion element 1321. The P-polarized optical engine in this embodiment has high contrast, high response speed, and strong resistance to ambient light.

[0201] In one embodiment, the P-polarized optical engine includes an image generating device and a waveplate. The waveplate is used to convert the polarization state of the light beam emitted from the image generating device into a P-polarized state. When the light beam emitted from the image generating device passes through the waveplate, the waveplate changes the polarization direction of the light beam emitted from the image generating device, making the polarization direction of the light beam the same as that of the P-polarized light. Therefore, by setting the waveplate, the purpose of projecting P-polarized light onto the diffusion element 1321 can be achieved. In addition, the P-polarized optical engine in this embodiment has high contrast, high response speed, and strong resistance to ambient light.

[0202] In one embodiment, the P-polarized light engine can also be an image generation module LCD. The LCD is based on transmissive liquid crystal polarization control: the unpolarized light from the backlight is converted into P-polarized light by a front polarizer, and the liquid crystal molecules change the polarization direction of the light according to the twist angle of the electrical signal; the rear polarizer (analyzer) only allows light with the same direction as the original P-polarized light to pass through, while the other components are blocked, so as to achieve the purpose of projecting P-polarized light onto the transparent display 1320. The P-polarized light engine in this embodiment is low in cost, technologically mature, and easy to integrate with transmissive polarization modulation.

[0203] In some possible implementations, the imaging light generated by the image generation unit 1310 is not P-polarized light; for example, the imaging light generated by the image generation unit 1310 can be S-polarized light. In this case, the display device also includes a polarization converter disposed in the optical path between the image generation unit 1310 and the transparent display element 1320. The polarization converter is used to convert the polarization state of the imaging light from the image generation unit 1310 to a P-polarized state and project the converted imaging light onto the transparent display element 1320.

[0204] For example, the image generation unit 1310 generates S-polarized light, and the polarization conversion element can be a half-wave plate to convert P-polarized light into S-polarized light.

[0205] This application also provides a computer-readable storage medium storing program code that, when executed on a computer, causes the computer to perform the above-described... Figure 3The control method shown is illustrated.

[0206] This application also provides a computer program product, which includes a computer program that, when run, causes the computer to perform the above-described actions. Figure 3 The control method shown.

[0207] This application embodiment also provides a chip, including: a circuit, the circuit being used to perform the above... Figure 3 The control method shown is illustrated.

[0208] This application also provides a head-up display device, including, as in the following embodiments: Figure 11 The control device, or includes, for example, Figure 12 The aforementioned projection device.

[0209] This application embodiment also provides a vehicle, which includes: the above-mentioned head-up display device, or includes, for example, the aforementioned head-up display device. Figure 11 The control device, or includes, for example, Figure 12 The projection device, or includes, for example, the projection device. Figure 13 or Figure 15 The display device in the middle.

[0210] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0211] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0212] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0213] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0214] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0215] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0216] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A control method, characterized in that, The method includes: Acquire a first image, which is an image to be projected onto a first display area in a first carrier; Based on the first angle, the pixel coordinates of the first image are distorted to obtain the second image. The first angle is the angle between the line connecting the user's eye and the center point of the image displayed in the first display area and the normal of the first carrier. The control projection unit projects the second image onto the first display area.

2. The method as described in claim 1, characterized in that, The method further includes: In response to the change in the user's eye height relative to the seat, a second angle is obtained, which is the angle between the line connecting the user's eye and the center point of the image displayed in the first display area and the normal of the first carrier; Based on the second angle, the pixel coordinates of the pixels in the first image are distorted to obtain a third image, wherein the length of the third image along the first direction is different from the length of the second image along the first direction. The projection unit is controlled to project the third image onto the first display area.

3. The method as described in claim 2, characterized in that, The length of the second image along the first direction is N times the length of the first image along the first direction, and the length of the third image along the first direction is M times the length of the first image along the first direction, where N and M are greater than or equal to 1, and M is greater than N when the second angle is greater than the first angle.

4. The method as described in claim 2 or 3, characterized in that, The first direction is the vertical direction of the image, and the image includes the first image to the third image.

5. The method according to any one of claims 1 to 4, characterized in that, The step of correcting the distortion of the pixel coordinates of the pixels in the first image according to the first angle to obtain the second image includes: Obtain a third angle, which is the angle between the line connecting the center point of the projection unit and the center point of the image displayed in the first display area and the normal of the first carrier; The stretch ratio is determined based on the first angle and the third angle; Based on the stretching factor, the pixel coordinates of the pixels in the first image are distorted to obtain the second image.

6. The method according to any one of claims 1 to 5, characterized in that, The first angle is associated with the angle between the first carrier and the ground, the distance between the user's eye and the center point of the image displayed in the first display area, the horizontal field of view of the image displayed in the first display area, and the vertical field of view of the image displayed in the first display area.

7. The method according to any one of claims 1 to 6, characterized in that, The first carrier is vehicle glass, and the first display area is provided with a first imaging film. The second image is imaged onto the first display area through the first imaging film.

8. The method according to any one of claims 1 to 7, characterized in that, The length of the first edge of the second image is determined based on the horizontal field of view and the first distance of the second image. The first edge includes an upper edge or a lower edge, and the first distance is the distance between the first edge and the user's eye.

9. The method according to any one of claims 1 to 8, characterized in that, The first carrier further includes a second display area, wherein the distance between the upper edge of the first display area and the lower edge of the first carrier is less than or equal to the distance between the lower edge of the second display area and the lower edge of the first carrier.

10. The method according to any one of claims 1 to 9, characterized in that, The angle between the first carrier and the ground is greater than or equal to 20 degrees and less than or equal to 40 degrees.

11. The method according to any one of claims 1 to 10, characterized in that, The first image includes three-dimensional image elements.

12. A control device, characterized in that, The device includes: an acquisition unit and a processing unit; The acquisition unit is used to acquire a first image, which is an image to be projected onto a first display area in a first carrier; The processing unit is used for: Based on the first angle, the pixel coordinates of the first image are distorted to obtain the second image. The first angle is the angle between the line connecting the user's eye and the center point of the image displayed in the first display area and the normal of the first carrier. The control projection unit projects the second image onto the first display area.

13. The apparatus as claimed in claim 12, characterized in that, The acquisition unit is further configured to acquire a second angle in response to a change in the height of the user's eye relative to the seat. The second angle is the angle between the line connecting the user's eye and the center point of the image displayed in the first display area and the normal of the first carrier. The processing unit is further configured to: Based on the second angle, the pixel coordinates of the pixels in the first image are distorted to obtain a third image, wherein the length of the third image along the first direction is different from the length of the second image along the first direction. The projection unit is controlled to project the third image onto the first display area.

14. The apparatus as claimed in claim 13, characterized in that, The length of the second image along the first direction is N times the length of the first image along the first direction, and the length of the third image along the first direction is M times the length of the first image along the first direction, where N and M are greater than or equal to 1, and M is greater than N when the second angle is greater than the first angle.

15. The apparatus as claimed in claim 13 or 14, characterized in that, The first direction is the vertical direction of the image, and the image includes the first image to the third image.

16. The apparatus as claimed in any one of claims 12 to 15, characterized in that, The acquisition unit is further configured to acquire a third angle, which is the angle between the line connecting the center point of the projection unit and the center point of the image displayed in the first display area and the normal of the first carrier. The processing unit is further configured to: The stretch ratio is determined based on the first angle and the third angle; Based on the stretching factor, the pixel coordinates of the pixels in the first image are distorted to obtain the second image.

17. The apparatus as claimed in any one of claims 12 to 16, characterized in that, The first angle is related to the angle between the first carrier and the ground, the distance between the user's eye and the center point of the image displayed in the first display area, the horizontal field of view of the image displayed in the first display area, and the vertical field of view of the image displayed in the first display area.

18. The apparatus as claimed in any one of claims 12 to 17, characterized in that, The first carrier is vehicle glass, and the first display area is provided with a first imaging film. The second image is imaged onto the first display area through the first imaging film.

19. The apparatus as claimed in any one of claims 12 to 18, characterized in that, The length of the first edge of the second image is determined based on the horizontal field of view and the first distance of the second image. The first edge includes an upper edge or a lower edge, and the first distance is the distance between the first edge and the user's eye.

20. The apparatus as claimed in any one of claims 12 to 19, characterized in that, The first carrier further includes a second display area, wherein the distance between the upper edge of the first display area and the lower edge of the first carrier is less than or equal to the distance between the lower edge of the second display area and the lower edge of the first carrier.

21. The apparatus as claimed in any one of claims 12 to 20, characterized in that, The angle between the first carrier and the ground is greater than or equal to 20 degrees and less than or equal to 40 degrees.

22. The apparatus as claimed in any one of claims 12 to 21, characterized in that, The first image includes three-dimensional image elements.

23. A projection device, characterized in that, The device includes a processor and a memory, the processor being coupled to the memory, the memory being used to store computer programs or instructions, and the processor being used to execute the computer programs or instructions in the memory, such that the method of any one of claims 1 to 11 is performed.

24. A chip, characterized in that, The chip includes circuitry for performing the method as described in any one of claims 1 to 11.

25. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores program code that, when executed on a computer, causes the computer to perform the method as described in any one of claims 1 to 11.

26. A computer program product, characterized in that, The computer product includes a computer program that, when run, causes the computer to perform the method as described in any one of claims 1 to 11.

27. A head-up display device, characterized in that, The device includes a control device as described in any one of claims 12 to 22, or a projection device as described in claim 23.

28. A vehicle, characterized in that, The vehicle includes the control device as described in any one of claims 12 to 22, or includes the projection device as described in claim 23, or includes the head-up display device as described in claim 27.

Images