An image display method and related equipment

Abstract

This application relates to an image display method and related equipment. The method includes: determining an initial pixel allocation method for a liquid crystal display (LCD) screen based on left-eye and right-eye images to be displayed; the initial pixel allocation method includes the initial light emission state of each pixel on the LCD screen; the LCD screen includes distorted pixel regions and non-distorted pixel regions; translating and adjusting the initial pixel allocation method based on a preset direction to obtain an adjusted pixel allocation method; determining a target pixel allocation method for the LCD screen based on the initial light emission state of each pixel in the non-distorted pixel regions and the adjusted light emission state of each pixel in the distorted pixel regions; and illuminating the LCD screen based on the target pixel allocation method, so that the light emitted from the LCD screen is split by a beam splitter to form left-eye and right-eye virtual images. The image display method of this application embodiment can optimize the display effect of a head-up display device and improve the user's viewing experience.

Description

Technical Field

[0001] This application relates to the field of head-up display technology, and more particularly to an image display method and related equipment. Background Technology

[0002] Glasses-free 3D display technology refers to a 3D display technology that allows users to view 3D images directly with the naked eye without wearing special 3D glasses, presenting a 3D effect. For example, by placing a slit grating or lenticular grating in front of an LCD screen, the image light emitted from the LCD screen is split by the slit grating or lenticular grating, and then refracted by a mirror and imaging structure before entering the driver's left and right eyes respectively. The images seen by the driver's left and right eyes are different, achieving a 3D viewing experience. In the process of realizing glasses-free 3D display technology, the quality of image display directly affects the user's final viewing experience.

[0003] However, a head-up display (HUD) is a non-uniform system. Even if the pixel pitch and raster design are uniform, there will still be some differences, which can cause problems such as translation, tilting, and distortion of the image seen by the human eye. For example, when a user watches, the left eye may see the image intended for the right eye, or the right eye may see the image intended for the left eye. This crosstalk between the images seen by the user's left and right eyes leads to a poor user experience.

[0004] Therefore, there is an urgent need for a 3D HUD image display method to solve the crosstalk problem caused by the non-uniformity of the system itself, so as to improve the user's visual experience. Summary of the Invention

[0005] This application provides an image display method and related equipment. The technical solution of this application is as follows:

[0006] According to a first aspect of the embodiments of this application, an image display method is provided for a head-up display device, the head-up display device including a liquid crystal screen and a beam splitter; the method includes:

[0007] Based on the left-eye and right-eye images to be displayed, the initial pixel allocation method of the LCD screen is determined; the initial pixel allocation method includes the initial light emission state of each pixel on the LCD screen; the LCD screen includes distorted pixel areas and non-distorted pixel areas;

[0008] The initial pixel allocation method is shifted and adjusted based on a preset direction to obtain the adjusted pixel allocation method; the adjusted pixel allocation method includes the adjusted light emission state of each pixel.

[0009] The target pixel allocation method of the LCD screen is determined based on the initial light emission state of each pixel in the non-distorted pixel region and the adjusted light emission state of each pixel in the distorted pixel region.

[0010] The LCD screen is lit up based on the target pixel allocation method, so that the light emitted from the LCD screen is split by the beam splitter to form a virtual image for the left eye and a virtual image for the right eye.

[0011] In some possible embodiments, the preset direction includes the lateral direction of the LCD screen; the method further includes:

[0012] The pixel allocation method of the LCD screen is determined based on the test images of the left eye and the right eye.

[0013] The initial distorted image is obtained by simulating the virtual image seen by the human eye based on the pixel allocation method; the virtual image includes either the left eye virtual image or the right eye virtual image.

[0014] The pixel allocation method is shifted to the left and to the right along the horizontal direction of the LCD screen, respectively, to obtain the pixel allocation method after shifting to the left and the pixel allocation method after shifting to the right.

[0015] Based on the pixel allocation method after left shift and the pixel allocation method after right shift, respectively, the virtual image seen by the human eye is simulated to obtain the left-shifted distortion image and the right-shifted distortion image;

[0016] Based on the initial distorted image, the left-shifted distorted image, and the right-shifted distorted image, determine the distorted pixel regions and the non-distorted pixel regions;

[0017] The initial distorted image includes a first undistorted image region, the left-shifted distorted image includes a second undistorted image region, and the right-shifted distorted image includes a third undistorted image region; the overlapping pixel units between any two image regions in the first, second, and third undistorted image regions are less than or equal to a preset pixel unit.

[0018] In some possible embodiments, determining distorted pixel regions and non-distorted pixel regions based on the initial distorted image, the left-shifted distorted image, and the right-shifted distorted image includes:

[0019] The second and third undistorted image regions are translated respectively to obtain the processed second and third undistorted image regions.

[0020] The first undistorted image region, the processed second undistorted image region, and the processed third undistorted image region are combined to obtain a combined image.

[0021] When it is determined that the stitched image and the ideal image meet the preset matching degree, the LCD screen is divided into pixel regions based on the first undistorted image region, the second undistorted image region and the third undistorted image region to obtain distorted pixel regions and undistorted pixel regions.

[0022] In some possible embodiments, the method further includes:

[0023] Set the tilt angle between the LCD screen and the beam splitter;

[0024] At different tilt angles, the initial distortion image, left-shift distortion image, and right-shift distortion image corresponding to each tilt angle are determined based on the left-eye test image and the right-eye test image;

[0025] Based on the initial distorted image, left-shifted distorted image, and right-shifted distorted image corresponding to each tilt angle, the target tilt angle is determined from different tilt angles;

[0026] Based on the initial distorted image, the left-shifted distorted image, and the right-shifted distorted image, determine the distorted pixel regions and the non-distorted pixel regions, including:

[0027] Based on the initial distorted image, left-shifted distorted image, and right-shifted distorted image corresponding to the target tilt angle, the distorted pixel region and the non-distorted pixel region are determined.

[0028] In some possible embodiments, the adjusted pixel allocation method includes a left-shifted pixel allocation method and a right-shifted pixel allocation method;

[0029] The initial pixel allocation method is shifted and adjusted based on a preset direction to obtain the adjusted pixel allocation method, including:

[0030] The initial pixel allocation method is shifted to the left and to the right along the horizontal direction of the LCD screen, respectively, to obtain the pixel allocation method after left shift adjustment and the pixel allocation method after right shift adjustment.

[0031] In some possible embodiments, the distorted pixel region includes a first distorted pixel region and a second distorted pixel region; the first distorted pixel region corresponds to a second undistorted image region, the second distorted pixel region corresponds to a third undistorted image region, and the undistorted pixel region corresponds to the first undistorted image region;

[0032] Based on the initial light emission state of each pixel in the non-distorted pixel region and the adjusted light emission state of each pixel in the distorted pixel region, the target pixel allocation method of the LCD screen is determined, including:

[0033] The initial emission state of each pixel in the non-distorted pixel region is determined as the target emission state of each pixel in the non-distorted pixel region;

[0034] Based on the pixel allocation method adjusted by left shift, determine the adjusted luminous state of each pixel in the first distorted pixel region;

[0035] The adjusted light emission state of each pixel in the first distorted pixel region is determined as the target light emission state of each pixel in the first distorted pixel region;

[0036] Based on the pixel allocation method adjusted by right shift, determine the adjusted luminous state of each pixel in the second distorted pixel region;

[0037] The adjusted light emission state of each pixel in the second distorted pixel region is determined as the target light emission state of each pixel in the second distorted pixel region;

[0038] The target pixel allocation method of the LCD screen is obtained based on the target light emission state of each pixel in the non-distorted pixel region, the target light emission state of each pixel in the first distorted pixel region, and the target light emission state of each pixel in the second distorted pixel region.

[0039] According to a second aspect of the embodiments of this application, an image display device is provided for a head-up display device, the head-up display device including a liquid crystal screen and a beam splitter; the image display device includes:

[0040] The first determining module is used to determine the initial pixel allocation method of the LCD screen in the head-up display device based on the left-eye image and the right-eye image to be displayed; the initial pixel allocation method includes the initial light emission state of each pixel on the LCD screen; the LCD screen includes distorted pixel areas and non-distorted pixel areas;

[0041] The adjustment module is used to translate and adjust the initial pixel allocation method based on a preset direction to obtain the adjusted pixel allocation method; the adjusted pixel allocation method includes the adjusted light emission state of each pixel;

[0042] The second determining module is used to determine the target pixel allocation method of the LCD screen based on the initial light emission state of each pixel in the non-distorted pixel region and the adjusted light emission state of each pixel in the distorted pixel region.

[0043] The illumination module is used to illuminate the LCD screen based on the target pixel allocation method, so that the light emitted from the LCD screen is split by the beam splitting element to form a virtual image for the left eye and a virtual image for the right eye.

[0044] According to a third aspect of the embodiments of this application, a head-up display device is provided, comprising:

[0045] LCD screen;

[0046] Spectrometer;

[0047] processor;

[0048] Memory used to store processor-executable instructions;

[0049] The processor is configured to execute instructions to implement the image display method of the first aspect of the embodiments of this application.

[0050] According to a fourth aspect of the present application, a computer-readable storage medium is provided, which, when the instructions in the computer-readable storage medium are executed by a processor of an electronic device, enables the electronic device to perform the image display method of the first aspect of the present application.

[0051] According to a fifth aspect of the present application, a computer program is provided, which, when executed by a processor, implements the image display method of the first aspect of the present application.

[0052] The technical solutions provided by the embodiments of this application bring at least the following beneficial effects:

[0053] First, based on the left-eye and right-eye images to be displayed, the initial pixel allocation method of the LCD screen is determined. Then, by adjusting the initial pixel allocation method, mainly by adjusting the light emission state of pixels in the distorted pixel region, the target pixel allocation method of the LCD screen is obtained by combining the initial light emission state of each pixel in the non-distorted pixel region and the adjusted light emission state of each pixel in the distorted pixel region. Finally, the LCD screen is lit based on the target pixel allocation method, which significantly improves the crosstalk problem between the left-eye virtual image and the right-eye virtual image formed after the light emitted from the LCD screen is split by the beam splitter, thereby optimizing the display effect of the head-up display device and improving the user's viewing experience.

[0054] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and do not limit this application. Attached Figure Description

[0055] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application, and do not constitute an undue limitation of this application.

[0056] Figure 1 This is a schematic diagram illustrating an application environment according to an exemplary embodiment;

[0057] Figure 2 This is a flowchart illustrating an image display method according to an exemplary embodiment;

[0058] Figure 3 This is a schematic diagram illustrating the beam-splitting principle of a slit grating according to an exemplary embodiment;

[0059] Figure 4This is a schematic diagram illustrating a naked-eye 3D principle according to an exemplary embodiment;

[0060] Figure 5 This is a schematic diagram of the structure of a head-up display device according to an exemplary embodiment;

[0061] Figure 6 This is a schematic diagram illustrating a left-eye image and a right-eye image according to an exemplary embodiment;

[0062] Figure 7 This is a schematic diagram illustrating image light projection from a liquid crystal screen to an eye box according to an exemplary embodiment;

[0063] Figure 8 This is a flowchart illustrating the determination of distorted and non-distorted pixel regions according to an exemplary embodiment;

[0064] Figure 9 This is a schematic diagram illustrating a partial pixel allocation method according to an exemplary embodiment;

[0065] Figure 10 This is a schematic diagram illustrating various distorted images according to an exemplary embodiment;

[0066] Figure 11 This is a schematic diagram illustrating various distorted images according to an exemplary embodiment;

[0067] Figure 12 This is a flowchart illustrating the determination of distorted and non-distorted pixel regions according to an exemplary embodiment;

[0068] Figure 13 This is a schematic diagram illustrating an image stitching process according to an exemplary embodiment;

[0069] Figure 14 This is a block diagram illustrating an image display device according to an exemplary embodiment. Detailed Implementation

[0070] To enable those skilled in the art to better understand the technical solutions of this application, the technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings.

[0071] It should be noted that the terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar first objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0072] In related technologies, when a head-up display device performs 3D imaging, crosstalk occurs between the left-eye image and the right-eye image. That is, information from the left-eye image appears in the right-eye image, or information from the right-eye image appears in the left-eye image, resulting in a poor stereoscopic image effect perceived by the user.

[0073] Based on this, embodiments of this application provide an image display method for a head-up display device, which can solve the problem of crosstalk between the images seen by the user's left and right eyes, improve image quality, and thus enhance the user's viewing experience.

[0074] Please see Figure 1 , Figure 1 This is a schematic diagram illustrating the application environment of a head-up display (HUD) device according to an embodiment of this application. The HUD can be used in automobiles as a driving assistance instrument, and can also be applied to other vehicles, such as airplanes and high-speed trains. The technical solution of this application will be described below using an in-vehicle HUD as an example.

[0075] Through the image display method of this application embodiment, the HUD can clearly and accurately project vehicle speed, navigation information, alarm information, etc., in the form of images and characters, onto the driver's front through optical components, forming a virtual image with a three-dimensional effect in front of the driver's line of sight, and has a good imaging effect.

[0076] The following describes a specific embodiment of an image display method provided in this application. This method can be implemented by an image display device inside a head-up display device or by a separate image display device. Figure 2 This is a flowchart illustrating an image display method according to an exemplary embodiment, such as... Figure 2 As shown, the image display method may include the following steps:

[0077] S201: Determine the initial pixel allocation method of the LCD screen based on the left-eye image and the right-eye image to be displayed; the initial pixel allocation method includes the initial light emission state of each pixel on the LCD screen; the LCD screen includes distorted pixel areas and non-distorted pixel areas.

[0078] In this embodiment, the head-up display (HUD) includes a liquid crystal display (LCD) screen and a beam splitter. During 3D imaging, the left-eye and right-eye images to be displayed are first fused to determine the illumination mode of the LCD screen. Then, the LCD screen is illuminated according to this illumination mode, so that the light emitted from the LCD screen is split by the beam splitter to display the corresponding left-eye and right-eye images. The beam splitter can be a lenticular grating or a slit grating. The technical solution of this application will be described in detail below using a slit grating as an example.

[0079] For example, such as Figure 3 As shown, a slit grating is disposed on the surface of the LCD screen, so that the light rays from adjacent pixels in the LCD screen are separated by the slit and emitted at different angles, thus achieving light splitting; the light rays emitted from the slit grating are refracted sequentially by a mirror assembly and an imaging structure (such as a vehicle's windshield) before entering the user's left and right eyes respectively, resulting in different images seen by the user's left and right eyes; for example... Figure 4 As shown, by optically designing the HUD, the user's left eye sees image P1 and the right eye sees image P2. Images P1 and P2 can be combined in the user's brain to form a stereoscopic image with a sense of depth. By changing the position between the two images and adjusting the binocular parallax, the distance of the virtual image perceived by the user can be changed (in reality, the distance of the virtual image remains constant). The closer the two images are, the closer the distance of the virtual image perceived by the user; conversely, the farther the two images are, the farther the distance of the virtual image perceived by the user.

[0080] Therefore, in this embodiment of the application, firstly, the image display device needs to determine the initial pixel allocation method of the liquid crystal screen based on the left-eye image and the right-eye image to be displayed; wherein, the initial pixel allocation method includes the initial light emission state of each pixel on the liquid crystal screen, and the initial light emission state of each pixel includes whether each pixel emits light and the color information of the light to be emitted.

[0081] It should be noted that the aforementioned pixel refers to the smallest light-emitting unit on the LCD screen in actual applications; generally, for color LCD screens, the smallest light-emitting unit is each R / G / B sub-pixel; therefore, when applied to color LCD screens, each pixel described in this application can be understood as each R / G / B sub-pixel.

[0082] like Figure 5 As shown, taking a color LCD screen as an example, the eye box includes two partitions for explanation; the two partitions repeat periodically, with the user's left and right eyes located in partitions 1 and 2 respectively; in practical applications, the partitioning scheme of the eye box can be determined based on the width of a slit grating covering several sub-pixels in the LCD screen (equivalent to treating several sub-pixels in the LCD screen as a complete pixel).

[0083] Reference Figure 5 After the left-eye and right-eye images are fused, the sub-pixels on the LCD screen alternately display the left-eye and right-eye images. The width of a slit grating (referring to the width of a slit and the width of a strip grating adjacent to the slit) covers two adjacent sub-pixels. One of these two adjacent sub-pixels displays the left-eye image, and the other displays the right-eye image. For ease of explanation and understanding, assume that the left-eye image to be displayed is a pure white image and the right-eye image is a pure black image. Then, the ideal image viewed by the user's left and right eyes through the imaging structure should be as follows: Figure 6 As shown in (a), the left eye can only see the pure white image L1, and the right eye can only see the pure black image R1.

[0084] However, due to the non-uniformity in the structure of the HUD itself, such as the spacing between pixels on the LCD screen and the spacing between slits on the slit grating, the displayed image will be distorted. For example, Figure 6 As shown in (b), the user's left and right eyes see mixed black and white images L2 and R2, resulting in a poor viewing experience. In practical applications, this means that information from the left-eye image appears in the right-eye image, and vice versa, causing crosstalk.

[0085] like Figure 7 As shown, pixels located at the edges of the LCD screen are more prone to translational distortion than pixels located in the center. For example, pixel P1, located in the center, has a small deviation from its ideal position. However, pixel P2, located at the upper edge, should be in the same vertical direction as pixel P1, but it is actually distorted by being translated to the right relative to pixel P1. Pixels in the central region, such as pixel P1, emit light that, after passing through the reflective components and imaging structure, can accurately fall into either the left or right eye partition of the eyepiece, so the left eye sees a pure white image L1 and the right eye sees a pure black image R1. However, pixels located at the edges, such as pixel P2, are translated, causing the partition into which their emitted light falls after passing through the reflective components and imaging structure to also shift. The light originally intended to display the left eye image ends up falling into the right eye partition, resulting in the user's right eye seeing both the pure white image L1 and the pure black image R1.

[0086] Therefore, in this embodiment, the LCD screen is divided into distorted pixel area and non-distorted pixel area. The pixels in the distorted pixel area are those that have undergone translational distortion. By changing the initial light emission state of the pixels in the distorted pixel area, the initial pixel allocation method of the LCD screen is adjusted. Subsequently, the LCD screen is lit up based on the adjusted pixel allocation method, which significantly improves the crosstalk phenomenon between the left-eye image and the right-eye image formed after lighting up, thereby improving the user's viewing experience.

[0087] In some possible embodiments, the distorted pixel regions and non-distorted pixel regions in the liquid crystal screen can be pre-calibrated, specifically including, for example... Figure 8 The following steps are shown:

[0088] S801: Determine the pixel allocation method of the LCD screen based on the left-eye test image and the right-eye test image.

[0089] In this step, the left-eye test image and the right-eye test image are fused together, and the pixel allocation method of the LCD screen is determined in conjunction with the eye box partitioning scheme. The pixel allocation method refers to the light-emitting state of each pixel on the LCD screen. Here, the left-eye test image can be the pure white image L1 mentioned above, and the right-eye test image can be the pure black image R1 mentioned above. Figure 5 In the structure shown, the pixel allocation method of the LCD screen is that adjacent sub-pixels are lit alternately.

[0090] S803: Simulates the virtual image seen by the human eye based on the pixel allocation method to obtain the initial distorted image; the virtual image includes the left eye virtual image or the right eye virtual image.

[0091] In this step, based on the pixel allocation method, the software simulates the virtual image seen by the human eye to obtain the initial distorted image; here, the virtual image seen by the left eye can be simulated, and the resulting initial distorted image can be referenced. Figure 6 Alternatively, the L2 value can be used to simulate the virtual image seen by the right eye, and the resulting initial distorted image can be referenced. Figure 6 R2 in the middle.

[0092] S805: Shift the pixel allocation method to the left and to the right along the horizontal direction of the LCD screen to obtain the left-shifted pixel allocation method and the right-shifted pixel allocation method.

[0093] S807: Simulates the virtual image seen by the human eye based on the left-shifted pixel allocation method and the right-shifted pixel allocation method respectively, to obtain the left-shifted distortion image and the right-shifted distortion image.

[0094] In steps S805 to S807 above, with the human eye position fixed, the pixel allocation method is first shifted to the left along the horizontal direction of the LCD screen to obtain the left-shifted pixel allocation method; that is, the light emission state of each pixel is replaced with the light emission state of the Nth pixel to the right of each pixel, where N represents the left-shifted pixel unit; the left-shifted pixel unit can be increased sequentially starting from the smallest shift unit, and after each shift, the virtual image seen by the human eye is re-simulated based on the left-shifted pixel allocation method to obtain the left-shifted distorted image; the final selected left-shifted distorted image must ensure that there are two obvious partitions in the image, that is, crosstalk exists only at the lower edge in the left-shifted distorted image; in fact, during the continuous left-shifting process, the left-shifted distorted image will undergo regular changes, and the left-shifted distorted image is selected by observing these regular changes; the same applies to right-shifting;

[0095] Using the initial distorted image as Figure 6 Taking L2 as an example, the pixel allocation method corresponding to L2 is as follows: Figure 9 As shown, in two adjacent sub-pixels, one sub-pixel is "ON" lit, and the other sub-pixel is "OFF". Shifting this pixel allocation method to the left by one sub-pixel unit results in the following left-shifted pixel allocation method: Figure 9 As shown in the lower left corner, the left-shifted distortion image obtained by simulating the virtual image of the left eye using this method is as follows: Figure 10 The lower left corner shows L3; during the left shift, the bright and dark areas of the left-shifted distortion image switch regularly, that is, the black and white stripes cycle in front of the eye until the black stripe is at the lower edge area; similarly, the final right-shifted distortion image obtained after shifting one sub-pixel unit to the right is as follows. Figure 10 L4 is shown in the bottom right corner;

[0096] In practical applications, the changes in left-shifted or right-shifted distorted images are related to the pixel unit of translation, the eyebox partitioning scheme, and the pixel allocation method. For example, if the eyebox partitioning is divided into 12 partitions, and the offset of the black stripe in the left-shifted distorted image is insufficient to cover the upper edge area of ​​the image after moving one subpixel, then the subpixel can be moved further. After moving two subpixels, the offset of the black stripe can cover the upper edge area of ​​the left-shifted distorted image, and the desired left-shifted distorted image is obtained.

[0097] Furthermore, since the pixel allocation method of the LCD screen determined in S801 has a periodic pattern, for example, several pixels in the horizontal direction can form a cycle, and the light emission state of these several pixels can be reproduced on several pixels in the next cycle; thus, for pixels at the edge, such as the rightmost sub-pixel "b" in L3, after the pixel allocation method is shifted to the left by one sub-pixel, this sub-pixel "b" can be the first sub-pixel of the next cycle, and the corresponding light emission state is "ON".

[0098] S809: Determine the distorted pixel region and the non-distorted pixel region based on the initial distorted image, the left-shifted distorted image, and the right-shifted distorted image.

[0099] The initial distorted image includes a first undistorted image region, the left-shifted distorted image includes a second undistorted image region, and the right-shifted distorted image includes a third undistorted image region.

[0100] Generally, the central region of the initial distorted image is the first undistorted image region, and its upper and lower edge regions will experience crosstalk. After changing the pixel allocation method, the lower edge region of the resulting left-shifted distorted image is the main region where crosstalk occurs, and thus the upper edge region of the left-shifted distorted image is the second undistorted image region. Similarly, the upper edge region of the right-shifted distorted image is the main region where crosstalk occurs, and thus the lower edge region of the right-shifted distorted image is the third undistorted image region.

[0101] Specifically, the first undistorted image region in the initial distorted image, the second undistorted image region in the left-shifted distorted image, and the third undistorted image region in the right-shifted distorted image need to be pre-calibrated. During calibration, it is necessary to ensure that the overlapping pixel units between any two image regions in the first, second, and third undistorted image regions are less than or equal to a preset pixel unit. Here, the preset pixel unit can be 0, meaning that there is no overlap between any two image regions. Then, the LCD screen is divided into pixel regions based on the first, second, and third undistorted image regions to obtain distorted and undistorted pixel regions.

[0102] In addition, it should be noted that, Figure 10 In the L2, L3, and L4 distorted images shown, the crosstalk image regions are all irregular in shape, which is related to the structural design of the HUD. For example, when the LCD screen and the slit grating are tilted relative to each other, the shape of the crosstalk image regions in the distorted images obtained at a certain tilt angle can become more regular and standard.

[0103] Therefore, in the structural design process of the HUD, the following steps can also be taken: setting the tilt angle between the LCD screen and the slit grating; determining the initial distorted image, left-shifted distorted image, and right-shifted distorted image corresponding to each tilt angle based on the left-eye test image and the right-eye test image at different tilt angles; the specifics can be referred to the above embodiment, and will not be repeated here; then, based on the initial distorted image, left-shifted distorted image, and right-shifted distorted image corresponding to each tilt angle, determining the target tilt angle from different tilt angles. That is, at the target tilt angle, the shape of the image area where crosstalk occurs in each distorted image is a standard shape, such as a rectangle. Correspondingly, in the subsequent step S809, the distorted pixel area and the non-distorted pixel area are determined based on the initial distorted image, left-shifted distorted image, and right-shifted distorted image corresponding to the target tilt angle.

[0104] For example, when the tilt angle of the slit grating is arctan(1 / 3) = 18.4°, the resulting initial distorted image, left-shifted distorted image, and right-shifted distorted image are as follows: Figure 11 As shown, the crosstalk regions in each distorted image are clearly standard rectangles, meaning each distorted image has a distinct boundary line. This allows for the rapid identification of undistorted regions within each distorted image. For example, measurements show that the first undistorted image region is the central white region W1 of the initial distorted image L2, occupying 3 / 4 of the entire image; the second undistorted image region is the upper edge white region W2 of the left-shifted distorted image L3, occupying 1 / 8 of the entire image; and the third undistorted image region is the lower edge white region W3 of the right-shifted distorted image L4, occupying 1 / 8 of the entire image.

[0105] The tilt angle of the slit grating is arctan(1 / 3) to match the tilt angle of the grating with the proportion of the sub-pixels. Even if the grating is tilted, the image light emitted by the three complete RGB sub-pixels can still be seen. The specific design depends on the actual needs. This is just an example.

[0106] In the above embodiments, by optimizing the tilt angle between the liquid crystal screen and the slit grating, the shape of the image region where crosstalk occurs in each distorted image can become more regular and standard, thereby making it easier to intuitively determine the distorted or non-distorted image regions in each distorted image; in practical applications, it can also improve the efficiency of adjusting the initial pixel allocation method and speed up the image display.

[0107] In some possible embodiments, step S809, when determining the distorted pixel region and the non-distorted pixel region in the liquid crystal screen, may specifically take the following steps: Figure 12 The following steps:

[0108] S1201: The second and third undistorted image regions are translated respectively to obtain the processed second and third undistorted image regions.

[0109] Here, since the left-shifted distorted image is simulated based on the pixel allocation method after the left shift, the second undistorted image region needs to be shifted to the right by the corresponding pixel units based on the left shift to obtain the processed second undistorted image region; similarly, the third undistorted image region is shifted to the left by the corresponding pixel units based on the right shift to obtain the processed third undistorted image region; in this way, the image content of the processed second and third undistorted image regions is aligned with the image content of the first undistorted image region.

[0110] S1203: Perform image stitching on the first undistorted image region, the processed second undistorted image region, and the processed third undistorted image region to obtain a stitched image.

[0111] like Figure 13 As shown, Figure 11 The undistorted image regions W1, W2, and W3 in each distorted image are stitched together to obtain the final stitched image L.

[0112] S1205: When it is determined that the stitched image and the ideal image meet the preset matching degree, the LCD screen is divided into pixel regions based on the first undistorted image region, the second undistorted image region and the third undistorted image region to obtain distorted pixel regions and undistorted pixel regions.

[0113] In this step, the stitched image can be manually evaluated to determine if it matches the ideal image; for example... Figure 13 Whether the stitched image L is a pure white image L1; or through an image matching algorithm, whether the matching degree between the stitched image and the ideal image reaches a preset matching degree. Here, the preset matching degree can be set according to the actual situation, for example, it can be 0.9, 0.95, or 1, etc.; when it is determined that the matching degree between the stitched image and the ideal image reaches the preset matching degree, the LCD screen is divided into pixel regions based on the first non-distorted image region, the second non-distorted image region, and the third non-distorted image region to obtain distorted pixel regions and non-distorted pixel regions.

[0114] Specifically, the distorted pixel region can include a first distorted pixel region and a second distorted pixel region. Based on the correspondence between image pixels and LCD screen pixels, the pixel region on the LCD screen corresponding to the first undistorted image region is determined as the undistorted pixel region, the pixel region on the LCD screen corresponding to the second undistorted image region is determined as the first distorted pixel region, and the pixel region on the LCD screen corresponding to the third undistorted image region is determined as the second distorted pixel region; for example, the pixel region on the LCD screen corresponding to W1 is determined as the undistorted pixel region, the pixel region on the LCD screen corresponding to W2 is determined as the first distorted pixel region, and the pixel region on the LCD screen corresponding to W3 is determined as the second distorted pixel region.

[0115] In the above embodiments, the pixel allocation method is determined in advance using the left-eye test image and the right-eye test image. By changing the pixel allocation method, distorted images under different pixel allocation methods are collected. Then, the non-distorted image regions in the different distorted images are stitched together to complete the calibration of the distorted and non-distorted pixel regions on the LCD screen. In this way, it is estimated which pixels on the LCD screen will be distorted. In the subsequent image display process in actual applications, the initial light emission state of these distorted pixels can be changed to solve the crosstalk problem between the left-eye image and the right-eye image.

[0116] S203: The initial pixel allocation method is shifted and adjusted based on a preset direction to obtain the adjusted pixel allocation method; the adjusted pixel allocation method includes the adjusted light emission state of each pixel.

[0117] In this embodiment, the preset direction is consistent with the movement direction during the calibration process. For example, in the embodiment above, the movement is horizontal along the horizontal direction of the LCD screen during calibration. Therefore, the preset direction here can be the horizontal direction of the LCD screen.

[0118] Accordingly, in the actual image display process, the image display device can first shift the initial pixel allocation method to the left along the horizontal direction of the LCD screen to obtain a left-shifted adjusted pixel allocation method, and then shift the initial pixel allocation method to the right along the horizontal direction of the LCD screen to obtain a right-shifted adjusted pixel allocation method. That is, the above-mentioned adjusted pixel allocation method can include the left-shifted adjusted pixel allocation method and the right-shifted adjusted pixel allocation method. The left-shifted adjusted pixel allocation method can include the light emission state of each pixel after the left-shifted adjustment, and the right-shifted adjusted pixel allocation method can include the light emission state of each pixel after the right-shifted adjustment. Here, the translation adjustment in step S203 is to change the light emission state of each pixel, which can be referred to the relevant content of step S805 above, and will not be repeated here.

[0119] S205: Determine the target pixel allocation method of the LCD screen based on the initial light emission state of each pixel in the non-distorted pixel region and the adjusted light emission state of each pixel in the distorted pixel region.

[0120] S207: The LCD screen is lit based on the target pixel allocation method, so that the light emitted from the LCD screen is split by the slit grating to form a virtual image for the left eye and a virtual image for the right eye.

[0121] In this embodiment, the target pixel allocation method of the liquid crystal screen includes the target light emission state of each pixel on the liquid crystal screen, that is, whether each pixel ultimately emits light, and the color information of the emitted light, etc. After determining the target pixel allocation method of the liquid crystal screen, the image display device lights up the liquid crystal screen according to the target pixel allocation method, so that the light emitted from the liquid crystal screen is split by the slit grating to form a left-eye virtual image and a right-eye virtual image. The crosstalk phenomenon between the finally formed left-eye virtual image and right-eye virtual image can be significantly improved.

[0122] Specifically, as mentioned above, the distorted pixel area on the LCD screen can include a first distorted pixel area and a second distorted pixel area. The first distorted pixel area corresponds to the second undistorted image area, the second distorted pixel area corresponds to the third undistorted image area, and the undistorted pixel area corresponds to the first undistorted image area. Therefore, when determining the target allocation method of the LCD screen, the image display device can determine the initial light emission state of each pixel in the undistorted pixel area as the target light emission state of each pixel in the undistorted pixel area.

[0123] Then, based on the pixel allocation method adjusted by left shift, the adjusted light emission state of each pixel in the first distorted pixel region is determined; the adjusted light emission state of each pixel in the first distorted pixel region is determined as the target light emission state of each pixel in the first distorted pixel region;

[0124] Then, based on the pixel allocation method adjusted by right shift, the adjusted light emission state of each pixel in the second distorted pixel region is determined; the adjusted light emission state of each pixel in the second distorted pixel region is determined as the target light emission state of each pixel in the second distorted pixel region;

[0125] In this way, the target light emission state of each pixel on the LCD screen is obtained, that is, the target pixel allocation method of the LCD screen.

[0126] In the above embodiments, the light emission state of the pixels in the first and second distorted pixel regions on the liquid crystal screen is mainly adjusted to adapt to the distortion caused by the structure of the HUD itself, and to improve the crosstalk phenomenon between the left-eye virtual image and the right-eye virtual image displayed in the end.

[0127] In summary, the image display method provided in this application adjusts the initial pixel allocation method of the liquid crystal screen, mainly by adjusting the light emission state of pixels in the distorted pixel region of the liquid crystal screen in combination with the actual distortion situation; then, by combining the initial light emission state of each pixel in the non-distorted pixel region and the adjusted light emission state of each pixel in the distorted pixel region, the target pixel allocation method of the liquid crystal screen is obtained; finally, the liquid crystal screen is lit based on the target pixel allocation method, so that the crosstalk problem between the left-eye virtual image and the right-eye virtual image formed by the light emitted from the liquid crystal screen after passing through the slit grating is significantly improved, thereby optimizing the display effect of 3D HUD and improving the user viewing experience.

[0128] Figure 14 This is a block diagram illustrating an image display device according to an exemplary embodiment. The image display device is used in a head-up display device, which includes a liquid crystal display screen and a beam splitter; see reference... Figure 14 The image display device includes a first determining module 1401, an adjusting module 1402, a second determining module 1403, and a lighting module 1404;

[0129] The first determining module 1401 is used to determine the initial pixel allocation method of the LCD screen in the head-up display device based on the left-eye image and the right-eye image to be displayed; the initial pixel allocation method includes the initial light emission state of each pixel on the LCD screen; the LCD screen includes distorted pixel areas and non-distorted pixel areas;

[0130] The adjustment module 1402 is used to translate and adjust the initial pixel allocation method based on a preset direction to obtain the adjusted pixel allocation method; the adjusted pixel allocation method includes the adjusted light emission state of each pixel.

[0131] The second determining module 1403 is used to determine the target pixel allocation method of the LCD screen based on the initial light emission state of each pixel in the non-distorted pixel region and the adjusted light emission state of each pixel in the distorted pixel region.

[0132] The lighting module 1404 is used to light up the LCD screen based on the target pixel allocation method, so that the light emitted from the LCD screen is split by the beam splitting element to form a virtual image for the left eye and a virtual image for the right eye.

[0133] In some possible embodiments, the preset direction includes the horizontal direction of the LCD screen; the device further includes a third determining module, used to determine the pixel allocation method of the LCD screen based on the left-eye test image and the right-eye test image; to simulate the virtual image seen by the human eye based on the pixel allocation method to obtain an initial distorted image; the virtual image includes a left-eye virtual image or a right-eye virtual image; to shift the pixel allocation method to the left and to the right along the horizontal direction of the LCD screen respectively to obtain a left-shifted pixel allocation method and a right-shifted pixel allocation method; and to determine the pixel allocation method based on the left-shifted pixel allocation method and the right-shifted pixel allocation method respectively. The allocation method simulates the virtual image seen by the human eye to obtain a left-shifted distorted image and a right-shifted distorted image. Based on the initial distorted image, the left-shifted distorted image, and the right-shifted distorted image, distorted pixel regions and undistorted pixel regions are determined. Among them, the initial distorted image includes a first undistorted image region, the left-shifted distorted image includes a second undistorted image region, and the right-shifted distorted image includes a third undistorted image region. The overlapping pixel units between any two image regions in the first, second, and third undistorted image regions are less than or equal to a preset pixel unit.

[0134] In some possible embodiments, the third determining module is further configured to perform translation processing on the second undistorted image region and the third undistorted image region respectively to obtain the processed second undistorted image region and the processed third undistorted image region; perform image stitching processing on the first undistorted image region, the processed second undistorted image region, and the processed third undistorted image region to obtain a stitched image; when it is determined that the stitched image and the ideal image meet a preset matching degree, divide the LCD screen into pixel regions based on the first undistorted image region, the second undistorted image region, and the third undistorted image region to obtain distorted pixel regions and undistorted pixel regions.

[0135] In some possible embodiments, the device further includes a fourth determining module for setting the tilt angle between the liquid crystal screen and the beam splitter; determining an initial distorted image, a left-shifted distorted image, and a right-shifted distorted image corresponding to each tilt angle based on the left-eye test image and the right-eye test image at different tilt angles; and determining a target tilt angle from different tilt angles based on the initial distorted image, the left-shifted distorted image, and the right-shifted distorted image corresponding to each tilt angle.

[0136] Correspondingly, the third determining module is also used to determine the distorted pixel region and the non-distorted pixel region based on the initial distorted image, the left-shifted distorted image and the right-shifted distorted image corresponding to the target tilt angle.

[0137] In some possible embodiments, the adjusted pixel allocation method includes a left-shifted pixel allocation method and a right-shifted pixel allocation method;

[0138] The adjustment module 1402 is also used to shift the initial pixel allocation method to the left and to the right along the horizontal direction of the LCD screen, respectively, to obtain the pixel allocation method after left shift adjustment and the pixel allocation method after right shift adjustment.

[0139] In some possible embodiments, the distorted pixel region includes a first distorted pixel region and a second distorted pixel region; the first distorted pixel region corresponds to a second undistorted image region, the second distorted pixel region corresponds to a third undistorted image region, and the undistorted pixel region corresponds to the first undistorted image region;

[0140] The second determining module 1403 is further configured to: determine the initial light emission state of each pixel in the non-distorted pixel region as the target light emission state of each pixel in the non-distorted pixel region; determine the adjusted light emission state of each pixel in the first distorted pixel region according to the left-shifted pixel allocation method; determine the adjusted light emission state of each pixel in the first distorted pixel region as the target light emission state of each pixel in the first distorted pixel region; determine the adjusted light emission state of each pixel in the second distorted pixel region according to the right-shifted pixel allocation method; determine the adjusted light emission state of each pixel in the second distorted pixel region as the target light emission state of each pixel in the second distorted pixel region; and obtain the target pixel allocation method of the LCD screen based on the target light emission state of each pixel in the non-distorted pixel region, the target light emission state of each pixel in the first distorted pixel region, and the target light emission state of each pixel in the second distorted pixel region.

[0141] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0142] This application also provides a head-up display device, including a liquid crystal screen, a beam splitter, a processor, and a memory for storing processor-executable instructions; wherein the processor is configured to execute instructions to implement the image display method of this application.

[0143] In an exemplary embodiment, a computer-readable storage medium is also provided, wherein when the instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform the image display method of the embodiments of this application.

[0144] In an exemplary embodiment, a computer program is also provided, which, when executed by a processor, implements the image display method of the embodiments of this application.

[0145] Other embodiments of this application will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this application that follow the general principles of this application and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this application are indicated by the following claims.

[0146] It should be understood that this application is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this application is limited only by the appended claims.

Claims

1. An image display method, characterized in that, For a head-up display device, the head-up display device being a non-uniform system, the head-up display device including a liquid crystal display screen and a beam splitter; the method includes: Based on the left-eye and right-eye images to be displayed, the initial pixel allocation method of the liquid crystal screen is determined; the initial pixel allocation method includes the initial light emission state of each pixel on the liquid crystal screen; the liquid crystal screen includes distorted pixel areas and non-distorted pixel areas, the distorted pixel areas refer to the areas where the pixel light emission light deviates from the ideal imaging path due to the non-uniformity of the head-up display device, and the non-distorted pixel areas refer to the areas where the pixel light emission light conforms to the ideal imaging path; The initial pixel allocation method is translated and adjusted based on a preset direction to obtain an adjusted pixel allocation method; the adjusted pixel allocation method includes the adjusted light emission state of each pixel; The target pixel allocation method of the liquid crystal screen is determined based on the initial light emission state of each pixel in the non-distorted pixel region and the adjusted light emission state of each pixel in the distorted pixel region. The LCD screen is lit up based on the target pixel allocation method, so that the light emitted from the LCD screen is split by the beam splitter to form a virtual image for the left eye and a virtual image for the right eye.

2. The image display method according to claim 1, characterized in that, The preset direction includes the horizontal direction of the LCD screen; the method further includes: The pixel allocation method of the liquid crystal screen is determined based on the left-eye test image and the right-eye test image; Based on the pixel allocation method, the virtual image seen by the human eye is simulated to obtain an initial distorted image; the virtual image includes a left-eye virtual image or a right-eye virtual image. The pixel allocation method is shifted to the left and to the right along the horizontal direction of the LCD screen to obtain the left-shifted pixel allocation method and the right-shifted pixel allocation method; Based on the left-shifted pixel allocation method and the right-shifted pixel allocation method respectively, the virtual image seen by the human eye is simulated to obtain the left-shifted distortion image and the right-shifted distortion image; The distorted pixel region and the non-distorted pixel region are determined based on the initial distorted image, the left-shifted distorted image, and the right-shifted distorted image; The initial distorted image includes a first undistorted image region, the left-shifted distorted image includes a second undistorted image region, and the right-shifted distorted image includes a third undistorted image region; the overlapping pixel units between any two image regions in the first undistorted image region, the second undistorted image region, and the third undistorted image region are less than or equal to a preset pixel unit.

3. The image display method according to claim 2, characterized in that, The step of determining the distorted pixel region and the non-distorted pixel region based on the initial distorted image, the left-shifted distorted image, and the right-shifted distorted image includes: The second undistorted image region and the third undistorted image region are respectively translated to obtain the processed second undistorted image region and the processed third undistorted image region. The first undistorted image region, the processed second undistorted image region, and the processed third undistorted image region are combined to obtain a combined image. When it is determined that the stitched image and the ideal image meet a preset matching degree, the LCD screen is divided into pixel regions based on the first undistorted image region, the second undistorted image region, and the third undistorted image region to obtain the distorted pixel region and the undistorted pixel region.

4. The image display method according to claim 2, characterized in that, The method further includes: The tilt angle between the LCD screen and the beam splitter is set; At different tilt angles, based on the left-eye test image and the right-eye test image, the initial distortion image, left-shift distortion image and right-shift distortion image corresponding to each tilt angle are determined; Based on the initial distorted image, left-shifted distorted image, and right-shifted distorted image corresponding to each tilt angle, the target tilt angle is determined from the different tilt angles; The step of determining the distorted pixel region and the non-distorted pixel region based on the initial distorted image, the left-shifted distorted image, and the right-shifted distorted image includes: Based on the initial distorted image, the left-shifted distorted image, and the right-shifted distorted image corresponding to the target tilt angle, the distorted pixel region and the non-distorted pixel region are determined.

5. The image display method according to claim 2, characterized in that, The adjusted pixel allocation method includes a left-shifted pixel allocation method and a right-shifted pixel allocation method; The step of translating and adjusting the initial pixel allocation method based on a preset direction to obtain the adjusted pixel allocation method includes: The initial pixel allocation method is shifted to the left and to the right along the horizontal direction of the LCD screen to obtain the pixel allocation method adjusted by shifting to the left and the pixel allocation method adjusted by shifting to the right.

6. The image display method according to claim 5, characterized in that, The distorted pixel region includes a first distorted pixel region and a second distorted pixel region; the first distorted pixel region corresponds to the second undistorted image region, the second distorted pixel region corresponds to the third undistorted image region, and the undistorted pixel region corresponds to the first undistorted image region. The step of determining the target pixel allocation method of the liquid crystal screen based on the initial light emission state of each pixel in the non-distorted pixel region and the adjusted light emission state of each pixel in the distorted pixel region includes: The initial emission state of each pixel in the undistorted pixel region is determined as the target emission state of each pixel in the undistorted pixel region; Based on the left-shifted pixel allocation method, determine the adjusted luminous state of each pixel in the first distorted pixel region; The adjusted light emission state of each pixel in the first distorted pixel region is determined as the target light emission state of each pixel in the first distorted pixel region; Based on the right-shifted pixel allocation method, determine the adjusted luminescence state of each pixel in the second distorted pixel region; The adjusted light emission state of each pixel in the second distorted pixel region is determined as the target light emission state of each pixel in the second distorted pixel region; The target pixel allocation method of the liquid crystal screen is obtained based on the target light emission state of each pixel in the non-distorted pixel region, the target light emission state of each pixel in the first distorted pixel region, and the target light emission state of each pixel in the second distorted pixel region.

7. An image display device, characterized in that, For a head-up display device, the head-up display device is a non-uniform system, the head-up display device includes a liquid crystal display screen and a beam splitter; the image display device includes: The first determining module is used to determine the initial pixel allocation method of the LCD screen in the head-up display device based on the left-eye image and the right-eye image to be displayed; the initial pixel allocation method includes the initial light emission state of each pixel on the LCD screen; the LCD screen includes distorted pixel areas and non-distorted pixel areas, the distorted pixel areas refer to the areas where the pixel light emission light deviates from the ideal imaging path due to the non-uniformity of the head-up display device, and the non-distorted pixel areas refer to the areas where the pixel light emission light conforms to the ideal imaging path; An adjustment module is used to translate and adjust the initial pixel allocation method based on a preset direction to obtain an adjusted pixel allocation method; the adjusted pixel allocation method includes the adjusted light emission state of each pixel; The second determining module is used to determine the target pixel allocation method of the liquid crystal screen based on the initial light emission state of each pixel in the non-distorted pixel region and the adjusted light emission state of each pixel in the distorted pixel region. The illumination module is used to illuminate the LCD screen based on the target pixel allocation method, so that the light emitted from the LCD screen is split by the beam splitting element to form a left-eye virtual image and a right-eye virtual image.

8. A head-up display device, characterized in that, include: LCD screen; Spectrometer; processor; Memory used to store the processor's executable instructions; The processor is configured to execute the instructions to implement the image display method as described in any one of claims 1-6.

9. A computer-readable storage medium, characterized in that, When the instructions in the computer-readable storage medium are executed by the processor of the electronic device, the electronic device is enabled to perform the image display method as described in any one of claims 1-6.

10. A computer program, characterized in that, When the computer program is executed by a processor, it implements the image display method according to any one of claims 1-6.

Images