Image display method, device, equipment and medium of a head-up display system

Abstract

The present application provides an image display method, device, equipment and medium for a head-up display system. By detecting the positions of both eyes, a first image and a second image are obtained. The first color information of each pixel in the first image is extracted, and the second color information of each pixel in the second image is extracted. A first set of image generation sub-units corresponding to each pixel in the first image is determined from the image generation components, and a second set of image generation sub-units corresponding to each pixel in the second image is determined. The first display parameters of the first set of image generation sub-units corresponding to each pixel are determined according to the first color information of each pixel in the first image, and the second display parameters of the second set of image generation sub-units corresponding to each pixel are determined according to the second color information of each pixel in the second image. The present application can improve the determination accuracy of the display parameters, enable both eyes to see the preset corresponding images respectively, and reduce the crosstalk between the images seen by both eyes.

Description

Technical Field

[0001] The present invention relates to the technical field of image display, and in particular, to an image display method, apparatus, device, and medium for a head-up display system. Background Art

[0002] The naked-eye 3D display technology means that users can directly view three-dimensional images with the naked eye without wearing special 3D glasses. The naked-eye 3D display technology includes lenticular gratings, slit gratings, etc. In the existing image display method of the naked-eye 3D head-up display system, it may occur that the left eye of the user sees the image intended for the right eye, or the right eye sees the image intended for the left eye, resulting in crosstalk between the images seen by the left and right eyes of the user. It may also cause a large gap between the final imaging effect and the expected 3D display effect, resulting in poor user experience. Summary of the Invention

[0003] To solve the problem that there is crosstalk between the images seen by the existing left and right eyes, resulting in a large gap between the final imaging effect and the expected display effect, and poor user experience, the present application provides an image display method, apparatus, electronic device, and storage medium:

[0004] According to a first aspect of the present application, there is provided an image display method for a head-up display system, wherein the head-up display system includes an image generation component, a lenticular grating, an optical component, and a window. The head-up display system is configured to cause the imaging light emitted by the image generation component to be split by the lenticular grating and reflected by the optical component to form a virtual image on the window and enter the eye box region of both eyes.

[0005] The image display method of the head-up display system includes:

[0006] Detect the positions of the user's both eyes, determine the eye box region based on the detected binocular position data, and determine a first target eye box partition and a second target eye box partition from multiple eye box partitions of the eye box region; the eye box partitions are obtained by partitioning the eye box region based on the optical parameters of the lenticular grating and the image generation component;

[0007] Obtain a first image and a second image, extract the first color information of each pixel in the first image and extract the second color information of each pixel in the second image; at least some image elements of the first image are the same as some image elements of the second image;

[0008] Determine a first set of image generation sub-units corresponding to each pixel in the first image and a second set of image generation sub-units corresponding to each pixel in the second image from the image generation component;

[0009] Determine the first display parameters of the first image generation subunit sets corresponding to each pixel according to the first color information of each pixel in the first image, and determine the second display parameters of the second image generation subunit sets corresponding to each pixel according to the second color information of each pixel in the second image;

[0010] Control the image display of each image generation subunit in the first image generation subunit set according to the first display parameters, and control the image display of each image generation subunit in the second image generation subunit set according to the second display parameters;

[0011] Among them, the first display parameter is used to indicate that the first image generation subunit sets corresponding to each pixel in the first image are in a light-emitting state, and emit imaging light that matches the color information of the corresponding pixel, is split by the lenticular grating, and is incident on the first target eye box partition after being reflected by the imaging component;

[0012] The second display parameter is used to indicate that the second image generation subunit sets corresponding to each pixel in the second image are in a light-emitting state, and emit imaging light that matches the color information of the corresponding pixel, is split by the lenticular grating, and is incident on the second target eye box partition after being reflected by the imaging component.

[0013] According to the second aspect of the present application, there is provided an image display device for a head-up display system. Among them, the head-up display system includes an image generation component, a lenticular grating, an optical component, and a window. The head-up display system is configured to cause the imaging light emitted by the image generation component to be split by the lenticular grating, reflected by the optical component, form a virtual image on the window, and be incident on the eye box area of both eyes.

[0014] The image display device of the head-up display system includes:

[0015] A detection module, configured to detect the positions of the user's both eyes, determine the eye box area based on the detected binocular position data, and determine a first target eye box partition and a second target eye box partition from multiple eye box partitions in the eye box area; the eye box partitions are obtained by partitioning the eye box area based on the optical parameters of the lenticular grating and the image generation component;

[0016] An acquisition module, configured to acquire a first image and a second image, extract the first color information of each pixel in the first image, and extract the second color information of each pixel in the second image; at least part of the image elements of the first image are the same as part of the image elements of the second image;

[0017] A first determination module, configured to determine the first image generation subunit sets corresponding to each pixel in the first image and the second image generation subunit sets corresponding to each pixel in the second image from the image generation component;

[0018] A second determination module, configured to determine first display parameters of a first image generation subunit set corresponding to each pixel in the first image according to the first color information of each pixel in the first image, and determine second display parameters of a second image generation subunit set corresponding to each pixel in the second image according to the second color information of each pixel in the second image;

[0019] A control module, configured to control image display of each image generation subunit in the first image generation subunit set according to the first display parameters, and control image display of each image generation subunit in the second image generation subunit set according to the second display parameters;

[0020] Wherein, the first display parameters are used to indicate that the first image generation subunit set corresponding to each pixel in the first image is in a light-emitting state, and emits imaging light that matches the color information of the corresponding pixel, is split by a lenticular grating, and is incident on the first target eye box partition after being reflected by an imaging component;

[0021] The second display parameters are used to indicate that the second image generation subunit set corresponding to each pixel in the second image is in a light-emitting state, and emits imaging light that matches the color information of the corresponding pixel, is split by a lenticular grating, and is incident on the second target eye box partition after being reflected by an imaging component.

[0022] On the other hand, an acquisition module, configured to acquire a first image to be displayed and a second image to be displayed; the first image to be displayed is a pre-set image in which imaging light is incident on the first target eye box partition, and the second image to be displayed is a pre-set image in which imaging light is incident on the second target eye box partition;

[0023] Based on the image mapping information between the image to be displayed and the virtual image, perform inverse distortion processing on the first image to be displayed and the second image to be displayed respectively to obtain a first image and a second image;

[0024] Perform color extraction processing on the first image to obtain first color information of each pixel in the first image, and perform color extraction processing on the second image to obtain second color information of each pixel in the second image.

[0025] On the other hand, the first determination module includes:

[0026] A first determination sub-module, configured to determine a first image generation unit set corresponding to each pixel in the first image from an image generation component;

[0027] A second determination sub-module, configured to determine a first image generation subunit set corresponding to each pixel in the first image from the first image generation unit set based on first position information; the first position information is the position information between the image generation component and the lenticular grating.

[0028] On the other hand, the image generation component includes a plurality of image generation units, which are arranged in an array. Each image generation unit includes a plurality of image generation subunits, which are arranged in an array.

[0029] The first determination sub-module is configured to, for each pixel in the first image, determine a first target row corresponding to the pixel from the array of image generation units based on the first position information and the second position information; the second position information is the position information of the pixel in the first image.

[0030] Based on the first position information, determine a first associated row set of the first target row from the array of image generation units; the first target row and the associated rows in the first associated row set are consecutive rows in the array of image generation units.

[0031] Determine a first set of image generation units corresponding to the pixel from the multiple image generation units of the first target row and the multiple image generation units of each associated row.

[0032] On the other hand, the second determination sub-module is configured to determine a first set of candidate image generation subunits corresponding to the pixel from the multiple first sets of image generation units of the first target row based on the first position information.

[0033] Determine a second set of candidate image generation subunits corresponding to the pixel from the multiple first sets of image generation units of each associated row; the first candidate image generation subunits in the first set of candidate image generation subunits and the second candidate image generation subunits in the second set of candidate image generation subunits are in the same column of the array of image generation subunits.

[0034] Perform an integration process on the first set of candidate image generation subunits and the second set of candidate image generation subunits to obtain a first set of image generation subunits corresponding to the pixel.

[0035] On the other hand, the first set of image generation subunits includes a first candidate image generation subunit, a second candidate image generation subunit, and a third candidate image generation subunit, and the first candidate image generation subunit, the second candidate image generation subunit, and the third candidate image generation subunit are located in different image generation units.

[0036] The second determination module is configured to, for the first color information of each pixel in the first image, determine a first sub-display parameter of the first candidate image generation subunit according to the first sub-color information in the first color information.

[0037] Determine a second sub-display parameter of the second candidate image generation subunit according to the second sub-color information in the first color information.

[0038] Determine a third sub-display parameter of the third candidate image generation subunit according to the third sub-color information in the first color information.

[0039] According to a third aspect of the present application, an electronic device is provided. The electronic device includes a processor and a memory. At least one instruction or at least one program segment is stored in the memory, and the at least one instruction or the at least one program segment is loaded and executed by the processor to implement the image display method of the head-up display system according to the first aspect of the present application.

[0040] According to a fourth aspect of the present application, a computer storage medium is provided. At least one instruction or at least one program segment is stored in the storage medium, and the at least one instruction or the at least one program segment is loaded and executed by the processor to implement the image display method of the head-up display system according to the first aspect of the present application.

[0041] According to a fifth aspect of the present application, a computer program product is provided. The computer program product includes at least one instruction or at least one program segment, and the at least one instruction or the at least one program segment is loaded and executed by the processor to implement the image display method of the head-up display system according to the first aspect of the present application.

[0042] The image display method, device, equipment and medium of a head-up display system provided by the embodiments of the present application have the following technical effects:

[0043] By detecting the positions of a user's two eyes, determining an eyebox area based on the detected two-eye position data, and determining a first target eyebox partition and a second target eyebox partition from multiple eyebox partitions of the eyebox area; the eyebox partitions are obtained by partitioning the eyebox area based on a preset light splitting strategy of a lenticular grating; acquiring a first image and a second image, extracting first color information of each pixel in the first image, and extracting second color information of each pixel in the second image; partial image elements of the first image are the same as partial image elements of the second image; determining a set of first image generation sub-units corresponding to each pixel in the first image and a set of second image generation sub-units corresponding to each pixel in the second image from an image generation component; determining first display parameters of the set of first image generation sub-units corresponding to each pixel according to the first color information of each pixel in the first image, determining second display parameters of the set of second image generation sub-units corresponding to each pixel according to the second color information of each pixel in the second image, controlling the image display of each image generation sub-unit in the set of first image generation sub-units according to the first display parameters, and controlling the image display of each image generation sub-unit in the set of second image generation sub-units according to the second display parameters. Among them, the first display parameters are used to indicate that the set of first image generation sub-units corresponding to each pixel in the first image is in a light-emitting state, and emit imaging light that matches the color information of the corresponding pixel, is split by the lenticular grating, and is incident on the first target eyebox partition after being reflected by an imaging component; the second display parameters are used to indicate that the set of second image generation sub-units corresponding to each pixel in the second image is in a light-emitting state, and emit imaging light that matches the color information of the corresponding pixel, is split by the lenticular grating, and is incident on the second target eyebox partition after being reflected by the imaging component. Based on the embodiments of the present application, by detecting the distribution of the two eyes in the eyebox area in real time, the determination accuracy of the display parameters can be improved. Moreover, by determining the display parameters of each image generation sub-unit according to the color information of each pixel in the image that is intended to be seen by the two eyes in advance, the two eyes can respectively see the preset corresponding images, reducing the crosstalk between the images seen by the two eyes. Description of the Drawings

[0044] To more clearly illustrate the technical solutions and advantages in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0045] Figure 1 It is a schematic diagram of an application environment provided by an embodiment of the present application;

[0046] Figure 2 It is a schematic diagram of a head-up display system provided by an embodiment of the present application;

[0047] Figure 3 It is a schematic diagram of light splitting of a cylindrical lens provided by an embodiment of the present application;

[0048] Figure 4 It is a schematic diagram of imaging of a naked-eye 3D image provided by an embodiment of the present application;

[0049] Figure 5 It is a schematic diagram of image display of a head-up display system provided by an embodiment of the present application;

[0050] Figure 6 It is a schematic diagram of image crosstalk existing in a head-up display system provided by an embodiment of the present application;

[0051] Figure 7 It is a schematic flow diagram of an image display method based on a head-up display system provided by an embodiment of the present application;

[0052] Figure 8 It is a schematic diagram of the optical path of a head-up display system provided by an embodiment of the present application;

[0053] Figure 9 It is a schematic diagram of comparison between an image to be displayed and a virtual image provided by an embodiment of the present application;

[0054] Figure 10 It is a schematic diagram of inverse distortion processing of an image to be displayed provided by an embodiment of the present application;

[0055] Figure 11 It is a schematic diagram of obtaining a first image by performing inverse distortion processing on a first image to be displayed and obtaining a second image by performing inverse distortion processing on a second image to be displayed provided by an embodiment of the present application;

[0056] Figure 12 It is a schematic diagram of an image generation component provided by an embodiment of the present application;

[0057] Figure 13 It is a schematic structural diagram of an image display device of a head-up display system provided by an embodiment of the present application;

[0058] Figure 14 It is a schematic hardware structure diagram of an electronic device for implementing the image display method of the head-up display system provided by an embodiment of the present application. Detailed implementation manners

[0059] To make the objectives, technical solutions, and advantages of this application more clear, the following will further describe the embodiments of this application in detail with reference to the accompanying drawings. Obviously, the described embodiments are only one embodiment of this application, rather than all embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in this application without creative efforts fall within the scope of protection of this application.

[0060] As used herein, an "embodiment" refers to a specific feature, structure, or characteristic that may be included in at least one implementation manner of this application. In the description of the embodiments of this application, it should be understood that terms such as "first", "second", and "third" are only used for descriptive purposes and cannot be construed as indicating or implying relative importance or implicitly specifying the quantity of the indicated technical features. Thus, features defined with "first", "second", and "third" etc. may explicitly or implicitly include one or more of such features. Moreover, terms such as "first", "second", and "third" etc. are used to distinguish similar objects and do not necessarily need to be used to describe a specific order or sequence. It should be understood that such data can be interchanged under appropriate circumstances so that the embodiments of this application described herein can be implemented in an order other than that illustrated or described herein. In addition, terms such as "include", "have", and "be" and any variations thereof are intended to cover non-exclusive inclusion.

[0061] Please refer to Figure 1 , Figure 1 which is a schematic diagram of an application environment provided by an embodiment of this application. The application environment can be a vehicle, and a head-up display system can be set on the vehicle, and an image display method of the head-up display system can be implemented. The head-up display system is a comprehensive electronic device including devices such as electronic components, display components, and controllers, and can project information such as vehicle speed, navigation information, and warning information in the form of images and characters into the driver's field of vision through optical components.

[0062] Please refer to Figure 2 , Figure 2 which is a schematic diagram of a head-up display system provided by an embodiment of this application. The head-up display system, also known as a Head Up Display (HUD), can include an image generation component, a lenticular grating, an optical component, and an imaging component. Among them, the image generation component can include an image source and a liquid crystal display screen. The lenticular grating can be attached to the liquid crystal display screen, and the relative position between the lenticular grating and the liquid crystal display screen can be parallel or inclined. The optical component can be a mirror component, and the mirror component can include a first mirror and a second mirror. The first mirror can be a plane mirror or a curved mirror. The second mirror can be a free-form surface mirror. The imaging component can be a window, that is, a windshield. Please refer to Figure 3 , Figure 3It is a schematic diagram of light splitting of a cylindrical lens provided by an embodiment of the present application. The lenticular grating can be used to change the exit direction of the imaging light emitted by the liquid crystal display screen, realizing light splitting, so that a part of the imaging light emitted by the liquid crystal display screen enters the user's left eye, and a part of the imaging light enters the user's right eye. Specifically, after the light of adjacent display units in the liquid crystal display screen is refracted by the lenticular grating, the exit angles are different.

[0063] Please refer to Figure 4 , Figure 4 It is a schematic diagram of the imaging of a naked-eye 3D image provided by an embodiment of the present application. The implementation principle of the naked-eye 3D image is to perform optical design on the head-up display system, so that the user's left eye sees the image P1 through the imaging component, and the right eye sees the image P2. Since the images P1 and P2 are two images with parallax, the object seen by the user has a sense of depth and space, and a three-dimensional picture with a sense of depth is synthesized in the user's brain. The characteristic of the naked-eye 3D image is that by changing the position between the two images viewed by the user and adjusting the binocular parallax, the virtual image distance felt subjectively by the user can be changed. In fact, the virtual image distance remains unchanged. The closer the two images are, the closer the virtual image distance felt subjectively by the user is. On the contrary, the farther the two images are, the farther the virtual image distance felt subjectively by the user is.

[0064] Please refer to Figure 5 , Figure 5 It is a schematic diagram of image display of a head-up display system provided by an embodiment of the present application. The imaging component of the head-up display system, such as the windshield, that is, the display range of the head-up display system can include an augmented reality area, that is, the AR area, and a non-augmented reality area, that is, the W area. Among them, the augmented reality navigation image and the augmented reality warning image can be displayed in the augmented reality area, that is, the AR area. Among them, the augmented reality navigation image can display different navigation images and animations according to the distance between the vehicle and the intersection ahead, turn-by-turn (TBT) signals, such as The augmented reality warning image can be "-", and it can display different colors according to the distance between the vehicle and the vehicle ahead. The augmented reality warning image can be "Δ", and it can display different colors according to the distance between the vehicle and the pedestrian. The augmented reality warning image can be It can display different colors according to the distance between the vehicle and the lane line. And the vehicle speed, speed limit, the distance between the vehicle and the front camera, turn-by-turn (TBT), lane line selection information, some advanced driver assistance system (ADAS) information, and navigation thumbnail can be displayed in the non-augmented reality area, that is, the W area.

[0065] Please refer to Figure 6 ,Figure 6 It is a schematic diagram of image crosstalk existing in a head-up display system provided by an embodiment of the present application. Among them, the eyebox area is divided into 4 eyebox partitions e1, e2, e3, and e4, and the distance between the user's two eyes is the width of two eyebox partitions. Assume that when the user's left eye is located within the eyebox partition e1, the right eye is located within the eyebox partition e3. It is preset that the left eye sees the image P1 and the right eye sees the image P2. However, when the user changes the head posture, for example, when the user turns the head to the left, the positions of the user's two eyes change, and the position of the left eye exceeds the original eyebox area. Again, when the user turns the head to the right, the positions of the user's two eyes change, and the position of the right eye exceeds the original eyebox area. Since the eyebox area is not strictly divided, images may also be seen in the area beyond the eyebox area. Moreover, according to the optical design of the HUD, it is considered that the divided eyebox area is periodically repeated. Therefore, the image actually seen by the left eye may be the image P2 for the right eye. When the right eye moves from the eyebox partition e3 to the eyebox partition e2, the actual image seen by the right eye may be the image P1 for the left eye, thus causing crosstalk between the images seen by the user's left and right eyes and affecting the user experience.

[0066] In order to improve the user experience and avoid crosstalk between the images seen by the user's left and right eyes, the present application provides an image display method based on a head-up display system.

[0067] The following introduces a specific embodiment of an image display method based on a head-up display system of the present application. Please refer to Figure 7 , Figure 7 It is a schematic flowchart of an image display method based on a head-up display system provided by an embodiment of the present application. This specification provides the method operation steps as shown in the embodiment or flowchart, but based on routine or non-creative labor, it may include more or fewer operation steps. The step order listed in the embodiment is only one of many execution orders and does not represent the only execution order. In actual execution, it can be executed in the method order shown in the embodiment or the drawings or executed in parallel (for example, in an environment of parallel processors or multi-threaded processing).

[0068] As Figure 7 shown, the image display method based on the head-up display system may include:

[0069] S701: Detect the positions of the user's two eyes, determine the eyebox area based on the detected binocular position data, and determine a first target eyebox partition and a second target eyebox partition from multiple eyebox partitions of the eyebox area.

[0070] In the embodiments of the present application, before implementing the image display method of the head-up display system, the eye box area can be partitioned according to the parameters of the lenticular grating to obtain multiple eye box partitions. That is, the eye box partitions are obtained by partitioning the eye box area based on the optical parameters of the lenticular grating and the image generation component. Among them, the target eye box partition can also be referred to as the effective viewing area. The target eye box partition can refer to the eye box area based on the partitioning process, the eye box partition into which the left eye falls, or the eye box partition into which the right eye falls. The eye box partition into which the left eye falls can be called the first target eye box partition, and the eye box partition into which the right eye falls can be called the second target eye box partition. By real-time detecting the positions of the user's binoculars and determining the target eye box partitions, that is, the effective viewing areas, in the eye box area, the images given to the binoculars can be adjusted in real time, which can improve the display accuracy and enhance the user experience.

[0071] Among them, the optical parameters of the lenticular grating and the image generation component can be the number of sub-pixels in the liquid crystal display screen covered by the width of one columnar lens in the lenticular grating, or the surface shape of the lenticular grating, the thickness of the columnar lens, the refractive index of the columnar lens material, the refractive index of the glue between the columnar lenses, the thickness of the glue, and the optical parameters of the liquid crystal display screen, such as the thickness and refractive index of each layer involved between the filter of the liquid crystal display screen and the upper surface of the liquid crystal display screen. In some alternative embodiments, the eye box area can be divided based on the following principle to obtain multiple eye box partitions:

[0072] For example, according to the number of sub-pixels in the liquid crystal display screen covered by the width of one columnar lens in the lenticular grating when designing a 3D HUD (equivalent to taking several sub-pixels in the liquid crystal display screen as a complete pixel), the eye box partition scheme can be determined. In other words, the width of one columnar lens in the lenticular grating can be designed to cover several image generation sub-units in the liquid crystal display screen, which is equivalent to taking several pixel areas in the liquid crystal display screen as a complete pixel. Among them, one image generation sub-unit can be one pixel of the liquid crystal display screen.

[0073] Optionally, when partitioning the eye box area, the eye box area can be partitioned based on the number of image generation sub-units covered by the width of each columnar lens in the lenticular grating to obtain multiple eye box partitions. Among them, the eye box partitions can be periodically repeated. For example, if the width of one columnar lens covers 4 image generation sub-units in the liquid crystal display screen, the eye box area can be divided into 4 eye box partitions. If the width of one columnar lens covers 5 image generation sub-units in the liquid crystal display screen, the eye box area can be divided into 5 eye box partitions. Optionally, the number of eye box partitions can be greater than 3 and not an integer multiple of 3. And, in order to avoid too severe resolution compression of the virtual image on the imaging component, it is usually selected to divide the eye box area into 4 eye box partitions or 5 eye box partitions.

[0074] In some alternative embodiments, the eye box region may also be partitioned according to the surface profile of the lenticular grating, the thickness of the cylindrical lens, the refractive index of the cylindrical lens material, the refractive index of the glue between the cylindrical lenses, the thickness of the glue, and the optical parameters of the liquid crystal display screen, such as the thickness and refractive index of each layer involved between the filter of the liquid crystal display screen and the upper surface of the liquid crystal display screen, to obtain a plurality of eye box partitions. For example, if the width of one cylindrical lens can cover 4 image generation sub-units in the liquid crystal display screen, the eye box region can be divided into 2(2 + 4*n) eye box partitions, where n = 0, 1, 2, 3... If the width of one cylindrical lens can cover 5 image generation sub-units in the liquid crystal display screen, the eye box region can be divided into 2(2.5 + 5*n) eye box partitions, where n = 0, 1, 2, 3...

[0075] S703: Obtain a first image and a second image, extract the first color information of each pixel in the first image, and extract the second color information of each pixel in the second image; at least some of the image elements of the first image are the same as some of the image elements of the second image.

[0076] In an alternative embodiment, the first image may be a pre-set image for the user's left eye to see, and the second image may be a pre-set image for the user's right eye to see. After obtaining the first image and the second image, color extraction processing may be performed on the first image to obtain the first color information of each pixel in the first image, and at the same time, color extraction processing may be performed on the second image to obtain the second color information of each pixel in the second image.

[0077] In an alternative embodiment, the first image may be an image obtained after inverse distortion processing of a pre-set image for the user's left eye to see, and the second image may be an image obtained after inverse distortion processing of a pre-set image for the user's right eye to see.

[0078] Please refer to Figure 8 , Figure 8 is a schematic optical path diagram of a head-up display system provided by an embodiment of the present application. The head-up display system HUD belongs to an off-axis virtual image imaging display system. The imaging light exits from the surface of the liquid crystal display screen, is reflected by a flat mirror once, a curved mirror once, and then enters the human eye after being reflected by the windshield. Since the surface profiles of the curved mirror and the windshield are both high-order free-form surfaces, there is a large optical distortion in the head-up display system.

[0079] Please refer to Figure 9 , Figure 9It is a schematic diagram for comparing a to-be-displayed image and a virtual image provided by an embodiment of the present application. For example, a standard 26*16 dot matrix image as shown in 9a can be used for calibration, and a dot matrix virtual image as shown in 9b can be observed at the binocular positions. It can be seen that the dot matrix virtual image 9b has obvious distortion relative to the standard dot matrix image 9a, including compression, tilt, and irregular torque.

[0080] Therefore, in order to avoid the difference between the virtual image effect seen by the user and the to-be-displayed image due to the optical distortion existing in the head-up display system, and even the distortion affecting the user experience, in some alternative embodiments, the to-be-displayed image can be adjusted, and inverse distortion processing can be performed on the to-be-displayed image, and then the image after the inverse distortion processing is displayed through the image generation component of the HUD, so that finally the virtual image seen by the user has no distortion compared with the to-be-displayed image. In other words, the purpose of performing inverse distortion on the to-be-displayed image is to process the preset image for the user to see, that is, the to-be-displayed image, in advance to offset the optical distortion of the head-up display system, so that normal and regular virtual images can be seen by both eyes.

[0081] Please refer to Figure 10 , Figure 10 It is a schematic diagram for performing inverse distortion processing on a to-be-displayed image provided by an embodiment of the present application. In the head-up display system, the image F0 generated by the liquid crystal display screen is distorted into a virtual image F1 and collected by both eyes. Assume that the image F0 generated by the liquid crystal display screen is transformed into the virtual image F1 through the distortion A, then the inverse distortion process can be called A -1 transformation. Since there is a one-to-one mapping relationship between the feature points of the image F0 generated by the liquid crystal display screen and the virtual image F1, therefore, according to this mapping relationship, the inverse of the mapping matrix can be obtained to process the to-be-displayed image and eliminate the optical distortion.

[0082] In the embodiment of the present application, a first to-be-displayed image and a second to-be-displayed image can be obtained. Among them, the first to-be-displayed image can be a preset image in which the imaging light is incident on the first target eye box partition, that is, the image preset for the user's left eye to see, and the second to-be-displayed image can be a preset image in which the imaging light is incident on the second target eye box partition, that is, the image preset for the user's right eye to see. Then, based on the image mapping information between the to-be-displayed image and the virtual image, inverse distortion processing can be performed on the first to-be-displayed image and the second to-be-displayed image respectively to obtain a first image and a second image. Then, color extraction processing can be performed on the first image to obtain the first color information of each pixel in the first image, and at the same time, color extraction processing can be performed on the second image to obtain the second color information of each pixel in the second image. By performing inverse distortion processing on the to-be-displayed image to obtain an image, it can make the virtual images seen by both eyes have no distortion relative to the image generated by the liquid crystal display screen, improve the image display effect, and enhance the user experience.

[0083] S705: Determine the set of first image generation subunit corresponding to each pixel in the first image and the set of second image generation subunit corresponding to each pixel in the second image from the image generation component.

[0084] In the embodiments of the present application, the set of first image generation units corresponding to each pixel in the first image can be determined from the image generation component, and based on the first position information, the set of first image generation subunits corresponding to each pixel in the first image can be determined from the set of first image generation units. Wherein, the first position information can be the position information between the image generation component and the lenticular grating, or can be understood as the number of image generation subunits in the liquid crystal display screen covered by the width of a lenticular lens in the lenticular grating.

[0085] In the embodiments of the present application, the image generation component can include a plurality of image generation units, the plurality of image generation units can be arranged in an array, each image generation unit can include a plurality of image generation subunits, and the plurality of image generation subunits can be arranged in an array.

[0086] In some alternative embodiments, for each pixel in the first image, the first target row corresponding to each pixel in the first image can be determined from the array of image generation units based on the first position information between the image generation component and the lenticular grating and the second position information of each pixel in the first image. Then, based on the first position information between the image generation component and the lenticular grating, the set of first associated rows of the first target row can be determined from the array of image generation units. The first target row and the associated rows in the set of first associated rows can be consecutive rows in the array of image generation units. Next, the set of first image generation units corresponding to the pixel can be determined from the plurality of image generation units in the first target row and the plurality of image generation units in each associated row.

[0087] In some alternative embodiments, the set of first candidate image generation subunits corresponding to the pixel can be determined from the plurality of first image generation unit sets in the first target row based on the first position information between the image generation component and the lenticular grating. And, the set of second candidate image generation subunits corresponding to the pixel can be determined from the plurality of first image generation units in each associated row. Then, the set of first image generation subunits corresponding to the pixel can be obtained by integrating the set of first candidate image generation subunits and the set of second candidate image generation subunits.

[0088] In some alternative embodiments, for each pixel in the second image, based on the first position information between the image generation component and the lenticular grating and the second position information of each pixel in the second image, the second target row corresponding to each pixel in the second image can be determined from the array of image generation units. Then, based on the first position information between the image generation component and the lenticular grating, the second associated row set of the second target row can be determined from the array of image generation units. The second target row and the associated rows in the second associated row set can be consecutive rows in the array of image generation units. Next, the second image generation unit set corresponding to the pixel can be determined from the multiple image generation units of the second target row and the multiple image generation units of each associated row.

[0089] In some alternative embodiments, based on the first position information between the image generation component and the lenticular grating, the third candidate image generation subunit set corresponding to the pixel can be determined from the multiple second image generation unit sets of the second target row. And, the fourth candidate image generation subunit set corresponding to the pixel can be determined from the multiple second image generation units of each associated row. Then, the third candidate image generation subunit set and the fourth candidate image generation subunit set can be integrated to obtain the second image generation subunit set corresponding to the pixel.

[0090] S707: Determine the first display parameters of the first image generation subunit set corresponding to each pixel according to the first color information of each pixel in the first image, and determine the second display parameters of the second image generation subunit set corresponding to each pixel according to the second color information of each pixel in the second image.

[0091] In the embodiments of the present application, the first display parameter is used to indicate that the first image generation subunit set corresponding to each pixel in the first image is in a light-emitting state, and emits imaging light that matches the color information of the corresponding pixel, is split by the lenticular grating, and is incident on the first target eyebox partition after being reflected by the imaging component. The second display parameter is used to indicate that the second image generation subunit set corresponding to each pixel in the second image is in a light-emitting state, and emits imaging light that matches the color information of the corresponding pixel, is split by the lenticular grating, and is incident on the second target eyebox partition after being reflected by the imaging component.

[0092] Figure 11 It is a schematic diagram of obtaining a first image by performing inverse distortion processing on a first image to be displayed and obtaining a second image by performing inverse distortion processing on a second image to be displayed according to the embodiments of the present application. Figure 12 It is a schematic diagram of an image generation component provided by the embodiments of the present application.

[0093] As Figure 11As shown, the pixel P110 in the first image to be displayed P1 corresponds to the pixel P110' in the first image P1', the pixel P111 in the first image to be displayed P1 corresponds to the pixel P111' in the first image P1', the pixel P120 in the first image to be displayed P1 corresponds to the pixel P120' in the first image P1', and so on. The pixel P210 in the second image to be displayed P2 corresponds to the pixel P210' in the second image P1', the pixel P211 in the second image to be displayed P2 corresponds to the pixel P211' in the second image P2', the pixel P220 in the second image to be displayed P2 corresponds to the pixel P220' in the second image P2', and so on. Then, the RGB pixel values of each pixel in the first image P1' can be extracted, and the RGB pixel values of each pixel in the second image P2' can be extracted.

[0094] As Figure 12 shown, the image generation component may include a plurality of image generation units, such as Figure 12 the image generation unit 1 enclosed by the dashed line and containing R11, G11, B11, R12, the image generation unit 2 enclosed by the dashed line and containing G12, B12, R13, G13, the image generation unit 3 enclosed by the dashed line and containing R21, G21, B21, R22... The plurality of image generation units may be arranged in an array. Each image generation unit may include a plurality of image generation subunits, and the plurality of image generation subunits may be arranged in an array. For example, the image generation unit 1 may include the image generation subunits R11, G11, B11, R12, the image generation unit 2 may include the image generation subunits G12, B12, R13, G13, and the image generation unit 3 may include the image generation subunits R21, G21, B21, R22.

[0095] In the embodiment of the present application, the first set of image generation subunits may include a first candidate image generation subunit, a second candidate image generation subunit, and a third candidate image generation subunit. Among them, the first candidate image generation subunit, the second candidate image generation subunit, and the third candidate image generation subunit may be located in different image generation units. As Figure 12 shown, the first candidate image generation subunit may be R11, the second candidate image generation subunit may be G12, and the third candidate image generation subunit may be B13. Among them, the first candidate image generation subunit may be located in the image generation unit 1, and the second candidate image generation subunit may be located in the image generation unit 2.

[0096] In some alternative embodiments, for the first color information of each pixel in the first image, the first sub-display parameter of the first candidate image generation subunit may be determined according to the first sub-color information in the first color information, the second sub-display parameter of the second candidate image generation subunit may be determined according to the second sub-color information in the first color information, and the third sub-display parameter of the third candidate image generation subunit may be determined according to the third sub-color information in the first color information. As Figure 11 shown, for pixel P110’, the first display parameter of the first candidate image generation subunit R11 may be determined according to the red R value in the RGB color information of pixel P110’, and this first display parameter is used to indicate that the first candidate image generation subunit R11 emits imaging light corresponding to the red R value. Moreover, the second display parameter of the second candidate image generation subunit G12 may be determined according to the green G value in the RGB color information of pixel P110’, and this second display parameter is used to indicate that the second candidate image generation subunit G12 emits imaging light corresponding to the green G value. The third display parameter of the third candidate image generation subunit B13 may be determined according to the blue B value in the RGB color information of pixel P110’, and this third display parameter is used to indicate that the third candidate image generation subunit B13 emits imaging light corresponding to the blue B value.

[0097] S709: Control the image display of each image generation subunit in the first image generation subunit set according to the first display parameter, and control the image display of each image generation subunit in the second image generation subunit set according to the second display parameter.

[0098] By using the image display method of the head-up display system provided in the embodiments of the present application, the determination accuracy of the display parameter can be improved by detecting the distribution of both eyes in the eye box area in real time. Moreover, by determining the display parameter of each image generation subunit according to the color information of each pixel in the image that is desired to be seen by both eyes in advance, it is possible to enable both eyes to see the corresponding preset images respectively and reduce the crosstalk between the images seen by both eyes.

[0099] For the convenience of understanding, a specific example is given below to illustrate the above-mentioned image display method of the head-up display system.

[0100] Suppose that the relative position of the lenticular grating and the liquid crystal display screen is parallel, and one cylindrical lens in the lenticular grating covers 4 image generation subunits. It is detected that the left eye is located at the center position of the eye box partition e1, and the right eye is located at the center position of the eye box partition e3. The resolutions of the first image to be displayed and the second image to be displayed are both 320*160. Since the resolution is compressed by 4 times from the generated image of the liquid crystal display screen to the virtual image, the resolution of the generated image of the liquid crystal display screen can be 1280*640.

[0101] AsFigure 11 As shown, the pixel P110 in the first image to be displayed P1 corresponds to the pixel P110' in the first image P1', the pixel P111 in the first image to be displayed P1 corresponds to the pixel P111' in the first image P1', the pixel P120 in the first image to be displayed P1 corresponds to the pixel P120' in the first image P1', and so on. The pixel P210 in the second image to be displayed P2 corresponds to the pixel P210' in the second image P1', the pixel P211 in the second image to be displayed P2 corresponds to the pixel P211' in the second image P2', the pixel P220 in the second image to be displayed P2 corresponds to the pixel P220' in the second image P2', and so on. Then, the RGB pixel values of each pixel in the first image P1' can be extracted, and the RGB pixel values of each pixel in the second image P2' can be extracted.

[0102] Next, taking the first pixel P110' in the upper left corner of the first image P1' and the first pixel P210' in the upper left corner of the second image P2' as examples, the method for determining the display parameters of the image generation subunit in the image generation component will be introduced.

[0103] As Figure 12As shown in the figure, since the first pixel P110' is located in the first row of the first image P1', the L1 row in the array of the image generation unit can be used as the first target row of the pixel P110'. Moreover, since the width of one cylindrical lens in the cylindrical lens grating covers 4 image generation subunits, the L2 to L4 rows in the array of the image generation unit can be used as the first associated row set of the pixel P110'. Since it is detected that the left eye is located at the center position of the eye box partition e1 and the right eye is located at the center position of the eye box partition e3, the first candidate image generation subunit set corresponding to the pixel P110' can be determined from the L1 row, that is, R11, G12, and B13. And the second candidate image generation subunit set corresponding to the pixel P110' can be determined from the L2 row, that is, R21, G22, and B23, the second candidate image generation subunit set corresponding to the pixel P110' can be determined from the L3 row, that is, R31, G32, and B33, and the second candidate image generation subunit set corresponding to the pixel P110' can be determined from the L4 row, that is, R41, G42, and B43, to obtain the first image generation subunit set {R11, G12, B13, R21, G22, B23, R31, G32, B33, R41, G42, B43} corresponding to the pixel P110'. Then, R11, R21, R31, and R41 can be controlled to be in the light-emitting state and emit imaging light corresponding to the red pixel value, that is, the R pixel value, in the pixel P110', G12, G22, G32, and G42 can be controlled to be in the light-emitting state and emit imaging light corresponding to the green pixel value, that is, the G pixel value, in the pixel P110', and B12, B22, B32, and B42 can be controlled to be in the light-emitting state and emit imaging light corresponding to the blue pixel value, that is, the B pixel value, in the pixel P110'. At the same time, the image generation subunit set {G11, B12, R14} corresponding to the eye box partition e2 is controlled to display black, and the image generation subunit set {R12, G13, B14} corresponding to the eye box partition e4 also displays black. For the pixel P210', the same method can be adopted. B11, B21, B31, and B41 can be controlled to be in the light-emitting state and emit imaging light corresponding to the blue pixel value, that is, the B pixel value, in the pixel P210', R13, R23, R33, and R43 can be controlled to be in the light-emitting state and emit imaging light corresponding to the red pixel value, that is, the R pixel value, in the pixel P210', and G14, G24, G34, and G44 can be controlled to be in the light-emitting state and emit imaging light corresponding to the green pixel value, that is, the G pixel value, in the pixel P210'.

[0104] The image display device of a head-up display system provided by an embodiment of the present application Figure 13It is a schematic structural diagram of an image display device of a head-up display system provided by an embodiment of the present application. Among them, the head-up display system includes an image generation component, a lenticular grating, an optical component, and a window. The head-up display system is configured to make the imaging light emitted by the image generation component be split by the lenticular grating and reflected by the optical component to form a virtual image on the window and be incident into the eye box area of both eyes.

[0105] As Figure 13 shown, the image display device of the head-up display system may include:

[0106] A detection module 1301, configured to detect the positions of both eyes of a user, determine the eye box area based on the detected binocular position data, and determine a first target eye box partition and a second target eye box partition from multiple eye box partitions of the eye box area; the eye box partitions are obtained by partitioning the eye box area based on the optical parameters of the lenticular grating and the image generation component;

[0107] An acquisition module 1303, configured to acquire a first image and a second image, extract first color information of each pixel in the first image, and extract second color information of each pixel in the second image; at least some image elements of the first image are the same as some image elements of the second image;

[0108] A first determination module 1305, configured to determine a first set of image generation sub-units corresponding to each pixel in the first image and a second set of image generation sub-units corresponding to each pixel in the second image from the image generation component;

[0109] A second determination module 1307, configured to determine first display parameters of the first set of image generation sub-units corresponding to each pixel according to the first color information of each pixel in the first image, and determine second display parameters of the second set of image generation sub-units corresponding to each pixel according to the second color information of each pixel in the second image;

[0110] A control module 1309, configured to control the image display of each image generation sub-unit in the first set of image generation sub-units according to the first display parameters, and control the image display of each image generation sub-unit in the second set of image generation sub-units according to the second display parameters;

[0111] Among them, the first display parameters are used to indicate that the first set of image generation sub-units corresponding to each pixel in the first image is in a light-emitting state, and emit imaging light that matches the color information of the corresponding pixel, is split by the lenticular grating, and is reflected by the imaging component and incident into the first target eye box partition;

[0112] The second display parameter is used to indicate that the second image generation subunit sets corresponding to the pixels in the second image are in a light-emitting state, and emit imaging light that matches the color information of the corresponding pixels, is split by a lenticular grating, and is incident on the second target eyebox partition after being reflected by an imaging component.

[0113] In some alternative embodiments, an acquisition module is configured to acquire a first image to be displayed and a second image to be displayed; the first image to be displayed is a pre-set image for incident imaging light on a first target eyebox partition, and the second image to be displayed is a pre-set image for incident imaging light on a second target eyebox partition.

[0114] Based on the image mapping information between the image to be displayed and the virtual image, perform inverse distortion processing on the first image to be displayed and the second image to be displayed respectively to obtain a first image and a second image.

[0115] Perform color extraction processing on the first image to obtain first color information of each pixel in the first image, and perform color extraction processing on the second image to obtain second color information of each pixel in the second image.

[0116] In some alternative embodiments, the first determination module includes:

[0117] A first determination sub-module is configured to determine, from an image generation component, a first image generation unit set corresponding to each pixel in the first image.

[0118] A second determination sub-module is configured to determine, based on first position information, a first image generation subunit set corresponding to each pixel in the first image from the first image generation unit set; the first position information is the position information between the image generation component and the lenticular grating.

[0119] In some alternative embodiments, the image generation component includes a plurality of image generation units, the plurality of image generation units are arranged in an array, each image generation unit includes a plurality of image generation subunits, and the plurality of image generation subunits are arranged in an array.

[0120] The first determination sub-module is configured to, for each pixel in the first image, determine a first target row corresponding to the pixel from the array of image generation units based on the first position information and second position information; the second position information is the position information of the pixel in the first image.

[0121] Based on the first position information, determine a first associated row set of the first target row from the array of image generation units; the first target row and the associated rows in the first associated row set are consecutive rows in the array of image generation units.

[0122] Determine a first image generation unit set corresponding to the pixel from the plurality of image generation units of the first target row and the plurality of image generation units of each associated row.

[0123] In some alternative embodiments, the second determination sub-module is configured to determine a first candidate image generation sub-unit set corresponding to a pixel from a plurality of first image generation unit sets of a first target row based on the first position information;

[0124] Determine a second candidate image generation sub-unit set corresponding to the pixel from a plurality of first image generation units of each associated row; the first candidate image generation sub-units in the first candidate image generation sub-unit set and the second candidate image generation sub-units in the second candidate image generation sub-unit set are located in the same column of the array of image generation units;

[0125] Integrate and process the first candidate image generation sub-unit set and the second candidate image generation sub-unit set to obtain a first image generation sub-unit set corresponding to the pixel.

[0126] In some alternative embodiments, the first image generation sub-unit set includes a first candidate image generation sub-unit, a second candidate image generation sub-unit, and a third candidate image generation sub-unit, and the first candidate image generation sub-unit, the second candidate image generation sub-unit, and the third candidate image generation sub-unit are located in different image generation units;

[0127] The second determination module is configured to, for the first color information of each pixel in the first image, determine a first sub-display parameter of the first candidate image generation sub-unit according to a first sub-color information in the first color information;

[0128] Determine a second sub-display parameter of the second candidate image generation sub-unit according to a second sub-color information in the first color information;

[0129] Determine a third sub-display parameter of the third candidate image generation sub-unit according to a third sub-color information in the first color information.

[0130] The apparatus and method embodiments in this application are based on the same application concept.

[0131] An embodiment of this application provides an electronic device, which includes a processor and a memory. At least one instruction or at least one program segment is stored in the memory, and the at least one instruction or the at least one program segment is loaded and executed by the processor to implement the image display method of the head-up display system provided in the above method embodiment.

[0132] Figure 14 It is a schematic hardware structure diagram of an electronic device for implementing the image display method of the head-up display system provided in the embodiment of this application. The electronic device may participate in constituting or include the image display device of the head-up display system provided in the embodiment of this application. As Figure 14As shown, the electronic device may include one or more processors 1401 (shown as 1401a and 1401b in the figure) (the processor 1401 may include, but is not limited to, a microprocessor 1401MCU or a programmable logic device FPGA, etc.), a memory 1403 for storing data, and a transmission device 1405 for communication functions. In addition, it may further include: a display, an input / output interface (I / O interface), a universal serial bus (USB) port (which may be included as one of the ports of the I / O interface), a network interface, and / or a power supply. Those of ordinary skill in the art can understand that Figure 14 the structure shown is only schematic and does not limit the structure of the above-mentioned electronic device. For example, the electronic device may further include more or fewer components than Figure 14 shown in Figure 14 or have a different configuration from that shown.

[0133] It should be noted that the above one or more processors 1401 and / or other data processing circuits may generally be referred to as "data processing circuits" in this application. The data processing circuit may be embodied in software, hardware, firmware, or any combination thereof, in whole or in part. In addition, the data processing circuit may be a single independent processing module, or be incorporated in whole or in part into any one of the other elements in the electronic device (or mobile device). As involved in the embodiments of this application, the data processing circuit is used as a processor 1401 to control (for example, the selection of a variable resistance terminal path connected to an interface).

[0134] The memory 1403 may be used to store software programs and modules of application software, such as the program instructions / data storage device corresponding to the image display method of the head-up display system in the embodiments of this application. The processor 1401 runs the software programs and modules stored in the memory 1403 to perform various function applications and data processing, that is, to implement the above-mentioned image display method of a head-up display system. The memory 1403 may include a high-speed random access memory, and may also include a non-volatile random access memory 1403, such as one or more magnetic storage devices, flash memories, or other non-volatile solid-state memories 1403. In some possible embodiments, the memory 1403 may further include a memory 1403 that is remotely located relative to the processing unit, and these remote memories 1403 may be connected to the electronic device through a network. Examples of the above network include, but are not limited to, the Internet, an enterprise intranet, a local area network, a mobile communication network, and combinations thereof.

[0135] The transmission device 1405 is used to receive or send data via a network. Specific examples of the above-mentioned network may include a wireless network provided by a communication provider of an electronic device. In one example, the transmission device 1405 includes a network adapter (Network Interface Controller, NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device 1405 may be a Radio Frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0136] The display can be, for example, a touch-screen liquid crystal display (LED), which enables a user to interact with the user interface of the electronic device (or mobile device).

[0137] An embodiment of the present application provides a computer-readable storage medium, which can be disposed in an electronic device to store at least one instruction or at least one segment of a program related to an image display method for a head-up display system in a method embodiment. The at least one instruction or the at least one segment of the program is loaded and executed by the processor to implement the image display method for the head-up display system provided in the above method embodiment.

[0138] Optionally, in this embodiment, the above storage medium may be located in at least one of multiple network servers in a computer network. Optionally, in this embodiment, the above storage medium may include, but is not limited to: various media that can store program codes such as a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk, or an optical disc.

[0139] It should be noted that: the above sequence of embodiments of the present application is only for description and does not represent the superiority or inferiority of the embodiments. Moreover, the above description of specific embodiments is provided in this specification, and other embodiments are also within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be executed in the order of different embodiments and can achieve the expected results. Additionally, the processes depicted in the drawings do not necessarily require a specific order or connection order to achieve the desired results. In some embodiments, multi-task parallel processing is also possible or may be advantageous.

[0140] Each embodiment in this specification is described in a progressive manner. For the same or similar parts among the embodiments, reference can be made to each other, and the key points of each embodiment are the differences from other embodiments. In particular, for the embodiments of the device and the electronic device, since they are based on the method embodiments and are similar, the description is relatively simple, and reference can be made to the relevant parts of the method embodiments for the relevant content.

[0141] The above is the preferred embodiment of the present invention. It should be noted that for those of ordinary skill in the art, without departing from the principle of the present invention, several improvements and modifications can be made, and these improvements and modifications are also regarded as the protection scope of the present invention.

Claims

1. An image display method for a head-up display system, the head-up display system comprising an image generation component, a lenticular grating, an optical component, and a window, the head-up display system being configured to cause imaging light emitted by the image generation component to be split by the lenticular grating and reflected by the optical component to form a virtual image on the window and enter the eye box region of both eyes, characterized in that, including: detecting the positions of the user's two eyes and determining the target eye box partitions of the two eyes in the eye box region; determining the eye box region based on the detected binocular position data and determining a first target eye box partition and a second target eye box partition from multiple eye box partitions of the eye box region; the eye box partitions are obtained by partitioning the eye box region based on the optical parameters of the cylindrical lens grating and the image generation component; acquiring a first image and a second image, and extracting first color information of each pixel in the first image and second color information of each pixel in the second image, including: acquiring a first image to be displayed and a second image to be displayed; the first image to be displayed is a pre-set image in which imaging light is incident on the first target eye box partition, and the second image to be displayed is a pre-set image in which imaging light is incident on the second target eye box partition; performing inverse distortion processing on the first image to be displayed and the second image to be displayed respectively based on the image mapping information between the image to be displayed and the virtual image to obtain the first image and the second image; performing color extraction processing on the first image to obtain first color information of each pixel in the first image, and performing color extraction processing on the second image to obtain second color information of each pixel in the second image; at least some image elements of the first image are the same as some image elements of the second image; determining a first set of image generation subunits corresponding to each pixel in the first image and a second set of image generation subunits corresponding to each pixel in the second image from the image generation component; determining first display parameters of the first set of image generation subunits corresponding to each pixel according to the first color information of each pixel in the first image, and determining second display parameters of the second set of image generation subunits corresponding to each pixel according to the second color information of each pixel in the second image; controlling the image display of each image generation subunit in the first set of image generation subunits according to the first display parameters, and controlling the image display of each image generation subunit in the second set of image generation subunits according to the second display parameters; wherein, the first display parameters are used to indicate that the first set of image generation subunits corresponding to each pixel in the first image is in a light-emitting state, and emits imaging light that matches the color information of the corresponding pixel, is split by the cylindrical lens grating, and is incident on the first target eye box partition after being reflected by the imaging component; the second display parameters are used to indicate that the second set of image generation subunits corresponding to each pixel in the second image is in a light-emitting state, and emits imaging light that matches the color information of the corresponding pixel, is split by the cylindrical lens grating, and is incident on the second target eye box partition after being reflected by the imaging component.

2. The method according to claim 1, characterized in that, The determining the first set of image generation subunits corresponding to each pixel in the first image from the image generation component includes: determining the first set of image generation units corresponding to each pixel in the first image from the image generation component; Based on the first position information, determine a first set of image generation subunits corresponding to each pixel in the first image from the first set of image generation units; the first position information is the position information between the image generation component and the lenticular grating.

3. The method according to claim 2, wherein The image generation component includes a plurality of image generation units, the plurality of image generation units are arranged in an array, each image generation unit includes a plurality of image generation subunits, and the plurality of image generation subunits are arranged in an array; Determining the first set of image generation units corresponding to each pixel in the first image from the image generation component includes: For each pixel in the first image, based on the first position information and the second position information, determine a first target row corresponding to the pixel from the array of image generation units; the second position information is the position information of the pixel in the first image; Based on the first position information, determine a first set of associated rows of the first target row from the array of image generation units; the first target row and the associated rows in the first set of associated rows are consecutive rows in the array of image generation units; Determine the first set of image generation units corresponding to the pixel from the plurality of image generation units in the first target row and the plurality of image generation units in each associated row.

4. The method according to claim 3, wherein Determining the first set of image generation subunits corresponding to each pixel in the first image from the first set of image generation units includes: Based on the first position information, determine a first set of candidate image generation subunits corresponding to the pixel from the plurality of first sets of image generation units in the first target row; Determine a second set of candidate image generation subunits corresponding to the pixel from the plurality of first image generation units in each associated row; the first candidate image generation subunits in the first set of candidate image generation subunits and the second candidate image generation subunits in the second set of candidate image generation subunits are in the same column of the array of image generation subunits; Perform an integration process on the first set of candidate image generation subunits and the second set of candidate image generation subunits to obtain the first set of image generation subunits corresponding to the pixel.

5. The method according to claim 2, wherein The first set of image generation subunits includes a first candidate image generation subunit, a second candidate image generation subunit, and a third candidate image generation subunit, and the first candidate image generation subunit, the second candidate image generation subunit, and the third candidate image generation subunit are in different image generation units; Determining the first display parameters of the first set of image generation subunits corresponding to each pixel according to the first color information of each pixel in the first image includes: For the first color information of each pixel in the first image, determine the first sub-display parameter of the first candidate image generation subunit according to the first sub-color information in the first color information; Determine the second sub-display parameter of the second candidate image generation subunit according to the second sub-color information in the first color information; Determine the third sub-display parameter of the third candidate image generation subunit according to the third sub-color information in the first color information.

6. An image display device for a head-up display system, the head-up display system comprising an image generation component, a lenticular grating, an optical component, and a window, the head-up display system being configured to cause imaging light emitted by the image generation component to be split by the lenticular grating, reflected by the optical component, form a virtual image on the window, and be incident on the eye box region of both eyes, characterized in that, Includes: A detection module, configured to detect the positions of the user's two eyes and determine the target eye box partitions of the two eyes in the eye box region; Based on the detected binocular position data, determine the eye box region and determine the first target eye box partition and the second target eye box partition from multiple eye box partitions of the eye box region; The eye box partitions are obtained by partitioning the eye box region based on the optical parameters of the cylindrical lens grating and the image generation component; An acquisition module, configured to acquire a first image and a second image, extract the first color information of each pixel in the first image, and extract the second color information of each pixel in the second image, including: Acquire a first image to be displayed and a second image to be displayed; the first image to be displayed is a pre-set image in which imaging light is incident on the first target eye box partition, and the second image to be displayed is a pre-set image in which imaging light is incident on the second target eye box partition; Based on the image mapping information between the image to be displayed and the virtual image, perform inverse distortion processing on the first image to be displayed and the second image to be displayed respectively to obtain the first image and the second image; Perform color extraction processing on the first image to obtain the first color information of each pixel in the first image, and perform color extraction processing on the second image to obtain the second color information of each pixel in the second image; At least some image elements of the first image are the same as some image elements of the second image; A first determination module, configured to determine a first set of image generation subunits corresponding to each pixel in the first image and a second set of image generation subunits corresponding to each pixel in the second image from the image generation component; A second determination module, configured to determine the first display parameters of the first set of image generation subunits corresponding to each pixel according to the first color information of each pixel in the first image, and determine the second display parameters of the second set of image generation subunits corresponding to each pixel according to the second color information of each pixel in the second image; A control module, configured to control the image display of each image generation subunit in the first set of image generation subunits according to the first display parameters, and control the image display of each image generation subunit in the second set of image generation subunits according to the second display parameters; Wherein, the first display parameter is used to indicate that the first set of image generation subunits corresponding to each pixel in the first image is in a light-emitting state, and emits imaging light that matches the color information of the corresponding pixel, is split by the cylindrical lens grating, and is incident on the first target eye box partition after being reflected by the imaging component; The second display parameter is used to indicate that the second set of image generation subunits corresponding to each pixel in the second image is in a light-emitting state, and emits imaging light that matches the color information of the corresponding pixel, is split by the cylindrical lens grating, and is incident on the second target eye box partition after being reflected by the imaging component.

7. An electronic device, characterized in that, The electronic device includes a processor and a memory. At least one instruction or at least one program segment is stored in the memory, and the at least one instruction or the at least one program segment is loaded and executed by the processor to implement the image display method of the head-up display system according to any one of claims 1-5.

8. A computer storage medium, characterized in that, At least one instruction or at least one program segment is stored in the storage medium, and the at least one instruction or the at least one program segment is loaded and executed by a processor to implement the image display method of the head-up display system according to any one of claims 1-5.

9. A computer program product, characterized in that, The computer program product includes at least one instruction or at least one program segment, and the at least one instruction or the at least one program segment is loaded and executed by a processor to implement the image display method of the head-up display system according to any one of claims 1-5.

Images