Image display method and apparatus, and electronic device and storage medium

Abstract

Disclosed in the present application are an image display method and apparatus, and an electronic device and a storage medium. The image display method may be applied to a head-up display device, wherein the head-up display device is in communication connection with an eye recognition device, and the head-up display device comprises a display screen and a light splitting element. The method comprises: acquiring the current eye position information of a target object, which eye position information is sent by an eye recognition device within the current period; on the basis of the current eye position information, determining whether eyes of the target object are outside the current eyebox partition, wherein the current eyebox partition is determined on the basis of eye position information of the target object within the previous period; when a determination result is yes, on the basis of the current eye position information, updating the current eyebox partition; and on the basis of a visual region corresponding to an updated left-eye eyebox partition in a display screen and a visual region corresponding to an updated right-eye eyebox partition in the display screen, displaying an image to be displayed. The present application enables a user to always view a three-dimensional effect image in an ideal state during movement.

Description

Image display method and device, electronic device, and storage medium

[0001] The present application claims priority to the Chinese patent application No. 202410880161.8, filed on July 2, 2024, to the Chinese Patent Office, the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD

[0002] The present application relates to the field of head-up display technology, and in particular to an image display method and device, an electronic device, and a storage medium. BACKGROUND

[0003] Naked eye 3D (3-dimension) display technology refers to a 3D display technology that allows users to directly enjoy three-dimensional images with naked eyes without wearing special 3D glasses, and presents a 3D effect. For example, by setting a slit grating or a cylindrical grating in front of a display screen, light emitted by the display screen is split by the slit grating or the cylindrical grating, and then refracted by an imaging structure to enter the left eye and the right eye of a driver, respectively. The images seen by the left eye and the right eye of the driver are different, forming binocular parallax, and a stereoscopic picture with depth is synthesized in the brain of the user, achieving a 3D viewing experience. However, a head-up display (HUD) itself is a non-uniform system, and there is distortion or processing tolerance. Even if the pixel pitch and the grating design are uniform, there will still be some differences, resulting in problems such as translation, tilting, and distortion of the images seen by the human eyes; for example, crosstalk between the images seen by the left eye and the right eye of the user.

[0004] The related technology mainly optimizes static scenes when dealing with the crosstalk problem of head-up display, that is, when the eyes of the user are located in a preset eyebox partition and remain relatively static, the system can effectively correct the corresponding visible area in the display screen to eliminate the image crosstalk phenomenon and ensure that the user obtains a clear and undisturbed visual experience. However, this solution faces severe challenges in dynamic environments, especially in complex driving situations.

[0005] In actual driving, the motion state of the user is highly dynamic and multidimensional, which means that the position of the eyes of the user frequently changes. This dynamic change makes it difficult to accurately maintain the correspondence between the preset eyebox partition and the preset visible area. Once the eyes of the user are out of the original preset range or move quickly, the original crosstalk correction mechanism may fail, resulting in that the left eye and the right eye start to receive image information that should be received by the other eye, that is, the crosstalk phenomenon occurs, which affects the accurate judgment of the road conditions and the reaction speed of the driver. SUMMARY

[0006] To solve the problems in the related art, the embodiments of the present application provide an image display method and device, electronic equipment and storage medium. The technical solutions are as follows:

[0007] In one aspect, an image display method is provided, applied to a head-up display device, the head-up display device being in communication connection with an eye recognition device, the head-up display device comprising a display screen and a light splitting element; the method comprising:

[0008] obtaining current eye position information of a target object sent by the eye recognition device in a current period, the current eye position information comprising a current left eye position and a current right eye position;

[0009] determining whether the eyes of the target object are out of a current eyebox partition based on the current eye position information, the current eyebox partition being determined based on eye position information of the target object in a previous period, the current eyebox partition comprising a left eye eyebox partition and a right eye eyebox partition;

[0010] in a case where the determination result is yes, updating the current eyebox partition based on the current eye position information;

[0011] respectively displaying a to-be-displayed image in a visual area corresponding to the left eye eyebox partition in the updated current eyebox partition and a visual area corresponding to the right eye eyebox partition in the updated current eyebox partition in the display screen, so that light rays emitted by the display screen form a left eye virtual image and a right eye virtual image after being split by the light splitting element; the visual area is provided with display units arranged in an array, and each display unit corresponds to display a sub-pixel in the to-be-displayed image.

[0012] In another aspect, an image display device is provided, applied to a head-up display device, the head-up display device being in communication connection with an eye recognition device, the head-up display device comprising a display screen and a light splitting element; the device comprising:

[0013] a position obtaining module, configured to obtain current eye position information of a target object sent by the eye recognition device in a current period, the current eye position information comprising a current left eye position and a current right eye position;

[0014] a position determining module, configured to determine whether the eyes of the target object are out of a current eyebox partition based on the current eye position information, the current eyebox partition being determined based on eye position information of the target object in a previous period, the current eyebox partition comprising a left eye eyebox partition and a right eye eyebox partition;

[0015] an eyebox updating module, configured to, in a case where the determination result is yes, update the current eyebox partition based on the current eye position information;

[0016] The image display module is configured to display the to-be-displayed image based on the corresponding visual area of the left-eye eyebox partition in the updated current eyebox partition in the display screen and the corresponding visual area of the right-eye eyebox partition in the updated current eyebox partition in the display screen, respectively, so that the light emitted by the display screen forms left-eye and right-eye virtual images after being split by the light splitting element; the visual area is provided with display units arranged in an array, and each display unit corresponds to a sub-pixel of the to-be-displayed image.

[0017] In an example embodiment, the corresponding visual area of the eyebox partition in the display screen is formed by fusing the corresponding preset visual area of the eyebox partition in the display screen and the corresponding preset visual area of the adjacent eyebox partition of the eyebox partition in the display screen; the device further comprises a pixel adjustment module configured to adjust the sub-pixel corresponding to the display unit in the visual area corresponding to the eyebox partition where the target eye is located in the display screen when the target object's eye does not exceed the current eyebox partition, the pixel adjustment module comprising:

[0018] The target determination module is configured to, when the result of the judgment is no, determine the position information in the current eye position information that does not exceed the current eyebox partition to obtain the target eye and the target eye position.

[0019] The first boundary moving module is configured to move the fusion boundary in the visual area corresponding to the eyebox partition where the target eye is located in the display screen based on the target eye position, so that the sub-pixel corresponding to the display unit in the visual area is switched with the movement of the fusion boundary; the fusion boundary is the boundary between the corresponding preset visual area of the eyebox partition in the display screen and the corresponding preset visual area of the adjacent eyebox partition of the eyebox partition in the display screen in the visual area corresponding to the eyebox partition in the display screen.

[0020] In an example embodiment, the first boundary moving module comprises:

[0021] The change rate determination module is configured to determine the change rate of the target eye position based on the target eye position and the eye position corresponding to the target eye in the previous period.

[0022] The second boundary moving module is configured to move the fusion boundary in the visual area corresponding to the eyebox partition where the target eye is located in the display screen based on the target eye position and the change rate of the target eye position, so that the sub-pixel corresponding to the display unit in the visual area is switched with the movement of the fusion boundary.

[0023] In an exemplary embodiment, the position determining module comprises:

[0024] The range determining module is configured to determine whether the eyes of the target object are beyond the spatial range corresponding to the current eyebox partition based on the current eye position information.

[0025] In an exemplary embodiment, the device further comprises a first range determining module configured to determine the spatial range corresponding to each eyebox partition, and the first range determining module comprises:

[0026] The sampling point determining module is configured to determine, for each eyebox partition, a plurality of target sampling points corresponding to the eyebox partition based on a preset sampling density.

[0027] The sample display module is configured to display a sample image based on the visual area corresponding to the eyebox partition in the display screen.

[0028] The virtual image collecting module is configured to collect a virtual image at each target sampling point respectively.

[0029] The target virtual image module is configured to determine a virtual image in which crosstalk phenomenon exists in the virtual image corresponding to each target sampling point in the plurality of target sampling points, to obtain a plurality of target virtual images.

[0030] The boundary determining module is configured to determine a boundary point corresponding to the eyebox partition based on the relative positional relationship between the target sampling points corresponding to each target virtual image in the plurality of target virtual images; and the boundary point corresponding to the eyebox partition encloses the spatial range corresponding to the eyebox partition.

[0031] In an exemplary embodiment, the visual area corresponding to the eyebox partition in the display screen is obtained based on a correction of the preset visual area corresponding to the key points in the eyebox partition in the display screen; and the device further comprises a second range determining module configured to determine the spatial range corresponding to each eyebox partition, and the second range determining module comprises:

[0032] The adjacent determining module is configured to determine, for each eyebox partition in a plurality of continuously distributed eyebox partitions, a plurality of adjacent eyebox partitions corresponding to the eyebox partition.

[0033] The boundary point determining module is configured to determine, for each adjacent eyebox partition, a midpoint between the key points in the eyebox partition and the key points in the adjacent eyebox partition, to obtain a boundary point.

[0034] The boundary fitting module is configured to fit the boundary points corresponding to each adjacent eyebox partition in the plurality of adjacent eyebox partitions, to obtain the spatial range corresponding to the eyebox partition.

[0035] In another aspect, an electronic device is provided, including a processor and a memory having at least one instruction or at least one program stored therein, the at least one instruction or the at least one program being loaded and executed by the processor to implement the image display method of any of the above aspects.

[0036] In another aspect, a computer-readable storage medium is provided, having at least one instruction or at least one program stored therein, the at least one instruction or the at least one program being loaded and executed by a processor to implement the image display method of any of the above aspects.

[0037] In another aspect, a computer program product or computer program is provided, including computer instructions stored in a computer-readable storage medium. A processor of an electronic device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the electronic device to perform the image display method of any of the above aspects.

[0038] The embodiment of the present application establishes a communication connection with the eye recognition device, obtains the current eye position information of the target object in the current period, judges whether the eyes of the target object are out of the current eye box partition based on the current eye position information, and determines the current eye box partition based on the eye position information of the target object in the last period. In the case of yes, the current eye box partition is updated based on the current eye position information. The left eye image and the right eye image are displayed in the corresponding visual area of the display screen based on the updated left eye box partition and the corresponding visual area of the display screen based on the updated right eye box partition, respectively, so that the light emitted by the display screen forms the left eye virtual image and the right eye virtual image after being split by the light splitting element. By real-time acquisition of the eye position of the target object, the eye box partition where the eyes of the target object are located is updated in real time, and the to-be-displayed image is displayed in the corresponding visual area of the display screen based on the updated eye box partition, so that the user can always watch the three-dimensional effect image in the ideal state even if the eye position changes, and the crosstalk phenomenon can always be avoided, the judgment and reaction speed of the driver to the road conditions are improved, and strong protection is provided for driving safety. BRIEF DESCRIPTION OF DRAWINGS

[0039] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0040] FIG. 1 is a schematic diagram of an application environment of a head-up display device provided by the present application;

[0041] Fig. 2 is a schematic diagram of a head-up display device according to an embodiment of the present application;

[0042] Fig. 3 is a schematic diagram of a naked-eye 3D according to an embodiment of the present application;

[0043] Fig. 4 is a schematic diagram of a first pixel distribution according to an embodiment of the present application;

[0044] Fig. 5 is a schematic diagram of a second pixel distribution according to an embodiment of the present application;

[0045] Fig. 6 is a schematic diagram of a third pixel distribution according to an embodiment of the present application;

[0046] Fig. 7 is a schematic diagram of a fourth pixel distribution according to an embodiment of the present application;

[0047] Fig. 8 is a schematic diagram of an implementation environment of a method for determining a visible area according to an embodiment of the present application;

[0048] Fig. 9 is a schematic diagram of a method for determining a visible area according to an embodiment of the present application;

[0049] Fig. 10 is a schematic diagram of an eyebox partition according to an embodiment of the present application;

[0050] Fig. 11 is a schematic diagram of a change of a virtual image according to an embodiment of the present application;

[0051] Fig. 12 is a schematic diagram of an implementation environment of a method for displaying an image according to an embodiment of the present application;

[0052] Fig. 13 is a flowchart of a method for displaying an image according to an embodiment of the present application;

[0053] Fig. 14 is a schematic diagram of an eyebox partition corresponding to a virtual image according to an embodiment of the present application;

[0054] Fig. 15 is a schematic diagram of a method for displaying an image according to an embodiment of the present application;

[0055] Fig. 16 is a schematic diagram of a change of another virtual image according to an embodiment of the present application;

[0056] Fig. 17 is a schematic diagram of a method for displaying an image according to an embodiment of the present application;

[0057] Fig. 18 is a schematic diagram of a first method for moving a fusion boundary according to an embodiment of the present application;

[0058] Fig. 19 is a schematic diagram of a second method for moving a fusion boundary according to an embodiment of the present application;

[0059] Fig. 20 is a schematic diagram of a third method for moving a fusion boundary according to an embodiment of the present application;

[0060] FIG. 21 is a structural block diagram of an image display device according to an embodiment of the present application;

[0061] FIG. 22 is a hardware structural block diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0062] The technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art without creative work fall within the scope of protection of the present application.

[0063] It should be noted that the terms "first", "second", and the like in the specification and claims of the present application and the above-described drawings are used to distinguish similar objects, and do not necessarily indicate a specific order or a chronological sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, system, product, or server including a series of steps or units does not necessarily have to be limited to those steps or units clearly listed, but can include other steps or units not clearly listed or inherent to the process, method, product, or device.

[0064] It can be understood that in the specific embodiments of the present application, data related to user information and the like is involved, and when the above embodiments of the present application are applied to specific products or technologies, user permission or consent needs to be obtained, and the collection, use, and processing of related data need to comply with relevant laws, regulations, and standards in relevant countries and regions.

[0065] Please refer to FIG. 1, which shows an application environment schematic diagram of a head-up display device according to an embodiment of the present application. The head-up display device can be applied to a car as a driving assistance instrument, and can also be applied to other vehicles, such as an airplane, a high-speed train, and the like. In the following, a car-mounted HUD will be taken as an example to introduce the technical solutions of the present application. Through the image display method according to the embodiments of the present application, the HUD can clearly and accurately project the speed, navigation information, warning information, and the like in the form of images and characters to the front of the driver through optical components to form a virtual image with a stereoscopic effect in front of the driver's line of sight, and has a good imaging effect.

[0066] Please refer to FIG. 2, which shows a schematic diagram of a 3D HUD provided by an embodiment of the present application. The 3D HUD includes an image generating unit, a cylindrical lens grating (or a slit grating) attached to the image generating unit, a mirror assembly, and the like. The image generating unit is composed of an LCD (Liquid Crystal Display) and a backlight. The mirror assembly can include multiple mirrors, as shown in FIG. 2, which includes mirror 1 and mirror 2. Mirror 1 can be a plane mirror or a free-form curved mirror, and mirror 2 can be a free-form curved mirror. In the implementation of the 3D HUD, the outgoing light rays of the image generating unit pass through the cylindrical lens grating (or the slit grating) and are limited, and different outgoing angles are achieved to split the light. The light rays emitted by the cylindrical lens grating (or the slit grating) pass through the mirror assembly and the windshield of the vehicle in turn and are refracted, and then enter the left eye and the right eye of the user, respectively. The images seen by the left eye and the right eye of the user are different.

[0067] Please refer to FIG. 3, which shows a schematic diagram of a naked-eye 3D provided by an embodiment of the present application. The HUD is optically designed such that the left eye of the user sees image P1 and the right eye sees image P2. Image P1 and image P2 can be combined into a stereoscopic picture with a sense of depth in the brain of the user. By changing the positions of the two images and adjusting the binocular parallax, the subjective distance of the virtual image perceived by the user can be changed (in fact, the distance of the virtual image is constant). The closer the two images are, the closer the subjective distance of the virtual image perceived by the user is. Conversely, the farther the two images are, the farther the subjective distance of the virtual image perceived by the user is.

[0068] Please refer to FIG. 4, which shows a schematic diagram of a first pixel distribution provided by an embodiment of the present application. As shown in FIG. 4-1, it is a sub-pixel distribution mode of the image itself, and A1a-A1d correspond to the white image (L) viewed by the left eye, and the other four sub-pixels correspond to the black image (R) viewed by the right eye. The light emitted by the four sub-pixels can only meet the requirement of the left eye for consistent brightness. As shown in FIG. 4-2, it is used to illustrate the case when the cylindrical grating (or slit grating) and the display screen are relatively inclined. The inclination angle of the grating is arctan(1 / 3), so that the inclined grating matches the aspect ratio of the sub-pixel. The diagonal line of a certain sub-pixel is inclined to determine the distribution position of the pixel relative to the inclined grating. According to the distribution position, the image generated by the image generation unit of the HUD is determined. However, because the overall grating area is inclined to the right, if the integrity of the image on the display screen viewed by the user's eyes is required, it can be seen from FIG. 6-2 that the A2 row of sub-pixels is moved to the right by one sub-pixel relative to the overall A1 row, that is, the spatial position relative to the display screen is changed by one row, and the area viewed by the left eye is moved by one sub-pixel on the display screen, that is, the inclined pixel needs to be moved to the right by one sub-pixel every time it moves up one row, and to the left by one sub-pixel every time it moves down one row, so that the left eye always sees the left image and the right eye always sees the right image when viewed by the human eye.

[0069] Referring to FIGS. 5-7, which are schematic diagrams of a second pixel distribution, a third pixel distribution, and a fourth pixel distribution provided by embodiments of the present application, FIG. 5 shows the sub-pixel distribution manner and position of the image itself, in order to ensure that the left eye of the human eye always sees a complete left image and the right eye always sees a complete right image, the display screen is changed to achieve this effect. Specifically, because the positions of the 8 sub-pixels are different, the light rays emitted by the sub-pixels into the eyebox correspond to different eyebox partitions, and the image content information viewed by the human eye will be different. The sub-pixel distribution corresponds to the image displayed by the HUD in a one-to-one manner, and 8 images with different sub-pixel distribution states can be obtained. The 8 images are respectively the results of making the left and right eyes of the user see a pure white / black image at different positions in the eyebox, and one image corresponds to one sub-pixel distribution state. If the 8 sub-pixels correspond to S1-S8, the 8 positions of the 8 sub-pixels (i.e., the positions of the light rays emitted by the sub-pixels on the display screen) will be arranged in a periodic cycle with the image top starting point L1. With the image top starting point L1 as the reference center, the sub-pixel distribution arrangement is different when the starting point L1 is at any one of the positions S1-S8. For example, when the starting point L1 is at the S1 position, the sub-pixel distribution state is L1, L2, L3, L4, R1, R2, R3, and R4, which is the first sub-pixel distribution state. When the starting point L1 is at the S2 position, the sub-pixel distribution state is R4, L1, L2, L3, L4, R1, R2, and R3, which is the second distribution state. When the starting point is at the other 6 positions (S3-S8), the sub-pixel distribution state is sequentially arranged. That is, the starting point position is changed with a certain sub-pixel as the reference, and the relative position of the sub-pixel changes. With respect to the cylindrical grating (or slit grating) attached to the display screen, the corresponding light ray distribution also moves after the relative position of the sub-pixel changes. The white / black area that can be viewed by the left and right eyes of the human eye in the eyebox is different. From the image level, it is equivalent to moving one sub-pixel to the left for each row upwards and moving one sub-pixel to the right for each row downwards on the image frame of the 8 different images. That is, because the left and right eyes can only see a pure white / black image effect at a certain position in the eyebox, if the human eye moves left or right, image switching is required, and the distribution state of the remaining sub-pixels can be changed to ensure that the left eye sees a white image and the right eye sees a black image. Specifically, referring to FIG. 7, which is a schematic diagram of the specific arrangement of the 8 states of the image, L is the white image area viewed by the left eye, and R is the black image area viewed by the right eye.

[0070] Referring to FIG. 8, it shows an implementation environment schematic diagram of a visual area determination method provided by an embodiment of the present application. If a camera is placed at the center position of the eyebox partition, an actual representation of the distribution state image of 8 subpixels is shot. Taking the subpixel distribution state 4 in FIG. 7 as an example, a white image is given to the left eye. Theoretically, the center position of the eyebox partition is the best observation position of the user's eye. The user's left eye can see a full white image and the image brightness is uniform. Taking the pupil distance interval of 60-70mm as an example, the corresponding right eye sees a full black image in the corresponding complementary area (state 8) and the image is uniform. The actual image shot represents the virtual image seen by the human eye in the eyebox partition through the light splitting element of the HUD. However, due to the non-uniformity of the HUD, when the human eye is at the center position of the eyebox partition, the human eye cannot completely watch the pure black or pure white condition, but there is a little white on the left lower right upper and a little black, or even a gradual change from black to gray to white. This effect is exactly because the HUD distortion or processing tolerance causes the image black and white display to be not completely, that is, the left eye cannot completely watch the pure white picture of the left eye, but there is a little pure black picture of the right eye, which is the crosstalk phenomenon. The above crosstalk phenomenon not only occurs at the center position 5 of the eyebox partition, but also exists at the remaining positions of the eyebox partition.

[0071] Referring to FIG. 9, a schematic diagram of a method for determining a visible area according to an embodiment of the present application is shown. Assuming that the eyebox is divided into 8 sub-areas, e1-e8, the virtual images shown in state 1, state 2, state 3, and state 4, for e3, an actual performance picture of the sub-pixel distribution state is taken at e3, and actual performance pictures of the sub-pixel distribution state are taken at its adjacent e1, e2, and e4, the four virtual images are image fused to obtain the virtual image seen at e3, which is converted to the coordinate system of the display screen to obtain the corresponding visible area of e3 in the display screen. Referring to FIG. 10, a schematic diagram of an eyebox partition according to an embodiment of the present application is shown. Since the motion state of the user will not move only in one plane, the eye position will also change with the change of the motion state of the user, therefore, when defining the eyebox in the naked eye 3D technology, the eyebox is expanded in three dimensions, that is, a z-axis is added to the existing plane eyebox to define the front and back movement of the user's eyes. In a specific implementation, the size of a common eyebox is 130mm*50mm, which is expanded to 130mm*50mm*the width range of the front and back movement of the eyes. Specifically, taking a plane with a length and width of 130mm*50mm as an example, there are 9 eye position shooting reference points on the plane, and there are also 9 eye position shooting reference points on the front and back two planes, that is, there are 27 eye position shooting reference points on an eyebox. Specifically, when determining the visible area, the camera is placed at multiple positions in the eyebox of the HUD system, and the camera takes actual performance pictures of 8 sub-pixel distribution state images at the same position, and 27*8 pictures are obtained. The pictures represent the virtual image pictures seen by the human eye through the light splitting element of the HUD in the eyebox.

[0072] Referring to FIG. 11, a schematic diagram of a change of a virtual image according to an embodiment of the present application is shown. Taking the shooting at C5 position and the shooting at C6 position as an example, if 4 pictures are taken at C5 position and C6 position (equivalent to the right eye of the user moving from C5 position to C6 position), the image boundaries extracted according to the brightness do not change, the 4 pictures taken at C5 position can be spliced into a pure black picture according to the boundaries, but when the human eye moves to the right, the black and white stripes on the 4 pictures at C6 position move regularly with the movement of the human eye, and when the picture moves to a certain image, the black / white stripes will exceed the extracted boundaries, and the pictures taken at C6 position cannot be spliced into a pure black picture according to the fixed boundaries.

[0073] In view of this, the present application provides an image display method, applied to a head-up display device, the head-up display device being in communication connection with an eye recognition device, and the head-up display device comprising a display screen and a light splitting element. In specific implementation, please refer to FIG. 12, which shows an implementation environment schematic diagram of an image display method provided by an embodiment of the present application. The eye recognition device can be specifically set as a DMS (Driver Monitoring System, driver monitoring system). The installation position of the DMS is not specifically limited in the present application, and needs to meet the requirements that the DMS can be rigidly fixed between the human eye and the front windshield, does not block the line of sight of the human eye, and will not be blocked by the steering wheel or the body posture in driving.

[0074] Please refer to FIG. 13, which shows a flowchart of an image display method provided by an embodiment of the present application. It should be noted that the present specification provides method operation steps such as embodiments or flowcharts, but more or fewer operation steps can be included based on conventional or non-creative labor. The order of steps listed in the embodiments is only one of the many execution orders of the steps, and does not represent the only execution order. In actual system or product execution, the method order shown in the embodiments or the drawings can be executed in sequence or in parallel (for example, in a parallel processor or multi-threaded processing environment). Specifically, the method is applied to a head-up display device, the head-up display device being in communication connection with an eye recognition device, and the head-up display device comprising a display screen and a light splitting element; as shown in FIG. 13, the method can comprise:

[0075] S1301, obtaining current eye position information of a target object sent by the eye recognition device in a current period.

[0076] Wherein, the current period is a period for detecting the eye position of the target object. Specifically, in the working process of the head-up display device, the eye recognition device detects the eye position of the target object in a period and sends it to the head-up display device.

[0077] Wherein, the target object is a user currently using the head-up display device.

[0078] Wherein, the current eye position information comprises a current left eye position and a current right eye position. Specifically, the current left eye position represents coordinate information corresponding to the left eye of the target object, and the current right eye position represents coordinate information corresponding to the right eye of the target object.

[0079] S1303, judging whether the eyes of the target object are out of the current eye box partition based on the current eye position information.

[0080] Specifically, if the result of the judgment is no, step S1305 can be executed; otherwise, if the result of the judgment is yes, step S1309 can be executed.

[0081] The current eye box partition is determined based on the eye position information of the target object in the previous period, and the current eye box partition includes a left eye box partition and a right eye box partition. Specifically, the left eye box partition is the eye box partition in which the left eye of the target object is located, and the right eye box partition is the eye box partition in which the right eye of the target object is located.

[0082] Specifically, whether the left eye of the target object exceeds the left eye box partition is determined according to the current left eye position, and whether the left eye of the target object exceeds the right eye box partition is determined according to the current right eye position.

[0083] Specifically, if the eye of the target object exceeds the current eye box partition, the eye box partition in which the eye of the target object is located is re-determined according to the current eye position information; if the eye of the target object does not exceed the current eye box partition, the sub-pixels corresponding to the display units in the visual area corresponding to the current eye box partition in the display screen are adjusted according to the current eye position information.

[0084] In an exemplary embodiment, the above step S1303 can include the following steps:

[0085] It is determined whether the eye of the target object exceeds the spatial range corresponding to the current eye box partition based on the current eye position information.

[0086] Specifically, when the eye is in the spatial range corresponding to the eye box partition, no crosstalk phenomenon occurs when the image to be viewed by the eye is displayed in the visual area corresponding to the eye box partition in the display screen.

[0087] In a specific implementation, the visual area corresponding to each eye box partition in the display screen is corrected by the method shown in FIGS. 8-9. Specifically, for each preset visual area corresponding to each eye box partition in the display screen, the preset visual area corresponding to the adjacent eye box partition in the display screen is adjusted, which optimizes the display effect of the head-up display device, so that the user's eye can view the image intended for the left eye and the image intended for the right eye at any position of the eye box, and the crosstalk phenomenon can be avoided.

[0088] As can be seen from the above technical solutions of the embodiments of the present application, the embodiments of the present application limit the specific spatial range corresponding to the eye box partition, so as to determine whether the user's eye exceeds the current eye box partition and whether the eye box partition needs to be re-determined.

[0089] In an exemplary embodiment, the spatial range corresponding to the eye box partition can be determined by the following steps:

[0090] For each eye box partition, a plurality of target sampling points corresponding to the eye box partition are determined based on a preset sampling density.

[0091] Display the sample image in the corresponding visual area of the display screen based on the eyebox partition;

[0092] Collect the virtual image at each target sampling point respectively;

[0093] Determine the virtual image existing crosstalk phenomenon in the virtual image corresponding to each target sampling point in the plurality of target sampling points, to obtain a plurality of target virtual images;

[0094] Determine the boundary point corresponding to the eyebox partition based on the relative position relationship between the target sampling points corresponding to each target virtual image in the plurality of target virtual images; the boundary point corresponding to the eyebox partition circumscribes the spatial range corresponding to the eyebox partition.

[0095] The preset sampling density indicates the number of target sampling points in an eyebox partition.

[0096] The target virtual image is the virtual image existing crosstalk phenomenon.

[0097] Specifically, the image seen by the eye is used as the basis for judgment, that is, after the eye sees the virtual image without crosstalk at a position through image splicing, the eye moves in the eyebox until crosstalk appears in the visual image, and the coordinates of the eye at this time are recorded as the boundary point. In a specific implementation, a camera can be used instead of the eye to sample the virtual image.

[0098] Specifically, when the eye is in the spatial range corresponding to the eyebox partition, the image to be seen by the eye is displayed based on the visual area of the display screen corresponding to the eyebox partition, and no crosstalk phenomenon occurs.

[0099] As can be seen from the above technical solutions of the embodiments of the present application, the embodiments of the present application sample the virtual image in the eyebox partition, determine the spatial range corresponding to the eyebox partition according to the target sampling point corresponding to the virtual image existing crosstalk phenomenon, and use the spatial range as the basis for judging whether the user's eye exceeds the current eyebox partition, thereby improving the objectivity of the judgment and accurately determining the eyebox partition in which the user's eye is located.

[0100] In an exemplary embodiment, the visual area of the display screen corresponding to the eyebox partition is obtained by correcting the preset visual area of the display screen corresponding to the key point in the eyebox partition; the spatial range corresponding to the eyebox partition can also be determined by the following steps:

[0101] For each eyebox partition in the plurality of continuously distributed eyebox partitions, determine a plurality of adjacent eyebox partitions corresponding to the eyebox partition;

[0102] For each adjacent eyebox partition, determine the midpoint between the key point in the eyebox partition and the key point in the adjacent eyebox partition, to obtain the boundary point;

[0103] By fitting the boundary points corresponding to each adjacent eyebox partition in multiple adjacent eyebox partitions, the spatial range corresponding to the eyebox partition is obtained.

[0104] Among them, the multiple adjacent eye box sections corresponding to the eye box section are the eye box sections that are adjacent to the current eye box section.

[0105] In practice, the center point of each eye box partition is typically selected as the key point. The visible area of ​​each eye box partition on the display screen is corrected using the method shown in Figures 8 and 9. Specifically, for each eye box partition's preset visible area on the display screen, the preset visible area of ​​its adjacent eye box partitions is used for adjustment. In practice, virtual images are captured at the key points of the eye box partitions as mappings to the preset visible areas, and image fusion is performed to obtain the adjusted visible area. This optimizes the display effect of the head-up display device, enabling the user's left eye to see the image intended for the left eye and the right eye to see the image intended for the right eye from any position on the eye box, thus avoiding crosstalk.

[0106] Specifically, when the eye is within the space corresponding to the eye box partition, no crosstalk will occur when the image to be shown to the eye is displayed on the screen based on the corresponding visible area of ​​the eye box partition.

[0107] For example, there is position A in eyebox partition 1 and position B in eyebox partition 2. At position A (x1, y1, z1), a virtual image with the best fusion state can be acquired, and at position B (x2, y2, z2), another virtual image with the best fusion state can be acquired. Therefore, the midpoint of the two positions ((x1+x2) / 2, (y1+y2) / 2, (z1+z2) / 2) is taken as the boundary point between eyebox partition 1 and eyebox partition 2.

[0108] In practice, the spatial range corresponding to the eye box partitions can also be obtained based on optical theory design.

[0109] As can be seen from the above technical solutions of the embodiments of this application, the embodiments of this application obtain boundary points by determining the midpoint between the key points in the eye box partition and the key points in the adjacent eye box partitions, and fit the boundary points corresponding to each adjacent eye box partition in multiple adjacent eye box partitions to obtain the spatial range corresponding to the eye box partition, which serves as the basis for judging whether the user's eyes are outside the current eye box partition, thereby improving the objectivity of the judgment and accurately determining the eye box partition where the user's eyes are located.

[0110] S1305, update the current eye box partition based on the current eye position information.

[0111] Specifically, if the left eye of the target object exceeds the left eye eyebox partition, the left eye eyebox partition is re-determined based on the current left eye position; if the right eye of the target object exceeds the right eye eyebox partition, the right eye eyebox partition is re-determined based on the current right eye position.

[0112] S1307, respectively display the to-be-displayed image based on the corresponding visual area in the display screen of the left eye eyebox partition in the updated current eyebox partition and the corresponding visual area in the display screen of the right eye eyebox partition in the updated current eyebox partition, so that the light emitted by the display screen forms a left eye virtual image and a right eye virtual image after being split by the light splitting element.

[0113] The visual area is provided with display units arranged in an array, and each display unit corresponds to a sub-pixel in the to-be-displayed image. Specifically, when the left eye or the right eye of the target object is in a certain eyebox partition, the area covered by the display unit in the display screen corresponding to the pixel point in the virtual image seen by the left eye or the right eye of the target object is the corresponding visual area of the eyebox partition in the display screen.

[0114] In specific implementation, the corresponding visual area in the display screen of each eyebox partition is corrected by the method shown in FIGS. 8-9. Specifically, for the preset visual area in the display screen of each eyebox partition, the preset visual area in the display screen of the adjacent eyebox partition is used for adjustment, thereby optimizing the display effect of the head-up display device, enabling the user's eyes to see the image intended for the left eye and the image intended for the right eye at any position of the eyebox, and avoiding crosstalk.

[0115] The left eye eyebox partition in the updated current eyebox partition matches the current left eye position of the target object, and the right eye eyebox partition in the updated current eyebox partition matches the current right eye position of the target object.

[0116] Specifically, refer to FIGS. 14 and 15, which respectively show a schematic diagram of an eyebox partition corresponding virtual image provided by an embodiment of the application and a principle schematic diagram of an image display method provided by an embodiment of the application. The crosstalk-free virtual image shown in FIG. a can be seen at the eyebox partition e2, and the crosstalk-free virtual image shown in FIG. b can be seen at the eyebox partition e3. If the eye moves from e2 to e3, FIG. a needs to be switched to FIG. b, and the visual area in the display screen is adjusted, i.e., the visual area corresponding to e2 is adjusted to the visual area corresponding to e3.

[0117] S1309, determine the position information in the current eye position information that does not exceed the current eyebox partition, to obtain the target eye and the target eye position.

[0118] The target eye is an eye that does not exceed a corresponding eyebox partition in the current eyebox partition. Specifically, if the left eye of the target object does not exceed the left eyebox partition in the current eyebox partition, the left eye of the target object is the target eye; if the right eye of the target object does not exceed the right eyebox partition in the current eyebox partition, the right eye of the target object is the target eye; the target eye can include the left eye and the right eye of the target object at the same time.

[0119] The target eye position is the position of an eye that does not exceed a corresponding eyebox partition in the current eyebox partition. Specifically, if the left eye of the target object does not exceed the left eyebox partition in the current eyebox partition, the eye position is the current left eye position in the current eye position information; if the right eye of the target object does not exceed the right eyebox partition in the current eyebox partition, the eye position is the current right eye position in the current eye position information; the target eye position can include the current left eye position and the current right eye position of the target object at the same time.

[0120] S1311, based on the target eye position, moving the fusion boundary in the visible area corresponding to the eyebox partition where the target eye is located in the display screen, so that the sub-pixel corresponding to the display unit in the visible area is switched with the movement of the fusion boundary.

[0121] Specifically, please refer to FIG. 16, which shows another variation of the virtual image provided by the embodiment of the application. When the eye is located at the midpoint of e2 or e3, there is a luminance difference at the fusion boundary seen by the eye. When the eye moves from e2 to e3, the user will feel dizzy when switching from FIG. a to FIG. b, and it cannot be guaranteed whether crosstalk will occur during the switching process.

[0122] The visible area corresponding to the eyebox partition in the display screen is formed by fusing the preset visible area corresponding to the eyebox partition in the display screen and the preset visible area corresponding to the adjacent eyebox partition of the eyebox partition in the display screen.

[0123] The fusion boundary is the boundary between the preset visible area corresponding to the eyebox partition in the display screen and the preset visible area corresponding to the adjacent eyebox partition of the eyebox partition in the display screen in the visible area corresponding to the eyebox partition in the display screen. The fusion boundary can be a curve or a straight line, which is not limited here.

[0124] Specifically, the relative position relationship between the sub-pixel in the to-be-displayed image and the fusion boundary remains unchanged, and the sub-pixel moves with the movement of the fusion boundary, and the sub-pixel corresponding to the display unit in the visible area is switched.

[0125] In a specific implementation, the moving direction of the fusion boundary is not necessarily the same as the moving direction of the eye. For example, the eye moves to the left, and the fusion boundary moves to the right; the eye moves to the right, and the fusion boundary moves to the left; the eye moves to the left, and the fusion boundary moves to the left, etc.

[0126] Specifically, please refer to Figure 17, which shows a schematic diagram of another image display method provided in this application embodiment. During the process of the eye moving from e2 to e3, that is, switching from Figure a to Figure b, the fusion boundary in Figure a is moved towards the corresponding fusion boundary in Figure b. The specific moving distance is determined according to the eye's movement distance. That is, when the eye moves from left to right, the three fusion boundaries of the four regions also move along with the eye.

[0127] Specifically, please refer to Figure 18, which shows schematic diagrams illustrating the principles of three boundary fusion movement methods provided in embodiments of this application. The current eye position information is represented by coordinates (x...). D ,y D ,z D The corresponding fusion boundary coordinates of different camera positions are fitted to obtain the fusion boundary function f(x, y) related to the eye coordinates. This boundary can be a curve or a straight line, and no specific setting is required.

[0128] When the eye moves in the x-direction within the eye box, the fusion boundary is manifested as an x-direction offset in the image coordinate system, as shown in formula (1), where there is a moving rate scaling factor k1 and an initial offset b1: Δx = k1Δx D +b1 (1)

[0129] When the eye moves in the y-direction within the eye box, the fusion boundary is manifested as a y-direction offset in the image coordinate system. The offset relationship is shown in formula (2), where there is a moving rate scaling factor k2 and an initial offset b2: Δy = k2Δy D +b2 (2)

[0130] When the eye moves in the z-direction within the eye box, the fusion boundary is manifested as a y-direction offset in the image coordinate system, with changes in slope and intercept, as shown in formulas (3) to (7). The slope / initial offset in the x / y formula is affected by the z-coordinate, and the spacing between the boundaries on the x / y axes also changes. b1=k3△z D (3) or b2=k3△z D (4) k1=k4△z D +b3 (5) or k2=k4△z D +b3 (6) D=k5△zD +b4 (7)

[0131] Wherein, △x represents the moving distance of the fusion boundary in x direction, and △y represents the moving distance of the fusion boundary in y direction; k is a moving conversion factor, indicating that the image moves k in the corresponding direction of the image when moving 1 unit in the x / y / z axis; △x D , △y D , △z D respectively represent the moving distance of the eye in the x, y and z directions; D represents the intercept of the adjacent boundary in the x or y direction. As shown in FIG. 19, the intercept is narrowed, the slope is unchanged, and the fusion boundary is increased; as shown in FIG. 20, the intercept is unchanged, the slope is increased, and the fusion boundary is increased.

[0132] From the above technical solutions of the embodiments of the present application, it can be seen that the embodiments of the present application acquire the eye position of the target object in real time to update the eye box partition in which the eye of the target object is located in real time, display the to-be-displayed image in the corresponding visual area of the display screen based on the updated eye box partition, and lock the movement of the eye in the process of updating the eye box partition to move the fusion boundary in the visual area, so as to prevent the user from feeling dizzy or the crosstalk phenomenon from occurring in the process of switching the eye box partition, ensure that the user can always watch the three-dimensional effect image in the ideal state even if the eye position changes, and always prevent the crosstalk phenomenon, thereby improving the judgment and reaction speed of the driver to the road conditions and providing strong protection for driving safety.

[0133] In an exemplary embodiment, the above step S1311 can include the following steps:

[0134] Based on the target eye position and the eye position of the target eye corresponding to the last period, determine the change rate of the target eye position;

[0135] Based on the target eye position and the change rate of the target eye position, move the fusion boundary in the visual area corresponding to the eye box partition of the target eye in the display screen, so that the sub-pixel corresponding to the display unit in the visual area is switched with the movement of the fusion boundary.

[0136] Wherein, the change rate of the target eye position indicates the moving speed of the target eye.

[0137] Wherein, the visual area corresponding to the eye box partition in the display screen is formed by fusing the preset visual area corresponding to the eye box partition in the display screen and the preset visual area corresponding to the adjacent eye box partition of the eye box partition in the display screen.

[0138] The fusion boundary is a boundary between a preset visual area corresponding to the eyebox partition in the display screen and a preset visual area corresponding to an adjacent eyebox partition of the eyebox partition in the display screen.

[0139] Specifically, the relative position relationship between the sub-pixel in the to-be-displayed image and the fusion boundary is kept unchanged, and the sub-pixel is moved along with the movement of the fusion boundary, and the sub-pixel corresponding to the display unit in the visual area is switched along with the movement of the fusion boundary.

[0140] Specifically, the speed of left / right movement of the fusion boundary is calculated according to the movement speed of the eyes, and the fusion boundary is updated in real time.

[0141] It can be seen from the above technical solutions of the embodiments of the present application that the movement speed of the eyes of the user is determined, and the fusion boundary in the visual area is moved according to the position of the eyes and the movement speed of the eyes, so as to prevent the crosstalk phenomenon from occurring in the process of switching the eyebox partition, and the real-time performance of the movement of the fusion boundary is improved, and the dizziness of the user is further reduced.

[0142] Corresponding to the image display method provided in the above several embodiments, the embodiments of the present application also provide an image display device. Since the image display device provided by the embodiments of the present application corresponds to the image display method provided by the above several embodiments, the implementation manner of the foregoing image display method is also applicable to the image display device provided by the embodiments of the present application, which will not be described in detail in the embodiments.

[0143] Please refer to FIG. 21, which shows a structural schematic diagram of an image display device provided by the embodiments of the present application. The device has the function of implementing the image display method in the above method embodiments, which can be realized by hardware or by executing corresponding software by hardware. The device is applied to a head-up display device, the head-up display device is in communication connection with an eye recognition device, and the head-up display device includes a display screen and a light splitting element. As shown in FIG. 21, the device can include:

[0144] The position acquisition module 2110 is configured to acquire current eye position information of the target object sent by the eye recognition device in a current period, and the current eye position information includes a current left eye position and a current right eye position.

[0145] The position judgment module 2120 is configured to judge whether the eyes of the target object are out of a current eyebox partition based on the current eye position information. The current eyebox partition is determined based on the eye position information of the target object in a previous period, and the current eyebox partition includes a left eyebox partition and a right eyebox partition.

[0146] The eyebox updating module 2130 is configured to update the current eyebox partition based on the current eye position information if the result of the judgment is yes.

[0147] The image display module 2140 is configured to display the to-be-displayed image in the corresponding visual area in the display screen based on the left eyebox partition in the updated current eyebox partition and the corresponding visual area in the display screen based on the right eyebox partition in the updated current eyebox partition, so that the light emitted by the display screen forms a left eye virtual image and a right eye virtual image after being split by the light splitting element. The visual area is provided with display units arranged in an array, and each display unit corresponds to a sub-pixel in the to-be-displayed image.

[0148] In an example embodiment, the corresponding visual area in the display screen of the eyebox partition is formed by fusing the corresponding preset visual area in the display screen of the eyebox partition and the corresponding preset visual area in the display screen of the adjacent eyebox partition of the eyebox partition. The device further comprises a pixel adjustment module configured to adjust the sub-pixel corresponding to the display unit in the corresponding visual area in the display screen of the eyebox partition where the target eye is located if the eye of the target object does not exceed the current eyebox partition. The pixel adjustment module comprises:

[0149] The target determination module is configured to determine the position information in the current eye position information that does not exceed the current eyebox partition if the result of the judgment is no, and obtain the target eye and the target eye position.

[0150] The first boundary moving module is configured to move the fusion boundary in the corresponding visual area in the display screen of the eyebox partition where the target eye is located based on the target eye position, so that the sub-pixel corresponding to the display unit in the visual area is switched with the movement of the fusion boundary. The fusion boundary is the boundary between the corresponding preset visual area in the display screen of the eyebox partition and the corresponding preset visual area in the display screen of the adjacent eyebox partition of the eyebox partition in the corresponding visual area in the display screen of the eyebox partition.

[0151] In an example embodiment, the first boundary moving module comprises:

[0152] The change rate determination module is configured to determine the change rate of the target eye position based on the target eye position and the eye position corresponding to the target eye in the previous period.

[0153] The second boundary moving module is configured to move the fusion boundary in the corresponding visual area in the display screen of the eyebox partition where the target eye is located based on the target eye position and the change rate of the target eye position, so that the sub-pixel corresponding to the display unit in the visual area is switched with the movement of the fusion boundary.

[0154] In an example embodiment, the position judgment module comprises:

[0155] a range determining module configured to determine whether the eyes of the target object are out of a spatial range corresponding to the current eyebox partition based on the current eye position information.

[0156] In an exemplary embodiment, the device further comprises a first range determining module configured to determine the spatial range corresponding to each eyebox partition, the first range determining module comprising:

[0157] a sampling point determining module configured to determine, for each eyebox partition, a plurality of target sampling points corresponding to the eyebox partition based on a preset sampling density;

[0158] a sample displaying module configured to display a sample image based on the visual area corresponding to the eyebox partition in the display screen;

[0159] a virtual image collecting module configured to collect a virtual image at each target sampling point respectively;

[0160] a target virtual image module configured to determine a virtual image in which crosstalk phenomenon exists in the virtual image corresponding to each target sampling point in the plurality of target sampling points, to obtain a plurality of target virtual images;

[0161] a boundary determining module configured to determine a boundary point corresponding to the eyebox partition based on the relative positional relationship between the target sampling points corresponding to each target virtual image in the plurality of target virtual images; the boundary point corresponding to the eyebox partition circumscribes the spatial range corresponding to the eyebox partition.

[0162] In an exemplary embodiment, the visual area corresponding to the eyebox partition in the display screen is obtained based on a correction of the preset visual area corresponding to the key point in the eyebox partition in the display screen; the device further comprises a second range determining module configured to determine the spatial range corresponding to each eyebox partition, the second range determining module comprising:

[0163] a neighboring determining module configured to determine, for each eyebox partition in a plurality of continuously distributed eyebox partitions, a plurality of neighboring eyebox partitions corresponding to the eyebox partition;

[0164] a boundary point determining module configured to determine, for each neighboring eyebox partition, a midpoint between the key point in the eyebox partition and the key point in the neighboring eyebox partition, to obtain a boundary point;

[0165] a boundary fitting module configured to fit the boundary points corresponding to each neighboring eyebox partition in the plurality of neighboring eyebox partitions, to obtain the spatial range corresponding to the eyebox partition.

[0166] It should be noted that the apparatus provided by the above embodiments, in realizing its functions, only divides the above-mentioned various functional modules by way of example, and in actual application, the above-mentioned functions can be completed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the above-described functions. In addition, the apparatus and method embodiments provided by the above embodiments belong to the same concept, and the specific implementation process is detailed in the method embodiments, which will not be repeated here.

[0167] The electronic device provided in the embodiments of the present application includes a processor and a memory, and the memory stores at least one instruction or at least one program, which is loaded and executed by the processor to implement any one of the image display methods provided in the above method embodiments.

[0168] The memory can be used to store software programs and modules, and the processor executes various functional applications and data processing by running the software programs and modules stored in the memory. The memory can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, application programs required by functions, etc.; and the data storage area can store data created according to the use of the device, etc. In addition, the memory can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state memory device. Accordingly, the memory can also include a memory controller to provide access of the processor to the memory.

[0169] The method embodiments provided in the embodiments of the present application can be executed in a computer terminal, a server or a similar computing device, that is, the above-mentioned electronic device can include a computer terminal, a server or a similar computing device. FIG. 22 is a hardware structure block diagram of a computer device running an image display method according to an embodiment of the present application. As shown in FIG. 22, the internal structure of the computer device can include but is not limited to a processor, a network interface and a memory. Among them, the processor, the network interface and the memory in the computer device can be connected through a bus or other means, and in the diagram 22 shown in the embodiments of the present application, the connection through the bus is taken as an example.

[0170] The processor (or CPU (Central Processing Unit)) is the computing core and control core of the computer device. The network interface can optionally include a standard wired interface, a wireless interface (such as WI-FI, a mobile communication interface, etc.). The memory is a memory device in the computer device, used to store programs and data. It can be understood that the memory here can be a high-speed RAM memory device, or a non-volatile memory device (non-volatile memory), such as at least one disk storage device; optionally, it can also be at least one storage device located away from the aforementioned processor. The memory provides a storage space that stores the operating system of the electronic device, which can include but is not limited to: a Windows system (an operating system), a Linux (an operating system), an Android (a mobile operating system) system, an IOS (a mobile operating system) system, etc., and the present application does not limit this; and in the storage space, one or more instructions suitable for being loaded and executed by the processor are also stored, which can be one or more computer programs (including program codes). In the embodiment of the present application, the processor loads and executes one or more instructions stored in the memory to implement the image display method provided by the above method embodiment.

[0171] The embodiment of the present application also provides a computer readable storage medium, which can be arranged in an electronic device to save at least one instruction or at least one program related to an image display method, and the at least one instruction or the at least one program is loaded and executed by the processor to implement any one of the image display methods provided by the above method embodiments.

[0172] Optionally, in the present embodiment, the storage medium can include but is not limited to: a U disk, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk, and various media that can store program codes.

[0173] It should be noted that the above sequence of the embodiments of the present application is only for description, and does not represent the advantages and disadvantages of the embodiments. The above describes specific embodiments of the present application. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be executed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multi-task processing and parallel processing are possible or can be advantageous.

[0174] The various embodiments described in this specification are presented by way of example, and each embodiment is not necessarily composed of all features described with respect to other embodiments. Each embodiment is directed to the differentiating features from other embodiments. In particular, the device embodiments are described with less detail as they are substantially similar to the method embodiments.

[0175] It is understood by those skilled in the art that all or part of the steps of the above-mentioned embodiments can be completed by hardware, or by programs instructing relevant hardware, and the programs can be stored in a computer-readable storage medium. The storage medium mentioned above can be a read-only memory, a magnetic disk or an optical disk, etc.

Claims

1. An image display method applied to a head-up display device, the head-up display device being in communication connection with an eye recognition device, the head-up display device comprising a display screen and a light splitting element; the method comprising: obtaining current eye position information of a target object sent by the eye recognition device in a current period, the current eye position information comprising a current left eye position and a current right eye position; judging whether the eyes of the target object are out of a current eye box partition based on the current eye position information; the current eye box partition being determined based on eye position information of the target object in a previous period, the current eye box partition comprising a left eye box partition and a right eye box partition; in a case where the judging result is yes, updating the current eye box partition based on the current eye position information; respectively displaying a to-be-displayed image in a corresponding visual area of the left eye box partition in the updated current eye box partition and a corresponding visual area of the right eye box partition in the updated current eye box partition in the display screen, so that light emitted by the display screen forms a left eye virtual image and a right eye virtual image after being split by the light splitting element; the visual area being provided with display units arranged in an array, each of the display units corresponding to display a sub-pixel in the to-be-displayed image.

2. The image display method according to claim 1, wherein the corresponding visual area of the eye box partition in the display screen being formed by fusion of a corresponding preset visual area of the eye box partition in the display screen and a corresponding preset visual area of an adjacent eye box partition of the eye box partition in the display screen; the method further comprising: in a case where the judging result is no, determining position information in the current eye position information that does not exceed the current eye box partition, to obtain a target eye and a target eye position; moving a fusion boundary in a corresponding visual area of an eye box partition in which the target eye is located in the display screen based on the target eye position, so that a sub-pixel corresponding to the display unit in the visual area is switched with the movement of the fusion boundary; the fusion boundary being a boundary between a corresponding preset visual area of the eye box partition in the display screen and a corresponding preset visual area of an adjacent eye box partition of the eye box partition in the display screen in the corresponding visual area of the eye box partition in the display screen.

3. The image display method according to claim 2, wherein the moving of the fusion boundary in the corresponding visual area of the eye box partition in which the target eye is located in the display screen based on the target eye position, so that the sub-pixel corresponding to the display unit in the visual area is switched with the movement of the fusion boundary, comprising: determining a change rate of the target eye position based on the target eye position and a corresponding eye position of the target eye in the previous period; moving the fusion boundary in the corresponding visual area of the eye box partition in which the target eye is located in the display screen based on the target eye position and the change rate of the target eye position, so that the sub-pixel corresponding to the display unit in the visual area is switched with the movement of the fusion boundary.

4. The image display method according to claim 1, wherein The judging whether the eyes of the target object exceed a current eyebox partition based on the current eye position information comprises: The judging whether the eyes of the target object exceed a current eyebox partition based on the current eye position information comprises:

5. The image display method of claim 4, further comprising: For each eyebox partition, determining a plurality of target sampling points corresponding to the eyebox partition based on a preset sampling density; Displaying a sample image based on a visual area corresponding to the eyebox partition in the display screen; Respectively collecting a virtual image at each target sampling point; Determining a virtual image in which crosstalk phenomenon exists in the virtual image corresponding to each target sampling point in the plurality of target sampling points, to obtain a plurality of target virtual images; Determining a boundary point corresponding to the eyebox partition based on a relative positional relationship between target sampling points corresponding to each target virtual image in the plurality of target virtual images; The boundary point corresponding to the eyebox partition circumscribes the spatial range corresponding to the eyebox partition.

6. The image display method according to claim 4, wherein The visual area corresponding to the eyebox partition in the display screen is obtained based on a correction of a preset visual area corresponding to a key point in the eyebox partition in the display screen; The method further comprises: For each eyebox partition in a plurality of continuously distributed eyebox partitions, determining a plurality of adjacent eyebox partitions corresponding to the eyebox partition; For each adjacent eyebox partition, determining a midpoint between a key point in the eyebox partition and a key point in the adjacent eyebox partition to obtain a boundary point; Fitting the boundary points corresponding to each adjacent eyebox partition in the plurality of adjacent eyebox partitions to obtain the spatial range corresponding to the eyebox partition.

7. An image display device applied to a head-up display device, the head-up display device being in communication connection with an eye recognition device, the head-up display device comprising a display screen and a light splitting element; the device comprising: A position acquisition module configured to acquire current eye position information of a target object sent by the eye recognition device in a current period, the current eye position information comprising a current left eye position and a current right eye position; A position judging module configured to judge whether the eyes of the target object exceed a current eyebox partition based on the current eye position information; The current eyebox partition is determined based on eye position information of the target object in a previous period, and the current eyebox partition comprises a left eye eyebox partition and a right eye eyebox partition; An eyebox updating module configured to, in a case where the result of the judgment is yes, update the current eyebox partition based on the current eye position information; An image display module configured to display a to-be-displayed image in a visual area corresponding to the left eye eyebox partition in the updated current eyebox partition in the display screen and a visual area corresponding to the right eye eyebox partition in the updated current eyebox partition in the display screen, respectively, so that light emitted by the display screen forms a left eye virtual image and a right eye virtual image after being split by the light splitting element; The visual area is provided with display units arranged in an array, and each display unit corresponds to display a sub-pixel in the to-be-displayed image.

8. An electronic device comprising a processor and a memory, the memory having stored therein at least one instruction or at least one program, the at least one instruction or the at least one program being loaded and executed by the processor to implement the image display method according to any one of claims 1-6.

9. A computer-readable storage medium having stored therein at least one instruction or at least one program, the at least one instruction or the at least one program being loaded and executed by a processor to implement the image display method according to any one of claims 1-6.

10. A computer program which, when executed by a processor, implements the image display method according to any one of claims 1-6.

Images